JP2015036845A - Electronic device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which, during a touch operation with respect to a touch panel, a user cannot check an image located at a touch position.SOLUTION: An electronic device comprises a control unit that causes a touch position image to be displayed in a first area serving as one part of a display area including a position where the touch operation is performed during detection of a touch operation with respect to a display area of a motion image in a touch panel to be displayed in a second area different from the first area. While the touch operation with respect to the display area of the motion image in the touch panel is being detected, a program makes a computer execute a control step of causing the touch position image displayed in the first area serving as one part of display areas including the position where the touch operation is performed to be displayed in the second area different from the first area.

Description

  The present invention relates to an electronic device and a program.

While maintaining the touch panel operation, the imaging unit is controlled so as to continuously capture the subject image, and the imaging condition of the subject image is adjusted based on the image portion corresponding to the position of the touch panel receiving the operation. An apparatus is known (see, for example, Patent Document 1).
[Prior art documents]
[Patent Literature]
[Patent Document 1] Japanese Patent Application Laid-Open No. 2011-188057

  There is a problem that the user cannot confirm the image of the touch position on the touch panel while performing a touch operation on the touch panel.

  In the first aspect, the electronic device is displayed in the first area, which is a partial display area including the position where the touch operation is performed, while the touch operation is detected on the moving image display area on the touch panel. A control unit that displays the touched position image in a second area different from the first area.

  In the second aspect, the program is displayed in the first area which is a part of the display area including the position where the touch operation is performed while the touch operation is detected on the moving image display area on the touch panel. The computer is caused to execute a control step of displaying the touch position image in a second area different from the first area.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

An example of the usage scene of the camera system 5 is shown. An example of a block configuration of the camera 10 is shown. An example of the setting menu which selects the display place of a touch position image is shown. An example of the selection screen for selecting the display position of a subarea is shown. An example of the setting screen for setting the size and display magnification of a subarea is shown. An example of the setting screen for setting a touch imaging | photography mode is shown. An example of a display while the touch-off recording stop mode is set is schematically shown. An example of display when the retouch recording stop mode is set is schematically shown. An example of an operation flow in the camera 10 is shown. An example of an operation flow when performing a live view operation is shown. It is a detailed operation | movement flow which optimizes imaging | photography conditions with respect to a touch area | region.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Moreover, not all the combinations of features described in the embodiments are essential to the solving means of the invention.

  FIG. 1 shows an example of a usage scene of the camera system 5. The camera system 5 includes a camera 10 and a display device 11. The camera 10 has a touch panel 138. The display device 11 is detachably connected to the camera 10. When the display device 11 is connected to the camera 10, the camera 10 can display an image on the touch panel 138 and can display an image on the display device 11.

  On the touch panel 138, a moving image generated by imaging by the camera 10 is displayed. When a moving image captured by the camera 10 is displayed on the touch panel 138, when a touch operation on the touch panel 138 is detected, shooting conditions for the subject at the touch position are optimized and recording of moving image data is started. At this time, the camera 10 sets the sub area 50 at a position away from the touch position in the moving image display area 40 on the touch panel 138, and displays the touch position image, which is an image of the touch position, in the sub area 50. . The sub-area 50 is set at a position separated from the touch position by a predetermined distance or more so as not to be hidden by the user's finger. The touch position image is enlarged and displayed in the sub-area 50 at a display magnification set in advance by the user.

  As described above, the camera 10 is an image displayed in the first area which is a partial display area including the position where the touch operation is performed while the touch operation is detected on the moving image display area on the touch panel 138. A touch position image is displayed in a second area different from the first area. The sub area 50 corresponds to the second area. For this reason, the user can confirm the state of the subject at the touch position in the sub-area 50 while operating the touch panel 138 with a finger to specify the subject of interest.

  The sub area 50 is a partial display area in the moving image display area on the touch panel 138. However, the touch position image may be displayed on the display device 11. For example, instead of displaying the touch position image on the touch panel 138, the camera 10 may cause the display device 11 to display the touch position image. When a touch position image is displayed on the display device 11, the touch position image may be displayed in full screen on the display area of the display device 11. The display device 11 may display another display object superimposed on the touch position image. The display device 11 may include a display area for touch position images and a display area for other objects. The display device 11 may display the touch position image in the display area for touch position images and display other objects in other display areas.

  FIG. 2 shows an example of a block configuration of the camera 10. This figure shows a block configuration of the camera 10 with the lens unit 120 mounted.

  The lens unit 120 includes a lens mount having a lens mount contact 121. The camera body 130 includes a camera mount having a camera mount contact 131. When the lens mount and the camera mount are engaged and the lens unit 120 and the camera body 130 are integrated, the lens mount contact 121 and the camera mount contact 131 are connected. The lens MPU 123 is connected to the camera MPU 140 via the lens mount contact 121 and the camera mount contact 131, and controls the lens unit 120 in cooperation with each other while communicating with each other.

  The lens unit 120 includes a lens group 122, a lens driving unit 124, and a lens MPU 123. The subject light passes through the lens group 122 as an optical system of the lens unit 120 along the optical axis and enters the camera body 130. The main mirror 145 can take an advancing state where it has advanced into the subject light flux centered on the optical axis of the lens group 122 and a retracted state where it has been retracted from the subject light flux.

  When the main mirror 145 is in the advanced state, the main mirror 145 reflects a part of the subject light flux that has passed through the lens group 122. Specifically, the region near the optical axis of the main mirror 145 in the advanced position is formed as a half mirror. Part of the subject luminous flux incident on the region near the optical axis is transmitted and the other part is reflected. The subject luminous flux reflected by the main mirror 145 is guided to the finder unit 147 and observed by the user. The user can check the composition and the like through the finder unit 147. The finder unit 147 may include a display device that presents various types of information including information indicating the setting state of the imaging operation to the user, along with the subject image based on the subject luminous flux.

  Part of the subject luminous flux that has passed through the region near the optical axis of the main mirror 145 is reflected by the sub mirror 146 and guided to the AF unit 142. The AF unit 142 includes a plurality of photoelectric conversion element arrays that receive a subject light beam. The photoelectric conversion element array outputs a signal with a phase match when in a focused state, and outputs a signal with a phase shift when in a front pin state or a rear pin state. The amount of phase shift corresponds to the amount of shift from the focus state. The AF unit 142 detects a phase difference by performing a correlation operation on the output of the photoelectric conversion element array, and outputs a phase difference signal indicating the phase difference to the camera MPU 140.

  The focus state of the lens group 122 is adjusted using the phase difference signal from the AF unit 142 under the control of the camera MPU 140 and the like. For example, the target position of the focus lens included in the lens group 122 is determined by the camera MPU 140 based on the focus state detected from the phase difference signal, and the position of the focus lens is controlled by the control of the lens MPU 123 toward the determined target position. Is done. Specifically, the lens MPU 123 controls the lens driving unit 124 including a focus lens motor as an example, and moves the focus lens constituting the lens group 122. As described above, when the main mirror 145 is in the advanced state after being lowered, the focus state of the lens group 122 is detected by the phase difference detection method, and the focus adjustment is performed. The AF unit 142 is provided with photoelectric conversion element arrays at a plurality of positions respectively corresponding to the plurality of regions in order to adjust the focus state in each of the plurality of regions in the subject image.

  The photometric element 144 receives a part of the light beam guided to the optical viewfinder. The luminance information of the subject detected by the photoelectric conversion element included in the photometric element 144 is output to the camera MPU 140. The camera MPU 140 calculates an AE evaluation value based on the luminance information acquired from the photometric element 144 and uses it for exposure control.

  When the main mirror 145 retracts from the subject light beam, the sub mirror 146 retracts from the subject light beam in conjunction with the main mirror 145. A focal plane shutter 143 as an example of a mechanical shutter is provided on the lens group 122 side of the image sensor 132. When the main mirror 145 is in the retracted state and the focal plane shutter 143 is in the open state, the subject light flux that has passed through the lens group 122 is incident on the light receiving surface of the image sensor 132.

  The imaging element 132 functions as an imaging unit. The image sensor 132 captures an image of the subject using the subject light flux that has passed through the lens group 122. Examples of the image sensor 132 include a solid-state image sensor such as a CCD sensor or a CMOS sensor. The imaging element 132 has a plurality of photoelectric conversion elements that receive the subject light flux, and outputs an analog signal corresponding to the amount of accumulated charge generated by each of the plurality of photoelectric conversion elements to the analog processing unit 133. The analog processing unit 133 performs analog processing such as sensitivity correction processing and OB clamping processing on the analog signal output from the image sensor 132 and outputs the analog signal to the A / D converter 134. The A / D converter 134 converts the analog signal output from the analog processing unit 133 into a digital signal representing image data and outputs the digital signal. The image sensor 132, the analog processing unit 133, and the A / D converter 134 are driven by a driving unit 148 that receives an instruction from the camera MPU 140.

  Image data output as a digital signal from the A / D converter 134 is input to the ASIC 135. The ASIC 135 is an integrated circuit in which circuits related to the image processing function are integrated into one. The ASIC 135 uses at least a part of the memory area of the RAM 136 as an example of a volatile memory as a buffer area for temporarily storing image data, and performs various image processing on the image data stored in the RAM 136. Apply. Examples of the image processing by the ASIC 135 include defective pixel correction, white balance correction, color interpolation processing, color correction, gamma correction, contour enhancement processing, and image data compression processing. When the image sensor 132 continuously captures images, sequentially output image data is sequentially stored in the buffer area. A plurality of image data obtained by continuously capturing images by the image sensor 132 is sequentially stored in the buffer area as image data of continuous still images or image data of each image constituting the moving image. The RAM 136 also functions as a frame memory that temporarily stores frames when the ASIC 135 processes moving image data.

  Examples of image processing in the ASIC 135 include processing for generating image data for recording, processing for generating image data for display, and image data processing for automatic focus adjustment (AF). Further, the image processing in the ASIC 135 includes processing for detecting the contrast amount for AF processing and the like. Specifically, the ASIC 135 detects the contrast amount from the image data and supplies it to the camera MPU 140. For example, the ASIC 135 detects the contrast amount from each of a plurality of image data obtained by imaging with the focus lens positioned at different positions in the optical axis direction. The camera MPU 140 adjusts the focus state of the lens group 122 based on the detected contrast amount and the position of the focus lens. For example, the camera MPU 140 determines the target position of the focus lens so as to increase the amount of contrast, and causes the lens MPU 123 to control the position of the focus lens toward the determined target position. As described above, when the main mirror 145 is up and in the retracted state, the focus state of the lens group 122 is detected by the contrast detection method, and the focus adjustment is performed. As described above, the camera MPU 140 performs the focus adjustment of the lens group 122 in cooperation with the ASIC 135 and the lens MPU 123.

  When recording the image data output from the A / D converter 134, the ASIC 135 converts the image data into a standardized image format. For example, the ASIC 135 performs a compression process for generating still image data obtained by encoding still image data in an encoding format compliant with a standard such as JPEG. Further, the ASIC 135 converts a plurality of frames into QuickTime, H.264, and the like. H.264, MPEG2, Motion JPEG, etc. A compression process for generating moving image data encoded by an encoding method compliant with a standard such as JPEG is performed.

  The ASIC 135 outputs and records the generated image data such as still image data and moving image data to an external memory 180 as an example of a nonvolatile recording medium. For example, the ASIC 135 records in the external memory 180 as a still image file and a moving image file. An example of the external memory 180 is a semiconductor memory such as a flash memory. Specifically, as the external memory 180, various memory cards such as an SD memory card, a CF storage card, and an XQD memory card can be exemplified. The image data stored in the RAM 136 is transferred to the external memory 180 through the recording medium IF 150. Further, the image data recorded in the external memory 180 is transferred to the RAM 136 through the recording medium IF 150 and used for processing such as display. Examples of the recording medium IF 150 include a card controller that controls access to the above-described memory card. The image data stored in the RAM 136 is transferred to an external device such as a personal computer, a display device, and a printer through the external device IF 152. Further, image data recorded in an external device such as a personal computer is transferred to the RAM 136 through the external device IF 152 and used for processing such as display. Examples of the external device IF 152 include a USB controller and an HDMI (registered trademark) controller.

  The ASIC 135 generates display image data in parallel with the generation of recording image data. For example, the ASIC 135 generates display image data to be displayed on the display unit 168 such as a liquid crystal display device during a so-called live view operation. Further, at the time of image reproduction, the ASIC 135 generates image data for display from the image data read from the external memory 180. The generated display image data is converted into an analog signal under the control of the display control unit 137 and displayed on the display unit 168. In addition to the image display based on the image data obtained by imaging, the ASIC 135 and the display control unit also include objects for touch panels such as various menu items related to various settings of the camera 10 without displaying an image based on the image data. The image is displayed on the display unit 168 by being superposed under the control of 137.

  The display unit 168 is provided with a touch sensor 162 as a part of the touch panel 138. The display unit 168 and the touch sensor 162 function as the touch panel 138. The touch sensor 162 may be provided on substantially the entire surface of the display unit 168. As the touch sensor 162, touch sensors of various detection methods such as a resistive film method and a capacitance method can be applied. The output of the touch sensor 162 is output to the touch detection unit 160, the touch position is calculated in the touch detection unit 160, and is output to the camera MPU 140. For example, the touch detection unit 160 calculates the X coordinate and the Y coordinate of the touch position on the display unit 168 and supplies the calculated X coordinate and Y coordinate to the camera MPU 140. When the camera MPU 140 specifies a user instruction according to the coordinates of the touch position output from the touch detection unit 160 and the display content displayed on the display unit 168 and determines to accept a user operation on the display unit 168 In addition, 10 units are controlled in accordance with a user instruction. Accordingly, each part of the camera 10 can be controlled in accordance with an operation by the user's fingertip, pen, or the like on the touch panel 138.

  The operation input unit 141 receives an operation from the user. The operation input unit 141 includes a release button, a rotary operation member such as a multi-selector and a command dial, a button-type operation member such as a playback button and a movie button, a switch-type operation member such as a live view switch and a power switch, etc. Includes various operating members. The camera MPU 140 detects that the operation input unit 141 has been operated, and executes an operation corresponding to the operation. For example, the camera MPU 140 controls each part of the camera 10 so as to execute a focus position adjustment operation or a photographing operation when a release button is pressed.

  The camera 10 is controlled directly or indirectly by the camera MPU 140 and the ASIC 135 including the control described above. Constants, parameters such as variables, programs, and the like necessary for the operation of the camera 10 are stored in the system memory 139. The system memory 139 is an electrically erasable / storable nonvolatile memory, and is configured by, for example, a flash ROM, an EEPROM, or the like. The system memory 139 stores parameters, programs, and the like so that they are not lost even when the camera 10 is not operating. Parameters, programs, and the like stored in the system memory 139 are expanded in the RAM 136 and used for controlling the camera 10. The ASIC 135, the RAM 136, the system memory 139, the display control unit 137, the touch detection unit 160, and the camera MPU 140 in the camera main body 130 are connected to each other via a connection interface 149 such as a bus and exchange various data.

  Each part of the camera main body 130, each part of the lens unit 120, and the external memory 180 are supplied with power from the power supply 190 through the power supply circuit 192 under the control of the camera MPU 140. The power source 190 may be a secondary battery such as a nickel metal hydride battery or a lithium ion battery, a non-rechargeable primary battery such as a dry battery, or the like. A power source 190 as a battery is detachably attached to the camera body 130. The power source 190 may be a commercial power source.

  FIG. 3 shows an example of a setting menu 300 for selecting the display destination of the touch position image. The setting menu 300 includes a menu item 310 for selecting the touch panel 138 as a display destination, and a menu item 320 for selecting the display device 11 as a display destination.

  The setting menu 300 is displayed on the touch panel 138 when a menu item for setting a touch position image is selected in the upper setting menu. The setting menu 300 is displayed on the touch panel 138 when the display device 11 is connected to the camera 10. When the display device 11 is not connected to the camera 10, when a menu item for setting a touch position image is selected in the upper setting menu, a selection for selecting a display position of a sub-area described later is selected. A screen is displayed.

  Even when the display device 11 is not connected to the camera 10, the setting menu 300 may be displayed when a menu item for setting a touch position image is selected. In this case, the menu item 320 may be grayed out, and the user's selection operation on the menu item 320 may be invalidated.

  FIG. 4 shows an example of a selection screen 400 for selecting the display position of the sub area. The selection screen 400 is displayed on the touch panel 138 when the menu item 310 is selected in the setting menu 300 of FIG. In addition, when the display device 11 is not connected to the camera 10, the menu item for setting the touch position image is selected in the above-described upper setting menu, and displayed on the touch panel 138.

  Selection screen 400 includes a sub-area 410a, a sub-area 410b, a sub-area 410c, a sub-area 410d that indicate candidates for display positions of the sub-area, and a main area 420. The user selects one subarea from these subareas 410 through a touch operation or an operation on the operation input unit 141. Information indicating the display position of the selected sub-area is stored in the system memory 139 as a parameter.

  In the selection screen 400, the user may select a plurality of subareas 410 from the plurality of subareas 410. When a plurality of subareas 410 are selected, the camera MPU 140 dynamically selects the display position of one subarea 410 from the display positions of the selected subareas 410 and displays the touch position image. You may let me.

  When selecting a plurality of subareas 410, the subareas 410 may be selected together with the display priority. The camera MPU 140 may select the sub-areas 410 in order, and set a higher priority for the sub-areas 410 in the selected order. When the display position for displaying the touch position image is dynamically selected from the display positions of the plurality of selected sub-areas 410, the camera MPU 140 may select the display positions in order of priority.

  FIG. 5 shows an example of a setting screen 500 for setting the size and display magnification of the sub area. The setting screen 500 is displayed on the touch panel 138 when the selection of the sub-area 410 is confirmed on the selection screen 400 of FIG.

  The setting screen 500 includes a sub area object 510 indicating a display position candidate of the sub area, a main area object 520, a simulated object 530, a simulated object 532, an operation object 540, and an operation object 550. The main area object 520 represents a moving image display area on the touch panel 138. The sub-area object 510 represents the display range of the touch position image. Therefore, the relative size of the sub area object 510 with respect to the main area object 520 indicates the relative size of the display range of the touch position image with respect to the moving image display area. The sub area object 510 is displayed in the main area object 520 at the display position selected on the selection screen 400 in FIG.

  The operation object 540 receives a user instruction to change the size of the sub area. The operation object 540 includes an object 541 that receives an instruction to further increase the size of the sub-area, and an object 542 that receives an instruction to further reduce the size. When the object 541 is operated, the size of the sub-area object 510 is enlarged. When the object 542 is operated, the subarea object 510 is reduced. Thus, when the operation object 540 is operated, the display magnification of the sub area object 510 with respect to the main area object 520 is changed. The user can select a desired sub-area size through the operation object 540.

  The operation object 550 receives a user instruction to change the display magnification. The operation object 550 includes an object 551 that receives an instruction to further increase the display magnification and an object 552 that receives an instruction to further decrease the display magnification. When the object 551 is operated, the size of the simulated object 532 is enlarged. When the object 552 is operated, the size of the simulated object 532 is reduced. Thereby, when the operation object 550 is operated, the display magnification of the simulated object 532 with respect to the simulated object 530 is changed. The user can select a desired display magnification through the operation object 550.

  The user operates the operation object 540 and the operation object 550 through a touch operation or an operation on the operation input unit 141. Information indicating the size and display magnification of the sub-area determined by the user operation is stored as a parameter in the system memory 139. As described above, the camera MPU 140 transmits at least one of the information indicating the position of the sub area in the moving image display area on the touch panel 138, the information indicating the size of the sub area, and the information indicating the display magnification to the sub area through the setting screen. Get information from the user. And camera MPU140 controls the display of the touch position image to a subarea based on the acquired information.

  FIG. 6 shows an example of a setting screen 600 for setting the touch shooting mode. The touch shooting mode defines the operation content instructing the start of image data recording and the end of image data recording. The setting screen 600 is displayed on the touch panel 138 when the size and display magnification of the sub area 410 are determined on the setting screen 500 of FIG.

  The setting screen 600 includes a menu item 610 and a menu item 620 for selecting a recording mode of image data, and a menu 611 and a menu 612 for performing settings in the recording mode corresponding to the menu item 610. The menu item 610 starts recording image data in the external memory 180 in response to a single touch operation on the touch panel 138 and ends recording image data in the external memory 180 in response to another touch operation. This is a menu item for selecting a recording mode. This recording mode is called a retouch recording stop mode. The menu item 620 is a menu item for selecting a second recording mode in which image data is continuously recorded in the external memory 180 while a touch operation is performed on the touch panel 138. This recording mode is called a touch-off recording stop mode.

  A menu 611 is a pull-down menu for selecting an operation content for instructing start and end of recording of image data. Examples of options include double clicks and tap operations. For example, when double-click is selected as the operation content, recording of image data is started when any part of the moving image display area is double-clicked, and when an area selected by a menu 612 to be described later is double-clicked. Recording of the image data ends.

  A menu 612 is a pull-down menu for selecting in which display area the recording stop of image data is accepted. Options include main area, sub-area, and all areas. The camera MPU 140 accepts the type of touch operation selected from the pull-down menu 611 for the selected area as a recording stop instruction.

  Note that the non-selected area that has not been selected as the area for receiving the recording stop receives an operation having a different content from the recording stop. Examples of operations received in the non-selected area include pinch-in operations and pinch-out operations.

  The user operates various menus on the setting screen 600 through a touch operation or an operation on the operation input unit 141. Information determined by the user operation is stored as a parameter in the system memory 139.

  FIG. 7 schematically shows a display example while the touch-off recording stop mode is set. When the imaging operation starts, a moving image is displayed in the display area 701 on the screen 700.

  When any position in the moving image display area 701 is touched, various shooting conditions including adjustment of the focus state of the lens unit 120, adjustment of exposure conditions, white balance, and the like are determined. Data recording is started (screen 710). As described above, the camera MPU 140 adjusts the imaging condition of the imaging element 132 for the subject at the position corresponding to the position where the touch operation is performed on the touch panel 138. Here, the image data may be moving image data. The image data may be still image data.

  In addition, on the screen 710, a partial image of the extraction target area determined based on the size and the display magnification described with reference to FIG. 5 is displayed in the sub-area 711 in the display area 701. The sub-area 711 has the size described with reference to FIG. 5 and is set to the display position described with reference to FIG. At this time, the sub-area 711 is determined so as not to include the touch position of the user operation.

  The camera MPU 140 sequentially acquires the current touch position. The camera MPU 140 sequentially updates the images displayed in the sub area 711 with the touch position image of the current touch position. Further, the recording of the image data is continued.

  When the touch position moves and the touch position approaches the sub area 711, the position where the touch position image is displayed is changed to the sub area 721 (screen 720). For example, when the distance between the touch position and the sub-area 711 is equal to or less than a predetermined value, the sub-area 721 is set at a position shifted in the direction opposite to the moving direction of the touch position.

  As described above, the camera MPU 140 determines the position of the sub area in the moving image display area on the touch panel 138 so that the touch position image is displayed at a position away from the touch-operated position. In particular, the camera MPU 140 identifies the destination of the touch-operated position and determines the position of the sub-area so that the touch position image is displayed at a position away from the identified destination position. As a result, the user can follow the moving object of interest and continue to specify the position of the moving object of interest. Further, the user can continue to specify the moving object of interest while visually recognizing the moving destination.

  When the touch is no longer detected, the camera MPU 140 ends the recording of the moving image (screen 730). Even when the recording of the moving image is completed, the imaging operation by the image sensor 132 is continued, and the moving image based on the generated image data is continuously displayed on the touch panel 138.

  As described above, when the moving image based on the image data obtained by the imaging device 132 capturing the subject is displayed on the touch panel 138, the camera MPU 140 detects the image data according to the detection of the touch operation on the touch panel 138. Start recording. When the touch operation on the touch panel 138 is detected, the camera MPU 140 starts displaying the touch position image in the sub area and starts recording the image data, and the touch operation on the touch panel 138 is no longer detected. Finishes recording the image data. When the touch operation on the touch panel 138 is no longer detected, the display of the sub area is also ended.

  FIG. 8 schematically shows a display example when the retouch recording stop mode is set. When the imaging operation starts, a moving image is displayed in the display area 701 as in the screen 700 of FIG. Here, the difference from the operation in the touch-off recording stop mode will be mainly described.

  When imaging starts, a screen 810 similar to the screen 700 is displayed. When any position in the display area 811 is double-clicked on the screen 810, the recording of the image data is started together with the display of the moving image. Even if the touch is not detected, the recording of the image data is continued (screen 820).

  When any position in the display area 821 is touched on the screen 820, various shooting conditions including AF, AE, white balance and the like are determined, and an imaging operation and an image processing operation are performed based on the shooting conditions. Is called. Then, partial images of the extraction target area set based on the display size and the display magnification described with reference to FIG. 5 are displayed in the sub-area 831 in the display area 821 (screen 830, screen 840). Similar to the sub area 711 and the sub area 721, the display positions of the sub area 831 and the sub area 841 are set at positions away from the touch position. While the touch is detected, the operation condition at the touch position is optimized. The operation during the period in which the touch is detected is the same as that described in relation to the screen 710 and the screen 720 in FIG.

  Next, when the touch is no longer detected, the optimization target area of the operation condition is set following the movement of the subject corresponding to the previous touch position (screen 850). When no touch is detected, the display of the sub-area is stopped.

  Then, when any position in the display area 851 is double-clicked, the recording of the image data is finished (screen 860). Even when the recording of the moving image is completed, the imaging operation by the image sensor 132 is continued, and the moving image based on the generated image data is continuously displayed on the touch panel 138.

  When the touch operation for designating the subject is detected again after the touch is no longer detected, the touch position image is displayed in the sub-area as described in connection with the screen 830, the screen 840, etc. Optimize the shooting conditions. This operation is repeated each time a touch operation for designating a subject is detected until recording is completed.

  Thus, when the moving image is displayed on the touch panel 138, the camera MPU 140 starts recording image data in response to detection of a touch operation on the touch panel 138. The camera MPU 140 starts recording the image data in response to the detection of the first type touch operation on the touch panel 138 when the image data is not recorded, and when the image data is recorded, the touch panel 138 Recording of image data is stopped in response to detection of the first type touch operation on 138. When the camera MPU 140 detects the second touch operation on the touch panel 138, the touch of the second type touch operation is detected while the second type touch operation is detected on the touch panel 138. The touch position image according to the position is displayed in the sub area.

  Note that during recording of image data, other instructions may be received by a different type of operation than the touch operation for designating the subject. For example, a pinch-in operation and a pinch-out operation may be accepted. The subject may be zoomed in according to the pinch-in operation. That is, the subject may be magnified. The subject may be zoomed out according to the pinch out operation. That is, the subject may be reduced in size. In this case, the focal length of the optical system of the lens unit 120 may be changed. Further, zoom-in or zoom-out processing may be performed by image processing by a so-called digital zoom method.

  For example, when a double click for instructing the start of recording is detected on the screen 810, a touch position image of the touch position where the double click is detected may be displayed in the sub area. Then, the image at which the touch position image is displayed in the sub area may be sequentially updated by following the subject at the touch position when the double click is performed. The same applies to the case after the touch operation for designating the subject is detected. For example, on the screen 850, the image at which the touch position image is displayed in the sub area may be sequentially updated following the subject at the previous touch position.

  When the image of the subject of interest is displayed in the sub area even when the touch operation is not detected, the sub area and the main area may acquire different instructions. In the setting described with reference to FIG. 6, when it is set that an instruction to stop recording image data is received in the sub area, the recording of image data may be stopped in response to a touch operation on the sub area. For example, when a double click is detected again for the sub area, the recording of the image data is stopped. On the other hand, when a pinch-in operation or a pinch-out operation is detected for the main area, a zoom-in or zoom-out operation may be performed according to the operation as described above. As described above, when the image data is being recorded, the camera MPU 140 accepts a touch operation indicating a recording stop instruction for stopping the recording of the image data in the sub area, and other than the second area in the moving image display area. In the area, a touch operation with an instruction different from the recording stop instruction is received. Note that when the image data is recorded, the camera MPU 140 may accept, in the sub area, a touch operation for starting the recording of the partial image data in the first area in addition to the recording of the image data.

  FIG. 9 shows an example of an operation flow in the camera 10. FIG. 9 shows a processing flow from activation to termination of the camera 10. This flow is started, for example, when a power switch as a part of the operation input unit 141 is switched to the ON position. This flow is executed by controlling each part of the camera 10 mainly by the camera MPU 140.

  In step S <b> 900, the camera MPU 140 performs initial setting of the camera 10. For example, the camera MPU 140 expands various parameters for controlling the camera 10 from the system memory 139 to the RAM 136. As the developed various parameters, the information described with reference to FIGS. 3 to 8 can be exemplified. In addition, the camera MPU 140 sets operating conditions of each unit of the camera 10 based on, for example, a state of a mode dial or the like as a part of the operation input unit 141 and various developed parameters. Examples of operation conditions include shooting modes such as continuous shooting and single shooting, imaging conditions such as shutter speed and exposure conditions, image processing conditions such as white balance, and the like.

  Subsequently, in step S902, the camera MPU 140 displays the content set in the initial setting on the touch panel 138 or the like. For example, the camera MPU 140 displays information such as the above-described operating conditions on the touch panel 138 in various formats such as icon display.

  Subsequently, in step S904, the camera MPU 140 identifies the event that has occurred. Here, as an event based on an operation on the operation input unit 141 or the touch sensor 162, an operation setting event based on an operation for setting the operation of the camera 10, a live view event based on an operation of a live view switch, and a shooting based on an operation on a release button. An event and a power-off event for turning off the power of the camera 10 will be described in particular.

  If it is determined in step S904 that the event has occurred due to an operation for setting operation, the instructed setting process is performed (step S910). For example, the camera MPU 140 performs various setting processes including the touch operation settings described with reference to FIGS. When the operation setting is changed in this step, the parameter variable is changed according to the changed operation setting.

  If it is determined in step S904 that the event is based on an operation on the release button, focus adjustment or shooting is performed according to the depression of the release button (step S912).

  If it is determined in step S904 that the event has occurred due to an operation for starting the live view operation, the process shifts to a live view operation mode (step S914). The live view operation mode will be described later.

  In step S904, when an event other than the operation setting event, the live view event, the shooting event, and the power-off event occurs, an operation corresponding to the event is performed (step S916). For example, a process of operating in a playback mode of image data in response to an operation of a playback button, a process of shifting to a power saving mode when no user operation continues, and the like can be exemplified. When the operations in step S910, step S912, step S914, and step S916 are completed, the process proceeds to the determination in step S904.

  In step S904, if a power off event occurs, end processing is performed (step S918). The power off event occurs when the power switch is switched to the OFF position. In addition, a power-off event occurs when there is no user instruction for a predetermined period. The processing executed in step S918 includes processing for recording information such as various changed parameters in the system memory 139. When the end process is completed, this flow ends.

  FIG. 10 shows an example of an operation flow when performing a live view operation. This flow can be applied to the process of step S914 in the flow of FIG.

  When this flow starts, the camera MPU 140 starts a live view imaging operation (step S1002). During the live view imaging operation, the camera MPU 140 causes the imaging device 132 to repeatedly perform the imaging operation, and the subject image is displayed on the touch panel 138 based on image data sequentially generated by the imaging device 132 performing the repeated imaging operation. Are displayed sequentially.

  Subsequently, in step S1004, an operation event is determined. Here, as an operation event, an event for starting recording of image data and an event for ending the live view operation will be described. The event for starting the recording of the image data occurs in response to the detection of the touch operation when the touch shooting mode is set to the touch-off recording stop mode. When the retouch recording stop mode is set, the event for starting the recording of the image data occurs in response to the detection of the touch operation selected as the operation type on the setting screen of FIG.

  When an event for starting the recording of the image data occurs, the recording of the image data is started. (Step S1006). At this time, recording of image data at the touch position may also be started. The image data at the touch position may be image data in a range displayed in the sub area. The image data of the entire range and the image data of the touch position may be recorded in the external memory 180 in association with each other. Subsequently, the touch shooting mode is determined (step S1008).

  If the touch shooting mode is the touch-off recording stop mode, the shooting condition optimization process for the touch area is performed while detecting that the screen is touched (step S1010). Specifically, the processing described in relation to the screen 710 and the screen 720 in FIG. 7 is performed. This process will be described with reference to FIG. When the touch on the screen is not detected and the process of step S1010 is completed, the recording of the image data is stopped (step S1012), and the process proceeds to step S1004.

  If it is determined in step S1008 that the touch shooting mode is the retouch recording stop mode, the shooting conditions are optimized for a predetermined region (step S1020). Here, the imaging conditions may be optimized for the position where the recording start touch operation is detected. Subsequently, a predetermined touch operation on the touch panel 138 is detected (step S1022). The predetermined touch operation includes a touch operation for designating a region of interest, a touch operation for ending recording of image data, and other predetermined operations described later.

  If it is determined in step S1022 that a touch operation for designating the attention area is detected, the attention area is controlled (step S1024). The camera MPU 140 may detect an operation that keeps pressing the touch panel 138 for a predetermined time or more as a touch operation that designates a region of interest. In step S1024, specifically, the processing described in relation to the screen 830 and the screen 840 in FIG. 8 is performed. The processing content in step S1024 is the same as the processing content in step S1010. This process will be described with reference to FIG.

  When it is determined in step S1022 that another predetermined touch operation is detected, predetermined control corresponding to the operation is performed (step S1026). Examples of other predetermined touch operations include a pinch-in operation and a pinch-out operation. In step S1026, enlargement processing is performed according to the pinch-in operation, and reduction processing is performed according to the pinch-out operation.

  If it is determined in step S1022 that the region of interest designation operation, the touch operation for ending the image data recording, and other predetermined touch operations are not detected, the process proceeds to step S1020. When the process proceeds to step S1020 after step S1024, a process for optimizing the shooting conditions is performed following the subject at the last touch position. Specifically, the operation described in relation to the screen 850 in FIG. 8 is performed.

  If it is determined in step S1022 that a touch operation for ending image data recording is detected, the process proceeds to step S1012. The touch operation for ending the image data recording is the touch operation selected as the operation type on the setting screen of FIG.

  If it is determined in step S1004 that an operation event for ending the live view operation has occurred, the live view imaging operation is ended (step S1030), and this flow is ended. The operation event that ends the live view operation is when the live view switch is returned to the stop position, or when there is no instruction to start recording image data for a predetermined time after starting the live view imaging operation, etc. To occur.

  FIG. 11 is a detailed operation flow for optimizing the shooting conditions for the touch area. This flow can be applied to the processing of step S1010 and step S1024 in the flow of FIG.

  When this flow starts, an area including the touch position is set as an optimization target area of the shooting condition (step S1100), and the shooting condition is optimized for the subject imaged in the area (step S1102). For example, the imaging conditions such as the focus state and exposure conditions of the lens unit 120 are optimized for the subject. Also, image processing conditions such as white balance adjustment are optimized.

  Subsequently, the display position of the sub-area is determined based on the touch position (step S1104). The display position of the sub area is set to a position that does not include the touch position. For example, when one display position is selected on the setting screen of FIG. 4 and the sub-area is displayed at the display position, if the touch position is not included in the sub-area, the display position is the display position of the sub-area. Selected as. When the selected display position includes the touch position, another display position away from the touch position is automatically determined. Whether or not a touch position is included in the sub-area is determined in consideration of the display size selected in relation to FIG.

  Subsequently, the touch position image is displayed in the sub-area determined in step S1104 (step S1106). The image area extracted as the touch position image is determined based on the display size, display magnification, and touch position selected on the setting screen of FIG.

  Subsequently, a change in the touch state is detected (step S1108). If the touch position has not changed but the touch state is maintained, the shooting conditions are optimized for the same position (step S1110), and the process proceeds to step S1106. The case where the touch position has not changed includes the case where the amount of change in the touch position is equal to or less than a predetermined value.

  If a change in the touch position is detected while the touch state is maintained, the process proceeds to step S1100. For example, in step S1100, an area including the touch position after movement is determined as an optimization target area. In step S1104, the position of the sub area is determined in consideration of the moving direction of the touch position. For example, as described in relation to the screen 710 and the screen 720 in FIG. 7, the position of the sub area may be determined on the side opposite to the direction in which the touch position moves.

  If it is determined in step S1108 that the touch state is released, this flow ends.

  In the above description, the case where the touch position image is mainly displayed in the sub area in the touch panel 138 has been described with reference to FIGS. However, even when the touch position image is displayed on the display device 11, the user may be able to set the display magnification, the display size, and the like described with reference to FIG. 5 through the touch panel 138. Similarly, for the setting of the touch shooting mode described with reference to FIG. 6, the setting for the display device 11 may be set through the touch panel 138. Further, the display device 11 has a power saving function and may shift to the sleep mode. The condition setting for shifting the display device 11 to the sleep mode and the display setting for the touch position image when the display device 11 is in the sleep mode may be set through the touch panel 138. Further, as described above, the image data of the image displayed on the display device 11 may be recorded in the external memory 180 together with the image data of the moving image displayed on the touch panel 138, similarly to the image displayed in the subarea. .

  In the above description, the processing described as the operation of the camera MPU 140 is realized by the camera MPU 140 controlling each hardware of the camera 10 according to a program. In the above description, the processing realized by the ASIC 135 can be realized by a processor. For example, the processing described as the operation of the ASIC 135 is realized by the processor controlling each hardware included in the camera 10 according to the program. That is, the processing described in relation to the camera 10 of the present embodiment is performed by the processor operating in accordance with the program to control each hardware, so that each hardware including the processor, the memory, and the like cooperates with the program. It can be realized by operating. The same applies to the operation of the display device 11. That is, the process can be realized by a so-called computer device. The computer device may load a program for controlling the execution of the above-described process, operate according to the read program, and execute the process. The computer device can load the program from a computer-readable recording medium storing the program.

  In the present embodiment, the camera 10 with the lens unit 120 attached is taken as an example of an imaging apparatus. However, the imaging device is a concept including the camera body 130 to which the lens unit 120 is not attached. As imaging devices, in addition to interchangeable lens cameras such as single-lens reflex cameras and mirrorless cameras, non-interchangeable cameras such as compact digital cameras, video cameras, mobile phones with imaging functions, and imaging functions A portable information terminal and various electronic devices having an imaging function can be applied. In addition, the above-described processing can be applied not only at the time of live view operation but also at the time of reproduction of a moving image, for example. Therefore, the above-described processing can be applied to various electronic devices other than the imaging device. As the electronic device, various devices such as a mobile phone, a portable information terminal, a computer such as a so-called tablet or laptop computer, and a navigation device such as a car navigation system can be applied.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

5 camera system, 10 camera, 11 display device, 40 display area, 50 subarea, 120 lens unit, 121 lens mount contact, 122 lens group, 123 lens MPU, 124 lens drive unit, 130 camera body, 131 camera mount contact, 132 imaging device, 133 analog processing unit, 134 A / D converter, 135 ASIC, 136 RAM, 137 display control unit, 138 touch panel, 139 system memory, 140 camera MPU, 141 operation input unit, 142 AF unit, 143 focal plane Shutter, 144 Photometric element, 145 Main mirror, 146 Sub mirror, 147 Finder unit, 148 Drive unit, 149 Connection interface, 150 Recording medium IF, 160 Touch detection unit, 162 Tchisensa, 168 display unit, 180 an external memory, 190 power supply, 192 power supply circuit

Claims (13)

While the touch operation is detected for the moving image display area on the touch panel, the touch area image displayed in the first area, which is a partial display area including the touch-operated position, is displayed in the first area. An electronic device provided with the control part displayed on the 2nd field different from. The electronic device according to claim 1, wherein the second area is a partial display area in the moving image display area on the touch panel. It further includes an imaging unit that images the subject,
The touch panel displays the moving image based on image data obtained by the imaging unit imaging a subject,
The electronic device according to claim 1, wherein the control unit starts recording the image data in response to detection of a touch operation on the touch panel when the moving image is displayed on the touch panel. The control unit starts recording the image data in response to detection of the first type touch operation on the touch panel when the image data is not recorded, and records the image data. The electronic device according to claim 3, wherein recording of the image data is stopped in response to detection of the first type touch operation on the touch panel. The control unit displays the touch position image corresponding to the touch position of the second type touch operation in the second area while the second type touch operation is detected on the touch panel. The electronic device according to claim 4. The control unit performs a touch operation indicating a recording stop instruction to stop recording of the image data when the image data is recorded on a part of the display area of the moving image on the touch panel. The electronic according to any one of claims 3 to 5, wherein a touch operation of an instruction different from the recording stop instruction is received in an area other than the second area in the moving image display area. machine. When the image data is being recorded, the control unit accepts, in addition to the recording of the image data, a touch operation for starting recording of partial image data in the range of the first area in the second area. The electronic device as described in any one of Claim 3 to 5. When the touch operation on the touch panel is detected, the control unit starts displaying the touch position image on the second area and starts recording the image data, and the touch operation on the touch panel is detected. The electronic device according to claim 3, wherein the recording of the image data is terminated when it is not performed. The electronic device according to claim 3, further comprising an imaging condition adjustment unit that adjusts an imaging condition by the imaging unit with respect to a subject at a position corresponding to the touch-operated position on the touch panel. Information indicating at least one of information indicating the position of the second area within the display area of the moving image on the touch panel, information indicating the size of the second area, and information indicating the display magnification in the second area Further comprising an information acquisition unit for acquiring from
The electronic device according to claim 1, wherein the control unit controls display of the touch position image in the second region based on the information acquired by the information acquisition unit. The control unit determines a position of the second area in the moving image display area on the touch panel so that the touch position image is displayed at a position away from the touch-operated position. The electronic device according to any one of 10. A moving destination specifying unit for specifying a moving destination of the position to be touched;
The electronic device according to claim 11, wherein the control unit determines the position of the second region so that the touch position image is displayed at a position away from the position of the destination specified by the destination specifying unit. . While the touch operation is detected for the moving image display area on the touch panel, the touch area image displayed in the first area, which is a partial display area including the touch-operated position, is displayed in the first area. The program for making a computer perform the control step displayed on the 2nd field different from.

Images