JP2016167171A - Electronic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus that can optionally set an offset vector with good operability depending on a finger to perform a touch operation or the position of a touch, and can improve operability.SOLUTION: When any one of two physical input points A and B simultaneously touching a touch panel 6 on the surface of a display 5 is separated from the touch panel, an electronic apparatus stores a relative position of the separated physical input point to the physical input point maintaining the touch as an offset vector, and calculates a logical input point from the stored offset vector according to the position of the physical input point maintaining the touch.SELECTED DRAWING: Figure 2(a)

Description

  The present invention relates to an electronic apparatus such as a digital camera provided with a touch panel as position specifying means.

  Conventionally, there is an electronic device provided with a touch panel as a position designation means on a screen display. The touch panel regards a position offset from the touched physical input point as a designated position (hereinafter, defined as a logical input point) and transmits the position to the control unit. For the offset from the physical input point, an offset vector consisting of a predetermined distance and angle is defined at the center of the screen display. In the vicinity of the four sides of the screen display, the angle is perpendicular to each side near the physical input point. Has been fixed. In the vicinity of the four corners of the screen display, the angle is fixed to 45 degrees with respect to each corner near the physical input point. As a result, the operator can specify the position of a designation target such as a small icon in the screen display without hiding it with a finger that is touch-operated (see Patent Document 1).

JP-A-11-24841

  In the preceding example, an offset vector from the physical input point is determined in advance. For example, in the center of the screen, the offset vector is defined in the direction (upper left direction) indicated by the right index finger in accordance with the touch operation with the right index finger.

  However, when the touched position approaches the upper side of the screen display, the angle of the offset vector is switched upward at a certain position. For this reason, when the touch operation is performed near the switching boundary, the angle of the offset vector is suddenly switched, and a position different from the logical input point intended by the operator may be input as the logical input point. .

The electronic device according to the present invention is
Image display means 5 for displaying an image;
Contact detection means 6 disposed on the surface of the image display means 5 for detecting the coordinates of physical input points in the image display means in contact;
Relative position calculation means for calculating relative position information from the coordinates of two physical input points which are in contact with each other in the image display means;
Relative position information for storing the relative position information of the distant physical input point with respect to the physical input point maintaining contact when any one of the two physical input points that are in contact at the same time leaves the image display means Consists of storage means,
A logical input point is calculated from the relative position information stored in the relative position information storage unit for a physical input point that is in contact with only one point, and the relative position is maintained when the physical input point moves. However, the logic input point is also moved.

  According to the present invention, since the operator can set the offset vector from the physical input point to the logical input point with a simple operation, an offset vector with good operability can be arbitrarily set according to the finger to be touched or the touched position And operability can be improved. In addition, since the angle of the offset vector does not suddenly change at the outer periphery of the screen, an unintended position is not input as a logical input point.

1 is a rear perspective view of a digital camera according to a first embodiment of the present invention. Display contents of the display 5 in a state where two points on the display 5 are touched simultaneously. Display contents of display 5 with one left touch point released Display contents on the display 5 when the in-focus position is specified in detail Display contents of the display 5 in a state where two points on the display 5 are touched simultaneously. Display contents of the display 5 with the right touching point released The flowchart which shows the procedure of the processing performed in CPU101 Display contents of the display 5 in a state where two points on the display 5 are touched simultaneously. Display contents of display 5 that expands the image display by dragging the touching finger Block diagram of digital camera

  Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a rear perspective view of a digital camera as an example of an electronic apparatus to which the present invention can be applied.

  As shown in FIG. 1, a power switch 2, a mode switch 3, and a shutter switch 4 included in an operation unit 106 for a user to operate the camera 1 are disposed on the upper surface of the camera 1. The mode switch 3 sets the camera 1 to the shooting mode (REC) when it is slid to the left and to the playback mode (PLAY) when it is slid to the right.

  A display 5 that is a display screen is provided on the back of the camera, and a touch panel 6 included in the operation unit 106 is provided on the surface of the display 5. An operation instruction is transmitted to the CPU 101 by touching the touch panel 6 with a finger. An imaging lens (not shown) is provided in front of the camera, and the entire angle of view including the subject image that has passed through the imaging lens is displayed on the display 5.

  The display 5 shows a woman 7 in the direction in which the photographing lens is directed, and an AF touch button 8 for switching a function for designating a focus position by a touch operation of the touch panel 6 is arranged on the upper right side of the screen. . When the camera is on, the photographer can set the focus position at an arbitrary position by a touch operation. When the camera is off, the camera focus is automatically fixed at the center of the field angle. Below the AF touch button 8, an AF zoom button 9 for switching a function capable of enlarging the display on the display 5 at the time of shooting is arranged. When the camera is on, the photographer can display the subject on the display 5 in an enlarged manner to indicate the in-focus position in detail, and when it is off, the camera cannot display the enlarged image and displays the entire angle of view.

  FIG. 6 shows an example of the configuration of a digital camera (digital camera 100) as an example of an electronic apparatus to which the present invention can be applied. In addition, although it has imaging parts, such as a lens and an imaging sensor, illustration is abbreviate | omitted.

  In FIG. 6, a CPU 101, a memory 102, a nonvolatile memory 103, an image processing unit 104, a display 5, an operation unit 106, a recording medium I / F 107, an external I / F 109, and a communication I / F 110 are connected to an internal bus 150. ing. Each unit connected to the internal bus 150 can exchange data with each other via the internal bus 150.

  The memory 102 is composed of, for example, a RAM (a volatile memory using a semiconductor element). The CPU 101 controls each unit of the digital camera using the memory 102 as a work memory, for example, according to a program stored in the nonvolatile memory 103. The nonvolatile memory 103 stores image data, audio data, other data, various programs for operating the CPU 101, and the like. The nonvolatile memory 103 is composed of, for example, a hard disk (HD) or ROM.

  Based on the control of the CPU 101, the image processing unit 104 acquires image data stored in the nonvolatile memory 103 or the recording medium 108, a video signal acquired via the external I / F 109, or a communication I / F 110. Various image processing is performed on the image data. The image processing performed by the image processing unit 104 includes A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, and color conversion. Processing etc. are included. The image processing unit 104 may be configured with a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 can perform image processing according to a program without using the image processing unit 104.

  The display 5 displays an image or a GUI screen constituting a GUI (Graphical User Interface) based on the control of the CPU 101. The CPU 101 generates a display control signal according to a program, controls each part of the digital camera so as to generate a video signal to be displayed on the display 5 and output it to the display 5. The display 5 displays a video based on the output video signal. The configuration of the digital camera itself may be an interface for outputting a video signal to be displayed on the display 5, and the display 5 may be configured by an external monitor (such as a television).

  The operation unit 106 is an input device for accepting user operations including a character information input device such as a keyboard, a pointing device such as a mouse and a touch panel, buttons, dials, joysticks, touch sensors, and a touch pad. Note that the touch panel is an input device that is configured to overlap with the display 5 and is configured to output coordinate information according to the touched position.

  The storage medium I / F 107 can be loaded with a recording medium 108 such as a memory card, a CD, or a DVD. Under the control of the CPU 101, data can be read from the loaded recording medium 108 and data can be written to the recording medium 108. I do. The external I / F 109 is an interface that is connected to an external device by a wired cable or wirelessly and inputs / outputs a video signal and an audio signal. The communication I / F 110 is an interface for communicating with an external device, the Internet 111, and the like to transmit and receive various data such as files and commands.

When the operation unit 106 includes a touch panel, the CPU 101 performs the following operations on the touch panel. Alternatively, the state can be detected.
-A finger or pen that did not touch the touch panel newly touched the touch panel. That is, the start of touch (hereinafter referred to as touch-down).
-The touch panel is touched with a finger or pen (hereinafter referred to as touch-on).
-The touch panel is moved while being touched with a finger or a pen (hereinafter referred to as Touch-Move).
-The finger or pen that touched the touch panel is released. That is, the end of touch (hereinafter referred to as touch-up).
A state where nothing is touched on the touch panel (hereinafter referred to as touch-off).

  When touchdown is detected, it is also detected that touch-on is performed at the same time. After touch-down, unless touch-up is detected, normally touch-on continues to be detected. The touch move is detected in a state where touch-on is detected. Even if the touch-on is detected, the touch move is not detected unless the touch position is moved. After it is detected that all fingers or pens that have been touched are touched up, the touch is turned off.

  The CPU 101 is notified of these operations / states and the position coordinates where the finger or pen is touching the touch panel via the internal bus, and the CPU 101 determines what operation has been performed on the touch panel based on the notified information. judge. Regarding the touch move, the moving direction of the finger or pen moving on the touch panel can be determined for each vertical component / horizontal component on the touch panel based on the change of the position coordinates.

  In addition, it is assumed that a stroke is drawn when touch-up is performed on the touch panel through a certain touch move from touch-down. The operation of drawing a stroke quickly is called a flick. A flick is an operation of quickly moving a certain distance while touching the finger on the touch panel and then releasing it, in other words, an operation of quickly tracing the finger on the touch panel. When it is detected that a touch move is performed at a predetermined speed or more over a predetermined distance and a touch-up is detected as it is, it can be determined that a flick has been performed. In addition, when it is detected that a touch move is performed at a predetermined distance or more and less than a predetermined speed, it is determined that a drag has been performed.

  The touch panel may be any of various types of touch panels such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method. . Depending on the method, there are a method for detecting that there is a touch due to contact with the touch panel, and a method for detecting that there is a touch due to the approach of a finger or pen to the touch panel, but either method may be used.

  FIG. 2A shows the display content of the display 5 when the photographer is touching two points on the display 5 at the same time. The AF touch button 8 is on and the AF zoom button 9 is off. FIG. 2B shows a state in which the right point touched from FIG. 2A is released, and FIG. 2C shows the display 5 on which the in-focus position is finely adjusted from FIG. 2B. Show the contents.

  As shown in FIG. 2 (a), in order to focus on the face of the woman 7, the photographer touches the face of the woman 7 on the display 5 and two points shifted to the left with the fingers 10a and 10b. ing. The touch panel 6 transmits the touched positions on the display 5 to the CPU 101 as physical input points A and B.

  Next, the photographer releases the finger 10b touching the face of the woman 7 from the touch panel 6 as shown in FIG. The CPU 101 stores the relative position of the physical input point B where the finger 10b is released with respect to the physical input point A maintaining the touch as an offset vector defined by the distance and angle from the physical input point A, and the physical input point B Is recognized as a logical input point B which is regarded as a designated position. The display 5 displays a frame-shaped focus mark 11 indicating the focus position at the position of the logical input point B, and an arrow mark 12 indicating the offset vector from the physical input point A. Since the current offset vector is displayed on the display 5, the photographer can visually confirm the relative positional relationship between the physical input point and the logical input point. When the finger 10a of the physical input point A maintaining the touch is released from the touch panel 6, the logical input point B is recognized as an in-focus position and AF control is started.

  In FIG. 2 (b), the center of the face of the woman 7 is focused. However, when the user wants to focus especially on the left pupil 7a in the face, the photographer displays the left pupil 7a on the display 5 with the current pupil. Check the amount of deviation of the focus mark 11. As shown in FIG. 2C, when a position shifted from the physical input point A by the amount of deviation confirmed on the display 5 is touched, the position is detected as a new physical input point C. The CPU 101 calculates the logical input point D for the physical input point C from the stored offset vector, and displays the focus mark 11 on the display 5 at the position of the left pupil 7a of the woman 7 intended by the photographer. . An arrow mark 12 indicating an offset vector is also displayed on the display 5 starting from the physical input point C. The photographer can finely adjust the in-focus position without hiding the in-focus object with a finger, and can accurately focus even a subject of a size that is hidden with the finger on the display 5.

  FIG. 3A shows the display content of the display 5 when the photographer touches two points on the display 5 at the same time when the woman 7 moves to the left within the angle of view from FIG. The AF touch button 8 is on and the AF zoom button 9 is off. FIG. 3B shows the display content of the display 5 in a state in which the left point touched from FIG. 3A is released.

  As shown in FIG. 3A, since the photographer focuses on the face of the woman 7, the photographer touches the physical input point E and the physical input point F at the same time as shown in FIG. The finger 10e touching the physical input point E is released. When the physical input point E leaves the state where the physical input point E and the physical input point F are simultaneously touched, the CPU 101 re-uses the relative position of the physical input point E with respect to the physical input point F as an offset vector. The physical input point E is stored as a logical input point E. The display 5 displays an in-focus mark 11 at the position of the logical input point E, and an arrow mark 12 indicating an offset vector from the physical input point F. When the finger 10f of the physical input point F maintaining the touch is released from the touch panel 6, the AF control is started with the logical input point E as the in-focus position.

  In FIG. 2B, the offset vector is also in the upper right direction because the subject is arranged at the upper right in the display 5, but when the subject moves to the lower left in the display 5 as shown in FIG. The photographer redefines the offset vector in the lower left direction to indicate the in-focus position. In this way, the photographer can redefine the offset vector with a simple touch operation. Therefore, the optimum offset vector is defined according to the position of the subject in the display 5 and the direction of the finger to be touched and focused. It is possible to instruct the position by a touch operation without hiding the position with a finger.

  FIG. 4 is a flowchart showing a procedure of processing performed in the CPU 101. This processing is realized by reading the program recorded in the nonvolatile memory 103 into the memory 102 and executing it by the CPU 101.

  When two touches on the touch panel 6 are detected in step 101, the CPU 101 recognizes the positions of the two touched points in step 102 as physical input points, and calculates and stores the relative position information of the two points.

  When the movement of the two physical input points is detected in step 103, the CPU 101 returns to step 102 to re-recognize each position of the two moved points as the physical input point, and calculates and stores the relative position information of the two points again. To do. If the movement of the two physical input points is not detected in step 103, the process returns to step 103 while both of the two physical input points touched in step 104 maintain the touch on the touch panel 6, The loop from step 103 to step 104 is repeated.

  If it is detected in step 104 that one of the two physical input points touched is separated, the process proceeds to step 105.

  In step 105, the CPU 101 recognizes one point away from the touch panel 6 as a logical input point for the physical input point that maintains the touch, and the physical input that maintains the touch from the relative position information stored in step 102. An offset vector defined from the distance from the point and the angle is stored.

  In step 106, the logical input point and the offset vector are displayed on the display panel and visually notified to the photographer.

  If the movement of the physical input point that keeps touching is detected in step 107, the process proceeds to step 111, and the logical input point for the physical input point after the movement is calculated again from the offset vector stored in step 105. Return to 106. If the movement of the physical input point that keeps touching is not detected in step 107, the process proceeds to step 108.

  If it is not detected in step 108 that the physical input point maintaining the touch has moved away from the touch panel 6, the process returns to step 107 and steps 107 to 108 are repeated. If it is detected in step 108 that the physical input point is separated, the logical input point is focused in step 109.

  If no touch is detected on the touch panel 6 in step 110, the process ends. If a touch is detected, the process proceeds to step 111, and the logic for the physical input point where the touch is detected from the offset vector stored in step 105. The input point is calculated, and the process returns to step 106.

  If it is detected in steps other than step 101 that two points are touched simultaneously, the process returns to step 101.

  FIG. 5A shows the display content of the display 5 when the photographer is touching two points on the touch panel 6 at the same time. The AF touch button 8 is on and the AF zoom button 9 is on. FIG. 5B shows the display contents of the display 5 in which the finger touched from FIG. 5A is dragged to enlarge the image display.

  When the AF zoom button 9 is on, the offset vector is fixed to the value before the on state. As shown in FIG. 5A, a logical input point I is calculated from a fixed offset vector with respect to a physical input point G previously detected when the photographer touches the display 5 with two points. If the physical input point G and the physical input point H are detected at the same time, the left physical input point is detected first and the right physical input point is detected later. A logical input point is calculated from a fixed offset vector. As shown in FIG. 5B, when the physical input point H detected later is dragged in the direction 13 away from the physical input point G without moving the position of the physical input point G on the touch panel 6, logical input is performed. The image display is enlarged around the point I. When the physical input point H is dragged in a direction approaching the physical input point G in the enlarged display state, the image display is reduced around the logical input point I.

  Since the logical input point I, which is the focus position, does not move on the display 5, the photographer can enlarge the focus position without protruding from the display 5, and the focus position can be set for the magnified subject. You can give detailed instructions.

  In addition, when the movement of the physical input point is detected with only one physical input point, or when the movement of the physical input point detected earlier with two points touched simultaneously is detected, A logical input point is calculated from a fixed offset vector with respect to the physical input point.

  The control of the CPU 101 may be performed by one piece of hardware, or the entire apparatus may be controlled by a plurality of pieces of hardware sharing the processing.

  Although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms without departing from the gist of the present invention are also included in the present invention. included. Furthermore, each embodiment mentioned above shows only one embodiment of this invention, and it is also possible to combine each embodiment suitably.

  In the above-described embodiment, the case where the present invention is applied to a digital camera has been described as an example. However, the present invention is not limited to this example and can be applied to any electronic device including a touch panel. That is, the present invention can be applied to a personal computer, a PDA, a mobile phone terminal, a portable image viewer, a printer device including a display, a digital photo frame, a music player, a game machine, an electronic book reader, and the like.

(Other examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

5 Display, 6 Touch panel, 106 Operation unit

Claims (4)

Image display means 5 for displaying an image;
Contact detection means 6 disposed on the surface of the image display means 5 for detecting the coordinates of physical input points in the image display means in contact;
Relative position calculation means for calculating relative position information from the coordinates of two physical input points which are in contact with each other in the image display means;
Relative position information for storing the relative position information of the distant physical input point with respect to the physical input point maintaining contact when any one of the two physical input points that are in contact at the same time leaves the image display means Consists of storage means,
A logical input point is calculated from the relative position information stored in the relative position information storage unit for a physical input point that is in contact with only one point, and the relative position is maintained when the physical input point moves. An electronic device characterized in that the logical input point moves. In the situation where relative position information is stored in the relative position information storage means, the relative position calculation is performed when one of the physical input points is separated from the state where two points in the image display means are in contact with each other at the same time. 2. The electronic apparatus according to claim 1, wherein the relative position information stored in the relative position information storage means is overwritten with the relative position information calculated by the means. 2. The electronic apparatus according to claim 1, wherein a focusing operation is performed on a logical input point corresponding to a physical input point when only one physical contact point is in contact with the image display means. When the image display means 5 is touched at two points, the logical input point for the physical input point that is touched first is calculated from the relative position information stored in the relative position information storage means, and the physical input point that is touched later The electronic apparatus according to claim 1, wherein when a drag operation is performed, an image display is enlarged / reduced around the logical input point.