JP6433144B2 - Electronic device, tactile sensation control method, and program - Google Patents

Description

The present invention relates to an electronic device, a tactile sensation control method , a program, and a storage medium .

In recent years, there are an increasing number of electronic devices equipped with a touch panel that serves as both a display device and an input device. However, providing more user-friendly and easy-to-understand user interfaces leads to an improvement in merchantability, so various measures have been taken. It has been broken.
One of them is a technology that feeds back the operation by giving a tactile sensation to the fingertip when the operation is performed. By using tactile feedback, the user not only visually understands the operation, but also understands it as a fingertip sensation, so that a more intuitive operation can be performed. .
The tactile feedback can be used not only for the purpose of notifying that the operation has been performed but also for the purpose of notifying the user of something. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for detecting an operation position when operating a touch panel and applying vibration when the operation position moves out of a predetermined area. Patent Document 2 discloses a technique for applying vibration to notify that a button that should not be operated has been operated.

Japanese Patent No. 3935271 JP 2007-282083 A

  Some electronic devices include a plurality of display devices such as a video camera including a touch panel type LCD panel that also serves as a display device and an input device, and an EVF (electronic viewfinder) as a display device. There are also things. As described above, it is desired to provide an easy-to-use user interface using tactile feedback in an electronic device including a plurality of display devices.

  SUMMARY An advantage of some aspects of the invention is that it provides an easy-to-use user interface using tactile feedback in an electronic device including a plurality of display devices.

Therefore, the present invention is an electrical apparatus, which is an imaging unit, a first display unit, a second display unit as an electronic viewfinder disposed at a position different from the first display unit, and the first display unit . Eyepiece detecting means for detecting an eyepiece to the second display means, first detection means for detecting an operation by an operator on an input surface provided corresponding to the first display means, and vibration on the operator a first touch giving a second tactile giving vibration to the operator from the first touch to a different touch, there a different feel from that of the first touch and the second touch And a tactile sensation generating unit that generates a third tactile sensation that applies vibration to the manipulator, and the tactile sensation generating unit detects that the eyepiece is not detected by the eyepiece detection unit, and the first detection unit As the operation, the operation element displays the first display. When it is detected that a touch outside the area of the button displayed in the row is detected, no tactile sensation is generated, and an eyepiece is not detected by the eyepiece detection unit, and the operation is performed by the first detection unit as the operation. When it is detected that the operator has touched the area of the button displayed on the first display means, the first tactile sensation is generated, the eye detection is detected by the eye detection means, and the first touch is detected. It is detected by the one detection means that the operation element has touched the area outside the button area displayed on the first display means and set to surround the button as the operation. The second tactile sensation is generated, an eyepiece is detected by the eyepiece detection means, and the operation element is displayed on the first display means as the operation by the first detection means. When it is detected that a touch outside the area set to surround the tongue is detected, the eye detection unit detects the eye contact without generating a tactile sensation, and the first detection unit performs the operation as the operation. The third tactile sensation is generated when it is detected that the operator has touched the area of the button displayed on the first display means .

  According to the present invention, it is possible to provide an easy-to-use user interface using tactile feedback in an electronic device including a plurality of display devices.

It is a figure which shows a digital camera. It is a flowchart which shows a tactile sensation control process. It is a figure which shows the example of a screen of an LCD panel. It is a flowchart which shows a 1st display control process. It is a flowchart which shows a 2nd display control process. It is a figure for demonstrating a 2nd display control process. It is a flowchart which shows the 2nd display control process based on the example of a change. It is a figure for demonstrating the 2nd display control process which concerns on the example of a change. It is a flowchart which shows the tactile sense control process which concerns on 2nd Embodiment. It is a flowchart which shows the tactile sense control process which concerns on 3rd Embodiment. It is a figure which shows the example of a display of a LCD panel. It is a flowchart which shows the tactile sense control process which concerns on 4th Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram illustrating an electronic device 100. Examples of the electronic device 100 include a mobile phone, a digital camera, a digital video camera, and a smartphone. In the present embodiment, the electronic device 100 has two screens. Hereinafter, a case where the electronic apparatus 100 is a digital video camera will be described as an example.
As shown in FIG. 1, the electronic device 100 includes a CPU 101, a memory 102, a nonvolatile memory 103, an image processing unit 104, an LCD panel 112, an operation unit 106, a recording medium I / F 107, an external I / F 109, a communication I / F 110, and An imaging unit 105 is included. The electronic device 100 also includes an LCD panel 112, an LCD panel switching unit 113, an EVF (electronic finder) 114, an EVF switching unit 115, a switching detection unit 116, an eyepiece detection unit 117, a load detection unit 121, a panel tactile sensation generation unit 122, and a housing. A touch generation unit 123 is provided. These units are connected to the internal bus 150, and can exchange data with each other via the internal bus 150.

The memory 102 includes, for example, a RAM (a volatile memory using a semiconductor element). The CPU 101 controls each unit of the electronic device 100 using the memory 102 as a work memory, for example, according to a program stored in the nonvolatile memory 103. The nonvolatile memory 103 stores image data, audio data, other data, various programs for operating the CPU 101, and the like. The non-volatile memory 103 has, for example, a hard disk (HD), a ROM, and the like.
Note that the functions and processing of the electronic device 100 to be described later are realized by the CPU 101 reading a program stored in the nonvolatile memory 103 or the like and executing the program.

The image processing unit 104 performs various image processing on the image data based on the control of the CPU 101. Image data to be subjected to image processing includes image data stored in the non-volatile memory 103 and the recording medium 108, a video signal acquired through the external I / F 109, image data acquired through the communication I / F 110, There are image data captured by the imaging unit 105 and the like.
The image processing performed by the image processing unit 104 includes A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, and color conversion. Processing etc. are included. The image processing unit 104 is a dedicated circuit block for performing specific image processing, for example. Also, depending on the type of image processing, the CPU 101 can execute image processing according to a program instead of the image processing unit 104.

The LCD panel 112 and the EVF 114 display an image, a GUI screen configuring a GUI (Graphical User Interface), and the like based on the control of the CPU 101. The CPU 101 generates a display control signal according to a program, controls each unit of the electronic device 100 so as to generate a video signal to be displayed on the LCD panel 112 and output it to the LCD panel 112. The CPU 101 also generates a display control signal according to the program, controls each part of the electronic device 100 so as to generate a video signal for display on the EVF 114 and output the generated video signal to the EVF 114. Then, the LCD panel 112 and the EVF 114 display a video based on the output video signal.
The LCD panel switching unit 113 and the EVF switching unit 115 output images to the LCD panel 112 and the EVF 114 for the purpose of controlling when the LCD panel 112 and the EVF 114 are used exclusively or not using one, respectively. And control output stop. The switching detection unit 116 is a detection unit for acquiring information for switching the LCD panel switching unit 113 and the EVF switching unit 115. Examples of the control of the LCD panel 112 and the EVF 114 include exclusive control according to detection of opening / closing of the LCD panel 112, exclusive control according to detection of drawing out of the EVF 114, exclusive control according to detection of eye contact with the EVF 114, and the like.
As another example, electronic device 100 may have an interface for outputting a video signal to be displayed on LCD panel 112 or EVF 114 without having LCD panel 112 and EVF 114. In this case, the electronic device 100 displays an image or the like on an external monitor (such as a television).

The operation unit 106 is an input device for accepting user operations such as a character information input device such as a keyboard, a pointing device such as a mouse and a touch panel 120, a button, a dial, a joystick, a touch sensor, and a touch pad. The touch panel 120 is an input device (input surface) that is configured to overlap with the LCD panel 112 and output coordinate information corresponding to the touched position.
A recording medium 108 such as a memory card, CD, or DVD can be attached to the storage medium I / F 107. The storage medium I / F 107 reads data from the loaded recording medium 108 and writes data to the loaded recording medium 108 based on the control of the CPU 101.

The external I / F 109 is an interface that is connected to an external device by a wired cable or wirelessly to input / output a video signal or an audio signal. The communication I / F 110 is an interface for communicating with an external device, the Internet 111, etc. (including telephone communication) and transmitting / receiving various data such as files and commands.
The imaging unit 105 is a camera unit having an imaging element such as a CCD sensor or a CMOS sensor, a zoom lens, a focus lens, a shutter, a diaphragm, a distance measuring unit, an A / D converter, and the like. The imaging unit 105 can capture still images and moving images. The image data of the image captured by the image capturing unit 105 is transmitted to the image processing unit 104, subjected to various processes in the image processing unit 104, and then recorded on the recording medium 108 as a still image file or a moving image file.
The eyepiece detection unit 117 is a sensor for detecting that the operator is looking into the EVF 114. The eyepiece detection unit 117 includes an infrared light emitting device provided in the vicinity of the EVF 114 and a student device that detects the reflected light.

The CPU 101 receives the coordinate information of the touch position output from the touch panel 120 via the internal bus 150. Then, the CPU 101 detects the following operations and states based on the coordinate information.
An operation of touching the touch panel 120 with a finger or a pen (hereinafter referred to as touchdown).
A state where the touch panel 120 is touched with a finger or a pen (hereinafter referred to as touch-on).
An operation of moving the touch panel 120 while touching it with a finger or a pen (hereinafter referred to as a move).
An operation of releasing a finger or pen that has been touching the touch panel 120 (hereinafter referred to as touch-up).
A state in which nothing touches the touch panel 120 (hereinafter referred to as touch-off).
Further, when the CPU 101 detects a move, the CPU 101 determines the moving direction of the finger or pen based on the coordinate change of the touch position. Specifically, the CPU 101 determines a vertical component and a horizontal component in the moving direction on the touch panel 120.

The CPU 101 also detects stroke, flick, and drag operations. The CPU 101 detects a stroke when touch-up is performed through a certain move from touch-down. The CPU 101 detects a flick when a move of a predetermined distance or more and a predetermined speed or more is detected and a touch-up is subsequently detected. The CPU 101 also detects a drag when a move greater than a predetermined distance and less than a predetermined speed is detected.
Note that the flick is an operation of quickly moving a certain distance while touching the finger on the touch panel 120 and releasing the finger from the touch panel 120 as it is. That is, the flick is an operation of quickly tracing the touch panel 120 with a finger.

The touch panel 120 may be any of various types of touch panels such as a resistive film type, a capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. good.
The load detection unit 121 is provided integrally with the touch panel 120 by adhesion or the like. The load detection unit 121 is a strain gauge sensor, and detects a load (pressing force) applied to the touch panel 120 by utilizing the fact that the touch panel 120 is bent (distorted) by a small amount according to the pressing force of the touch operation. As another example, the load detection unit 121 may be provided integrally with the LCD panel 112. In this case, the load detection unit 121 detects a load applied to the touch panel 120 via the LCD panel 112.

The panel tactile sensation generating unit 122 generates a tactile sensation to be given to an operator such as a finger or a pen that operates the touch panel 120. That is, the panel tactile sensation generating unit 122 generates a stimulus that can be sensed by the touching user through the touched part. The panel touch generation unit 122 is provided integrally with the touch panel 120 by adhesion or the like. The panel tactile sensation generating unit 122 is a piezoelectric element, more specifically, a piezoelectric vibrator, and vibrates with an arbitrary amplitude and frequency under the control of the CPU 101. Thereby, the touch panel 120 is curved and vibrated, and the vibration of the touch panel 120 is transmitted to the operator as a tactile sensation. That is, the panel tactile sensation generating unit 122 gives a tactile sensation to the operation element by vibrating itself.
As another example, the panel touch generation unit 122 may be provided integrally with the LCD panel 112. In this case, the panel touch generation unit 122 causes the touch panel 120 to bend and vibrate via the LCD panel 112.

  The CPU 101 can generate various patterns of tactile sensations by changing the amplitude and frequency of the panel tactile sensation generating section 122 and vibrating the panel tactile sensation generating section 122 with various patterns.

Further, the CPU 101 can control the tactile sensation based on the touch position detected on the touch panel 120 and the pressing force detected by the load detection unit 121. For example, it is assumed that the CPU 101 detects the touch position corresponding to the button icon displayed on the LCD panel 112 in response to the touch operation of the operator, and the load detection unit 121 detects a pressing force equal to or greater than a predetermined value. In this case, the CPU 101 generates vibrations around one cycle. As a result, the user can perceive a tactile sensation such as a click feeling when pressing a mechanical button.
Further, the CPU 101 executes the function of the button icon only when the pressing force of a predetermined value or more is detected in a state where the touch to the position of the button icon is detected. That is, the CPU 101 does not execute the button icon function when a weak pressing force is detected, such as when the button icon is simply touched. Thereby, the user can perform an operation with the same feeling as when pressing a mechanical button.
The load detection unit 121 is not limited to a strain gauge sensor. As another example, the load detection unit 121 may include a piezoelectric element. In this case, the load detection unit 121 detects the load based on the voltage output from the piezoelectric element according to the pressing force. Further, the pressure element as the load detection unit 121 in this case may be the same as the pressure element as the panel tactile sensation generation unit 122.

Further, the panel tactile sensation generating unit 122 is not limited to the one that generates vibration by the pressure element. As another example, the panel tactile sensation generating unit 122 may generate an electric tactile sensation. For example, the panel tactile sensation generating unit 122 includes a conductive layer panel and an insulator panel. Here, like the touch panel 120, the conductive layer panel and the insulator panel are overlapped with the LCD panel 112 and provided in a plane. When the user touches the insulator panel, a positive charge is charged in the conductive layer panel. That is, the panel tactile sensation generating unit 122 can generate a tactile sensation as an electrical stimulus by charging the conductive layer panel with a positive charge. The panel tactile sensation generating unit 122 may give the user a feeling (tactile sensation) that the skin is pulled by the Coulomb force.
As another example, the panel tactile sensation generator 122 may include a conductive layer panel that can select whether to charge a positive charge for each position on the panel. Then, the CPU 101 controls the positive charge position. As a result, the panel tactile sensation generating unit 122 can give the user various tactile sensations such as a “cracking sensation”, “gritty feel”, and “smooth feeling”.
As another example, the panel tactile sensation generator 122 may generate a tactile sensation by ultrasonically vibrating the surface of the touch panel 120. Due to the ultrasonic vibration, a high-pressure air film is formed between the touch panel 120 and the finger. Therefore, the panel tactile sensation generating unit 122 may give a “smooth feeling” by the floating action of the air film, and give a “gritty feeling” by instantaneously switching the size of the floating action.

  The case tactile sensation generating unit 123 generates a tactile sensation by vibrating the entire electronic device 100. The case tactile sensation generating unit 123 includes, for example, an eccentric motor and realizes a known vibration function and the like. Thereby, the electronic device 100 can give a tactile sensation to the user's hand or the like holding the electronic device 100 by the vibration generated by the housing tactile sensation generating unit 123.

FIG. 2 is a flowchart showing tactile sensation control processing by the electronic device 100. The electronic device 100 according to the present embodiment controls tactile sensation generation based on whether the EVF 114 is being used. Specifically, the electronic device 100 does not generate the tactile sensation when the EVF 114 is not used and only the LCD panel 112 is used, and generates the tactile sensation when the EVF 114 is also used.
FIG. 3 is a view showing an example of a screen displayed on the LCD panel 112. On the screen 301 shown in FIG. 3, two buttons 302 and 303 are displayed. The user inputs an instruction to the electronic device 100 by touching these buttons 302 and 303. The EVF 114 may display a screen similar to the screen displayed on the LCD panel 112 or a different screen.

When an operation on the touch panel 120 is accepted by the user, in S201, the CPU 101 of the electronic device 100 detects an operation by the operator (detection process) and accepts an operation on the touch panel 120. The operations accepted at this time include touch-down, touch-on, move, touch-up, touch-off, etc. as described above. Hereinafter, an operation on the touch panel 120 using the operator by the user will be appropriately referred to as a panel operation. Next, in S202, the CPU 101 acquires the touch coordinates of the touch position in the panel operation.
Next, in S203, the CPU 101 confirms whether or not the touch position is within the button area. For example, in the example illustrated in FIG. 3, the CPU 101 determines that the touch position is within the button area when the touch position is the coordinates within the buttons 302 and 303. If the touch position is within the button area (YES in S203), the CPU 101 advances the process to S204. If the touch position is outside the button area (NO in S203), the CPU 101 advances the process to S211.

In step S204, the CPU 101 converts information indicating that the button has been operated into event information. Here, the event information is a command for executing a function assigned to the operated button. Examples of the command include executing a function such as opening a menu screen and closing the current screen. In step S205, the CPU 101 controls the display of the operated button in order to notify the user that the converted event information has been received. Specifically, the CPU 101 performs image processing that changes the display mode of the buttons so that the buttons appear to be pressed.
In S206, the CPU 101 determines whether the event information is valid in the scene at the time of processing. Specifically, the CPU 101 determines that the event information is invalid when the electronic device 100 does not have a function corresponding to the event information or when the electronic device 100 cannot operate the function. If the event information is valid (YES in S206), the CPU 101 advances the process to S207. If the event information is invalid (NO in S206), the CPU 101 advances the process to S211.

In S207, the CPU 101 acquires the usage status of the EVF 114. Next, in S208, the CPU 101 confirms whether the EVF 114 is in use from the usage status (confirmation process). In the present embodiment, the electronic device 100 acquires the detection result by the eyepiece detection unit 117 that detects the presence or absence of the eyepiece on the EVF 114 as the usage status. Then, the CPU 101 determines that the EVF 114 is in use when the usage status indicating that the eyepiece is detected in the usage status, and acquires the usage status indicating that the eyepiece is not detected. Is not in use. Note that the specific processing for determining whether or not the device is in use is not limited to the embodiment.
As another example, the CPU 101 may acquire a detection result by a detection unit (not shown) that detects the withdrawal of the EVF 114 as a usage state. In this case, the CPU 101 determines that the EVF 114 is in use when acquiring the usage status indicating that the drawer has been detected, and is using the EVF 114 when acquiring the usage status indicating that the drawer has not been detected. Judge that it is not.

If the EVF 114 is in use (YES in S208), the CPU 101 advances the process to S209. If the EVF 114 is not in use (NO in S208), the CPU 101 advances the process to S210. In step S <b> 209, the CPU 101 controls the panel tactile sensation generation unit 122 to generate a tactile sensation to be given to the operator via the touch panel 120 (tactile sensation control processing).
Next, in S210, the CPU 101 executes an event related to the event information. Next, in S211, the CPU 101 determines whether the processing is completed. If the CPU 101 determines that the process has been completed, the tactile sensation control process ends. If the CPU 101 determines that the process has not been completed, the process proceeds to S201.

  As described above, when the touch operation on the touch panel 120 is performed while using the EVF 114, the electronic device 100 according to the first embodiment generates a tactile sensation to be given to the operator. Thereby, even when the user performs the touch operation without looking at the LCD panel 112, the user can grasp whether or not the electronic device 100 has recognized the touch operation. That is, the electronic device 100 according to the present embodiment can provide an easy-to-use user interface using tactile feedback in an electronic device including a plurality of display devices.

The tactile sensation control process is a minimum operation of the electronic device 100, and the electronic device 100 further executes a display control process as described below. Thereby, the usability can be further improved.
FIG. 4 is a flowchart illustrating a first display control process executed by the electronic device 100 when the LCD panel 112 is in use and the EVF 114 is not used. The first display control process is performed in parallel with the tactile sensation control process described with reference to FIG. In step S <b> 401, the CPU 101 acquires switching information from the switching detection unit 116. Here, the switching information is information indicating whether or not switching between the LCD panel 112 and the EVF 114 of the display device is detected.

Next, in S402, the CPU 101 confirms whether or not display switching from the LCD panel 112 to the EVF 114 is detected based on the switching information. If the switching is detected (YES in S402), the CPU 101 advances the process to S404. If the switching is not detected (NO in S402), the CPU 101 advances the process to S403.
In S403, the CPU 101 continues the display on the LCD panel 112. On the other hand, in S404, the CPU 101 puts the LCD panel 112 into a non-display state. In step S405, the CPU 101 displays the EVF 114. Note that this process may be incorporated and executed in the display control process shown in FIG. As another example, the CPU 101 may change the display image of the LCD panel 112 to a lower-brightness image in S404, thereby setting the LCD panel 112 in a low-brightness state.
As described above, the CPU 101 realizes exclusive display on the LCD panel 112 and the EVF 114 based on the switching information when the EVF 114 is in use or when the user performs an operation without looking at the LCD panel 112. be able to.

FIG. 5 is a flowchart showing a second display control process executed by the electronic device 100 while the LCD panel 112 is being used. By the second display control process, the operation position of the touch operation on the touch panel 120 is displayed on the EVF 114. Thereby, operability can be improved.
In step S <b> 501, the CPU 101 acquires touch coordinates where a touch operation has been performed. Next, in S502, the CPU 101 determines whether or not the EVF 114 is in use. The process of S502 is the same as the process of S208. If the EVF 114 is in use (YES in S502), the CPU 101 advances the process to S503. If the EVF 114 is not in use (NO in S502), the CPU 101 ends the second display control process.
In step S <b> 503, the CPU 101 converts the touch coordinates of the touch position on the LCD panel 112 into coordinates in the EVF 114. In step S504, a guide image indicating the touch position is displayed on the EVF 114. Thus, the second display control process ends. Note that this process may be incorporated and executed in the display control process shown in FIG.

  FIG. 6 is a diagram for explaining the second display control process. FIG. 6A shows the LCD panel 112. A button 600 is displayed on the LCD panel 112. FIG. 6B is a diagram showing the EVF 114. A button 610 corresponding to the button 600 is displayed on the EVF 114. In this state, it is assumed that a touch operation to the position 601 is performed on the touch panel 120 corresponding to the LCD panel 112 as illustrated in FIG. In this case, as shown in FIG. 6B, the EVF 114 displays a guide image 612 indicating the touch position at a position 611 corresponding to the position 601.

Next, a modification example of the electronic device 100 according to the first embodiment will be described. FIG. 7 is a flowchart illustrating the second display control process according to the modification. In FIG. 7, processes similar to those in the second display control process according to the first embodiment are assigned the same numbers. In the modification example, electronic device 100 displays a guide image indicating the touch position on EVF 114 only when a specific position on touch panel 120 is touched. Thereby, the control burden of the electronic device 100 can be reduced, and unnecessary display on the EVF 114 can be prevented.
Hereinafter, differences of the second display control process according to the modified example from the second display control process according to the first embodiment will be described. If the EVF 114 is in use in S502 (YES in S502), the CPU 101 advances the process to S701. In step S <b> 701, the CPU 101 confirms whether or not the touch position is a specific position. Here, it is assumed that the specific position is a predetermined position, and is set in the nonvolatile memory 103 or the like, for example. If the touch position is the specific position (YES in S701), the CPU 101 advances the process to S503. If the touch position is a position other than the specific position (NO in S701), the CPU 101 ends the second display control process.

  FIG. 8 is a diagram for explaining the second display control process according to the modified example. FIG. 8A shows a specific position. In this example, as shown in FIG. 8A, the intersection value of the vertical and horizontal lines is determined as the specific position. Note that the CPU 101 may or may not display points or grids indicating specific positions on the LCD panel 112. When the specific position 801 shown in FIG. 8A is touched, the EVF 114 displays a guide image 812 indicating the touch position at a position 811 corresponding to the touched specific position 801, as shown in FIG. 8B. indicate.

(Second Embodiment)
The electronic device 100 according to the second embodiment varies tactile sensation control depending on whether the EVF 114 is in use. FIG. 9 is a flowchart illustrating tactile sensation control processing by the electronic device 100 according to the second embodiment. In FIG. 9, the same number is attached | subjected to the process similar to each process of the tactile sense control process which concerns on 1st Embodiment. Here, the tactile sensation control process according to the second embodiment will be described with respect to differences from the tactile sensation control process according to the first embodiment.

If the EVF 114 is not in use in S208 (NO in S208), the CPU 101 advances the process to S901. In step S901, the CPU 101 performs first tactile sensation control. Here, the first tactile sensation control is a process of controlling the panel tactile sensation generating unit 122 and generating a first tactile sensation to be given to the operator. In S208, if the EVF 114 is in use (YES in S208), the CPU 101 advances the process to S902.
In step S902, the CPU 101 performs second tactile sensation control. Here, the second tactile sensation control is a process of controlling the panel tactile sensation generating unit 122 and generating a second tactile sensation to be given to the operator. Here, the first tactile sensation and the second tactile sensation are different tactile sensations. The different tactile sensations are tactile sensations in which at least one of the strength of tactile sensation, or the type of tactile sensation such as a rough feeling or a rough feeling is different. Note that the processing in S901 and S902 is an example of tactile sensation control processing. Other configurations and processes of the electronic device 100 according to the second embodiment are the same as those of the electronic device 100 according to the first embodiment.
As described above, the electronic device 100 according to the second embodiment generates different tactile sensations depending on whether or not the EVF 114 is in use. Thereby, it is possible to provide a user interface with ease of use.

  As a modification example of the electronic device 100 according to the second embodiment, the second tactile sensation control is a process of generating a tactile sensation by controlling the housing tactile sensation generating unit 123 and vibrating the entire electronic device 100. Also good. Thereby, the electronic device 100 can give a user a tactile sensation even when the operator is not in contact with the touch panel 120.

(Third embodiment)
The electronic device 100 according to the third embodiment varies tactile sensation control according to whether the EVF 114 is in use and the touch position. FIG. 10 is a flowchart illustrating tactile sensation control processing by the electronic device 100 according to the third embodiment. Here, the tactile sensation control process according to the third embodiment will be described with respect to differences from the tactile sensation control process according to the first embodiment.

FIG. 11 is a diagram illustrating a display example of the LCD panel 112. FIG. 11A is a diagram showing a screen 1101 displayed when the EVF 114 is in use. A first area 1102 is set on the screen 1101. Here, the first area 1102 is an area in which, for example, a button for accepting a user operation is displayed.
FIG. 11B is a diagram showing a screen 1111 displayed when the EVF 114 is not in use. A second area 1112 and a third area 1113 are set on the screen 1111. Here, the third area 1113 is an area where buttons are displayed. The second area 1112 is an area in a predetermined range around the third area 1113.
Note that the first region 1102 and the third region 1113 may be the same region or different regions. In any case, it is assumed that the first area 1102 and the third area 1113 are areas where buttons are displayed.

  Hereinafter, tactile sensation control processing when the screens 1101 and 1111 shown in FIG. 11 are displayed will be described. In step S202, the CPU 101 obtains touch coordinates, and then advances the process to step S1001. In step S <b> 1001, the CPU 101 acquires the usage status of the EVF 114. In step S1002, the CPU 101 confirms whether the EVF 114 is in use. If the EVF 114 is in use (YES in S1002), the CPU 101 advances the process to S1007. If the EVF 114 is not in use (NO in S1002), the CPU 101 advances the process to S1003.

  In step S <b> 1003, the CPU 101 confirms whether the touch position is within the first area 1102. If the touch position is within the first area 1102 (YES in S1003), the CPU 101 advances the process to S1004. If the touch position is outside the first area 1102 (NO in S1003), the CPU 101 advances the process to S211. In S1004, the CPU 101 converts the touch coordinates into the first event. In step S <b> 1005, the CPU 101 controls display of the operated button. Next, in S1006, the CPU 101 performs first tactile sensation control, and then advances the process to S210. Here, the first tactile sensation control is a process of controlling the panel tactile sensation generating unit 122 to generate the first tactile sensation.

On the other hand, in S <b> 1007, the CPU 101 confirms whether or not the touch position is within the second area 1112. If the touch position is in the second region 1112 (YES in S1007), the CPU 101 advances the process to S1008. If the touch position is outside the second region 1112 (NO in S1007), the CPU 101 advances the process to S1010.
In step S1008, the CPU 101 converts the touch coordinates into the second event. Next, in S1009, the CPU 101 performs second tactile sensation control, and then advances the process to S210. Here, the second tactile sensation control is a process of controlling the panel tactile sensation generating unit 122 to generate a second tactile sensation different from the first tactile sensation.

In step S <b> 1010, the CPU 101 confirms whether the touch position is within the third area 1113. If the touch position is within the third region 1113 (YES in S1010), the CPU 101 advances the process to S1011. If the touch position is outside the third region 1113 (NO in S1010), the CPU 101 advances the process to S211.
In step S1011, the CPU 101 converts touch coordinates into a third event. In step S1012, the CPU 101 controls display of the operated button. Next, in S1013, the CPU 101 performs the third tactile sensation control, and then advances the process to S210. Here, the third tactile sensation control process is a process of controlling the panel tactile sensation generating unit 122 to generate a third tactile sensation different from both the first tactile sensation and the second tactile sensation. The first event, the second event, and the third event are executed in S210.
The remaining configuration and processing of the electronic device 100 according to the third embodiment are the same as the configuration and processing of the electronic device 100 according to other embodiments.

  As described above, the electronic device 100 according to the third embodiment generates different tactile sensations depending on whether or not the EVF 114 is in use and depending on the touch position. Thereby, for example, an erroneous operation when operating the touch panel 120 while watching the EVF 114 can be prevented. Therefore, it is possible to provide a user interface that is easier to use.

  As a first modification of the third embodiment, at least two of the first tactile sensation, the second tactile sensation, and the third tactile sensation may be the same. Further, the CPU 101 may perform a plurality of tactile sensation controls according to the number of preset areas, and the number is not limited to the embodiment.

  As a second modification, at least one of the second tactile sensation control and the third tactile sensation control is a process of controlling the housing tactile sensation generating unit 123 to generate a tactile sensation by vibrating the entire electronic device 100. There may be. Thereby, the electronic device 100 can give a user a tactile sensation even when the operator is not in contact with the touch panel 120. Further, in this case, the second tactile sensation generated in the second tactile sensation control and the third tactile sensation generated in the third tactile sensation control may be the same or different. Here, the different tactile sensations are tactile sensations generated by vibrations in which at least one of the magnitude of vibration and the vibration pattern is different.

(Fourth embodiment)
The electronic device 100 according to the fourth embodiment varies tactile sensation control depending on whether the EVF 114 is in use and the pressing force in the touch operation. FIG. 12 is a flowchart illustrating tactile sensation control processing by the electronic device 100 according to the fourth embodiment. Here, a difference between the tactile sensation control process according to the fourth embodiment and the tactile sensation control process according to the first embodiment will be described.
After the process of S202, the CPU 101 advances the process to S1201. In S <b> 1201, the CPU 101 acquires a pressing value indicating a pressing force at the time of the touch operation from the load detection unit 121, and then advances the process to S <b> 203. Thereafter, the CPU 101 performs the processes of S203 to S208. If the EVF 114 is in use in S208 (YES in S208), the CPU 101 advances the process to S1203. If the EVF 114 is not in use (NO in S208), the CPU 101 advances the process to S1202. In S1202, the CPU 101 performs first tactile sensation control. Here, the first tactile sensation control is a process of controlling the panel tactile sensation generating unit 122 and generating a first tactile sensation to be given to the operator.

In step S1203, the CPU 101 determines whether the pressing value acquired in step S1201 is greater than or equal to a preset reference value. If the pressed value is equal to or greater than the reference value (YES in S1203), the CPU 101 advances the process to S1205. If the pressed value is less than the reference value (NO in S1203), CPU 101 advances the process to S1204.
In step S1204, the CPU 101 performs second tactile sensation control. In S1205, the CPU 101 performs third tactile sensation control. Here, the second tactile sensation control is a process of controlling the panel tactile sensation generating unit 122 and generating a second tactile sensation to be given to the operator. The third tactile sensation control is a process of controlling the panel tactile sensation generating unit 122 to generate a third tactile sensation to be given to the operator. Here, the first tactile sensation, the second tactile sensation, and the third tactile sensation are all different tactile sensations. As another example, at least two of the first tactile sensation, the second tactile sensation, and the third tactile sensation may be the same tactile sensation.

For example, in S1202, the CPU 101 generates a tactile sensation (first tactile sensation) corresponding to the button operation. When the pressing force is less than the reference value, the CPU 101 generates a tactile sensation (second tactile sensation) for notifying the user that the button has been touched in S1204. Then, when the pressing force exceeds the reference value, the CPU 101 generates a tactile sensation (third tactile sensation) for notifying the user that a still image is to be recorded in S1205. Thereby, it is possible to notify the user that each of the two-step operations such as a photo button for receiving a still image recording instruction has been received.
In S210, the CPU 101 executes an event corresponding to each condition. For example, in the example of still image recording, when the EVF 114 is not in use, the CPU 101 records a still image in S210. If the EVF 114 is in use and the pressing value is less than the reference value, the CPU 101 executes only the focusing operation in S210. On the other hand, when the EVF 114 is in use and the pressing value is greater than or equal to the reference value, the CPU 101 records a still image in S210.
The remaining configuration and processing of the electronic device 100 according to the fourth embodiment are the same as the configuration and processing of the electronic device 100 according to the other embodiments.

  As described above, the electronic device 100 according to the present embodiment generates different tactile sensations according to the pressing force as well as whether or not the EVF 114 is in use. Accordingly, it is possible to notify the user that a different instruction has been received according to the pressing force.

<Other embodiments>
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media. Then, the computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the program.

  As mentioned above, according to each embodiment mentioned above, in an electronic device provided with a plurality of display devices, it is possible to provide an easy-to-use user interface using tactile feedback.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications can be made within the scope of the gist of the present invention described in the claims.・ Change is possible.

100 electronic equipment, 101 CPU, 102 memory, 103 nonvolatile memory, 112 LCD panel, 114 EVF, 120 touch panel, 121 load detection unit, 122 panel touch generation unit, 123 housing touch generation unit

Claims (7)

Imaging means;
First display means;
Second display means as an electronic viewfinder disposed at a position different from the first display means;
Eyepiece detecting means for detecting an eyepiece with respect to the second display means;
First detection means for detecting an operation by an operator on an input surface provided corresponding to the first display means;
A first tactile giving vibration to the operator, a second touch giving vibration to the operator of a different tactile sensation as the first touch, and the first touch and the second touch Has a tactile sensation generating means for generating a third tactile sensation having different tactile sensations and applying vibration to the operation element ,
The tactile sensation generating means includes
When an eyepiece is not detected by the eyepiece detection means, and the first detection means detects that the operation element touches outside the area of the button displayed on the first display means as the operation. Does not generate a touch,
The eyepiece detecting means detects that the eyepiece is not detected, and the first detecting means detects that the operation element has touched the area of the button displayed on the first display means as the operation. If the first tactile sensation is generated,
An eyepiece is detected by the eyepiece detecting means, and the operation element is outside the area of the button displayed on the first display means as the operation by the first detecting means so as to surround the button. When it is detected that a touch has been made within the set area, the second tactile sensation is generated,
An eyepiece is detected by the eyepiece detection means, and the operation element touches outside the region set to surround the button displayed on the first display means as the operation by the first detection means. Does not generate a tactile sensation,
When the eyepiece is detected by the eyepiece detection unit, and the first detection unit detects that the operation element has touched the button area displayed on the first display unit as the operation. An electronic apparatus that generates the third tactile sensation . Display control means for controlling the display of the first display means;
The display control means includes
When the first tactile sensation and the third tactile sensation are generated by the tactile sensation generating means, a display for changing the display form of the buttons is performed,
2. The electronic device according to claim 1, wherein when the second tactile sensation is generated and when the tactile sensation is not generated, control is performed so as not to perform display for changing a display form of the button. A region of a button displayed on the first display means when an eyepiece is detected by the eyepiece detection means;
3. The electronic device according to claim 1 , wherein an area of the button displayed on the first display unit when the eyepiece is not detected by the eyepiece detection unit is the same region. 4. When the eyepiece detecting unit detects an eyepiece, the second display unit is in use, and the first display unit is in a non-display state or a low luminance state. Item 4. The electronic device according to any one of Items 1 to 3 . Imaging means;
First display means;
Second display means as an electronic viewfinder disposed at a position different from the first display means;
Eyepiece detecting means for detecting an eyepiece with respect to the second display means;
First detection means for detecting an operation by an operator on an input surface provided corresponding to the first display means;
A first tactile sensation that imparts vibration to the operation element, a second tactile sensation different from the first tactile sensation that imparts vibration to the operation element, the first tactile sensation, and the second tactile sensation A tactile sensation generating means for generating a third tactile sensation having different tactile sensations and applying vibration to the operation element
A tactile sensation control method executed by an electronic device having
When an eyepiece is not detected by the eyepiece detection means, and the first detection means detects that the operation element touches outside the area of the button displayed on the first display means as the operation. Does not generate a touch,
The eyepiece detecting means detects that the eyepiece is not detected, and the first detecting means detects that the operation element has touched the area of the button displayed on the first display means as the operation. In some cases, generating the first tactile sensation;
An eyepiece is detected by the eyepiece detecting means, and the operation element is outside the area of the button displayed on the first display means as the operation by the first detecting means so as to surround the button. When it is detected that a touch has been made within the set area, the second tactile sensation is generated,
An eyepiece is detected by the eyepiece detection means, and the operation element touches outside the region set to surround the button displayed on the first display means as the operation by the first detection means. Does not generate a tactile sensation,
When the eyepiece is detected by the eyepiece detection unit, and the first detection unit detects that the operation element has touched the button area displayed on the first display unit as the operation. And generating the third tactile sensation . The program for functioning a computer as each means of the electronic device as described in any one of Claims 1 thru | or 4 . A computer-readable storage medium storing a program for causing a computer to function as each unit of the electronic device according to any one of claims 1 to 4 .

Images