JP2012234387A - Electronic apparatus, display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to confirm whether he/she has successfully performed desired gesture input on an electronic apparatus.SOLUTION: An electronic apparatus is equipped with a luminous body 24 composed of a plurality of illuminants arranged around a touch panel operation unit 12. When a user touches the touch panel operation unit 12 with a finger and further performs gesture input by moving the finger in a predetermined movement, the electronic apparatus causes the luminous body 24 to emit light in an emission pattern corresponding to the type of the gesture input. Thus, the user can visually confirm whether the user has successfully performed desired gesture input on the electronic apparatus.

Description

  The present invention relates to an electronic device including a touch panel operation unit such as a tablet personal computer or a smartphone, a display method of the electronic device, and a program.

  As an operation unit of a personal computer or a portable terminal device, key input such as a keyboard and a numeric keypad has been mainstream. In the case of such a key input, the feeling when the key is physically pressed is directly transmitted to the user, so that the input operation can be performed reliably. However, in the case of key input, a plurality of physical keys must be prepared for the device, which hinders miniaturization and weight reduction.

  On the other hand, in a multifunctional portable terminal device called a tablet-type personal computer or a smartphone, a touch panel operation unit in which a touch panel is stacked on a display panel is provided, and a user touches the touch panel operation unit with a finger, Various inputs can be made. In such touch panel input, it is not necessary to prepare a physical key in the device, and the size and weight can be reduced. Moreover, in touch panel operation, operation is easy to understand intuitively.

The touch panel not only accepts touch input based on the position where the user's finger touches the touch panel, but also makes so-called gesture input that touches the touch panel operation unit and moves the finger in a predetermined manner. There is something to accept.
For example, the remote control transmitter described in Patent Literature 1 determines the gesture input of the operator from the movement locus of the input operation to the touch panel sheet, and transmits control data corresponding to the gesture input to the controlled device. Thereby, it is supposed that the operator can remotely control the controlled device by gesture input for moving the thumb holding the case without looking at the control content.

JP 2010-193107 A

  When there are a plurality of gestures that can be input in the gesture input, the user may not be able to grasp whether or not the desired input has been performed. For example, the remote control transmitter described in Patent Document 1 accepts a gesture input that moves the thumb in any direction of right and left. When the gesture is input, if the direction in which the finger is moved becomes oblique, the user may not be able to grasp which gesture input is accepted.

  An object of this invention is to provide the electronic device, display method, and program which can solve the above-mentioned subject.

  The present invention has been made to solve the above-described problems, and an electronic apparatus according to an aspect of the present invention includes a touch panel operation unit in which a touch panel is stacked on a display panel, and a position surrounding the touch panel operation unit. And a means for controlling the light emission pattern of the light emitter according to the type of input in which the user touches the touch panel operation unit with a finger and further moves the finger in a predetermined manner of movement. It is characterized by providing.

  According to another aspect of the present invention, there is provided a display method for an electronic device including a touch panel operation unit in which a touch panel is stacked on a display panel, and having a light emitter at a position surrounding the touch panel operation unit. When it is detected that the user touches the touch panel operation unit with a finger and the finger is further moved in a predetermined manner, the light emission is performed according to the type of input in which the finger is moved in the predetermined manner. It is characterized by controlling the light emission pattern of the body.

  The program according to one embodiment of the present invention is a program for an electronic device including a touch panel operation unit in which a touch panel is stacked on a display panel, and a light emitter is provided around the touch panel operation unit. And detecting that the user has touched the touch panel operation unit with a finger, and detecting that the user has further moved the finger in a predetermined manner on the touch panel operation unit, and determining the type of input. And a step of controlling a light emission pattern of the light emitter in accordance with a type of input in which the user touches the touch panel operation unit with a finger and the finger is moved in a predetermined manner. .

  According to the present invention, the user can confirm whether or not a desired gesture input has been performed.

It is a top view which shows the outline | summary of the external shape of the portable terminal device in the 1st Embodiment of this invention. It is a disassembled perspective view which shows schematic structure of the touchscreen operation part in the embodiment. It is explanatory drawing which shows the example of the light emission pattern of the light-emitting body in the embodiment. It is a block diagram which shows schematic structure of the portable terminal device in the embodiment. It is a flowchart used for operation | movement description of the portable terminal device in the embodiment. It is a block diagram which shows schematic structure of the portable terminal device in the 2nd Embodiment of this invention.

<First Embodiment>
Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a plan view showing an outline of an external shape of a mobile terminal device as an example of an electronic apparatus in the first embodiment of the present invention. As shown in the figure, a touch panel operation unit 12 is disposed on the casing 11 of the mobile terminal device 1 over substantially the entire surface thereof.

  FIG. 2 is an exploded perspective view showing a schematic configuration of the touch panel operation unit 12. As shown in the figure, the touch panel operation unit 12 is configured by laminating a touch panel 22 on a display panel 21 and further laminating a protective screen 23 thereon.

  The display panel 21 is configured by an LCD (Liquid Crystal Display) display, an organic EL (Electro Luminescence) display, or the like, and displays various types of information such as icons and keys. When touch panel 22 receives contact, touch panel 22 outputs a detection signal corresponding to the coordinates of the touched portion. As the touch panel 22, various types such as a capacitance method and a resistance film method can be used. The touch panel 22 corresponds to a single operation for detecting the coordinates of one touched finger part and a multi-operation for detecting the coordinates of two or more touched finger parts.

  In the touch panel operation unit 12, various types of information such as icons and buttons are displayed on the display panel 21. In response to this display, when the user touches the touch panel operation unit 12 with a finger, a detection signal corresponding to the operation of the finger is output from the touch panel 22. In this way, the touch panel operation unit 12 receives various inputs by a touch operation in which the user touches the touch panel operation unit 12 with a finger.

  The touch panel operation unit 12 can detect not only touch position detection for detecting a position on the display panel touched by a finger but also gesture input. Here, “gesture input” is to perform a predetermined input by touching the touch panel operation unit 12 with a finger and further moving the finger in a predetermined manner.

  Typical gesture input includes “flick”, “zoom in”, “zoom out”, “rotate”, and the like. “Flick” is an operation of touching the touch panel operation unit 12 with a finger and sliding it on a straight line. “Zoom out” is an operation of touching the touch panel operation unit 12 with two fingers and moving the two fingers apart. “Zoom in” is an operation of touching the touch panel operation unit 12 with two fingers and moving the two fingers closer together. “Rotate” is an operation of touching the touch panel operation unit 12 with two fingers, fixing one finger, and rotating the other finger.

  Further, as shown in FIG. 2, a light emitter 24 is provided at a position surrounding the periphery of the touch panel operation unit 12 (that is, a position surrounding the periphery of the display panel 21 or the touch panel 22). The light emitter 24 is configured by arranging a plurality of light sources such as a plurality of LEDs (Light Emitting Diodes). In addition, the structure of the light emitter 24 is not limited to a structure in which a plurality of light sources are provided. For example, the light emitter 24 may be configured by a display panel such as an organic EL, an inorganic EL, or an LCD provided at a position surrounding the periphery of the touch panel operation unit 12. Moreover, you may make it comprise combining these.

In the mobile terminal device 1, when a gesture input is performed on the touch panel operation unit 12, the light emitter 24 emits light with a light emission pattern corresponding to the type of gesture input.
Here, FIG. 3 is an explanatory diagram illustrating an example of a light emission pattern of the light emitter 24.
FIG. 5A shows an example of the light emission pattern of the light emitter 24 when a right flick input is performed. As shown in FIG. 6A, when a right flick input is performed, the light emitters have a pattern in which light flows in two directions from the center on the left side to the center on the right side as indicated by arrows A11 and A12. 24 emits light.

  FIG. 3B shows an example of the light emission pattern of the light emitter 24 when the lower flick input is performed. As shown in FIG. 5B, when a lower flick input is performed, a pattern in which light flows in two directions from the center of the upper side toward the center of the lower side as indicated by arrows A21 and A22 is generated. In addition, the light emitter 24 emits light.

  FIG. 3C shows an example of the light emission pattern of the light emitter 24 when zoom-out input is performed. As shown in FIG. 6C, when zoom-out input is performed, as shown by arrows A31 and A32, a pattern in which light flows in two directions from the center on the left to the upper and lower centers is generated. As indicated by A33 and A34, the light emitter 24 emits light so that a pattern in which light flows in two directions from the center on the right side to the upper and lower centers respectively.

  FIG. 3D shows an example of the light emission pattern of the light emitter 24 when zoom-in input is performed. As shown in FIG. 6D, when zoom-in input is performed, as indicated by arrows A41 and A42, a pattern in which light flows in two directions from the center on the upper side to the centers on the left and right is generated, and the arrow A43 And A44, the light emitter 24 emits light so that a pattern in which light flows in two directions from the lower center to the left and right centers is generated.

  FIG. 3E shows an example of the light emission pattern of the light emitter 24 when the rotate input is performed. As shown in FIG. 5E, when the rotation input is performed, the light emitter 24 emits light in a pattern in which light flows from the lower center according to the rotation direction.

  FIG. 4 is a block diagram illustrating a schematic configuration of the mobile terminal device 1. In the figure, the mobile terminal device 1 includes a touch panel operation unit 12, a light emitter 24, a host CPU 51, a ROM 52, a flash memory 53, a RAM 54, a wireless communication unit 56, a display drive unit 57, and a touch panel control. Part 58 and a light emitter driving part 59. The touch panel operation unit 12 includes a display panel 21 and a touch panel 22.

  A host CPU (Central Processing Unit) 51 controls each part of the mobile terminal device 1. The host CPU 51 is an example of a unit that controls lighting states of a plurality of light sources of the light emitter in the present invention, and emits a light emission control signal of a light emission pattern corresponding to the type of gesture accepted by the touch panel operation unit 12 as described later. By outputting to the body drive unit 59, the light emission pattern of the light emitter 24 is controlled.

  A ROM (Read Only Memory) 52 stores in advance various programs that the host CPU 51 reads and executes, such as a boot program, a basic program, and various application programs. The flash memory 53 stores various preset data and data for storage. A RAM (Random Access Memory) 54 is a memory for data processing.

  The wireless communication unit 56 performs data communication by transmitting and receiving radio waves. Various communication methods of the wireless communication unit 56 can be used. For example, the wireless communication unit 56 may perform communication according to a communication method such as IEEE802.11b / g or IEEE802.11n, or PDC (Personal Digital Cellular), GSM (Global System for Mobile Communication), You may make it communicate according to the communication system in a mobile telephone, such as CDMA (Code Division Multiple Access) or WCDMA (Wideband CDMA).

  The display drive unit 57 displays various information on the display panel 21 in response to an instruction from the host CPU 51. The touch panel control unit 58 detects the touch position (coordinates on the touch panel 22) and the movement of the user's finger that has touched the touch panel 22, and outputs the information to the host CPU 51. In response to an instruction from the host CPU 51, the light emitter drive unit 59 controls the light emission order and the light emission time of the LEDs 60a, 60b, 60c,... Arranged in the light emitter 24, and the LEDs 60a, 60b, 60c,. Is turned on with a predetermined light emission pattern.

Next, the operation of the mobile terminal device 1 will be described with reference to FIG.
As described above, when the user touches the touch panel operation unit 12 with a finger and further performs a gesture input by moving the finger with a predetermined operation, the mobile terminal device 1 emits light with a light emission pattern corresponding to the type of the gesture input. The body 24 emits light.

FIG. 5 is a flowchart showing a processing procedure for causing the mobile terminal device 1 to emit light with the light emission pattern corresponding to the type of gesture input.
In the figure, the host CPU 51 determines whether or not the user's finger touches the touch panel operation unit 12 based on the output of the touch panel control unit 58 (step S1). If it is determined (detected) that the user's finger has touched the touch panel operation unit 12 (step S1: YES), the coordinates of the position touched by the finger and the movement of the finger are determined (step S2). Then, the host CPU 51 determines the type of gesture from the movement of the user's finger (step S3).

  When the type of gesture is determined, the host CPU 51 outputs a light emission control signal of a light emission pattern corresponding to the determined type of gesture to the light emitter driving unit 59 (step S4). When the light emitter drive unit 59 receives the output of the light emission control signal from the host CPU 51, the LEDs 60a, 60b, 60c,... Of the light emitter 24 have a light emission pattern corresponding to the type of gesture as shown in FIG. Is turned on (step S5).

  As described above, in the mobile terminal device 1 according to the first embodiment of the present invention, the light emitter 24 is provided so as to surround the touch panel operation unit 12, and the user touches the touch panel operation unit 12 with a finger. When the finger is further moved in a predetermined manner and gesture input is performed, the light emitter 24 emits light with a light emission pattern corresponding to the type of gesture input. Thereby, the user can confirm visually intuitively whether the desired gesture input was performed. Moreover, in the portable terminal device 1 according to the first embodiment of the present invention, the light emitting body 24 emits illumination light in response to a gesture input to the touch panel operation unit 12 by the user, so that it is easy for the user to use and enjoy. Can provide.

In the mobile terminal device 1, since the light emitter 24 is provided at a position surrounding the touch panel operation unit 21, the gesture accepted by the light emission pattern of the light emitter 24 even for more complicated gesture input. Input can be presented to the user visually.
For example, as a gesture input, the mobile terminal device 1 touches the touch panel operation unit with a finger and slides it on a straight line, touches two fingers with the touch panel operation unit, and spreads or brings these two fingers closer together. When an operation of moving or two fingers touching the touch panel operation unit and an operation of fixing one finger and rotating the other finger can be received, the received gesture input is visually recognized by the user with the light emission pattern described in FIG. Can be presented.

  In the first embodiment described above, the coordinates and movement information of the user's finger detected by the touch panel control unit 58 are output to the host CPU 51, and the light emitter driving unit 59 receives the instruction from the host CPU 51. Although the light emitter 24 is turned on with a light emission pattern corresponding to the type of gesture, the type of gesture is determined from the information of the user's finger coordinates and movement detected by the touch panel control unit 58, and this type of gesture is determined. The result may be directly output to the light emitter driving unit 59 without going through the host CPU 51, and the light emitter 24 may be controlled to light with a predetermined light emission pattern.

  In order to directly output information on the coordinates and movements of the user's finger detected by the touch panel control unit 58 to the light emitter driving unit 59, for example, the touch panel control unit 58 detects the coordinates and movements of the user's finger detected by itself. A circuit for detecting a specific pattern (that is, a circuit for detecting a specific gesture) is provided for each type of gesture to be detected. When any of the circuits detects a gesture, the touch panel control unit 58 turns on the light emitter 24 with a light emission pattern corresponding to the circuit.

  As described above, the coordinates of the user's finger detected by the touch panel control unit 58 and the information on the movement are directly output to the light emitter driving unit 59 without using the host CPU 51, thereby reducing power consumption. Can also be expected to improve response.

<Second Embodiment>
FIG. 6 is a block diagram showing a schematic configuration of the mobile terminal device according to the second embodiment of the present invention. In the figure, the mobile terminal device (electronic device) 2 includes a touch panel operation unit 12, a light emitter 24, a host CPU 51, a ROM 52, a flash memory 53, a RAM 54, a wireless communication unit 56, and a display drive unit 57. A touch panel control unit 58, a light emitter drive unit 59, a vibration unit 61, and a vibration drive unit 62. The touch panel operation unit 12 includes a display panel 21 and a touch panel 22.
In the same figure, parts having the same functions corresponding to the respective parts in FIG. 4 have the same reference numerals (12, 21, 22, 24, 51, 52, 53, 54, 56, 57, 58, 59). , 60a, 60b, 60c), and the description thereof is omitted.

As described above, in the mobile terminal device 1 according to the first embodiment, when the user touches the touch panel operation unit 12 and performs a gesture input, the light emitter 24 lights up with a light emission pattern corresponding to the type of gesture.
On the other hand, in the mobile terminal device 2 according to the second embodiment, the vibration unit 61 is further provided. When the user touches the touch panel operation unit 12, the host CPU 51 controls and drives the vibration drive unit 62 to vibrate. The part 61 vibrates. Thus, when the user touches the touch panel operation unit 12, the user can grasp as a sense that the touch panel operation unit 12 has been operated by the vibration. As described above, in the portable terminal device 2, the user can grasp the operation more intuitively by combining the illumination of the light emitter 24 and the vibration of the finger to be operated, and provides the user with ease of use and enjoyment. A possible portable terminal device can be realized.

  In addition, the vibration part 61 is provided with respect to the protective screen 23 of the touchscreen operation part 12, for example. Or you may make it provide the vibration part 61 with respect to the housing | casing 11 of the portable terminal device 1. FIG.

  Further, in the above-described example, the illumination by the light emitter 24 and the vibration of the finger by the vibration unit 61 are combined. However, the light emitter 24 can be used for various information notifications such as calls, incoming mails, games, etc. It may be combined with illumination light emission of various applications.

  In the above example, the mobile terminal device having the touch panel operation unit has been described. However, the present invention is not limited to the mobile terminal device, and various electronic devices having a touch panel operation unit such as a tablet personal computer and various video devices. It can be applied to equipment.

Note that a program for realizing all or part of the functions of the mobile terminal device 1 or 2 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. The processing of each unit may be performed as necessary. Here, the “computer system” includes an OS and hardware such as peripheral devices.
Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design changes and the like without departing from the gist of the present invention.

DESCRIPTION OF SYMBOLS 1, 2 Portable terminal device 11 Case 12 Touch panel operation part 21 Display panel 22 Touch panel 23 Protective screen 24 Luminescent body 51 Host CPU
52 ROM
53 Flash memory 54 RAM
56 wireless communication unit 57 display drive unit 58 touch panel control unit 59 light emitter drive unit 61 vibration unit 62 vibration drive unit

Claims (5)

A touch panel operation unit formed by laminating a touch panel on a display panel;
A light emitter disposed in a position surrounding the periphery of the touch panel operation unit;
An electronic apparatus comprising: means for controlling a light emission pattern of the light emitter according to a type of input in which a user touches the touch panel operation unit with a finger and further moves the finger with a predetermined movement method.   The type of input that is performed by a user touching the touch panel operation unit with a finger and further moving the finger in a predetermined manner includes touching the touch panel operation unit and sliding the finger on a straight line. Including touching the touch panel operation unit and moving the two fingers so as to spread or move the two fingers together, touching the two fingers to the touch panel operation unit, and fixing one finger and rotating the other finger. The electronic device according to claim 1.   The electronic apparatus according to claim 1, further comprising a vibration unit that notifies the touch panel operation unit that the user has touched with a finger by vibration. A display method of an electronic device comprising a touch panel operation unit formed by laminating a touch panel on a display panel, and having a light emitter at a position surrounding the periphery of the touch panel operation unit,
When it is detected that the user touches the touch panel operation unit with a finger and the finger is further moved in a predetermined manner, the light emitter is selected in accordance with the type of input in which the finger is moved in the predetermined manner. A display method characterized by controlling the light emission pattern. A program for an electronic device having a touch panel operation unit formed by laminating a touch panel on a display panel,
A light emitter is provided around the touch panel operation unit,
Detecting that the user touches the touch panel operation unit with a finger;
Detecting that the user has further moved the finger in a predetermined manner on the touch panel operation unit, and determining the type of input; and
And a step of controlling a light emission pattern of the light emitter in accordance with a type of input in which the user touches the touch panel operation unit with a finger and the finger is moved in a predetermined manner. An executable program.

Images