JP5355850B2 - Portable electronic device and display control method for portable electronic device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable electronic device that has sensor elements and provides comfortable operability that does not make a user feel troublesome. <P>SOLUTION: When a control section controls the display of a display section according to the contact detected by a sensor element in each sensor element group mounted in the portable electronic device, a plurality of selection items are displayed in parallel in the direction parallel to a predetermined direction on the display section, a cursor for selecting at least one from the plurality of selection items is displayed, and control is performed so that the selected item of the plurality of selection items is changed by the cursor in response to the transition of the position of the contact detection of the plurality of sensor elements constituting the first sensor element group during the display of the plurality of selection items. <P>COPYRIGHT: (C)2008,JPO&amp;INPIT

Description

  The present invention relates to a portable electronic device, and more particularly to a portable electronic device provided with a plurality of sensor elements that detect contact as an operation input unit and a display control method thereof.

  Conventionally, various interfaces and configurations have been developed as operation input units of portable electronic devices according to their functions and designs. For example, there is a technique in which a rotary electronic input device is provided in a portable electronic device, and a cursor displayed on a display unit is moved according to the amount of rotation of the rotary dial input device (see, for example, Patent Document 1). However, since these conventional technologies use a “rotary dial” that involves physical and mechanical rotation, malfunctions and breakdowns are likely to occur due to mechanical wear, etc., and maintenance of the operation input unit is required. There was a problem that the service life was short.

In view of this, a technique using a sensor element as an operation input unit that does not involve physical or mechanical rotation has been proposed (see, for example, Patent Documents 2 and 3). In this proposed technology, a plurality of sensor elements are arranged in an annular shape, the control unit monitors contact detection from each sensor element, and if continuous contact is detected, it responds to the transition of the contact detection location. Thus, it is determined that an instruction to move the display position has occurred.
Japanese Patent Laid-Open No. 2003-280792 Japanese Patent Laid-Open No. 2005-522797 JP 2004-31196 A

  26 and 27 show conventional sensor elements and control examples thereof. As shown in FIGS. 26 (a) and 27 (a), for example, when a sensor element for detecting contact is traced clockwise with a finger as indicated by an arrow AR in FIG. 26 (a). In FIG. 27B, an operation target area (such as a cursor shown on LS3 by hatching) indicating which one of the items LS1 to LS8 on the display unit in the display unit is selected is scrolled downward. When tracing counterclockwise as indicated by the arrow AR in (b), a “movement rule” such as scrolling upward as shown in FIG. However, in such a “movement rule”, when the finger is traced clockwise from the lower left to the “upper” of the sensor element provided in the annular shape, for example, the operation target area among the items LS1 to LS8 of the display unit Since LS3 “scrolls downward”, the movement direction of the user's finger and the scroll direction of the items on the display unit do not match, and many users feel uncomfortable with the operability. The general user intuitively expects the display item to move in the same way as the direction of his / her finger, but with this proposed technology, the display operation on the opposite side is different from his / her expectation. You will feel stress. In other words, the physical movement (circular movement) of the user's finger that instructs movement does not match the scrolling movement of the display item (vertical direction, horizontal direction), so the user looks at the screen while actually moving the finger. Unless it is confirmed, it is difficult to grasp the scroll direction. Therefore, not only a rotary dial type but also a sensor element type that detects contact is still insufficient as a user interface for moving a selection item by a user's intuitive operation.

  In addition, it is desirable to mount the sensor element and the display unit on the outer surface of the casing in a small portable electronic device having a small mounting area on the outer surface of the casing without impairing operability and design. In that case, the sensor element is inevitably small, and the sensor element at the position intended by the user cannot be touched correctly, and the cursor and the operation target area displayed on the display unit move in an unexpected direction. . For example, if the user's finger that instructs movement on the sensor element touches a sensor element that causes an unintended instruction operation due to excessive movement, the operation of the display unit different from that intended by the user Become. This can also be a factor that causes the user to feel stress. This is particularly noticeable before the user is accustomed to using the portable electronic device. Accordingly, there is a need for a technique that avoids / invalidates erroneous contact of sensor elements that may occur due to carelessness or inexperience of the user while faithfully following the user's instruction operation.

  The present invention solves the above-mentioned problems, avoids an operation (that is, an erroneous instruction operation) that can be performed unintentionally by the user while appropriately responding to the instruction operation of the user, and makes the user troublesome. An object of the present invention is to provide a portable electronic device that provides comfortable and intuitive operability without making it feel and a display control method thereof.

In order to achieve the above object, a portable electronic device according to a first aspect of the present invention includes a first sensor element group in which a plurality of sensor elements whose contact is detected are arranged adjacently and continuously,
A display unit disposed adjacent to the first sensor element group on the surface on which the first sensor element group is provided;
A control unit for controlling display of the display unit;
With
The plurality of sensor elements constituting the first sensor element group are arranged in a predetermined first direction component on the same plane as the display surface of the display unit and on the same plane as the display surface. When decomposing into two directional components of a second direction component orthogonal to the first direction, one of the first and second direction components increases as the other increases, and the one decreases Arranged such that the other has an increasing relationship as it decreases,
In the state where the control unit displays a plurality of selection items arranged in a direction parallel to the first direction on the display unit, the plurality of sensor elements constituting the first sensor element group are in contact transition. The display unit changes the display of the item selected in the plurality of selection items according to a change in position in a direction parallel to the component of the first direction among the transition directions of the contact. controls,
A second sensor element group constituted by the same number of sensor elements as the plurality of sensor elements constituting the first sensor element group;
An end portion of the first sensor element group and an end portion of the second sensor element group are arranged so as to be adjacent to each other,
When one of the plurality of sensor elements of the first or second sensor element group detects a contact transition, the control unit detects a transition of the contact in a direction parallel to the component of the first direction. The display of the item selected in the plurality of selection items is changed in one direction according to the change in position, and when the other plurality of sensor element groups detect the contact transition continuously, the transition of the contact is detected. The display unit is configured to change the display of an item selected in the plurality of selection items in a direction opposite to the one direction in response to a change in position in a direction parallel to the component in the first direction. It is characterized by controlling .

Furthermore, in order to achieve the above object, according to the method of the second aspect of the present invention, the arrangement direction of each element is a component in a predetermined first direction on the same plane as the display surface of the display unit and the display surface When one of the first and second direction components increases, the other decreases as the two direction components of the second direction component orthogonal to the first direction on the same plane And a display control method of a portable electronic device including a sensor element group arranged so that the other increases as the one decreases.
Displaying a plurality of selection items side by side in a direction parallel to the first direction on the display unit;
Detecting a transition of contact between the plurality of sensor elements constituting the first sensor element group;
Identifying a change in position in a direction parallel to the first direction component of the contact transition direction based on detection of the contact transition;
In response to changes in the identified position, we have a, and controlling the display unit so as to shift the displayed items are selected in the plurality of selection items,
A second sensor element group constituted by the same number of sensor elements as the plurality of sensor elements constituting the first sensor element group;
An end portion of the first sensor element group and an end portion of the second sensor element group are arranged so as to be adjacent to each other,
When one of the plurality of sensor elements of the first or second sensor element group detects a contact transition, it responds to a change in position in a direction parallel to the component of the first direction in the contact transition direction. When the display of the item selected in the plurality of selection items is changed in one direction, and the other plurality of sensor element groups detect contact transitions in succession, the first of the contact transition directions is Controlling the display unit to change the display of an item selected in the plurality of selection items in a direction opposite to the one direction according to a change in position in a direction parallel to a component of one direction;
It is characterized in that have a.

  According to the present invention, while following the user's instruction operation faithfully, avoiding malfunction due to erroneous contact of the sensor element that may occur due to user's carelessness or inexperience, comfortable and intuitive operation without making the user feel complicated It is possible to provide a portable electronic device that imparts performance.

  Embodiments of the present invention will be described below in detail with reference to the drawings. In this embodiment, the present invention is applied to a mobile phone terminal as a typical example of a mobile electronic device.

(First embodiment)
FIG. 1 is a block diagram showing an outline of the mobile phone terminal of this embodiment. The cellular phone terminal 100 shown in the figure includes a control unit 110, a sensor unit 120, a display unit 130, a storage unit (flash memory or the like) 140, an information processing function unit 150, a telephone function unit 160, a key operation unit KEY, and a speaker SP. Further, the communication unit COM is connected to a CDMA communication network (not shown) to perform communication. Further, the sensor unit 120 uses a sensor element group including a plurality of sensor elements (for example, a contact sensor whose detection unit is provided on the outer surface of the device housing and detects contact / proximity of an object such as a finger) Corresponding to n, that is, the first sensor element group G1, the second sensor element group G2, and the nth sensor element group G3. The storage unit 140 includes a storage area 142 and an external data storage area 144. Yes. The control unit 110 and the information processing function unit 150 are preferably configured by a calculation unit such as a CPU and a software module. Note that a serial interface unit SI, which will be described later, an RFID module RFID connected to the control unit 110 via the serial interface unit SI, an infrared communication unit IR, a camera 220 and a light 230, a microphone MIC, a radio module RM, a power source PS, power supply controller PSCON and the like are connected to control unit 110, but are omitted here for simplification.

  The function of each block in the block diagram of FIG. 1 will be briefly described. The control unit 110 detects contact of an object such as a user's finger by the sensor unit 120, stores the detected information in the storage area 142 of the storage unit 140, and controls processing of the information stored by the information processing function unit 150. . Then, information corresponding to the processing result is displayed on the display unit 130. Further, the control unit 110 controls the telephone function unit 160 for the normal call function, the key operation unit KEY, and the speaker SP. The display unit 130 includes a sub display unit ELD and a main display unit (not shown) (a display unit provided at a position where the mobile phone terminal 100 is hidden in the closed state and exposed in the open state).

  FIG. 2 is a perspective view of the mobile phone terminal 100 of the present embodiment in which the sensor element is mounted on the housing. FIG. 2A is a perspective view showing the appearance of the mobile phone terminal 100. The cellular phone terminal 100 includes a touch sensor unit 210 (in appearance, a sensor unit 130, that is, a panel PNL described later with reference to FIG. 3 covering the sensor elements G1 and G2), a camera 220, and a light 230. In addition to the closed state as shown in FIG. 2, the mobile phone terminal 100 can also be formed by opening or turning the hinge part, and the touch sensor part 210 can be operated even in the closed state. It is provided at a position. FIG. 2B illustrates the mobile phone terminal 100 according to the present embodiment in which the panel PNL is omitted and only the arrangement around the sensor element and the sub display unit ELD is displayed for explaining the operation of the touch sensor according to the present embodiment. It is a perspective view. As illustrated, the sensor elements L1 to L4 and R1 to R4 are arranged side by side along the periphery of the sub display unit ELD. The sensor elements L1 to L4 and R1 to R4 constitute a first sensor element group G1 and a second sensor element group G2, respectively. The first sensor element group G1 and the second sensor element group G2 are arranged with the separation portions SP1 and SP2 therebetween. These sensor element groups have a line-symmetric layout with the sub display portion ELD sandwiched therebetween and the direction in which the selection candidate items are arranged as the center line. In this embodiment, an organic EL display is used for the sub display unit ELD, but a liquid crystal display or the like can also be used, for example. In this embodiment, a capacitive contact sensor is used as the sensor element, but a thin film resistance contact sensor or the like can also be used.

  The direction in which the plurality of sensor elements L1 to L4 and R1 to R4 constituting the first sensor element group 122 and the second sensor element group 124 arranged in an annular shape are arranged except for the terminal portions of the respective sensor element groups. In this configuration, the display unit always has a predetermined one-direction component, and items displayed on the sub-display unit ELD are arranged along the predetermined one direction. That is, when the predetermined one direction is the longitudinal direction of the mobile phone terminal 100 in FIG. 2B, that is, the vertical direction of the paper, attention is paid to any one of the sensor elements L1 to L4 and R1 to R4. When the direction component in the longitudinal direction is decomposed into the predetermined one direction and a component perpendicular to the predetermined direction, a component parallel to the predetermined one direction is always included. Items displayed on the sub-display unit ELD are arranged. Therefore, the action of the user tracing his / her finger in an arc along the first sensor element group 122 or the second sensor element group 124 is the vertical direction with respect to the page of the item displayed on the sub display unit ELD. The user is reminded of the movement.

  In the mobile phone terminal 100 of FIG. 2, the sub display unit ELD displays information according to the use of the mobile phone terminal 100. For example, when the mobile phone terminal 100 is used as a music player, the sub-display unit ELD displays a song that can be played. A combination of a song name and an artist name is one item, that is, a “selection candidate item”. The user operates the touch sensor unit 210 as an operation input unit to change the capacitances of the sensor elements R1 to R4 and L1 to L4 to move items and operation target areas displayed on the sub display unit ELD. To select the song. At this time, the touch sensor has a configuration in which the sensor elements are arranged around the sub display unit ELD as shown in FIG. 2, so that the mounting portion in the external housing of the small portable electronic device is not greatly occupied, and The user can operate the sensor element while viewing the display on the sub display unit ELD.

  FIG. 3 is an exploded perspective view showing the configuration of the touch sensor unit 210 mounted on the mobile phone terminal 100 of the present embodiment. For ease of understanding, the members are shown separately in the order of construction. As shown in the figure, a donut-shaped panel PNL is arranged along the periphery of the display unit ELD made of organic EL elements. The panel PNL is preferably thin enough so as not to affect the sensitivity of the sensor element provided in the lower part. Under the panel PNL, eight electrostatic capacitance type sensor elements L1 to L4 and R1 to R4 capable of detecting contact of a human finger are arranged in a substantially annular shape. The left four sensor elements L1 to L4 constitute a first sensor element group G1, and the right four sensor elements R1 to R4 constitute a second sensor element group G2. A clearance (gap) is provided between adjacent sensor elements in each sensor element group so that adjacent sensor elements do not interfere with the contact detection function. Note that this clearance is not necessary when using a sensor element that does not interfere. Between the sensor element L4 located at one end of the first sensor element group G1 and the sensor element R1 located at one end of the second sensor element group G2, a clearance larger than the clearance (for example, twice or more) A separation portion SP1 having a width) is provided. Similarly to the separation portion SP1, the separation portion SP2 is provided between the sensor element L1 located at the other end of the first sensor element group G1 and the sensor element R4 located at the other end of the second sensor element group G2. Provide. Such separation portions SP1 and SP2 can prevent fingers from interfering with each other when the first sensor element group G1 and the second sensor element group G2 function separately.

  The tact switches SW1 and SW2 are arranged below the sensor element so that the centers of the tact switches are located in the clearance between the sensors L2 and L3 and the clearance between the R2 and R3. . By depressing the part of the panel PNL corresponding to the position of the tact switch, this tact switch is depressed, thereby selecting the item displayed on the display unit. When the selection is performed, for example, a backlight (not shown) installed behind the sub display unit ELD or the sensor element is turned on, and the selection is performed by the user, that is, the tact switch is pressed down. It shows that. Further, when an event to be notified to the user, such as a voice call or an incoming mail, occurs, the sub-display portion ELD is turned on.

  FIG. 4 is a detailed functional block diagram of the mobile phone terminal 100 of the above-described embodiment. Needless to say, the various types of software shown in FIG. 4 operate based on the programs stored in the storage unit 140 shown in FIG. 1 and are executed by the control unit 110 after providing a work area on the storage unit 140. . Various functions of the mobile phone terminal 100 are divided into software blocks and hardware blocks, as shown in FIG. The software block includes a base application BA having a flag storage unit FLG, a sub display unit display application AP1, a lock security application AP2, other applications AP3, and a radio application AP4. The software block further includes an infrared communication application APIR and an RFID application APRF. When these various applications (application software) control various hardware of the hardware block, the infrared communication driver IRD, RFID driver RFD, audio driver AUD, radio driver RD, and protocol PR are used as drivers. For example, the audio driver AUD, the protocol PR, and the radio driver RD control the microphone MIC, the speaker SP, the communication unit COM, and the radio module RM, respectively. The software block also includes a key scan port driver KSP that monitors and detects the operation state of the hardware, and includes touch sensor driver-related detection, key detection, and open / close detection that detects opening / closing of mobile phone terminals such as a folding type and a sliding type. And earphone attachment / detachment detection.

  The hardware block includes a key operation unit KEY including dial keys, various buttons including tact switches SW1 and SW2, which will be described later, an open / close detection device OCD that detects opening / closing based on the operating state of the hinge unit, and a microphone attached to the device body. MIC, earphone EAP, speaker SP, communication unit COM, radio module RM, serial interface unit SI, and switching control unit SWCON. The switching control unit SWCON drives the infrared communication unit IR, the RFID module (radio identification tag) RFID, the touch sensor module TSM (the sensor unit 120 and the sensor unit 120 such as an oscillation circuit) according to an instruction from the corresponding block of the software block. A switching unit that selects any one of the above-described necessary parts (moduleized) and switches the hardware (IR, RFID, TSM) to be selected so that the serial interface unit SI picks up the signal. A switch instruction is issued to SW. The power supply PS supplies power to the selection target hardware (IR, RFID, TSM) via the power supply controller PSCON.

  FIG. 5 is a block diagram showing a more detailed configuration of the touch sensor function of the mobile phone terminal 100 of this embodiment described above. The mobile phone terminal 100 shown in the figure includes a touch sensor driver block TDB, a touch sensor base application block TSBA, a device layer DL, an interrupt handler IH, a queue QUE, an OS timer CLK, and various applications AP1 to AP3. Here, the touch sensor base application block TSBA includes a base application BA and a touch sensor driver upper application program interface API, and the touch sensor driver block TDB includes a touch sensor driver TSD and a result notification unit NTF. The device layer DL includes a switching control unit SWCON, a switching unit SW, a serial interface unit SI, an infrared communication unit IR, an RFID, and a touch sensor module TSM, and the interrupt handler IH includes a serial interrupt monitoring unit SIMON and a confirmation unit CNF. Is provided.

  Next, the function of each block will be described with reference to the drawings. In the touch sensor base application block TSBA, whether or not to activate the touch sensor is exchanged between the base application BA and the touch sensor driver upper application program interface API. The base application BA is an application that is a base of the sub display unit display application AP1 that is an application for the sub display unit, the lock security application AP2 that is an application that locks the mobile phone terminal 100 for security protection, and other applications AP3. Yes, when activation of the touch sensor is requested from the respective applications to the base application BA, the activation of the touch sensor is requested to the application program interface API higher than the touch sensor driver. The sub display unit refers to a display unit (sub display unit ELD) surrounded by sensor elements arranged in an annular shape in the cellular phone terminal 100 according to the present embodiment.

  When receiving a request for activation, the touch sensor driver upper application program interface API confirms whether or not the touch sensor can be activated in a block (not shown) that manages activation of the application in the base application BA. That is, lighting of the sub display unit ELD indicating that application selection is being performed, or activation of an application that is set in advance such that the touch sensor is not activated, such as an application attached to the FM radio or other mobile phone terminal 100 Check for the presence of a flag indicating. As a result, when it is determined that the touch sensor can be activated, the touch sensor driver upper application program interface API requests the touch sensor driver TSD to activate the touch sensor module TSM. That is, power supply from the power source PS to the touch sensor module TSM is actually started via the power source controller PSCON.

  When activation is requested, the touch sensor driver TSD issues a request to the serial interface unit SI in the device layer DL, and controls to open a port with the touch sensor driver TSD in the serial interface unit SI.

  Thereafter, the touch sensor driver TSD outputs a signal having information on the sensing result of the touch sensor (hereinafter referred to as a contact signal) to the serial interface unit SI at a cycle of 20 ms by the internal clock of the touch sensor module TSM. To control.

  The contact signal is output as an 8-bit signal corresponding to each of the eight sensor elements R1 to R4 and L1 to L4. That is, when each sensor element detects contact, this contact signal is a signal in which “flag: 1” representing contact detection is set in a bit corresponding to the sensor element that has detected the contact. A contact signal is formed. That is, the contact signal includes information indicating “which sensor element” is “either contact / non-contact”.

  The serial interrupt monitoring unit SIMON in the interrupt handler IH takes out the contact signal output to the serial interface unit SI. Here, the confirmation unit CNF confirms True / False of the extracted contact signal in accordance with conditions set in advance in the serial interface unit SI, and puts only True signal data into the queue QUE (signal True). The type of / False will be described later). The serial interrupt monitoring unit SIMON also monitors other interrupt events of the serial interface unit SI during activation of the touch sensor, such as occurrence of pressing of the tact switch.

  When the detected contact is the first contact, the monitoring unit SIMON puts a signal indicating “press” into the queue QUE (queuing) before the contact signal. After that, the contact signal is updated at a cycle of 45 ms by a clock by the OS timer CLK of the operation system, and when no contact is detected a predetermined number of times, a signal indicating “release” is put in the queue QUE. This makes it possible to monitor the movement of contact detection between sensor elements from the start of contact to release. Note that “first contact” refers to an event in which a signal having “flag: 1” is generated when there is no data in the queue QUE or when the latest input data is “release”. Through these processes, the touch sensor driver TSD can know the detection state of the sensor element in the section from “press” to “release”.

  At the same time, when the contact signal output from the touch sensor is a signal that satisfies the condition of “False”, the monitoring unit SIMON generates a pseudo-signal indicating “release” and puts it in the queue QUE. Here, the conditions to be False (false) are “when contact is detected by two discontinuous sensor elements”, “when an interrupt occurs during activation of the touch sensor (for example, sub-display by notification such as incoming mail) "When the ON / OFF state of the part ELD is changed)", "When a key press occurs while the touch sensor is activated", or "When a contact across a plurality of sensor element groups is detected" as described later. Is set.

  In addition, for example, when the contact is detected simultaneously by two adjacent sensor elements such as the sensor elements R2 and R3, the monitoring unit SIMON corresponds to the element that detects the contact, as in the case of detecting a single element. The contact signal flagged in the bit to be put is put in the queue QUE.

  The touch sensor driver TSD reads a contact signal from the queue QUE at a period of 45 ms, and determines an element that has detected contact based on the read contact signal. The touch sensor driver TSD considers the change in contact determined by the contact signal sequentially read from the queue QUE and the positional relationship with the detected element, and “contact start element”, “contact moving direction (right / Counterclockwise) "and" number of elements moved from press to release (ie, movement distance) ". The touch sensor driver TSD writes the determined result in the result notification unit NTF and notifies the base application BA to update the result.

  As described above, when the update of the result is notified to the base application BA by the touch sensor driver TSD, the base application BA confirms the result notification unit NTF, and further describes the content of the information notified to the result notification unit NTF. Notification is made to a higher-order application that requires a touch sensor result (such as a display unit display application AP1 for displaying a menu screen on the sub display unit and a lock security application AP2 for lock control).

  Here, the determination of the contact direction and the movement distance is performed by a combination of contact detection of a single sensor element and contact detection of adjacent sensor elements. That is, when the contact completely changes from a single sensor element (for example, R2) to an adjacent sensor element (in this example, R3), one element in that direction (one item in the sub display unit ELD). ) Is generated, and the occurrence of movement is written in the result notification unit NTF. However, this transition is not completely completed, and a transition is made from a single sensor element (for example, R2) to an adjacent sensor element (for example, R3 in this example) (in this example, R2 and R3 are in contact). Thus, when released before completely shifting to the single sensor element R3, the instruction that the movement is performed is not generated, and the occurrence of the movement is not written in the result notification unit NTF.

  FIG. 6 is a schematic block diagram for explaining data processing for contact detection by each sensor element in the mobile phone terminal 100 of the present embodiment. For simplification of explanation, only the sensor elements R1 to R4 are shown, but the same processing is performed for the sensor elements L1 to L4.

  A constant high frequency is applied to each of the sensor elements R <b> 1 to R <b> 4, and calibration is performed in consideration of a change in stray capacitance, and the high frequency state at this time is set as a reference. (R1 pre-processing unit 300a, R2 pre-processing unit 300b, R3 pre-processing unit 300c, R4 pre-processing unit 300d) detects a change in a high-frequency state based on a change in capacitance due to finger contact or the like Then, it is transmitted to the A / D converter 310 (A / D converter 310a for R1, A / D converter 310b for R2, A / D converter 310c for R3, A / D converter 310d for R4), It is converted into a digital signal indicating contact detection. The digitized signals are transmitted to the control unit 320, and the information held by the signals is stored in the storage unit 330 as a set of collected signals as a sensor element group. Thereafter, this signal is sent to the serial interface unit and the interrupt handler. The interrupt handler converts the signal into a signal that can be read by the touch sensor driver, and the converted signal is queued. Note that the control unit 320 detects a direction when contact is detected by two or more adjacent sensor elements based on information stored in the storage unit 330.

  Hereinafter, the response of the sub display unit to the operation of the sensor element will be described with reference to FIGS. 7A to 21A are schematic views showing only the sub display unit ELD mounted on the mobile phone terminal 100 and the sensor elements arranged side by side along the periphery thereof for the sake of simplicity of explanation. (B) is a figure which shows the sensor element detected with time transition, (c) is a figure which shows the position change of the operation object area | region of the sub display part ELD according to the detected sensor element. In (a) of these figures, the sensor element, the sensor element group, and the separated portion are denoted by the same reference numerals as in FIG. In the display of the sub display unit ELD in (c), TI indicates the title of the item list displayed by the sub display unit, and LS1 to LS4 indicate items that are selection candidate items (for example, several scrollable lines). Also, in the sub-display part of (c), the item in the state to be operated is placed on the item so that it can be identified as the current operation target region, or the item itself is highlighted. Highlight with In these figures, the items displayed as the operation target area are hatched and highlighted. For convenience of explanation, “moving target” will be described only as an operation target area, but the sub-display unit can be operated on the same principle when the item itself is moved (scrolled).

  Each of the first sensor element group 122 and the second sensor element group 124 includes four sensor elements, and in this embodiment, the selection items on the sub display unit ELD are also excluded except for one line of the title TI. , LS1 to LS4 are set to be displayed. That is, the number of sensor elements included in each sensor element group is the same as the number of selection items on the sub display unit ELD.

  FIG. 7 is a diagram for explaining the response of the sub display unit when the user traces the sensor element with a finger or the like. In FIG. 4A, when the sensor elements are continuously traced from the top to the bottom indicated by the arrow AR1, for example, using a contact means such as a finger, the control unit changes over time as shown in FIG. Detect contact. In this case, the sensor elements R1, R2, R3, and R4 are in this order. Since the detected continuous contact from R1 to R4 detects the contact with two or more of the adjacent sensor elements, the direction is detected, and depending on the number of times the adjacent sensor elements are transitioned and the direction thereof, The operation target area moves on the list displayed on the sub display unit ELD. Although the operation target area is represented by hatching, an area with a narrow hatching pitch is an initial position, and an area with a wide hatching pitch is a position after movement. In this case, if the initial position of the operation target area is the item LS1 as shown in (c), the operation target area moves from the top to the bottom by three items to the item LS4. In this way, according to this configuration, the “operation target area moves downward” on the display unit, as in the case of the user's “upward to downward finger pointing operation”, the user can feel as if with his / her finger. It feels as if the operation target area is freely moved. That is, the operation feeling as intended by the user can be obtained.

  Similarly, if the sensor elements are traced in the direction indicated by the arrow AR2 in FIG. 6A, the sensor elements L4, L3, L2, and L1 are in this order among the sensor elements as shown in FIG. In this case, since the contact is detected by the transition of three adjacent sensor elements from the top to the bottom as in the case of the arrow AR1, the operation target region is 3 from the item LS1 to the item LS4 from top to bottom as shown in (c). Move one minute. In this case as well, since the “operation target area moves downward” on the display unit, as in the case of the user's “upward to downward finger pointing operation”, the user can intuitively perform the operation as intended. Can be done automatically.

  FIG. 8 is a diagram showing a case where the sensor element is traced in the opposite direction to FIG. 7, that is, from the bottom to the top. When traced in the direction of the arrow AR1 as shown in FIG. 5A, the sensor elements R4, R3, R2, and R1 among the sensor elements detect contact in this order as shown in FIG. Similarly, in the direction of the arrow AR2, L1, L2, L3, and L4 among the sensor elements detect contact in this order as shown in (b). In these cases, if the initial position of the operation target area is item LS4 in (c), both of the operation target areas move from bottom to top up to item LS1.

  With this configuration, regardless of whether the first sensor element group 122 is operated or the second sensor element group 124 is operated, in each sensor element group, the user can move from the upper sensor element. When the finger is traced to the lower sensor element, the selection item in the operation selection area of the sub display unit ELD is also moved from the upper side to the lower side, and the user moves from the lower sensor element to the upper sensor element. If the finger is traced, the selection item of the sub display portion ELD is also moved from the lower side to the upper side. Therefore, the user can intuitively move the item in the operation target area of the sub display unit ELD up and down without making a mistake in the vertical movement of the finger corresponding to the vertical movement of the operation target area.

  Further, in this embodiment, the number of the plurality of sensor elements included in one sensor element group is the same as the number of selection items displayed on the sub display unit ELD. By tracing (or from the bottom to the top), the operation target area of the sub display unit ELD can be moved from the top to the bottom (or from the bottom to the top) over all the selection items by one operation. That is, when selecting an item from the items on the same screen, the user simply drags the finger once on one sensor element group, and selects an arbitrary item on the sub display unit ELD. You can choose.

  Further, in this way, when the user performs an operation of tracing both sensor element groups continuously across the separation part SP1 or SP2 with a finger or the like, the user's finger performs a constant circular motion. On the basis of the above, on the sub-display unit ELD, the movement of the operation target area can be folded back, that is, the operation target area can be reciprocated.

  In the following explanation, when the user traces the sensor element with a finger or the like, the response of the sub display unit when the contact of the sensor element is continuously detected across the separated part of the element group is described. It is shown together with the detection of contact in the absence.

  9 to 12 show a case where two adjacent sensor elements are continuously contacted. FIG. 9 is a diagram for explaining the response of the sub display unit when the user traces a plurality of sensor elements with a finger or the like. When the two sensor elements are continuously traced from the bottom to the top indicated by the arrow AR in FIG. 4A, the control unit detects contact with the time transition shown in FIG. In this case, this means that the sensor elements L3 and L4 are touched in this order. In this case, the continuous contact from the sensor elements L3 to L4 detects the direction because two or more of the adjacent sensor elements do not straddle the separation portion SP1, and the direction of the adjacent sensor elements is detected. The operation target area moves on the item list displayed on the sub display unit ELD according to the number of times of transition and its direction. In this case, if the initial position of the operation target area is LS2 as shown in (c), the operation target area moves one item from bottom to top up to LS1.

  FIG. 10 is a diagram illustrating the response of the display unit when the first sensor element group G1 and the second sensor element group G2 are continuously contacted across the separation part SP1. When the user continuously traces two sensor elements with a finger or the like in the direction from the left to the right indicated by the arrow AR in FIG. 9A, the control unit detects contact with the transition shown in FIG. In this case, the sensor elements L4 and R1 are in this order. In the mobile phone terminal 100 according to the present embodiment, when the detection of the contact of the sensor element crosses the separation part, the detection of the contact of the sensor element before and after the separation part is detected in each sensor element group G1 or G2, respectively. The movement is valid if it spans two or more sensor elements. When the contact of the sensor elements before and after straddling the separation part is detected by only one sensor element in the sensor element groups G1 and G2 before or after straddling the separation part, it is equivalent to one straddling the separation part. Disable movement. Therefore, in this case, after detection of one sensor element L4 in the first sensor element group, detection of contact in the sensor elements in the second sensor element group that is adjacent to and crosses the separation portion SP1 is detected by the sensor element. Since there is only one contact by R1, the movement from the first contact L4 detected by the first sensor element group G1 to the second contact R1 detected by the second sensor element group G2 becomes invalid. Therefore, as shown in (c), the operation target area of the sub display unit ELD does not move.

  FIG. 11 is also a diagram illustrating the response of the sub display unit when the user traces on the sensor element. When the user continuously traces each sensor element with a finger or the like from the bottom to the top indicated by the arrow AR in FIG. 4A, the control unit detects contact with the time transition shown in FIG. In this case, the sensor elements R2 and R1 are in this order. As in the case of FIG. 8, in this case, the movement of the contact detection is effective because the movement of the user's finger or the like on the sensor element does not cross the separation portion SP1, and the operation target area as shown in FIG. If the initial position of LS2 is LS2, the operation target area moves one item from bottom to top up to LS1.

  FIG. 12 is a diagram for explaining the response of the sub display unit when the first sensor element group G1 and the second sensor element group G2 are continuously contacted across the separation part SP1 as in FIG. When the user continuously traces each sensor element with a finger or the like in the direction from the right to the left indicated by the arrow AR in (a), the control unit detects contact with the time transition shown in (b). In this case, the sensor elements R1 and L4 are in this order. Based on the same concept as in FIG. 10, the first contact in the second sensor element group G2 before straddling the separation portion SP1 is only one sensor element (R1), and the first contact after straddling the separation portion SP1. Since the second contact in the sensor element group G1 is also only one sensor element (L4), the movement from R1 to L4 becomes invalid, and the operation target area moves in the sub-display unit ELD as shown in (c). do not do.

  FIGS. 13 to 18 show a case where three adjacent sensor elements are continuously in contact with each other and a case where the sensor element straddles the separation SP1. FIG. 13 is a diagram for explaining the response of the sub display unit when the user traces the sensor element with a finger or the like. When the sensor elements are continuously traced from the bottom to the top indicated by the arrow AR in FIG. 4A, the control unit detects contact with the time transition shown in FIG. In this case, the order is sensor elements L2, L3, and L4. As in the case of FIG. 8, in this case, since the movement does not cross the separation portion SP1, the detection of the contact of L2 to L4 is effective, and the initial position of the operation target region is LS3 as shown in (c). Assuming that the operation target area moves two items from the bottom to the top to the item LS1.

  FIG. 14 is a diagram for explaining the response of the sub display unit when the first sensor element group G1 and the second sensor element group G2 are continuously contacted across the separation part SP1. When the user continuously traces each sensor element with a finger or the like in the direction from the left to the right indicated by the arrow AR in (a), the control unit detects contact with the time transition shown in (b). In this case, the sensor elements L3, L4, and R1 are in this order. In this case, as shown in the figure, the number of sensor elements that detected contact with the second sensor element group beyond the separation portion SP1 after detecting two contacts with the first sensor element group is one. is there. Therefore, the first contact (L3 to L4) detected by the first sensor element group G1 is effective, but the movement to the second contact (L4 to R1) detected by the second sensor element group G2 is It becomes invalid. Accordingly, as in the case described with reference to FIG. 10, the list selected in accordance with the number of transitions between adjacent sensor elements and the direction thereof moves on the list displayed on the sub display unit ELD, and is shown in (c). Thus, if the initial position of the operation target area is the item LS2, the operation target area moves one item from the bottom to the top to the item LS1.

  FIG. 15 is also a diagram for explaining the response of the sub display unit when the user traces the sensor element with a finger or the like. When the sensor elements are continuously traced from left to right as indicated by arrow AR in (a), the control unit detects contact with the time transition shown in (b). In this case, the sensor elements L4, R1, and R2 are in this order. In this case, since the detection of the first contact before straddling the separation part SP1 is only one sensor element (only L4), the movement of the contact detection from L4 to R1 across the separation part SP1 is invalid. However, the movement from R1 to R2 is effective because the contact for two parts is detected after straddling the separation portion SP1. Therefore, similarly to the case described with reference to FIG. 14, if the initial position of the operation target area is the item LS2 as shown in FIG. 14C, in this case, the operation target area moves the items from top to bottom until the item LS3. Move one.

  FIG. 16 is a diagram for explaining the response of the sub display unit when the user traces the sensor element with a finger or the like. When the sensor elements are continuously traced from the bottom to the top indicated by the arrow AR in (a), the control unit detects contact with the time transition shown in (b). In this case, the order is sensor elements R3, R2, and R1. Similarly to the case described with reference to FIG. 13, in this case as well, the movement does not cross the separation portion SP1, so that the initial position of the operation target area is the item LS3 as shown in FIG. The area moves two items from bottom to top up to item LS1.

  FIG. 17 is a diagram for explaining the response of the sub display unit when the user traces the sensor element with a finger or the like. When the sensor elements are continuously traced from left to right as indicated by arrow AR in (a), the control unit detects contact with the time transition shown in (b). In this case, the order is sensor elements R2, R1, and L4. The movement from R2 to R1 is effective because it is two movements before straddling the separation part SP1, but the movement from R1 to L4 has only one detection of contact after straddling the separation part SP1. Becomes invalid. Accordingly, similarly to the case described with reference to FIG. 10, if the initial position of the operation target area is the item LS2 as shown in FIG. 10C, in this case, the operation target area moves the items from the bottom to the top to the item LS1. Move one.

  FIG. 18 is a diagram illustrating the response of the sub display unit when the user traces the sensor element with a finger or the like. When the sensor elements are continuously traced in the direction from right to left as indicated by the arrow AR in (a), the control unit detects contact with the transition shown in (b). In this case, the order is sensor elements R1, L4, and L3. In this case, since there is only one detection (R1 only) before the first contact crosses the separation portion SP1, the movement of the contact detection from R1 to L4 is invalid. On the other hand, the movement from L4 to L3 is effective because two contacts are detected after straddling the separation portion SP1. Therefore, similarly to the case described with reference to FIG. 10, if the initial position of the operation target area is the item LS2 as shown in (c), in this case, the operation target area moves the items from top to bottom until the item LS3. Move one.

  As described above, the operation when straddling the separation portion SP1 is described together with the case of straddling the separation portion SP2, but the same operation is performed when straddling the separation portion SP2.

  In this way, when the user starts the operation, even if the position of the finger is not strictly started from the sensor element at the end of each sensor element group, it slightly exceeds that end. Even if the operation is started from one adjacent sensor element among the plurality of sensor elements forming one sensor element group, the contact detection of the sensor element at the operation start point is invalidated.

  Therefore, the user is not required to perform a very precise finger operation at the operation start point or the operation end point, so that the usability is remarkably improved.

  FIG. 19 is a diagram illustrating the display on the sub display unit when the user traces the sensor element with his / her finger or the like. As indicated by an arrow AR in FIG. 6A, the user traces in the order of L2, L3, L4 from the sensor element L1 of the first touch sensor group G1 with a finger or the like, and directly exceeds the separation portion SP1. A description will be given of a case where the sensor element R4 of the second touch sensor element group G2 is traced as an end in the order of R2, R3, and R4 after reaching R1. In this case, contact is detected with a time transition as shown in FIG. That is, contact is detected in the order of L1, L2, L3, L4, R1, R2, R3, and R4. The detection of the contact from L1 to L4 in the sensor element group G1 is the same control as described in FIG. 8, and the initial position of the operation target area is item LS4 as shown in FIG. 19C. Then, three operation target areas move from the bottom to the top from the item LS4 to the item LS1. Next, at the moment when the sensor element R1 is detected from the sensor element L4 beyond the separation part SP1, the control is the same as described in FIG. 10, and the detection is invalidated. Does not move with the item LS1. When the next sensor element R2 is detected, the control is the same as described in FIG. 15, and the detection from the sensor element R1 to the sensor element R2 is valid. Move one to LS2. Hereinafter, the continuous detection from the sensor elements R2 through R3 to R4 is effective because it does not extend over the separation part SP1 or SP2. As a result, for the detection of the contact from R1 to R4 in the sensor element group G2, the same control as in the case described with reference to FIG. 7 is performed. That is, as shown in FIG. 19 (d), the operation target region that was in the item LS1 when the sensor element R1 was detected is the same as the item LS1 when the detection of the sensor element reaches R4 via R2 and R3. Move up to three items from top to bottom to item LS4.

  Therefore, in this case, when the user performs an operation of tracing the touch sensor unit 210 with a finger or the like, the item of the operation target area on the sub display unit ELD returns to the original position by one round trip.

  In FIG. 19, the case has been described in which the user traces the sensor element clockwise with the finger or the like according to the direction of the arrow AR, but even when the user traces counterclockwise in the direction opposite to the arrow AR. The detection order of the sensor elements is only reversed from the above case, and as a result, the operation target region moves from the bottom to the top from the items LS4 to LS1 by the detection from R4 to R1 in the sensor element group G2, By the detection from L4 to L1 in the sensor element group G1, the operation target region moves from top to bottom from the item LS1 to LS4.

  Further, the user traces clockwise with a finger or the like from the sensor element R1 of the second touch sensor group G2 in the order of R2, R3, R4, reaches the L1 as it passes the separation portion SP2, and then continues to L2. When the sensor element L4 of the first touch sensor element group G1 is traced in the order of L3, L4, the initial position of the operation target region is detected for detection of contact from R1 to R4 in the sensor element group G2. Assuming that the item is the item LS1, the operation target area is moved from the top to the bottom by the item LS4 by three, and contact detection from the L1 to L4 in the sensor element group G1 is detected from the bottom to the item LS4 to the item LS1. Move up three places.

  Further, in the counterclockwise direction, the sensor element L4 of the first touch sensor group G1 is traced in the order of L3, L2, and L1, and then passes through the separation portion SP2 to reach R4, and then continues to R3, R2, and R1. In order to detect the contact from L4 to L1 in the sensor element group G1 even when the sensor element R1 of the second touch sensor element group G2 is traced in order, the initial position of the operation target area is the item LS1. Then, three operation target areas move from top to bottom to the item LS4, and further, detection of contact from R4 to R1 in the sensor element group G2 corresponds to three from bottom to top from the item LS4 to the item LS1. Moving.

  As a result, even if the user moves the finger in a ring shape without releasing it from the sensor, when the finger returns to the original position, the same item as the item selected first is selected. And does not give the user a sense of incongruity.

(Example 2)
The case where there are two sensor element groups has been described above, but there may be two or more sensor element groups. FIG. 20 shows three sensor element groups including a first sensor element group G1 (L1 to L3), a second sensor element group G2 (R1 to R3), and a third sensor element group G3 (M1 to M3). The case where it arrange | positions along the circumference | surroundings of the sub display part ELD across the separation parts SP1-SP3 is shown.

  FIG. 20 will be described. When the user continuously traces each sensor element with a finger or the like in the direction from the left to the right indicated by the arrow AR in (a), the control unit detects contact with the time transition shown in (b). In this case, the sensor elements L2, L3, and R1 are in this order. As shown in the figure, the detection of the contact of the sensor element before straddling the separation portion SP1 is two (L2 to L3), and this movement is effective. In addition, since there is only one sensor element (R1 only) after straddling the separation part SP1, movement before and after straddling the separation part SP1 (from L3 to R1) becomes invalid. Therefore, similarly to the case described with reference to FIG. 10, if the initial position of the operation target area is the item LS4 as shown in (c), in this case, the operation target area moves items from the bottom to the top up to the item LS3. Move one. Here, the display of the sub display unit ELD has been shown as an example of scrolling in the vertical direction of the screen, but depending on the application, it may be scrolled in the horizontal direction of the screen.

  In the case of the present embodiment, for the sensor element group G1 and the sensor element group G2, when the user traces his / her finger from R1 to R3 or from L3 to L1 on each sensor element group, the sub display unit It is preferable to control the operation target area of the ELD to move from top to bottom. When the finger is traced from R3 to R1 or from L1 to L3, the operation target area of the sub-display unit ELD is changed. It is preferable to control to move from bottom to top. Further, regarding the sensor element group G3, when the user traces the finger from M1 to M3 or from M3 to M1, the operation target area moves down one in both cases and then returns one up. By controlling, it is possible to correspond to the intuitive operation of the user.

(Example 3)
FIG. 21 is a diagram illustrating a configuration in which each sensor element group having a plurality of sensor elements is arranged in a line. The first, second and third sensor element groups G1 to G3 are arranged so as to be aligned in a row with the separation portions SP1 and SP2 therebetween. In this case, the sub display portion ELD (not shown in FIG. 5A) is disposed at an appropriate location such as above or below the column of sensor element groups. In addition, when the direction of the sensor element group is the horizontal direction so that the user can operate intuitively, it is preferable that the arrangement of the selection items displayed on the sub display unit ELD is also the horizontal direction. When the sensor element is continuously traced from left to right as indicated by the arrow AR in (a), the control unit detects contact with the time transition shown in (b). In this case, the sensor elements L3, R1, and R2 are in this order. As shown in the figure, since the detection of the sensor element before straddling the separation portion SP1 is one (only L3), the movement before and after straddling the separation portion SP1 (from L3 to R1) becomes invalid. Moreover, the detection of the contact of the sensor element after straddling the separation part SP1 is two (R1 to R3), and this movement becomes effective. Therefore, similarly to the case described with reference to FIG. 10, if the initial position of the operation target area is the item LS5 as shown in FIG. 10C, in this case, the operation target area moves the item from the bottom to the top up to the item LS4. Move one.

  In the above embodiment, the sensor element group is arranged in a horizontal row, but as a modification, the arrangement of the centimeter element group is also arranged in a vertical row in correspondence with the selection items of the sub display unit ELD being arranged vertically. Of course, it is possible to adopt such a configuration, and the sub-display unit ELD may be arranged in a line on the left, right, top and bottom of the sub display unit ELD according to the required function, application and design.

  In the above embodiment, the separation portions SP1 and SP2 are provided between the sensor element groups. However, the number of separation portions can be set to an appropriate number depending on the function and application of the mobile phone terminal 100. In addition, it is possible to form a vertical or horizontal single-row sensor element group by using only one sensor element group without providing any separation portion. In this case, the above-described processing across the separation portion is not performed.

Example 4
FIG. 22 is a conceptual diagram showing the sensor element detection state divided into 16 so as to determine not only a single element detection state but also a multiple element detection state in which two adjacent elements are further detected. This embodiment is substantially the same as the configuration of FIG. 3, but a tact switch is also provided between the first sensor element group G1 and the second sensor element group G2. That is, a tact switch SW3 is newly provided between the sensor element L4 and the sensor element R1, and a tact switch SW4 is newly provided between the sensor element R4 and the sensor element L1. If the detection states of the eight sensor elements are managed one by one, the eight detection states can be managed. However, in the eight detection states, since the number of states, that is, state changes are small, it is not possible to perform very precise control. For example, in the case of the tact switch SW1 arranged across the sensor elements, when the user depresses the tact switch SW1 with a finger or the like, contact is detected in the sensor elements L2 and L3 prior to the depressing. For this reason, the display may move due to this detection, and a process such as “decision” may be performed by pressing SW1 while the selection display according to an operation instruction not intended by the user is performed. In other words, when the sensor elements L2 and L3 are detected instantaneously and continuously in this order, the user presses the tact switch SW1 with the intention of selecting an item displayed in the current operation target area, for example. However, when the tact switch SW1 is pressed, the upward movement of the contact from the sensor elements L2 to L3 is detected, and the operation target region is shifted upward and then selected by pressing the tact switch SW1. There is a possibility that the operation is fixed and an unintended item is determined and instructed.

  The configuration of the sensor element in FIG. 22 is almost the same as the configuration of the sensor element in FIG. However, the contact detection configuration is detected in detail. For example, when the user touches only L1 with a finger or the like, the contact of L1 is detected. However, when the user touches the vicinity of the boundary between L1 and L2, it is detected as a state of touching “L1 and L2.” If the contact completely moves to L2 and leaves L1, it is detected as a contact of L2 only. In this case, when the vicinity of the boundary between L2 and L3 is touched, it is detected as a state where “L2 and L3” are touched. By adopting a configuration in which detection is performed in the same manner, 16 detection states can be detected while using 8 sensor elements.

  By assigning 16 detection states using eight sensor elements in this way, two or three sensors are used to detect contact by adjacent sensor elements in order to appropriately process the pressing processes of the tact switches SW1 to SW4. There is a method of deferring confirmation of a movement instruction until a detection state change (movement) of the element is detected. Also, a method of discarding the detection state (result) of the sensor element up to that point when the tact switch has been pressed can be considered. Hereinafter, these will be described in detail with reference to flowcharts.

  FIG. 23 is a flowchart showing an example of the movement confirmation process (that is, the hold process) in the 16 detection states, and this flowchart every time it is detected that any one detection state occurs in the queue QUE. Processing is performed by the touch sensor driver TSD. A position (any one of 16 detection states) first detected from the released state is set as the first reference point. From this reference point, the current detection position (detection state newly entered in the queue QUE), and the previous detection position (previous detection state remaining in the queue QUE), the movement distance (detection state) Transition). As shown in the figure, in step K10, it is determined whether or not the previous position has been released. If it is determined that it has been released (the previous data remaining in the queue QUE is “release”), the process proceeds to step K12, and whether or not the current detection position has been released (ie, newly entered) Whether or not the data is “release”). If it is determined that the current detection position has been released, the process ends. If not, the process proceeds to step K14, where the reference point and the previous detection position are set as the current detection position.

  If it is determined in step K10 that the previous position has not been released (that is, if another detection has occurred and the current detection follows), the process proceeds to step K16, where the current detection position is It is determined whether or not it has been released (that is, whether or not the newly input signal is “release”). If it is determined that the current detection position is released, the reference point and the previous detection position are initialized (cleared), and the process ends (step K18). If it is determined in step K16 that the current detection position has not been released, the distance between the previous detection position and the current detection position is calculated (step K20), and is the calculated distance 1 or 2? It is determined whether or not (step K22). If it is determined that the calculated distance is not 1 or 2 (that is, 3 or more), the sensor element is skipped and it is determined that the detection state is discontinuous (step K24), and the reference point is set to the current detection position. Set and proceed to step K36. If it is determined that the distance calculated in step K22 is 1 or 2, the distance between the current detection position and the reference point is calculated (step K28). In addition, since the calculation of the distance indicates the detection position for each sensor element by the signal put in the queue QUE, the number of the 16 detection states between the previous detection position and the current detection position. The touch sensor driver TSD determines whether there is a difference in minutes.

  Further, it is determined whether or not the distance calculated in step K28 is 2 or 3 (step K30). If the condition is not satisfied (that is, 4 or more), the process proceeds to step K36 as an error, and the condition is satisfied ( If the distance is 2 or 3, the movement is confirmed (step K32). That is, the first touched position is set as the “reference point”, and then the “previous position” is updated when contact is continuously detected without being “released”, and finally the latest detected position “ Only when it is determined that “current position” is “moved 2 or 3” with respect to the reference point, it is determined that “there is movement”. Further, since the single element detection state and the multiple element detection state are continuously detected, it is determined that the movement is “2”. Therefore, on the sensor element, the sensor element is not used until the above “2 movement”. One finger is moved. The next reference point is set to a position that is moved by two in the movement direction from the previous reference point (step K34), and the process proceeds to step K36. In step K36, the “previous detection position” is set to the “current detection position” for the next process, and the process ends.

  When the tact switches SW1 to SW4 are pressed, the previous detection position and reference point set at the time of pressing detection are initialized (cleared). Next, a process when the tact switch in FIG. 22 is pressed will be described using the movement confirmation process of the flowchart. When the tact switch SW1 is pressed, if the detection state transitions in the order of “L2 detection state” and “L2-L3 detection state”, only one detection state transitions (moves / changes) at this time. Therefore, the movement is not fixed. When the finger is released after the tact switch SW1 is pressed, the detection state may transition in the order of “L2-L3 detection state” and “L3 detection state”. At this time, if the detection state until the tact switch is pressed is held, two detection states transition in the order of “L2 detection state”, “L2-L3 detection state”, and “L3 detection state”. Although the movement may be confirmed, as described above, since the past detection result is discarded when the tact switch SW1 is pressed, the erroneous detection when the finger is released is prevented. Therefore, when the tact switch is released, it is not erroneously recognized as a movement instruction of the sensor element.

  Alternatively, when the tact switch SW1 is released, the detection state may transition in the order of “L2 detection state” and “L2-L3 detection state”. Even if the detection result before the tact switch is pressed is discarded, the sensor element may be touched again when the tact switch is released. However, even in such a case, according to the processing of the flowchart of FIG. 22, there is only one detection state, so that it is erroneously recognized as a movement instruction of the sensor element when the tact switch is released. There is no.

  FIG. 24 is a diagram for explaining a determination process when the process of the flowchart of FIG. 23 is applied to the contact from the sensor elements L1 to L4 of FIG. As shown in the figure, the detection state changes are “L1 detection”, “L1-L2 detection”, “L2 detection”, “L2-L3 detection” “L3 detection”, “L3-L4 detection”, “L4 detection”. It becomes. That is, the single element detection state, the multiple element detection state, and L1 to L4 are repeatedly detected. First, the first “L1 detection” is set to the reference point BP1 (K14). Next, when “L1-L2 detection” occurs, since the previous position is not “release” but “L1 detection”, the previous position is compared with the current position detected this time (K20). Here, it is validated because it is the movement of one frame from L1 to “L1-L2”, and this time, the reference point is compared with the current position (K28). Here, since the reference point and the previous position are set to the same L1, the movement amount is still one frame, and the movement is not confirmed at this stage, and the L1-L2 detection state of the current position is set to the previous position PP1. (K36).

  Furthermore, if “L2 detection” occurs without “release” in the middle, the previous position is “L1-L2 detection”, so the previous position is compared with the current position CP1 detected this time (K20). . Here, the movement is one frame from L1-L2 to L2, which is valid because the determination condition “1 or 2?” Is satisfied. Next, the reference point is compared with the current position (K28). Since the reference point is set to the same L1 as in the case of detecting L1 this time as well, the positional relationship with L2 is two frames, so the movement amount is determined to be two frames (K30). The movement is confirmed for the first time here (K32). Then, for the next determination, the reference point BP2 is set to a point where two frames are shifted in the moving direction from “L1 detection”, that is, “L2 detection” is set (K34), and the previous position is set to the current position “L2 detection”. The setting process 1 is completed again.

  As described above, the touch sensor driver TSD determines the movement “1” by detecting the transition of the detection state of the two frames. That is, when the movement is confirmed in step K32, the movement direction component (clockwise direction from L1 to L4, ie, the direction from SP2 to SP1) and the movement of “1” and the movement of “1” are stored in the result notification unit NTF. The update of the storage content is notified to the application BA, and the base application BA extracts the update content and notifies the sub display unit display application AP1 and the like. If the sub display unit display application AP1 is in use, a movement amount of “1” is given to the “direction from bottom to top” based on the movement direction component. The display of the part ELD is changed. Specifically, when the list display as shown in FIG. 8C is performed and the operation target area is located at LS4, the operation target area moves to LS3 based on the confirmation process 1. . By the way, in the same manner as in the determination process 1, the detection state continues for “R4 detection” and “R3 detection” continuously from the “R4 detection” state for the second sensor element group R1 to R4. Even when the transition is made, the touch sensor gives the sub-display unit display application AP1 via the base application information on the “direction from the bottom to the top” and the movement amount of “1” based on the movement direction component. On the screen display of the list display, the operation target area changes from the item LS4 to LS3 as in the operation in the first sensor element unit.

  Next, a case where the finger movement continues without “release” subsequent to the confirmation process 1 will be described. As in the case of the confirmation process 1, as shown in the confirmation process 2 in the figure, the detection state is “L2-L3 detection” from the reference point BP2 as the previous position PP2, and “L3 detection” becomes the current position CP2. Since the distance between the reference point BP2 and the current position CP2 is two frames, the movement “1” is further determined. That is, the movement of the total “2” is confirmed by both the confirmation process 2 subsequent to the confirmation process 1. Then, for further subsequent processing, the reference point is changed with “L3 detection” two frames ahead of the reference point BP2 “L2 detection” as a new reference point BP3.

  Similarly, as shown in the confirmation process 3 in the figure, the detection state advances two frames from the reference point BP3, and “L3-L4 detection” is set to the previous position CP3, and “L4 detection” becomes the current position CP3. At that time, since the distance becomes two frames, “1” movement is further confirmed, and a total of “3” movements are confirmed together with the confirmation processes 1 and 2. In this way, a total of “3” moves are notified to the application.

  As the display on the sub display part ELD, the sub display part display application AP1 is notified of the movement confirmation of “1” twice in the “direction from bottom to top” following the confirmation process 1. The operation target area changes from LS3 to LS1 that has moved "2" upward. Here, not only the detection of a single element detection state but also a detection state of a plurality of elements is detected and the detection state is subdivided, but the movement amount determined by the movement of two state transitions is “ As a result, in the case of a sensor element composed of four sensor elements as in the example, the maximum movement determination of “3” is performed. In other words, when the number of sensor elements is four and the movement is confirmed only by single element detection, the final movement amount is very approximate, but only exactly above the single element. Even if it is not touched, a movement amount of “3” at the maximum can be ensured, and inaccurate operation by the user can be dealt with in a form that meets the user's wishes without causing any reaction. In this way, when an item is selected by the touch sensor and the tact switch is subsequently pressed, the key detection driver prompts the determination instruction by pressing the donut-shaped panel that is in contact with the touch sensor during operation. Since it can be given to an in-use application such as a sub display unit display application via the user interface, a more comfortable user interface with less finger movement for the user is provided.

  In the case of a sensor element group composed of “4” sensor elements, “3”, which is obtained by subtracting “1” for the sensor element that comes into contact first, is the maximum movement determination amount. Therefore, when displaying the selection items on the sub display unit ELD as a list, it is preferable that the sub display unit display application displays the selection items of “4” rows, which is the same number as the number of sensor elements “4”. By performing display control in this way, contact detection is first performed on the sensor elements L1 and R4 at the bottom (SP1 side), and when contact detection continues to the top (SP2 side), the movement of “3” is confirmed. Is supplied to the sub-display unit display application, the selection target area moves from the lowermost level (LS4) to the uppermost level (LS1). That is, since the maximum movement from the bottom to the top is the maximum movement from the bottom to the top on the display, the movement operation to the touch sensor coincides with the movement display on the sub display unit ELD. It is possible to provide a user interface that is very easy to grasp the operation content.

  Furthermore, since the first sensor element group and the second sensor element group are arranged in a symmetrical form with the sub display unit ELD interposed therebetween, the same operation instruction can be given regardless of which one is operated. In addition, since the end portions are arranged side by side, for example, when the contact detection state is shifted clockwise from the sensor element L1 to the detection state of the sensor element R4, the following is displayed on the sub display unit ELD. Such a display change occurs. That is, when the operation target area moves from the lowermost stage LS4 to the uppermost stage LS1 from the L1 detection to the L4 detection time, and subsequently the detection state transitions from R1 to R4, the operation target area changes from the uppermost stage LS1 to the lowermost stage LS4. Will return. As a result, the user can give an up / down direction when selecting a selection item or return the operation target area to the original position without removing the finger even once, which is highly comfortable for the user. A feeling of operation can be given.

  In addition, when the user carrying the mobile phone performs an operation in a place where vibration is likely to occur, there may be a case where the finger leaves the touch sensor for a moment during movement of the finger due to external vibration. In such a case, if it is a rough detection method that detects only movement by detecting only the number of sensor elements, it is difficult to cause detection omissions, but not only single element detection but also multiple element detection In the case of a precise detection method that also detects the state, it is conceivable that the finger may skip one detection state because the finger continues to rotate even if the instruction is instantaneously separated. However, if the distance between the previous position and the current position is 1 or 2 in step K22, the continuous movement detection state is established even if two movements have been made from the previous position, that is, even if one is skipped from the previous position. Because it can be handled, it can be as close as possible to the user's desired action even under vibration.

  In step K30, not only 2 frames but also 3 frames are valid. Therefore, even when the finger is momentarily detached due to vibration or when a detection state is detected by a quick operation, it moves. Operation can be detected. In addition, when detecting the amount of movement for three frames, not only is the amount of movement “1” fixed as in the case of the next two frames, but the setting of the reference point for the next detection is the same as when moving two frames. Since only two frames are moved relative to the previous reference point, even when movement is confirmed by detecting three frames, an amount of movement confirmation of “n−1” obtained by subtracting 1 from the number n of sensor elements is secured. This makes it possible for the user to obtain a stable operation feeling of the same operation feeling regardless of how the user touches.

  Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, functions included in each member, each means, each step, etc. can be rearranged so as not to be logically contradictory, and a plurality of means, steps, etc. can be combined or divided into one. Is possible. In the embodiment, the description has been made using the capacitive sensor as the touch sensor, but the touch sensor is not limited to this system. For example, there are touch sensors such as a thin film resistance method that detects contact by measuring current fluctuation by detecting contact between a plurality of thin film electrodes, but the present invention is realized even if such a touch sensor is used. Is possible.

  Further, in each embodiment, each sensor element group is arranged in an annular shape, and the arrangement of display items in the sub-display unit ELD is arranged vertically, but it is not always necessary to do so. Various changes can be made according to the functions and design required for the terminal. For example, as shown in FIG. 25A, the semicircular sensor element group G1 is arranged only on the right side or the left side of the sub display unit ELD in accordance with the arrangement of the display items in the vertical direction on the sub display unit ELD. In correspondence with the arrangement of the display items in the horizontal direction on the sub display unit ELD as shown in FIG. 5B, the semicircular sensor element group G1 is arranged only on the upper side or the lower side of the sub display unit ELD. Alternatively, it may be configured to be arranged symmetrically in the vertical direction. Further, the outer periphery of the sub display portion ELD and the shape of the sensor element group G1 do not necessarily have to be circular, and the sub display portion ELD has a hexagonal shape as shown in FIG. It is naturally possible to arrange the sensor element group G1 so as to be symmetrically along the right side, the left side, or both the left and right sides, and further to arrange so that the sensor element group G1 is symmetrically along the upper side, the lower side, or both sides of the upper and lower sides. It is. Although not shown, the sub-display portion ELD has a rectangular shape, and a U-shaped sensor element group G1 is arranged symmetrically on the upper or lower side or both upper and lower sides, or symmetrically on the left or right side or left and right sides. It is also possible to do. Also in these layouts, the sensor element group G1 and each sensor element constituting the sensor element group G1 can be of any number according to the function and the design.

  Furthermore, in the embodiments, the description has been made with reference to a mobile phone terminal, but a mobile wireless terminal other than a telephone, a PDA (Personal Digital Assistance), a portable game machine, a portable audio player, a portable video player, a portable electronic dictionary, a portable electronic The present invention can be widely applied to portable electronic devices such as a book viewer.

It is a block diagram which shows the outline | summary of the mobile telephone terminal of a present Example. It is a perspective view of the mobile telephone terminal of a present Example. It is a disassembled perspective view which shows the structure of the display part periphery mounted in the mobile telephone terminal of a present Example. It is a detailed functional block diagram of a present Example. It is a block diagram which shows the more detailed structure of the touch sensor function of the mobile telephone terminal of a present Example. It is a schematic block diagram of the data processing of the contact detection by each sensor element in the mobile phone terminal of this embodiment. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 1 of this invention. It is a figure explaining operation | movement of the sensor element of Example 2 of this invention. It is a figure explaining operation | movement of the sensor element of Example 3 of this invention. It is the conceptual diagram which divided and showed the sensor element detection state to 16. It is a flowchart which shows an example of the movement confirmation process in 16 detection states. FIG. 24 is a diagram illustrating a determination process when the process of the flowchart of FIG. 23 is applied to contact from the sensor elements L1 to L4 of FIG. It is a figure of the example of a layout of the sensor element and sub display part of the modification of this invention. It is a figure explaining the conventional sensor element and its control example. It is a figure explaining the conventional sensor element and its control example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Mobile phone terminal 110 Control part 120 Sensor part 122-126 Sensor element group 130 Display part 140 Storage part 142 Storage area 144 External data storage area 150 Information processing function part 160 Telephone function part 170 Input part key panel 180 Loudspeaker 210 Touch sensor 220 Camera 230 Light ELD Sub display part PNL Panel R1-R4 Sensor element L1-L4 Sensor element G1-G3 Sensor element group SP1, SP2 Separation part SW1-SW4 Tactile switch AP1-AP4 Application BA Base application FLG Flag storage part APRF RFID application APIR Infrared communication application IRD Infrared communication driver RFD RFID driver KSP Key scan port driver AUD Audio driver PR Protocol RD Radio driver SI Serial in Interface part SWCON Switching control part KEY Key operation part OCD Open / close detection device (magnetic)
MIC microphone EAP earphone SP speaker COM communication unit RM radio module SW switching unit IR infrared communication unit RFID RFID module TSM touch sensor module PSCON power supply controller PS power supply QUE queue CNF confirmation unit SIMON serial interrupt monitoring unit IH interrupt handler DL device layer CLK OS Timer TSB Touch sensor driver block TSBA Touch sensor base application block API Application program interface 300 Preprocessing system 310 A / D converter 320 Control unit 330 Storage unit AR, AR1, AR2 Arrow TI Title LS1 to LS8 List item M1 to M3 Sensor element BP1 to BP3 Reference points PP1 to PP3 Previous position CP1 to CP3 Current position

Claims (2)

A first sensor element group in which a plurality of sensor elements whose contact is detected are arranged adjacently and continuously;
A display unit disposed adjacent to the first sensor element group on the surface on which the first sensor element group is provided;
A control unit for controlling display of the display unit;
With
The plurality of sensor elements constituting the first sensor element group are arranged in a predetermined first direction component on the same plane as the display surface of the display unit and on the same plane as the display surface. When decomposing into two directional components of a second direction component orthogonal to the first direction, one of the first and second direction components increases as the other increases, and the one decreases Arranged such that the other has an increasing relationship as it decreases,
In the state where the control unit displays a plurality of selection items arranged in a direction parallel to the first direction on the display unit, the plurality of sensor elements constituting the first sensor element group are in contact transition. The display unit changes the display of the item selected in the plurality of selection items according to a change in position in a direction parallel to the component of the first direction among the transition directions of the contact. controls,
A second sensor element group constituted by the same number of sensor elements as the plurality of sensor elements constituting the first sensor element group;
An end portion of the first sensor element group and an end portion of the second sensor element group are arranged so as to be adjacent to each other,
When one of the plurality of sensor elements of the first or second sensor element group detects a contact transition, the control unit detects a transition of the contact in a direction parallel to the component of the first direction. The display of the item selected in the plurality of selection items is changed in one direction according to the change in position, and when the other plurality of sensor element groups detect the contact transition continuously, the transition of the contact is detected. The display unit is configured to change the display of an item selected in the plurality of selection items in a direction opposite to the one direction in response to a change in position in a direction parallel to the component in the first direction. A portable electronic device characterized by being controlled . The arrangement direction of the respective elements is 2 of a component in a predetermined first direction on the same plane as the display surface of the display unit and a component in a second direction orthogonal to the first direction on the same plane as the display surface. Arranged so that when one of the components in the first and second directions increases, the other decreases as one of the components in the first and second directions increases, and the other increases as the one decreases A display control method for a portable electronic device including the sensor element group,
Displaying a plurality of selection items side by side in a direction parallel to the first direction on the display unit;
Detecting a transition of contact between the plurality of sensor elements constituting the first sensor element group;
Identifying a change in position in a direction parallel to the first direction component of the contact transition direction based on detection of the contact transition;
In response to changes in the identified position, we have a, and controlling the display unit so as to shift the displayed items are selected in the plurality of selection items,
A second sensor element group constituted by the same number of sensor elements as the plurality of sensor elements constituting the first sensor element group;
An end portion of the first sensor element group and an end portion of the second sensor element group are arranged so as to be adjacent to each other,
When one of the plurality of sensor elements of the first or second sensor element group detects a contact transition, it responds to a change in position in a direction parallel to the component of the first direction in the contact transition direction. When the display of the item selected in the plurality of selection items is changed in one direction, and the other plurality of sensor element groups detect contact transitions in succession, the first of the contact transition directions is Controlling the display unit to change the display of an item selected in the plurality of selection items in a direction opposite to the one direction according to a change in position in a direction parallel to a component of one direction;
The display control method for a portable electronic device, characterized by have a.

Images