JP2013047866A - Portable electronic equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem that it is necessary to use a touch panel installed in a display in the case of selecting an icon displayed on the display or controlling the display screen of the display.SOLUTION: Portable electronic equipment includes; a first display part; a second display part; a first detection part arranged so as to be overlapped with the first display part for detecting a contact by a user; a first determination part for determining whether or not the first conditions are satisfied by the contact by the user detected by the first detection part; and a display control part for, when it is determined that the first conditions are satisfied by the first determination part, controlling the display of the second display part in accordance with the contact by the user, and for, when it is determined that the first conditions are satisfied by the first determination part, controlling the display of the first display part in accordance with the contact by the user.

Description

  The present invention relates to a portable electronic device having a plurality of touch panel displays.

  A portable electronic device having two touch panels is known. In recent years, portable electronic devices can realize complicated functions that are inferior to personal computers. When selecting an icon selected on the display, the user can select the icon by directly pressing the displayed icon.

JP 2006-31224 A

  However, in the portable electronic device as described above, in order to control the screen displayed on the display, a touch panel provided on the display must be used. Therefore, for example, when there are a plurality of icons to be selected and each is displayed on a different display, the user needs to carry a finger to the different display each time, which is troublesome.

  Therefore, the present invention has been made in view of such problems, and a portable electronic device that can improve user convenience by controlling the display of the other display using a touch panel provided on one display. The purpose is to provide equipment.

  In order to solve the above-described problem, a mobile electronic device according to the present invention includes a first display unit, a second display unit, a detection unit that is arranged on the first display unit and detects contact by a user, and the detection A first determination unit that determines whether or not contact by a user detected by the unit satisfies a first condition; and if the first determination unit determines that the first condition is satisfied, the user The display of the second display unit is controlled according to the contact by the first display unit, and when the first determination unit determines that the first condition is satisfied, the first display unit is controlled according to the contact by the user. A display control unit for controlling display.

  By providing the above configuration, the display on the other display is controlled using the touch panel provided on one display, so that the convenience of the user can be improved.

1 is an external perspective view of a mobile phone 100. FIG. 1 is a configuration diagram of a mobile phone 100. FIG. 4 is a diagram for explaining the posture of the mobile phone 100. FIG. It is a figure for demonstrating a user's touch position. It is a figure for demonstrating the 1st relationship of a user's touch position. It is a figure for demonstrating the 2nd relationship of a user's touch position. It is a figure for demonstrating the 3rd relationship of a user's touch position. It is a figure for demonstrating the movement of a user's touch position. 4 is a flowchart for explaining processing performed in mobile phone 100.

  Hereinafter, a mobile phone 100 as an embodiment of a mobile electronic device according to the present invention will be described.

  FIG. 1 is an external perspective view of a slide-type mobile phone 100. The mobile phone 100 includes an upper housing 101 and a lower housing 102. The lower housing 102 is provided with a first touch panel 105. The upper housing 101 is provided with a speaker 103, a microphone 104, and a second touch panel 106. On each touch panel, key groups such as cursor keys and numeric keys, icons, and the like are displayed based on instructions from the user, and the user can perform various operations by touching them with a finger or the like. Further, the upper housing 101 and the lower housing 102 are connected so as to be openable and closable.

  FIG. 1A is an external perspective view when the upper housing 101 and the lower housing 102 are in a closed state. The closed state is when the upper casing 101 is in a relative position so as to cover the touch panel of the lower casing 102. In the present embodiment, the closed state is referred to as a closed state.

  FIG. 1B is an external perspective view when the upper housing 101 and the lower housing 102 are in an open state. The opened state is a relative position where the second touch panel 106 provided in the upper casing 101 and the first touch panel 105 provided in the lower casing 102 are in a relation that allows visual recognition from the same direction. In the present embodiment, the open state is referred to as an open state.

  FIG. 2 is a configuration diagram of the mobile phone 100.

  The mobile phone 100 includes a wireless unit 110, a microphone 104, a speaker 103, a signal processing unit 113, a state detection unit 112, a first touch panel 105, a second touch panel 106, a storage unit 111, a posture determination unit 107, and a control unit 118. Is done.

  The radio unit 110 performs modulation / demodulation of signals transmitted / received via the antenna 109.

  The signal processing unit 113 performs processing for transmitting an audio signal input from the microphone 104 via the wireless unit 110, and processing for outputting an audio signal received from the antenna 109 via the wireless unit 110 to the speaker 103. I do. Further, the signal processing unit 113 receives data such as e-mail via the wireless unit 110 and outputs the data to the control unit 118.

  The microphone 104 outputs the input sound to the signal processing unit 113 as an audio signal.

  The speaker 103 outputs the audio signal processed by the signal processing unit 113 or the audio data received from the control unit 118 as audio.

  The first touch panel 105 includes a first display unit 114 and a first input unit 115, and the second touch panel 106 includes a second display unit 116 and a second input unit 117.

  Each display unit includes an LCD (Liquid Crystal Display), and has a function of displaying images such as characters and icons on the LCD based on instructions from the control unit 118.

Each input unit detects a touch by the user, and during detection, unit time (for example, 1/6)
Every 0 seconds), the coordinate value of the touched position is output to the control unit 118 and the storage unit 111. Touching means that the user touches the first input unit 115 or the second input unit 117 with a finger or the like. Detachment means that when the user touches the first input unit 115 or the second input unit 117 with a finger, the touching finger is separated from the first input unit 115 or the second input unit 117. The sliding means that when the user touches the first input unit 115 or the second input unit 117 with a finger, the touching user's finger moves while maintaining contact. Each input unit determines that the touch has been made when the coordinate value is detected. Each input unit determines that it is detached when the detected coordinate value is no longer detected. Each input unit determines to be a slide when the detected coordinate value changes with time. Note that touching the first input unit 115 or the second input unit 117 is not limited to the user's finger. A pen other than the user's finger may be used. The first input unit 115 and the second input unit 117 may be realized by any method such as a resistance film method, an optical method, and a capacitive coupling method used in a general touch panel. Further, the first input unit 115 and the second input unit 117 can simultaneously detect a plurality of touches by the user. The first input unit 115 can detect a new touch by the user when one touch by the user is detected. The first input unit 115 outputs the coordinate value of the already touched position and the coordinate value of the newly touched position to the control unit 118. The same applies to the second input unit 117.

  The storage unit 111 includes a ROM, a RAM, an EEPROM, a nonvolatile RAM, a flash memory, an HDD, and the like, and stores a program processed by the control unit 118.

  In addition, the storage unit 111 has a function of storing coordinate values output from each input unit for each unit time (for example, 1/60 seconds) while detecting a touch by the user. That is, the memory | storage part 111 memorize | stores the coordinate value output between the touch state and the detached state.

  The posture determination unit 107 includes the acceleration sensor 14 and detects the posture of the mobile phone 100 using the acceleration sensor 14. Based on the output of the acceleration sensor, the posture determination unit detects whether the mobile phone 100 is in the posture shown in FIG. 3A or the posture shown in FIG. 3B, as shown in FIG. FIG. 3A shows a posture in which the mobile phone 100 is used by being opened like a book, for example. FIG. 3B shows a posture in which the lower housing 102 is held and used by the user as in a conventional slide type mobile phone 100. In this embodiment, FIG. 3A is referred to as a first posture, and FIG. 3B is referred to as a second posture. Posture determination unit 107 outputs the detected posture to control unit 118.

  The state detection unit 112 has a function of detecting the relative position of the upper housing 101 with respect to the lower housing 102. Specifically, the state detection unit 112 detects whether the mobile phone 100 is in an open state or a closed state. The state detection unit 112 outputs the detected result to the control unit 118. As an example of the state detection unit 112, for example, it is conceivable to provide a magnet sensor in the upper casing 101 and the lower casing 102. By providing a magnet sensor, an electrical signal flows when the magnet sensors are close to each other when they are in the closed state, and an electrical signal does not flow when they are open because the magnet sensors are separated. May be.

  The control unit 118 includes a first determination unit 119, a second determination unit 120, and a display control unit 121, and controls the overall operation of the mobile phone 100. The control unit 118 is a processing unit such as a CPU (Central Processing Unit).

  The first determination unit 119 determines whether the number of touches by the user detected by the first input unit 115 is one or a plurality when the device is in the second state. When the number of touches by the user is one, the first determination unit 119 outputs the result to the display control unit 121 described later. If a plurality of touches by the user are detected at the same time, the first determination unit 119 outputs the result to the second determination unit 120.

  When a plurality of touches are simultaneously detected by the first determination unit 119, the second determination unit 120 determines the relative positional relationship of the plurality of touches based on the position coordinates per unit time of the plurality of touches. Judging. The second determination unit 120 outputs the determination result to the display control unit 121. Processing performed by the second determination unit 120 will be described with reference to FIGS. As illustrated in FIG. 4, for example, it is assumed that the first determination unit 119 detects a touch with the finger A and the finger B in the first input unit 115. The second determination unit 120, based on the output from the first determination unit 119, the first coordinate value (X1, Y1) of the touch position 200 of the finger A and the second coordinate value (X2, Y2) of the touch position 201 of the finger B. ) Is acquired from the first input unit 115. The second determination unit 120 calculates a first difference between the first coordinate value and the second coordinate value, that is, (X1-X1, Y2-Y2). Next, the second determination unit 120 obtains the third coordinate value (X3, Y3) of the touch position 202 of the finger A and the fourth coordinate value (X4, Y4) of the touch position 203 of the finger B after the unit time has passed. Obtained from one input unit 115. The second determination unit 120 calculates a second difference between the third coordinate value and the fourth coordinate value, that is, (X3-X4, Y3-Y4). The second determination unit 120 compares the first difference with the second difference. When comparing the first difference and the second difference, the second determination unit 120 calculates the square root of the sum of the square of “X1−X2” and the square of “Y1−Y2”, and “X3−X4”. ”And the square root of the sum of“ Y3−Y4 ”. That is, the second determination unit 120 determines whether the linear distance between the finger A and the finger B has become longer, shorter, or the same when the unit time has elapsed. As illustrated in FIG. 5, the second determination unit 120 determines that the first relationship is established when the linear distance between the finger A and the finger B is the same. The first relationship is that the finger A and the finger B move while the finger A and the finger B are stationary or the relative position of the finger B with respect to the finger A does not change. As illustrated in FIG. 6, the second determination unit 120 determines that the second relationship is in the second relationship when the linear distance between the finger A and the finger B becomes longer. The second relationship is that the relative position of the finger B with respect to the finger A is separated. As illustrated in FIG. 7, the second determination unit 120 determines that the third relationship is established when the linear distance between the finger A and the finger B becomes small. The third relationship is that the relative position of the finger B with respect to the finger A approaches. The second determination unit 120 outputs the determined relationship to the display control unit 121. The linear distance is, for example, the dotted line 204 in FIG.

  The display control unit 121 can control the display of the first display unit 114 and the second display unit 116.

  When the first state is detected by the posture determination unit 107, the display control unit 121 controls the display of the first display unit 114 based on the user input detected by the first input unit 115, and the second The display of the second display unit 116 can be controlled based on the user input detected by the input unit 117.

  When the second state is detected by the posture determination unit 107, the display control unit 121 displays the first display unit 114 and the second display unit 116 based on the user input detected by the first input unit 115. Can be controlled. When the number of touches by the user is one, the display control unit 121 controls the display of the first display unit 114 based on the touch by the user. When a specific icon is touched by the user and then detached, the display control unit 121 displays an image displayed by executing the application program specified by the selected icon on the first display unit 114. To do. In addition, when a specific icon is touched by the user and then dragged and detached, the display control unit 121 displays the icon selected by the user at the position where the detachment is detected. The display control unit 121 controls the display of the second display unit 116 based on the output from the second determination unit 120. The display control unit 121 moves the image displayed on the second display unit 116 with the movement of the touch when the first determination unit 119 determines the first relationship. For example, as illustrated in FIG. 8, when the display control unit 121 moves the finger A and the finger B in the direction of the arrow C, the display of the second display unit 116 is scrolled horizontally. When the display control unit 121 moves the finger A and the finger B in the direction of the arrow D as shown in FIG. 8, the display on the second display unit 116 is vertically scrolled. Note that the direction in which the finger A and the finger B are moving may be determined by acquiring the position coordinates of the finger A or the finger B detected by the first input unit 115. When the second determination unit 120 determines that the second relationship is the second relationship, the display control unit 121 enlarges and displays the image displayed on the second display unit 116. When the second determination unit 120 determines that the third relationship is present, the display control unit 121 reduces the image displayed on the second display unit 116 and displays it.

  Next, the operation of the mobile phone 100 will be described with reference to FIG.

  The posture determination unit 107 detects whether or not the mobile phone 100 is in the second posture (S21). When the posture determination unit 107 detects that the posture is the second posture (YES in S21), the control unit 118 determines whether or not a touch by the user is detected by the first input unit 115. When the first posture is detected by the posture determination unit 107 (NO in S21), the control unit 118 determines whether or not an input is detected by the first input unit 115 (S31). When the first input unit 115 detects a touch by the user, the display control unit 121 controls the display of the first display unit 114 based on the user's touch (S32). When the first input unit 115 does not detect the user's touch, the control unit 118 determines whether the second input unit 117 detects the touch by the user (S41). When a user touch is detected by the second input unit 117 (YES in S41), the display control unit 121 controls the display of the second display unit 116 based on the detected touch (S42).

  When the mobile phone 100 is in the second posture (YES in S21), the first determination unit 119 has two or more touched by the user when the first input unit 115 detects the touch by the user. It is determined whether or not (S22). When the number of touches is one (NO in S22), the first determination unit 119 outputs the result to the display control unit 121. The display control unit 121 controls the display of the first display unit 114 based on the movement of the touch position by the user detected by the first input unit 115 (S32). The “movement of the touch position” is detachment or slide.

  When the first determination unit 119 determines that the number touched by the user is two or more (YES in S22), the second determination unit 120 determines the relationship between the detected touch positions. The second determination unit 120 calculates a distance between touch positions (hereinafter referred to as a first distance) (S23). The second determination unit 120 is referred to as “two distances for calculating a distance between touch positions after a predetermined time has elapsed” (S24). The second determination unit 120 compares the first distance and the second distance. The second determination unit 120 determines whether the first distance and the second distance are the same (S25). When the first distance and the second distance are the same (YES in S25), the second determination unit 120 determines the first relationship and outputs the result to the display control unit 121. If the second determination unit 120 determines that the first relationship is the first relationship, the display control unit 121 scrolls the image displayed on the second display unit 116 according to the movement of the touch position (S26).

  If the first distance and the second distance are not the same (NO in S25), the second determination unit 120 determines whether or not the length of the first distance is shorter than the length of the second distance (S51). . If the length of the first distance is shorter than the length of the first distance (YES in S51), the second determination unit 120 determines that the second relationship is present, and outputs the result to the display control unit 121. When the second determination unit 120 determines that the second relationship is the second relationship, the display control unit 121 enlarges and displays the image displayed on the second display unit 116 (S52).

The second determination unit 120 determines that the length of the first distance is not shorter than the length of the second distance (S51).
NO), the length of the first distance is determined to be longer than the length of the second distance, and the third relationship is determined (S61). When the second determination unit 120 determines that the third relationship is established, the display control unit 121 reduces the image displayed on the second display unit 116 and displays it (S61).

  With the above operation, the user controls the display on the other display using the touch panel provided on the one display. Therefore, convenience for the user is improved as compared with the conventional case.

[Other Embodiments]
(1) In the present embodiment, the mobile phone 100 may include an operation unit that can detect an operation by the user. When a predetermined operation is detected by the operation unit, the display control unit 121 may control the display of the first display unit 114 based on the result determined by the second determination unit 120. Specifically, the display control unit 121 scrolls the image displayed on the first display unit 114 when the first relationship is determined. If the display control unit 121 determines that the second relationship is present, the display control unit 121 enlarges and displays the image displayed on the first display unit 114. When it is determined that the relationship is the third relationship, the display control unit 121 reduces and displays the image displayed on the first display unit 114. The operation unit includes hard keys such as buttons.

  (2) In the present embodiment, the display control unit 121 has been described by scrolling the image displayed on the second display unit 116 when the second determination unit 120 determines the first relationship, This is not necessarily the case. When a pointer such as an arrow is displayed on the second display unit 116 and the second determination unit 120 determines that the first relationship is present, the display control unit 121 responds to the movement of the finger A and the finger B. The pointer may be moved. In addition, when the second determination unit 120 determines that the first relationship is established, the control unit 118 can display a pointer when the user continuously touches the first input unit 115 using the finger A and the finger B. The application specified by may be executed. The display control unit 121 causes the second display unit 116 to display an image displayed by executing the application.

  (3) Although the mobile phone 100 is described as including the first casing and the second casing, the present invention is not necessarily limited to this case. The mobile phone 100 may have only one housing, and the first display portion 114, the second display portion 116, and the first input portion 115 may be provided in one housing.

  (4) The control unit 118 can control the display of the second display unit 116 based on the input detected by the second input unit 117 when the cellular phone 100 is in the closed state. The first determination unit 119 determines whether the number of user touches detected by the second input unit 117 is one or more. When the number of touches by the user is one, the first determination unit 119 outputs the result to the display control unit 121 described later. If a plurality of touches by the user are detected at the same time, the first determination unit 119 outputs the result to the second determination unit 120. When a plurality of touches are simultaneously detected by the first determination unit 119, the second determination unit 120 determines the relative positional relationship of the plurality of touches based on the position coordinates per unit time of the plurality of touches. Judging. When it is determined that the display control unit 121 has the first relationship, the display control unit 121 scrolls the image displayed on the second display unit 116. When it is determined that the display control unit 121 has the second relationship, the display control unit 121 enlarges and displays the image displayed on the second display unit 116. When it is determined that the display control unit 121 has the third relationship, the display control unit 121 reduces and displays the image displayed on the second display unit 116.

  (5) The display control unit 121 may move the position of the image instead of scrolling the image displayed on the first display unit 114 when it is determined as the first relationship. The display control unit 121 may move the position of the image displayed on the second display unit 116 when the first relationship is determined when the mobile phone 100 is in the closed state.

  (6) In the present embodiment, the display control unit 121 controls the display of the first display unit 114 or the second display unit 116 using the result detected by the first input unit 115. Not limited. The display control unit 121 may control the display of the first display unit 114 or the second display unit 116 using the result detected by the second input unit 117. The first determination unit 119 makes a determination based on the number of touches detected by the second input unit 117. The second determination unit 120 determines the positional relationship of the touch based on the touch position detected by the second input unit 117. The display control unit 121 controls the display of the first display unit 114 based on the determination of the second determination unit 120. In this case, the contents of the process executed by the mobile phone 100 are the same as those in FIG.

  (7) Although the second determination unit 120 determines the first relationship to the third relationship based on the touched position, it is not always necessary to determine the three relationships. The second determination unit 120 may determine whether the relationship is the second relationship or the third relationship based on the touched position, or may determine only the second relationship.

  (8) The processing of S25, S51, and S61 in FIG. 9 may be switched in order. For example, the process of S51 may be performed after the process of S24, the process of S25 may be performed if NO in the process of S51, and the process of S61 may be performed if NO in the process of S25. When the process of S61 comes after S25, a process of “the first distance is longer than the second distance” is added between S61 and S24.

  In addition, the embodiments can be appropriately modified in various ways within the scope of the technical idea shown in the claims.

DESCRIPTION OF SYMBOLS 103 Speaker 104 Microphone 105 1st touch panel 106 2nd touch panel 107 Posture determination part 109 Antenna 110 Radio | wireless part 111 Memory | storage part 112 State detection part 113 Signal processing part 114 1st display part 115 1st input part 116 2nd display part 117 2nd Input unit 118 Control unit 119 First determination unit 120 Second determination unit 121 Display control unit

Claims (13)

A first display unit;
A second display;
A first detection unit that is arranged over the first display unit and detects contact by a user;
A first determination unit that determines whether or not contact by a user detected by the first detection unit satisfies a first condition;
When the first determination unit determines that the first condition is satisfied, the display of the second display unit is controlled according to the contact by the user, and the first determination unit controls the first condition. A display control unit that controls display of the first display unit in response to contact by the user;
Mobile electronic device having The first condition is that the number of places touched by the user is the first number;
The portable electronic device according to claim 1. The first number is two;
The portable electronic device according to claim 2. An operation unit for detecting an operation by a user;
When the operation by the user is detected by the operation unit, the display control unit only displays the first display unit according to the contact by the user among the first display unit and the second display unit. To control,
The portable electronic device according to claim 1. A second determination unit that determines a relative relationship between the first contact and the second contact when the first detection unit detects the first contact and the second contact by the user;
Enlarging the image displayed on the second display unit when the second determination unit determines that the relative relationship is the first relationship;
The portable electronic device according to claim 3. Reducing the image displayed on the second display unit when the second determination unit determines that the relative relationship is the second relationship;
The portable electronic device according to claim 3. A calculation unit that calculates a distance between the position of the first contact and the position of the second contact;
The second determination unit compares the first distance at the first time with the second distance after a predetermined time has elapsed from the first time, and when the second distance in the previous period is greater than the first distance, Determining that it is in a first relationship;
The portable electronic device according to claim 5. A calculation unit that calculates a distance between the position of the first contact and the position of the second contact;
The second determination unit compares the first distance at the first time with the second distance after a predetermined time has elapsed from the first time. When the second distance in the previous period is smaller than the first distance, Determining that there is a second relationship;
The portable electronic device according to claim 6. An inclination detection unit that detects the inclination of the own device;
The display control unit controls only the display of the first display unit among the first display unit and the second display unit according to the contact by the user when the tilt of the own device is a specific tilt. about,
The portable electronic device according to claim 1. A second detection unit arranged to overlap the second display unit and detecting contact by the user;
In the case where the inclination of the own device is the specific inclination, the display control unit is configured to select the first display unit and the second display unit according to a user contact detected by the second detection unit. Controlling only the display of the second display,
The portable electronic device according to claim 9. A second detection unit that is arranged over the second display unit and detects contact by a user;
A first housing provided with the first display unit;
A second housing provided with the second display section;
A state detection unit that detects whether or not the first display unit is in a closed state covered by the second housing;
The first determination unit determines whether the contact by the user detected by the second detection unit satisfies the first condition when the closed state is detected by the state detection unit;
When the second detection unit detects the third contact and the fourth contact in the case where the first condition is satisfied, the second determination unit has a relative relationship with the third contact and the fourth contact. Judging
The display control unit controls display of the second display unit based on the relative relationship;
The portable electronic device according to claim 3. When it is determined that the relative relationship is the first relationship, the display control unit enlarges the image displayed on the second display unit, and the relative relationship is the second relationship. If determined, reducing the image displayed on the second display unit;
The portable electronic device according to claim 11. A display control method executed in a portable electronic device including a first display unit and a second display unit capable of detecting contact by a user,
Determining whether the contact by the user satisfies the first condition;
If it is determined that the first condition is satisfied, the step of controlling the display of the second display unit according to the contact by the user;
If it is determined that the first condition is not satisfied, the step of controlling the display of the first display unit according to the contact by the user;
A display control method including: