JP2008027183A - Information processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor easy to carry, which can display most suitable for an operator without especially making the operator conscious. <P>SOLUTION: An information processor 100 includes a flat enclosure 110 which is of such size as to be held with one hand and has an approximately rectangular shape having a main surface, and the enclosure 110 has first and second side faces disposed on both sides of the main surface. Furthermore, the information processor 100 includes: a display device 118 having a display face provided in the main surface; sheet-like pressure sensitive sensors 120R and 120L for detecting a distribution of contact areas between the first and second side faces and a human hand; and a control part for controlling contents displayed on the display face by the display device 118, on the basis of outputs of the pressure sensitive sensors 120R and 120L. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, and more particularly to an input interface in an information processing apparatus having a touch panel that can be operated with one hand.

  Recent advances in performance of mobile phones, especially their multi-functionality, are remarkable, and it is no longer appropriate to call a phone, but to be called a portable computer. In addition to the telephone function, the mobile phone is provided with a clock, a calculator, a game function, and an Internet access function. Therefore, the mobile phone also operates as a platform for running applications such as a full browser and e-mail.

  Thus, although it is no longer a mere telephone but a mobile phone that should be called a portable information terminal, there are still problems to be solved. The biggest challenge is the human interface, especially the information input interface. Since it is a portable device, the mobile phone must be small.

  In the case of a computer, information can be input at high speed using a keyboard having a large number of keys. However, in the case of a mobile phone, it is difficult to provide a large number of keys due to restrictions due to the physical size of the device. If too many keys are provided, it is difficult to input due to the size of the finger. If the key is enlarged, the housing must be enlarged.

  Furthermore, a problem peculiar to mobile phones is the fact that characters and the like are often input with one hand. Therefore, it is necessary to devise in particular that input with one hand can be easily performed. Patent Document 1 discloses a mobile phone in which keys are arranged so that input can be easily performed with one hand.

  FIG. 1 shows a front view of the mobile phone described in Patent Document 1. FIG. Referring to FIG. 1, a mobile phone 30 described in Patent Document 1 is provided in a substantially vertically long and substantially rectangular parallelepiped housing 32 that is large enough to be held by one hand 36 and an upper front portion of the housing 32. And a number of keys 40, 42, 44, 46, and 48 disposed at the lower front of the housing 32.

  In this mobile phone 30, a plurality of keys are arranged on a circle centering on a point O near the joint at the base of the thumb so that the key can be easily pressed with the thumb 38 when the housing 32 is held with the right hand. 40, and a plurality of keys 42, 44, 46, and 48 are arranged on a circle concentric with the circle.

  With this arrangement, when the housing 32 is held with the right hand, a plurality of keys arranged on concentric circles can be easily operated by rotating the thumb 38 around the point O.

  However, the mobile phone 30 described in Patent Document 1 has a problem that if the keys are arranged for the right hand, the left hand is extremely difficult to operate. Further, for example, when the mobile phone 30 is held with one hand and the keys are operated with the other hand, there is a problem that the keys are not arranged in a matrix and are difficult to use.

  On the other hand, as a portable information terminal, Japanese Patent Application Laid-Open Publication No. 2004-228561 determines whether the operator is operating the terminal with the right hand or the terminal with the left hand and changes the display method according to the result. FIG. 2 shows a front view of an electronic notebook 70 which is a portable information terminal disclosed in Patent Document 2. As shown in FIG.

  Referring to FIG. 2, this electronic notebook 70 includes a flat rectangular parallelepiped casing 72, a liquid crystal display section 74 disposed on almost the entire front surface of the casing 72, and a casing sandwiching the liquid crystal display section 74. It includes a rotary switch 80 disposed on opposite sides of the body 72, and an execute key 76 and a cancel key 78. The rotary switch 80 is a switch operated when selecting a menu item displayed on the liquid crystal display unit 74, and the execution key 76 is a key operated when instructing execution of the selected item. Reference numeral 78 denotes a key operated when the execution of the selected item is stopped.

  The electronic notebook 70 further includes photosensors 82 and 84 disposed on the side surface of the housing 72 where the rotary switch 80 is disposed at positions symmetrical to each other across the rotary switch 80.

  In this electronic notebook 70, photosensors 82 and 84 are arranged at a position sandwiching the rotary switch 80. For example, when the user holds the casing 72 with the left hand as shown in FIG. 2, the rotary switch 80 is operated with the left hand, so the photo sensor 82 is hidden with the left hand. On the other hand, the photo sensor 84 is not hidden. Therefore, in this case, the outputs of the photosensors 82 and 84 are different from each other. Conversely, when the electronic notebook 70 is held with the right hand, the rotary switch 80 is held on the right side and the casing 72 is held upside down. In this case, the photo sensor 84 is hidden by the right hand, and the photo sensor 82 is not hidden.

Therefore, by examining the outputs of the photo sensors 82 and 84, it can be determined whether the electronic notebook 70 is held with the right hand or the left hand. Then, the displayed screen is rotated so that it is upside down between the case where it is held with the right hand and the case where it is held with the left hand. As a result, regardless of whether the user holds the electronic notebook 70 with the right hand or the left hand, the screen is displayed on the liquid crystal display unit 74 so as to be in the correct orientation when viewed from the user. As a result, correct display can be performed regardless of whether the user holds the casing 72 with the right hand or the left hand.
Japanese Patent Laid-Open No. 2002-164980 (FIG. 1) Japanese Patent Laid-Open No. 4-88546 (FIG. 2)

  Mobile information terminals such as mobile phones are often held and operated with only one hand. In such a case, there is a need for a portable information terminal that is easy to operate regardless of whether the user holds the casing with the right hand or the left hand. In particular, the keys are preferably arranged in a form optimized for the right hand when held with the right hand, and in a form optimized for the left hand when held with the left hand.

  For this purpose, it is necessary to determine whether the portable information terminal is held with the right hand or the left hand by some means.

  The electronic notebook 70 disclosed in Patent Document 2 is assumed to be operated mainly by the rotary switch 80 and the execution key 76 and the cancel key 78. Accordingly, the housing 72 is naturally held in the two ways described above, and as a result, the photosensors 82 and 84 can determine whether the housing 72 is held with the right hand or the left hand. However, in the case of an information processing apparatus that is always carried, such as a mobile phone, it is preferable that the thickness of the casing is small. If such a switch is provided on the side of the casing, it is difficult to hold and is not practical. In addition, there are many opportunities to input various characters, and it is not practical to use the above switches for that purpose. Therefore, it is difficult to apply the technology disclosed in Patent Document 2 to a small information processing apparatus such as the mobile phone disclosed in Patent Document 1. Further, when a touch panel is provided on the display device, it is expected that the above-described switch will not be operated in the first place. In the method described in Patent Document 2, how the operator holds the housing is output as a sensor. It cannot be judged clearly only by itself. Therefore, it is extremely difficult to provide the technology described in Patent Document 2 to an information processing apparatus that assumes input using a touch panel.

  SUMMARY OF THE INVENTION Therefore, an object of the present invention is an information processing apparatus of a size that can be held with one hand, and an information processing apparatus that is easy to hold that can perform optimal display for the operator without making the operator particularly conscious. Is to provide.

  Another object of the present invention is to provide an information processing apparatus that can be held with one hand and that can be input efficiently without making the operator particularly conscious. That is.

  An information processing apparatus according to a first aspect of the present invention is an information processing apparatus including a flat casing having a substantially rectangular parallelepiped shape having a main surface and having a size that can be held with one hand. The housing has first and second side surfaces arranged with the main surface interposed therebetween. The information processing apparatus is further provided with a display device having a display surface provided on the main surface, the first and second side surfaces, and the first and second side surfaces and a human hand (including a finger). First detection means for detecting the distribution of the contact area, and display control means for controlling the content displayed on the display surface by the display device based on the output of the first detection means. .

  When the operator holds the casing with his hand, the distribution of the contact area between the hand and the side of the casing is detected by the first detection means. The display control means controls the content displayed on the display screen based on the output of the first detection means. For example, when the operator holds the case with the left hand and when the case holds the case with the right hand, it is better to change the layout of GUI (Graphical User Interface) parts on the screen symmetrically. It may be preferable. Further, when the operator holds the casing in the horizontal direction, it is desirable to switch the display to a shape suitable for the horizontal position. Alternatively, depending on the position of the hand holding the housing, it may be desirable to change the display position so that important information is displayed at a position that is not hidden by the hand. By arranging the first detection means on the two side surfaces of the case, it is possible to detect how the operator's hand is placed with respect to the case and determine how the operator holds the case. it can. The display control means controls the display device so that the display content is suitable for the determination result. As a result, it is possible to provide an information processing apparatus capable of performing optimal display for the operator without making the operator particularly conscious.

  Preferably, the information processing device further includes a coordinate detection device for outputting the coordinates of the position designated by the operator on the display surface. The display control means switches between a plurality of input screens and receives input based on the output of the input means for receiving an input by the operator and the output of the first detection means in cooperation with the display device and the coordinate detection device. Screen switching means for controlling the input means.

  The input means receives an input from the operator through cooperation between the display device and the coordinate detection device. At the time of this input, the operator uses a finger. From the output of the first detection means, it is possible to switch the input screen in a form that is easy for the operator to operate, or to display the precautions that should be displayed to the operator at a position that is easy to see. Therefore, input becomes easy for the operator, and input errors are reduced. It is possible to provide an information processing apparatus capable of efficient input regardless of how the operator holds the casing without making the operator particularly conscious.

  More preferably, the information processing apparatus has a top-and-bottom distinction, and the first and second side surfaces are respectively the main surfaces of the casing when the operator holds the casing with the top of the apparatus facing upward. They are the left side and the right side. The screen switching means includes a determination means for determining whether the operator is operating the housing with only the left hand, only the right hand, or both hands based on the output of the first detection means, And a means for controlling the input means so as to receive the input by switching the input screen for the left hand, the right hand, and the both hands according to the determination result.

  When the information processing apparatus is used in a vertical type, the operator usually holds the left and right side surfaces centering on the top and bottom. From the distribution of the contact area between the hand and the housing on these side surfaces, it can be determined, for example, on a rule basis whether the left hand only, the right hand only, or both hands are operated. Based on the determination result, the input means is controlled to receive the input by switching the input screens for left hand, right hand, and both hands. Therefore, it is possible to input using an input screen suitable for the case of operating with only one hand and the case of operating with both hands. As a result, the input can be made efficient.

  More preferably, the information processing apparatus has a top-and-bottom distinction, and the first and second side surfaces are respectively the main surfaces of the casing when the operator holds the casing with the top of the apparatus facing upward. They are the left side and the right side. The screen switching means includes a template storage means for storing a plurality of templates corresponding to typical outputs of the first detection means when the operator holds the casing, and outputs of the first detection means. By the pattern matching with a plurality of templates stored in the template storage means, the operator holds the housing with the left hand and operates with the left hand, holds with the right hand and operates with the right hand, or with one hand A determination means for determining whether to hold and operate with the other hand, and an input means to switch the input screen for left hand, right hand, and both hands according to the determination result of the determination means to receive input Means for controlling.

  From the distribution of the contact area between the hand and the case on the side of the case, it is determined by pattern matching with the template whether the left hand only, the right hand only, or both hands are used. Based on the determination result, the input means is controlled to receive the input by switching the input screens for left hand, right hand, and both hands. Since it is determined by pattern matching, it is possible to appropriately determine various ways of holding by preparing the template appropriately, and depending on the result, when operating with only one hand and when operating with both hands Then, it can input using the input screen suitable for each. That is, it is possible to accurately determine the holding method and use the most suitable input screen according to the result, and as a result, it is possible to make the input more accurate and efficient.

  The left-hand input screen and the right-hand input screen may have an arrangement of input GUI parts that are substantially symmetrical to each other.

  When the case is held with the left hand and when the case is held with the right hand, the arrangement of fingers for operation is exactly symmetrical. Therefore, by making the left-hand input screen and the right-hand input screen substantially symmetrical to each other, even when one-hand input is performed with either the left or right hand, the input can be performed with the same efficiency.

  The input screen for both hands may have a symmetrical GUI component arrangement.

  When operating with both hands, it is possible to input with the same arrangement of left and right GUI parts as in the prior art. Therefore, even when operating with both hands, input can be performed with at least the same efficiency as in the prior art, and the efficiency of input can be improved as a whole due to the efficiency of one-handed one-handed input.

  Preferably, the left-hand input screen has a plurality of GUI parts arranged in a matrix of a plurality of rows and a plurality of columns, and the matrix is arranged above each column in comparison with the column on the right side of the column. Configured to be

  Use left thumb for left handed left hand input. Therefore, it is necessary to arrange the GUI parts in a range that is easy to press with the thumb around the base of the left thumb. That is, it is necessary to arrange the GUI parts within a range close to a circle centered on the base of the thumb and to make the GUI parts easy to see. When the GUI component matrix is configured so that each column is positioned higher than the column on the right side of the column, the GUI component is located in a range that can be easily held by the thumb of the left hand and is arranged in a matrix. Therefore, GUI parts can be easily distinguished. As a result, input can be performed efficiently and with few errors, without overdoing the left hand.

  More preferably, the left-hand input screen has a plurality of GUI parts arranged in a matrix of a plurality of rows and a plurality of columns, and the plurality of GUI parts are assumed on the left side of the center of the plurality of GUI parts. As the distance from the point increases, the area increases.

  Use left thumb for left handed left hand input. Therefore, the GUI component near the base of the left thumb can be pressed almost vertically by the tip of the thumb. However, when trying to hold down a GUI component that is far away, the thumb is stretched, so that the thumb becomes nearly parallel to the display surface, making it difficult to push a narrow range. Therefore, by increasing the area of the GUI part at such a position, it is possible to efficiently suppress the GUI part with few errors. Moreover, since the GUI parts are arranged in a matrix, the GUI parts can be easily distinguished. As a result, input can be performed efficiently and with few errors, without overdoing the left hand.

  More preferably, the first detection means is a sheet-like pressure sensor provided on the first and second side surfaces, or a temperature sensor provided at a plurality of locations on each of the first and second side surfaces. Alternatively, an optical sensor may be included.

  The screen switching means is further arranged based on the determination result of the determination means so that the window of the application that requires character input is arranged at a position adjacent to the input screen from the direction opposite to the position of the user's hand. A means for changing the arrangement of windows for displaying applications on the display surface may be included.

  Based on the determination result of the determination means, the window for the application that requires character input is arranged at a position adjacent to the input screen from the direction opposite to the position of the user's hand, and Means for changing the arrangement of windows for displaying applications on the display surface may be included so that windows of other applications are not displayed.

  Preferably, the information processing apparatus is provided on a third and fourth side surface of the housing different from the first and second side surfaces, and a distribution of a contact area between the third and fourth side surfaces and a human hand is provided. It further includes a second detecting means for detecting. The display control means performs display by the display device between the first and second display modes in which the images are displayed on the display surface in directions different from each other by 90 degrees based on the outputs of the first and second detection means. Display switching means for switching is included.

  The display switching means may be configured to change the number of application windows displayed on the display surface according to the display mode when switching the display by the display device between the first and second display modes. Instead of this, or in addition to this, when switching the display by the display device between the first and second display modes, the relative position of the window of the application to be displayed on the display surface is changed to the application. You may be comprised so that it may change with the kind of.

  As described above, according to the present invention, by disposing the first detection means on the two side surfaces of the casing, it is possible to detect how the operator's hand is arranged with respect to the casing, It is possible to determine how the person holds the casing. From the output of the first detection means, it is possible to switch the input screen in a form that is easy for the operator to operate, or to display the precautions that should be displayed to the operator at a position that is easy to see. For example, based on the output of the first detection means, it is determined whether the operator is operating the housing with only the left hand, only the right hand, or both hands, and depending on the determination result, for the left hand, for the right hand, and The input means can be controlled to receive an input by switching the input screen for both hands. Therefore, it is possible to input using an input screen suitable for the case of operating with only one hand and the case of operating with both hands.

  As a result, there is provided an information processing apparatus that can be held with one hand, and can perform optimal display or efficient input for the operator without making the operator particularly conscious it can.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description and drawings, the same parts are denoted by the same reference numerals. Their functions and names are also the same. Therefore, detailed description thereof will not be repeated each time.

  In the following description, the display device and the coordinate detection device are described using a capacitance type full-screen liquid crystal touch panel, but the display device and the coordinate detection device are those used in this embodiment. It is not limited to. Any combination of display device and coordinate detection device as long as it has a function of outputting information indicating whether or not a certain position on the display has been designated and a function of outputting coordinate information relating to the designated position But it can be used. Moreover, as a touch panel, the thing of a full screen is suitable at various points, However, The touch panel which provided the display apparatus only in a part of main surface of a housing | casing may be used.

  For example, instead of a capacitive touch panel, a touch panel of another system such as a resistive film system, or a tablet may be adopted.

  In the following description, “hand” refers not only to the so-called palm portion but also to the finger portion.

<Appearance>
FIG. 3 shows a perspective view of a mobile phone 100 which is a portable information terminal according to an embodiment of the present invention. Referring to FIG. 3, mobile phone 100 includes a casing 110 having a main surface and a flat, substantially rectangular parallelepiped shape, and a stacked liquid crystal display device disposed on substantially the entire main surface of casing 110. (LCD) 118 and capacitive touch panel 119, which is a full-screen liquid crystal touch panel 116 that is a display device-integrated touch panel, and the main surface of housing 110, which are arranged above and below full-screen liquid crystal touch panel 116, respectively. Speaker 112 and microphone 114. Use of holding the casing 110 on the right side surface of the casing 110 when the full-screen liquid crystal touch panel 116 is viewed from the front so that the speaker 112 is positioned above (top) and the microphone 114 is positioned below (ground). A sheet-like right pressure sensor 120R that detects a pressure distribution by a person's finger in a planar area and outputs it in the form of a binarized image is provided, and also on the opposite side surface (left side surface) A similar left pressure sensor 120L is provided.

  The full-screen liquid crystal touch panel 116 outputs coordinate information in a predetermined coordinate system indicating a designated location when a position is designated by a finger touching a part, and when the finger is no longer touched, that is, designated When is released, it has a function of stopping the output of coordinate information.

<Hardware configuration>
FIG. 4 is a block diagram showing the hardware configuration of mobile phone 100 according to the present embodiment. Referring to FIG. 4, a mobile phone 100 includes a speaker 112, a microphone 114, a full-screen liquid crystal touch panel 116 (LCD 118 and a capacitive touch panel 119), a right pressure sensor 120R, a left pressure sensor 120L, and an antenna. 180, a ringer 186, a nonvolatile memory 188 for storing necessary programs such as an initial setting value of the mobile phone 100, an input screen program, and a holding method determination program, a speaker 112, a microphone 114, and a full-screen liquid crystal touch panel 116, an antenna 180, a ringer 186, and a memory 188, a function as a mobile phone, a function of determining how the user holds the mobile phone 100, and displaying a screen of an input key arrangement optimized for the determination result To realize various other functions And a control circuit 182.

  The control circuit 182 detects an incoming call from another mobile communication terminal at another base and outputs an incoming call detection signal based on a signal received from the base station via the antenna 180. 208, a line closing unit 206 for controlling on / off of the communication line via the antenna 180 in response to a predetermined control signal, and a base station via the line closing unit 206 and the antenna 180. An RF (Radio Frequency) processing unit 204 for controlling the strength of signals exchanged between them, and a signal given to the RF processing unit 204 and the RF processing unit 204 for performing safe signal transmission / reception with the base station A baseband processing unit 202 for performing predetermined signal processing on a signal received via the D / A converter, a DA converter and an AD converter, and a microphone 114 and a speaker. An audio interface (audio I / F) 200 for inputting and outputting audio via the power 112, an audio I / F 200, a baseband processing unit 202, an RF processing unit 204, a line closing unit 206, a full-screen liquid crystal By controlling the touch panel 116 and the ringer 186, a telephone call is made in response to a request from the user or an incoming call is processed to perform voice communication between the user and another portable communication terminal. Or a communication control unit 210 for performing character communication or performing processing on a character string input by the user.

  The communication control unit 210 is substantially composed of a CPU (Central Processing Unit) and software. In the present embodiment, the software is stored in the memory 188, and is appropriately read out and executed by the communication control unit 210. Although details are not described in this embodiment, the contents of the memory 188 can be rewritten, whereby various functions can be upgraded and added by the mobile phone 100.

<Principle of judgment>
In the present embodiment, whether the user holds the mobile phone with the right hand or the left hand, and operates with one hand or with both hands, the right pressure sensor 120R and the left sensor The determination is made by pattern matching using the output of the pressure sensor 120L. Hereinafter, typical patterns will be described.

  FIG. 5 shows output patterns of the right-side pressure sensor 120R and the left-side pressure sensor 120L, which are characteristic in the case of holding by one hand. When the cellular phone 100 shown in FIG. 5 (A) is held with the left hand as shown in FIG. 5 (B), typically, as shown in FIG. Contact area 240 and the right pressure sensor 120R have a contact area 242 with the hand. In the case shown in FIG. 5B, the left side surface is in contact with the left pressure sensor 120L at two locations, the belly part of the left thumb and the base part of the thumb. As a result, as shown in FIG. 5C, two contact area images 252 and 250 are obtained from the left pressure sensor 120L. On the right side, assuming that three fingers are in contact with the right pressure sensor 120R, three contact area images 254, 256, and 258 are obtained.

  On the other hand, as shown in FIG. 5D, when the mobile phone 100 is held with the right hand, the state is just the opposite of the case with the left hand. That is, the left pressure sensor 120L has a hand contact area 270, and the right pressure sensor 120R has a hand contact area 272. In the case shown in FIG. 5D, the left side surface is in contact with the left pressure sensor 120L at the three positions of the middle finger, the ring finger, and the little finger of the left hand. As a result, as shown in FIG. 5E, three contact region images 280, 282, and 284 are obtained from the left pressure sensor 120L. On the right side, the belly part of the thumb of the right hand and the base part of the thumb are in contact with the right pressure sensor 120R. Accordingly, two contact area images 286 and 288 are obtained.

  Of course, due to the relationship between the size of the casing of the mobile phone 100 and the size of the hand, for example, in the case of FIG. 5C, the right pressure sensor 120R and the left index finger to the little finger all contact, and therefore the four contacts. An area image may be obtained. The same applies to the right hand.

  On the other hand, when not only holding the mobile phone 100 but also trying to input by touching the full-screen liquid crystal touch panel 116 with the thumb of the holding hand, the right pressure sensor 120R. The output of the left pressure sensor 120L is as follows.

  6A and 6B, the left hand simply holds the mobile phone 100, the relationship between the left hand and the mobile phone 100 when the input is going to be performed with the right hand, and the left side. The relationship with the output of the pressure sensitive sensor 120L and the right pressure sensitive sensor 120R is shown. FIGS. 6C and 6D respectively show the relationship between the left hand and the mobile phone 100 when the left hand is holding the mobile phone 100 and trying to input using the thumb of the left hand. .

  6A and 6B are the same as FIGS. 5B and 5C, respectively. On the other hand, in FIG. 6C, unlike the case of FIG. 6A, the left side surface of the mobile phone 100 is in contact only with the base region 300 of the left thumb, and is not in contact with the thumb. As a result, as shown in FIG. 6D, only one contact area image 310 is output from the left side surface. On the other hand, the right hand region is in contact with three fingers in the region 302 as in FIG. Therefore, three contact area images 312, 314, 316 (or four contact area images) are output from the right pressure sensor 120R.

  A similar relationship can be obtained with the right hand. Therefore, when the output as shown in FIG. 6B is obtained, it can be determined that the mobile phone 100 is held with the left hand and the input is performed with the right hand. When an output as shown in FIG. 6D is obtained, it can be determined that the mobile phone 100 is held with the left hand and the input is also performed with the left hand. In the case of the right hand, the same determination can be made by the symmetrical output.

  Actually, there are subtle differences in how the mobile phone 100 is held, depending on the person, so in this embodiment, rather than the determination based on the rules as described above, a large number of output examples are collected and templated. The most likely holding method is determined by matching the output image obtained in step 1 and the template. In this embodiment, combinations of holding and inputting methods are as follows: (1) Two-hand operation (hold with left hand and input with right hand, hold with right hand and input with left hand), (2) Left hand operation (hold with left hand) The three cases of (input with the left hand) and (3) right hand operation (hold with the right hand and input with the right hand) may be determined.

  In addition, since it is determination by a mobile phone, it is not preferable to spend much calculation cost for matching. Therefore, in the present embodiment, for example, only the pixel value on the center line of the output image is used as a sample, and matching is performed with a template created in advance in the same manner. For the matching, for example, DP (Dynamic Programming) matching is used. An appropriate threshold is set in advance, and only when there is a template with the shortest DP distance obtained by DP matching between the template and the output image and the distance is equal to or less than the threshold The method of holding and inputting determined by the above is adopted, and in all other cases, the above-described (1), that is, the two-hand operation is determined. The image obtained from the right pressure sensor 120R and the image obtained from the left pressure sensor 120L are DP-matched independently with the right hand template and the left hand template in the template, respectively, and the total value of the obtained DP distances is obtained. The DP distance between each template and the obtained data.

  7 and 8 show examples of sensor output patterns corresponding to templates. FIGS. 7A and 7B are pattern examples when the mobile phone 100 is held with the left hand and input is performed with the right hand (two-hand operation). FIGS. 8A and 8B are pattern examples in which the mobile phone 100 is held with the left hand and input is performed with the left hand. The right-hand pattern may be a left-right inverted version of the pattern for the right hand, and therefore a unique pattern for the right hand is considered unnecessary. However, in this embodiment, the right-hand pattern is also the left-hand pattern. Separately prepared.

  Further, as described above, when the DP distance between the template obtained as a result of matching and the output image is larger than the threshold value, it is determined that the operation is a two-handed operation. Therefore, although it is only necessary to prepare a template for the left hand in practice, a template for determining a two-hand operation is prepared in the present embodiment.

  Hereinafter, holding the mobile phone 100 with the left hand is referred to as “left hand holding”, and holding the mobile phone 100 with the right hand is referred to as “right hand holding”.

  FIG. 9 shows a character button arrangement 340 displayed on the full-screen liquid crystal touch panel 116 of the mobile phone 100 when left-handed and left-handed (hereinafter referred to as “left-handed one-handed operation”), and right-handed and right-handed. (Hereinafter, this is referred to as “right-handed one-handed operation”), a character button array 342 displayed in the same manner is shown.

  Referring to FIGS. 9A and 9B, character button array 340 for left-handed one-handed operation includes a plurality of buttons 350 to 364 arranged so as to form a matrix that rises to the left as a whole. The button 352 in the lowermost row of the center column is arranged above the button 354 in the lowermost row of the rightmost column. The button 350 in the lowermost row at the left end is arranged further above the button 352. The same applies to the top row, with the leftmost button 360 being the highest, the middle row button 362 being the next highest, and the rightmost button 364 being the lowest.

  When viewed from the column, it can be said that a certain column is arranged at a higher position than the column on the right side of the column.

  The reason for this arrangement is that, as in Patent Document 1, when operating with the left hand, keys are arranged at positions that are easy to operate with the thumb. The vicinity of the base of the thumb is difficult to hold with the thumb. Therefore, all the keys in the leftmost row are slightly raised above the keys in the other rows so that they can be easily held by the thumb.

  In the present embodiment, a character button is used as an input GUI component, but the present invention is not limited to only using a character button. Any GUI component can be used as long as it can be operated with a single finger.

  The same applies to the character button array 342 for right-handed one-handed operation shown in FIGS. 9C and 9D. In this case, the left-handed one-handed operation is symmetrically arranged. That is, the buttons are arranged so as to form a matrix that rises to the right as a whole.

  FIG. 10 shows a character button array 410 displayed on the full-screen liquid crystal touch panel 116 when it is determined that the operation is both hands. Referring to FIG. 10, the character button array 410 includes a plurality of keys 420 to arranged in a matrix including rows in a direction orthogonal to the long side of the housing 110 and rows in a direction parallel to the long side. 434. Since the buttons are arranged symmetrically in this way, the input operation can be performed without any trouble both in the case of left-handed and right-handed input and in the case of right-handed and left-handed input. However, the button arrangement need not be strictly symmetrical. Needless to say, there may be a part that is not symmetrical.

<Program structure>
As described above, the determination of the two-handed operation, the left-handed one-handed operation, and the right-handed one-handed operation is performed by matching the outputs of the right pressure sensor 120R and the left pressure sensor 120L with a template prepared in advance. A control structure of a program for determining a handle and an operation method is shown in a flowchart form in FIG. Note that a program having a control structure described below is stored in, for example, the memory 188 shown in FIG. 4 and is read and executed by the CPU in the communication control unit 210 as appropriate. Such a program may be stored in the memory 188 when the mobile phone 100 is shipped, or may be downloaded from a server (not shown) to the mobile phone 100 via data communication by the mobile phone 100 and recorded in the memory 188. When a recording medium such as a memory card can be attached to the cellular phone, a program is stored in the memory card and read from the memory card, or moved from the memory card to the memory 188 and read from the memory 188. Also good.

  Referring to FIG. 11, it is determined in step 450 whether or not the operation mode of mobile phone 100 is the input mode. If the mode is the input mode, the process proceeds to step 452. If the mode is not the input mode, the process of step 450 is repeated until the input mode is entered. When not in the input mode, it is preferable to display the screen in a direction preset by the user or in a direction determined by an application. In the first place, there is no need to display the keyboard. Therefore, by the processing in step 450, the keyboard is not displayed in a mode other than the input mode.

  In step 452, a process of acquiring image data that is an output of the left pressure sensor 120L and the right pressure sensor 120R is performed. This processing is realized by the CPU included in the communication control unit 210 reading data from the addresses assigned to the left pressure sensor 120L and the right pressure sensor 120R in the block diagram shown in FIG.

  In step 454, a process for extracting a feature amount for determining the contact area of the hand from the output image of the left pressure sensor 120L and the output image of the right pressure sensor 120R acquired in step 452 is executed. In this embodiment, as described above, in both images, only the image data of the center line along the longitudinal direction (vertical direction of the housing 110) is extracted for pattern matching, and is used as a feature amount.

  In step 456, pattern matching is performed by DP matching between a plurality of templates prepared in advance and the feature amount extracted in step 454. As a result of this matching, a template having the smallest DP distance calculated with the feature amount extracted in step 454 is selected, and it is further determined whether or not the DP distance is equal to or smaller than a predetermined threshold value. If there is such a template, the determination result in step 456 is determined depending on whether the template is a two-handed operation template, a left-handed one-handed operation template, or a right-handed one-handed operation template. If there is no template that satisfies the above conditions, it is determined that the user is performing a two-handed operation as a default.

  In step 458, processing branches into three steps depending on the result of matching in step 456. That is, if it is determined that the user is performing a left-handed one-hand operation, the process proceeds to step 460. If it is determined that the user is performing a two-handed operation, the process proceeds to step 462, where the user is performing a right-handed right-handed operation. If it is determined that the user is performing, the process proceeds to step 464. In all other cases, the process proceeds to step 462.

  In step 460, a program for realizing a keyboard screen for left-handed and left-handed operation (FIGS. 9A and 9B) is executed. In step 462, a program for realizing a two-handed keyboard screen (FIG. 10) is executed. In step 464, a program for realizing a keyboard screen for right-handed one-handed operation (FIGS. 9C and 9D) is executed.

  Thereafter, the control shifts to a program for realizing each keyboard screen, and the execution of the program shown in FIG. 11 ends.

  FIG. 12 schematically shows the matching process performed in steps 452 to 456 in FIG. Referring to FIG. 12, a plurality of templates 474 are stored in advance in memory 188 shown in FIG. Information indicating whether the template corresponds to a two-handed operation, a template corresponding to a left-handed one-handed operation, or a template corresponding to a right-handed one-handed operation is attached to these templates.

  The output image from the right pressure sensor 120R is given to the right feature amount extraction unit 470, and the feature amount is extracted. In the present embodiment, the pixel value of the pixel column on the center line of the image is extracted as the feature amount as the feature amount. Similarly, the output image from the left pressure sensor 120L is given to the left feature amount extraction unit 472, and the feature amount is extracted. In the present embodiment, the right side feature quantity extraction unit 470 and the left side feature quantity extraction unit 472 are realized by a CPU included in the communication control unit 210 shown in FIG. 4 and a program step 454 showing the control structure in FIG. The

  The matching unit 476 combines the feature amount from the right-side feature amount extraction unit 470 and the feature amount from the left-side feature amount extraction unit 472, and performs DP matching with each template stored in the template 474. A determination result 478 is output. DP matching performed by the matching unit 476 can be realized by a commercially available mathematical processing program tool.

<Operation>
3 to 12, mobile phone 100 according to the present embodiment operates as follows. Referring to FIG. 3, when the user turns on switch of mobile phone 100, a program for determining the handle and operation method shown in FIG. 11 is started. Referring to FIG. 11, the program for determining the handle and operation method determines in step 450 whether or not the operation mode of mobile phone 100 is the input mode. If no application is activated, the mobile phone 100 does not enter the input mode, so the determination result in step 450 is NO, and step 450 is repeated.

  It is assumed that the user has started an application for inputting characters such as e-mail. Then, the determination result in step 450 shown in FIG. 11 is YES, and the process proceeds to step 452.

  The right pressure sensor 120 </ b> R and the left pressure sensor 120 </ b> L illustrated in FIG. 4 generate a binary image indicating the pressure of the user's hand and provide the communication control unit 210. The pattern of the image at this time is as shown in FIGS. 7 and 8, for example. In step 452 shown in FIG. 11, the image information is read by the CPU and processed by the program.

  In step 454, feature amounts are extracted from the image data output by the right pressure sensor 120R and the left pressure sensor 120L obtained in step 452. That is, only the pixel columns on the center line of both images are taken out, and two data strings composed of these pixel values are extracted as feature amounts.

  In step 456, DP matching between the feature amount thus extracted and the template 474 is executed. As a result of the matching, if the DP distance between the left-handed one-handed operation template is the shortest and the value is equal to or smaller than the threshold value, the left-handed one-handed operation as shown in FIGS. A program that displays character button array 340 on full-screen liquid crystal touch panel 116 and accepts input is started. Similarly, when it is determined that the operation is a right-handed one-handed operation, a program for displaying the character button array 342 for right-handed one-handed operation shown in FIGS. 9C and 9D on the full-screen liquid crystal touch panel 116 and receiving an input is started. . If it is determined that the operation is a two-handed operation, a program for displaying the character button array 410 for two-handed operation shown in FIG. 10 on the full-screen liquid crystal touch panel 116 and receiving an input is started.

  A character string input using these character button arrays is converted into a kana / kanji character via an unillustrated kana / kanji conversion program and passed to an e-mail program or the like.

  As described above, according to the mobile phone 100 according to this embodiment, how the user holds the casing 110 of the mobile phone 100 is read by the right pressure sensor 120R and the left pressure sensor 120L. It is determined by matching the pattern of the contact area between the housing 110 and the hand and a template prepared in advance. Then, according to the determination result, a character is input by a character button array for left-handed one-handed operation, right-handed one-handed operation, or two-handed operation. Since determination by pattern matching is employed, even if there are a wide variety of patterns having the casing 110, it is possible to determine the handle and the operation method with a certain degree of reliability. The character button layouts that are selected and displayed as a result of the judgment are all suitable for each case, enabling efficient character input, fewer input errors, and faster and more reliable input. it can. Further, when it cannot be determined that the operation is one-handed, a character button array for two-handed operation is displayed as a default, so that even in the worst case, characters can be input at the same speed as a conventional mobile phone.

  Since the right-type pressure sensor 120R and the left-side pressure sensor 120L are sheet-like in the present embodiment, even if the casing 110 is thin and small, the contact area with the hand on both sides can be determined. It does not get in the way when the body 110 is held.

  As a result, the cellular phone according to the present embodiment can realize more efficient character input compared to a portable information terminal such as a conventional cellular phone.

<Modification>
In the above-described embodiment, the character button arrangement for left-handed one-handed operation, right-handed one-handed operation, or two-handed operation is automatically selected and displayed in accordance with the outputs of the right pressure sensor 120R and the left pressure sensor 120L. The The display position or display size of each character button array itself is fixed.

  However, it is expected that there are various physiques of people who use the mobile phone 100. Therefore, it is effective to make it possible to adjust the display position of the character button array and to make the display size adjustable.

  FIGS. 13A and 13B show examples of character button arrangements in a mobile phone 500 further provided with such a function. FIG. 13A shows a display position 510 of a character button array for left-handed one-hand operation, which is suitable for a person whose hand size is smaller than the size of the casing of the mobile phone 500, for example. In this example, the display position 510 of the character button arrangement is a small area centered on the left side of the center of the full-screen liquid crystal touch panel 116 slightly to the left. FIG. 13B shows a display position 512 of a character button array for right-handed one-hand operation in the same mobile phone 500. In this example, the display position 512 of the character button array is a small area centered slightly below the center at the bottom of the full-screen liquid crystal touch panel 116.

  By making the display position and size of the character button arrangement adjustable in this way, character input can be performed with a character button arrangement having a position and size suitable for the size of the user's hand and wrinkles at the time of input. Is possible. As a result, character input becomes more efficient.

  Such adjustment can be performed by the user as appropriate, and parameters for the adjustment are stored in, for example, the memory 188 of FIG. When displaying the character button array, this parameter may be checked, and the character button array may be displayed at the position and size adjusted according to the parameter.

  Moreover, in the said embodiment, what is shown by FIG. 9 (A)-(D) is employ | adopted as a character button arrangement | sequence for one-hand operation. However, the present invention is not limited to such an embodiment, and any character arrangement suitable for one-handed operation may be used. One example is shown in FIG.

  14A and 14B show a character button array 540 for left-handed one-handed operation displayed on the full-screen liquid crystal touch panel 116 of the mobile phone 530 according to this modification. The character button array 540 basically includes a plurality of buttons 550 to 576 arranged in a matrix composed of rows and columns parallel to the horizontal and vertical directions of the full-screen liquid crystal touch panel 116, respectively. These buttons are arranged so that the area increases as the distance from the base of the thumb of the left hand to be operated increases.

  Referring to FIG. 14B, for example, if the button 560 is closest to the base of the thumb, it can be seen that the area of the button increases as the button 560 is further away. If the button closest to the base of the thumb is other than the button 560, the area of the button is increased as the button is moved away from the button.

  Generally, when holding the housing 110 with the left hand, the base of the thumb of the left hand is considered to be located near the left side surface of the housing 110 or on the left side of the left side. However, when inputting with the left hand, it is possible to extend the thumb on the screen. Therefore, any position on the left side of the center of the button array 540 may be assumed as the base of the thumb. However, it is desirable that the vertical position of this point is not shifted vertically from the vertical distribution range of the button array 540.

  14C and 14D show a character button array 542 for right-handed one-hand operation, which is employed in the mobile phone 530. FIG. The button array shape of the character button array 542 includes a plurality of buttons 590 to 616 arranged in rows and columns parallel to the horizontal direction and the vertical direction of the full-screen liquid crystal touch panel 116, respectively. These buttons are arranged so that the area increases as the distance from the base of the thumb of the right hand to be operated increases. Basically, the character button array 542 is bilaterally symmetric with the character button array 540 shown in FIG. However, the character assigned to each button is not symmetrical with the character button array 540, and matches the character assigned to the button in the character button array 540.

  Normally, when the user operates the button with the thumb of the same hand while holding the mobile phone casing with one hand, the thumb is perpendicular to the touch panel surface at a position close to the base of the thumb as shown in FIG. As shown in FIG. 15C, the thumb changes to a posture parallel to the touch panel surface as it moves away from the base of the thumb. Therefore, a relatively small area can be pushed at the base of the thumb as shown in FIG. 15B, but at a position far from the thumb, a wide area corresponding to the belly of the thumb as shown in FIG. Touching the touch panel surface. In order to cope with such a problem, by adopting a character button arrangement as shown in FIG. 14B, even when a button displayed at a position distant from the base of the thumb is pressed, the target button is pressed without difficulty. be able to. Therefore, the movement of the finger becomes easier, the fatigue is reduced, and the input can be performed efficiently.

  In the above embodiment, the sheet-like right pressure sensor 120R and left pressure sensor 120L detect the pattern of the area in contact with the user's hand on both sides of the mobile phone casing. However, the means for detecting the pattern of the area in contact with the user's hand is not limited to the sheet-like pressure sensor, and other means may be used. For example, an optical sensor array including a large number of small optical sensors may be provided on both sides of the housing, and a signal pattern obtained therefrom may be used. Alternatively, a sheet-like temperature sensor may be attached to both sides of the housing, and a temperature distribution pattern obtained from the temperature sensor may be used. Alternatively, a sensor that detects contact with a human body using electromagnetic induction may be used.

  In the above embodiment, DP matching is used for matching with the template. However, the present invention is not limited to DP matching, and other matching methods may be used. For example, after obtaining the output of the sensor center line as described above, the sensor center line is divided into a plurality of predetermined regions, and a vector having the number of black pixels existing therein as an element is obtained. May be used for matching. In this case, as a template, similar vectorization is performed in advance on a typical pattern obtained by experiment, and the cosine similarity between the template vector and the vector obtained by processing the data obtained from the sensor The handle and the operation method may be determined by the above.

  Further, if the performance of the CPU provided in the apparatus and the storage capacity of the memory allow, the image obtained from the sensor may be used as it is for pattern matching. In this case, it is necessary to prepare several typical images corresponding to combinations of each handle and operation method as a template.

<Modified example of switching between vertical and horizontal display>
In the above embodiment, sensors that detect contact with the hand are arranged only on the left and right side surfaces of the housing 110 of the mobile phone 100. When the mobile phone 100 is used as a normal mobile phone, it is assumed that the mobile phone 100 is used in a vertically long shape, and this is considered sufficient. However, the case 110 having the full-screen liquid crystal touch panel 116 as shown in FIG. 3 may be provided with a function of receiving and displaying a TV (television) broadcast, for example. In such a case, there is a possibility that the casing 110 is held horizontally and some input is performed in this state. Therefore, sensors may be arranged not only on the left and right side surfaces of the housing 110 but also on the upper and lower side surfaces. Also in this case, how the user holds the housing 110 can be determined by pattern matching using the output from each sensor. Then, the image is switched between portrait and landscape according to the determination result. That is, the display mode is switched between the vertical display mode and the horizontal display mode in which images are displayed at angles different from each other by 90 degrees.

  FIG. 16 shows a display example on the full-screen liquid crystal touch panel 116 when the mobile phone 100 is used by switching between the horizontal direction and the vertical direction. 16A is a display example when a right-handed right-hand operation is performed in horizontal display, FIG. 16B is a display example when a left-handed left-hand operation is performed in horizontal display, and FIG. A display example at the time of operation is shown respectively. In this modification, switching between the vertical type and the horizontal type is performed according to a user's instruction, and the handle and operation method are determined based on outputs from sensors disposed on the top and bottom sides of the casing 110. Then, the display on the full-screen liquid crystal touch panel 116 is controlled according to the determination result.

  When horizontal display is performed as shown in FIGS. 16A and 16B, it becomes easy to start two or more applications simultaneously. For example, as shown in FIG. 16A, a window 710 on the full-screen liquid crystal touch panel 116 receives and displays terrestrial digital so-called one-segment broadcasting as a first application, and a window 712 returns a mail as a second application. It is usage such as inputting. In this case, when operating with the right hand, it is desirable to set the character input area on the right as shown by the window 714 in FIG.

  As shown in FIG. 16B, the display example of the full-screen liquid crystal touch panel 116 when operating with the left hand displays windows 722 and 724 for two applications on the right side as shown in FIG. It is desirable to set a character input area on the left.

  In addition, when operating with the right hand, it is desirable that the application that requires character input be displayed immediately adjacent to the character input area, and when operating with the left hand, it is immediately adjacent to the character input area. It is desirable to be displayed. This is because it is easier to operate when the area to be touched and the area to which characters are input are close in distance when inputting characters. That is, it is desirable to change the layout of each application depending on whether the input part is displayed on the left or right. Therefore, in the example shown in FIG. 16A, it is preferable that the e-mail input program is displayed in the window 712, and in the example shown in FIG. 16B, the e-mail input program is displayed in the window 722.

  For example, as shown in FIG. 16A, when right-handed operation is performed with a right hand, it may be necessary to input characters in an application using the leftmost window 710. is there. In such a case, switching may be performed such that the result of character input performed in the window 714 is input to the application in the window 710 in accordance with a user instruction. Alternatively, the left and right order of the window 710 and the window 712 may be interchanged. By changing the order, the application using the window 710 operates using the window 712 adjacent to the character input area of the window 714, and input becomes easier.

  For example, consider a case where the user changes the way the mobile phone 100 is held from the horizontal display shown in FIG. 16B to the vertical display shown in FIG. In this case, it is considered that the user is more dedicated to character input than in the horizontal display. It is conceivable that the character input area is displayed in the lowermost window 730 of the full-screen liquid crystal touch panel 116 and only the application requiring character input is left in the window 732. At this time, an application not related to character input can be prevented from being displayed, or the application itself can be terminated.

  FIG. 17 shows a flowchart of a program executed by the mobile phone 100 when changing from vertical display to horizontal display. In step 750, it is determined whether or not there is an instruction to switch to the horizontal type by a user input or the like. If there is no switching instruction, the process returns to step 750 and waits for the switching instruction.

  If there is a switching instruction, it is determined in step 752 whether the current operation mode is the right hand input mode (hereinafter referred to as “right hand mode”) or the left hand input mode (hereinafter referred to as “left hand mode”). judge. If it is the right hand mode, the process proceeds to step 754, and if it is the left hand mode, the process proceeds to step 756.

  In the determination at step 752, in the case of the mobile phone 100 according to the first embodiment, the results detected by the right pressure sensor 120R and the left pressure sensor 120L arranged on both sides in the vertical display are used. It is desirable. However, the present invention is not limited to such an embodiment, and the display mode for the horizontal display may be set in advance by the user. Of course, when the left and right handles and the operation method are detected in the horizontal direction by disposing the sensor on the side surface in the vertical direction of the casing 110, the detection result may be used. .

  In step 756, a window for displaying an application is set in the left-hand mode. In step 754, conversely, application display settings are made in the right-hand mode. Here, it includes not only the setting of the display in the character input area but also the change of the arrangement of windows for displaying the applications as shown in FIGS.

  In the subsequent step 758, the display layout of the horizontal screen displayed on the full-screen liquid crystal touch panel 116 is determined based on the setting made in step 754 or 756. The layout changes depending not only on the left and right modes but also on which application operates. Basically, an application that requires character input is set near the character input area. In any case, when the setting is completed, the process proceeds to step 760.

  In step 760, applications such as a one-segment broadcasting application and a mail creation program are displayed according to the layout determined in step 758.

  In this way, not only the vertical / horizontal switching of the display but also the display position of the application is adjusted based on the output of the sensor, so the display method that seems to be optimal according to the change in how the user holds the housing 110 Thus, display on the full-screen liquid crystal touch panel 116 can be performed. In particular, for applications that require input, the character input area can be easily input by appropriately determining the display position of the character input area according to the hand and the operation method. The burden on the eyes is reduced.

  In the above modification, the setting is such that part of the application is hidden in the vertical arrangement, but both applications are displayed as in FIGS. 16A and 16B, but character input is required. The display position of the application may be determined so that the window of the application is close to the character input area. In addition, the sensor for detecting the distribution of the contact area between the user's hand and the side surface of the apparatus cannot be arranged on both side surfaces in the vertical arrangement. For example, it may be arranged only on both side surfaces in the horizontal arrangement (that is, the top and bottom end faces in the vertical arrangement), or may be arranged on all four side surfaces. Furthermore, in the case of a mobile phone, there is a distinction between the top and bottom in the vertical arrangement, and about 2/3 from the lower end of the lower half area or all the side faces also on both side faces in the vertical arrangement. The sensor may be arranged only up to the height of.

  In the above-described embodiment, the handle and the operation method are determined by pattern matching between the sensor output and the template. However, the present invention is not limited to such an embodiment. In particular, since there is an upper limit on the number of fingers in one human hand, the number and order of contact areas and non-contact areas between the housing 110 and the fingers when the mobile phone 100 is held is not so large. There are no variations. Therefore, a rule for determining the handle and the operation state based on the number and order of the left and right contact areas and non-contact areas may be created, and the determination may be performed on a rule basis. It is particularly preferable to use a decision tree.

  For example, the following rules can be considered.

Number of contact areas on the right side> Number of contact areas on the left side → Number of contact areas on the left side = 1 → Left-handed one-handed operation Number of contact areas on the right side> Number of contact areas on the left side → Number of contact areas on the left side = 2 → Left-handed, two-handed operation Number of right-side contact areas <Number of left-sided contact areas → Number of right-sided contact areas = 1 → Right-handed one-handed operation Number of right-sided contact areas <Number of left-sided contact areas → Number of right-sided contact areas Number = 2 → Right-handed two-handed operation Other → Two-handed However, when making a rule-based decision, it is easily affected by noise present in the image. It is desirable to remove noise by calculating the number of black pixels present for each row and calculating the profile in the longitudinal direction of the image depending on whether the value is equal to or greater than a predetermined threshold value.

  Note that the present invention is not applicable only to the mobile phone as described in the above embodiment. Besides this, it can also be applied to so-called PDA (Personal Digital Assistant). In the case of a PDA, there is a device that uses a pen instead of a finger. In such cases, the user can select a display method that is easy for the user to operate by using the results of the handling of the handle and the operation method as described above. it can.

  Furthermore, not only those that are classified as independent information processing devices, such as mobile phones and PDAs, but also remote controllers (hereinafter referred to as “remote controllers”) attached to, for example, television receivers, hard disk recorders, and the like. The present invention can also be applied to other information processing apparatuses. In particular, the present invention can be suitably used for a remote controller 780 using a touch panel 790 for most of the operation screen as shown in FIG. A liquid crystal is suitable for the touch panel, but a display device other than the liquid crystal may be used. Since television receivers, hard disk recorders, and the like have diversified functions, it is desirable that various operation panels can be displayed using the touch panel as described above. Since many users operate the remote controller with only one hand, the operation panel is displayed in a form suitable for the handle as shown in FIGS. 18A and 18B by determining the handle. Thus, a remote controller that is easy for the user to operate can be provided.

  In addition, even in the case of an information processing apparatus that effectively uses a full-screen touch panel by using the determination function of the handle and operation method as in the present invention, a button corresponding to some function may be left as hardware. It is natural to be good.

  The embodiment disclosed herein is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim in the claims after taking into account the description of the detailed description of the invention, and all modifications within the meaning and scope equivalent to the wording described therein are intended. Including.

6 is a diagram showing a character button array of a mobile phone 30 disclosed in Patent Document 1. FIG. It is a figure explaining the determination mechanism of a handle in the electronic notebook 70 disclosed by patent document 2. FIG. It is a figure which shows the external appearance of the mobile telephone 100 which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the mobile telephone 100 shown in FIG. FIG. 3 is a diagram schematically illustrating a pattern of a contact area between a housing 110 of a mobile phone 100 and a hand when the user holds the mobile phone 100 with one hand. FIG. 3 is a diagram schematically illustrating a pattern of a contact area between a case 110 and a hand of the mobile phone 100 when a user operates the mobile phone 100 with one hand or both hands. It is a figure which shows typically the pattern of the sensor output at the time of left-handed and both-hands operation. It is a figure which shows typically the pattern of the sensor output at the time of left hand holding and one hand operation. It is a figure which shows typically the character button arrangement | sequences 340 and 342 which are displayed when it determines with one hand operation and changes with a handle. It is a schematic diagram which shows the character button arrangement | sequence 410 at the time of both-hands operation. It is a flowchart which shows the control structure of the program for implement | achieving the mobile telephone 100 which concerns on embodiment. It is a figure which shows typically the pattern matching process performed with the mobile telephone 100 which concerns on embodiment. It is a figure which shows typically the display positions 510 and 512 of the character button arrangement | sequence from which a display position and a magnitude | size change based on a modification. It is a figure which shows typically the character button arrangement | sequence 540 and 542 which the magnitude | size of the button which changes according to the distance from the base of the thumb based on a modification. It is a figure which shows typically the contact surface of the finger | toe when holding the housing | casing of a mobile telephone with one hand and operating a button with the thumb of the same hand. It is a figure explaining the case where a mobile telephone is used in a horizontal direction. It is a flowchart which shows the control structure of the program for switching a display from a vertical display to a horizontal display. It is a figure which shows the external appearance and switching of a display which employ | adopted the touchscreen of a full screen.

Explanation of symbols

100 Mobile phone 110 Case 116 Full-screen liquid crystal touch panel 118 LCD
119 Capacitive touch panel 120L Left side pressure sensor 120R Right side pressure sensor 188 Memory 210 Communication controller 240, 242, 270, 272, 300, 302 Contact area 250, 252, 254, 256, 258, 280, 282, 284 , 286, 288, 310, 312, 314, 316 Contact area image 340, 342, 410, 540, 542 Character button arrangement 780 Remote control 790 Touch panel

Claims (14)

An information processing apparatus including a flat housing having a substantially rectangular shape having a main surface and a size that can be held with one hand,
The housing has first and second side surfaces arranged across the main surface,
The information processing apparatus further includes:
A display device having a display surface provided on the main surface;
First detection means provided on the first and second side surfaces for detecting the distribution of the contact area between the first and second side surfaces and a human hand;
An information processing apparatus comprising: display control means for controlling contents displayed on the display surface by the display device based on an output of the first detection means. A coordinate detection device for outputting coordinates of a position designated by an operator on the display surface;
The display control means includes
Input means for receiving input by an operator in cooperation with the display device and the coordinate detection device;
The information processing apparatus according to claim 1, further comprising: a screen switching unit configured to control the input unit so as to switch a plurality of input screens and receive an input based on an output of the first detection unit. The information processing apparatus has a top-and-bottom distinction, and the first and second side surfaces of the casing are respectively when the operator holds the casing with the top of the information processing apparatus facing upward. A left side surface and a right side surface sandwiching the main surface;
The screen switching means
Determination means for determining whether the operator operates the housing with only the left hand, only the right hand, or both hands based on the output of the first detection means;
The information processing apparatus according to claim 2, further comprising: means for controlling the input means so as to switch input screens for left hand, right hand, and both hands depending on a determination result of the determination means. . The information processing apparatus has a top-and-bottom distinction, and the first and second side surfaces of the casing are respectively when the operator holds the casing with the top of the information processing apparatus facing upward. A left side surface and a right side surface sandwiching the main surface;
The screen switching means
Template storage means for storing a plurality of templates corresponding to typical outputs of the first detection means when an operator holds the casing;
The operator holds the casing with the left hand and operates with the left hand or with the right hand by pattern matching with the plurality of templates stored in the template storage means. A determination means for determining whether it is operating with the right hand or holding with one hand and operating with the other hand;
The information processing apparatus according to claim 2, further comprising: means for controlling the input means so as to switch input screens for left hand, right hand, and both hands depending on a determination result of the determination means. . The left-hand input screen has a plurality of GUI parts arranged in a matrix of a plurality of rows and a plurality of columns,
5. The information processing apparatus according to claim 3, wherein the matrix is configured such that any column is disposed above the column on the right side of the column. The left-hand input screen has a plurality of GUI parts arranged in a matrix of a plurality of rows and a plurality of columns,
The plurality of GUI parts are configured such that the area increases as the distance from a certain point assumed on the left side of the center of the plurality of GUI parts increases. An information processing apparatus according to claim 1. The information processing according to any one of claims 3 to 6, wherein the left-hand input screen and the right-hand input screen have substantially symmetrical input GUI parts. apparatus. The information processing apparatus according to claim 3, wherein the input screen for both hands has a symmetrical GUI component arrangement. The first detecting means is a sheet-like pressure sensor provided on the first and second side surfaces, or a temperature sensor provided on each of the first and second side surfaces. The information processing apparatus according to claim 1, comprising an optical sensor. The screen switching means further includes
Based on the determination result of the determination means, the window of the application that requires character input is arranged on the display surface so as to be arranged at a position adjacent to the input screen from a direction opposite to the position of the user's hand. The information processing apparatus according to claim 3, further comprising means for changing a layout of a window for displaying an application. The changing means is configured such that an application window that requires character input is arranged at a position adjacent to the input screen from a direction opposite to the position of the user's hand based on the determination result of the determination means. The information processing apparatus according to claim 10, further comprising means for changing an arrangement of windows for displaying applications on the display surface so that windows of other applications are not displayed. The first and second side surfaces of the housing are different from the first and second side surfaces, and are for detecting the distribution of the contact area between the third and fourth side surfaces and a human hand. Two detection means,
The display control means displays the display between the first and second display modes in which images are displayed on the display surface in directions different from each other by 90 degrees based on outputs of the first and second detection means. The information processing apparatus according to claim 1, further comprising display switching means for switching display by the apparatus. The display switching means is configured to change the number of application windows displayed on the display surface according to a display mode when switching the display by the display device between the first and second display modes. The information processing apparatus according to claim 12. When the display switching means switches the display by the display device between the first and second display modes, the display switching means determines the relative position of the window of the application displayed on the display surface according to the type of the application. The information processing apparatus according to claim 12 or 13, wherein the information processing apparatus is configured to be changed.

Images