JP5058187B2 - Portable information terminal - Google Patents

Description

  The present invention relates to a portable information terminal, and more particularly to a portable information terminal provided with an optical touch panel.

  A mobile phone provided with a touch panel is widely known (for example, Patent Document 1). The touch panel can display an arbitrary image on the display screen, and can detect a position on the display screen where an operator such as a finger or a touch pen contacts. For this reason, a virtual operation button can be formed on the display screen by displaying a button on the display screen and detecting contact of the operator with the display area of the button.

  In addition, a mobile phone that allows a user to easily change the layout of buttons on the touch pad has been proposed (for example, Patent Document 2). The mobile phone described in Patent Document 2 determines the sizes and display positions of a plurality of buttons displayed on a display screen based on a user operation for drawing a diagram on a touch panel.

Japanese Patent Laid-Open No. 2004-110379 JP 2007-274136 A

  Generally, the operator of the touch panel may be either a finger or a touch pen, but the contact area with the touch panel varies greatly depending on the type of the operator. In the case of operation with a finger, the contact area with the touch panel varies depending on the type of finger. For this reason, it is desirable to arrange a button having a size corresponding to the contact area of the operation element on the touch panel. For example, when operating with an operator having a small contact area, it is desirable to arrange a large number of buttons on the display screen using small buttons. On the other hand, when operating with an operator having a large contact area, it is desirable to arrange a large button that is easy to operate.

  In addition, the mobile phone has a small display screen, and the display screen is often hidden by the operating hand. For this reason, when operating with the right hand, it is desirable to arrange the buttons on the right side and arrange the characters on the left side, and when operating with the left hand, it is desirable to reverse these arrangements. The size and arrangement of the scroll bar are the same as in the case of the button.

  In addition, when performing a drag operation to move the operation element in contact with the touch panel, the distance that the operation element can be moved becomes shorter as the contact area between the operation element and the touch panel becomes larger. It becomes difficult to perform a long drag operation.

  Therefore, if the size and arrangement of display objects such as buttons, scroll bars, and characters displayed on the display screen of the touch panel can be changed according to the contact area of the operation element, operability can be improved. Conceivable. However, there is a problem that it is troublesome for the user to change the size and arrangement of the display object by performing an operation for changing the setting.

  As described above, the mobile phone of Patent Document 2 allows the user to determine the size and display position of the button by a simple operation. However, the display object is not changed so as to have an appropriate size or arrangement according to the operation element.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a portable information terminal that displays a display object corresponding to the type of operation element on a touch panel. It is another object of the present invention to provide a portable information terminal that performs screen scrolling according to the type of operation element during a drag operation. Furthermore, it aims at providing the portable information terminal which can prevent a misoperation according to an operation element.

The portable information terminal according to the first aspect of the present invention includes an optical touch panel in which a large number of optical sensors are two-dimensionally arranged on a display screen and generates a captured image photographed outward, and the optical image based on the captured image. Operator discriminating means for discriminating the type of operator operating the touch panel, display pattern storage means for holding two or more display patterns, and display pattern selection for selecting the display pattern based on the type of the operator Means, display control means for controlling the display screen based on the selected display pattern, operation position determination means for determining the operation position by the operator based on the captured image, and the operation position. Based on the drag operation determining means for determining the drag operation by the operation element and the determination result of the drag operation on the display screen. And a scroll control means for controlling the scrolling of Display pattern, the scroll control means, based on the type of the operating element, configured to determine the scrolling amount.

  With such a configuration, it is possible to select a display pattern corresponding to the type of the operator that operates the optical touch panel, and display the optical touch panel based on the display pattern. For this reason, it is possible to ensure good operability according to the type of the operator without the user performing complicated setting work. For example, when an operator having a small contact area such as a touch pen is used, a small operation object can be selected to increase the amount of information in the display screen. On the other hand, when an operator having a large contact area such as a finger is used, a large operation object that can be easily operated with the finger can be arranged. Even when the operation is performed with a finger, operation objects having different sizes can be arranged depending on whether the operation is performed with the thumb or the operation with other fingers.

In addition , since the amount of scrolling can be determined according to the type of operation element, even when a drag operation is performed with any of the different operation elements, good scroll control can be performed, improving operability. Can be made. For example, by changing the ratio of the scroll amount with respect to the drag movement amount depending on the type of the operation element, the difference in the drag operation by the operation element is compensated, and good operability can be obtained regardless of which operation element is used. be able to.

In addition to the above-described configuration, the portable information terminal according to the second aspect of the present invention includes an optical touch panel in which a large number of optical sensors are two-dimensionally arranged on a display screen and generates a photographed image photographed outward, and the photographed image. Based on the above, the operator discriminating means for discriminating the type of the operator operating the optical touch panel, the display pattern storage means for holding two or more display patterns, and the display pattern based on the type of the operator Display pattern selection means for selecting the display, display control means for controlling the display screen based on the selected display pattern, and operation position determination means for determining the operation position of the operator based on the captured image A pinch operation determining means for determining a pinch operation by the operation element based on the operation position, and the display image based on the determination result of the pinch operation. And a display magnification control means for controlling the display magnification of the display pattern on said display scale control means, based on the type of the operating element, configured to determine the display magnification.

  According to such a configuration, since the display magnification can be determined according to the type of the operation element, even when a pinch operation is performed with any of the different operation elements, good display magnification control is performed. And operability can be improved. For example, by changing the ratio of the display magnification amount with respect to the pinch operation amount depending on the type of the operation element, the difference in the pinch operation by the operation element is compensated, and good operability can be obtained regardless of which operation element is used. Obtainable.

In addition to the above-described configuration, the portable information terminal according to the third aspect of the present invention includes an optical touch panel in which a large number of optical sensors are two-dimensionally arranged on a display screen and generates a photographed image photographed outward, and the photographed image. Based on the above, the operator discriminating means for discriminating the type of the operator operating the optical touch panel, the display pattern storage means for holding two or more display patterns, and the display pattern based on the type of the operator Display pattern selection means for selecting the display, display control means for controlling the display screen based on the selected display pattern, and operation position determination means for determining the operation position of the operator based on the captured image And a pinch operation determining means for determining a pinch operation by the operation element based on the operation position, and the pinch operation determining means is a type of the operation element. Based on configured to disable the pinch operation.

  According to such a configuration, the pinch operation can be invalidated according to the type of the operation element. Therefore, in the case of an operation element that does not perform the pinch operation, the pinch operation is usually handled by an erroneous operation or erroneous detection. It is possible to prevent the processing from being performed.

In addition to the above configuration, the portable information terminal according to the fourth aspect of the present invention is configured such that the operation element determination means determines whether the operation element is a touch pen or a finger.

In addition to the above-described configuration, the portable information terminal according to the fifth aspect of the present invention is configured such that the operation element determination means determines whether the operation element is a touch pen or a finger.

  ADVANTAGE OF THE INVENTION According to this invention, the portable information terminal which displays the display object according to the kind of operation element on a touch panel can be provided. In addition, it is possible to provide a portable information terminal that performs screen scrolling according to the type of operation element during a drag operation. Furthermore, it is possible to provide a portable information terminal that can prevent an erroneous operation depending on the operation element.

It is the external view which showed an example of the portable information terminal by embodiment of this invention. It is the figure which showed one structural example of the optical touch panel 2 of FIG. 2 is a block diagram illustrating an example of an internal configuration of the mobile phone 1 in FIG. 1. FIG. 4 is a block diagram illustrating an example of a detailed configuration of an operation processing unit 4 and a display image generation unit 5 in FIG. 3. 5 is a flowchart illustrating an example of an operation in the operation processing unit 4. It is the figure which showed an example of the screen display by the optical touch panel 2 of FIG.

  FIG. 1 is an external view showing an example of a portable information terminal according to an embodiment of the present invention. As an example of the portable information terminal, a mobile phone 1 having an optical touch panel is shown. The cellular phone 1 includes a housing 10, a receiving receiver 11, an optical touch panel 2, operation keys 13, and a transmitting microphone 14.

  The receiving receiver 11 is a voice output unit that outputs a received sound during a call. The optical touch panel 2 is a display device that has a display screen for displaying an image and detects a user operation input on the display screen. For example, it is possible to display a menu on the display screen, detect an operation position on the display screen by the user, and determine a menu option selected by the user. The operation key 13 is a contact-type operation input means, and can detect a pressing operation by a user. For example, a menu can be displayed on the display screen of the optical touch panel 2 by pressing the operation key 13. The transmission microphone 14 is a voice input means for inputting a transmission sound during a call.

  The user can perform various types of operation inputs using the optical touch panel 2. Here, “single tap” that taps the display screen once with the operator, “double tap” that taps twice at a predetermined time interval, “drag” that moves the operator while touching the display screen, operation Lightly pay the child on the display screen, that is, perform “flick” to move the operator quickly away from the display screen, and “pinch” to change the distance between the two operators while keeping them in contact with each other It shall be possible.

  For example, when the user performs a tap operation on an icon in the display screen, the icon can be selected or a function associated with the icon can be executed. Further, if a drag operation is performed, the screen display can be scrolled, and if a pinch operation is performed, the screen display can be enlarged or reduced.

  The optical touch panel 2 can discriminate not only the operation position on the display screen where the user has performed the operation input, but also the type of the operator used for the operation input. That is, it can be determined whether the user has operated with the touch pen or the finger, and if the user has operated with the finger, it can also be determined which of the thumb or the other finger has been used. Further, the optical touch panel 2 can determine the direction in which the operator is tilted with respect to the display screen. For this reason, it is also possible to determine whether the user is operating with the right hand or the left hand.

  In the mobile phone 1, by using such an optical touch panel 2, the display pattern to be displayed on the display screen is varied based on the type of the operator and the tilt direction. For this reason, the display pattern according to an operator can be displayed, and the display pattern according to right hand operation or left hand operation can be displayed.

  Further, in the cellular phone 1, the operation at the time of operation input is varied based on the type of the operation element and the tilt direction. For this reason, it is possible to realize good operability according to the type of the operator and the operating hand. Further, it is possible to prevent an erroneous operation by prohibiting an operation input that is not normally possible, such as a pinch operation when using the touch pen.

  FIG. 2 is a diagram showing a configuration example of the optical touch panel 2 of FIG. This optical touch panel 2 is configured as an inseparable unit of a display device and a touch panel by forming a large number of optical sensors in a liquid crystal panel. Using these optical sensors, the vicinity of the display screen can be photographed outward from the display screen to generate a photographed image.

  FIG. 2A is a perspective view showing the appearance of the optical touch panel 2. The optical touch panel 2 includes a liquid crystal panel 20, a backlight 21, a liquid crystal drive circuit 23, and an optical sensor control circuit 24. In the liquid crystal panel 20, a large number of display pixels 25 driven by the liquid crystal driving circuit 23 and a large number of photosensors 26 controlled by the photosensor control circuit 24 are provided. Further, the liquid crystal driving circuit 23 and the optical sensor control circuit 24 are respectively arranged on the frame portion of the liquid crystal panel 20 surrounding the display screen 22.

  FIG. 2B is an enlarged view showing an example of the display pixel 25 that forms the display screen 22. A large number of display pixels 25 are two-dimensionally arranged in a matrix in the display screen 12. Each display pixel 25 includes a red sub-pixel 25r, a green sub-pixel 25g, and a blue sub-pixel 25b, and an optical sensor 26 is disposed for each display pixel 25. That is, the same number of photosensors 26 as the display pixels 25 are two-dimensionally arranged in a matrix. Note that the number of both need not be the same.

  FIG. 2C shows a cross section of the liquid crystal panel 20 and the backlight 21 on the display screen 22. In the liquid crystal panel 20, liquid crystal is sealed in a gap between two glass plates 28, display pixels 25 and photosensors 26 are formed on the inner surface of one glass plate 28, and a common electrode 27 is formed on the inner surface of the other glass plate 28. Is formed.

  The backlight 101 is a light source disposed on the back side of the liquid crystal panel 20, and an image is displayed on the display screen 22 when light from the backlight 21 passes through the display pixels 25. When the user brings the operation element close to the display screen 22, the emitted light from the display screen 22 is reflected by the operation element, and this reflected light is incident on the optical sensor 26. Therefore, if the amount of incident light is detected by each optical sensor 26, a captured image taken outward from the display screen 22 can be obtained.

  This captured image includes not only an image of a contact portion with the optical touch panel 2 but also an image of a non-contact portion located in the vicinity of the optical touch panel 2. Further, the contact portion and the non-contact portion can be discriminated based on the brightness of the image. Therefore, not only the type of the operation element can be determined, but also the direction in which the operation element is inclined with respect to the optical touch panel 2 can be determined.

  FIG. 3 is a block diagram showing an example of the internal configuration of the mobile phone 1 of FIG. The mobile phone 1 includes an optical touch panel 2, an operation analysis unit 3, an operation processing unit 4, a display image generation unit 5, a function execution unit 6, and a display control unit 7.

  The operation analysis unit 3 includes an operation position determination unit 31, an operator determination unit 32, and an inclination direction determination unit 33, and analyzes a user operation on the optical touch panel 2 based on a photographed image output from the optical sensor control circuit 24. is doing.

  The operation position determination unit 31 determines the operation position in the display screen 22 based on the captured image. The operation position is the position of the tip of the operation element on the display screen. For example, the contact area of the operator can be extracted from the photographed image and can be obtained as the coordinate position in the display screen 22 at the center of the contact area.

  The operator determining unit 32 determines the type of the operator based on the captured image. Here, it is determined which of the touch pen or the finger is used for operation, and when the operation is performed with the finger, it is further determined which of the thumb or the other finger is used for operation. The type of the operation element can be determined by the shape and size of the tip of the operation element. For example, by comparing the area of the contact area with two threshold values, it can be determined whether the touch pen, thumb, or other finger.

  The tilt direction determination unit 33 determines the tilt direction of the operator with respect to the optical touch panel based on the captured image. The inclination of the operation element can be determined by the positional relationship between the contact part and the non-contact part of the operation element in the captured image. If there is a non-contact portion on the right side of the contact portion, it can be determined that the operation element is tilted to the right, and it is understood that the user is operating with the right hand. On the other hand, if there is a non-contact portion on the left side of the contact portion, it can be determined that the operation element is tilted to the left, and it can be seen that the user is operating with the left hand. Here, it is determined whether the user is operating with the right hand or the left hand by determining the inclination in the left-right direction. The tilt determination can be performed regardless of whether the operation element is a touch pen or a finger.

  The operation processing unit 4 determines the presence / absence and type of touch panel operation based on the operation position and type of the operator, determines processing based on the touch panel operation, and displays the display image generation unit 5 and the function execution unit 6 The process is instructed. For example, when a single tap operation is performed on the operation button on the display screen 22, the function execution unit 6 is instructed to execute a function corresponding to the operation button. On the other hand, when a drag operation or a pinch operation is performed in the display screen 22, the display image generation unit 5 is instructed to scroll or change the display magnification.

  The display image generation unit 5 generates a display image to be displayed on the display screen 22 based on the outputs of the operation analysis unit 3 and the operation processing unit 4. The display control unit 7 controls the liquid crystal drive circuit 23 in the optical touch panel 2 based on the display image from the display image generation unit 5.

  FIG. 4 is a block diagram illustrating an example of a detailed configuration of the operation processing unit 4 and the display image generation unit 5 of FIG. The operation processing unit 4 includes an operation determination unit 41, an effectiveness determination unit 42, a process determination unit 43, a determination parameter storage unit 41s, an allowable operation storage unit 42s, and a control parameter storage unit 43s.

  The operation determination unit 41 determines the type of touch panel operation such as a single tap operation, a drag operation, or a pinch operation based on the operation position of the operator. The operation type determination process is performed using the determination parameter read from the determination parameter storage unit 41s based on the type of the operator.

  The determination parameter storage unit 41s holds determination parameters used for determining the operation type by the operation element for each operation element type. For example, as a determination parameter for a single tap operation, as a time for touching the display screen 22, as a determination parameter for a double tap operation, as a time from a first tap operation to a second tap operation, or as a determination parameter for a flick operation The moving speed of the operating element, the movement amount of the operating element, and the like are held as determination parameters for the drag operation. By holding such determination parameters for each type of operator, it is possible to determine the operation type according to the type of operator.

  The validity determination unit 42 determines whether the operation type determined by the operation determination unit 41 is valid based on the type of the operator. The validity determination process is performed using the allowable operation read from the allowable operation storage unit 42s based on the type of the operator. That is, when the touch panel operation determined by the operation determination unit 41 is not included in the read allowable operation, it is determined that the touch panel operation is an invalid operation.

  The permissible operation storage unit 42 s holds, as permissible operations, touch panel operations that can be input with the operators for each type of operator. Here, a touch panel operation such as a single tap operation, a double tap operation, a drag operation, and a pinch operation is associated as an allowable operation with respect to the three operators of the touch pen, the thumb, and a finger other than the thumb. However, since the pinch operation performed by contacting two points is not performed with the touch pen, the allowable operation of the touch pen does not include the pinch operation. By holding such an allowable operation for each type of operation element, it is possible to prevent erroneous operation input and prohibited operation input from being erroneously detected.

  The process determining unit 43 determines the processing content to be performed based on an effective touch panel operation, and outputs a control signal to the function executing unit 6 or the display image generating unit 5. This processing content determination processing is performed based on the arrangement information of the operation object displayed on the display screen and the operation position of the operation element. An operation object is an object that is a target of user operation, such as an operation button or a handle of a scroll bar, among various objects displayed on the display screen. For example, when a single tap operation or a double tap operation for selecting the operation button is performed on the operation button, it is determined to execute the processing content previously associated with the operation button.

  Further, the process content determination process is performed using the control parameter read from the control parameter storage unit 43s based on the type of the operation element, and even when the same touch panel operation is performed, the operation element is determined. If the type of is different, the processing contents are also different.

  The control parameter storage unit 43s holds, for each type of operation element, control parameters used for display control performed based on an operation input by the operation element. For example, the ratio of the scroll movement amount to the drag movement amount is held as the scroll control parameter, and the ratio of enlargement or reduction to the pinch movement amount is held as the control parameter for changing the display magnification.

  By holding such control parameters for each type of operation element, display control according to the type of operation element can be performed. For example, since the thumb is shorter than the other fingers and the movable range is narrow, the moving distance on the display screen is also shortened. Therefore, when the drag operation is performed with the thumb, the control parameter indicating the ratio of the scroll movement amount to the drag movement amount is set to a larger value than when the drag operation is performed with a finger other than the thumb. Thus, even when a drag operation is performed with the thumb, scrolling with a large amount of movement can be performed as with other fingers. On the other hand, if a drag operation is performed with a touch pen, the movable range is wide, and it is easy to perform a drag operation with a large amount of movement. For this reason, in the case of a drag operation with a touch pen, scrolling with a short movement amount can be performed by reducing the control parameter indicating the ratio of the scroll movement amount to the drag movement amount.

  Steps S <b> 101 to S <b> 109 in FIG. 5 are flowcharts illustrating an example of operations in the operation processing unit 4. This operation determination process is executed when an operation input is performed on the optical touch panel 2.

  First, the operation discriminating unit 41 acquires the type of the manipulator discriminated by the manipulator discriminating unit 32 (step S101), and the judgment parameter associated with the type of the manipulator is read from the judgment parameter storage unit 41s. (Step S102). Next, the operation position on the display screen 22 determined by the operation position determination unit 31 is acquired (step S103), and the type of touch panel operation is determined from the operation position using the determination parameter read out earlier. (Step S104). That is, the operation type is determined according to the type of the operation element.

  Next, the validity determination unit 42 reads the allowable operation associated with the type of the operator from the allowable operation storage unit 42s (step S105). The validity determination unit 42 determines the validity by comparing the operation type previously determined by the operation determination unit 41 with the read allowable operation (step S106). That is, it is determined whether the touch panel operation is permitted as an operation by the operator. If the touch panel operation is an invalid operation that is not an allowable operation, the process ends without determining the process content (step S107).

  On the other hand, if the touch panel operation is an allowable operation, the process determining unit 43 reads out necessary control parameters from the allowable operation storage unit 42s (step S108). The control parameters are read according to the type of operation element and the operation type. The process determining unit 43 determines the process content based on the read control parameter, and outputs a control signal to the function executing unit 6 or the display control unit 7 that performs the process (step S109).

  The display image generation unit 5 includes a display pattern selection unit 51, a scroll control unit 52, a display magnification control unit 53, and a display pattern storage unit 51s.

  The display pattern selection unit 51 selects one of the display patterns in the display pattern storage unit 51s based on the type of operator and the tilt direction. The selection of the display pattern by the display pattern selection unit 51 is performed when an operation input to the display screen 22 is performed or when a display update signal is output from the function execution unit 6.

  In the display pattern storage unit 51s, two or more display patterns associated with the type of operator and the tilt direction are stored. The display pattern is information for generating a display image for the display screen 22, and includes one or more objects arranged on the display image and parameters related to these objects. For example, in the case of a display pattern that defines a list screen or thumbnail screen, objects such as text labels, text boxes, check boxes, scroll bars, list boxes, operation buttons, and display positions and sizes (height and width) of these objects Parameters such as font size, title, text display position (right-justified, left-justified, centered).

  In the display pattern selection unit 51, a display pattern corresponding to the type of the operator is selected. In particular, it is desirable to select a display pattern in which operation objects having a size corresponding to the type of operation element are arranged. For example, if the operator is a thumb, a display pattern in which a large object is arranged is selected. On the other hand, if the operation element is a touch pen, a display pattern in which smaller objects are arranged is selected, and more objects can be displayed in the display screen.

  The display pattern selection unit 51 selects a display pattern corresponding to the tilt direction of the operation element. That is, when the user is operating with the right hand, the display pattern for the right hand is selected, and when the user is operating with the left hand, the display pattern for the left hand is selected. The display pattern for the right hand makes the touch panel operation easy, and the display screen 22 is not easily hidden by the operating hand, so that the object is on the right side and the characters are left-aligned compared to the display pattern for the left hand. Is arranged in. On the other hand, in the display pattern for the left hand, the object is arranged on the left side and the characters are arranged in a right-justified format as compared with the case of the right-hand object.

  The scroll control unit 52 performs scroll control of the display image generated from the display pattern. This scroll control is performed based on a scroll control signal from the process determining unit 43. Further, the display magnification control unit 53 controls the display magnification of the display image in the display screen based on the display magnification control signal from the process determination unit 43.

  FIG. 6 is a diagram showing an example of the screen display by the optical touch panel 2 of FIG. 1, and (a) to (c) in the figure show a list screen 60a when the type or inclination direction of the operation element is different. ~ 60c is shown. These list screens 60a to 60c are composed of a list box 61, a determination button 64, and a clear button 65, and can be used when, for example, a list of contacts registered in the address book is displayed. Two or more items 63 and a scroll bar 62 are arranged in the list box 61. The decision button 64 and the clear button 65 are objects that are targets of user operations.

  FIG. 6A shows a list screen 60a when the user is operating with the thumb of the right hand. In general, when the optical touch panel 2 is operated with the finger of the right hand, the region on the right side of the operation position in the display screen 22 is easily hidden by the finger or palm of the right hand. Further, when the mobile phone 1 is held with the right hand and the display screen 22 is operated with the thumb of the right hand, it is difficult for the finger to reach the left side of the display screen 22. For this reason, when operating with the thumb of the right hand, as shown in the figure, the determination button 64 and the determination button 64 are arranged close to the right side. A scroll bar 63 is also arranged at the right end of the list box 61. On the other hand, the text displayed in each item 63 in the list box 61 is displayed left-aligned so that the characters are not easily hidden by the finger or palm of the right hand. That is, the object to be operated is unevenly distributed in the direction close to the hand used for operation input in the display screen, and the character string is unevenly distributed on the opposite side to the above direction. For this reason, the character string is not easily hidden by a finger or palm, and the display pattern is easy to operate even with the thumb.

  FIG. 6B shows a list screen 50b when the user is operating with the thumb of the left hand. In the list screen 60b, the determination button 64, the clear button 65, and the scroll bar 62 are arranged close to the left side so that the thumb of the left hand can easily reach. In addition, the text displayed in each item 63 is displayed right-justified and arranged so that the characters are not easily hidden by the finger or palm of the right hand.

  FIG. 6C shows a list screen 60c when the touch pen is operated with the right hand. In general, when the optical touch panel 2 is operated with a finger, it is necessary to display an operation button larger than the contact area because an operation error is likely to occur when the operation buttons 64 and 65 smaller than the contact area of the finger are arranged. As a result, the amount of information that can be displayed in the display screen 22 is reduced. On the other hand, the touch pen has a sufficiently small contact area, and such an erroneous operation is unlikely to occur. For this reason, as shown in the figure, by arranging small operation buttons 64 and 65 and enlarging the list box 61, the amount of information that can be displayed can be increased.

  In this embodiment, each time an operation input to the optical touch panel 2 is performed, the type and tilt direction of the operation element are determined, and an example in which the display pattern is updated based on these determination results is described. However, the present invention is not limited to such a case. For example, the display pattern may be updated when an operation input is first performed after the backlight is turned on. In other words, the display pattern may be updated after the power is turned on or when returning from the power saving mode in which the backlight is turned off, and the display pattern is not automatically updated during the subsequent lighting of the backlight. In addition, the display pattern can be updated at regular time intervals.

  In the present embodiment, the scroll amount based on the drag operation is determined based on the movement amount of the operation element, but the present invention is not limited to this. For example, the scroll amount can be determined based on the moving speed of the operation position. In this case, the control parameter storage unit 43s needs to hold a control parameter indicating the ratio of the scroll amount to the movement speed of the operation position.

DESCRIPTION OF SYMBOLS 1 Mobile phone 2 Optical touch panel 3 Operation analysis part 4 Operation processing part 5 Display image generation part 6 Function execution part 7 Display control part 10 Case 11 Reception receiver 12 Display screen 13 Operation key 14 Microphone 20 Transmission liquid crystal panel 21 Back Light 22 Display screen 23 Liquid crystal drive circuit 24 Photo sensor control circuit 25 Display pixel 26 Photo sensor 27 Common electrode 28 Glass plate 31 Operation position discriminating unit 32 Manipulator discriminating unit 33 Tilt direction discriminating unit 41 Operation discriminating unit 41 s Determination parameter storage unit 42 Effectiveness determination unit 42s Permissible operation storage unit 43 Processing determination unit 43s Control parameter storage unit 51 Display pattern selection unit 51s Display pattern storage unit 52 Scroll control unit 53 Display magnification control units 60a to 60c List screen 61 List box 62 Scroll bar 63 Item 64 OK button 65 Clear button Tan

Claims (5)

An optical touch panel in which a large number of optical sensors are two-dimensionally arranged on a display screen and generate a photographed image photographed outward,
An operator discriminating means for discriminating a type of an operator operating the optical touch panel based on the photographed image;
Display pattern storage means for holding two or more display patterns;
Display pattern selection means for selecting the display pattern based on the type of the operator;
Display control means for controlling the display screen based on the selected display pattern ;
An operation position discriminating means for discriminating an operation position by the operator based on the photographed image;
A drag operation determining means for determining a drag operation by the operator based on the operation position;
Scroll control means for controlling scrolling of the display pattern on the display screen based on the determination result of the drag operation,
The portable information terminal according to claim 1, wherein the scroll control means determines a scroll amount based on a type of the operation element . An optical touch panel in which a large number of optical sensors are two-dimensionally arranged on a display screen and generate a photographed image photographed outward,
An operator discriminating means for discriminating a type of an operator operating the optical touch panel based on the photographed image;
Display pattern storage means for holding two or more display patterns;
Display pattern selection means for selecting the display pattern based on the type of the operator;
Display control means for controlling the display screen based on the selected display pattern;
An operation position discriminating means for discriminating an operation position by the operator based on the photographed image;
Pinch operation determining means for determining a pinch operation by the operation element based on the operation position;
Display magnification control means for controlling the display magnification of the display pattern on the display screen based on the determination result of the pinch operation,
A portable information terminal to which the display magnification control means, based on the type of the operator, and determines the display magnification. An optical touch panel in which a large number of optical sensors are two-dimensionally arranged on a display screen and generate a photographed image photographed outward,
An operator discriminating means for discriminating a type of an operator operating the optical touch panel based on the photographed image;
Display pattern storage means for holding two or more display patterns;
Display pattern selection means for selecting the display pattern based on the type of the operator;
Display control means for controlling the display screen based on the selected display pattern;
An operation position discriminating means for discriminating an operation position by the operator based on the photographed image;
A pinch operation determining means for determining a pinch operation by the operation element based on the operation position;
A portable information terminal the pinch operation determination means, based on the type of the operating element, and wherein the disabling the pinch operation. The portable information terminal according to claim 1 , wherein the operation element determination unit determines whether the operation element is a touch pen or a finger. The portable information terminal according to any one of claims 1 to 3 , wherein the operator discriminating unit discriminates between the thumb and the other finger when the operator is a finger. .

Images