JP2012018697A - Portable terminal device, display control method, and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal device having good operability and capable of operating all buttons and the like of an operational object only by moving one finger of one hand in which a user holds the portable terminal device, when operating the portable terminal device mounted both of a touch panel and a fixed operation part.SOLUTION: The portable terminal device comprises: a housing case with movable units 11, 12; a display unit 17 capable of displaying visualized information to represent an operational object position; a touch sensor 13 for detecting a touch position of such as a finger of a user on the display unit; a shape detection unit for detecting variations in a shape of the housing case; an input operation management unit for managing the touch position of the sensor and the operational object position of each visualized information displayed on the display unit, in relation to each other; and a display control unit for automatically changing at least the display position, with respect to the visualized information to be displayed on the display unit, in accordance with the variations in the shape of the housing case detected by the shape detection unit.

Description

  The present invention relates to a portable terminal device including a deformable casing and a touch panel for input operation, a display control method for controlling the portable terminal device, and a display control program.

  For example, in devices such as mobile phone terminals and personal digital assistants (PDAs), those equipped with touch panels for input operations are increasing. This type of touch panel includes a touch sensor arranged so as to overlap the display screen. When the user touches the display screen with his / her finger or a pointed pen (stylus), the touch sensor detects the contact position and compares this position with the buttons and icons displayed on the screen. By doing so, it is determined whether or not the user has operated a button or icon on the screen.

  By adopting such a touch panel, it is possible to omit the mounting of a keyboard composed of a large number of physical switches and buttons. Further, since the number, shape, layout, etc. of buttons and icons displayed on the screen can be changed as necessary, the degree of freedom increases.

  As a related art of a portable terminal using a touch panel, for example, one disclosed in Patent Document 1 is known.

  In addition, a cellular phone terminal or the like often uses a housing that is relatively small when carried and can be folded so as to have a size that can be easily used when used, or a structure that can be deformed.

  For example, in Patent Document 2, the two members constituting the casing are arranged in an overlapped state, and the two members are relatively moved (slid). Making it possible is disclosed.

  By the way, even in the case of a portable terminal using a touch panel, it is often the case that an actual operation unit (hereinafter referred to as a fixed operation unit) including a large number of physical switches and buttons is provided in addition to the touch panel. It is. In other words, the number of buttons that can be displayed on the touch panel may be limited, or the size of the buttons that can be displayed on the touch panel may be small. Then, it is easier for the user to use a fixed operation unit such as a keyboard including a large number of buttons than a touch panel.

  However, if both the touch panel and the fixed operation unit are installed, the terminal becomes large. Therefore, in some mobile terminal products already on the market, a slide-type housing as disclosed in Patent Document 2 is adopted, and the user can deform the housing so as to extend and contract. Thus, the fixing operation unit is configured to be used in either the state where the fixing operation unit is housed inside the terminal or the state where the fixing operation unit is exposed on the surface of the terminal.

Japanese Patent Laid-Open No. 2002-268776 JP 2006-314128 A

  By the way, when operating a mobile phone terminal, for example, it is common for a user to hold the mobile phone terminal with one hand and operate each button of the operation unit on the terminal while moving the thumb of the same hand. Even when operating a mobile terminal equipped with a touch panel as described above, the user can hold this terminal with one hand and operate the buttons displayed on the touch panel on the terminal while moving the thumb of the same hand. It can be considered a desirable operation. In other words, with the operation of moving only one thumb, the user remembers the position of each button sensuously. It can be carried out.

  However, when the number of buttons to be operated is very large and these buttons are arranged in a relatively wide range, the user holds the terminal with one hand and moves all thumbs by moving only one thumb. It is difficult to operate. For example, when operating a terminal equipped with both a touch panel and a fixed operation unit as the operation unit, change the shape of the terminal housing so that the fixed operation unit is exposed on the surface, and both the fixed operation unit and the touch panel If an operation is attempted at the same time, there are buttons to be operated even at a position far from the base of the thumb, so that all buttons cannot be operated simply by moving the thumb. As a result, since the user operates the terminal using both hands, changes the hand holding the terminal, or operates while shifting the position of the hand, it cannot be said that the operability is good.

  An object of the present invention is to provide a portable terminal device with good operability that allows a user to operate all buttons and the like to be operated only by moving one finger of one hand holding the terminal.

One form of the portable terminal device of the present invention is
Provided with a housing having a movable part for changing the shape to at least two types of states, a display part capable of displaying any visible information representing the operation target part, a user's finger on the display surface of the display part, etc. A portable terminal device comprising a touch sensor for detecting the contact position of
A shape detector for detecting a change in the shape of the housing;
A display control unit that automatically changes at least a display position according to a shape change of the housing detected by the shape detection unit for each visible information to be displayed on the display unit; There,
The housing includes an upper housing and a lower housing that can move relative to each other by sliding or rotating,
The display unit and the touch sensor are mounted on the upper casing,
A fixed operation unit including a plurality of buttons whose positions are physically fixed that can be operated by the user is mounted on the lower housing,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects each operation target displayed on the display unit. The display position of visible information is moved to a position close to the fixed operation unit in the entire display area of the display unit.

In one form of the portable terminal device of the present invention,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects each operation target displayed on the display unit. The visible information is re-displayed at the destination position in a state where the size is reduced as compared with a predetermined standard state.

In one form of the portable terminal device of the present invention,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects each operation target displayed on the display unit. Of the visible information, only a part of the visible information that can be displayed is re-displayed at the position of the movement destination, and the visible information displayed at the movement destination is switched in accordance with an input operation for scrolling the display.

In one form of the portable terminal device of the present invention,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects an object on the content displayed on the display unit. A pointer indicating an operation target position for the operation target is displayed on the display unit, and visible information of the operation target to which a function for instructing movement of the display position of the pointer is assigned is displayed at a position close to the fixed operation unit. It is characterized by.

In one form of the portable terminal device of the present invention,
The display control unit includes, as the set of visible information, a virtual keyboard composed of a plurality of display buttons associated with each of a plurality of characters, a candidate display unit for displaying conversion candidates for the input characters, When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a change in the shape of the housing, the virtual keyboard is displayed. Is deleted, and only the candidate display portion is re-displayed at the position of the movement destination close to the fixed operation portion in the entire display area of the display portion.

In one form of the portable terminal device of the present invention,
The display control unit has a function of displaying, on the display unit, a virtual keyboard including a plurality of display buttons associated with a plurality of characters as the set of visible information, and the shape of the housing When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a change, the character assigned to each display button included in the virtual keyboard is different from a predetermined standard state. It is characterized by switching automatically.

In one form of the portable terminal device of the present invention,
An operation state detection unit for detecting the type of the application program in operation;
The display control unit automatically switches a configuration of a variable operation unit displayed on the display unit as the set of visible information in accordance with a detection result of the operation state detection unit.

One aspect of the display control method of the present invention is:
Provided with a housing having a movable part for changing the shape to at least two types of states, a display part capable of displaying any visible information representing the operation target part, a user's finger on the display surface of the display part, etc. A display control method for controlling the display of a portable terminal provided with a touch sensor for detecting the contact position of
The portable terminal is
The housing includes an upper housing and a lower housing that can move relative to each other by sliding or rotating,
The display unit and the touch sensor are mounted on the upper casing,
A fixed operation unit including a plurality of buttons whose positions are physically fixed that can be operated by the user is mounted on the lower housing,
The display control method includes:
For each visible information of the operation target displayed on the display unit, at least the display position is automatically changed according to the shape change of the housing,
When it is detected that the fixed operation unit is exposed on the surface due to the shape change of the housing, the display position of each visible information of the operation target displayed on the display unit is displayed on the display unit. It moves to a position close to the fixed operation section in the entire display area.

One form of the display control program of the present invention is:
Provided with a housing having a movable part for changing the shape to at least two types of states, a display part capable of displaying any visible information representing the operation target part, a user's finger on the display surface of the display part, etc. A display control program that can be executed by a computer for controlling the display of a mobile terminal provided with a touch sensor that detects the contact position of the mobile terminal,
The housing includes an upper housing and a lower housing that can move relative to each other by sliding or rotating,
The display unit and the touch sensor are mounted on the upper casing,
A fixed operation unit including a plurality of buttons whose positions are physically fixed that can be operated by the user is mounted on the lower housing,
The display control program is
A step of automatically changing at least a display position according to a change in shape of the housing for each visible information to be displayed on the display unit, and the fixed operation unit is exposed on the surface by the change in shape of the housing When it is detected that the state has been reached, the display position of each visible information to be operated displayed on the display unit is moved to a position close to the fixed operation unit in the entire display area of the display unit. And a step.

  According to the present invention, it is possible to provide a portable terminal device with good operability that allows a user to operate all buttons and the like to be operated only by moving one finger of one hand holding the terminal.

It is a front view showing the specific example of the external appearance of the portable terminal device in 1st Embodiment. It is a block diagram which shows the structural example of the principal part of the hardware and software of the portable terminal device shown in FIG. FIG. 3 is a block diagram illustrating an internal configuration of a display screen creation unit and a display mode management unit illustrated in FIG. 2. It is a schematic diagram showing the specific example of the correspondence of the shape change of the housing | casing in the portable terminal device shown in FIG. 1, and the operation mode which can be utilized. It is a flowchart showing the operation | movement regarding the display in the portable terminal device shown in FIG. It is a front view which shows the specific example (1) of the display content regarding the screen of the portable terminal device shown in FIG. It is a front view which shows the specific example (2) of the display content regarding the screen of the portable terminal device shown in FIG. It is a front view which shows the specific example (3) of the display content regarding the screen of the portable terminal device shown in FIG. It is a front view which shows the specific example (4) of the display content regarding the screen of the portable terminal device shown in FIG. It is a block diagram which shows the structural example of the principal part of the software of the portable terminal device in 2nd Embodiment. It is a block diagram showing the internal structure of the display screen preparation part shown in FIG. It is a schematic diagram which shows the specific example of the display mode management table with which the portable terminal device shown in FIG. 10 was equipped. It is a flowchart showing the operation | movement regarding the display in the portable terminal device shown in FIG.

(First embodiment)
One specific embodiment relating to the mobile terminal device, the display control method, and the display control program of the present invention will be described below with reference to FIGS.

  FIG. 1 is a front view illustrating a specific example of the appearance of the mobile terminal device according to the first embodiment. FIG. 2 is a block diagram showing a configuration example of main parts of hardware and software of the mobile terminal device shown in FIG. FIG. 3 is a block diagram showing an internal configuration of the display screen creation unit and the display mode management unit shown in FIG. FIG. 4 is a schematic diagram showing a specific example of a correspondence relationship between a change in the shape of the housing and the available operation modes in the mobile terminal device shown in FIG. FIG. 5 is a flowchart showing an operation related to display in the portable terminal device shown in FIG. 6 to 9 are front views showing specific examples of display contents related to the screen of the mobile terminal device shown in FIG.

  In the present embodiment, it is assumed that the present invention is applied to a mobile terminal device having an appearance as shown in FIG. As a realistic portable terminal device to which the present invention is applied, for example, a cellular phone terminal, a portable information terminal (PDA), or the like is assumed.

  The housing of the mobile terminal device shown in FIG. 1 has a structure that can be changed in shape. That is, as shown in FIG. 1B, an upper housing 11 and a lower housing 12 are provided independently of each other, and the upper housing 11 and the lower housing are arranged in the longitudinal direction (in the direction of the arrow in the drawing) by a user operation. The body 12 is relatively movable (slidable). Therefore, the casing of this portable terminal device is extendable and retractable, and the upper casing 11 and the lower casing 12 are completely overlapped to form a compact shape as shown in FIG. Alternatively, as shown in FIG. 1B, the upper casing 11 can be moved upward so that the fixing operation unit 14 of the lower casing 12 is exposed (stretched) on the surface.

  In this portable terminal device, as shown in FIG. 1, a screen display unit 17 and a transparent touch panel 13 are provided so as to overlap each other, and these are exposed on the surface of the casing. The screen display unit 17 is composed of a liquid crystal display or the like, and can display various visible information such as a two-dimensional image, characters, symbols, and icons.

  When the touch panel 13 touches the surface using a user's finger or a thin-pointed pen (stylus), the touch panel 13 can output a signal indicating the touched position. Since the surface of the touch panel 13 overlaps the screen display unit 17, visible information (variable operation unit) 16 such as various buttons and icons is displayed on the screen display unit 17 as shown in FIG. Each piece of information can be associated with a contact position (user operation position) on the touch panel 13 by position. That is, when the user touches the surface of the touch panel 13 so as to operate each button or icon displayed on the screen display unit 17, an input operation (pressing) on a specific button or icon corresponding to the touched position. Can be processed as Further, since the positions of buttons and icons displayed on the screen display unit 17 and functions to be assigned can be changed as necessary, they can be used as variable operation units.

  On the other hand, since the fixed operation unit 14 includes a large number of physical switches and buttons that are independent for each button, the configuration and the display (print contents) of each button cannot be changed.

  In a normal operation, the user operates the visible information (variable operation unit) 16 displayed on the screen display unit 17 with the touch panel 13 by making the terminal casing compact as shown in FIG. It is assumed that However, for example, when it is desired to input a sentence at a high speed, it is possible to input more efficiently by inputting characters using the fixed operation unit 14. Accordingly, in such a situation, the user changes the shape of the housing as shown in FIG. 1B, and performs the input operation by switching to a state where the fixing operation unit 14 is exposed on the surface.

  By the way, in the state shown in FIG. 1A, the user can touch all the positions on the screen display unit 17 by moving the thumb 15a without moving the hand 15, and all visible information ( The variable operation unit 16 can be easily operated. However, as shown in FIG. 1B, since not only the entire area on the screen display unit 17 but also the fixed operation unit 14 is an operation target, all the buttons cannot be operated only by moving the thumb 15a. For example, in order to touch the position of the region 13a shown in FIG. 1B, it is necessary to shift the positional relationship between the user's hand 15 and the housing, or to operate using both hands, so the operability deteriorates. .

  Therefore, in the present embodiment, the state of the visible information (variable operation unit) 16 displayed on the screen display unit 17 is switched in accordance with a change in the shape of the terminal casing. That is, in the example shown in FIG. 1A, the visible information (variable operation unit) 16 is evenly arranged over the entire area of the screen display unit 17, whereas in the example shown in FIG. The information (variable operation unit) 16 is moved to a position biased to the lower side of the screen display unit 17. Thereby, even if it is the shape of the housing | casing shown in FIG.1 (b), since all the visible information (variable operation part) 16 is in the position close | similar to the fixed operation part 14, a user will fix only by moving the thumb 15a. All buttons of the operation unit 14 and the visible information (variable operation unit) 16 can be operated.

  A configuration example of the portable terminal device shown in FIG. 1 is shown in FIG. FIG. 2A shows a hardware configuration, and FIG. 2B shows a software configuration including programs and data executed by the microcomputer (CPU) 19.

  As shown in FIG. 2A, the mobile terminal device includes a touch panel 13, a screen display unit 17, a shape change detection sensor 18, a microcomputer 19, and a numeric keypad 20. In FIG. 2, illustration of elements other than those related to the input operation is omitted.

  The touch panel 13 and the screen display unit 17 are arranged in a state of being exposed on the surface of the upper housing 11 as shown in FIG. The shape change detection sensor 18 is a sensor for detecting a difference in relative positional relationship between the upper housing 11 and the lower housing 12, and is shown in FIG. 1 (a) and FIG. 1 (b). The difference in shape from the state can be identified. The numeric keypad 20 is a physical keyboard corresponding to the fixed operation unit 14 shown in FIG. 1, and includes 12 sets of switches and buttons.

  The microcomputer 19 performs various processes related to the user's input operation by software having a configuration as shown in FIG. That is, the display content of the screen display unit 17 is changed according to the signal output from the shape change detection sensor 18, or the input signal from the touch panel 13 or the numeric keypad 20 is processed to receive the user's input operation.

  As shown in FIG. 2B, the program executed by the microcomputer 19 and the data software include elements of a shape change detection unit 21, a display mode switching unit 22, a screen update unit 23, and an operation detection unit 24. The display mode switching unit 22 includes a display mode management unit 25, a display mode determination unit 26, and a display screen creation unit 27.

  The shape change detection unit 21 processes a signal output from the shape change detection sensor 18 and notifies the display mode switching unit 22 of the shape change when the shape of the terminal casing changes. That is, when the (decompression) state shown in FIG. 1 (a) is switched to the (extension) state shown in FIG. 1 (b), and the (extension) state shown in FIG. 1 (b) is shown in FIG. 1 (a). Notify when it switches to the (shrinked) state.

  The display mode switching unit 22 creates a display mode screen suitable for the state after the shape of the housing has changed. The display mode management unit 25 manages the shape of the terminal casing and the display mode to be changed in association with each other. The display mode determination unit 26 determines a display mode to be changed. The display screen creation unit 27 creates a display mode screen to be changed.

  The screen updating unit 23 displays the screen of the content created by the display mode switching unit 22 on the screen display unit 17 in order to update to the display mode screen after the transition.

  The operation detection unit 24 processes a signal output from the numeric keypad 20 and a signal output from the touch panel 13 and receives an input operation from the user. Since the signal output from the touch panel 13 is position information indicating the contact position of the finger, the position information and the display position of each visible information 16 are compared to distinguish which visible information 16 has been operated. . Information on the display position of each visible information 16 is updated to the latest display mode content according to the mode switching of the display mode switching unit 22.

  As shown in FIG. 3B, the display mode management unit 25 includes a display mode management table 28. The display mode management table 28 holds information that associates the shape of the terminal casing with the display mode to be changed. That is, as shown in FIG. 1A, the state in which the casing is contracted is associated with the “contraction mode”, and the information associating the state in which the casing is extended with the “extension mode” is retained as shown in FIG. is doing.

  As shown in FIG. 3A, the display screen creation unit 27 includes an expansion mode screen creation unit 27a and a reduced mode screen creation unit 27b. The stretch mode screen creation unit 27 a creates a screen corresponding to “stretch mode” in the display mode management table 28. The reduced mode screen creation unit 27 b creates a screen corresponding to the “reduced mode” in the display mode management table 28.

  Regarding the switchable mode of the visible information (variable operation unit) 16 displayed on the screen display unit 17, in addition to the difference between “extended mode” and “reduced mode” managed by the display mode management unit 25 described above, “First mode”, “Second mode”, “Third mode”, “Fourth mode”, “Fifth mode” are prepared, and these are in any of various combinations as shown in FIG. used.

  The contents of the processing of the microcomputer 19 relating to the display switching of the visible information (variable operation unit) 16 of the portable terminal device shown in FIG. 1 are shown in FIG. FIG. 5A shows the basic processing contents, and FIG. 5B shows more detailed processing contents. Also, the processes given the same step numbers in FIGS. 5A and 5B represent the same processes.

  First, the process shown in FIG. In step S <b> 11, the shape change detection unit 21 monitors the signal output from the shape change detection sensor 18 and checks whether or not there is a change in shape. When a change in shape is detected, the process proceeds to step S12, and the shape change detection unit 21 is in a state in which the case is contracted as shown in FIG. 1A or a state in which the case is extended as shown in FIG. Get shape information to represent.

  In step S <b> 13, the display mode switching unit 22 uses the shape information acquired by the shape change detection unit 21 to create a display mode screen suitable for the changed shape.

  In step S14, the screen update unit 23 updates the configuration of the visible information (variable operation unit) 16 displayed on the screen display unit 17 to the contents of the new screen created by the display mode switching unit 22 in step S13.

  The content of step S13 shown in FIG. 5A can be specifically processed in steps S15, S16, and S17 shown in FIG.

  In step S15, the display mode determination unit 26 of the display mode switching unit 22 searches the display mode management table 28 on the display mode management unit 25 using the shape information acquired from the shape change detection unit 21 as a key.

  In step S <b> 16, as a result of the search in step S <b> 15, the display mode determination unit 26 acquires information on the display mode of the transition destination from the display mode management table 28.

  In step S17, the display screen creation unit 27 creates a corresponding screen according to the display mode information of the transition destination acquired by the display mode determination unit 26 in step S16.

  Specific examples of the configuration of the visible information (variable operation unit) 16 displayed on the screen display unit 17 in each display mode are shown in FIGS.

First, a configuration example of the screen illustrated in FIG. 6 will be described.
In the screen shown in FIG. 6A, twelve independent icons 16 </ b> A are evenly arranged in the entire area of the screen display unit 17. This screen (reduced 1) is applied to the combination of “reduced mode” and “first mode” shown in FIG.

  On the other hand, in the screen shown in FIG. 6B, only 12 regions where the 12 independent icons 16B are biased to the lower side of the screen display unit 17 (positions close to the fixed operation unit 14) are compared with FIG. Arranged in a reduced size. This screen (extension 1-1) is applied to the combination of “extension mode” and “first mode” shown in FIG.

  In the screen shown in FIG. 6C, three icons 16C selected from the twelve icons, left and right scroll buttons 16D and 16E, and a slider 16F are provided below the screen display unit 17. Only the biased region (position close to the fixed operation unit 14) is arranged with the same size as FIG. Three icons 16C displayed by operating the scroll buttons 16D, 16E or the slider 16F are switched to other icons. This screen (extension 1-2) is applied to the combination of “extension mode” and “first mode” shown in FIG.

  For example, when the screen display unit 17 is used as a menu launcher for starting various application programs, the icon 16A having a relatively large size is usually displayed on the screen as shown in FIG. 6A. A preferable operability can be obtained by arranging the display unit 17 uniformly. However, in the state where the casing is extended as shown in FIG. 1B, the thumb 15a does not easily reach the upper side of the screen display unit 17, so that the screen display unit 17 as shown in FIG. The operability can be improved by reducing and arranging the icon 16B in the downwardly biased area. Further, since the reduced icons cause a decrease in operability, as shown in FIG. 6C, only a part of the icons 16C are displayed at the same size and the display can be switched by scrolling. Can improve.

  In the example illustrated in FIG. 7, it is assumed that displayable content such as a Web page is displayed on the screen display unit 17 of the terminal using a Web browser.

  In the screen shown in FIG. 7A, the display content 30 is displayed in the entire area of the screen display unit 17, and the entire area is assigned as an operation unit operable with the thumb 15a. This screen (shrinking 2, shrinking 3) is applied to a combination of “shrinking mode” and “second mode” or “third mode” shown in FIG.

  On the other hand, on the screen shown in FIG. 7B, the operable icon 16G is arranged in an area that is biased to the lower side of the screen display unit 17 (a position close to the fixed operation unit 14), and the display content 30 is displayed in other areas. Is displayed. A movable pointer 31 is displayed on the display content 30. That is, by operating the icon 16G, the pointer 31 can be moved and an arbitrary position on the display content 30 can be clicked. This screen (extension 2-1) is applied to the combination of “extension mode” and “second mode” shown in FIG.

  Similarly, on the screen shown in FIG. 7C, the operable icon 16H is arranged in an area that is biased to the lower side of the screen display unit 17 (position close to the fixed operation unit 14), and display content is displayed in other areas. 30 is displayed. A movable pointer 31 is displayed on the display content 30. That is, by operating the icon 16H, the pointer 31 can be moved and an arbitrary position on the display content 30 can be clicked. This screen (extended 2-2) is applied to the combination of “extended mode” and “second mode” shown in FIG.

  On the other hand, in the screen shown in FIG. 8, the operable icon 16J is arranged in an area biased to the lower side of the screen display unit 17 (position close to the fixed operation unit 14), and the display content 30 is displayed in the other area. ing. The icon 16J is assigned an input operation function for scrolling the contents of the display content 30 displayed on the screen display unit 17 in the vertical direction on the screen. This screen (extension 3) is applied to the combination of “extension mode” and “third mode” shown in FIG.

  In the example illustrated in FIG. 9, it is assumed that the user inputs a message such as a sentence using an application program such as a text editor.

  In the screen shown in FIG. 9A, the input message display unit 32 is arranged in the upper third region of the screen display unit 17, the conversion candidate display unit 16N is arranged in the center, and the region biased downward ( A virtual keyboard 16M is arranged at a position close to the fixed operation unit 14. The virtual keyboard 16M includes 12 operable icons suitable for inputting characters. When the conversion candidate display unit 16N displays a character string of a conversion candidate for a character or a character string input by an operation of the virtual keyboard 16M or the like, and detects contact of a finger or the like at the position where each candidate character string is displayed The candidate is assumed to be selected by the user. This screen (reduction 4 and reduction 5) is applied to a combination of the “reduction mode” and the “fourth mode” or the “fifth mode” shown in FIG.

  On the other hand, in the screen shown in FIG. 9B, the virtual keyboard 16M in FIG. 9A is erased from the screen, and the conversion candidate display part 16N is biased to the lower side in the screen display part 17 (fixed operation part 14), and the input message display unit 32 is arranged in the other area. This screen (extension 4) is applied to the combination of “extension mode” and “fourth mode” shown in FIG. That is, since it is assumed that characters are input with the fixed operation unit 14 by extending the casing, the virtual keyboard 16M is unnecessary, and the conversion candidate display unit 16N is moved within the movable range of the thumb 15a. As a result, operability is improved.

  In the screen shown in FIG. 9C, an area in which the virtual keyboard 16P is biased downward in the screen display unit 17 instead of the virtual keyboard 16M in FIG. 9A (position close to the fixed operation unit 14). It is arranged in. Symbols or the like different from general characters are assigned to the buttons of the virtual keyboard 16P. This screen (extension 5) is applied to the combination of “extension mode” and “fifth mode” shown in FIG. That is, since it is assumed that characters are input by the fixed operation unit 14 with the casing extended, general characters are input from the fixed operation unit 14, and other symbols and the like are at positions where fingers can reach. Operability is improved by using the virtual keyboard 16P.

  In this embodiment, it is assumed that the case of the terminal changes in shape so as to expand and contract in the longitudinal direction. However, other changes in shape, such as changes in shape due to rotation, can be similarly handled. it can. That is, it is important to move an operation target button or the like that is frequently operated within a range in which the thumb 15a can reach in accordance with a change in shape.

  In this embodiment, it is assumed that control is performed using a computer and software including programs and data executed by the computer. However, the configuration may be configured only by dedicated hardware to which similar control functions are assigned. it can.

(Second Embodiment)
Another specific embodiment relating to the mobile terminal device, the display control method, and the display control program of the present invention will be described below with reference to FIGS.

  FIG. 10 is a block diagram illustrating a configuration example of a main part of software of the mobile terminal device according to the second embodiment. FIG. 11 is a block diagram showing the internal configuration of the display screen creation unit shown in FIG. FIG. 12 is a schematic diagram showing a specific example of a display mode management table provided in the mobile terminal device shown in FIG. FIG. 13 is a flowchart showing an operation related to display in the mobile terminal device shown in FIG.

  The second embodiment is a modification of the first embodiment. 10 to 13, elements or steps corresponding to those in the first embodiment are denoted by the same reference numerals or numbers. A configuration and operation peculiar to the second embodiment will be described below.

  Also in the present embodiment, the hardware of the mobile terminal device is assumed to have the same configuration as that of FIG. The software configuration in the second embodiment is shown in FIG. As shown in FIG. 10, in the second embodiment, a terminal state management unit 29 is added to the display mode switching unit 22.

  The terminal state management unit 29 performs processing for grasping the operation state of the terminal. Specifically, a difference in the operating state of the terminal is grasped by distinguishing the type of application program executed by the microcomputer 19 that controls the terminal.

  In the second embodiment, as shown in FIG. 11, the display screen creation unit 27 includes an extension 1 mode screen creation unit, an extension 2 mode screen creation unit, an extension 3 mode screen creation unit, and an extension X mode screen creation. ,..., A reduced 1 mode screen creation unit, a reduced 2 mode screen creation unit, a reduced 3 mode screen creation unit, a reduced X mode screen creation unit,. These are provided to create a screen for each mode.

  In the second embodiment, a display mode management table 28B as shown in FIG. As shown in FIG. 12, the display mode management table 28B includes a terminal state distinction (A, B, C representing differences in operating application programs), a terminal shape difference (stretching / contraction), Information indicating the correspondence relationship with the transitioned display mode is registered in association with each other.

  Display modes “extension 1 mode”, “extension 2 mode”, and “extension 4 mode” in the display mode management table 28B shown in FIG. 12 are, for example, “first mode”, “second mode” shown in FIG. This corresponds to a combination of “fourth mode” and “extended mode”, and “contracted 1 mode”, “contracted 2 mode”, and “contracted 4 mode” are, for example, “first mode”, “first mode” shown in FIG. This corresponds to a combination of “2 mode”, “fourth mode”, and “reduced mode”.

  When the display mode management table 28B shown in FIG. 12 is used, for example, when the application program running on the terminal is a Web browser and the terminal shape detected by the shape change detection unit 21 is “extension”, “extension” Transition to the “2 mode” display mode.

  The operation of the terminal in the second embodiment is shown in FIG. In the process shown in FIG. 13, steps S21 and S22 are different from the contents of FIG. That is, in step S <b> 21, the display mode determination unit 26 acquires terminal state information representing the operation state of the terminal (difference in application program) from the terminal state management unit 29. In step S22, the display mode determination unit 26 searches the display mode management table 28B using the terminal state information acquired in step S21 and the shape change information acquired in step S12 as keys. This search result is used in the next step S16.

  Therefore, in the second embodiment, the screen display unit not only adapts to the change in the shape of the casing of the terminal, but also allows a more efficient input operation corresponding to the difference in the operating application program. The position, size, number, etc. of the visible information (variable operation unit) 16 on 17 can be automatically switched.

  As described above, the portable terminal device, the display control method, and the display control program of the present invention are portable terminals such as a cellular phone terminal, a portable information terminal, and a portable music player. To improve the operability of the user by applying it to a device having a body and a touch panel, and having a variable operation unit (changeable operation unit on the touch panel) and a fixed operation unit (such as a numeric keypad that physically exists) Useful.

DESCRIPTION OF SYMBOLS 11 Upper housing | casing 12 Lower housing | casing 13 Touch panel 14 Fixed operation part 15 User's hand 15a Thumb 16 Visible information (variable operation part)
16A, 16B, 16C, 16D, 16E, 16G, 16H, 16J Icon 16M, 16P Virtual keyboard 16N Conversion candidate display unit 17 Screen display unit 18 Shape change detection sensor 19 Microcomputer 20 Numeric keypad 21 Shape change detection unit 22 Display mode switching unit DESCRIPTION OF SYMBOLS 23 Screen update part 24 Operation detection part 25 Display mode management part 26 Display mode determination part 27 Display screen creation part 27a Expansion mode screen creation part 27b Reduction mode screen creation part 28, 28B Display mode management table 29 Terminal state management part 30 Display content 31 Pointer 32 Input message display area

Claims (9)

Provided with a housing having a movable part for changing the shape to at least two types of states, a display part capable of displaying any visible information representing the operation target part, a user's finger on the display surface of the display part, etc. A portable terminal device comprising a touch sensor for detecting the contact position of
A shape detector for detecting a change in the shape of the housing;
A display control unit that automatically changes at least a display position according to a shape change of the housing detected by the shape detection unit for each visible information to be displayed on the display unit; There,
The housing includes an upper housing and a lower housing that can move relative to each other by sliding or rotating,
The display unit and the touch sensor are mounted on the upper casing,
A fixed operation unit including a plurality of buttons whose positions are physically fixed that can be operated by the user is mounted on the lower housing,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects each operation target displayed on the display unit. The mobile terminal device, wherein the display position of visible information is moved to a position close to the fixed operation unit in the entire display area of the display unit. The mobile terminal device according to claim 1,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects each operation target displayed on the display unit. Visible information is redisplayed at a destination position in a state where the size is reduced compared to a predetermined standard state. The mobile terminal device according to claim 1,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects each operation target displayed on the display unit. Of the visible information, only a part of the visible information that can be displayed is re-displayed at the position of the destination, and the visible information displayed at the destination is switched according to the input operation for scrolling the display. apparatus. The mobile terminal device according to claim 1,
When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a shape change of the housing, the display control unit detects an object on the content displayed on the display unit. A pointer indicating an operation target position for the operation target is displayed on the display unit, and visible information of the operation target to which a function for instructing movement of the display position of the pointer is assigned is displayed at a position close to the fixed operation unit. The portable terminal device characterized by this. The mobile terminal device according to claim 1,
The display control unit includes, as the set of visible information, a virtual keyboard composed of a plurality of display buttons associated with each of a plurality of characters, a candidate display unit for displaying conversion candidates for the input characters, When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a change in the shape of the housing, the virtual keyboard is displayed. The mobile terminal device is characterized in that only the candidate display unit is redisplayed at the position of the movement destination close to the fixed operation unit in the entire display area of the display unit. The mobile terminal device according to claim 1,
The display control unit has a function of displaying, on the display unit, a virtual keyboard including a plurality of display buttons associated with a plurality of characters as the set of visible information, and the shape of the housing When the shape detection unit detects that the fixed operation unit is exposed on the surface due to a change, the character assigned to each display button included in the virtual keyboard is different from a predetermined standard state. A portable terminal device that is automatically switched. The mobile terminal device according to claim 1,
An operation state detection unit for detecting the type of the application program in operation;
The display control unit automatically switches a configuration of a variable operation unit displayed on the display unit as the set of visible information according to a detection result of the operation state detection unit. Provided with a housing having a movable part for changing the shape to at least two types of states, a display part capable of displaying any visible information representing the operation target part, a user's finger on the display surface of the display part, etc. A display control method for controlling the display of a portable terminal provided with a touch sensor for detecting the contact position of
The portable terminal is
The housing includes an upper housing and a lower housing that can move relative to each other by sliding or rotating,
The display unit and the touch sensor are mounted on the upper casing,
A fixed operation unit including a plurality of buttons whose positions are physically fixed that can be operated by the user is mounted on the lower housing,
The display control method includes:
For each visible information of the operation target displayed on the display unit, at least the display position is automatically changed according to the shape change of the housing,
When it is detected that the fixed operation unit is exposed on the surface due to the shape change of the housing, the display position of each visible information of the operation target displayed on the display unit is displayed on the display unit. A display control method characterized by moving to a position close to the fixed operation unit in the entire display area. Provided with a housing having a movable part for changing the shape to at least two types of states, a display part capable of displaying any visible information representing the operation target part, a user's finger on the display surface of the display part, etc. A display control program that can be executed by a computer for controlling the display of a mobile terminal provided with a touch sensor that detects the contact position of the mobile terminal,
The housing includes an upper housing and a lower housing that can move relative to each other by sliding or rotating,
The display unit and the touch sensor are mounted on the upper casing,
A fixed operation unit including a plurality of buttons whose positions are physically fixed that can be operated by the user is mounted on the lower housing,
The display control program is
A step of automatically changing at least a display position according to a change in shape of the housing for each visible information to be displayed on the display unit, and the fixed operation unit is exposed on the surface by the change in shape of the housing When it is detected that the state has been reached, the display position of each visible information to be operated displayed on the display unit is moved to a position close to the fixed operation unit in the entire display area of the display unit. A display control program characterized by comprising steps.

Images