JP6691426B2 - Mobile terminal - Google Patents

Description

  The present invention relates to a technique of a mobile terminal device. The present invention also relates to a user interface technology for a display screen.

  2. Description of the Related Art Mobile terminal devices such as smartphones, which enable input operations by touching the display screen of a touch panel with a user's finger or the like, have become widespread. The mobile terminal device controls the display of content and the like on the display screen according to a touch input operation. The mobile terminal device acquires content information from the Internet, for example, according to an input operation and displays the content information on the display screen. At that time, if the entire content cannot be displayed on the display screen, the mobile terminal device displays a part of the display information of the content. The mobile terminal device accepts various operations such as tap, swipe, flick, and pinch as touch input operations on the display screen. For example, in the case of a swipe operation, the user touches the display screen with a finger, moves the touched screen, and then releases the finger. In the case of a flick operation, the user touches the display screen with a finger, quickly moves the finger, and then releases the finger. The mobile terminal device scrolls the display range of the content on the display screen or the like according to the touch input operation. This allows the user to browse other parts or the whole of the content on the display screen.

  Further, the mobile terminal device is provided with a screen called a basic operation screen or a home screen. For example, on the home screen, icons of a plurality of applications such as mail and browsers are arranged. In addition, a plurality of home screens may be provided. When an icon is selected on the home screen by an input operation, the application associated with the icon is executed and the application screen is displayed. When multiple applications are running, multiple application screens are provided. On the application screen, all or a part of the content or the like is displayed. The user can switch the display range such as the home screen displayed on the display screen by a touch input operation.

  Japanese Patent Application Laid-Open No. 2011-76349 (Patent Document 1) is an example of a prior art related to the user interface of the mobile terminal device as described above. Patent Document 1 describes the following as a mobile information terminal. The mobile information terminal detects the tilt of the device itself, generates tilt information indicating the direction and size of the tilt, and based on the tilt information about the tilt detected while the touch operation on the screen is maintained. Change the displayed image.

  Further, in recent years, not only a touch sensor but also a touch panel and a mobile terminal device including a pressure sensor capable of detecting a pressed state have been realized.

JP, 2011-76349, A

  However, the size of the display screen of the mobile terminal device is limited, and if the size of the content display information is large or there are many home screens, etc., a part of the content or multiple screens may be displayed in the display screen. Only a part of is the display range. When the user wants to browse a desired content or a part or the entire screen, a touch input operation such as swipe needs to be repeated many times in order to scroll the display range. Repeating touch input operation many times is troublesome and burdens the body. Further, when a large number of icons or the like are arranged on the display screen, the finger may not reach when the user searches for a desired icon or the like and touches the place. In that case, it is necessary to change the state of the hand of the terminal, operate with both hands, etc. for the purpose of the operation, which is troublesome.

  In the case of using the technique as disclosed in Patent Document 1, when the user touches the display screen of the terminal having a substantially flat plate shape in a horizontal state and tilts the display image, the display image can be scrolled. . However, the tilted state of the terminal, the state of the handle and the finger are various depending on the individual user, the situation, the intended operation, and the like. Normally, when a user holds a terminal and looks at the display screen, the vertical direction of the display screen is inclined with respect to the horizontal ground in accordance with the line of sight of the user and the state of the hand. In many cases. Therefore, with the technique as disclosed in Patent Document 1, it is not possible to appropriately cope with various states, and there is a possibility that the contents of the display screen are difficult to visually recognize, scrolling by an unintentional touch, or the like. There is room for improvement in terms of usability.

  An object of the present invention is a technology for realizing a more suitable usability, with regard to a technology of a user interface for a mobile terminal device and a display screen, by which the display range of contents and the like can be changed with little effort in response to various states of a user. Is to provide.

  A typical embodiment of the present invention is a mobile terminal device, which is characterized by having the following configuration.

  A mobile terminal device according to an embodiment is a display unit that displays information on a display screen, a pressure detection unit that detects a pressure on the display screen, and a control that changes a display range of the information displayed on the display screen. And a display control unit that performs the display control unit, wherein the display control unit displays the display in a state in which the first pressure is not held after the first pressure having a predetermined magnitude or more is detected by the pressure detection unit. Change the range.

  According to a typical embodiment of the present invention, regarding the technology of the user interface for the mobile terminal device and the display screen, it is possible to change the display range of the content or the like with a small amount of effort in response to various states of the user, A more suitable usability can be realized.

It is a figure which shows the structural outline of the portable terminal device of Embodiment 1 of this invention. FIG. 3 is a diagram showing a functional block configuration of a mobile terminal device according to the first embodiment. FIG. 3 is a diagram showing a configuration of software and the like of the mobile terminal device according to the first embodiment. FIG. 3 is a diagram showing an appearance and content display on the mobile terminal device according to the first embodiment. FIG. 4 is a diagram showing detection of a touch pressure sensor in the mobile terminal device according to the first embodiment. FIG. 3 is a diagram showing a side view of a usage state, a tilt angle, a tilting operation, and the like by a user in the mobile terminal device according to the first embodiment. FIG. 7 is a diagram showing a tilting operation and the like in the mobile terminal device according to the first embodiment as viewed from the front of the display screen. FIG. 5 is a diagram showing scroll display of contents as display range change control in the mobile terminal device of the first embodiment. FIG. 6 is a diagram showing a flow of control processing in the mobile terminal device of the first embodiment. FIG. 5 is a diagram showing a relationship between an angle and a scroll speed in the mobile terminal device according to the first embodiment. FIG. 3 is a diagram showing a case where the mobile terminal device according to the first embodiment is applied to a smart watch. It is a figure which shows operation and display control as a structure outline of the portable terminal device of Embodiment 2 of this invention. FIG. 11 is a diagram showing a flow of control processing in the mobile terminal device according to the second embodiment. FIG. 16 is a diagram showing display control of the mobile terminal device according to the first modified example of the second embodiment. FIG. 16 is a diagram showing display control of the mobile terminal device according to the second modified example of the second embodiment. FIG. 16 is a diagram showing display control of the mobile terminal device of the third modified example of the second embodiment. It is a figure which shows the 1st state of operation and display control as a structure outline of the portable terminal device of Embodiment 3 of this invention. FIG. 16 is a diagram showing a second state of operation and display control in the mobile terminal device of the third embodiment. It is a figure which shows the 3rd state in the portable terminal device of Embodiment 3. FIG. 11 is a diagram showing a change in display range in the mobile terminal device according to the third embodiment. FIG. 16 is a diagram showing a flow of control processing in the mobile terminal device of the third embodiment. It is a figure which shows the switching display of the some home screen in the portable terminal device of Embodiment 4 of this invention. FIG. 16 is a diagram showing display control in the mobile terminal device according to the fourth embodiment. FIG. 16 is a diagram showing the relationship between the pressing strength and the time interval in the mobile terminal device of the modified example of the fourth embodiment. FIG. 16 is a diagram showing an example of layer display in the mobile terminal device of the modified example of the fourth embodiment. FIG. 16 is a diagram showing an example of display information in the mobile terminal device of the modified example of the fourth embodiment. FIG. 16 is a diagram showing an example of display information in the mobile terminal device of the modified example of the fourth embodiment. FIG. 16 is a diagram showing a touch terminal position and the number of touches to be distinguished in the mobile terminal device of the modification of the fourth embodiment. FIG. 27 is a diagram showing discrimination of pressure sensors in a mobile terminal device of a modified example of the fourth embodiment. It is a figure which shows the display control of arrangement | positioning of several icons in the portable terminal device of Embodiment 5 of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In all of the drawings for explaining the embodiments, the same parts are designated by the same reference numerals in principle, and the repeated description thereof will be omitted.

(Embodiment 1)
The portable terminal device according to the first embodiment of the present invention will be described with reference to FIGS.

[Overview of configuration]
FIG. 1 shows an outline of the configuration of the mobile terminal device according to the first embodiment. FIG. 1 shows a state in which the user holds the housing 1 of the mobile terminal device with his / her left hand and touches and presses a location in the display screen 2 with his / her thumb. The mobile terminal device is in a state of being tilted with an absolute tilt angle θ with respect to the horizontal plane and the horizontal direction. On the display screen 2, a part of the entire display information 3 such as contents is displayed as a display range 4. For the sake of explanation, the X direction, the Y direction, and the Z direction are shown. The X direction and the Y direction are directions forming a plane of the housing 1, the display screen 2, the display information 3, and the like. The X direction is the horizontal direction, the horizontal direction, and the horizontal direction in the screen. The Y direction is the vertical direction in the screen, the vertical direction, and the vertical direction. The Z direction is a direction perpendicular to the X direction and the Y direction, and is the thickness direction of the housing 1 and the like.

  The mobile terminal device includes a display unit, a touch detection unit, a pressure detection unit, a tilt angle detection unit, a display control unit, and the like. The display unit displays the display information 3 such as contents on the display screen 2. The touch detection unit detects presence / absence of a touch on the display screen 2, position coordinates, and the like. The pressure detection unit detects the strength of pressure on the display screen 2 and the like. The tilt angle detection unit detects the tilt angle θ of the mobile terminal device. The display control unit controls the scrolls 5, 6 and the like as control for changing the display range 4 of the display information 3 based on the state of the pressing or the tilt angle.

  When the user wants to browse another part of the content displayed on the display screen 2 or the like, the user touches and presses a portion of the display screen 2 with, for example, a thumb in a handheld state suitable for the user. This operation is called a first pressing operation. In the first pressing operation, the user releases the finger after pressing with a certain strength or more. The pressure detection unit detects the first pressure having a predetermined magnitude or more at that time. Further, the tilt angle detection unit detects the tilt angle θ of the housing 1 during the first pressing. The display control unit shifts from the normal mode to the unique control mode based on the detection of the first press. The display control unit sets the angle θ of the tilt detected during the first pressing as the reference angle θ0. In the control mode after the first pressing operation, the finger is released from the display screen 2, the first pressing is not held, and there is no touch.

  The user performs an operation of tilting the housing 1 in the control mode. In other words, the housing 1 is rotated about a predetermined rotation axis and direction. The tilt angle detection unit similarly detects the tilt angle θn associated with the tilting operation and the rotation. The display control unit performs control to change the display range 4 on the display screen 2 in accordance with the magnitude of the difference between the tilt angle θn detected in the control mode state and the reference angle θ0. The display control unit controls the display operation of the scrolls 5 and 6 as the change control. The scrolls 5 and 6 are operations for continuously moving the display range 4 displayed on the display screen 2 vertically in the Y direction or the like.

  When a part of the desired content is displayed as the display range 4 by the operation of the scrolls 5, 6 and the like, the user touches and presses a position in the display screen 2 again. This operation is called a second pressing operation. In the second pressing operation, the user releases the finger after pressing with a certain strength or more. The press detection unit detects a second press having a predetermined magnitude or more during the second press operation. The display control unit terminates the operations of the scrolls 5, 6 and the like based on the detection of the second press, releases the control mode, and returns to the normal mode.

  Also, the user may tilt the angle θn so as to return it to a state near the initial reference angle θ0 during the control mode. In that case, the mobile terminal device suspends the scrolls 5 and 6.

  The above control is shown on the time axis at the bottom of FIG. When the first pressing operation is performed on the display screen 2 from the state of the normal mode at first, the mobile terminal device enters the control mode and sets the reference angle θ0. In the control mode, the mobile terminal device changes the display range 4 in accordance with the angle θn of the tilting operation in the state where the first pressure is not held. When the second pressing operation on the display screen 2 is performed from the control mode state, the mobile terminal device ends the change of the display range 4, cancels the control mode, and returns to the normal mode. In this way, the user can browse the desired location by changing the display range 4 of the content or the like by a simple operation.

[Mobile terminal device (1)]
FIG. 2 shows a functional block configuration of the mobile terminal device according to the first embodiment. The mobile terminal device according to the first embodiment is a smartphone. As the mobile terminal device, a smart watch, a mobile phone, a tablet PC, a PDA, a digital camera, and various other portable digital devices can be applied.

  The mobile terminal device according to the first embodiment includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 105, an operation unit 106, a vibration generation unit 107, an expansion interface unit 108, a sensor unit 110, an image processing unit 120, and It has a voice processing unit 130, a communication processing unit 140, and the like.

  The main control unit 101 is composed of a microprocessor unit or the like, and controls the entire mobile terminal device according to a program process. The system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each unit. The ROM 103 is a memory that stores basic operation programs such as OS and application programs. As the ROM 103, a rewritable ROM such as an EEPROM or a flash ROM is used. By updating the programs stored in the ROM 103, it is possible to upgrade the version of the basic operation program and the functions thereof. The RAM 104 serves as a work area during execution of the basic operation program and application programs. The storage unit 105 stores application programs and the like.

  The operation unit 106 is a unit including an input device that enables an input operation by a user, and includes operation keys. The operation keys include operation keys for turning on / off the power of the mobile terminal device and standby, an operation key for displaying a basic operation screen, and the like.

  The vibration generator 107 vibrates the mobile terminal device using an eccentric motor or the like. This allows the user to be informed of the state. The expansion interface unit 108 is an interface group for expanding the function of the mobile terminal device. The expansion interface unit 108 is composed of, for example, a USB interface, a memory interface, or the like. The USB interface connects a keyboard and other USB devices. The memory interface connects a memory card or other memory medium and transmits / receives data.

  The sensor unit 110 is a sensor group for detecting a state related to the mobile terminal device. The sensor unit 110 includes a GPS receiving unit 111, an acceleration sensor 112, a gyro sensor 113, a geomagnetic sensor 114, an illuminance sensor 115, a proximity sensor 116, and a touch pressure sensor 117. The sensor unit 110 may include other sensors.

  Using the GPS receiver 111, the position of the mobile terminal device can be detected as latitude and longitude, for example. Using the acceleration sensor 112 and the gyro sensor 113, the movement and tilt of the mobile terminal device can be detected. As the tilt, at least the tilt angle θ with respect to the horizontal plane can be detected. The direction of the mobile terminal device can be detected using the geomagnetic sensor 114. Using the illuminance sensor 115, the brightness around the mobile terminal device can be detected. Using the proximity sensor 116, it is possible to detect the proximity of the mobile terminal device to surrounding objects.

  The touch pressure sensor 117 can be used to detect the state of touching and pressing of the finger on the display screen 2 of the display unit 121. For example, the presence or absence of a touch and the touch position coordinates can be detected as the touch state. For example, the presence or absence of pressing and the strength of pressing can be detected as the pressed state. The touch pressure sensor 117 is not limited to the integrated type of the touch sensor and the pressure sensor, and the touch sensor and the pressure sensor may be provided as separate devices.

  The video processing unit 120 includes a display unit 121, a video signal processing unit 122, a first video input unit 123, and a second video input unit 124. The display unit 121 constitutes the display screen 2 and includes a display device such as a liquid crystal panel. The display unit 121 displays the video data processed by the video signal processing unit 122 on the display screen 2. The display unit 121 corresponds to the function of the touch pressure sensor 117 and may include a touch panel of a type having the touch pressure sensor 117 built therein. The video signal processing unit 122 includes a video RAM and the like, and drives the display unit 121 based on the video data input to the video RAM. The video signal processing unit 122 performs format conversion of video data, superimposition processing of menus and other OSD signals, and the like as necessary. The first video input unit 123 and the second video input unit 124 are, for example, camera units. The camera unit obtains image data of the surroundings and the object by converting the light input from the lens into an electric signal using an element such as a CCD or a CMOS sensor.

  The voice processing unit 130 includes a voice output unit 131, a voice signal processing unit 132, and a voice input unit 133. The audio output unit 131 includes a speaker and outputs the audio signal processed by the audio signal processing unit 132 as audio. The voice input unit 133 includes a microphone, converts ambient voice into voice data, and inputs the voice data.

  The communication processing unit 140 includes a LAN communication unit 141, a telephone network communication unit 142, and a short distance communication unit 143. The LAN communication unit 141 performs wireless communication connection and data transmission / reception with an access point for wireless communication. The telephone network communication unit 142 performs wireless communication connection with a base station of the mobile telephone communication network, telephone communication, and data transmission / reception. The short-range communication unit 143 corresponds to a communication interface such as BlueTooth (registered trademark) and performs short-range wireless communication with a corresponding device. Each unit of the communication processing unit 140 includes an encoding circuit, a decoding circuit, an antenna, and the like. The communication processing unit 140 may include an infrared communication unit or the like.

[Mobile terminal device (2)]
FIG. 3 shows the software configuration of the mobile terminal device according to the first embodiment, particularly the configuration of programs and data in the ROM 103, the RAM 104, and the storage unit 105. The ROM 103 stores a basic operation program 103a and other programs 103b. The RAM 104 includes a basic operation execution unit 104a, an application execution unit 104b, a temporary storage area 104c, and the like. When the basic operation program or the like is executed, data is held in the temporary storage area 104c as needed.

  The storage unit 105 has an application program 105a, various information / data storage areas 105b, and the like. The application program 105a is a program for realizing various functions such as a mail, a browser, a map, a game, and an electronic book reader. The various information / data storage area 105b stores various information and data such as setting information of the mobile terminal device and setting information for each application. The storage unit 105 includes a nonvolatile storage device such as a flash ROM, SSD, or HDD, and retains stored information even when power is not supplied to the mobile terminal device.

  The ROM 103 and the RAM 104 may be integrated with the main controller 101. As an alternative, some or all of the functions of the ROM 103 may be realized by a partial storage area of the storage unit 105.

  The main control unit 101 realizes the basic operation execution unit 104a by reading out the basic operation program 103a from the ROM 103, expanding it in the RAM 104, and executing it. The main control unit 101 realizes the application execution unit 104b by reading the application program 105a from the storage unit 105, loading it in the RAM 104, and executing it.

  The basic operation execution unit 104a includes a touch detection unit 201, a pressure detection unit 202, a tilt angle detection unit 203, a display control unit 204, and a vibration control unit 205 as each execution unit. The execution units work together.

  The touch detection unit 201 uses the touch pressure sensor 117 to perform touch detection processing. The touch detection unit 201 realizes a known function of detecting touches at a plurality of locations within the display screen 2. The touch detection unit 201 realizes a known function of detecting an operation such as tap, swipe, flick, or pinch. The pressure detection unit 202 uses the touch pressure sensor 117 to perform pressure detection processing. The pressure detection unit 202 detects the presence or absence of pressure at the touch position and the strength of the pressure.

  The tilt angle detection unit 203 uses the acceleration sensor 112 and the gyro sensor 113 to detect the tilt angle θ of the mobile terminal device. The display control unit 204 performs a process of controlling the display content of the display screen 2 according to an input operation on the display screen 2 of the display unit 121. This processing includes control processing such as scroll display operation. The vibration control unit 205 uses the vibration generation unit 107 to perform processing for causing the mobile terminal device to generate vibration.

  The OS of the mobile terminal device realized by the basic operation program 103a includes a known graphical user interface control unit. The graphical user interface control unit realizes a function of obtaining input information through a touch input operation on the display screen 2 and a function of controlling output to the display screen 2 based on a control process according to the input information.

[Appearance and content display]
FIG. 4 shows an example of the appearance of the mobile terminal device and content display on the application screen. The left side of FIG. 4 shows the configuration of the front surface of the housing 1 having the display screen 2, and the right side shows the configuration of the back surface. A display screen 2 having a substantially rectangular shape is provided on the surface of the housing 1 having a substantially flat plate shape. In the display screen 2, as the content display information 401, in this example, a partial area of the web page on the application screen by the web browser is displayed. It should be noted that texts, images, and the like in the Web page are simply illustrated by symbols such as ◯, ×, Δ, and □. Objects such as links may be included in the content. In this example, a case where a link 7 such as a URL is included between the area indicated by x and the area indicated by Δ is simply illustrated. An area 402 for displaying information such as a clock and an address is also provided in the display screen 2.

  The housing 1 includes a front camera unit 423 corresponding to the first video input unit 123, a rear camera unit 424 corresponding to the second video input unit 124, a speaker 431 of the audio output unit 131, and a microphone of the audio input unit 133. 433, etc. are provided.

  The housing 1 has a power key k1 and a home key k2 as operation keys. The power key k1 enables an input operation of turning on / off the power of the mobile terminal device and shifting / returning to a standby state. The power supply is switched on / off by pressing the power supply key k1 for a predetermined time or longer. When the power key k1 is pressed for a time shorter than a predetermined time, the standby state is entered or restored. The home key k2 enables an input operation regarding display of a home screen, which is a basic operation screen described later. By pressing the home key k2 while the application screen is displayed, the display is switched to the home screen.

  The user performs an input operation of touching the link 7 of the content in the application screen on the display screen 2 or the location of an object such as an icon in the home screen. As a result, the mobile terminal device reads and displays the content associated with the link 7, for example. The mobile terminal device executes, for example, an application associated with an icon and displays an application screen.

[Touch detection]
FIG. 5 shows detection of touch position coordinates and pressure using the touch pressure sensor 117. It has a region 500 corresponding to the display screen 2 and the touch pressure sensor 117. The area 500 is an area in which the touched and pressed states can be detected. The area 500 has position coordinates (X, Y) on a plane in the X and Y directions. The position of the point touched or pressed by the finger in the region 500 is shown as position coordinates (X1, Y1). The origin of the area 500 is the upper left position coordinate (0, 0), the width of the area 500 is Xm, and the height is Ym.

  The touch detection unit 201 uses the touch pressure sensor 117 to detect the position coordinates (X1, Y1) of the touched point in the area 500. The pressing detection unit 202 detects the strength of pressing at the point pressed by the touch using the touch pressing sensor 117. The pressing strength is Pn. In addition, the touch detection unit 201 can detect the number of touches and the touch position coordinates when a plurality of fingers are simultaneously touched in the area 500, using the touch pressure sensor 117.

  The touch detection unit 201 can detect a pinch operation or the like. In the case of a pinch operation, the user touches the display screen 2 with two fingers and widens or narrows the distance between the two fingers. The display control unit 204 controls a display operation such as enlargement or reduction of the display image size in the display screen 2 according to the detection of the state of the pinch operation.

  Note that the touch detection method and the pressure detection method are not particularly limited, and a known method can be applied. As an example, a capacitive touch pressure detection method can be applied. In this method, the capacitance change due to the proximity or pressing of a finger to the display screen is detected as a voltage value, and the touch position coordinates and the pressing strength are obtained by calculation based on the voltage value.

[Usage status, tilt angle, operation]
FIG. 6 shows a state in which the user holds the portable terminal device in his / her hand, an inclination angle of the portable terminal device, an operation of inclining the portable terminal device, and the like when the user and the housing 1 are viewed from the side. In this state, the planes corresponding to the housing 1 and the display screen 2 are inclined with respect to the horizontal plane or the vertical plane. In this tilted state, there is an absolute tilt angle θ with respect to the horizontal direction and the horizontal plane. The mobile terminal device of the first embodiment detects this angle θ and sets it as the reference angle θ0. From the state of the reference angle θ0, the user performs an operation of tilting the housing 1 for scrolling or the like.

  FIG. 7 shows a tilting operation and the like corresponding to FIG. 6 as viewed from the front of the display screen 2 with the user's line of sight. In the example of FIG. 7, a point near the center of the display screen 2 in the X and Y directions is touched. It is also assumed that that point is a reference point 601 for supporting the portable terminal device by hand. The axis of rotation during the tilting operation is the axis in the X direction and is indicated by the line 701.

  In FIGS. 6 and 7, the absolute tilt angle when the operation of further tilting with respect to the reference angle θ0 is θn. The angle θn is the angle of inclination of the display screen 2 and the content in the Y direction in this example. It has a difference value (θn-θ0) between the reference angle θ0 and the angle θn as an amount representing the angle of the relative inclination. Further, regarding the tilting operation and the tilt angle θn, the positive direction and the negative direction are shown. The positive direction is a direction in which the upper side of the display screen 2 is tilted to the front when viewed from the user when the support reference point 601 is fixed, and the negative direction is a direction in which the upper side of the display screen 2 is viewed from the user toward the back. The direction when tilting.

[Display range change control, scroll display]
FIG. 8 shows a content scroll display operation as display range change control in the mobile terminal device according to the first embodiment. The application screen in the display screen 2 includes an area 801 in which the content 800 can be displayed. In the area 801, a part of the display information 3 of the content 800 is displayed as the display range 4. The content 800 is an example of a Web page, and actual data is composed of HTML or the like. The display information 3 shows a case where a link 7 is included between areas such as text and images. The display information 3 is changed by the application according to the size of the area 801 and the like.

  The entire size of the display information 3 of the content 800, that is, the standard size when there is no enlargement / reduction, is larger than the size of the area 801. Therefore, the entire display information 3 cannot be displayed in the area 801. Therefore, in the area 801, a part of the display information 3 is displayed as the display range 4. The display range 4 is a range when the display information 3 of the content 800 is displayed in the area 801 of the display screen 2. In the present example, the display range 4 indicates the case of an area in the middle of the Web page, and includes a part of the area indicated by x, a part of the area indicated by the link 7, and Δ.

  When the user wants to browse another part of the content 800 that is not displayed from the state of the display range 4 displayed in the area 801, conventionally, the user scrolls by swiping or flicking. In this example, a case where scrolling up or down in the Y direction is possible is shown. Conventionally, when it is desired to browse the large-sized content 800, it is necessary to repeat operations such as swipe many times, which is troublesome.

  On the other hand, in the first embodiment, the display range 4 can be scrolled by the user performing the first pressing operation on the area 801 of the display screen 2 to incline the housing 1. That is, the display range 4 of the display information 3 can be changed. The scroll 5 is a first-direction scroll and indicates the top of the content 800 or a relatively upward scroll. In the scroll 5, the display range 4 is moved upward, and a part of the content 800 in the upward direction is displayed in the area 801. The scroll 6 is a second-direction scroll, and indicates scrolling toward the end or relatively downward in the content 800. In the scroll 6, the display range 4 is moved downward, and a part of the content 800 in the downward direction is displayed in the area 801. In the area 801 of the display screen 2, the image portion moves in the direction opposite to the scroll direction.

[Display control]
The display control in the mobile terminal device according to the first embodiment is as follows. When displaying content on the application screen of the display screen 2, the display control unit 204 of the mobile terminal device accepts a specific touch pressing operation and an operation of tilting the housing 1 by the user, and scrolls the display range 4. Perform range change control.

  It is assumed that the user is initially in the handheld state as shown in FIG. 6 and is browsing a part of the content 800 as the display range 4 as shown in FIG. When the user wants to browse another part of the content 800 from that state, first, as shown in FIG. 1, the user first performs a first pressing operation on the area 801 of the display screen 2. At this time, the user releases the finger after pressing with a certain strength or more. The portable terminal device shifts to the control mode when the pressing strength Pn is the first pressing with a predetermined magnitude or more. The mobile terminal device detects the angle θ at the time of detecting the first press and sets it as the reference angle θ0. The reference angle θ0 is an angle temporarily set for control. The angle θ may be detected within a predetermined time from the time point when the first pressure is detected.

  The user performs an operation of tilting the housing 1 in a desired direction with the finger released from the display screen 2 after the first pressing operation. For example, when the user wants the scroll 5 to move upward, the user inclines in the negative direction. The mobile terminal device detects the angle θn corresponding to the tilting operation, and detects the difference value (θn−θ0) which is the amount of the relative tilt angle. The mobile terminal device determines whether or not to scroll and the scrolling direction, speed, and the like using the first pressing strength Pn and the difference value (θn−θ0). The mobile terminal device performs control so that different scroll display operations are performed according to the direction and size indicated by the difference value (θn−θ0). This scroll display operation changes the display range 4 in the area 801 of the display screen 2.

  When the desired display range 4 is displayed in the area 801 by scrolling, the user can temporarily stop scrolling by returning the tilt of the housing 1 to a state close to the initial reference angle θ0. Further, the user can resume scrolling by inclining from that state.

  The user can return to the normal mode by the second pressing operation in the state of the desired display range 4. The mobile terminal device detects the second press at the time of the second press operation, ends the change of the display range 4 by scrolling at that time, cancels the control mode, and returns to the normal mode. The user can browse a part of the content 800 corresponding to the display range 4 at the time of the cancellation.

  Also, the user may select an object such as the link 7 within the desired display range 4 by touching it before the second pressing operation. In this case, the mobile terminal device performs the process of executing the object, for example, the process of reading and displaying the content of the link 7, and releases the control mode.

[Control flow]
FIG. 9 shows a flow of control processing for realizing the display range changing control in the first embodiment. The basic operation execution unit 104a, particularly the display control unit 204 executes the process of the flow of FIG. It should be noted that there are a first mode, a second mode, and a third mode as modes that are control states for realizing this flow. The management value of each mode is 0, 1, 2. Mode = 0 (first mode) indicates the initial state. Mode = 1 (second mode) indicates a state with a touch or the like. Mode = 2 (third mode) indicates a state where the first pressure is applied and the like. FIG. 9 includes steps S101 to S126. The steps will be described below in order.

  (S101) The display control unit 204 reads the content selected by the user. The display control unit 204 initially sets the mode to mode = 0 (first mode).

  (S102) The display control unit 204 first displays the top of the content, for example, the area 821 in FIG. 8 on the display screen 2. Note that such a display position is determined according to the application and the content.

  (S103) The mobile terminal device receives an input operation by the user through the operation unit 106 and the touch pressure sensor 117 and acquires input information corresponding to the input operation. The display control unit 204 acquires the touch input information via the touch detection unit 201. At that time, the touch detection unit 201 detects the presence or absence of a touch and the touch position coordinates (X1, Y1). Further, the pressure detection unit 202 detects the presence or absence of pressure and the strength Pn of pressure.

  (S104) The display control unit 204 branches the process depending on the presence / absence of a touch based on the input information. If there is a touch (Y), proceed to S105, and if there is no touch (N), proceed to S117.

  (S105) The display control unit 204 acquires information including the touch position coordinates (X1, Y1) from the touch detection unit 201.

  (S106) Further, the display control unit 204 acquires, from the pressure detection unit 202, information including the pressure intensity Pn at the touch position corresponding to the touch position coordinates in S105.

  (S107) The display control unit 204 confirms whether or not the current mode is mode = 2 (third mode), and branches. If mode = 2, the process proceeds to S108, and if not, the process proceeds to S110.

  (S108) The display control unit 204 compares the pressing strength Pn acquired in S106 with a predetermined threshold Pt, determines whether the strength Pn is equal to or greater than the threshold Pt, and branches. If Pn ≧ Pt, the process proceeds to S109, and if Pn <Pt, the process returns to S103.

  (S109) The display control unit 204 sets the mode to mode = 0 (first mode), and returns to S103. The flow of S107 and S109 corresponds to cancellation of the control mode by the second pressing operation.

  (S110) On the other hand, in S110, the display control unit 204 compares the pressing strength Pn acquired in S106 with a predetermined threshold Pt, determines whether the strength Pn is equal to or greater than the threshold Pt, and branches. I do. If Pn ≧ Pt, the process proceeds to S113, and if Pn <Pt, the process proceeds to S111.

  (S111) The display control unit 204 stores and holds the touch position coordinates (X1, Y1) acquired in S105 in the memory.

  (S112) The display control unit 204 sets the mode to mode = 1 (second mode), and returns to S103.

  (S113) On the other hand, in S113, the display control unit 204 causes the tilt angle detection unit 203 to acquire the tilt angle θ of the mobile terminal device.

  (S114) The display control unit 204 sets the angle θ acquired in S113 as the reference angle θ0. The flow of S107, S110, S114, etc. corresponds to the control during the first pressing operation.

  (S115) The display control unit 204 stores and holds the reference angle θ0 in the memory.

  (S116) The display control unit 204 sets the mode to mode = 2 (third mode), and returns to S103.

  (S117) On the other hand, when there is no touch in S104, the display control unit 204 confirms the current mode and branches in S117. When mode = 0, the process returns to S103, when mode = 1, the process proceeds to S118, and when mode = 2, the process proceeds to S121.

  (S118) The display control unit 204 determines the touch position coordinates (X1, Y1) stored in S111 as the touch position on the display screen 2 and the position of the object such as the link 7 in the display information 3 on the display screen 2. To compare. The display control unit 204 branches depending on whether or not their positions match. If they match, that is, if the user's touch position corresponds to the link 7 or the like, the process proceeds to S120, and if they do not match, the process proceeds to S119.

  (S119) The display control unit 204 sets the mode to mode = 0 (first mode), and returns to S103.

  (S120) The display control unit 204 executes processing associated with the object. For example, the display control unit 204 acquires the content specified by the URL of the link 7 from a server on the Internet, reads the content, and displays the content on the display screen 2. In this case, the mobile terminal device exits the loop of this flow as indicated by A1 and performs the same processing on the new content from the beginning of this flow.

  (S121) On the other hand, in S121, the tilt angle detection unit 203 detects the tilt angle θn of the mobile terminal device. The display control unit 204 acquires information including the angle θn from the tilt angle detection unit 203.

  (S122) The display control unit 204 compares the absolute value | θn−θ0 | of the difference value between the angle θn and the reference angle θ0 with a predetermined threshold θt, determines whether the absolute value | θn−θ0 | is equal to or more than the threshold θt, and branches. I do. If | θn−θ0 | ≧ θt, the process proceeds to S123, and if | θn−θ0 | <θt, the process returns to S103. It should be noted that when the difference value is 0 or almost 0, it means that the state of the reference angle θ0 has not changed. When the absolute value | θn−θ0 | is within the range smaller than the threshold value θt, scrolling is not caused. Therefore, by setting the threshold value θt, it is possible to prevent scrolling when the tilt angle slightly changes without the user's intention.

  (S123) The display control unit 204 uses the angle θn acquired in S121 and the like to set the scroll speed Sn to be used for the scroll display operation according to the formula (1) below.

Sn = S0 × | θn−θ0 | / θt (1)
The predetermined reference scroll speed is S0. The reference scroll speed S0 may be a fixed set value for mounting or a set value that can be variably set by the user. In the formula (1), the scroll speed Sn is increased by multiplying the reference scroll speed S0 by multiplying according to the magnitude of the absolute value of the difference between the threshold value θt and the angle θn (| θn−θ0 | / θt). It is determined. That is, the larger the angle θn with respect to the reference angle θ0, the larger the scroll speed Sn can be. The setting of S123 is also shown in FIG. 10 described later.

  (S124) Next, the display control unit 204 performs branching according to the magnitude relationship between the angle θn and the reference angle θ0, in other words, the sign of the difference value (θn−θ0). If the angle θn is larger than the reference angle θ0 (θn> θ0), the process proceeds to S125, and if it is smaller (θn <θ0), the process proceeds to S126.

  (S125) The display control unit 204 performs the downward scroll process for causing the scroll 6 in FIG. 8 to be performed using the scroll speed Sn set in S123, corresponding to the tilt in the positive direction, and then returns to S103.

  (S126) The display control unit 204 performs the upward scroll process for causing the scroll 5 of FIG. 8 to be performed using the scroll speed Sn set in S123, corresponding to the inclination in the negative direction, and then returns to S103.

  The flow of S104, S117, S125, etc. corresponds to the change of the display range 4 during the control mode. In this flow, the process is repeated every predetermined time in a loop, and the scrolling process in S125 or the like corresponds to scrolling for moving a predetermined distance in a predetermined time. By continuing the processing of S125 and the like many times by the loop, long-distance continuous scrolling is also realized.

[Scroll speed setting]
FIG. 10 shows the relationship between the absolute value | θn−θ0 | of the difference between the tilt angles θ and the scroll speed Sn regarding the setting of the scroll speed Sn in step S123 of FIG. The abscissa represents the absolute value | θn−θ0 |, and indicates the values of the thresholds θt, 2 × θt, and 3 × θt, for example. The vertical axis represents the scroll speed Sn, and indicates the values of the reference scroll speed S0, 2 × S0, 3 × S0, for example. A straight line 1001 indicates a function corresponding to the expression (1), and the scroll speed Sn linearly increases according to the absolute value | θn−θ0 |.

[Effects, etc.]
As described above, according to the mobile terminal device of the first embodiment, it is possible to change the display range of the content and the like with a small amount of work in response to various states of the user, and it is possible to realize more suitable usability. The mobile terminal device changes the display range 4 of the content by the scroll display control using the pressing strength Pn and the inclination angle θn. The user sets the housing 1 of the mobile terminal device in a hand-held state suitable for himself or the situation, for example, a state where he or she naturally holds it with one hand. The user can set the state as the reference angle θ0 by the first pressing operation at a desired time. The user can scroll and change the display range 4 by directly tilting the housing 1 in a desired direction. Then, the user can cancel the state by the second pressing operation at a desired time. The user can quickly browse the desired display range 4 with a simple operation without having to repeat the touch operation many times. The user can move a desired distance by scrolling with one operation.

  Since the control mode is entered by setting the first press of a predetermined magnitude or more as a trigger and the reference angle θ0 is set, it is possible to prevent accidental scrolling when a touch is unintentionally made by the user. The user can also adjust the scroll speed Sn and the like according to the angle θn and the like. The user can also quickly select the link 7 or the like in conjunction with scrolling.

  Further, the mobile terminal device according to the first embodiment can be preferably applied to a device such as a smart watch having a relatively small display screen size. When the size of the display screen is relatively small, when the display screen is touched and pressed with a finger, a part of the display screen is hidden by the finger, which is difficult for the user to visually recognize, and the usability may not be good. . On the other hand, in the mobile terminal device according to the first embodiment, even when the size of the display screen 2 is relatively small, the user can scroll once while pressing the finger once and releasing the finger, and the display information can be visually recognized. Cheap.

  FIG. 11 shows a pressing operation and the like on the display screen 2 in the case of a smart watch as the mobile terminal device of the first embodiment. It shows a state in which a part of the display screen 2 is touched and pressed with one finger of the right hand while the smart watch is attached to the left wrist. The case where the display screen 2 is circular and the size of the display screen 2 is about the wrist width is shown. At the time of the first pressing operation, part of the display screen 2 is temporarily hidden. In the state of the control mode after the finger is released by the first pressing operation, the entire display screen 2 can be visually recognized. The user can scroll while looking at the entire display screen 2 by tilting his wrist or the like, and can easily obtain the desired display range 4.

[Modification (1)]
The following are possible modifications of the first embodiment. In the first embodiment, as shown in FIG. 1 and the like, the case where the scroll display operation in the Y direction is controlled using the angle θ of inclination of the display screen 2 and the content in the Y direction has been described, but the present invention is not limited to this. is there. A mode in which the scroll display operation in the X direction is controlled using the display screen 2 and the angle of inclination of the content with respect to the X direction is also possible. FIG. 7 shows an operation of tilting the tilt angle φn in the X direction. It is also possible to control the scroll display operation in all directions including up, down, left and right by simultaneously executing both the Y direction control and the X direction control. Such control in each direction may be a fixed application on implementation, an application selectable according to user settings, or an application selected according to an application, content, or the like. For example, omnidirectional control may be applied in the case of an application that displays a content that has a relatively large size, such as a photographic image or a map, and that can be enlarged or reduced.

  In the first embodiment, as the control correspondence, the downward scroll is used for the positive tilt, and the upward scroll is used for the negative tilt, but the opposite correspondence may be used. Further, the scroll display operation of the first embodiment is an operation of continuously changing the display range 4, for example, an operation of smoothly moving in pixel units, but the present invention is not limited to this and is applicable. For example, it is possible to apply an operation of intermittently scrolling for each fixed area or distance.

[Modification (2)]
As the content that is the target information of the display range change control, not only a Web page or the like but also various kinds such as a photographic image can be applied. The display operation for changing the display range is not limited to scrolling, and enlarging / reducing can be applied. When applied to enlargement / reduction, the correspondence relationship may be, for example, enlargement processing when the inclination angle is in the positive direction and reduction processing when the inclination angle is in the negative direction.

  For example, assume that the mobile terminal device is a digital camera and the target information is a plurality of photographic images. In the device, in the normal mode, a plurality of photographic images or one selected photographic image is displayed on the display screen. In that state, the photographic image can be scrolled by a swipe operation or the like, and the photographic image can be enlarged / reduced by a pinch operation or the like. When the size of the photographic image is large or the image is enlarged, a part of the photographic image is displayed on the display screen 2. The device enters the control mode from the normal mode in response to the first pressing operation. In the display of the control mode, the photographic image can be scrolled or enlarged / reduced according to the tilt angle, and the control mode returns to the normal mode display in response to the second pressing operation.

  In particular, as a photographic image, it can be applied to a panoramic image or a celestial sphere image, which has a large size and angle of view and cannot be displayed all at once. By the operation in the control mode, it is possible to easily change a part of the entire panorama image or the whole celestial sphere image as a display range corresponding to the line-of-sight direction. The user can suitably browse the desired part or the whole of the photographic image.

[Modification (3)]
In step S123 of FIG. 9, it is determined that the scroll speed Sn is linearly changed according to the absolute value | θn−θ0 |, like the function of the straight line 1001 of FIG. 10, but the invention is not limited to this. For example, the function 1002 in FIG. 10 may be determined by a stepwise function. In this function 1002, the scroll speed Sn is determined to be a constant value according to the division of the range of the absolute value | θn−θ0 |. Further, a scroll speed Sn may be determined within a range from the lower limit value to the upper limit value by applying a function including a predetermined upper limit value and a lower limit value. Further, not only a linear function but also a non-linear function may be applied.

  Further, the scroll speed Sn may be set to a constant value regardless of the angle θn, or may be variably set by user setting. As the user setting means, for example, an item for displaying a user setting screen or the like on the display screen 2 and setting the scroll speed Sn or the like may be provided. The threshold value Pt and the threshold value θt in FIG. 9 may be fixed setting values in mounting, or may be set by the user. In the case of the user-configurable mode, the user can set suitable settings that are easy for the user to operate.

[Modification (4)]
At the time of shifting to the control mode according to the first pressing operation, predetermined information indicating the state of the control mode may be displayed in the display screen 2. This is not limited to display, and may be predetermined voice output or vibration generation. Further, when the control mode is released by the second pressing operation, the display of the predetermined information may be erased or another predetermined output may be performed.

  Further, when determining the first pressing and shifting to the control mode, the determination may be further made based on the touch duration time or the like. That is, the control mode may be shifted to when the duration of the touched state when the pressing force of a predetermined amount or more is continued is a predetermined threshold value or more.

[Modification (5)]
In the first embodiment, basically, the information of the pressing strength Pn is used for the determination of the first pressing operation and the second pressing operation and the control mode switching. Further, as a modification, the pressing strength Pn may be used when determining the scroll speed and the like. For example, the reference scroll speed S0 in step S123 of FIG. 9 is determined using the first pressing strength Pn. For example, the reference scroll speed S0 is set to increase as the strength Pn increases. Then, the scroll speed Sn is calculated using the reference scroll speed S0. That is, the scroll speed Sn is determined by reflecting information on both the strength Pn and the angle θn. Further, the scroll speed Sn may be determined using the first pressing strength Pn, and the angle θn may be used only for determining the scroll direction.

[Modification (6)]
In the first embodiment, during the control mode from the first pressing operation to the second pressing operation, the first pressing is not held, and basically there is no touch. As a modified example, similarly to Embodiment 2 and the like which will be described later, during the control mode, the state where the first pressure is not held and the state where the touch is maintained may be maintained. That is, in the modified example, after the first pressing is detected by the first pressing operation, the pressing is weakened and the finger is kept touched without being released. In the control mode, the display range is changed according to the angle of inclination, and the touch position can be changed arbitrarily. Then, the control mode is released in response to the detection of the second pressing of the second pressing operation.

  Further, in the first embodiment, the temporary stop of scrolling is realized by returning the angle θn to the vicinity of the reference angle θ0. As a modified example, temporary suspension of scrolling may be realized as follows. After the first pressing operation, scrolling is automatically performed according to the angle θn without touching. When the user wants to pause scrolling midway, the user lightly touches the inside of the display screen 2 to maintain the touched state. The mobile terminal device suspends scrolling while detecting the touched state. The user releases the finger when he wants to resume scrolling. The mobile terminal device restarts scrolling in response to the detection of the non-touch state. Then, the control mode is released in response to the detection of the second pressing of the second pressing operation.

(Embodiment 2)
A mobile terminal device according to the second embodiment of the present invention will be described with reference to FIGS. The basic configuration of the second embodiment and the like is the same as that of the first embodiment, and the configuration parts of the second embodiment different from those of the first embodiment will be described below. In the second embodiment, similar to the first embodiment, the case where the target information is the content display information is shown, and the case where the display operation of the display range change control is the Y-direction scroll is shown.

[Overview of configuration]
FIG. 12 shows the appearance, operation, display control, etc., as a configuration outline of the second embodiment. The left side of FIG. 12 shows a state where the location of the content display information 1201 in the display screen 2 is first pressed. The user performs a first pressing operation on a portion of the display screen 2 with a predetermined pressing force or more. This first pressing operation is different from the first pressing operation of the first embodiment in that after the first pressing of a predetermined magnitude or more, the pressing is weakened and the finger remains in contact, that is, the touch is maintained. is there. During the control mode, the first pressure is not maintained. The mobile terminal device treats the first position corresponding to the touch position coordinates of the first pressing operation as the reference position. The mobile terminal device enters the control mode from the normal mode by using the first pressing operation as a trigger.

  The right side of FIG. 12 shows the state when the control mode is entered. The mobile terminal device displays the direction selection icon J1 for scroll control with the first position as the reference position. The direction selection icon J1 is a control object that enables selection of the scroll direction and the like. The direction selection icon J1 includes an upward area e1, a downward area e2, and a central stop area e0 between them. Initially, the direction selection icon J1 is displayed in a state in which the central stop area e0 is arranged within a predetermined range with respect to the first position corresponding to the touch position of the finger tip of the first pressing operation. In other words, the direction selection icon J1 is arranged so that the first position is included in the central stop area e0. In this state, scrolling has not started yet.

  The user selects a desired area in the direction selection icon J1 by a slide operation of moving the finger on the direction selection icon J1 while maintaining the presence of the touch after the first pressing operation. The user can select the upward scroll by placing the tip of the finger in the upper area e1 and can select the downward scroll by placing the tip of the finger in the lower area e2. When the upward area e1 is selected, the mobile terminal device performs upward scrolling similarly to the scroll 5 of FIG. 8 of the first embodiment. When the downward area e2 is selected, the mobile terminal device performs downward scrolling similarly to the scroll 6.

  In addition, the user can select temporary suspension of scrolling by selecting to place the finger on the central stop area e0. When the central stop area e0 is selected, the mobile terminal device suspends the upward or downward scrolling. For example, the user selects the upward area e1 from the state of the first central stop area e0 to scroll upward. When the state of the desired display range 4 is reached, the user returns the position of the finger to the central stop area e0 and stops the upward scroll. Also, the user selects the downward area e2 from that state to scroll downward, and when the state of the desired display range 4 is reached, the position of the finger is returned to the central stop area e0 and the downward scroll is stopped. Let

  The mobile terminal device releases the control mode and returns to the normal mode when the user detects a state in which the user has removed the finger from the direction selection icon J1, that is, a non-touch state. With the cancellation, the mobile terminal device ends the scrolling in the state of the display range 4 at that time, and also hides the direction selection icon J1.

  Further, in the control mode, when the user moves the finger to the position of the link 7 and releases the finger, the mobile terminal device selects the link 7 to execute the corresponding process and release the control mode.

  Further, the mobile terminal device determines the scroll speed according to the strength Pn of the first pressing of the first pressing operation. In addition, the mobile terminal device variably determines the scroll speed according to the strength of pressing when selecting the upward area e1 or the downward area e2 of the direction selection icon J1.

[Control flow]
FIG. 13 shows a flow of control processing of the display control unit 204 according to the second embodiment. There are first to third modes as modes, and management values are 0, 1, and 2. The modes are independent in each embodiment and have different meanings. Specific values such as the threshold value are different in each embodiment. FIG. 13 has steps S201 to S222. The steps will be described below in order.

  (S201 to S206) The processing of S201 to S206 is the same as the processing of the first embodiment. In S201, the display control unit 204 reads the content selected by the user. The display control unit 204 initially sets the mode to mode = 0 (first mode). In S202, the display control unit 204 first displays the top of the content on the display screen 2. In S203, the mobile terminal device receives an input operation by the user through the operation unit 106 and the touch pressure sensor 117, and acquires input information corresponding to the input operation. The display control unit 204 acquires the touch input information via the touch detection unit 201. At that time, the touch detection unit 201 detects the presence or absence of a touch and the touch position coordinates (X1, Y1). Further, the pressure detection unit 202 detects the presence or absence of pressure and the strength Pn of pressure.

  In S204, the display control unit 204 branches the process based on the presence / absence of a touch based on the input information. When there is a touch (Y), the process proceeds to S205, and when there is no touch (N), the process proceeds to S218. In S205, the display control unit 204 acquires information including the touch position coordinates (X1, Y1) from the touch detection unit 201. In S206, the display control unit 204 acquires information including the pressing strength Pn at the touch position from the pressing detection unit 202.

  (S207) The display control unit 204 confirms whether the current mode is mode = 2 (third mode), and branches. If mode = 2, the process proceeds to S213, and if not, the process proceeds to S208.

  (S208) The display control unit 204 compares the pressing strength Pn acquired in S206 with the threshold Pt, determines whether the strength Pn is equal to or greater than the threshold Pt, and branches. If Pn ≧ Pt, the process proceeds to S209, and if Pn <Pt, the process proceeds to S211.

  (S209) The display control unit 204 displays the direction selection icon J1 as shown in FIG. At this time, the display control unit 204 displays the direction selection icon J1 in a state where the central stop area e0 is arranged at a position within a predetermined range with respect to the touch position coordinates (X1, Y1) acquired in S205.

  (S210) The display control unit 204 sets the mode to mode = 2 (third mode), and returns to S203.

  (S211) On the other hand, in S211, the display control unit 204 stores and holds the touch position coordinates (X1, Y1) in the memory.

  (S212) The display control unit 204 sets the mode to mode = 1 (second mode), and returns to S203.

  (S213) On the other hand, in the case of mode = 2 in S207, in S213, the display control unit 204 determines whether or not the touch position coordinates (X1, Y1) acquired in S205 are within the area of the direction selection icon J1, Make a branch. If it is within the area of the direction selection icon J1, the processing proceeds to S214, and if it is outside the area, the processing returns to S203.

  (S214) The display control unit 204 sets the scroll speed Sn based on the following equation (2) using the pressing intensity Pn acquired in S206.

Sn = S0 × Pn / Pt (2)
In the equation (2), the scroll speed Sn is determined so that the reference scroll speed S0 is increased by multiplication in accordance with the magnitude (Pn / Pt) of the pressing strength Pn with respect to the threshold value Pt. That is, the scroll speed Sn increases as the strength Pn increases.

  (S215) The display control unit 204 determines which area in the direction selection icon J1 the touch position coordinate (X1, Y1) acquired in S205 corresponds to, and branches. That is, it is determined whether the touch position is in the upper area e1, the lower area e2, or the central stop area e0. If it corresponds to the upward region e1, the process proceeds to S216, if it corresponds to the downward region e2, the process proceeds to S217, and if it corresponds to the central stop region e0, the process returns to S203.

  When the touch position is in the central stop area e0, the scroll processing of S216 and the like is not executed, so that the scroll is temporarily stopped for a predetermined time.

  (S216) The display control unit 204 performs the upward scroll process at the scroll speed Sn set in S214 according to the selection of the upward area e1, and returns to S203. In this process, the scroll 5 that continuously moves a predetermined distance for a predetermined time according to the scroll speed Sn is performed.

  (S217) The display control unit 204 performs the downward scroll process at the scroll speed Sn set in S214 according to the selection of the downward region e2, and returns to S203. In this process, the scroll 6 that continuously moves a predetermined distance for a predetermined time according to the scroll speed Sn is performed.

  (S218) On the other hand, if there is no touch in S204, the display control unit 204 confirms the current mode and branches in S218. When mode = 0 (first mode), the process returns to S203, when mode = 1 (second mode), the process proceeds to S219, and when mode = 2 (third mode), the process proceeds to S221.

  (S219) The display control unit 204 determines the touch position coordinates (X1, Y1) stored in S211 as the touch position on the display screen 2 and the position of the object such as the link 7 in the display information 3 on the display screen 2. To compare. The display control unit 204 branches depending on whether or not their positions match. If they match, the process proceeds to S220, and if they do not match, the process proceeds to S222.

  (S220) The display control unit 204 executes a process associated with the selected object. For example, the display control unit 204 acquires the content specified by the URL of the link 7 from a server on the Internet, reads the content, and displays the content on the display screen 2. In this case, the mobile terminal device exits the loop of this flow as indicated by A2 and performs the same processing from the beginning of this flow on the new content.

  (S221) On the other hand, in S221, the display control unit 204 hides the direction selection icon J1.

  (S222) The display control unit 204 sets the mode to mode = 0 (first mode), and returns to S203.

[Effects, etc.]
As described above, according to the mobile terminal device of the second embodiment, it is possible to change the display range with a small amount of labor, without repeating the touch operation many times, as in the first embodiment. The user can quickly scroll the content display information to a desired state by operating one hand and one finger. The user can adjust the scroll speed according to the strength of pressing. In the second embodiment, a part of the display screen 2 is hidden by the direction selection icon J1, but the user can clearly recognize the scrollable direction and the like.

[Modification (1)]
The following are possible modifications of the second embodiment. In the second embodiment, the direction selection icon J1 including the upper and lower regions in the Y direction is displayed to perform the Y direction scrolling display control, but the present invention is not limited to this.

  FIG. 14 shows a case where display control of X-direction scroll is performed as a first modification. As the target information, for example, the case of content display information 1401 such as an electronic book including a vertically written sentence is shown. The mobile terminal device displays the direction selection icon J2 including the left and right regions in the X direction in response to the first pressing operation. The direction selection icon J2 has a leftward area e3, a central stop area e0, and a rightward area e4. The mobile terminal device uses the direction selection icon J2 to control left and right scrolling in the X direction.

  As a second modification, FIG. 15 shows a case where scroll display control in both the Y direction and the X direction is performed. As the target information, for example, the case of map information 1501 having a relatively large size is shown. The mobile terminal device displays the direction selection icon J3 in response to the first pressing operation. The direction selection icon J3 has four directional areas (up, down, left and right) and a central stop area. The mobile terminal device controls scrolling in each of the up, down, left, and right directions according to the selection of the direction area.

  Further, for example, when the beginning of the content in the Y direction is the display range 4, scrolling upward is invalid. As another modified example, in the display of the direction selection icon, the display state may be controlled in detail by hiding the direction area corresponding to the direction in which scrolling is disabled or making the selection impossible.

  FIG. 16 shows, as a third modification, a mode in which the central stop area e0 is not provided in the direction selection icon. The mobile terminal device displays the direction selection icon J4 according to the first pressing operation. The direction selection icon J4 has an upper area e1 in the upper half and a lower area e2 in the lower half of the circle. Depending on those areas, you can select scroll up or scroll down. In addition, when the user moves his / her finger inside the direction selection icon J4 to a position outside the direction selection icon J4, the mobile terminal device suspends scrolling. Further, when the user releases the finger from inside or outside the direction selection icon J4, the mobile terminal device releases the control mode. As another modification, when the finger moves outside the direction selection icon J4, the control mode may be released without pausing the scrolling.

[Modification (2)]
As a modified example, similarly to the first embodiment, the control mode switching may be performed using the first pressing operation and the second pressing operation. In this modification, the first pressing operation on the display screen 2 enters the control mode to display the direction selection icon, and the second pressing operation releases the control mode to hide the direction selection icon. The second pressing operation may be a second pressing particularly in the central stop area e0 or a second pressing outside the direction selection icon. The touched state may not be maintained during this control mode. The user can select a desired scroll direction or the like by touching the direction selection icon after releasing the finger by the first pressing operation. Also, during this control mode, the user can select by touching the link 7.

[Modification (3)]
In the second embodiment, the information on the pressing strength Pn is used when determining the first pressing operation and setting the scroll speed Sn. The present invention is not limited to this, and as a modified example, information on the pressing strength Pn may be used as a variable for other control. For example, when setting the scroll speed Sn in step S214 of FIG. 13, a fixed value, for example, the reference scroll speed S0 may be used. Further, during the control mode, the pressing strength Pn or the like of the upper area e1 or the lower area e2 is detected. Then, the mobile terminal device variably determines the scroll speed Sn in that direction by using the pressing strength Pn of the area. The user moves the finger to, for example, the upward area e1 and presses it with a desired strength. The mobile terminal device determines the scroll speed Sn so as to increase it with respect to the reference scroll speed S0 in accordance with the pressing strength Pn of the upward area e1. That is, as the upward area e1 is pressed down more strongly, higher-speed upward scrolling is realized.

  Further, the mobile terminal device may detect the pressing strength Pn of the central stop area e0 and control the enlargement / reduction display operation. When the user wants to temporarily stop scrolling in the central stop area e0 and enlarges the image at that position, the user presses the central stop area e0 with a desired strength. The mobile terminal device controls the enlargement / reduction of the image according to the pressing strength Pn of the central stop area e0 and the touch position. The mobile terminal device enlarges and displays the map image in accordance with the magnitude of the strength Pn with the touch position as the center, for example. In addition, the mobile terminal device displays the reduced size as the strength Pn decreases. The user can release the control mode in that state by removing the finger from the central stop area e0 in a state where the image has a desired size.

(Embodiment 3)
A mobile terminal device according to the third embodiment of the present invention will be described with reference to FIGS. Hereinafter, components of the third embodiment different from those of the second embodiment will be described. In the third embodiment, the case where the target information is map information is shown, and the case where the display operation of the display range change control is scrolling in an arbitrary direction within a plane in the X direction and the Y direction is shown.

[Overview of configuration]
FIG. 17 shows operations, display control, etc. as a configuration outline of the third embodiment. FIG. 17 shows a case where the display screen 2 is touch-pressed with the thumb while the case 1 is held by the left hand. The state of FIG. 17 is referred to as a first state. The user touches and presses a desired portion of the map information 1701 on the display screen 2. This operation is called a first pressing operation. This first pressing operation is an operation for maintaining the presence of touch without weakening the pressing and releasing the finger after detecting the first pressing having a predetermined magnitude or more. During the control mode after the first pressing operation, the first pressing is not held. The touch position coordinates (X1, Y1) at the time of the first pressing operation are represented as the first position LA and LA = (Xa, Ya). The mobile terminal device sets the first position LA as the reference position Lr in response to the detection of the first press. Expressed as Lr = (Xr, Yr).

  The mobile terminal device enters the control mode from the normal mode in response to the first pressing operation, sets the reference position Lr, and displays the predetermined reference point icon C1 at the reference position Lr. In other words, the reference point icon C1 is the first position icon. In this example, the reference point icon C1 is a sun mark.

  FIG. 18 shows a second state which is a transition from the first state of FIG. The user performs a slide operation of moving the finger to a desired position while maintaining the presence of the touch from the first state where the finger is touched at the reference position Lr. The touch position after moving the finger by this operation is referred to as the second position LB. It is represented as LB = (Xb, Yb).

  The distance between two points of the reference position Lr, which is the first position LA, and the second position LB is Dn. Further, the direction from the reference position Lr to the second position LB is V1. The mobile terminal device recognizes the second position LB, the distance Dn, the direction V1, and the like. The reference point icon C1 remains displayed during the control mode. The user can recognize the magnitude and the direction V1 of the distance Dn between the two points of the first position LA and the second position LB based on the reference point icon C1.

  As a modification, the reference point icon C1 and the like may not be displayed at the first position LA. Further, a mode in which a predetermined second position icon is displayed at the second position LB may be used. It is also possible to display both the reference point icon C1 and the second position icon.

  FIG. 19 shows a third state which is a state transitioned from the second state of FIG. The mobile terminal device grasps the positional relationship between the reference position Lr and the second position LB in the change from the first state to the second state, and based on the positional relationship, whether or not to scroll, its direction, and speed. Etc. In the third state of FIG. 19, the scroll 191 is performed in the direction V1 corresponding to the positional relationship between the two points. As a result, the display range 4 in the map information 1701 moves in the direction V1. In the display screen 2, the image portion moves in the direction 192 which is the opposite direction to the direction V1 of the scroll 191.

  FIG. 20 shows changes in the display range 4 on the map information 1701 during the scroll 191 in the direction V1 from the second state to the third state. The display range 4 is changed from the display range 2001 of the first state and the second state to the display range 2002 of the third state.

  In addition, when the user moves the touch position to return from the second position LB to the reference point icon C1 of the reference position Lr, the mobile terminal device suspends scrolling. When the user releases the finger, the mobile terminal device ends scrolling in the state of the display range 4 at that time, hides the reference point icon C1, cancels the control mode, and returns to the normal mode.

[Control flow]
FIG. 21 shows a flow of control processing of the display control unit 204 in the third embodiment. The control processing when displaying map information in an application screen in an application such as a map or position search is shown. As modes, there are a first mode and a second mode, and management values are 0 and 1. FIG. 21 has steps S301 to S317. The steps will be described below in order.

  (S301) The display control unit 204 reads map information. The display control unit 204 initially sets the mode to mode = 0 (first mode).

  (S302) The display control unit 204 first displays a partial range of a predetermined position of the map information on the display screen 2. The predetermined position is, for example, the current GPS position coordinates of the mobile terminal device, or the position designated by the user in the position search.

  (S303) The mobile terminal device receives an input operation by the user through the operation unit 106 and the touch pressure sensor 117, and acquires input information corresponding to the input operation. The display control unit 204 acquires the touch input information via the touch detection unit 201. At that time, the touch detection unit 201 detects the presence or absence of a touch and the touch position coordinates (X1, Y1). Further, the pressure detection unit 202 detects the presence or absence of pressure and the strength Pn of pressure.

  (S304) The display control unit 204 branches the process depending on the presence / absence of a touch based on the input information. If there is a touch (Y), proceed to S305, and if there is no touch (N), proceed to S315.

  (S305) The display control unit 204 acquires information including the touch position coordinates (X1, Y1) from the touch detection unit 201.

  (S306) The display control unit 204 acquires information including the pressing intensity Pn at the touch position from the pressing detection unit 202.

  (S307) The display control unit 204 confirms the current mode and branches. If mode = 0 (first mode), the process proceeds to S308, and if mode = 1 (second mode), the process proceeds to S312.

  (S308) The display control unit 204 compares the pressing strength Pn acquired in S306 with the threshold Pt, determines whether the strength Pn is equal to or greater than the threshold Pt, and branches. If Pn ≧ Pt, the process proceeds to S309, and if Pn <Pt, the process returns to S303.

  (S309) The display control unit 204 sets the touch position coordinates (X1, Y1) acquired in S305 as the reference position Lr = (Xr, Yr), and stores and holds it in the memory. The touch position coordinates (X1, Y1) at this time correspond to the first position LA = (Xa, Ya) in the first state.

  (S310) The display control unit 204 displays the reference point icon C1 at the reference position Lr in the display screen 2 as shown in FIG.

  (S311) The display control unit 204 sets the mode to mode = 1 (second mode), and returns to S303. The flow to S311 corresponds to the shift to the control mode according to the first pressing operation.

  (S312) On the other hand, when the mode = 1 in S307, the display control unit 204 uses the pressing intensity Pn acquired in S306 in S312, similarly to the equation (2) in the second embodiment. The scroll speed Sn is set based on the calculation by the formula (3) below.

Sn = S0 × Pn / Pt (3)
(S313) The display control unit 204 determines the X-direction scroll speed Sx and the X-direction scroll speed Sx based on the positional relationship between the touch position coordinates (X1, Y1) acquired in S305 and the reference position Lr = (Xr, Yr) stored in S309. Set the Y-direction scroll speed Sy. At this time, the display control unit 204 uses the scroll speed Sn set in S312 as a reference and determines the X-direction scroll speed Sx and the Y-direction scroll speed Sy based on the following expressions. The touch position coordinates (X1, Y1) at this time correspond to the second position LB = (Xb, Yb) in the second state.

  In the third embodiment, scrolling in an arbitrary direction within a plane formed by the X direction and the Y direction, that is, a scroll 191 such as the direction V1 in the third state in FIG. 19, is divided into an X direction scroll and a Y direction scroll. It is realized by dividing and combining. The X-direction scroll speed Sx is the speed corresponding to the X-direction scroll, and the Y-direction scroll speed Sy is the speed corresponding to the Y-direction scroll.

  When Y1 = Yb ≠ Yr, the display control unit 204 calculates the X-direction scroll speed Sx and the Y-direction scroll speed Sy according to the equation (4) below.

Sx = Sn × (Xr−X1) / (Yr−Y1), Sy = Sn (4)
When Y1 = Yb = Yr, the display control unit 204 calculates the X-direction scroll speed Sx and the Y-direction scroll speed Sy according to the equation (5) below.

Sx = Sn, Sy = 0 (5)
In the equation (4), the difference in position in the X direction (Xr-X1) between the reference position Lr and the second position LB = (Xb, Yb) = (X1, Y1) and the position in the Y direction The ratio (Xr-X1) / (Yr-Y1) is calculated using the difference (Yr-Y1). Then, in the equation (4), the X-direction scroll speed Sx is calculated so as to be increased with respect to the reference scroll speed Sn in accordance with the magnitude of the ratio. In the expression (4), for example, when (Xr-X1) = (Yr-Y1), Sx = Sn, and the X-direction scroll speed Sx and the Y-direction scroll speed Sy are the same.

  (S314) The display control unit 204 performs a scroll process of scrolling in the X direction and the Y direction using the scroll speed {Sx, Sy} set in S313 as the display control of the map information, and then returns to S303. By S314, as in the third state of FIG. 19, in the plane of the display screen 2 in the X direction and the Y direction, the scroll 191 in the direction V1 corresponding to the two points of the reference position Lr and the second position LB is generated. Will be realized. Along with this, the display range 4 in the map information 1701 is changed as shown in FIG.

  The flow to S314 corresponds to the change of the display range during the control mode. In S314, scrolling of a predetermined distance is performed in a predetermined time, and by continuing the processing of S314 in a loop, scrolling of a long distance is also realized.

  (S315) On the other hand, if there is no touch in S304, the display control unit 204 confirms the current mode and branches in S315. If mode = 0, the process returns to S303, and if mode = 1, the process proceeds to S316.

  (S316) The display control unit 204 hides the reference point icon C1 in the display screen 2.

  (S317) The display control unit 204 sets the mode to mode = 0 (first mode), and returns to S303. The flow to S317 corresponds to the release of the control mode.

[Effects, etc.]
As described above, according to the mobile terminal device of the third embodiment, it is possible to change the display range with a small amount of labor without repeating the touch operation many times, as in the second embodiment. The user can scroll in a desired direction by a simple operation with one hand and one finger. The user can adjust the scroll speed according to the strength of pressing. In the third embodiment, it is possible to scroll in any direction within the plane, and the user can select the scroll direction more finely.

[Modification (1)]
The following is possible as a modification of the third embodiment. When setting the X-direction scroll speed Sx and the Y-direction scroll speed Sy in step S313 of FIG. 21, you may determine according to the following formulas.

  When X1 = Xb ≠ Xr, the display control unit 204 calculates the X-direction scroll speed Sx and the Y-direction scroll speed Sy according to the equation (6) below.

Sx = Sn, Sy = Sn × (Yr−Y1) / (Xr−X1) (6)
When X1 = Xb = Xr, the display control unit 204 calculates the X-direction scroll speed Sx and the Y-direction scroll speed Sy according to the equation (7) below.

Sx = 0, Sy = Sn (7)
The expressions (4) and (5) are based on the position in the Y direction, and the expressions (6) and (7) are based on the position in the X direction.

  In step S312 of FIG. 21, the scroll speed Sn is determined using the pressing strength Pn, but as a modification, the formula (3) may be replaced with the formula (8) below.

Sn = S0 × Dn / Dt (8)
In the equation (8), the distance Dn between the two points in FIG. 18 is used. The reference value Dt indicates a predetermined reference value regarding the distance Dn. In the formula (8), the scroll speed Sn is determined by increasing the reference scroll speed S0 in accordance with the size (Dn / Dt) of the distance Dn with respect to the reference value Dt. Based on the scroll speed Sn, the mobile terminal device determines the scroll speed {Sx, Sy} in each direction in step S313.

[Modification (2)]
Various modifications of the third embodiment are possible as in the second embodiment. For example, as in the first embodiment, mode switching may be performed using the first pressing operation and the second pressing operation. In this modification, the control mode is entered by the first pressing operation on the display screen 2, the reference position Lr is set, the reference point icon C1 is displayed, and the control mode is released by the second pressing operation. The touched state may not be maintained during this control mode. The user can release the finger by the first pressing operation and then touch the second position LB to select a desired scroll direction or the like. The second pressing operation may be the second pressing on the reference point icon C1.

[Modification (3)]
As a modified example of the third embodiment, as in the modified example of the second embodiment, the information on the pressing strength Pn may be used as another control variable. For example, when setting the scroll speed Sn in step S312 of FIG. 21, a constant value, for example, the reference scroll speed S0 may be set. Alternatively, the scroll speed Sn may be determined according to the size of the distance Dn or the like. Further, in this modification, the pressing strength Pn at the second position LB or the like is detected during the control mode, and the scroll speed Sn is variably determined using the strength Pn. The mobile terminal device determines the scroll speed Sn so as to be increased with respect to the reference scroll speed S0 according to the strength Pn. That is, the more strongly the second position LB is pressed, the faster the scrolling is realized.

  Further, similarly to the modification of the second embodiment, the mobile terminal device may detect the pressing strength Pn at the reference position Lr and control the enlargement / reduction display operation at the touch position.

(Embodiment 4)
A mobile terminal device according to the fourth embodiment of the present invention will be described with reference to FIGS. Hereinafter, constituent parts of the fourth embodiment different from those of the first embodiment and the like will be described. The fourth embodiment shows a case where a plurality of home screens and a plurality of application screens are used as the target information. In the fourth embodiment, as the display range change control, screen switching when displaying one of the plurality of screens on the display screen 2 by switching is controlled. Further, the fourth embodiment corresponds to the modification of the first embodiment, and the display range changing control controls the screen switching using the angle of inclination.

[Home Screen]
FIG. 22 shows a state in which a home screen selected from a plurality of home screens is displayed on the display screen 2 of the mobile terminal device according to the fourth embodiment. The mobile terminal device according to the fourth embodiment switches and displays a plurality of home screens on the display screen 2 according to a specific touch pressing operation. The home screen has a plurality of home screens having different contents. Basically, one home screen is displayed in the display screen 2. The selected one home screen among the plurality of home screens corresponds to the display range 4. On one home screen, icons 9 and the like are arranged on the background. When the user selects and operates the icon 9, a transition is made to the corresponding application screen.

  In this example, home screens H1 to H5 are provided as a plurality of home screens. The home screens H1 to H5 are virtually managed as information in a layered arrangement by the OS of the mobile terminal device. That is, the home screens H1 to H5 are managed as layers L1 to L5. For example, the home screen H1 is the top layer L1 and the home screen H5 is the bottom layer L5. The number of home screens and layers is increased or decreased as needed. The bottom layer may be connected to the top layer so as to loop.

  The home screens H1 to H5 are shown, for example, in the case of being divided by genre. For example, on the home screen H1, three icons corresponding to communication-related applications are arranged, and on the home screen H2, icons corresponding to game applications are arranged. The plurality of home screens can be set by the user. In addition, when a plurality of icons do not fit on one home screen, they may be automatically divided into a plurality of home screens.

[Display control]
FIG. 23 shows a touch pressing operation on the home screen and screen switching as the display control of the fourth embodiment. The mobile terminal device according to the fourth embodiment receives the first pressing operation, the second pressing operation, the tilting operation, and the like, and controls screen switching of a plurality of home screens on the display screen 2. Screen switching is a display operation of switching the home screen, which is the display range 4 on the display screen 2, at predetermined time intervals. Note that FIG. 23 illustrates a case where the user holds the housing 1 with the left hand (not shown) and presses the display screen 2 with one finger of the right hand.

  The user performs a first pressing operation on a location on the home screen. When the mobile terminal device detects the first press at that time, it enters the control mode from the normal mode, and sets the angle θ of the inclination of the housing 1 at that time as the reference angle θ0. The user performs an operation of tilting in a desired direction, for example, the Y direction in the control mode. The mobile terminal device determines the screen switching direction and the like according to the difference value (θn−θ0) of the angle θn at that time. The mobile terminal device determines to switch the screen in the first direction when the inclination is in the negative direction and to switch the screen in the second direction when the inclination is in the positive direction, for example. The first direction is a layer descending direction in which the layer that is the display range 4 is descended, and the second direction is a layer rising direction.

  In addition, the mobile terminal device may determine a time interval for updating each screen and each layer, which corresponds to the speed at the time of screen switching, according to the angle θ.

  In the case of switching the first direction screen, the display control unit 204 sequentially switches the plurality of home screens in the layer descending direction. That is, the home screen displayed as the display range 4 on the display screen 2 is sequentially switched, for example, from the top layer L1 to the bottom layer L5. During the control mode, the user can temporarily stop the screen switching by returning the tilt to a state near the initial reference angle θ0. Further, the user can also perform the corresponding process by touching and selecting the icon 9 in the home screen during the control mode. The user performs the second pressing operation with the desired home screen in the display range 4. As a result, the mobile terminal device ends the screen switching, releases the control mode, and returns to the normal mode.

[Effects, etc.]
As described above, according to the fourth embodiment, it is possible to switch a plurality of home screens with a small amount of labor without having to repeat the touch operation many times. The user can switch the home screen in a desired direction by a simple operation. The user can adjust the speed of screen switching according to the strength of pressing and the angle of inclination.

[Modification (1)]
The following are possible modifications of the fourth embodiment. The time interval for updating when switching screens may be determined based on the following equation (9), for example. Let the time interval be Kn. The predetermined reference time interval is K0. In the expression (9), the time interval Kn is calculated so as to be decreased with respect to the reference time interval K0 according to the ratio (Pt / Pn) between the pressing strength Pn and the threshold value Pt.

Kn = K0 × Pt / Pn (9)
FIG. 24 shows a function 2401 corresponding to the expression (9). The horizontal axis represents strength Pn and the vertical axis represents time interval Kn. In the function 2401, it is determined that the time interval Kn decreases so that the strength Pn increases as the strength Pn increases. That is, the greater the strength Pn, the faster the screen switching speed. Further, a stepwise function like the function 2402 may be applied, or an upper limit value or a lower limit value may be provided. The time interval Kn can be variously set, such as a fixed value or a user set value, as in the first embodiment.

[Modification (2)]
The target information is not limited to a plurality of home screens, but can be similarly applied to a plurality of application screens and the like. Further, the present invention is not limited to a layered arrangement as a plurality of screens, but can be similarly applied to a case where they are arranged in parallel in the X direction and the Y direction.

  FIG. 25 shows a display state of the display screen 2 in the modification. In this way, the images of a plurality of screens may be displayed in layers or arranged in parallel on the display screen 2. In this case, the control according to the fourth embodiment can be applied with the plurality of screens as the target information. For example, when the home key k2 is pressed twice from the normal home screen state, a transition is made to the layer display state as shown on the left side of FIG. In this example, a case of a layered arrangement of a plurality of application screens G1 to G4 and the like is shown. In this state, the application screen G1 is displayed as the layer L1 in the foremost position. From this state, the control mode is entered according to the first pressing operation. During the control mode, for example, by switching one screen in the layer descending direction, the layer display state on the right side of FIG. 25 is switched. In this state, the application screen G2 is displayed as the layer L1 in the foremost position.

  FIG. 26 shows a case where the target information is content history information in the application screen. The history screens E1 to E3, which have content history information in time series and correspond to, for example, browsing history information of Web pages, are shown. For example, the latest history screen E1 is the display range 4. During the control mode, the history screens E1 to E3 and the like can be switched and displayed from the present to the past or from the past to the present by an operation such as changing the inclination in the Y direction.

  FIG. 27 shows a case where the target information is the content in the application screen, for example, a plurality of page information constituting an electronic book. The page screen p1-p3 etc. corresponding to several page information are shown. For example, the top page screen p1 is the display range 4. In the control mode, the page screens p1 to p3 and the like can be switched and displayed in a desired direction by an operation such as changing the tilt in the X direction.

[Modification (3)]
The screen switching is a display operation in which the screen is intermittently moved at a predetermined time interval, but is not limited to this, and may be a display operation in which the screen is continuously moved like the scroll of the first embodiment. Further, when the screens are switched, a vibration pattern may be generated every time one screen is switched, or a predetermined character or image may be displayed, voice may be output, or the like.

  A mode in which the screen switching direction, speed, and the like are determined in accordance with the operation of the direction selection icon in the second embodiment and the positional relationship between the two points in the third embodiment is also possible.

  Further, the direction, speed, etc. of the display operation may be determined according to the distinction between the touch positions when the display screen 2 is pressed.

  FIG. 28 shows an operation on the display screen 2 in the modified example. In FIG. 28, as the first pressing operation, a display operation in the first direction is performed when the upper area R1 in the display screen 2 is pressed, and a second direction display operation is performed when the lower area R2 is pressed. An example of determining is shown. A line 2801 indicates a boundary line between the upper side region R1 and the lower side region R2 in setting.

  Furthermore, the direction, speed, etc. of the display operation may be determined according to the number of touch positions when pressing the display screen 2. For example, as the first pressing operation, a relatively low first speed is used when touching one location on the display screen 2, and a relatively high second speed is used when two locations are simultaneously touched. You may decide.

  As a modification, the mobile terminal device may include a plurality of pressure sensors. In that case, the direction and speed of the display operation may be determined according to the proper use of these pressure sensors.

  FIG. 29 shows a mobile terminal device of a modified example, in which a touch pressure sensor 117 arranged corresponding to the display screen 2 on the front surface of the casing 1 and a pressing force arranged at a predetermined position on the rear surface of the casing 1. And a sensor 118. This portable terminal device performs, for example, a first directional display operation in the case of a first press on the front touch pressure sensor 117, and a second directional display operation in the case of a first press on the back pressure sensor 118. decide.

(Embodiment 5)
A mobile terminal device according to the fifth embodiment of the present invention will be described with reference to FIG. Hereinafter, components of the fifth embodiment different from those of the first embodiment and the like will be described. The fifth embodiment shows a case where a plurality of icons are displayed on the display screen 2 as the target information. In the fifth embodiment, as the display range changing control, the display operation when arranging and displaying a plurality of icons in the display screen 2 is controlled. Further, the fifth embodiment corresponds to the modification of the first embodiment, and the display range changing control controls the display operation using the angle of inclination.

[Control outline and icon layout]
FIG. 30 shows a display example of the arrangement of a plurality of icons in the home screen, an operation, etc. as the display control in the fifth embodiment. FIG. 30 shows a case where the user holds the housing 1 with his left hand and operates it with his thumb.

  FIG. 30A shows the first arrangement state. In the area where the home screen is displayed on the display screen 2, a plurality of icons 9 are arranged in a matrix in parallel in the X direction and the Y direction. In this example, eight icons 9 associated with eight applications are arranged in the area near the lower side. The eight icons 9 are shown as “App1” to “App8” for identification.

  FIG. 30B shows the second arrangement state. In the second arrangement state, the plurality of icons 9 are arranged in a circular shape and a ring shape, and in the ring, the plurality of icons 9 move so as to rotate on the circumference. The group of icons 9 moves intermittently at predetermined time intervals. A ring is arranged with a predetermined position in the display screen 2 as the center point Q0.

  In the first arrangement state, the user performs a first pressing operation of pressing a portion of the display screen 2 with a predetermined size or more and releasing the finger. The pressing position is an arbitrary position within the display screen 2. The pressing position may be a position on the icon 9 or a position other than the icon 9. The mobile terminal device enters the control mode in response to the first pressing operation and sets the tilt angle of the housing 1 as the reference angle θ0. The mobile terminal device changes the arrangement of the plurality of icons 9 from the first arrangement state to the second arrangement state.

  The mobile terminal device moves the plurality of icons 9 of the ring so as to rotate in a predetermined direction, for example, clockwise in the second arrangement state in the control mode. In addition, the mobile terminal device may determine the initial speed of movement of the icon 9 according to the strength Pn of the first pressing of the first pressing operation.

  Further, the mobile terminal device variably controls the moving direction and speed of the icon 9 according to the angle θn of the tilting operation in the second arrangement state. For example, when the inclination is in the positive direction, the rotation is clockwise, and when the inclination is in the negative direction, the rotation is counterclockwise, and the speed is determined according to the absolute value | θn−θ0 |.

  When the user returns the tilt angle θn to the vicinity of the reference angle θ0, the mobile terminal device temporarily stops the movement of the icon 9. The mobile terminal device may be temporarily stopped when the user touches the center of the ring. Further, when the user performs a touch selection operation on the desired icon 9, the mobile terminal device executes the process of the application associated with the icon 9 to cancel the control mode.

  In the second arrangement state, the user performs a second pressing operation of pressing a portion in the display screen 2, for example, the center or the outer area of the ring with a predetermined size or more and releasing the finger. The mobile terminal device releases the control mode in response to the second pressing operation and returns from the second arrangement state to the first arrangement state.

  The position of the center point Q0 may be a user-set value or a position near the touch position coordinates during the first pressing operation. In the second arrangement state, the mobile terminal device may be adjusted according to the number of the icons 9 such as the size of the ring or the icon 9 and displaying a part of the ring in the display screen 2.

[Effects, etc.]
As described above, according to the fifth embodiment, the operation of selecting the desired icon 9 on the screen can be realized with little effort. When operating with one hand or one finger, the user performs the first pressing operation when the finger does not reach the desired icon 9 in the first arrangement state in the display screen 2 or when the desired icon 9 is not found. Accordingly, the second arrangement state is changed. The user rotates the icon group 9 in the second arrangement state, and releases the finger when the desired icon 9 comes to the touch position of the finger. Alternatively, the desired icon 9 is touch-operated after the rotation of the icon 9 is temporarily stopped. As a result, the desired icon 9 can be selected and operated to transition to the application screen.

  Conventionally, when the user cannot reach the desired icon with his / her finger, he / she needs to change the state of the holding hand and push it with the finger of another hand. In the fifth embodiment, such trouble is unnecessary, and the icon can be easily and quickly selected with one hand and one finger. Further, the user can adjust the direction and speed of rotation of the icon according to the strength of pressing, the angle of inclination, etc., and can quickly select the desired icon.

(Other embodiments)
In the above-described embodiment, the case where the content, the home screen, the application screen, the icon, etc. are subject to the display range change control has been described. In addition, scrolling, screen switching, icon movement, and the like have been described as the display operation of the change control. These are not limited to the combinations in the above-described embodiment, and various combinations can of course be made.

  Although the present invention has been specifically described above based on the embodiment, the present invention is not limited to the above embodiment, and various modifications can be made without departing from the scope of the invention. Some or all of the functions and the like of the present invention may be realized by hardware such as an integrated circuit, or may be realized by software program processing.

  1 ... Housing, 2 ... Display screen, 3 ... Display information, 4 ... Display range, 5, 6 ... Scroll.

Claims (17)

A display unit that displays information on the display screen,
A pressure detection unit that detects pressure on the display screen,
A display control unit that controls the display range of the information displayed on the display screen;
Equipped with
The display control unit changes the display range in a state where the first press is not held after the first press having a predetermined magnitude or more is detected by the press detection unit,
Mobile terminal device. The mobile terminal device according to claim 1,
An inclination angle detection unit for detecting an inclination angle of the mobile terminal device;
The display control unit sets the first angle of the tilt detected by the tilt angle detection unit when the first press is detected as a reference angle, and in the state where the first press is not held, The display range is changed according to the magnitude of the difference between the second angle of the tilt detected by the tilt angle detection unit and the reference angle.
Mobile terminal device. The mobile terminal device according to claim 1,
A touch detection unit for detecting touch position coordinates with respect to the display screen,
The display control unit displays a direction selection icon with the first position of the touch position coordinates detected by the touch detection unit when the first press is detected as a reference position, and the first press is held. In a state where there is no, the display range is changed to a direction selected according to the touch position on the direction selection icon,
Mobile terminal device. The mobile terminal device according to claim 1,
A touch detection unit for detecting touch position coordinates with respect to the display screen,
The display control unit uses the first position of the touch position coordinates detected by the touch detection unit when the first press is detected as a reference position, and detects the touch when the first press is not held. The display range is changed in a direction determined according to the positional relationship between the second position and the first position of the touch position coordinates detected by the unit,
Mobile terminal device. The mobile terminal device according to claim 1,
The display control unit ends the change of the display range when a second press having a predetermined magnitude or more is detected by the press detection unit after the detection of the first press,
Mobile terminal device. The mobile terminal device according to claim 1,
A touch detection unit for detecting touch position coordinates with respect to the display screen,
The display control unit changes the display range in a state in which the first pressure is not held and a state with a touch detected by the touch detection unit is maintained, When the change to the non-touch state is detected, the change of the display range is finished,
Mobile terminal device. The mobile terminal device according to claim 1,
A touch detection unit for detecting touch position coordinates with respect to the display screen,
When the touch detection unit detects a selection operation of an object in the display screen after the detection of the first press, the display control unit ends the change of the display range and associates the display range with the object. Perform the specified process,
Mobile terminal device. The mobile terminal device according to claim 1,
The display control unit scrolls the display range at the time of the change,
Mobile terminal device. The mobile terminal device according to claim 1,
The display control unit switches the screen to be the display range among a plurality of screens at the time of the change,
Mobile terminal device. The mobile terminal device according to claim 1,
The display control unit changes the arrangement of a plurality of objects in the display screen at the time of the change and moves each object in the arrangement.
Mobile terminal device. The mobile terminal device according to claim 2,
When the second angle is within a predetermined angle range near the first angle, the display control unit does not perform a display operation of changing the display range, or suspends the display operation.
Mobile terminal device. The mobile terminal device according to claim 3,
The direction selection icon includes a central stop area,
If the touch position is the central stop area, or is an area outside the direction selection icon, the display control unit does not perform a display operation of changing the display range, or temporarily stops the display operation.
Mobile terminal device. The mobile terminal device according to claim 4,
When the touch position is within a predetermined range near the first position, the display control unit does not perform a display operation of changing the display range, or suspends the display operation.
Mobile terminal device. The mobile terminal device according to claim 1,
The display control unit changes the speed at which the display information is continuously moved at the time of the change, or the time interval at which the display information is intermittently moved, in accordance with the strength of the first pressing.
Mobile terminal device. The mobile terminal device according to claim 2,
The display control unit changes the speed at which the display information is continuously moved at the time of the change, or the time interval at which the display information is intermittently moved, in accordance with the magnitude of the difference between the tilt angles.
Mobile terminal device. The mobile terminal device according to claim 1,
The information is at least one of content display information, a plurality of home screens, a plurality of application screens, and a plurality of icons in the screen,
Mobile terminal device. The mobile terminal device according to claim 1,
A touch pressure sensor provided on the front surface having the display screen,
A touch detection unit for detecting touch position coordinates with respect to the display screen,
A mobile terminal device comprising: