JP2010193494A - Screen display-processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a screen display-processing device for displaying an appropriate screen according to the situations. <P>SOLUTION: The screen display-processing device includes: a means 101 for enabling a plurality of housings of a mobile terminal device to relatively move; a detection means 102 for detecting a parameter value indicating to what extent the plurality of housings are relatively moving; a determination means 103 for determining whether the shape of the mobile terminal device is changed based on the parameter value; and a control means 104 for controlling functions equipped to the mobile terminal device based on the change in the shape and the parameter value. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a screen display processing apparatus in a mobile phone or a portable information terminal according to the mobile phone.

  In recent years, mobile phones have become widespread, and various functions have been added to increase the performance. As a result, the operation of mobile phones has become increasingly complex. However, the current operation of mobile phones has not evolved much since the birth of mobile phones, and button operations are still the main focus. For this reason, even if you want to do a little work on a mobile phone, it is necessary to operate using a small number of buttons, so it is necessary to operate using only a complicated GUI menu and numeric keypad + α buttons. was there.

  Moreover, since it is difficult to use a CPU similar to a PC because of problems such as power consumption and price, a mobile phone has a hardware configuration using a relatively ineffective CPU. Moreover, since it is necessary to mount a small screen for portability, a liquid crystal monitor or the like having a resolution higher than that of a PC is not mounted. Because of these hardware problems, the operation screen of the mobile phone is not a multitasking type using the mainstream window metaphor on a PC. Basically, the entire screen is used by one application and is used as another application. When migrating, the application is often terminated and another application is started. Although the window metaphor may be used only for some functions, it is basically a single task or pseudo multitask type application execution.

  From the above, if you want to do a little different work on the mobile phone or access other information, the system configuration problem (from both hardware and software) and the operability problem combined, It was often difficult to use.

  On the other hand, the mechanism for cellular phone case design is evolving day by day, including the two-fold type that has become the mainstream now, the slide type, the screen that can be rotated, the one that can be folded in multiple directions, etc. There are mobile phones that perform various shape changes and posture changes.

  However, although the housing design has evolved to have various mechanisms, as described above, the system configuration has not changed, and only the mechanism has been renewed. The more complicated the mechanism, the more often the mobile phone is used in various forms, but it is difficult to say that the screen display is easy to see in each form.

  Also, with regard to the functions that mobile phones are equipped with, there are many functions that are simply gathered from PCs and other devices, and it can be said that they are easy to use in consideration of the usage conditions unique to mobile phones. There is no current situation. For example, a TV viewing function and a camera function are simply provided with a TV viewing function and a camera function, and these are not customized so as to be easy to use according to the use scene of the mobile phone.

  As for the manner mode, a manner mode for sound is mounted, but a manner mode for light leakage due to light emission by a backlight of a mobile phone screen is not considered. For example, in the dark, such as a movie theater being shown, the light leakage of mobile phones held by people around us is quite annoying. Some mobile phones are equipped with an optical sensor to control the brightness of the screen (see, for example, Patent Document 1), which is intended to make the screen easier to see under external light, It is not intended for manner mode against light leakage in the dark.

Furthermore, the screen display of mobile phones has not evolved much since the birth of mobile phones. In recent years, many people have put privacy films on the screens of mobile phones from the viewpoint of manners with respect to light leakage as described above and the desire to avoid seeing their own private information. Some mobile phones are equipped with this function, but the screen display is not well devised.
JP 2003-076333 A

  As mentioned above, current mobile phones have operability problems, application usability problems, mechanism utilization problems, screen visibility problems, etiquette problems for light leakage, privacy for screen display There are various issues such as

  The present invention has been made in consideration of the above-described circumstances, and an object of the present invention is to provide a screen display processing device that performs an appropriate screen display according to the situation.

  In order to solve the above-described problem, the screen display processing device according to the present invention includes an acquisition unit that acquires a parameter amount indicating the posture of one or more housings that constitute a mobile terminal device, and a difference between the parameter amount and a reference value. Determining means for determining which of a plurality of ranges classified by a plurality of thresholds, and browsing for allowing a user of the mobile terminal device to view the screen of the mobile terminal device based on the range to which the device belongs Direction estimation means, control means for switching functions mounted on the mobile terminal device according to the range to which the user belongs and the viewing direction, and the user holds the mobile terminal device Holding information acquisition means for acquiring holding information indicating holding contents, and the estimation means further estimates the viewing direction based on the holding information.

  Furthermore, the screen display processing device of the present invention includes a movable means for relatively moving a plurality of casings of the mobile terminal device, and a parameter amount indicating how much the plurality of casings move relative to each other. Detecting means for detecting; determining means for determining whether a difference between the parameter amount and the reference value belongs to a plurality of ranges classified by a plurality of threshold values; and one or more of the portable terminal devices Based on the acquisition means for acquiring the posture information indicating the posture of the housing of the mobile phone, the range to which the housing belongs, and the posture information, a viewing direction in which the user of the mobile terminal device browses the screen of the mobile terminal device is estimated In accordance with the range to which the user belongs and the viewing direction, a control unit that switches a function installed in the mobile terminal device, and a storage that indicates the content held by the user holding the mobile terminal device. Comprising a holding information obtaining means for obtaining information, and the estimating means on the basis of the further the retained information, characterized by guessing the viewing direction.

  In addition, the screen display processing device of the present invention detects a moving means for relatively moving a plurality of casings of the mobile terminal device and a parameter amount indicating how much the plurality of casings move relative to each other. Detecting means for determining, a determining means for determining which of a plurality of ranges classified by a plurality of threshold values a difference between the parameter amount and a reference value belongs to, and the portable terminal according to the belonging range Control means for switching functions mounted on the device, and layout, size, shape, display so that distortion is reduced when observing the content displayed on the screen of the mobile terminal device according to the range to which the device belongs Change means for changing at least one of the area and the display position, and the control means selects and controls the contents of the change.

  Furthermore, the screen display processing device according to the present invention classifies acquisition means for acquiring a parameter amount indicating the attitude of one or more housings of the mobile terminal device, and a difference between the parameter amount and a reference value by a plurality of threshold values. A determination unit that determines which range of a plurality of ranges belongs; a control unit that switches a function installed in the mobile terminal device according to the range to which the mobile device belongs; Change means for changing at least one of layout, size, shape, display area, and display position so that distortion is reduced when observing the content displayed on the screen of the terminal device, and The control means selects and controls the contents of the change.

  Still further, the screen display processing device of the present invention includes an acquisition unit configured to acquire a parameter amount indicating an attitude of one or more housings constituting the mobile terminal device, and the difference between the parameter amount and the reference value is a plurality of threshold values. A determination means for determining which of a plurality of ranges to be classified belongs, and an estimation for estimating a viewing direction in which a user of the mobile terminal device browses the screen of the mobile terminal device based on the range to which the device belongs Means, a control means for switching a function mounted on the mobile terminal device according to the range to which the mobile terminal device belongs, and a content displayed on the screen of the mobile terminal device according to the range to which the mobile terminal device belongs. Change means for changing at least one of layout, size, shape, display area, and display position so that distortion is reduced when observing And performing selection and control of the contents of the serial changes.

  Furthermore, the screen display processing device of the present invention has a movable means for relatively moving a plurality of casings of the mobile terminal device, and a parameter amount indicating how much the plurality of casings move relatively. Detection means for detecting, determination means for determining which of a plurality of ranges classified by a plurality of thresholds a difference between the parameter amount and a reference value belongs to, and one or more housings of the portable terminal device Based on acquisition means for acquiring posture information indicating the posture of the body, the range to which the body belongs, and the posture information, the user of the mobile terminal device estimates a viewing direction for browsing the screen of the mobile terminal device Means, control means for switching a function mounted on the portable terminal device according to the range and the viewing direction, and contents displayed on the screen of the portable terminal device according to the range Change means for changing at least one of layout, size, shape, display area, and display position so that distortion is reduced when observed, and the control means selects the contents of the change And performing control.

  According to the screen display processing device of the present invention, it is possible to perform an appropriate screen display according to the situation.

Hereinafter, a screen display processing apparatus and method according to embodiments of the present invention will be described in detail with reference to the drawings. Note that, in the following embodiments, the same numbered portions are assumed to perform the same operation, and repeated description is omitted.
(First embodiment)
<Overall configuration>
A screen display processing apparatus according to the first embodiment will be described with reference to FIG.
The screen display processing apparatus according to the present embodiment includes a movable mechanism unit 101, a movable parameter acquisition unit 102, a shape change detection unit 103, an application switching control unit 104, an application operation unit 105, a display unit 106, and an operation unit 107.

The movable mechanism unit 101 relatively moves a plurality of housings constituting a device (for example, a mobile terminal device such as a mobile phone terminal) including a screen display processing device. Details of the movable mechanism 101 will be described later with reference to FIGS.
The movable parameter acquisition unit 102 acquires a movable parameter corresponding to each case for the movable mechanism unit 101 to move each case. Details of the movable parameter acquisition unit 102 will be described later.
The shape change detection unit 103 detects a change in the shape of the device including the screen display processing device based on the movable parameter acquired by the movable parameter acquisition unit 102. For example, the shape change detection unit 103 acquires information indicating that the shape change of the device including the screen display processing device is “Yes” or “No”. Details of the shape change detection unit 103 will be described later.

The application switching control unit 104 uses the information that the shape change detected by the shape change detection unit 103 is “present” or “none” and the movable parameter acquired by the movable parameter acquisition unit 102 to perform screen display processing. Control functions installed in devices, including devices. In the present embodiment, control is performed to switch applications running on devices including the screen display processing device. Details of the application switching control unit 104 will be described later.
The application operation unit 105 receives the control content from the application switching control unit 104, switches the application to a predetermined application, and operates the application. Details of the application operation unit 105 will be described later.

The display unit 106 is a screen (for example, a liquid crystal screen) that can display character information, image information, and the like, and displays the operation status and results of devices including the screen display processing device.
The operation unit 107 includes various push button type keys for dial input, character input, command input, and the like, and outputs a key input signal corresponding to the key operation.

Next, an example of the appearance of a mobile phone terminal incorporating the screen display processing device of FIG. 1 will be described with reference to FIG.
This mobile phone terminal includes an upper casing 201 and a lower casing 202. The upper housing 201 and the lower housing 202 are attached to be openable and closable (foldable) via the movable mechanism 101, and the upper housing 201 has the display unit 106 and the lower housing 202 has the operation unit. 107 is provided.

  In such a mobile phone terminal, various function units (not shown) of the terminal normally operate according to the operation of the operation unit 107, and the operation contents and results are output to the display unit 106. For example, when the “mail” key in the operation unit 107 is pressed, the operation is switched to the mail function application, and the operation screen of the mail application is displayed on the display unit 106. When characters are input using the operation unit 107 in this state, the input characters are processed by the mail application, and are sequentially displayed on the display unit 106 as a state of mail input. When the Web application button is pressed, the screen is switched to the Web application, and the display unit 106 and the operation unit 107 are used for displaying and operating the Web application.

  The present embodiment relates to a screen display processing device included in such a mobile phone terminal or a portable information terminal conforming to the mobile phone terminal, and will be described in detail with respect to each part constituting the screen display processing device of the present embodiment. I will explain.

<Movable mechanism 101>
The movable mechanism 101 is for relatively moving a plurality of housings constituting the terminal. Specifically, as described above, the mobile phone terminal assumed in the present embodiment has an upper casing 201 and a lower casing 202, for example, as shown in FIG. It can be opened and closed (foldable). In the case of this example, the movable mechanism unit 101 is typically a hinge, and is a mechanism that allows the upper housing 201 and the lower housing 202 to be moved by a rotation mechanism so as to be opened and closed (foldable). . This is an example of a mobile phone terminal called a so-called two-fold type.

  There are mobile phone terminals having the movable mechanism 101 other than the two-fold type. An example is shown in FIG. This is a type called a slide type, and this mobile phone terminal includes a movable mechanism unit 101 (not shown), a display unit 106, a first operation unit 301, a second operation unit 302, an upper housing 201, It consists of a lower housing 202 and the like.

  The first operation unit 301 and the second operation unit 302 are obtained by dividing the function of the operation unit 107 described above into two places. This type of mobile phone terminal has a slide mechanism in the movable mechanism 101, and by this slide mechanism, the upper casing 201 and the lower casing 202 can be moved in the horizontal direction and can be opened and closed (slidable). It is a mechanism to do. FIG. 3 shows (a) when the mobile phone terminal is opened (when it is slid), and (b) when it is closed (when it is not slid). The two-fold type is different in terms of the opening and closing means of the mobile phone terminal, but the other functions are almost the same.

  In addition, although the example of the movable mechanism part 101 in the mobile phone terminal of two types of a folding type and a slide type was shown here, this is an example to the last and it is not limited to this. The same applies to any mechanism that has a movable mechanism.

<Moving parameter acquisition unit 102>
The movable parameter acquisition unit 102 is for acquiring a movable parameter of the movable mechanism unit 101 (a parameter for determining whether a plurality of housings are moving relatively). In other words, the movable parameter acquisition unit 102 detects a parameter value for determining whether a plurality of housings are moving relatively. When the mobile phone terminal is the above-described two-fold type, that is, when the movable mechanism of the movable mechanism unit 101 is a rotation mechanism, the rotation angle, that is, the angle formed by the upper casing 201 and the lower casing 202 is acquired as the movable parameter. The When the mobile phone terminal is a slide type, that is, when the movable mechanism of the movable mechanism unit 101 is a slide mechanism, a slide amount as a movable parameter, that is, an amount by which the lower casing 202 moves as viewed from the upper casing 201 (or a lower part) The amount of movement of the upper casing 201 as viewed from the casing 202) is acquired as a movable parameter. The same applies to other movable mechanisms. That is, a parameter that can be a movable amount of the movable mechanism is acquired. Also, the number of parameters is not necessarily one. When moving in a plurality of directions, there may be a plurality of parameters.

  Hereinafter, for the sake of simplicity, the description will be continued by taking a two-fold type as an example, but the same applies to other types of mobile phone terminals. The following description can be realized by appropriately replacing the movable mechanism and the movable parameter of each type of terminal.

<Shape change detection unit 103>
The shape change detection unit 103 is for detecting a change in the shape of the terminal from the movable parameter acquired by the movable parameter acquisition unit 102. The shape change detection unit 103 determines whether there is a change in the shape of the mobile terminal device based on the parameter value. The detection of the shape change may be simply detected as a change when the parameter value changes from a certain reference by a certain amount. For example, if the parameter value at time t is f (t), the reference parameter value is f0, and the threshold for change detection is TH,
| F (t) -f0 |> TH
Can be detected as That is, when | f (t) −f0 | exceeds TH, it is determined that there is a shape change.

Further, it is possible to detect using a difference between parameter values at a certain time t and a time t−Δt slightly earlier (by Δt).
| F (t) −f (t−Δt) |> TH
In this case, it is assumed that the shape has changed, and f (t) −f (t−Δt) is the amount of change.

Further, instead of simply taking the amount of change, the change may be detected based on the amount of change rate.
| Df (t) / dt | = | (f (t) −f (t−Δt)) / Δt |> TH
And so on.

  In addition, although the method to detect a change simply by a time difference etc. was shown here, it is not limited to this. Approximate information that changes every moment with a spline curve, etc., and if the slope becomes larger than a specific slope, it may be determined that there is a shape change, or a more complicated signal processing technique should be taken. You can also. In the present embodiment, the acquisition method itself is not essential, and various existing detection methods can be appropriately selected and used.

  Further, here, the case where the parameter value is a single amount has been described. However, in the case where the parameter value is a plurality of amounts, the above determination is performed individually for each number of parameters, and the change from each weighted average to “Yes” or “ The detection is performed by detecting “none”, regarding the parameter amount as a vector, and applying an arbitrary function prepared in advance for detection to the vector.

  The threshold value, the detection method, and the like are set in advance according to the control content in the application switching control unit 104 described later. Note that a plurality of threshold values and detection methods may be prepared so that the user can appropriately select or input the threshold amount in the operation menu of the mobile phone terminal.

  As described above, for example, it is possible to detect whether the upper casing 201 and the lower casing 202 are movable in a two-fold type mobile phone terminal.

  Further, the detection is not limited to one stage as described above. A plurality of threshold values may be prepared and a plurality of detection states may be output. That is, the angle at which the upper housing 201 and the lower housing 202 have changed may be detected in several stages.

<Application switching control unit 104, application operation unit 105>
The application switching control unit 104 uses the information on the presence or absence of the shape change detected by the shape change detection unit 103 and the value of the movable parameter acquired by the movable parameter acquisition unit 102 to By sending a control signal for switching the currently operating application to the application operating unit 105, the application currently operating on the terminal is switched.

  The application operation unit 105 receives the control content from the application switching control unit 104, switches the application to a predetermined application, and operates the application.

  Specifically, for example, the application switching control unit 104, when the shape change detection unit 103 detects a change in the shape of the terminal, the current terminal state acquired from the application operation unit 105 and the movable parameter acquisition unit 102 The application to be switched is determined in accordance with the value of the movable parameter acquired in (1), and a control signal for switching to the determined application is sent to the application operation unit 105.

  Here, the current state of the terminal acquired from the application operation unit 105 is the information on the application currently being executed, what kind of event should be performed for the event when an event occurs Information, input / output status to the terminal, and so on. Among such current terminal states, the application switching control unit 104 appropriately receives necessary information and treats it as information for control.

  The application operation unit 105 receives the control signal from the application switching control unit 104 and switches the operation from the currently executing application to the designated application.

  Here, the operation method of the application does not matter. For example, in the case of the multi-thread type, the current application is set as inactive, activated when the application to be switched is not activated, and activated when activated. In the case of the pseudo multithread type, the current application state is retained, the application is terminated, and the state when the switching target application is terminated is restored and activated. In addition, application switching is not necessarily performed on a full screen basis. A window may overlap a part of a screen of an application, and another application may be executed in the window. Also, the switching is not always single. A plurality of applications may be executed simultaneously in one screen.

  The application operation unit 105 is usually realized by a CPU or LSI, and includes a communication unit (not shown), a memory (not shown), an input / output unit (not shown) such as a speaker and a microphone, a camera, a GPS, and the like. By appropriately driving and controlling a device (not shown) using a program, operations such as menu operations, application execution, telephone calls, and the like of the mobile phone terminal are realized.

<Overall operation>
The screen display processing apparatus in the cellular phone terminal described above or a portable information terminal based on the cellular phone terminal can implement the following operations.

  As shown in FIG. 4, it is normal to use the two-fold type cellular phone terminal fully opened (in a state as shown in FIG. 2). In addition to this, for example, when a mail is received while browsing a Web page, in the case of a normal mobile phone terminal, a mail is received on a part of the screen (display unit 106). Is displayed. Or, on a slightly more friendly model, it shows at the same time who received what kind of email. This notification is typically displayed only for a certain period of time, disappears after a certain period of time, and returns to the original Web page browsing state. At this time, depending on the model, there may be a mail arrival icon remaining. The behavior around here varies depending on the model, but in the case of a conventional mobile phone terminal, if you want to read incoming mail, press the mail button once to exit the web browser application and move to the mail application, I need to read mail. Therefore, in order to return to the browsing state of the original Web browser again, it is necessary to start the Web browser again and read the original page, which is troublesome.

  In such a case, normally, when a mobile phone terminal is completely opened as in the past to perform work (web browsing with a web browser) and an incoming mail is received, as shown in FIG. The upper housing 201 of the mobile phone terminal is slightly rotated. The movable change is detected by the shape change detection unit 103, and the application switching control unit 104 performs control to switch to an application for displaying the incoming mail information. The application operation unit 105 Perform display operation. If this state is maintained, the mail incoming information display operation is continued, and the display unit 106 continues to display the mail incoming information.

  When the upper casing 201 of the mobile phone terminal is returned to the original fully opened state again, the shape change detecting unit 103 detects the shape change again, and the application switching control unit 104 changes the application to the original Web browser. Switching control is performed, and the application operation unit 105 switches the application to the original Web browser state.

  With the above operation, when a certain work (for example, Web browsing in the above example) is performed, if there is an event (incoming mail in the above example), the housing is moved slightly. By switching the screen to the application corresponding to the event, it is possible to quickly confirm the event information, and when browsing the information is completed, by returning the casing to its original state (movable), It is possible to realize a function of quickly returning to the original work. That is, information can be easily confirmed without touching any button (operation unit 107), and it is possible to quickly return to the original state.

Next, an example of the operation of the screen display processing apparatus of FIG. 1 will be described with reference to FIG.
First, it is determined whether or not the shape change detection unit 103 has detected a shape change 1 (step S601). In the case of the above example, the shape change 1 is a shape change in which the upper housing 201 and the lower housing 202 are closed from a completely opened position to a predetermined angle θ (or more than θ). The angle θ is acquired by the movable parameter acquisition unit 102, and the shape change detection unit 103 determines whether or not such a shape change 1 has occurred.

  If it is determined in step S601 that the shape change 1 has occurred, it is next determined whether any event has occurred (step S602). In the case of the above example, there is an event that an email has arrived. This is normally notified as an interrupt signal to the OS (operating system) or a system management program based thereon. Usually, it is often performed by the application operation unit 105, but may be managed, controlled, and operated by other components of the mobile phone terminal not shown. If it is determined in step S602 that no event has occurred, the process returns to S601.

  Next, the application switching control unit 104 determines whether or not the process corresponding to the event is application switching (step S603). Whether or not the process corresponding to the event is application switching is recorded in advance in a database (not shown) held by the application switching control unit 104. The application switching control unit 104 makes a determination against this database. If it is determined that the application is to be switched, the process returns to step S604; otherwise, the process returns to step S601.

  The application switching control unit 104 saves the current application state as a preparation for application switching (step S604). Here, a case where the application switching method in the mobile phone terminal is a pseudo multitask is described. In the case of the above example, the information (URL, browsing position, etc.) of the currently browsed page is saved in the Web browser. Next, an application to be switched according to the previous event is selected (step S605). In the above example, an application for notifying mail recipients and mail titles is selected. Then, switching to the selected application is performed (step S606). In the above example, an application for notifying mail recipients and mail titles (mail arrival notification application) is activated.

  The shape change detection unit 103 determines whether or not the shape change 2 is detected (step S607). If shape change 2 is detected in step S607, the process returns to step S608, and if not, the process returns to S607. Here, the shape change 2 is a shape change opposite to the shape change 1. In the case of the above example, the state changes from the state in which the upper housing 201 and the lower housing 202 are open at an angle θ (or open by θ or more) to the state in which the upper housing 201 and the lower housing 202 are completely opened. It becomes a shape change. That is, when the shape change 2 occurs after the shape change 1, the original shape before the shape change 1 is restored. Next, the state of the saved original application is restored (step S608), the process is switched to the original application and the process ends (step S609). In the case of the above example, the state of the Web browser (open URL, browsing position, etc.) before starting the mail arrival notification application is restored, and the Web browser is started. As described above, the mail incoming application is switched only when the upper casing 201 is moved by θ, the incoming call information can be confirmed, and when the upper casing 201 is returned to the original state, it returns to the originally activated application. Operation is realized.

  According to the first embodiment described above, when an event occurs during execution of an application, information obtained by an event can be obtained simply by moving the movable part of the mobile phone slightly without operating the operation unit 107. Can be viewed. Also, it is possible to quickly return to the original application operation simply by returning the movable part of the mobile phone.

In the above, the mail incoming notification application has been described as an example, but the present invention is not limited to this. Further, the operation may be performed using the operation unit 107 in a state where the application is switched due to the occurrence of the shape change 1. For example, the mail text may be displayed in the mail incoming notification application and can be browsed by scrolling the mail text using the direction keys.
In the above description, the mobile phone terminal having the rotation mechanism has been described as an example. However, the present invention is not limited to this. A similar operation can be realized depending on the movable method of the movable mechanism.
In the above, the operation of switching the application according to the shape change when a predetermined event occurs has been described, but the present invention is not limited to this. The application to be switched does not have to be linked to the event, such as switching to a calendar display application when there is a shape change. As a result, if you want to check the calendar while an application is running, you can check it by moving the movable part of the mobile phone a little. The same applies to other applications.

  In addition, the operations described above can be changed by a user appropriately selecting from a group of operations predetermined in the terminal using a menu or the like. For example, there are a threshold for detecting a shape change, contents of an application to be switched, and contents of a shape change used for switching. The operation group can also be obtained from outside the terminal by accessing the Internet using the communication function of the terminal. It is the same as the current mobile phone can acquire and change the ring tone and menu GUI (graphical user interface) from the outside.

(Modification 1 of the first embodiment)
In the first embodiment described above, the application is switched when there is a predetermined movable change, and when there is a change opposite to the predetermined movable change, that is, when there is a change back to the original shape, the original application is restored. Although the operation has been described, the present invention is not limited to this. However, the present invention is not limited to this, and arbitrary application switching may be performed for any shape change.

For example, an operation as shown in FIG. 7 can be performed.
First, the application switching control unit 104 determines whether or not the shape change 3 is detected (step S701). If the shape change 3 is detected, the process returns to step S702, and if not, the process returns to step S701. Here, for example, as the shape change 3 in S701, the upper housing 201 and the lower housing 202 are closed from a completely opened position to a predetermined angle θ (or more than θ) and then returned to a fully opened position again. Use a series of states.

  Next, the application switching control unit 104 determines whether another application is currently activated or whether there is another application currently saved (step S702), and another application exists. If yes, go to Step S703; otherwise, end. Next, the current application state is saved (step S703), and the next application is selected (step S704). Here, the next application may be determined in any way, but the application to be switched next is determined by managing the currently activated application in the order of use by using a queue or FIFO. Then, switching to the selected application is performed (step S705).

  By doing so, for example, it becomes possible to use a shape change using a movable mechanism of a mobile phone for a task switch application. For example, it is assumed that three applications, e-mail, web browser, and schedule book, are currently being executed, and the currently active application is e-mail. At this time, by moving the mobile phone a little, it is possible to sequentially change the active application to a Web browser, a schedule book,. In Microsoft Windows (registered trademark), it is possible to switch the currently active task by sequentially pressing the “Tab key” while pressing the “Alt key”, but this is the same operation.

(Modification 2 of the first embodiment)
In the first embodiment described above, the operation of switching a single application with respect to a predetermined single shape change has been described. However, the present invention is not limited to this. For example, when the upper housing 201 and the lower housing 202 change by an angle θ1 or more, the application 1 is switched, and when θ2 or more (θ2> θ1) changes, the application 2 is switched, and so on. In addition, the application to be switched may be changed according to the change amount of the shape change.

(Modification 3 of the first embodiment)
For example, when the upper housing 201 and the lower housing 202 change by an angle θ1 or more, the mode is switched to mode 1 of an application, and when θ2 or more (θ2> θ1) is changed, the mode is switched to mode 2 of the same application. The execution state of the application that switches according to the change amount of the shape change may change.

  For example, in the mail arrival notification application, only the recipient information is displayed in the mode 1, the mail title is displayed in accordance with the recipient information in the mode 2, and the mail text is displayed in accordance with the mode 2 in the mode 3. If the upper housing 201 and the lower housing 202 change by an angle θ1 or more with a mode, the mail incoming notification application is switched, but only the recipient information is displayed, and θ2 or more (θ2> θ1) changes. It is possible to realize an operation such as displaying not only the callee information but also the mail title. Thereby, the information to be obtained can be controlled by changing the mode of the application to be switched according to the movable amount of the movable part of the mobile phone terminal.

  This usage is useful when you don't want to leak too much private information. When the mobile phone is opened large (the angle formed by the upper casing 201 and the lower casing 202 is large), the screen appearance (FIG. 8 (a)) is small (the upper casing 201 and the lower casing 202 are formed). FIG. 8B shows an example of how the screen appears when only the angle is small (see FIG. 8B). It can be seen that the screen in FIG. 8A is better seen from the periphery, and the screen content is more difficult to see in FIG. 8B.

If you use this relationship well, if you don't close your phone too much, you will only see if there is an incoming call by switching applications, and if you only open your phone small, you will see the sender, email title, and body By doing so, the information displayed on the screen can be changed depending on how the mobile phone is opened (closed). In other words, if there is a person around and you do not want to see the contents of the mail, change the mobile phone to a small open state as shown in FIG. 8B, and send information such as the sender, mail title, and text. It is possible to browse secretly.
As described above, the amount of information displayed on the screen can be controlled sensuously by the amount of mobile phone movement.

(Modification 4 of the first embodiment)
A screen display processing apparatus according to Modification 4 of the first embodiment will be described with reference to FIG.
The screen display processing apparatus of this modification is obtained by adding a display position / size control unit 901 and a display position / size changing unit 902 to the screen display processing apparatus of the first embodiment.

The display position / size control unit 901 controls the screen display position and size of the application based on the parameter amount acquired by the movable parameter acquisition unit 102.
The display position / size changing unit 902 changes the screen display position and size of the application according to the control content of the display position / size control unit 901.

<Display Position / Size Control Unit 901, Display Position / Size Change Unit 902>
Specifically, the display position / size control unit 901 is a display screen of an application that is switched and operated by the application switching control unit 104 and the application operation unit 105 according to the parameter amount acquired by the movable parameter acquisition unit 102. Control the size and position of the.

  Consider a situation in which an application is switched to a clock application that superimposes and displays time on a part of the screen due to a change in the shape of the movable part of the mobile phone terminal during execution of an application. This is shown in FIG. Due to a certain shape change, the display of the clock application is superimposed on the center of the screen. At this time, as shown in FIG. 8B, when the mobile phone is opened only relatively small, it is difficult to see the display as shown in FIG. This modification is implemented in view of such a situation, and allows the position and size of the screen display of the application to be controlled according to the parameter amount acquired by the movable parameter acquisition unit 102. It is.

Specifically, for example, when the angle formed by the upper housing 201 and the lower housing 202 is small, the display position is shifted in proportion to the screen information as shown in FIG. To make it larger. The display size and display position can be represented by functions such as f (θ) and g (θ), respectively, where the movable parameter is θ. The functions f and g are determined in advance and stored in a database (not shown) referred to by the display position / size control unit 901. The display position / size control unit 901 acquires the functions f and g by referring to the database, and calculates the size and position from this and the parameter amount. The content of the function can be changed as appropriate according to the usage scene, and any function can be used. Note that although an example in which the movable parameter is one-dimensional has been described here, it is generally an n-dimensional vector. Further, f and g are functions for calculating a size and a position, respectively, using an n-dimensional vector as an input.
As described above, the display position and size can be appropriately changed according to the degree of change in the shape of the mobile phone terminal, and an easy-to-see display can be provided even if the shape changes.

(Modification 5 of the first embodiment)
A screen display processing apparatus according to Modification 5 of the first embodiment will be described with reference to FIGS.
The screen display processing device of this modification is obtained by adding a display switching unit 1101, a first display unit 1102, and a second display unit 1103 to the screen display processing device of the first embodiment.

  The display switching unit 1101 switches the display unit that displays the operation result and state in the application operation unit 105 and the screen of the application to the first display unit 1102 or the second display unit 1103.

<First display portion 1102 and second display portion 1103>
Many recent mobile phone terminals often have two or more display units. In the first embodiment, the display unit 106 does not particularly distinguish which display unit of the mobile phone. That is, the same implementation was possible regardless of which display unit was selected.

  In this modification, the display units are distinguished. FIG. 12 shows an example of a mobile phone terminal. Recent two-fold type mobile phone terminals usually have a relatively large screen (liquid crystal screen) called a main screen and a sub-screen arranged outside the mobile phone terminal (usually the back side of the main screen). (Also referred to as a rear screen). The first display unit 1102 is, for example, a main screen, and the second display unit 1103 is, for example, a sub screen.

  Here, an example in which the first display unit 1102 is a main screen and the second display unit 1103 is a sub-screen is shown, but the present invention is not limited to this. Further, when there are three or more screens, two of them may be selected as the first display unit 1102 and the second display unit 1103. Note that the functions of the first display unit 1102 and the second display unit 1103 are the same as those of the display unit 106 described in the first embodiment.

<Display switching unit 1101>
The display switching unit 1101 switches the display screen on the application operation unit 105 between the first display unit 1102 and the second display unit 1103. At this time, it is used as a judgment material for switching the parameter amount acquired by the movable parameter acquisition unit 102 and / or the shape change result detected by the shape change detection unit 103.

Next, the difference in the appearance of the screen according to the angle formed by the upper housing and the lower housing in the two-fold mobile phone terminal will be described with reference to FIG.
FIG. 13A shows a case where the angle formed is large, and the first display unit 1102 can be seen, but the second display unit 1103 cannot be seen. On the other hand, FIG. 13B shows a case where the angle formed is small. Conversely, the second display portion 1103 can be seen, but the first display portion 1102 cannot be seen. In other words, in the case of this example, the display unit that is always visible by appropriately switching the display unit to the first display unit 1102 and the second display unit 1103 according to the angle formed by the upper housing and the lower housing. It is possible to display the display contents.

Specifically, in the case of this example, if the angle θ formed is if θ> TH then the first display unit is selected, else the second display unit is selected, and the selection destination is determined. Here, TH is a threshold for switching. Note that this switching destination calculation method is merely an example, and an optimal calculation method may be used as appropriate based on the shape of the mobile phone terminal, the configuration of the movable mechanism, and the like.
As described above, according to the effect of the first embodiment, it is possible to browse information by selecting a screen that is easier to view.

<Display content change section>
Note that the display performance may differ between the first display unit 1102 and the second display unit 1103. When the first display unit 1102 is a main screen and the second display unit 1103 is a sub-screen, the main screen usually has a large number of inches and a high resolution. In comparison, sub-screens are often smaller in inches and lower in resolution. Also, the reaction rate is often low.

  In such a case, as shown in FIG. 14, a display content changing unit 1401 is further added to the screen display processing device of FIG. 11, and the display is performed according to the performance difference between the first display unit 1102 and the second display unit 1103. The problem can be solved by changing the content and displaying the changed display content on the second display unit 1103.

  Specifically, for example, when the resolution of the second display unit 1103 is lower, the screen display content of the application operation unit 105 is changed so that only a part of the content is displayed. In addition, the display layout may be changed, or the display character size may be changed. The content of the change is not limited to this, and various means can be used.

(Modification 6 of the first embodiment)
A screen display processing apparatus according to Modification 6 of the first embodiment will be described with reference to FIG.
The change from the first embodiment is that the application switching control unit 104 is changed to a light amount change control unit 1501 and a light emitting unit 1502 is newly added.

<Light Emitting Unit 1502>
The light emitting unit 1502 changes a display light amount (display brightness) of the display unit 106 and is a so-called backlight. The amount of light emission can be changed in several stages. The display brightness of the display unit 106 is determined by the light emission amount of the light emitting unit 1502.

<Light quantity change control unit 1501>
The light quantity change control unit 1501 uses the information on the presence or absence of the shape change detected by the shape change detection unit 103 and the value of the movable parameter acquired by the movable parameter acquisition unit 102 to use the mobile terminal. Control the functions installed in the device. In the present embodiment, the light amount change control unit 1501 is for determining the light emission amount of the light emitting unit 1502.

  At the same time, the light amount change control unit 1501 uses the information “existing” or “none” of the shape change detected by the shape change detecting unit 103 and the value of the movable parameter acquired by the movable parameter acquiring unit 102. Controls the color scheme, contrast, display size, etc. of the application operation screen. In response to the control content from the light quantity change control unit 1501, the application operation unit 105 changes the color scheme, contrast, display size, and the like of the operation screen of the application and outputs the change to the display unit 106.

<Overall operation>
As described above, in the screen display processing device according to the sixth modification, the light emission amount of the light emitting unit 1502 can be changed according to the shape change of the movable mechanism of the mobile phone terminal. This is linked to the change in the light emission amount of the display unit 106 as a result. By changing the amount of light emission, it becomes possible to perform display that is easy to see according to the amount of light in the environment.

In addition, the color arrangement, contrast, display size, and the like of the display screen of the application displayed on the display unit 106 can be changed according to the change in the shape of the movable mechanism of the terminal. By changing the color scheme and contrast, it is possible to perform a display that is easy to see even in a dark place or a display that is easy to see even in a bright place. The method of changing the color arrangement and contrast is not particularly limited in the embodiment, and various existing methods can be used. It is also possible to change the visibility in a dark place by changing the display size of the display screen of the application.
FIG. 16A shows an example in which the size of the display area is reduced without changing the character size in FIG. 16A, and FIG. 16B shows an example in which the size of the display area is reduced by changing the character size. . In either case, if you change the size of the display area and make the area outside the area not drawn (for example, the area drawn in black), the overall bright area decreases and the average brightness of the entire screen decreases. . This makes it easier to see even in dark places. In addition, what was demonstrated individually is an example to the last, and various methods can be used together.

  As described above, it is possible to change the light emission amount of the light emitting unit 1502 and change the color scheme, contrast, display size, and the like of the display screen of the application displayed on the display unit 106. There is an effect that it becomes possible to perform. The effect is increased by using both of these simultaneously.

  Here, consider a situation where a mobile phone is used in a dark place. For example, assume that an e-mail is received by a mobile phone while watching a movie in a movie theater. In such a case, when trying to check the mail by opening the mobile phone, the light emitting unit 1502 usually emits light and the content of the display unit 106 is displayed brightly the moment the mobile phone is opened. If you do this in the dark, a lot of light leaks around, and the people around you get annoyed by the glare from the light. Especially in places like movie theaters, when people in the vicinity perform such actions, the inconvenience caused by the light leakage is significant.

  Modification 6 of the first embodiment aims to solve such a problem, and changes in the light emission amount of the light emitting unit 1502 and display on the display unit 106 in accordance with the shape change of the movable mechanism of the terminal. By simultaneously changing the color scheme, contrast, display size, etc. of the display screen of the application to be displayed, an environment is provided in which light leakage to the surroundings is reduced as much as possible and necessary information can be browsed.

  Specifically, for example, the amount of light is increased in proportion to the amount of the angle θ formed by the upper casing 201 and the lower casing 202. When θ is small, the amount of light is small. When θ is large, the amount of light is large, and the maximum amount of light is obtained with the upper housing 201 and the lower housing 202 fully opened. The amount of light may be changed so as to increase linearly in proportion to the increase of θ, or may be changed by other methods.

  In this way, as shown in FIG. 8B, if the mobile phone is kept relatively small, the light emitting unit 1502 emits light with a small light emission amount, and the display unit 106 is displayed darkly. It will be. As described in the third modification of the first embodiment, if the mobile phone is kept relatively small, the screen seen from the periphery is small (see the above description with reference to FIG. 8B). Therefore, the light leakage is reduced, but this effect is great because the light emission amount is controlled to be reduced accordingly. The inventors have called the function of suppressing the amount of light in order to prevent the trouble caused by light leakage in the dark as the “light amount manner mode”. This embodiment is very suitable for realizing this light quantity manner mode.

In addition, although the example which increases a light quantity in proportion to (theta) was demonstrated above, it is not limited to this. On the contrary, the light amount may be increased in inverse proportion to θ, and other light amount changes may be performed.
Furthermore, the effect can be further increased by simultaneously applying a change in display size or a change in contrast as shown in FIG. 16 according to θ.

(Modification 7 of the first embodiment)
A screen display processing apparatus according to Modification 7 of the first embodiment will be described with reference to FIG.
The screen display processing apparatus according to this modification is obtained by adding a screen display change on / off unit 1701 to the screen display processing apparatus according to modification 6 of the first embodiment.

  The screen display change on / off unit 1701 changes the light emission amount of the light emitting unit 1502 according to the shape change by the movable mechanism in the screen display processing device according to the sixth modification of the first embodiment, and the application displayed on the display unit 106 This is for switching whether to change (on) or not (off) the color scheme, contrast, display size, etc. of the display screen.

  The screen display change on / off unit 1701 is realized by using a button that already exists in the operation unit 107 or a newly added button. For example, ON and OFF are sequentially switched by pressing a button.

  When realizing the “light quantity manner mode” as described above, it is desirable to use a manner mode button already present in the operation unit 107 as the screen display change on / off unit 1701. The manner mode button still has various modes. As one of the modes, the function of the screen display processing device according to the modification 6 of the first embodiment is assigned, and the manner mode button is the same as other modes. It is realized by handling with. In this case, the light amount manner mode function is treated as one of the manner mode modes, and on / off is set from the menu displayed when the manner mode is pressed, or a set of several manner modes is created (this In addition, a light amount manner mode function is included), and the manner mode is turned on and off by pressing the manner mode.

(Second Embodiment)
<Overall configuration>
A screen display processing apparatus according to the second embodiment will be described with reference to FIG.
The screen display processing apparatus according to the present embodiment includes an attitude information acquisition unit 1801, an attitude change detection unit 1802, an application switching control unit 1803, an operation unit 107, an application operation unit 105, and a display unit 106.

The attitude information acquisition unit 1801 acquires the attitude of at least one casing that constitutes the terminal.
The posture change detection unit 1802 detects a change in the posture of the terminal from at least one piece of posture information acquired by the posture information acquisition unit 1801.
The application switching control unit 1803 operates on the terminal using the “changed” or “not present” information of the posture change detected by the posture change detection unit 1802 and the posture information acquired by the posture information acquisition unit 1801. Control to switch the active application.

<Attitude information acquisition unit 1801>
Specifically, posture information acquisition section 1801 installs at least one or more posture detection sensors in at least one or more housings that constitute the terminal, and uses these to acquire the posture information of the terminal. The posture detection sensor is realized by using at least one of an inclination sensor, an acceleration sensor, an angular velocity sensor (gyro sensor), a magnetic sensor, and the like. The sensors listed here are merely examples, and may be posture detection sensors using other means.

Since the sensor mounting position, the number of mounting terminals, the mounting direction, etc. of the terminal are already known, the current posture information of the terminal can be obtained by using this and information from the sensor.
The posture information may be output individually for each posture detection sensor, or divided into several groups, the posture information within each group is calculated by some function, and the posture information for each group Or may be calculated as some total posture information by some function. The function is determined in advance by taking into account information such as the sensor attachment position, the number of attachments and the attachment direction of the terminal.

<Attitude change detection unit 1802>
The posture change detection unit 1802 detects a change in the posture of the terminal, and the posture change detection method used here is substantially the same as that of the first embodiment of the present invention described above. The posture change detection unit 1802 determines whether or not there is a change in posture based on posture information indicating the posture of one or more housings that constitute the mobile terminal device. For example, it is assumed that information from a three-axis posture detection sensor is obtained from the posture information acquisition unit 1801. If this is v = (vx, vy, vz), v is a vector quantity. If the reference posture information is v0 = (vx0, vy0, vz0), the magnitude of the difference, that is,
|| v-v0 ||> TH
When it becomes, it can be considered that the posture has changed. Here, TH is a predetermined threshold value, and || · || is an L2 norm. By doing so, it is possible to detect a change in posture from a certain reference posture. In addition, the detection method demonstrated here is an example to the last, and is not limited to this. Various methods described in the first embodiment described above can be used in the same manner, and methods other than those described here may be used.

<Application switching control unit 1803>
The application switching control unit 1803 operates on the terminal using the “changed” or “not present” information of the posture change detected by the posture change detection unit 1802 and the posture information acquired by the posture information acquisition unit 1801. It is for performing control to switch the application.

  Note that the operation of the application switching control unit 1803 is substantially the same as that of the first embodiment described above. In the description of the application switching control unit 104, if the shape change detection result is changed to the posture change detection result and the movable parameter information is changed to the posture information as appropriate, the operation of the shape change detection unit 103 is described.

<Overall operation>
In the first embodiment, it has been explained that the application can be switched by using the change in the shape of the mobile phone terminal. In the second embodiment, similarly, the same change can be made by using the change in the posture of the mobile phone terminal. An effect can be realized.

(Modification 1 of 2nd Embodiment)
Modifications similar to Modifications 1 to 7 of the first embodiment can be employed in the second embodiment. At this time, the same effect can be obtained by replacing the shape change in the modification of the first embodiment with the posture change.

(Third embodiment)
<Overall configuration>
A screen display processing apparatus according to the third embodiment will be described with reference to FIG.
The screen display processing apparatus of this embodiment includes an attitude information acquisition unit 1801, an attitude change detection unit 1802, a screen browsing direction estimation unit 1901, a display information conversion control unit 1902, a display information conversion unit 1903, and the display unit 106.

The screen browsing direction estimation unit 1901 estimates the direction in which the terminal user is browsing the terminal screen from at least one piece of posture information acquired by the posture information acquisition unit 1801.
The display information conversion control unit 1902 displays the “changed” or “not” information of the posture change detected by the posture change detection unit 1802, the posture information acquired by the posture information acquisition unit 1801, and the screen browsing direction estimation. Control for conversion of display information of the terminal is performed using information on the screen viewing direction estimated by the unit 1901.
The display information conversion unit 1903 converts the display information of the terminal according to the control content in the display information conversion control unit 1902.

<Screen viewing direction estimation unit 1901>
As described above, the screen viewing direction estimation unit 1901 uses at least one or more pieces of posture information acquired by the posture information acquisition unit 1801 and known information such as the sensor attachment position, the number of attachments, and the attachment direction of the terminal. Thus, it is possible to detect the attitude of the terminal. The screen browsing direction estimation unit 1901 first calculates the posture information of the display unit 106 using the detected posture information and information on the positional relationship between the known posture detection sensor and the display unit 106.

  With this and the assumption that the terminal user is viewing the screen facing the screen, usually in a vertical position (when standing or sitting in a chair) The direction in which the screen of the unit 106 is viewed is estimated. This will be described with reference to FIG. FIG. 20A shows an example in which the terminal is viewed in the normal direction. At this time, it is assumed that the posture of the display unit 106 is detected to be, for example, upward (attitude where the angle with the vertical direction is 0 degree). In the case of this and the above assumption (the state like the person shown in FIG. 20), it is estimated that the user is browsing the screen upward (the angle formed with the vertical direction is 0 degree). Similarly, FIG. 20B assumes that the user is viewing the terminal in the reverse direction (attitude of 180 degrees with respect to the vertical direction). Similarly, in FIG. 20 (c), it is assumed that the user is viewing the terminal sideways, more specifically, rightward (attitude of 90 degrees with respect to the vertical direction). Similar assumptions hold for any posture.

  Note that the estimation method from the posture information described above is merely an example, and the present invention is not limited to this. It can be estimated using arbitrary posture information. It is also possible to use assumptions other than those described above, and it is also possible to change some assumptions by preparing some assumptions in advance and allowing the user to select them.

<Display information conversion control unit 1902>
Specifically, when the posture change detection unit 1802 detects a posture change, the display information conversion control unit 1902 is estimated by the posture information acquired by the posture information acquisition unit 1801 and the screen browsing direction estimation unit 1901. Using the information on the screen viewing direction, for example, control is performed to convert the display content so as to always face the normal direction (upward) in accordance with the screen viewing direction of the user. FIG. 21 shows this state. As shown in FIG. 21, in the conventional mobile phone terminal, since the display direction is fixed, if the mobile phone terminal is not viewed in the correct direction (the direction of FIG. 21A), the displayed information is displayed. It was difficult to see (see the conventional display in the right column of FIG. 21). By changing the display content so that it always faces the normal direction (upward) according to the user's screen viewing direction, it can be viewed as display information that always faces the same direction regardless of the screen viewing direction of the terminal. (Refer to the display example in the present invention in the middle row of FIG. 21). At this time, for example, the display information conversion control unit 1902 may rotate the characters displayed on the screen by −θ from the information that the screen browsing direction estimated by the screen browsing direction estimation unit 1901 is θ degrees. A control signal for performing such conversion is sent to the display information conversion unit 1903.

<Display information conversion unit 1903>
Specifically, for example, the display information conversion unit 1903 performs rotation conversion of the display content as instructed by the rotation conversion control of the display content received from the display information conversion control unit 1902 and outputs the display content to the display unit 106. . Thereby, the display as shown in FIG. 21 is realized.

  In the above description of the display information conversion control unit 1902 and the display information conversion unit 1903, an example of rotation conversion has been described. However, the present invention is not limited to this, and arbitrary conversion control can be performed. is there.

<Overall operation>
In the third embodiment described above, the display content of the screen can be changed according to the attitude of the mobile phone terminal and / or the attitude change. This makes it possible to browse display information without worrying about the attitude of the mobile phone terminal.

Here, for example, a situation in which a mobile phone is stored in a bag as shown in FIG. 22 and the mobile phone is taken out of the bag to check the time will be described. Recently, there are many people who use a mobile phone as an alternative to a watch and do not carry other watches. In such a case, when holding and taking out the mobile phone in the bag, usually, somehow put the hand into the bag, find the mobile phone by touch without looking at the mobile phone, and take it out. There are many cases. In this case, the cellular phone taken out often faces in various directions. Also, even when looking for a mobile phone by looking inside the bag and taking it out, the mobile phone is not always pointing in a specific direction, so if you grab it and take it out, in many cases the same as above Facing the wrong direction.
22 (a), 22 (b), and 22 (c) illustrate how the cellular phone is taken out upward, downward, and sideways. The above story is the same even when the mobile phone is taken out in the pocket of the pants. That is, when the mobile phone is taken out from somewhere, as shown in FIG. 22, the posture when the user takes out often differs depending on the posture in which the mobile phone is stored. When checking the time displayed on the screen in such a situation, it is difficult to see the displayed characters because the screen viewing directions are various as they are. This is as described in FIG. Normally, after that, the mobile phone is held again in a direction in which the screen is easy to see (hereinafter referred to as a correct direction), that is, in the direction as shown in FIG. (D), FIG. 22 (e)). This is because the mobile phone is normally displayed on the screen so that the screen can be read correctly in a state as shown in FIG. 22A (a state held in the correct direction).

  That is, conventionally, when it is desired to use a mobile phone in such a state, the mobile phone is used by taking it out of a bag and holding the mobile phone again in the correct direction. However, this has the problem that it takes too much time and effort to access information (here, time) in order to realize a simple request to confirm the time. In such a case, if the information can be accessed in an easy-to-view state with the mobile phone terminal taken out, that is, as shown in FIG. Is solved. Furthermore, even if the mobile phone is not taken out of the bag, if the mobile phone is searched for in the bag and the screen can be seen, the time can be quickly confirmed, which can be said to be more effective.

  The above explanation is merely an example of a usage method, but it is possible to change the display content of the screen according to the attitude of the mobile phone terminal and / or the attitude change, and care about the attitude of the mobile phone terminal. The effect of viewing the display information without any problems is very large.

In the above description, the orientation and the viewing direction are described as one-dimensional for convenience, but the present invention is not limited to this. This may be two-dimensional, three-dimensional, or higher.
In the above description, an example of the conversion by the display information conversion control unit 1902 and the display information conversion unit 1903 is shown as conversion by one-dimensional parameters by using rotation as an example, but the present invention is not limited to this. For example, when considering three-dimensional posture information, the display unit 106 appears to be distorted like a trapezoid because there is a fluoroscopic component in the depth direction as shown in FIG. , Exaggerated shape for illustration). In such a case, the information displayed on the screen, for example, characters are viewed as having a similar trapezoidal distortion as shown in FIG. In view of such a situation, as shown in FIG. 23C, if conversion control and processing for converting characters into an inverted trapezoid are performed by the display information conversion control unit 1902 and the display information conversion unit 1903, FIG. In this way, even if the display unit 106 is viewed from an oblique direction, it is possible to view characters without distortion. In this way, processing that performs affine transformation in which parameters change according to the attitude of the terminal is also effective.

  For the same reason, in the case as shown in FIG. 23, the size of the observed character is different on the near side (the lower side of the screen) and the far side (the upper side of the screen) as viewed from the viewer of the screen (the same). Even if characters of a size are displayed, the front side is large and the back side is small), and it is also effective to align this according to the attitude of the terminal. In addition, since the front side is easier to see, it is also effective to change the layout of the screen display information so that important information is brought to the front by changing the layout of the screen display information. Furthermore, as described with reference to FIG. 16, a conversion process such as changing the size of the display area is also highly effective. In addition to this, various conversions can be considered.

(Modification 1 of 3rd Embodiment)
Modification 1 of the third embodiment of the present invention includes a camera function unit 2401 and a camera information analysis unit 2402 as shown in FIG. 24 in addition to the screen display processing device of the third embodiment of FIG. Instead of the screen browsing direction estimation unit 1901, a screen browsing direction estimation unit 2403 is included.

The camera function unit 2401 is a function for realizing a camera, and acquires image information (for example, a still image) from the outside world.
The camera information analysis unit 2402 analyzes image information captured by the camera function unit 2401.
The screen browsing direction estimation unit 2403 uses the analysis result of the camera information analysis unit 2402 and at least one or more posture information acquired by the posture information acquisition unit 1801 to estimate the user's screen browsing direction. .

<Camera information analysis unit 2402>
Specifically, the camera information analysis unit 2402 analyzes a face-like region, a direction in which the face is facing, and the like from image information using a computer vision technique such as face recognition. Thereby, when the user is reflected in the shootable range of the camera provided in the mobile phone terminal, it is possible to know the face position of the user. Using the analyzed face position information, face direction information, and the like, and the posture information of the display unit 106 described above, it is possible to estimate a more detailed screen viewing direction of the user. Specifically, the orientation vector with the user's face can be calculated from the camera from the face position and direction information reflected in the camera. By using this and information on the positional / posture relationship between the camera function unit 2401 and the display unit 106, it is possible to estimate the orientation vector with the user's face from the display unit 106.

  In the third embodiment, the terminal user usually views the screen while facing the screen in a vertical state (when standing or sitting on a chair). Although it is necessary to guess the direction in which the screen of the display unit 106 is viewed using the assumption, the screen viewing direction estimation unit 2403 is obtained without this assumption by adding a configuration like the first modification. Makes it possible to make a guess.

  In addition, although the example of the screen browsing direction estimation using face recognition was shown above, it is not limited to this. For example, when the sky, fluorescent light, or ceiling-like part is recognized from the image information captured by the camera function unit 2401, the camera function unit 2401 can be regarded as facing upward, and conversely, the floor or user's When the foot is recognized, the camera function unit 2401 can be regarded as facing downward. You may make it guess the attitude | position of a screen using this. Even if the user's face is not recognized, if the hair or part of the body is photographed, it is possible to guess the screen viewing direction for the user based on this.

(Modification 2 of the third embodiment)
In Modification 2 of the third embodiment of the present invention, in addition to the screen display processing device of the third embodiment of FIG. 19, as shown in FIG. 25, a holding information acquisition unit 2501 and a holding information analysis unit 2502 are provided. In addition, a screen browsing direction estimation unit 2503 is included instead of the screen browsing direction estimation unit 1901.

The holding information acquisition unit 2501 acquires holding information of the terminal.
The holding information analysis unit 2502 analyzes the holding information acquired by the holding information acquisition unit 2501.
The screen browsing direction estimation unit 2503 estimates the user's screen browsing direction using the analysis result of the holding information analysis unit 2502 and at least one or more pieces of posture information acquired by the posture information acquisition unit 1801. .

<Retention Information Acquisition Unit 2501 and Retention Information Analysis Unit 2502>
Specifically, the retained information acquisition unit 2501 is realized using a touch sensor or the like. At least one or more touch sensors are arranged in at least one casing constituting the terminal, and using this, information (holding position, holding area, holding direction, holding direction, Get the holding angle. The touch sensor acquires the coordinate value of the touched part. For example, when a plurality of coordinate values are acquired by one touch sensor, a region where the coordinate values are connected can be regarded as a holding area. Note that there are touch sensors that recognize only one finger or the like with one sensor, and those that have a plurality of recognition units in one sensor and recognize a plurality of fingers or the like.

  The holding information analysis unit 2502 analyzes in what form the terminal user holds the terminal based on the holding information. For example, the terminal is held only on the right side, or is held to surround the lower housing. Using this information further, the screen browsing direction estimation unit 2503 estimates the screen browsing direction.

  Similar to the effect of the first modification of the third embodiment, since it becomes possible to know how the terminal is held, the terminal user usually keeps his head in a vertical state (standing up It is possible to infer the screen viewing direction without relying on the assumption that the screen is viewed facing the screen when the user is sitting or sitting on a chair. The estimation can be performed using an arbitrary method. For example, it is estimated that the place where the value of the touch sensor is large (for example, the center of gravity of the sensor value) is the downward direction of the terminal, and from the attitude information of the terminal The viewing direction is calculated assuming the holding posture of the user. At this time, it is more effective if the user's listener information and the like are previously input to the terminal and used.

(Fourth embodiment)
<Overall configuration>
A screen display processing apparatus according to the fourth embodiment will be described with reference to FIG.
The screen display processing apparatus of this embodiment includes an orientation information acquisition unit 1801, a screen browsing direction estimation unit 2601, a display information conversion control unit 2602, a display information conversion unit 1903, a movable mechanism unit 101, a movable parameter acquisition unit 102, and a shape change detection. Part 103 and display part 106.

The screen viewing direction estimation unit 2601 allows the terminal user to view the terminal screen from the movable parameters acquired by the movable parameter acquisition unit 102 and / or at least one or more pieces of posture information acquired by the posture information acquisition unit 1801. Guess the direction you are.
The display information conversion control unit 2602 includes information on “present” or “none” of the shape change detected by the shape change detection unit 103, the movable parameter information acquired by the movable parameter acquisition unit 102, and the screen viewing direction. Control for conversion of display information of the terminal is performed using information on the screen viewing direction estimated by the estimation unit 2601.

<Screen viewing direction estimation unit 2601>
The screen viewing direction estimation unit 2601 uses the movable parameter acquired by the movable parameter acquisition unit 102 to acquire posture information including the position of the display unit 106 and the direction it is facing according to the change in the shape of the terminal. Is possible.
In addition, as described in the third embodiment, by using at least one or more pieces of posture information acquired by the posture information acquisition unit 1801 and known information such as the sensor attachment position, the number of attachments, and the attachment direction of the terminal. It is possible to detect the attitude of the terminal. The screen browsing direction estimation unit 2601 calculates the posture information of the display unit 106 by comprehensively using the acquired information.

<Display information conversion control unit 2602>
Unlike the display information conversion control unit 1902 of the third embodiment, the display information conversion control unit 2602 uses posture information and posture change information, whereas the display information conversion control unit 1902 uses movable parameter information and shape change. Information is used. The other points are the same. That is, various effects such as being easy to see the screen viewing direction estimated by the screen viewing direction estimation unit 2601 according to the shape change according to “Yes” or “No” of the shape change of the mobile phone terminal. It is characterized by performing control for conversion of display information for production.

<Overall operation>
In the fourth embodiment described above, the display content of the screen can be changed in accordance with the shape change of the mobile phone terminal and / or the shape at the time according to the shape change. it can. Thereby, when providing a screen display according to the change in the shape of the mobile phone terminal, it is possible to view the display information without worrying about the attitude of the mobile phone terminal at that time.

For example, FIG. 27 shows an example in which the shape change of the mobile phone terminal is performed in a different posture.
FIG. 27A shows a case where the mobile phone terminal is opened with the lower housing 202 facing down, that is, the angle formed by the upper housing 201 and the lower housing 202 is changed using the movable mechanism 101. FIG. 27B shows a case where the mobile phone terminal is opened with the upper casing 201 down, that is, when the angle formed by the upper casing 201 and the lower casing 202 is changed using the movable mechanism 101. is there. At this time, in FIG. 27A, the screen viewing direction and the display direction of the display unit 106 are the same, but in FIG. 27B, it is understood that the screen viewing direction is opposite (rotated by about 180 degrees). In this situation, as described in the first embodiment, when the screen information is changed according to the shape change, if the posture information acquired by the posture information acquisition unit 1801 is used together, As described in the third embodiment, for example, the display direction of the display unit 106 is converted in accordance with the direction estimated by the screen browsing direction estimation unit 2601 so that the user can easily view the display unit 106 in the same posture. Screen display can be performed. The present embodiment aims at this effect.

  By doing this, for example, if you want to check the time on a folded phone that does not have a sub-screen (back screen), open the phone a little without worrying about the orientation of the phone, It is possible to check the time by looking through the screen (as shown in FIGS. 27A and 27B). The inventors refer to such an information browsing method as “a little look”, but such an information browsing method allows easy access to information and is described in Modification 6 of the first embodiment. It also has an element of the light quantity manner mode, which is very effective.

(Modification 1 of 4th Embodiment)
As shown in FIG. 28, the present modification is a case where the posture information acquisition unit 1801 is omitted from the screen display processing apparatus of the fourth embodiment. In this case, it is the same as that of the fourth embodiment, except that the screen viewing direction of the user is estimated from the shape and information on the shape change.

  In the fourth embodiment, the first to third embodiments and the modifications in each can be used in appropriate combination, and the effects thereof have been described in the respective embodiments and modifications. This is very effective because it is a synergistic effect of the effects of the fourth embodiment.

(Fifth embodiment)
<Overall configuration>
The fifth embodiment of the present invention has a configuration in which a peripheral environment information acquisition unit 2901 for acquiring peripheral environment information is further added to the first to fourth embodiments.

<Ambient environment information acquisition unit 2901>
The peripheral environment information acquisition unit 2901 is for acquiring information on the amount of light in the peripheral environment, and is realized by using, for example, a light meter, an illuminometer, a luminance meter, an optical sensor, a photodiode, or the like. The surrounding environment information acquisition unit 2901 can know the brightness of the surrounding environment of the terminal.

  When the surrounding environment information acquisition unit 2901 is added to the first embodiment (FIG. 29) (or the second embodiment (FIG. 30)), the surrounding environment information acquisition unit 2901 includes the application switching control unit 104 (second In the embodiment, the acquired surrounding environment information is transmitted to the application switching control unit 1803 (the same applies hereinafter), and the application switching control unit 104 determines the control contents in consideration of the surrounding environment information in addition to the conventional information. . For example, the application switching control unit 104 performs control such as changing the application to be switched, changing the mode of the application, or changing the screen layout of the application according to the brightness of the surrounding environment.

  When the surrounding environment information acquisition unit 2901 is added to the modification 6 of the first embodiment, the surrounding environment information acquisition unit 2901 transmits the acquired surrounding environment information to the light amount change control unit 1501, and the light amount change control unit 1501 In addition to the conventional information, the control contents are determined in consideration of the surrounding environment information. For example, when the brightness of the surrounding environment is dark, the control is such that the light emission amount is reduced.

  When the surrounding environment information acquisition unit 2901 is added to the third embodiment (FIG. 31) (or the fourth embodiment (FIG. 32)), the surrounding environment information acquisition unit 2901 has acquired the display information conversion control unit 1902. The surrounding environment information is transmitted, and the display information conversion control unit 1902 determines the control content in consideration of the surrounding environment information in addition to the conventional information. For example, control is performed such as changing a display layout, a display area size, a conversion method such as a shape of display information, and the like according to the brightness of the surrounding environment.

  In addition, although the example implement | achieved using the light meter, the illumination meter, the luminance meter, the optical sensor, the photodiode etc. was shown above, it is not limited to this. You may implement | achieve using the camera function with which the mobile telephone terminal was equipped. In this case, it can be realized by using the average luminance of the photographing information of the camera.

(Sixth embodiment)
<Overall configuration>
The sixth embodiment has a configuration in which a screen browsing direction control unit 3301 for controlling the browsing possible direction of the terminal screen is added to the first to fourth embodiments. The drawings of this embodiment corresponding to the first to fourth embodiments are FIGS. 33 to 36.

<Screen viewing direction control unit>
Specifically, the screen browsing direction control unit 3301 controls the direction in which the screen provided on the display unit 106 of the terminal can be seen. For example, it can be seen from the front (near the normal direction of the screen) but cannot be seen when the angle with the screen is small (the angle with the normal direction of the screen is large). It is just like a mobile phone privacy filter. The control may be the reverse of the above.

  The screen browsing direction control unit 3301 can be realized by using a liquid crystal or a digital lens whose direction in which light passes changes depending on the applied voltage, for example. It can also be realized by arranging a slit mechanism (for example, realized with liquid crystal) that can control the slit pattern between the liquid crystal and the backlight, and changing the slit pattern. The realization method is not limited to this, and any realization method may be used.

  According to the present embodiment, for example, when this configuration is added to the third embodiment (FIG. 35), the screen is changed so that it is easy to see from the viewing direction of the user in accordance with the change in the attitude of the terminal. However, at this time, it can be viewed from the viewing direction of the user, but cannot be viewed from other directions. In this way, the user can easily see the information easily, but there is no worry that the information can be seen by anyone other than the viewer, and it is safe even if private information is displayed. In addition, the fact that the information cannot be seen by anyone other than the viewer means that, in other words, the screen emits light and cannot be seen outside the viewer direction. I can say that.

(Modification 1 of 6th Embodiment)
The screen display processing apparatus of this embodiment includes a screen browsing direction information control unit 3701 and a screen display information switching unit 3702 instead of the screen browsing direction control unit 3301. The drawings of this modification corresponding to the first to fourth embodiments are FIGS. 37 to 40.

  The screen browsing direction information control unit 3701 controls the screen information displayed on the screen to be different depending on the browsing direction of the terminal screen. For example, when the display unit 106 is viewed from the right side and from the left side, different contents are displayed on the screen. The screen viewing direction information control unit 3701 performs control so as to present different display contents according to a plurality of viewing directions on the screen of the mobile terminal device.

  The screen display information switching unit 3702 switches the content displayed on the display unit 106 according to the control content in the screen viewing direction information control unit 3701. The screen display information switching unit 3702 switches the content displayed on the display unit 106 according to the viewing direction of the user. For example, it can be realized by arranging a lenticular lens in the upper part of the screen, or arranging a slit mechanism (for example, realizable with liquid crystal) that can change the slit pattern between the screen and the backlight.

  According to the first modification of the sixth embodiment of the present invention, for example, when this configuration is added to the fourth embodiment, the information visible on the screen changes according to the viewing direction of the user. be able to. For example, when the terminal is changed in shape and viewed in a certain posture 1, some information 1 (for example, e-mail) is provided, and when viewed in a different posture 2, other information 2 (for example, a clock) is provided. It is possible to do that.

  According to the embodiment described above, it is possible to display an appropriate screen according to the situation by utilizing the mechanism of the casing of the mobile phone terminal and effectively utilizing the shape change and the posture change due to the change of the mechanism. it can. That is, operability problems existing in conventional mobile phones, application usability problems, mechanism utilization problems, screen visibility problems, manner problems with light leakage, privacy problems with screen display, etc. Various problems relating to the operation of the telephone terminal can be solved.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 is a block diagram of a screen display processing device according to a first embodiment. The figure which shows an example of the external appearance of a two-fold type mobile telephone terminal which incorporates the screen display processing apparatus of FIG. The figure which shows an example of the external appearance of the slide-type mobile telephone terminal which incorporates the screen display processing apparatus of FIG. The figure which shows an example of an external appearance when a two-fold type mobile telephone terminal is fully open. The figure which shows a mode that the upper housing | casing 201 of a mobile telephone terminal is rotated a little. The flowchart which shows an example of operation | movement of the screen display processing apparatus of FIG. 9 is a flowchart showing an example of the operation of the screen display processing apparatus in Modification 1 of the first embodiment. The figure for demonstrating the difference in the appearance of a screen according to the shape change by the movement of a two-fold type mobile telephone terminal. The block diagram of the screen display processing apparatus which concerns on the modification 4 of 1st Embodiment. The figure which shows an example of the control result of a display position and a size which the screen display processing apparatus of FIG. 9 performs. The block diagram of the screen display processing apparatus which concerns on the modification 5 of 1st Embodiment. The figure for demonstrating a main screen and a subscreen. The figure for demonstrating the difference in the appearance of the main screen and a sub screen according to the shape change by the movement of a two-fold type mobile telephone terminal. FIG. 10 is another block diagram of a screen display processing device according to Modification 5 of the first embodiment. The block diagram of the screen display processing apparatus which concerns on the modification 6 of 1st Embodiment. The figure for demonstrating an example of a display when the size of the display area of a screen is changed. The block diagram of the screen display processing apparatus which concerns on the modification 7 of 1st Embodiment. The block diagram of the screen display processing apparatus which concerns on 2nd Embodiment. The block diagram of the screen display processing apparatus which concerns on 3rd Embodiment. The figure for demonstrating the relationship between the attitude | position of a mobile telephone terminal, and the direction of a display screen. The figure for demonstrating the effect at the time of changing the attitude | position of a mobile telephone terminal, and the direction of a display screen. The figure for demonstrating the attitude | position at the time of taking out a mobile telephone terminal from a bag, and the state hold | maintained when using it. The figure for demonstrating an example of the conversion in the attitude | position of a mobile telephone terminal, the appearance from the browsing direction of a display part, and a display information conversion part. The block diagram of the screen display processing apparatus of the modification 1 of 3rd Embodiment. The block diagram of the screen display processing apparatus of the modification 2 of 3rd Embodiment. The block diagram of the screen display processing apparatus of 4th Embodiment. The figure for demonstrating the difference in the appearance of a screen according to the shape change by the movement of a two-fold type mobile telephone terminal, and the attitude | position in that case. The block diagram of the screen display processing apparatus of the modification 1 of 4th Embodiment. The block diagram of the screen display processing apparatus corresponding to 1st Embodiment of 5th Embodiment. The block diagram of the screen display processing apparatus corresponding to 2nd Embodiment of 5th Embodiment. The block diagram of the screen display processing apparatus corresponding to 3rd Embodiment of 5th Embodiment. The block diagram of the screen display processing apparatus of 5th Embodiment corresponding to 4th Embodiment. The block diagram of the screen display processing apparatus corresponding to 1st Embodiment of 6th Embodiment. The block diagram of the screen display processing apparatus corresponding to 2nd Embodiment of 6th Embodiment. The block diagram of the screen display processing apparatus of 6th Embodiment corresponding to 3rd Embodiment. The block diagram of the screen display processing apparatus of 6th Embodiment corresponding to 4th Embodiment. The block diagram of the screen display processing apparatus corresponding to 1st Embodiment of the modification 1 of 6th Embodiment. The block diagram of the screen display processing apparatus corresponding to 2nd Embodiment of the modification 1 of 6th Embodiment. The block diagram of the screen display processing apparatus corresponding to 3rd Embodiment of the modification 1 of 6th Embodiment. The block diagram of the screen display processing apparatus corresponding to 4th Embodiment of the modification 1 of 6th Embodiment.

DESCRIPTION OF SYMBOLS 101 ... Movable mechanism part, 102 ... Movable parameter acquisition part, 103 ... Shape change detection part, 104, 1803 ... Application switching control part, 105 ... Application operation part, 106 ... Display 107, operation unit, 201, upper housing, 202, lower housing, 301 ... first operation unit, 302 ... second operation unit, 901 ... display Position / size control unit, 902 ... display position / size change unit, 1101 ... display switching unit, 1102 ... first display unit, 1103 ... second display unit, 1401 ... display Content change unit, 1501... Light quantity change control unit, 1502... Light emission unit, 1701... Screen display change on / off unit, 1801. 240 ... screen browsing direction estimation unit, 1902, 2602 ... display information conversion control unit, 1903 ... display information conversion unit, 2401 ... camera function unit, 2402 ... camera information analysis unit, 2501 ... Holding information acquisition unit, 2502 ... Holding information analysis unit, 2503, 2601 ... Screen browsing direction estimation unit, 2901 ... Peripheral environment information acquisition unit, 3301 ... Screen browsing direction control unit, 3701 ... Screen viewing direction information control unit, 3702... Screen display information switching unit.

Claims (8)

Obtaining means for obtaining a parameter amount indicating an attitude of one or more housings constituting the mobile terminal device;
Determining means for determining which range of a plurality of ranges classified by a plurality of thresholds a difference between the parameter amount and a reference value belongs to;
A guessing means for guessing a viewing direction in which a user of the mobile terminal device browses the screen of the mobile terminal device based on the range to which the mobile terminal device belongs;
Control means for switching functions mounted on the mobile terminal device according to the range to which the mobile terminal device belongs and the viewing direction;
Holding information acquisition means for acquiring holding information indicating the holding content that the user holds the portable terminal device, and
The screen display processing device, wherein the estimation means further estimates the viewing direction based on the held information. Movable means for relatively moving a plurality of housings of the mobile terminal device;
Detecting means for detecting a parameter amount indicating how much the plurality of casings are moving relatively;
Determining means for determining which range of a plurality of ranges classified by a plurality of thresholds a difference between the parameter amount and a reference value belongs to;
Obtaining means for obtaining posture information indicating a posture of one or more housings of the mobile terminal device;
Guessing means for guessing a viewing direction in which a user of the mobile terminal device browses the screen of the mobile terminal device based on the range to which the mobile terminal device belongs and the attitude information;
Control means for switching functions mounted on the mobile terminal device according to the range to which the mobile terminal belongs and the viewing direction;
Holding information acquisition means for acquiring holding information indicating the holding content that the user holds the portable terminal device, and
The screen display processing device, wherein the estimation means further estimates the viewing direction based on the held information.   The said holding | maintenance information acquisition means acquires the said holding | maintenance information from the 1 or several position where the said user is holding the said portable terminal device using a contact sensor, The Claim 1 or Claim characterized by the above-mentioned. 2. The screen display processing device according to 2. Movable means for relatively moving a plurality of housings of the mobile terminal device;
Detecting means for detecting a parameter amount indicating how much the plurality of casings are moving relatively;
Determining means for determining which range of a plurality of ranges classified by a plurality of thresholds a difference between the parameter amount and a reference value belongs to;
Control means for switching functions mounted on the mobile terminal device according to the range to which the device belongs;
According to the range to which the mobile terminal device belongs, at least one of layout, size, shape, display area, and display position is changed so that distortion is reduced when the content displayed on the screen of the mobile terminal device is observed. Changing means,
The screen display processing device, wherein the control means performs selection and control of the contents of the change. Obtaining means for obtaining a parameter amount indicating the attitude of one or more housings of the mobile terminal device;
Determining means for determining which range of a plurality of ranges classified by a plurality of thresholds a difference between the parameter amount and a reference value belongs to;
Control means for switching functions mounted on the mobile terminal device according to the range to which the device belongs;
According to the range to which the mobile terminal device belongs, at least one of layout, size, shape, display area, and display position is changed so that distortion is reduced when the content displayed on the screen of the mobile terminal device is observed. Changing means,
The screen display processing device, wherein the control means performs selection and control of the contents of the change. Obtaining means for obtaining a parameter amount indicating an attitude of one or more housings constituting the mobile terminal device;
Determining means for determining which range of a plurality of ranges classified by a plurality of thresholds a difference between the parameter amount and a reference value belongs to;
A guessing means for guessing a viewing direction in which a user of the mobile terminal device browses the screen of the mobile terminal device based on the range to which the mobile terminal device belongs;
Control means for switching functions mounted on the mobile terminal device according to the range to which the mobile terminal device belongs and the viewing direction;
According to the range to which the mobile terminal device belongs, at least one of layout, size, shape, display area, and display position is changed so that distortion is reduced when the content displayed on the screen of the mobile terminal device is observed. Changing means,
The screen display processing device, wherein the control means performs selection and control of the contents of the change. Movable means for relatively moving a plurality of housings of the mobile terminal device;
Detecting means for detecting a parameter amount indicating how much the plurality of casings are moving relatively;
Determining means for determining which range of a plurality of ranges classified by a plurality of thresholds a difference between the parameter amount and a reference value belongs to;
Obtaining means for obtaining posture information indicating a posture of one or more housings of the mobile terminal device;
Guessing means for guessing a viewing direction in which a user of the mobile terminal device browses the screen of the mobile terminal device based on the range to which the mobile terminal device belongs and the attitude information;
Control means for switching functions mounted on the mobile terminal device according to the range to which the mobile terminal belongs and the viewing direction;
According to the range to which the mobile terminal device belongs, at least one of layout, size, shape, display area, and display position is changed so that distortion is reduced when the content displayed on the screen of the mobile terminal device is observed. Changing means,
The screen display processing device, wherein the control means performs selection and control of the contents of the change. In accordance with the browsing direction estimated by the estimation means, further comprising direction control means for controlling the display direction of the content so that the content displayed on the screen of the mobile terminal device is vertically upward,
11. The screen display processing device according to claim 4, wherein the direction control unit performs control so that the content changed by the changing unit is displayed in the display direction.

Images