WO2013021539A1 - Information display device - Google Patents

Information display device Download PDF

Info

Publication number
WO2013021539A1
WO2013021539A1 PCT/JP2012/004176 JP2012004176W WO2013021539A1 WO 2013021539 A1 WO2013021539 A1 WO 2013021539A1 JP 2012004176 W JP2012004176 W JP 2012004176W WO 2013021539 A1 WO2013021539 A1 WO 2013021539A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
information display
information
orientation
display screen
Prior art date
Application number
PCT/JP2012/004176
Other languages
French (fr)
Japanese (ja)
Inventor
山田 和範
紹二 大坪
務 向井
瑞穂 榊原
大嶋 光昭
Original Assignee
パナソニック株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2011-175453 priority Critical
Priority to JP2011175453 priority
Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
Publication of WO2013021539A1 publication Critical patent/WO2013021539A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 – G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163Indexing scheme relating to constructional details of the computer
    • G06F2200/1637Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0492Change of orientation of the displayed image, e.g. upside-down, mirrored
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00Specific applications
    • G09G2380/14Electronic books and readers
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00Specific applications
    • G09G2380/16Digital picture frames

Abstract

An information display device according to the present invention is provided with: an image display unit (108) for displaying an image in accordance with the orientation of a display screen; a terminal attitude detection unit (104) for detecting the attitude of the information display device on the basis of information acquired by an acceleration sensor, angular velocity sensor, and geomagnetism sensor; and a display orientation determination unit (105) for determining changes in the attitude of the information display device and deciding the orientation of the display screen. When the display screen of the information display device is substantially horizontal and it is determined that there is a change in the attitude of the information display device, if the information display device moves by a predetermined angle or more with reference to the orientation of the display screen of the information display device prior to the change in the attitude of the information display device being determined, the display orientation determination unit (105) decides the orientation of the display screen in such a way that the side of the information display device in the direction in which the predetermined angle with said reference direction is equalled or exceeded becomes the top section of the display screen. The image display unit (108) displays the image in accordance with the orientation of the display screen decided by the display orientation determination unit (105).

Description

Information display device

The present invention relates to a portable information display apparatus such as a smartphone and a tablet, and more particularly to a method of displaying a GUI of a terminal.

In recent years, high-performance portable information display terminals such as smartphones (hereinafter referred to as mobile) have appeared and are being applied to various applications. Above all, applications have appeared that use mobile devices to control home appliances. The shape of a smartphone or tablet is not the same as the posture of the case, as compared to a laptop computer, and can be freely held vertically, horizontally, or upside down. Therefore, the GUI needs to be displayed in the direction desired by the user.

On the other hand, there are mobile products that are implemented to detect the direction of gravity and display a GUI with the side perpendicular to the ground up. However, there are various ways in which users can hold mobiles, and there are cases where this method can not cope, for example, when mobiles are held horizontally and rotated.

Therefore, Patent Document 1 discloses one method for solving such a problem. Patent Document 1 discloses a method of changing the content of the screen display by detecting whether the mobile is held with two hands or one hand based on the pressure detected by the touch sensor.

Patent No. 4489719

However, the technology of Patent Document 1 can not cope with the case where the user holds the mobile in a manner different from the usual way of holding, or when the user holds the mobile in a different direction.

Therefore, the present invention focuses on the above-mentioned problems, and displays the GUI in such a direction that the user can view without discomfort even when the user holds various ways such as changing the direction of the information display device. It is an object of the present invention to provide an information display device that can

In order to solve the above problems, an information display device according to one aspect of the present invention is a mobile information sensor that detects a mobile attitude using various sensors such as an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, and a pressure sensor. By grasping the state and estimating the positional relationship between the user and the mobile and the attitude of the mobile, the GUI is displayed in a direction in which the user can look without discomfort.

According to the present invention, it is possible to realize an information display device capable of displaying a GUI in a direction in which the user can view without discomfort even when the user holds various ways. As a result, even when the user holds the vehicle in various ways, the user can operate the mobile without discomfort.

FIG. 1 is a diagram showing the relationship between the attitude of the information display apparatus and the screen display direction in Embodiment 1 of the present invention. FIG. 2 is a diagram showing an internal configuration of a processing unit that determines the display orientation of the screen of the information display device in Embodiment 1 of the present invention. FIG. 3 is a diagram for explaining the flow of processing of the information display device in the first embodiment of the present invention. FIG. 4 is a diagram for explaining the flow of processing of the information display device in the first embodiment of the present invention. FIG. 5 is a diagram showing an internal configuration of a processing unit that sets the direction of the information display device in the second embodiment of the present invention. FIG. 6 is a diagram for explaining the flow of processing of the information display device in the second embodiment of the present invention. FIG. 7 is a diagram for explaining the flow of processing of the information display device in the second embodiment of the present invention. FIG. 8 is a diagram for explaining the flow of processing of the information display device in the second embodiment of the present invention. FIG. 9 is a diagram showing the configuration of the information display device in the third embodiment of the present invention. FIG. 10 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention. FIG. 11 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention. FIG. 12 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention. FIG. 13 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention. FIG. 14 is an example of point target information stored in the position DB. FIG. 15 is a diagram showing another example of the relationship between the attitude of the information display device of the present invention and the screen display direction. FIG. 16 is a view showing another example of the relationship between the attitude of the information display device of the present invention and the screen display direction. FIG. 17 is a view showing another example of the relationship between the attitude of the information display device of the present invention and the screen display direction. FIG. 18 is a diagram for describing a method of displaying an icon indicating the direction of the information display device itself in the fourth embodiment of the present invention. FIG. 19 is a diagram showing a variation of the icon indicating the normal position in the information display device (mobile itself) in the fourth embodiment of the present invention. FIG. 20 is a diagram showing a variation of the icon indicating the normal position in the information display device (mobile itself) in the fourth embodiment of the present invention. FIG. 21 is a diagram showing a variation of the icon indicating the normal position in the information display apparatus (mobile itself) in the fourth embodiment of the present invention. FIG. 22 is a diagram showing a variation of the icon indicating the normal position in the information display device (mobile itself) in the fourth embodiment of the present invention. FIG. 23 is a diagram showing a variation of the icon indicating the normal position in the information display apparatus (mobile itself) in the fourth embodiment of the present invention. FIG. 24 is a diagram showing a variation of the icon indicating the normal position in the information display apparatus (mobile itself) in the fourth embodiment of the present invention. FIG. 25 is a diagram showing a variation of the icon indicating the normal position in the information display device (mobile itself) in the fourth embodiment of the present invention. FIG. 26 is a diagram showing a variation of the icon indicating the normal position in the information display apparatus (mobile itself) in the fourth embodiment of the present invention. FIG. 27 is a diagram showing a variation of the icon indicating the normal position in the information display apparatus (mobile itself) in the fourth embodiment of the present invention. FIG. 28 is a view showing an icon for prompting the user of the information display device of the fourth embodiment of the present invention to correct position. FIG. 29 is a diagram showing an icon for prompting the user of the information display device of the fourth embodiment of the present invention. FIG. 30 is a view showing an icon for prompting the user of the information display device of the fourth embodiment of the present invention. FIG. 31 is a view showing an icon for prompting the user of the information display apparatus of the fourth embodiment of the present invention. FIG. 32 is a diagram showing an icon for prompting the user of the information display device of the fourth embodiment of the present invention. FIG. 33 is a diagram showing an icon for prompting the user of the information display device of the fourth embodiment of the present invention. FIG. 34 is a diagram showing an icon for prompting the user of the information display device of the fourth embodiment of the present invention. FIG. 35 is a diagram showing a configuration of a mobile terminal of one aspect of the information display device in the fifth embodiment of the present invention. FIG. 36 is a diagram showing an example of a use case in Embodiment 5 of the present invention. FIG. 37 shows an example of a use case according to Embodiment 5 of the present invention. FIG. 38 is a diagram showing definitions of variables relating to the attitude in the horizontal direction and the vertical direction of the mobile terminal used in the description of the fifth embodiment of the present invention. FIG. 39 is a diagram showing the definition of variables relating to the horizontal and vertical attitudes of the mobile terminal used in the description of the fifth embodiment of the present invention. FIG. 40 is a diagram showing an example of a menu screen when the mobile terminal in the fifth embodiment of the present invention is operated as a TV remote control. FIG. 41 is a diagram showing an example of a use case in which the mobile terminal according to Embodiment 5 of the present invention is operated as a TV remote control. FIG. 42 is a diagram showing an example of a use case in which the mobile terminal according to Embodiment 5 of the present invention is operated as a TV remote control. FIG. 43 is a diagram showing an example of a use case in which the mobile terminal according to Embodiment 5 of the present invention is operated as a TV remote control. FIG. 44 is a diagram showing an example of a use case in which the mobile terminal according to Embodiment 5 of the present invention is operated as a TV remote control. FIG. 45 is a diagram showing an example of a use case of another operation of the mobile terminal according to Embodiment 5 of the present invention. FIG. 46 is a diagram for illustrating control flow of the mobile terminal according to Embodiment 5 of the present invention. FIG. 47 is a diagram for illustrating control flow of the mobile terminal according to Embodiment 5 of the present invention. FIG. 48 is a diagram for illustrating control flow of the mobile terminal according to Embodiment 5 of the present invention. FIG. 49 is a diagram for illustrating control flow of the mobile terminal according to Embodiment 5 of the present invention. FIG. 50 is a diagram for illustrating control flow of the mobile terminal according to Embodiment 5 of the present invention. FIG. 51 is a diagram for illustrating control flow of the mobile terminal according to the fifth embodiment of the present invention. FIG. 52 is a diagram showing another control flow of the mobile terminal in the fifth embodiment of the present invention. FIG. 53 is a diagram showing another control flow of the mobile terminal in the fifth embodiment of the present invention. FIG. 54 is a diagram showing another control flow of the mobile terminal in the fifth embodiment of the present invention. FIG. 55 is a diagram showing another control flow of the mobile terminal according to Embodiment 5 of the present invention. FIG. 56 is a diagram showing another control flow of the mobile terminal in the fifth embodiment of the present invention. FIG. 57 is a diagram for describing an operation in the case of using a mobile device according to Embodiment 5 of the present invention. FIG. 58 is a flow diagram for explaining a method of updating the reference orientation of the mobile device according to Embodiment 5 of the present invention. FIG. 59 is a flowchart for explaining a method of detecting that the mobile device falls horizontally in the fifth embodiment of the present invention. FIG. 60 is a diagram showing an example of directions of three axes of the magnetic sensor of the mobile device in the fifth embodiment of the present invention. FIG. 61 is a diagram for describing a method of detecting a horizontal fall using an acceleration sensor of a mobile device according to a fifth embodiment of the present invention. FIG. 62 is a diagram showing an example of directions of three axes of the magnetic sensor of the mobile device in the fifth embodiment of the present invention. FIG. 63 is a diagram for explaining the screen display direction of the mobile device in the fifth embodiment of the present invention. FIG. 64 is a diagram showing a screen display direction change table of the mobile device according to the fifth embodiment of the present invention. FIG. 65 is a diagram for explaining the screen display direction transition diagram of the mobile device in the fifth embodiment of the present invention. FIG. 66 is a diagram for explaining the screen display direction of the mobile device in the fifth embodiment of the present invention. FIG. 67 is a diagram showing the orientation of the mobile device when the mobile device rotates in the fifth embodiment of the present invention. FIG. 68 is a diagram showing a display of the mobile device when a person looks at the mobile device in the fifth embodiment of the present invention. FIG. 69 is a diagram showing a flow when a person rotates while holding a tablet, which is one aspect of the mobile device in the fifth embodiment of the present invention. FIG. 70 is a diagram showing a flow in the case where a person rotates while holding the tablet, which is one aspect of the mobile device in the fifth embodiment of the present invention. FIG. 71 is a diagram showing a flow of a method of updating the reference orientation of the mobile device according to Embodiment 5 of the present invention. FIG. 72 is a diagram showing a display of the mobile device when a person facing the mobile device looks at the mobile device according to the fifth embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

Embodiment 1
The first embodiment will explain the flow of processing for displaying a GUI in a direction that the user can view without discomfort by detecting the centrifugal force and the action of shaking the mobile by the user and changing the display direction of the screen. .

FIG. 1 is a diagram showing the relationship between the attitude of the information display apparatus and the screen display direction in Embodiment 1 of the present invention. As shown in FIG. 1, let us say that the initial state in which the user is looking at the mobile is (A). In (A), the screen is shifted 20 degrees from the vertical direction with respect to the desk which is a horizontal plane. When this state is turned 90 degrees clockwise, the state becomes (B), that is, the mobile is in the vertically long state, and the GUI is displayed with the side corresponding to the upper side in the vertical direction as the top.

As described above, in a mobile in which the screen display unit is not in the horizontal state, it is possible to perform GUI display with the upper side in the vertical direction as the upper part by detecting the gravity with an acceleration sensor or the like.

Furthermore, when the mobile is turned to the waterside as in (C), the display of (B) is maintained. After that, when the mobile is turned counterclockwise on the horizontal plane, the GUI is displayed in the direction that was at the top in (C) as in (D). Here, a desk is used to represent a horizontal surface, but it may be a floor, a ceiling, or a hand-held state.

Here, a method of determining the display orientation when the terminal attitude is changed to (C) and (D) while detecting the state of (A) or (B) using FIG. 2 will be described in more detail. . FIG. 2 is a diagram showing an internal configuration of a processing unit that determines the display orientation of the screen of the information display device in Embodiment 1 of the present invention.

As shown in FIG. 2, the mobile device of the present invention is a terminal such as an angle with respect to the horizontal plane of the mobile or an orientation on the horizontal plane based on information of the acceleration sensor 101, the angular velocity sensor 102, the geomagnetic sensor 103 and these sensors. The terminal orientation detection unit 104 that detects orientation information, the display orientation determination unit 105 that determines the display orientation of the GUI displayed on the mobile screen from the terminal orientation information, etc., and the terminal orientation information or GUI It has a time-series terminal state management unit 106 that stores and manages the display orientation in the time-series terminal state storage unit 107, and an image display unit 108.

Next, the flow of processing is shown using FIG. FIG. 3 is a diagram for explaining the flow of processing of the information display device in the first embodiment of the present invention.

First, in step 100a, the terminal attitude detection unit determines whether or not the attitude change of the terminal has been detected from various sensors, and if not detected, the process returns to step 100a.

Next, in step 100 b, when the terminal posture detection unit 104 detects the acceleration sensor value, the terminal posture detection unit 104 acquires the value of the acceleration sensor, and acquires the gravity direction.

Next, in step 100c, it is determined whether the terminal attitude detection unit 104 detects an inclination of an arbitrary angle (for example, 20 degrees) or more with respect to the horizontal plane of the mobile.

In step 100c, in the case of Yes, the process proceeds to step 100d, in which the terminal posture detection unit 104 determines the side that is on the upper most side in the vertical direction by the inclination among the postures detected from the information in the gravity direction.

Next, in step 100e, the orientation of the display screen is changed so that the side detected by the display orientation determination unit 105 is on the top of the screen display, and then in step 100f, the time-series terminal state management unit Save with the current display orientation.

Next, in step 100g, it is determined whether the display processing has ended. If yes, exit. If it does not finish (in the case of No), it returns to step 100a.

In the case of No at step 100c, the process proceeds to W01 in FIG.

Subsequently, the flow of processing will be shown using FIG. FIG. 4 is a diagram for explaining the flow of processing of the information display device in the first embodiment of the present invention.

First, in step 101a, the display orientation determination unit acquires the posture information and the display orientation of the immediately preceding terminal from the time-series terminal state management unit.

Next, in step 101 b, the terminal attitude detection unit acquires a change in the direction on the horizontal plane as the attitude of the terminal at the current time point using the angular velocity sensor or the geomagnetic sensor or both of them.

Next, in step 101 c, the display orientation determination unit compares the attitude information of the immediately preceding terminal with the attitude information of the terminal at the current time.

Next, in step 101d, represents that the attitude information of the immediately preceding terminal has an inclination greater than an arbitrary angle (for example, 20 degrees) with respect to the horizontal plane of the mobile? Determine if it is.

In the case of Yes, the process proceeds to step 101e, and the display orientation determination unit continues the display without changing the display orientation of the terminal immediately before. And it returns to W02 of FIG.

On the other hand, in the case of No, the process proceeds to step 101f, and is the change in orientation exceeding any certainty (70 degrees)? Determine if it is.

Next, in step 101g, the display orientation determination unit changes the screen by 90 degrees in the opposite direction to the direction of the change in orientation, and returns to W02 in FIG.

Thus, the information display apparatus (mobile) of the present embodiment can display the GUI in a direction in which the user can view without discomfort.

Second Embodiment
In the second embodiment, the setting of the direction using centrifugal force and the swing width of the mobile case considering the hand-held state of the user are also used to set the direction.

FIG. 5 is a diagram showing an internal configuration of a processing unit that sets the direction of the information display device in the second embodiment of the present invention. The configuration shown in FIG. 5 is different from the configuration shown in the first embodiment in that a centrifugal force direction detection unit 111 is added.

Next, the flow of processing is shown using FIG. FIG. 6 is a diagram for explaining the flow of processing of the information display device in the second embodiment of the present invention.

First, in step 110a, the terminal attitude detection unit acquires the value of the acceleration sensor and acquires the gravity direction.

Next, in step 110b, the terminal attitude detection unit calculates attitude information of the terminal with respect to the horizon from the value in the gravity direction.

Next, in step 110c, it is determined whether or not the display unit of the own device is nearly horizontal within a predetermined error.

In the case of Yes, the process proceeds to step 110e, and the centrifugal force direction detection unit acquires the value of acceleration in the horizontal direction.

Next, at step 110f, it is determined whether or not there is a case where the horizontal acceleration component continues to appear in a certain direction and there is no component in the reverse direction within an arbitrary time.

Here, in the case of Yes, the process proceeds to step 110h, the GUI is displayed with the far side of the acquired direction as the top, and the process proceeds to W03 in FIG.

In the case of No, the process proceeds to step 110g, the GUI is displayed according to the display orientation set in advance, and the process proceeds to W03 in FIG.

In the case of No at step 110c, the GUI is displayed with the side at the highest position as the top by the inclination of the terminal, and the process proceeds to W03 in FIG.

Subsequently, the flow of processing will be shown using FIG. FIG. 7 is a diagram for explaining the flow of processing of the information display device in the second embodiment of the present invention.

First, in step 111a, the terminal attitude detection unit acquires the value of the acceleration sensor, and acquires the gravity direction from the composite vector.

Next, in step 111b, the terminal attitude detection unit calculates the reference value of gravity based on the position information stored by the own terminal by measurement. Alternatively, based on the position information of the own terminal, a gravity reference value is obtained by accessing a server on the cloud.

Next, in step 111c, it is determined whether the combined value of the acquired three-axis acceleration is larger than the gravity reference value.

In the case of Yes, the process proceeds to step 111g, and the gravity direction is corrected so as to approach the largest vector.

Next, in step 111h, the GUI is displayed with the far side of the direction indicated by the composite vector excluding the gravity component on the horizontal plane as the top, and the process proceeds to W04 in FIG.

In the case of No in step 111c, the process proceeds to step 111d, and is the state where the display unit of the own device is nearly horizontal within a predetermined threshold (angle)? Determine if it is.

In the case of Yes, the process proceeds to step 111 e where the GUI is displayed according to the display orientation set in advance, and the process proceeds to W 04 in FIG.

In the case of No, the process proceeds to step 111f, and the inclination of the terminal causes the GUI to be displayed with the side at the highest position as the top, and proceeds to W04 in FIG.

Subsequently, the flow of processing will be shown using FIG. FIG. 8 is a diagram for explaining the flow of processing of the information display device in the second embodiment of the present invention.

First, in step 112a, the terminal attitude detection unit acquires the value of the acceleration sensor and acquires the gravity direction.

Next, in step 112 b, the terminal posture detection unit detects a side with a large swing width among the detected postures from the angular velocity sensor or the acceleration sensor.

Next, in step 112c, the terminal orientation determination unit uses the information indicating the relationship between the detected side with a large shake width and the side with a large shake width, which has been set in advance or stored in the past, and the head direction. Set the orientation of the GUI.

Next, in step 112 d, it is determined whether or not the user detects the leading direction by an inclination or centrifugal force exceeding a predetermined value within an arbitrary time (for example, 5 seconds).

If No, the process ends.

On the other hand, in the case of Yes, the process proceeds to step 112e, and it is determined whether the side is different from the side detected by the swing width. Here, if the determination is No, the process ends, and if the determination is Yes, the process proceeds to step 112f, and the terminal orientation determination unit saves the relationship between the side with the large swing width and the side to which the user set the head direction within a predetermined time thereafter. End.

Thus, the information display apparatus (mobile) according to the present embodiment sets the direction using centrifugal force, and also uses the swing width of the mobile chassis in consideration of the hand-held state of the user. The GUI can be displayed in a direction in which the user can view without discomfort.

Third Embodiment
In this embodiment, the mobile acquires the position information of the mobile by autonomous navigation using the built-in sensor, and the virtual tag in which the mobile has peripheral devices and objects in which the position is registered in advance and the position information. A method of determining the orientation of the screen when displaying a GUI or an application using information of the surrounding environment such as information will be described.

FIG. 9 is a diagram showing the configuration of the information display device in the third embodiment of the present invention.

Compared with the configuration of Embodiment 1, the configuration shown in FIG. 9 is a movement amount detection unit 121 that detects the movement amount of the mobile from the information acquired by the mobile using the built-in sensor, and coordinate estimation that estimates the current location coordinates of the mobile. A database for registering a list such as a virtual target information search unit, a peripheral device or object to be a point target, and virtual tag information having position information, where the mobile unit searches for information on the surrounding environment as a point target The difference is that the position DB 124 is added.

In addition, if it is a sensor useful in order to pinpoint a position, such as detection of height by a pressure sensor, it can be used as a built-in sensor.

Moreover, although position DB124 may be inside a terminal, it may be put on a cloud and the storage place does not matter.

Subsequently, the flow of processing will be shown using FIG. FIG. 10 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention.

First, at step 120a, the terminal attitude detection unit acquires the value of the acceleration sensor and acquires the gravity direction.

Next, in step 120 b, the terminal attitude detection unit calculates attitude information of the terminal with respect to the horizontal plane from the value in the gravity direction.

Next, in step 120 c, the terminal attitude detection unit determines the terminal attitude from the acceleration sensor and the angular velocity sensor geomagnetic sensor.

Next, in step 120 d, the movement amount detection unit acquires the value of the acceleration sensor from the previous coordinate estimation time.

Next, in step 120e, the movement amount detection unit acquires terminal attitude information from the terminal attitude detection unit.

Next, in step 120 f, the movement amount detection unit calculates the movement direction and movement distance of the terminal from the terminal attitude information and the value of the acceleration sensor.

Next, in step 120g, the coordinate estimating unit calculates an estimated present location coordinate which is a coordinate value of the current mobile based on the moving direction and the moving distance from the coordinate value at the time of coordinate estimation immediately before.

Next, in step 120h, the coordinate estimating unit sets the coordinate estimation accuracy from the total movement amount from the time when the reference point was recognized in the past, and the process proceeds to W05 in FIG.

Subsequently, the flow of processing will be shown using FIG. FIG. 11 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention.

First, in step 121a, the point object search unit confirms whether the object is in an object search state to which the terminal points (for example, the user presses a button, a specific position, or a stationary state).

Next, in step 121b, it is determined whether or not an object search state is in progress.

In the case of No, it progresses to W06 of FIG. On the other hand, in the case of Yes, the process proceeds to step 121 c, the point target search unit acquires the terminal attitude from the attitude control unit, and specifies the direction of the head direction of the terminal.

Next, in step 121 d, the point object search unit acquires the coordinate value of the own device from the coordinate estimation unit.

Next, in step 121e, the point object search unit confirms whether an object such as a device having position information registered on the position DB is present in the direction from the coordinate value of the own device to the head of the terminal Do.

Next, in step 121f, it is determined whether an object exists.

In the case of No, it progresses to W06 of FIG. On the other hand, in the case of Yes, the process proceeds to step 121g, activates the function related to the point object (for example, the control GUI of the target device), and proceeds to W06 in FIG.

Subsequently, the flow of processing will be shown using FIG. FIG. 12 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention.

First, in step 122a, the display orientation determination unit determines whether or not the mode is displaying a GUI related to the point object.

Next, in step 122 b, the display orientation determination unit acquires the terminal attitude from the terminal attitude detection unit.

Next, in step 122c, is the display unit of the own device close to horizontal within a predetermined threshold (eg, ± 10 degrees)? Determine if it is.

In the case of Yes, it progresses to W08 of FIG. On the other hand, in the case of No, it progresses to W07 of FIG.

Subsequently, the flow of processing will be shown using FIG. FIG. 13 is a diagram for explaining the flow of processing of the information display device in the third embodiment of the present invention.

In W07, in step 123a, the inclination of the terminal causes the GUI to be displayed with the side at the highest position as the top, and the process ends.

In W08, in step 123b, the display orientation determination unit calculates the side closer to the straight point object connecting the coordinate value of the own device and the coordinate value of the point object.

Next, in step 123c, it is determined whether a straight line connecting the calculated side and the coordinate value of the own device and the coordinate value of the point object is within an arbitrary angle (eg, 90 degrees + -20 degrees).

If the determination is Yes, the process ends. If the determination is No, the process proceeds to step 123d, and it is determined whether the accuracy of the position of the point target acquired from the position DB is equal to or higher than an arbitrary level (for example, 80%). Here, if the determination is Yes, the process ends. If the determination is No, the process proceeds to step 123e, and the display orientation determination unit determines whether the current state is rotating based on the information of the time-series terminal state management unit.

Next, in step 123f, is it being rotated in the direction where the straight line connecting the calculated side and the coordinate value of the own device and the coordinate value of the point object becomes an arbitrary angle (eg within 90 degrees +-20 degrees) Determine if it is.

In the case of Yes, the process ends. In the case of No, the process proceeds to Step 123g, and the display is continued without changing the current direction, and the process is ended.

FIG. 14 is an example of point target information stored in the position DB. As shown in FIG. 14, the object has absolute coordinate values in the respective three-dimensional space, or relative coordinate values based on any reference point used by the mobile to identify the position. Furthermore, it is also possible to have reference point angle information indicating the accuracy of coordinate values when the object itself is considered as a reference point. In addition, it is possible to have update time information in the case where the coordinates of the object and the reference point angle information are updated.

In this manner, according to the information display device of the present embodiment, the user can feel comfortable even if the user uses the mobile in various ways in a situation where the user is aware of the target that he / she wants to point A display of a GUI capable of operating a mobile is realized.

Embodiment 4
Described is a method for realizing a more user-friendly display by displaying an icon. For example, when the screen orientation of the mobile is changed, an icon indicating the current attitude of the mobile is displayed in order to prevent the relationship between the attitude of the mobile's own casing and the orientation of the mobile's own screen from becoming unclear.

Hereinafter, a method of displaying an icon indicating the direction of the information display device (mobile itself) according to the fourth embodiment of the present invention will be described with reference to the drawings. FIG. 18 is a diagram showing a variation of an icon indicating the normal position of the terminal in the information display device (mobile itself) in the fourth embodiment of the present invention. FIGS. 19 to 27 are diagrams showing variations of icons indicating normal positions in the information display apparatus (mobile itself) according to the fourth embodiment of the present invention.

In FIG. 18, the icon at the upper left of the screen of the mobile is a reduction of the picture of the mobile itself in which the button, camera and speaker positions are exaggerated. This icon keeps displaying the orientation of the terminal itself in a position that is easy to see even if the orientation of the screen changes. Specifically, the current position of the mobile terminal is displayed at the upper left regardless of the portrait orientation or the landscape orientation. At this time, the orientation of the icon does not change with respect to the casing regardless of the orientation of the mobile casing, and the icon is the same as the casing even if other contents in the screen are oriented in various directions. Displayed in the orientation.

Further, as shown in FIG. 21, the display position may be displayed at the lower right or lower left, and further, at the upper right or the like, the display position in the screen may be anywhere. Here, a picture inclined at 70 degrees from the horizontal plane is used, but this is an example, and the angle does not matter.

Similarly, FIGS. 19 and 20 also show variations of icon types. Further, in (A) to FIG. 27 of FIG. 21, the icons are shown in the case where only the picture of either the left or the right or the upper or lower one is shown at the horizontal position and the vertical position. As shown in FIG. 21, some mobile devices have a camera or speaker on the front, etc., and the camera needs to be on the top with respect to the vertical position and the horizontal position, etc. The correct position (normal position) There is. In this case, two types of icons may be used as icons for displaying to the user to indicate the correct positions when vertical and horizontal.

FIGS. 28 to 34 are diagrams showing icons for prompting the user of the information display apparatus in the fourth embodiment of the present invention.

For example, as shown in FIG. 28, when the icon has the upward direction of the icon in the direction of being in the normal position with respect to the vertical position, and the mobile is in the posture opposite to the normal position with respect to the vertical position, the icon is The user feels strange because he turns the other way around. This can prompt the user to be in the correct position. 29 to 34 also disclose icons for prompting the user to the correct position. Another example in the figure is an icon displayed on the upper left.

In addition, by making the icon left-right asymmetry and providing directionality, it is possible to indicate to the user as to which direction the terminal is rotated from the current position of the terminal to be rotated to the normal position. For example, as shown in FIG. 28, when the icon having the eyes as a motif looks to the right, it indicates that the right side of the terminal can be placed in the correct position by turning the right side up. Similarly, in FIGS. 29 to 34, the orientation of the face of the icon, the orientation of the pointing hand, and the orientation of the body indicate the orientation of the normal position.

Also, FIG. 26 shows an icon in which the picture changes to another depending on the vertical position and the horizontal position. What appears to be a bird in the horizontal position is what appears to be a rabbit in the vertical position, and it looks like a penguin in the horizontal position and a manbow in the vertical position. This makes it possible for the user to feel that the direction of the case is wrong when the picture is odd.

In this case, it is possible to eliminate the display of the icon that makes the user feel uncomfortable. At this time, the module that displays the icon can recognize the upward direction of the screen in advance, and can always display the icon according to the horizontal position and the vertical position with reference to the upper side of the GUI.

Fifth Embodiment
In this embodiment, an electrical configuration of a mobile terminal such as a digital camera as an aspect of the information display device will be described with reference to FIG. FIG. 35 is a diagram showing a configuration of a mobile terminal of one aspect of the information display device in the fifth embodiment of the present invention.

[1-1. Overview〕
The mobile terminal 5000 according to the present embodiment is a multifunctional mobile terminal that has an external input such as a touch panel and a display, and can perform Internet browsing, image browsing, music viewing, and operation of a TV and a home appliance. . The mobile terminal 5000 according to the present embodiment is supposed to rotate the mobile terminal vertically or horizontally for its purpose of use, but it is necessary to always rotate and display the screen in the direction in which the user faces. Then, regardless of how the user rotates the mobile terminal 5000, it is possible to always display the screen in an easy-to-see display direction.

[1-2. Constitution〕
[1-2-1. Electrical configuration]
The mobile terminal 5000 shown in FIG. 35 has the angular velocity sensor 1002 and the geomagnetic sensor 1003 and uses these inputs to cause the display direction control unit 1005 to detect from which direction the user currently has the mobile terminal 5000, and the display direction Decide. Then, the determined display direction is transmitted to the screen display control unit 1006. The screen display control unit 1006 generates information to be actually output to the display 1004 of the mobile terminal based on the information of the control direction control unit, and sends the information to the display 1004. The display 1004 displays the received information on the display screen. The configuration of mobile terminal 5000 will be described in detail below.

The external input unit 1030 is configured of a touch panel, a hardware key, and the like. By accepting the user's operation, various inputs for operating the mobile terminal 5000 can be received. When the display 1004 has a touch panel and can receive an external operation, it can also be used as the display 1004.

The controller 1020 is a control unit that controls the entire mobile terminal 5000. The controller 1020 can be realized by a semiconductor element or the like. The controller 1020 may be configured only by hardware, or may be realized by combining hardware and software. The controller 1020 can be realized by a microcomputer or the like. The controller 1020 can control the screen display direction with high convenience for the user and display it on the screen according to the orientation of the mobile terminal 5000 detected by the angular velocity sensor 1002 or the geomagnetic sensor 1003 or the like and the inclination in the vertical direction. Yes (more on this later).

The angular velocity sensor 1002 is a sensor for detecting the angular velocity of the mobile terminal 5000, and can detect angular velocities in a plurality of axial directions.

The geomagnetic sensor 1003 is a sensor for detecting azimuth information in the horizontal direction to which the mobile terminal 5000 is directed, and can acquire azimuth information.

The display direction control unit 1005 controls the display direction of the mobile terminal 5000 based on the information of the angular velocity sensor 1002 and the geomagnetic sensor 1003. For example, when the mobile terminal 5000 detects a 90 ° rotation clockwise in the horizontal direction, it can be considered that the user has rotated the mobile terminal 5000 from the long side direction to the short side direction, so the display screen 90 degrees counterclockwise Control such as instructing to rotate the The timing at which the rotation is performed will be described later.

The screen display control unit 1006 is a portion that actually generates a UI screen to be transmitted to the display 1004, based on the information of the display direction control unit 1005. The screen display control unit 1006 may be implemented by software, or may be implemented by a hybrid of hardware and software, such as hardwareization of high-load processing.

The display 1004 can display the UI screen transmitted from the screen display control unit 1006. The information read out from the memory 1010 can be displayed. In addition, the display 1004 can display various menu screens and the like for performing various settings of the mobile terminal 5000.

The memory 1010 is configured by a flash memory, a ferroelectric memory, or the like. The memory 1010 is a control program for controlling the entire mobile terminal 5000, and buttons, icon information, video, music information, text information, and display direction change of the mobile terminal 5000 for generating a typical menu screen. The information related to the threshold information etc. is stored. In particular, in the present embodiment, the memory 1010 displays an initial display orientation as determination information for switching the display direction, horizontal rotation threshold information, vertical rotation threshold information, display menu information to be switched, and current The library information for rotating the menu screen is stored.

[1-2-2. Correspondence of terms]
The angular velocity sensor 1002 is an example of an information acquisition unit for detecting the attitude of the mobile terminal 5000. The geomagnetic sensor 1003 is an example of a means for detecting the horizontal direction, that is, the direction information or the horizontal rotation to which the mobile terminal 5000 faces.

The controller 1020 is an example of an information acquisition unit, a rotation determination unit, a rotation detection unit, and a control unit. The internal memory 1010 is an example of a storage unit. The display 1004 is an example of a display unit.

[1-3-1. Use Case〕
An example of the use case assumed in this embodiment will be described with reference to FIGS. 36 and 37.

Now, as shown in FIG. 36, Mr. A is operating the mobile terminal 5000 with the short film direction toward Mr. A (this will be called vertical holding in this embodiment), and the long film direction such as a video is directed to Mr. A Even if it is better to look sideways in this embodiment (as in the present embodiment, as shown in the right figure in FIG. 36), the screen does not rotate, so Mr. A switches from vertical holding to horizontal holding. In the case it was necessary to rotate the screen separately.

However, in the present embodiment, as shown in FIG. 37, when Mr. A switches from vertically held as shown in the left of FIG. 37 to landscaped display as shown in the right of FIG. It is characterized in that the screen is automatically rotated.

[1-3-2. Display screen rotation control (overall)]
In order to explain a series of operations of the mobile terminal 5000 of the present embodiment, for convenience of explanation, the description will be divided into a normal case and a special case according to use cases.

FIGS. 38 and 39 are diagrams showing definitions of variables relating to the horizontal and vertical attitudes of mobile terminal 5000 used in the description of the present embodiment.

Using FIG. 38, variables relating to the horizontal orientation of the mobile terminal 5000 are defined. That is, in the initial state of the mobile terminal 5000, the direction in which the mobile terminal 5000 is facing is defined as D0. Also, the mobile terminal 5000 rotates in the horizontal direction, and defines the direction currently facing as D1.

In the present embodiment, although D0 / D1 is described using orientation information, it may be information for detecting the horizontal rotation of D0 / D1 mobile terminal 5000, for example, the horizontal direction of the gyro sensor The acceleration may be accumulated to detect the relative direction in which the mobile terminal 5000 is facing.

Subsequently, with reference to FIG. 39, variables relating to the inclination of the mobile terminal 5000 in the vertical direction are defined. The inclination in the case where the mobile terminal 5000 is directed in the horizontal direction is 0 degrees, and the case in which the mobile terminal 5000 is set in the vertical direction is 90 degrees. The inclination of the current mobile terminal 5000 is defined as H. HThr is a vertical inclination threshold for performing display rotation described later.

FIG. 40 is a diagram showing an example of a menu screen when the mobile terminal 5000 is operated as a TV remote control. The case where the mobile terminal 5000 is displayed vertically is shown in the left of FIG. 40, and the case where the mobile terminal 5000 is displayed horizontally is shown in the right of FIG. In the case of portrait orientation, the channel button is enlarged. In the case of landscape orientation, additional information on the program is displayed together. By changing the content to be displayed in portrait orientation and landscape orientation, the user can easily access desired information. become. Here, FIGS. 41 to 44 are diagrams showing an example of a use case when the mobile terminal 5000 is operated as a TV remote control. FIG. 45 is a diagram illustrating an example of a use case of another operation of the mobile terminal 5000.

A control flow of mobile terminal 5000 in the present embodiment will be described using FIG. 46 to FIG. FIGS. 46 to 51 are diagrams for illustrating the control flow of mobile terminal 5000 in the fifth embodiment of the present invention.

First, at step 601a, the mobile terminal 5000 is turned on.

Next, in step 601 b, the display direction control unit 1005 acquires the current azimuth information D 1 of the mobile terminal 5000 from the geomagnetic sensor 1003.

Next, in step 601 c, the display direction control unit 1005 initializes the initial display direction Do with the direction information D1.

Next, in step 601 e, the display direction control unit 1005 detects whether horizontal rotation is permitted. In the case of No, the process proceeds to step 601 d. In the case of Yes, the process proceeds to step 601 f.

Here, it will be described as to whether or not horizontal rotation is permitted. The mobile terminal 5000 can be set to allow or not allow rotation by user operation. When the mobile terminal 5000 is operated as a remote control as shown in FIG. 41, there are cases where the display is not rotated even if the rotation of the mobile terminal 5000 is detected. Therefore, by having the function to allow / disallow horizontal display rotation. Unintended screen rotation can be prevented.

Next, in step 601 f, the display direction control unit 1005 acquires the current initial azimuth information D 0 of the mobile terminal 5000 and the horizontal rotation threshold DThr from the memory 1010.

Next, in step 601g, the display direction control unit 1005 acquires the current azimuth information D1 of the mobile terminal 5000 from the geomagnetic sensor 1003.

Next, in step 601 h, does the display direction control unit 1005 change the detected direction information D1 by more than DThr from the initial direction information D0? Determine In the case of No, the process proceeds to step 601d. In the case of Yes, the process proceeds to step 601j.

Next, at step 601j, the rotation detection start time is recorded only for the first time.

Next, in step 601k, is the display direction control unit 1005 having a predetermined time elapsed from the rotation detection time? To detect

In the case of No, after waiting for a fixed time in step 601 m, the process proceeds to step 601 g. In the case of Yes, the process proceeds to step 601 n.

Next, in steps 601j to 601n, the time for detecting the amount of rotation for a fixed time is provided because the mobile terminal 5000 is rotated more than twice the rotation threshold, for example, when the user rotates the mobile terminal 5000 by 180 degrees. In this case, the mobile terminal 5000 is rotated smoothly. In addition, it is to prevent the user's eyes from being flickered by continuous rotation in the opposite direction when the mobile terminal 5000 is rotated in the opposite direction immediately after rotating the mobile terminal 5000 by the rotation threshold or more.

Next, in step 601 n, the display direction control unit 1005 detects whether the display surface of the mobile terminal 5000 is vertically upward or downward.

Next, in step 601o, the display direction control unit 1005 notifies the screen display control unit 1006 of an instruction to rotate the screen so that the D0 direction is at the top of the display screen.

As for step 601n and step 601o, for example, as shown in FIG. 45, when the user is facing up and operating the mobile terminal 5000, the direction in which the screen is rotated for correction when the mobile terminal 5000 makes D1 direction, This is because the display 1004 of the mobile terminal 5000 is reversed in the vertical downward direction and in the vertical direction.

Next, in step 601 p, the display direction control unit 1005 executes flickering and threshold control processing of screen rotation.

Next, in step 601 r, the screen display control unit 1006 determines whether creation of a new screen is OK. In the case of No, after waiting for a fixed time in step 601s, the process proceeds to step 601q. In the case of Yes, the process proceeds to step 601s.

In this step, for example, when software of the user interface layer of the mobile terminal 5000 performs another process with high priority (for example, screen scroll), it means a process of waiting for completion of the process with high priority. There is.

Next, in step 601t, the screen display control unit 1006 determines whether to newly create a screen to be rotated.

In the case of No, the display screen is rotated last time in step 601 x and drawn on the display 1004. In the case of Yes, the process proceeds to step 601 u.

Hereinafter, the reason why the screen to be rotated is newly created in step 601t will be described.

As described above, the mobile terminal 5000 is assumed to have various applications such as a video player and a TV remote control. Therefore, depending on the function used by the mobile terminal 5000, it is better to rotate the display direction as it is (for example, a video player etc.), or to change the display contents by vertical display and horizontal display. There is (for example, a remote control). By this step, the convenience by the user rotating the mobile terminal 5000 is further improved.

Next, in step 601 u, the screen display control unit 1006 creates a new screen.

Next, in step 601 v, the display 1004 draws a new creation screen.

Next, in step 602 a, the display direction control unit 1005 acquires the current elevation angle information H 1 of the mobile terminal 5000 from the angular velocity sensor 1002.

Next, in step 602b, the display direction control unit 1005 determines whether the absolute value of the detected elevation angle information H1 is larger than the vertical direction rotation threshold HThr2.

In the case of No, the process proceeds to step 601w. In the case of Yes, the process proceeds to step 602 c.

Next, in step 602 c, the display direction control unit 1005 notifies the screen display control unit 1006 of an instruction to rotate the screen so that the side on the high side of the screen is at the top of the display screen.

Next, in step 602d, the screen display control unit 1006 determines whether to newly create a screen to be rotated.

In the case of No, the display screen is rotated last time in step 602 g and drawn on the display 1004. In the case of Yes, the process proceeds to step 602e.

Next, in step 602e, the screen display control unit 1006 creates a new screen.

Next, in step 602 f, the display 1004 draws a new creation screen.

Next, in step 602 h, the display direction control unit 1005 acquires the current elevation angle information H 1 of the mobile terminal 5000 from the angular velocity sensor 1002.

Next, in step 602j, the display direction control unit 1005 determines whether the absolute value of the detected elevation angle information H1 is smaller than the vertical direction rotation threshold HThr1.

In the case of No, the process proceeds to step 602 h. In the case of Yes, the process proceeds to step 602 m.

Next, in step 602k, the display direction control unit 1005 sets the current direction D1 as D0.

By setting the current direction in which the mobile terminal 5000 is facing as the initial orientation D0 when the user once tilts the mobile terminal 5000 in the vertical direction and then returns it horizontally by the processing of step 602 j to step 602 m. It is possible to reset or correct the rotational direction.

Next, in FIG. 51, an operation when the mobile terminal 5000 recovers from the sleep state will be described.

First, in step 603a, the mobile terminal 5000 detects a return from the sleep state.

Next, when detecting the return from the sleep state, the process proceeds to step 603 b.

Next, in step 603b, the screen display control unit 1006 reads the display direction at the previous sleep time from the memory.

Next, in step 603 c, the screen display control unit 1006 draws on the display 1004 the same screen as the display direction in the previous sleep.

Next, the process transitions to step 601 d.

In the present embodiment, although the description has been made in the context of performing the horizontal rotation after the initialization (or sleep return), as shown in FIG. 52 to FIG. It is also possible to do. Here, FIGS. 52 to 56 are diagrams showing another control flow of the mobile terminal in the fifth embodiment of the present invention.

At the time of initialization and return from sleep, it is assumed that the value of the initial orientation D0 in the horizontal direction and the orientation information D1 in the horizontal direction of the current mobile terminal 5000 may not be correct as it is, so By performing the rotation determination of the above, it is possible to more accurately rotate the display screen.

[1-3-3. Display screen rotation control (details supplement)
The step 601 e of FIG. 47 is supplemented using FIGS. 41, 42 and 43. As described above, the mobile terminal 5000 is equipped with many functions, and also has, for example, a general-purpose remote control function. For example, while operating in the general-purpose remote control mode, if the user rotates with the remote control while trying to operate a component located at a position rotated 90 degrees from the TV, the display direction also rotates, and the convenience is lost. As shown in FIG. 43, the same applies to the case where the mobile terminal 5000 is surfing or the like and the mobile terminal 5000 is directed to the TV to switch to the remote control mode and operate the TV. For this reason, as shown in FIG. 42, it is preferable that the mobile terminal 5000 have rotation determination of performing rotation in the vertical direction and performing rotation in the horizontal direction for each operation mode. This makes it possible to prevent screen rotation unintended by the user, and to improve operability.

In the present embodiment, when the mobile terminal 5000 operates, for example, a TV placed on the floor, the screen is rotated when the inclination when operating the TV exceeds the vertical direction rotation threshold HThr2. Convenience falls. Therefore, it is desirable for the mobile terminal 5000 to make the vertical direction rotation threshold value and the horizontal direction rotary position variable depending on the operation mode.

In addition, since the operation of the TV is generally performed by infrared rays, the vertical direction rotation threshold HThr2 is increased or the vertical direction rotation threshold HThr2 is increased in the remote control mode, for example, when the surface emitting infrared rays faces downward in the mobile terminal 5000. By suppressing the rotation of the direction, the operability of the user is improved.

Sixth Embodiment
In this embodiment mode, an operation in the case where the user uses the mobile device while standing or tilting the mobile device on the desk will be described with reference to FIGS.

The processing flow shown in FIG. 57 will be described below.

First, starting at step 1020a, with the direction in which the mobile device is facing when the mobile device is leveled down at step 1020b as the reference direction, and the screen of the mobile device when the mobile device is leveled down Is held as the screen display direction as the optimum display direction for the user. The method of updating the reference orientation will be described in detail later with reference to FIG.

Next, in step 1020c, the value of the direction sensor is acquired as the current direction.

Next, in step 1020 d, the difference between the reference orientation and the current orientation is calculated, and is used as the rotation angle.

Next, in step 1020e, the screen display direction is determined from the relationship between the rotation angle and the screen display table. The method of determining the screen display direction will be described in detail later with reference to FIGS. 64 to 66.

Next, the screen is displayed in step 1020 f, and the process returns to step 1020 b.

FIG. 58 is a flowchart for explaining the method of updating the reference orientation (step 1020 b) in FIG. The processing flow shown in FIG. 58 will be described below.

First, starting at step 1010a, it is detected at step 1010b whether the mobile device has been leveled down. A method of detecting whether the mobile device has been leveled will be described in detail later with reference to FIGS. 59 to 61.

Next, in step 1010c, it is determined whether it is detected whether the mobile device has been leveled down.

In the case of No, the process proceeds to step 1010 f and ends. In the case of Yes, the process proceeds to step 1010 d, and holds the value of the direction sensor of the mobile device when being flipped horizontally as the reference direction, and the display screen direction from the rotation direction of the mobile device when being flipped horizontally at step 1010 e Hold. The method of determining the display screen direction will be described in detail later with reference to FIGS. 62 and 63.

Then, the process ends at step 1010 f.

FIG. 59 is a flowchart for explaining a detection method (1010b) that the mobile device of FIG. 58 falls horizontally.

The processing flow shown in FIG. 59 will be described.

First, step 1030a starts.

Next, in step 1030b, the previous horizontal state of the mobile device is acquired.

Next, in step 1030 c, the absolute values of the three-axis magnetic sensor are acquired. Here, FIG. 60 is a diagram showing an example of directions of three axes of the magnetic sensor of the mobile device.

Next, in step 1030d, it is checked whether the sum of the x-axis and y-axis sensor values is greater than the z-axis sensor value by a threshold or more.

If step 1030d is YES, control is passed to step 1030e, where it is determined that the current horizontal state is horizontal.

Next, in step 1030 g, it is checked whether the previous horizontal state is “non-horizontal” and the current horizontal state is “horizontal”.

If step 1030g is YES, control is passed to step 1030h, where it is determined that the mobile device has been leveled horizontally, and processing ends at step 1030i.

If step 1030d is NO, the process proceeds to step 1030f, determines that the current horizontal state is not horizontal, proceeds to step 1030g, and if step 1030g is NO, proceeds to step 1030i and ends.

Next, when the detection method (1010e) of the front screen direction in FIG. 58 is described using FIG. 62 and FIG. 63, first, starting at step 1070a, immediately before the mobile device is leveled down at step 1070b. The values (Pitch and Roll) of the immediately following gyro sensor are obtained, and the amount of change in Pitch and Roll is determined. Here, Pitch and Roll of the mobile device are rotation angles of the x axis and the y axis shown in FIG.

Next, in step 1070c, it is checked whether the amount of change in Pitch> the amount of change in Roll.

In the case of Yes, the processing proceeds to step 1070d, and it is confirmed whether Pitch> 0. In the case of Yes, the process proceeds to step 1070e, the + y-axis direction is held as the display screen direction, and the process ends at step 1070j. On the other hand, if step 1070d is No, the process proceeds to step 1070f, holds the -y axis direction as the display screen direction, and ends at step 1070j.

If Step 1070c is No, the process proceeds to Step 1070g, and it is confirmed whether Roll> 0. If Yes, the process proceeds to Step 1070h, holds the + x axis direction as the display screen direction, and ends at Step 1070j. .

Next, if step 1070g is No, the process proceeds to step 1070i, the −x axis direction is held as the display screen direction, and the process ends at step 1070j.

Subsequently, the screen display direction of FIG. 58 will be described using FIG. 64 to FIG.

The processing flow shown in FIG. 66 will be described.

First, in step 1100a, in step 1100b, the screen display direction change table shown in FIG. 64 is referred to, and a transition step is obtained from the rotation angle.

Next, in step 1100c, the screen display direction transition diagram shown in FIG. 65 is referred to, and the state of the display screen direction of the mobile device when being held horizontally is acquired.

Next, at step 1100 d, the state is advanced from the state acquired at step 1100 c by the step obtained at step 1100 b.

Next, the direction of the previous state advanced in step 1100 e is held as the direction of the display screen, and the process ends in step 1100 f.

According to the method, it is possible to obtain the effect that the screen of the mobile device can always be displayed in the appropriate direction to the user, even when the mobile device placed horizontally is used while turning it repeatedly.

For example, when the mobile device is flipped horizontally on the desk from the state shown in FIG. 1B as shown in FIG. 1C and rotated 90 degrees counterclockwise as shown in FIG. 1D. Do. It is desirable for the user to always display the screen display in his / her direction.

At this time, according to the flow of FIG. 63, the side of 001-a of the mobile device shown in FIG. 1 is considered as the rotation angle, and the + y axis direction is held as the display screen direction. An example of rotation in this case will be described with reference to FIG. In (A) of FIG. 67, the orientation of the mobile device points at the orientation of 270 degrees. Since this 270 degree is the azimuth when it is turned horizontally, the reference azimuth = 270 degrees is held. In (B) of FIG. 67, the azimuth of the mobile device when the mobile device is rotated by the user is 230 degrees. In this case, the rotation angle is 230-270 = -40 degrees. Referring to the screen display direction change table of FIG. 64, since the transition of the rotational display direction is 0 step at −40 degrees, the screen display direction remains in the + y direction. Next, when the user rotates the mobile device to (C) in FIG. 67, the current orientation of the mobile device is 180 degrees. At this time, the rotation angle is 180-270 = -90 degrees. Referring to the screen display direction table of FIG. 64, -90 degrees is 3 steps advanced, and in the screen display direction transition diagram of FIG. 65, since the current direction is + y axis direction, + x axis direction advanced by 3 steps , New screen display direction.

Although the method using the magnetic sensor shown in FIG. 59 has been described as the method of detecting whether the mobile device in FIG. 66 has been leveled horizontally (step 1010 b), a detection method using an acceleration sensor may be used. A detection method using an acceleration sensor will be described with reference to FIG.

First, in step 1050a, in step 1050b, the previous horizontal state of the mobile device is acquired.

Next, in step 1050c, the value of the acceleration sensor is acquired.

Next, in step 1050 d, is the difference between the acceleration in the two axial directions and the dynamic acceleration smaller than the threshold? Check if.

In the case of Yes, the process proceeds to step 1050e to determine that the current horizontal state is horizontal.

Next, in step 1050g, is the previous horizontal state "non-horizontal" and the current horizontal state "horizontal"? Check if.

In the case of Yes, the process proceeds to step 1050g, determines that the mobile device has fallen horizontally, and ends at step 1050h.

If step 1050d is NO, the process proceeds to step 1050f, determines that the current horizontal state is not horizontal, proceeds to step 1050g, and if step 1050g is NO, proceeds to step 1030h and ends.

Note that the rotation of the device may be detected using a gyroscope without using the orientation sensor, and the display screen may be changed according to the rotation of the device. In this method, an accumulated error occurs each time the sensor is rotated more than the direction sensor, but even with a device that does not have the direction sensor, the screen orientation can be displayed in an appropriate direction according to the rotation of the device. You can get

In the fifth embodiment, the mobile terminal 5000 may be equipped with a proximity sensor or a sensor for detecting contact, and the screen to be activated may be directed to the user at the time of sleep release. This makes it possible to automatically rotate the screen in a direction easy for the user to view, regardless of the position of the mobile terminal 5000 and the user at the time of sleep release or power ON.

FIG. 67 is a diagram showing the orientation of the mobile device in the case where the mobile device rotates in the fifth embodiment of the present invention. FIG. 67 shows an example of the orientation of the mobile device when performing the flow of FIG. 63 described above. Arrows in the figure indicate the orientation of the screen of the mobile device.

Further, another example of automatically rotating the screen in a direction easy for the user to view is shown in FIG. Here, FIG. 68 is a diagram showing a display of the mobile device when a person looks at the mobile device in the fifth embodiment of the present invention. 69 and 70 are diagrams showing a flow when a person rotates while holding the tablet, which is one aspect of the mobile device in the fifth embodiment of the present invention. The flow shown in FIG. 69 will be described below.

First, it starts at step 1130a.

Next, in step 1020b, the reference orientation is updated.

Next, in step 1130 g, it is checked whether or not acceleration of one, two, or three axes of the acceleration sensor has been detected within a predetermined time (for example, 500 milliseconds).

If it can not be confirmed (No in step 1130 g), the process proceeds to step 1020 c, and the value of the direction sensor is acquired as the current direction.

Next, in step 1020 d, the difference between the reference orientation and the current orientation is calculated and used as the rotation angle.

Next, in step 1020e, the screen display direction is determined from the relationship between the rotation angle and the screen display table.

Next, in step 1020 f, the screen is displayed. Then, it returns to step 1020b.

If it can be confirmed in step 1130 g (Yes in step 1130 g), the process returns to step 1020 b.

Subsequently, the flow shown in FIG. 70 will be described.

First, it starts at step 1130a.

Next, in step 1140b, the reference orientation is updated.

Next, in step 1140c, the face of the user is photographed.

Next, in step 1140 g, it is checked whether the orientation of the face of the user photographed when the reference orientation has been updated and whether the current orientation of the face has changed.

If it can be confirmed, that is, if the current face orientation has changed (Yes in step 1140), the process proceeds to step 1020c, and the value of the orientation sensor is acquired as the current orientation.

The processes after step 1020 d are the same as described with reference to FIG.

Here, the method of updating the reference orientation will be described with reference to FIG.

FIG. 71 is a diagram showing a flow of a method of updating the reference orientation of the mobile device in the fifth embodiment of the invention.

First, it starts at step 1150a.

Next, in step 1010b, it is detected whether the mobile device has been leveled down.

Next, in step 1010c, it is checked whether the mobile device has been leveled down or detected.

If it is detected (Yes in step 1010c), the process proceeds to step 1010d, and the value of the direction sensor of the mobile device when it is lowered horizontally is held as the reference direction.

Next, in step 1010e, the display screen direction is held from the rotation direction of the mobile device when it is flipped horizontally.

Next, in step 1150 g, the face of the user is photographed, and the process proceeds to step 1050 f and ends.

If it is not detected at step 1010c (No at step 1010c), the process proceeds to step 1050f and ends.

As described above, according to the fifth embodiment, it is possible to automatically rotate the screen in a direction easy for the user to view, regardless of the positions of the mobile terminal and the user.

In addition, although the case where the user using a mobile terminal is one was demonstrated above, it does not restrict to it. For example, as shown in FIG. 72, a person facing the mobile device may use it. Here, FIG. 72 is a diagram showing a display of the mobile device when a person facing the mobile device looks at the mobile device according to the fifth embodiment of the present invention.

Further, in the fifth embodiment, when the mobile terminal 5000 is in a car, control may be performed to suppress the rotation of the mobile terminal 5000. Specifically, in coordination with the in-vehicle mode, if rotation control is performed, or if the moving speed is higher than the threshold value from GPS and acceleration information, it is determined that the user is on a car or other moving means, and the screen is rotated. You may This further improves the convenience of the user.

As described above, according to the present invention, it is possible to automatically rotate the screen in a direction easy for the user to view, regardless of the position of the information display device and the user.

Specifically, the information display device according to one aspect of the present invention is the information display device based on information acquired by a display unit that displays an image according to the orientation of the display screen, an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor. And a determination unit that determines the orientation change of the information display device, and determines the orientation of the display screen, the determination unit determining whether the display screen of the information display device is substantially the same When it is determined that there is a change in the attitude of the information display device in the horizontal state, the orientation of the display screen of the information display device before it is determined that there is a change in the attitude of the information display device is used as a reference. The direction of the display screen is determined so that the side of the information display device in the direction formed by the reference direction and the predetermined angle is the upper part of the display screen when the information display device moves by a predetermined angle or more. The display unit displays an image in accordance with the orientation of the display screen determined by the determining unit.

Here, when the determination unit determines that the display screen of the information display device is not in a substantially horizontal state and that there is a change in posture of the information display device, the determination unit is closest to the upper side opposite to the vertical direction. The orientation of the display screen may be determined such that the side of the information display device is at the top of the display screen, and the display unit may display an image according to the orientation of the display screen determined by the determination unit.

Here, the attitude of the information display device means the appearance of the outer shape of the information display device which appears when the information display device performs some static or dynamic operation or when the information display device performs some operation. It is indicated by the inclination from the ground plane and the direction. In addition, “display according to the orientation of the display screen” means, for example, when displaying the entire image of the building, the top floor of the building in the direction (upper side) of the orientation of the display screen Lower side) Direction when displaying the basement of a building. Further, the sides of the information display device correspond to four sides in the case where the information display device is formed, for example, in a quadrangular outer shape.

With this configuration, it is possible to automatically rotate the screen in a direction easy for the user to view, regardless of the position of the information display device and the user.

In addition, the information display device according to an aspect of the present invention further includes a centrifugal force direction detection unit that detects a centrifugal force direction based on the information acquired by the acceleration sensor, and the determination unit determines the information display device When the display screen is substantially horizontal and the centrifugal force direction detection unit detects the centrifugal force direction and determines that there is a change in the posture of the information display device, the centrifugal force detected by the centrifugal force direction detection unit The orientation of the display screen is determined so that the side of the information display device farthest in the force direction is at the top of the display screen, and the display unit displays an image according to the orientation of the display screen determined by the determination unit You may.

Further, the information display apparatus according to an aspect of the present invention includes a shake detection unit that detects a shake of a side of the information display apparatus based on information acquired by at least one of the acceleration sensor and the angular velocity sensor. In the determination unit, the display screen of the information display device is in a substantially horizontal state, and the shake detection unit detects a shake of a side having an amplitude equal to or greater than a threshold, and an attitude change of the information display device If it is determined that there is, the direction of the display screen is determined such that the side with the largest amplitude of the shake detected by the shake detection unit is at the top of the display screen, and the display unit is determined by the determination unit The image may be displayed according to the orientation of the display screen.

In the information display device according to one aspect of the present invention, the current position of the information display device is further determined by autonomous navigation using information acquired by the acceleration sensor and at least one of the angular velocity sensor and the geomagnetic sensor. A coordinate estimation unit for estimating the position of the user using the information display terminal based on the posture of the information display terminal at the current position and the orientation of the display screen; When the display screen of the information display terminal is rotated at the current position while the display screen of the information display terminal is substantially horizontal, the estimated position of the user is displayed. The orientation of the display screen may be determined to be at the bottom of the screen, and the display unit may display an image according to the orientation of the display screen determined by the determination unit. .

Here, for example, when the information display device is moving, the determination unit is configured to move the position of the user from the moving direction of the information display terminal on the opposite side to the moving direction with respect to the information display terminal. The orientation of the display screen is determined such that the position of the user estimated is present and the position of the estimated user is at the bottom of the display screen, and the display unit determines the image according to the orientation of the display screen determined by the determination unit. It may be displayed.

Furthermore, in the information display device according to one aspect of the present invention, the display unit is a part of the position on the display screen, the position being determined based on the orientation of the display screen with respect to the user. An icon may be displayed to indicate the normal position of the information display device.

As mentioned above, although the information display apparatus which concerns on the one or several aspect of this invention was demonstrated based on embodiment, this invention is not limited to this embodiment. Without departing from the spirit of the present invention, various modifications as may occur to those skilled in the art may be applied to this embodiment, or a configuration constructed by combining components in different embodiments may be one or more of the present invention. It may be included within the scope of the embodiments.

In the above embodiments, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory. Here, software for realizing the information display device and the like of each of the above-described embodiments is the following program.

That is, this program detects the attitude of the information display device based on the information obtained by the display step of displaying an image according to the orientation of the display screen of the information display device on a computer, and the acceleration sensor, the angular velocity sensor and the geomagnetic sensor. Determining an attitude change of the information display device, and determining an orientation of the display screen, wherein the display screen of the information display device is substantially horizontal in the determination step. And the information display apparatus based on the orientation of the display screen of the information display apparatus before it is determined that there is a change in the attitude of the information display apparatus when it is determined that there is a change in the attitude of the information display apparatus. Side moves by more than a predetermined angle, the side of the information display device in the direction that is more than the predetermined angle with the reference and the upper part of the display screen Determining the orientation of so that the display screen, in the display step may be to perform the displaying the image in accordance with the orientation of the display screen determined in the determining step.

The information display device according to the present invention is particularly useful for providing a user interface of a high-performance portable information display terminal such as a smartphone and a tablet.

101 acceleration sensor 102 angular velocity sensor 103 geomagnetic sensor 104 terminal attitude detection unit 105 display direction determination unit 106 time series terminal state management unit 107 time series terminal state storage unit 108 image display unit 111 centrifugal force direction detection unit 121 movement amount detection unit 1002 angular velocity Sensor 1003 Geomagnetic sensor 1004 Display 1005 Display direction control unit 1006 Screen display control unit 1010 Memory 1020 Controller 1030 External input unit 5000 Mobile terminal

Claims (10)

  1. An information display device,
    A display unit that displays an image according to the orientation of the display screen;
    An attitude detection unit that detects an attitude of the information display device based on information acquired by an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor;
    A determination unit that determines a change in posture of the information display device and determines an orientation of the display screen;
    If the determination unit determines that the display screen of the information display device is substantially horizontal and that there is a change in posture of the information display device, it is determined that there is a change in posture of the information display device When the information display device moves by a predetermined angle or more with respect to the orientation of the display screen of the information display device, the side of the information display device in the direction formed by the reference direction and the predetermined angle or more is the display Determine the orientation of the display screen to be at the top of the screen,
    The display unit displays an image in accordance with the orientation of the display screen determined by the determination unit.
  2. When the determination unit determines that the display screen of the information display device is not in a substantially horizontal state and that there is a change in the attitude of the information display device, the information display closest to the upper side opposite to the vertical direction Determine the orientation of the display screen so that the side of the device is at the top of the display screen;
    The information display device according to claim 1, wherein the display unit displays an image in accordance with the orientation of the display screen determined by the determination unit.
  3. And a centrifugal force direction detection unit that detects a centrifugal force direction based on the information acquired by the acceleration sensor.
    When the determination unit determines that the display screen of the information display device is in a substantially horizontal state, the centrifugal force direction detection unit detects a centrifugal force direction, and that there is a change in posture of the information display device. The direction of the display screen is determined such that the side of the information display device farthest in the centrifugal force direction detected by the centrifugal force direction detection unit is at the top of the display screen,
    The information display device according to claim 1, wherein the display unit displays an image in accordance with the orientation of the display screen determined by the determination unit.
  4. And a shake detection unit configured to detect a shake of a side of the information display device based on information acquired by at least one of the acceleration sensor and the angular velocity sensor.
    In the determination unit, the display screen of the information display device is in a substantially horizontal state, and the shake detection unit detects a shake of a side having an amplitude equal to or greater than a threshold, and an attitude change of the information display device When it is determined that there is, the direction of the display screen is determined such that the side with the largest amplitude of the shake detected by the shake detection unit is at the top of the display screen,
    The information display device according to claim 1, wherein the display unit displays an image in accordance with the orientation of the display screen determined by the determination unit.
  5. And a coordinate estimation unit configured to estimate the current position of the information display device by autonomous navigation using information acquired by the acceleration sensor and at least one of the angular velocity sensor and the geomagnetic sensor.
    The determination unit further determines, based on the information display terminal, the position of the user using the information display terminal based on the attitude of the information display terminal at the current position and the orientation of the display screen. When it is estimated that the display screen of the information display terminal is substantially horizontal at the current position, the display is performed so that the estimated position of the user is at the bottom of the display screen. Determine the orientation of the screen,
    The information display device according to any one of claims 1 to 4, wherein the display unit displays an image in accordance with the orientation of the display screen determined by the determination unit.
  6. When the information display device is moving, the determination unit estimates the position of the user from the moving direction of the information display terminal as being opposite to the moving direction with respect to the information display terminal. Determining the orientation of the display screen such that the estimated position of the user is at the bottom of the display screen;
    The information display device according to any one of claims 1 to 5, wherein the display unit displays an image in accordance with the orientation of the display screen determined by the determination unit.
  7. The display unit further includes
    The display device according to any one of claims 1 to 6, wherein an icon for indicating the correct position of the information display device to the user is displayed at a position which is a part of the position on the display screen and is determined based on the orientation of the display screen. The information display device according to 1 or 2.
  8. Displaying the image according to the orientation of the display screen of the information display device;
    An attitude detection step of detecting an attitude of the information display device based on information acquired by an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor;
    Determining a change in posture of the information display device, and determining a direction of the display screen;
    In the determination step, when it is determined that the display screen of the information display device is substantially horizontal and that there is a change in posture of the information display device, it is determined that there is a change in posture of the information display device When the information display device moves by a predetermined angle or more with respect to the orientation of the display screen of the information display device, the side of the information display device in the direction formed by the reference and the predetermined angle or more is the display screen Determine the orientation of the display screen to be on top,
    An information display method for displaying an image according to the orientation of the display screen determined in the determination step in the display step.
  9. Displaying the image according to the orientation of the display screen of the information display device;
    An attitude detection step of detecting an attitude of the information display device based on information acquired by an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor;
    Determining a change in posture of the information display device, and determining a direction of the display screen;
    In the determination step, when it is determined that the display screen of the information display device is substantially horizontal and that there is a change in posture of the information display device, it is determined that there is a change in posture of the information display device When the information display device moves by a predetermined angle or more with respect to the orientation of the display screen of the information display device, the side of the information display device in the direction formed by the reference and the predetermined angle or more is the display screen Determine the orientation of the display screen to be on top,
    The non-temporary computer-readable recording medium with which the program for making a computer perform displaying an image according to the direction of the said display screen determined in the said determination step in the said display step was recorded.
  10. An integrated circuit configured as an information display device,
    A display unit that displays an image according to the orientation of the display screen;
    An attitude detection unit that detects an attitude of the information display device based on information acquired by an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor;
    A determination unit that determines a change in posture of the information display device and determines an orientation of the display screen;
    If the determination unit determines that the display screen of the information display device is substantially horizontal and that there is a change in posture of the information display device, it is determined that there is a change in posture of the information display device When the information display device moves by a predetermined angle or more with respect to the orientation of the display screen of the information display device, the side of the information display device in the direction formed by the reference and the predetermined angle or more is the display screen Determine the orientation of the display screen to be on top,
    The display unit displays an image according to the orientation of the display screen determined by the determination unit.
PCT/JP2012/004176 2011-08-10 2012-06-27 Information display device WO2013021539A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2011-175453 2011-08-10
JP2011175453 2011-08-10

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201280002232.XA CN103201700B (en) 2011-08-10 2012-06-27 Information display means
JP2013502329A JP6021800B2 (en) 2011-08-10 2012-06-27 Information display device

Publications (1)

Publication Number Publication Date
WO2013021539A1 true WO2013021539A1 (en) 2013-02-14

Family

ID=47668081

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/004176 WO2013021539A1 (en) 2011-08-10 2012-06-27 Information display device

Country Status (3)

Country Link
JP (1) JP6021800B2 (en)
CN (1) CN103201700B (en)
WO (1) WO2013021539A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013070194A (en) * 2011-09-21 2013-04-18 Kyocera Corp Portable terminal device, program, and display control method
CN103217895A (en) * 2013-04-07 2013-07-24 上海与德通讯技术有限公司 Electronic wristwatch and electronic communication device capable of supporting gesture function
CN104077052A (en) * 2014-06-26 2014-10-01 联想(北京)有限公司 Information processing method and electronic equipment
JP2015502602A (en) * 2011-11-09 2015-01-22 サムスン エレクトロニクス カンパニー リミテッド Screen rotation control method terminal and touch systems and support this,
JP2015184391A (en) * 2014-03-21 2015-10-22 大木 光晴 Image display method, device, and program
KR101588136B1 (en) * 2014-10-10 2016-02-15 한국과학기술원 Method and Apparatus for Adjusting Camera Top-down Angle for Mobile Document Capture
KR101632538B1 (en) * 2015-07-28 2016-06-22 한국과학기술원 Method and Apparatus for Adjusting Camera Top-down Angle for Mobile Document Capture based on Micro Tilting
JP2016531340A (en) * 2013-07-02 2016-10-06 ジャン,ホンミン Mobile operating system
JP2016536712A (en) * 2014-08-12 2016-11-24 シャオミ・インコーポレイテッド Weather display method, apparatus, program and recording medium
JP2018514003A (en) * 2015-12-25 2018-05-31 小米科技有限責任公司Xiaomi Inc. Electrical equipment protection method and protection systems, and electrical equipment

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103744510A (en) * 2014-01-06 2014-04-23 联想(北京)有限公司 Information processing method and electronic device
CN104244045B (en) * 2014-09-28 2016-02-24 小米科技有限责任公司 The control method and apparatus for presenting video picture

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000250434A (en) * 1999-02-26 2000-09-14 Sharp Corp Portable information equipment and gravitational direction detector
JP2008070884A (en) * 2004-01-28 2008-03-27 Softbank Mobile Corp Mobile communication terminal
JP2008139711A (en) * 2006-12-05 2008-06-19 Lenovo Singapore Pte Ltd Portable electronic equipment, method of changing display direction of screen, program, and storage medium
JP2010026064A (en) * 2008-07-16 2010-02-04 Sony Computer Entertainment Inc Portable image display, control method thereof, program, and information storage medium
JP2010113503A (en) * 2008-11-06 2010-05-20 Sharp Corp Mobile terminal device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003345492A (en) * 2002-05-27 2003-12-05 Sony Corp Portable electronic apparatus
JP2005242283A (en) * 2004-01-28 2005-09-08 Vodafone Kk Mobile communication terminal
JP2010237030A (en) * 2009-03-31 2010-10-21 Alps Electric Co Ltd Current position display
JP4823342B2 (en) * 2009-08-06 2011-11-24 株式会社スクウェア・エニックス A portable computer with a touch-panel display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000250434A (en) * 1999-02-26 2000-09-14 Sharp Corp Portable information equipment and gravitational direction detector
JP2008070884A (en) * 2004-01-28 2008-03-27 Softbank Mobile Corp Mobile communication terminal
JP2008139711A (en) * 2006-12-05 2008-06-19 Lenovo Singapore Pte Ltd Portable electronic equipment, method of changing display direction of screen, program, and storage medium
JP2010026064A (en) * 2008-07-16 2010-02-04 Sony Computer Entertainment Inc Portable image display, control method thereof, program, and information storage medium
JP2010113503A (en) * 2008-11-06 2010-05-20 Sharp Corp Mobile terminal device

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013070194A (en) * 2011-09-21 2013-04-18 Kyocera Corp Portable terminal device, program, and display control method
JP2015502602A (en) * 2011-11-09 2015-01-22 サムスン エレクトロニクス カンパニー リミテッド Screen rotation control method terminal and touch systems and support this,
US9785202B2 (en) 2011-11-09 2017-10-10 Samsung Electronics Co., Ltd. Method for controlling rotation of screen and terminal and touch system supporting the same
CN103217895A (en) * 2013-04-07 2013-07-24 上海与德通讯技术有限公司 Electronic wristwatch and electronic communication device capable of supporting gesture function
US10324583B2 (en) 2013-07-02 2019-06-18 Hongming Jiang Mobile operating system
JP2016531340A (en) * 2013-07-02 2016-10-06 ジャン,ホンミン Mobile operating system
JP2015184391A (en) * 2014-03-21 2015-10-22 大木 光晴 Image display method, device, and program
CN104077052A (en) * 2014-06-26 2014-10-01 联想(北京)有限公司 Information processing method and electronic equipment
JP2016536712A (en) * 2014-08-12 2016-11-24 シャオミ・インコーポレイテッド Weather display method, apparatus, program and recording medium
KR101588136B1 (en) * 2014-10-10 2016-02-15 한국과학기술원 Method and Apparatus for Adjusting Camera Top-down Angle for Mobile Document Capture
KR101632538B1 (en) * 2015-07-28 2016-06-22 한국과학기술원 Method and Apparatus for Adjusting Camera Top-down Angle for Mobile Document Capture based on Micro Tilting
JP2018514003A (en) * 2015-12-25 2018-05-31 小米科技有限責任公司Xiaomi Inc. Electrical equipment protection method and protection systems, and electrical equipment

Also Published As

Publication number Publication date
JP6021800B2 (en) 2016-11-09
CN103201700B (en) 2017-03-08
CN103201700A (en) 2013-07-10
JPWO2013021539A1 (en) 2015-03-05

Similar Documents

Publication Publication Date Title
US9563229B2 (en) Portable computer with multiple display configurations
US8903517B2 (en) Computer device and an apparatus having sensors configured for measuring spatial information indicative of a position of the computing devices
US9019204B2 (en) Electronic apparatus and control method therefor
CN103365594B (en) The flexible display device and a method for providing its ui
US8531399B2 (en) Control apparatus, input apparatus, control system, control method, and handheld apparatus
JP5670384B2 (en) Free space pointing device with an ease of use that slope compensation and improvement
US8610663B2 (en) Portable device and method for controlling the same
US9919233B2 (en) Remote controlled vehicle with augmented reality overlay
JP5397081B2 (en) Mobile terminal
US20090322676A1 (en) Gui applications for use with 3d remote controller
KR101627191B1 (en) Method and apparatus for determining a user input from inertial sensors
KR101515629B1 (en) Method and apparatus for providing event of portable device having flexible display unit
US20100033422A1 (en) Systems and methods for processing motion sensor generated data
US9108105B2 (en) Systems and methods for determining controller functionality based on position, orientation or motion
US10101873B2 (en) Portable terminal having user interface function, display method, and computer program
CN104160686B (en) The portable electronic device based on the user motion and control the operation of the method
US8972617B2 (en) Multi-configuration computer
US9134799B2 (en) Interacting with a projected user interface using orientation sensors
JP4325707B2 (en) Input device, control device, a control system and control method
US9507431B2 (en) Viewing images with tilt-control on a hand-held device
US8339364B2 (en) Spatially-correlated multi-display human-machine interface
US9292102B2 (en) Controlling and accessing content using motion processing on mobile devices
KR101577124B1 (en) Remote control device
US8939838B2 (en) Accessory for playing games with a portable electronic device
US8913009B2 (en) Spatially-correlated multi-display human-machine interface

Legal Events

Date Code Title Description
ENP Entry into the national phase in:

Ref document number: 2013502329

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12821688

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct app. not ent. europ. phase

Ref document number: 12821688

Country of ref document: EP

Kind code of ref document: A1