KR20130139746A - Portable information display terminal - Google Patents

Abstract

Provided is a portable information display terminal capable of displaying a screen in an appropriate display direction even when a user's face direction cannot be detected. The portable information display terminal 1 is a state for detecting at least a use state of the case and the display unit by detecting the display unit 10 for displaying information, the case 20 provided with the display unit on the surface, and the inclination of the case. The face direction is detected by the face detection function on the basis of the detection sensor 53, the imaging section 11 capable of imaging the user's face, and the data of the user's face captured by the imaging section. And a control unit 51 for controlling to switch the screen display direction of the display unit on the basis of the detection result of the detection result and the detection result by the state detection sensor.

Description

Portable information display terminal {PORTABLE INFORMATION DISPLAY TERMINAL}

The present invention relates to a portable information display terminal, and more particularly, to a portable information display terminal having a display unit and a case in which the display unit is provided.

Background Art Conventionally, a portable information display terminal having a display portion and a case in which the display portion is provided is known. Such a portable information display terminal is disclosed, for example, in Japanese Patent Application Laid-Open No. 2009-130816.

Japanese Patent Application Laid-Open No. 2009-130816 discloses a display unit for displaying a television broadcast image (screen display), a mobile phone body (case) in which the display unit is provided on the surface, and a camera (imaging unit) capable of capturing a user's face. A mobile phone (portable information display terminal) provided with is disclosed. The mobile phone according to Japanese Patent Application Laid-Open No. 2009-130816 discloses a user's face photographed by a camera when the user starts viewing the television broadcast image by the display unit while the user holds the mobile phone main body. The display unit is configured to display a television broadcast video in a display direction corresponding to the face direction of the captured user.

Patent Document 1: Japanese Patent Application Publication No. 2009-130816

However, in a mobile phone (portable information display terminal) according to Japanese Patent Application Laid-Open No. 2009-130816, when a user's face cannot be imaged by a camera, such as when there is no user in the imaging range of the camera, the user Face direction cannot be detected. For this reason, in the mobile phone according to Japanese Patent Application Laid-Open No. 2009-130816, when the user's face direction cannot be detected, the television broadcast video (screen display) is used as an appropriate display direction corresponding to the user's face direction. There is a problem that the display cannot be displayed.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and one object of the present invention is to provide a portable information display terminal capable of displaying a screen in an appropriate display direction even when a user's face direction cannot be detected. To provide.

According to one aspect of the present invention, a portable information display terminal includes a display unit for displaying information, a case in which the display unit is provided on a surface, and a state detection sensor for detecting at least a use state of the case and the display unit by detecting the inclination of the case. And an image capturing unit capable of capturing a user's face, and a face direction detection by a face detection function based on data of the user's face captured by the image capturing unit. And a control unit for controlling to switch the screen display direction of the display unit based on the detection result by the control unit.

In the portable information display terminal according to one aspect of the present invention, as described above, the screen display of the display unit is performed based on the detection result of the user's face direction detected by the face detection function and the detection result by the state detection sensor. By changing the directions, unlike the case where the image display direction of the display unit is switched based only on the detection result of the face direction of the user detected by the face detection function, the face direction of the user captured by the imaging unit cannot be detected. Even if it is, the state detection sensor which detects the inclination of a case can detect what state (posture) a case is. Thus, even when the face direction of the user captured by the imaging unit cannot be detected, the screen can be displayed in an appropriate display direction based on the state (posture) detected by the state detection sensor.

In the portable information display terminal according to the one aspect, preferably, after the control unit detects the use state of the case and the display unit by the state detection sensor, based on the detection result by the state detection sensor, It is configured to perform control for determining whether to detect the direction of the face of the user. With such a configuration, prior to the start of the imaging unit, the state detection sensor detects the use state of the case and the display unit, and it is possible to determine whether the imaging unit needs to be activated in accordance with the detection result by the state detection sensor. Thereby, when it is not necessary to detect the direction of a user's face by the imaging unit, there is no need to perform an operation process for unnecessarily starting the imaging unit, so that the operation of displaying the screen in the proper display direction can be performed quickly. .

In the portable information display terminal according to one of the above aspects, preferably, when the predetermined use state is detected by the state detection sensor, the control unit has a direction of the face of the user rather than the use state detected by the state detection sensor. It is comprised so that a detection result may be given priority and it switches to the screen display direction corresponding to a direction of a face of a user. In such a configuration, when the screen display direction based on the detection result of the user's face direction and the screen display direction based on the inclination by the state detection sensor are in a predetermined use state that is likely to be different, By giving priority to the detection result, it can display as a screen display direction more suited to actual usage.

In the portable information display terminal which switches to the screen display direction corresponding to the direction of the face of the user when the predetermined use state is detected, Preferably, the predetermined use state is a use state in which the case is held by hand and used. When the use state of gripping and using the case by hand is detected, the control unit gives priority to the detection result in the face direction of the user over the use state detected by the state detection sensor, and the screen corresponding to the face direction of the user. It is comprised so that it may switch to a display direction. In such a configuration, it is difficult to determine how the user is viewing the screen in the detection result based on the inclination by the state detection sensor in the case of using the case lying down while holding the case by hand. In the case of holding by the hand, the direction of the face of the user is preferentially detected and the screen direction corresponding to the direction of the face of the user can be switched to display as a suitable screen display direction that is more suitable for the actual usage. have.

In the portable information display terminal which switches to the screen display direction corresponding to the direction of the face of the user when the predetermined use state is detected, Preferably, the control unit is based on data of the face of the user picked up by the imaging unit. When it is determined that the user's face direction is inclined within a predetermined angle range with respect to the reference line along the up and down direction of the display unit, control is performed to hold the display unit without changing the screen display direction. In this configuration, it is possible to avoid a situation in which the screen display direction is frequently switched in strict response to the state in which the user's face direction does not coincide completely in the up and down direction of the display unit, so that frequent display screen switching operations are performed. As a result, the operability of the portable information display terminal by the user can be improved.

In the portable information display terminal which is maintained without changing the screen display direction of the display unit when the direction of the face of the user is inclined within a predetermined angle range with respect to the reference line, the predetermined angle range is preferably the direction of the face of the user. Angle ranges tilted approximately equally in the left and right directions perpendicular to the reference line. With such a configuration, even if the direction of the face of the user is inclined in any of the left and right directions with respect to the reference line, it is possible to determine whether or not the screen display direction is switched with almost the same sensitivity. Therefore, the operability of the portable information display terminal can be made uniform without depending on the inclination direction of the face direction.

In this case, preferably, the imaging section is disposed outside the display section along the reference line. In such a configuration, the user's face direction can be specified by the imaging unit centered on the reference line along the vertical direction of the display unit, so that the inclination direction of the user's face direction can be detected with high accuracy.

In the portable information display terminal which switches to the screen display direction corresponding to the direction of the face of the user when the predetermined use state is detected, Preferably, the control unit uses the case by hand holding the case by the state detection sensor. When it is detected that it is not a state, it is comprised so that control of switching the screen display direction of a display part may be performed based on the detection result by a state detection sensor. In this way, when it is detected that the case is not held by the hand, it is considered that the case is fixedly placed on a mounting surface or the like. When the case is fixedly placed on a mounting surface or the like, the direction of the display portion and the direction of the face of the user when the user views the display portion are in a constant relationship, and the face of the user is higher than the case where the case is held and used by hand. In this case, the screen cannot be detected in an appropriate display direction by performing a control to switch the screen display direction of the display unit using the detection result of the state detection sensor without using the face detection function in this case. I can display it.

In this case, preferably, when it is detected by the state detection sensor that the case is not in the use state in which the case is held by hand, the control unit does not start the imaging unit, and based on the detection result by the state detection sensor, It is comprised so that control to switch the screen display direction of a display part may be performed. In such a configuration, the operation processing to start the imaging unit unnecessarily is not performed, so that the operation of displaying the screen in the proper display direction can be performed quickly. In addition, the power consumption of the portable information display terminal can be reduced as long as the imaging unit is not activated.

In the portable information display terminal which switches to the screen display direction corresponding to the direction of the face of the user when the predetermined state of use is detected, Preferably, the state detection sensor detects the inclination of the case to detect the case and the display unit. Use of any one of the first use state to stand on the mounting surface, the second use state to use the case and the display unit lying on the mounting surface, and the third use state to hold the case as a predetermined use state by hand. It is provided in order to detect whether it is a state, and a control part gives priority to the detection result of a user's face direction, when a state detection sensor detects that it is at least a 3rd use state, and displays the screen display direction corresponding to a user's face direction. When switching to, and when it is detected by the state detection sensor that the first use state or the second use state, Based on the detection result by a detection sensor, it is comprised so that control to switch the screen display direction of a display part may be performed. In such a configuration, when the case is in the first use state and the second use state placed on the mounting surface, the screen can be displayed in an appropriate display direction by the state detection sensor. In the third use state in which the case is gripped by hand, the screen can be displayed in an appropriate display direction that matches the user's face direction based on the detection result of the user's face direction.

In the portable information display terminal which switches to the screen display direction corresponding to the direction of the face of the user when the predetermined use state is detected, Preferably, the state detection sensor has at least the display unit again in addition to the predetermined use state. It is configured to detect the state lying up to face the tooth surface, the control unit is detected by the state detection sensor that the case is not a predetermined use state held by the user, and the inclination of the state in which the display is upside down facing the mounting surface Is detected, the system enters the standby mode without using the face detection function and detects that the predetermined state of use of the case is held by the user by the state detection sensor, and the display unit faces up to the mounting surface. When the tilt of the released state is detected, the direction of the face of the user does not enter standby mode. It is comprised so that control to display the screen display based on a detection result will be performed. In such a configuration, when the state detection sensor detects that the case is not in a predetermined use state held by the user, and when the display unit detects the inclination of the upside down to face the mounting surface, the user displays the portable information. Since it is considered that the terminal is not used, the power saving of the portable information display terminal can be achieved by shifting to the standby mode. On the other hand, even when it is detected that the display part is held by the user, even when it is detected that the display part is inclined to face the mounting surface, the user is using the portable information display terminal (for example, In this case, the screen can be displayed in an appropriate display direction consistent with the face direction of the user, based on the detection result of the face direction of the user.

In this case, preferably, the control unit notifies the use state of the case and the display unit by the state detection sensor when performing the control to display the screen display based on the detection result of the user's face direction without shifting to the standby mode. It is configured to perform control to hold the function to detect. With this configuration, even in a situation where the case is held by the user, the case and the display unit can be immediately used by using the state detection sensor in which the detection function is maintained even in a situation where the imaging unit cannot detect the direction of the face of the user. Since the use state (posture) of can be detected, the operation of displaying the screen in the proper display direction can be reliably performed.

In the portable information display terminal which switches to the screen display direction corresponding to the direction of the face of the user when the predetermined state of use is detected, preferably, the state detection sensor detects the inclination of the case, at least the case and the display unit. Any one of the first use state to stand up on the mounting surface, the second use state to use the case and the display unit lying on the mounting surface, and the third use state to hold the case as a predetermined use state by hand. It is provided in order to detect whether it is a use state, and a case is comprised so that the 1st inclination in a 1st use state and the 2nd inclination in a 2nd use state may have an external shape which can be installed in a mounting surface so that it may be different from each other. It is. In such a configuration, since the case can be installed on the mounting surface at different inclinations of the first use state and the second use state based on the outer shape of the case, the first use state is based on the detection result by the state detection sensor. And the second use state can be easily identified and specified, and the screen can be displayed in an appropriate display direction corresponding to the first use state and the second use state.

In this case, preferably, the case is configured such that the first inclination and the second inclination are relatively different from each other by 90 degrees or more, and the control unit uses the first use based on the outer shape of the case acquired by the state detection sensor. The first use state and the second use state can be determined and specified on the basis of the inclinations of the cases different from the state and the second use state by 90 degrees or more. With such a configuration, the first use state and the second use state can be reliably discriminated and detected according to the difference in the inclination of 90 degrees or more based on the outer shape of the case.

In the portable information display terminal according to the one aspect, preferably, the control unit is configured to, from the face data of the user imaged by the imaging unit, when the use state of gripping and using the case by hand by the state detection sensor is detected. In the case where the direction of the face of the user cannot be detected, when the inclination value detected by the state detection sensor is determined to be within a predetermined angle range from the inclination value detected last time, the screen display direction of the display unit is not switched. It is configured to maintain. In such a configuration, when the inclination value detected by the state detection sensor is within a predetermined angle range from the inclination value detected last time while the user is holding the case, the inclination value was detected last time. Since the inclination does not change greatly from the inclination at the time, it is considered that the relative positional relationship between the user and the portable information display terminal does not change significantly. In this case, the screen can be displayed in an appropriate display direction that matches the direction of the face of the user by maintaining the screen display direction without changing the display portion.

In the above configuration, preferably, when the control unit cannot detect the face direction of the user from the face data of the user picked up by the imaging unit, the inclination value detected this time by the state detection sensor is detected last time. When it is detected from the inclination value that it is changing beyond the predetermined angle range, the face detection function is configured to detect the face direction of the user again. In such a configuration, in the state where the user is holding the case, the inclination value detected this time by the state detection sensor is changed from the inclination value detected last time by more than a predetermined angle range. Since the inclination is greatly changed from the inclination when this is detected, it is considered that the relative positional relationship between the user and the portable information display terminal is greatly changed or the direction in which the user is holding the case is changed. In this case, by detecting the face direction of the user again by the face detection function, the screen can be displayed in an appropriate display direction consistent with the face direction of the user, based on the detected result of the detected face direction of the user.

In this case, preferably, the control unit is configured to perform control for holding the function of detecting the case and the use state of the display unit by the state detection sensor when detecting the face direction of the user by the face detection function. When the control unit detects that the face direction of the user cannot be detected as a result of performing control for detecting the face direction of the user again by the face detection function, the screen display direction of the display unit is based on the detection result by the state detection sensor. It is configured to perform control to switch. With this configuration, even in a situation where the case is held by the user, even if it is impossible for the imaging unit to redetect the direction of the face of the user, the state of the case and the display unit can be immediately used using the state detection sensor. ) Can be detected without interrupting the operation of displaying the screen in the proper display direction.

In the portable information display terminal according to the one aspect, preferably, a storage unit for storing the inclination angle detected by the state detection sensor is further provided, and the state detection sensor detects the inclination of the case to at least the case and Any one of a first use state in which the display unit is placed on the mounting surface, a second use state in which the case and the display unit are laid on the mounting surface, and a third use state in which the case as a predetermined use state is held by hand. And a tilt angle before the use state stored in the storage unit is changed and a tilt angle after the use state stored in the storage unit is changed, thereby controlling the first use state and The second use state is determined and specified, and the third use state used by holding the case by hand is determined. It is configured to be specific. With such a configuration, the above three usage states of the portable information display terminal can be reliably determined and specified on the basis of the change of the inclination angle before and after the usage state is changed.

In this case, preferably, the control unit determines and specifies the third use state in which the case is gripped by hand when the inclination angle detected by the state detection sensor changes with time within a predetermined range. In addition, when the inclination angle detected by the state detection sensor does not change with time within a predetermined range, the first use state or the second use state is determined and specified. In such a configuration, by acquiring a temporal change in the inclination angle, the use state of the portable information display terminal can be more accurately determined and specified.

In the portable information display terminal according to the one aspect, preferably, the state detection sensor includes an inclination sensor. If comprised in this way, the inclination sensor can detect the inclination of a case easily.

BRIEF DESCRIPTION OF THE DRAWINGS The whole perspective view for demonstrating the structure of the liquid crystal display part side of the portable information display terminal which concerns on one Embodiment of this invention.
2 is an overall perspective view for explaining the configuration of the surface side on the opposite side to the surface on which the liquid crystal display unit of the frame of the portable information display terminal shown in FIG. 1 is provided;
FIG. 3 is a perspective view showing a state in which the portable information display terminal is gripped with the longitudinal direction of the portable information display terminal shown in FIG.
4 is a perspective view showing a state in which the portable information display terminal is gripped with the longitudinal direction of the portable information display terminal illustrated in FIG.
FIG. 5 is a perspective view showing a state in which a frame and a liquid crystal display unit of the portable information display terminal shown in FIG. 1 are placed on a mounting surface; FIG.
FIG. 6 is a perspective view showing a state in which a frame and a liquid crystal display of the portable information display terminal shown in FIG. 1 are laid on a mounting surface; FIG.
7 is a block diagram for explaining an internal configuration of the portable information display terminal shown in FIG.
FIG. 8 is a perspective view showing a state in which the frame and the liquid crystal display of the portable information display terminal shown in FIG. 1 are placed upside down on a mounting surface; FIG.
FIG. 9 is a perspective view showing a state in which the width direction of the liquid crystal display of the portable information display terminal shown in FIG. 1 and the vertical direction of the face of the user substantially coincide.
10 is a view showing a state in which the direction of the face of the user is inclined between about -45 degrees and about +45 degrees with respect to the width direction of the liquid crystal display of the portable information display terminal shown in FIG.
FIG. 11 is a perspective view showing a state in which the longitudinal direction of the liquid crystal display of the portable information display terminal shown in FIG. 1 substantially coincides with the up and down direction of the face of the user.
12 is a view showing a state in which the direction of the face of the user is inclined between about -45 degrees and about +45 degrees with respect to the longitudinal direction of the liquid crystal display of the portable information display terminal shown in FIG.
FIG. 13 is a flowchart for explaining a display direction change and maintenance flow corresponding to a state (state other than the handheld state) of the portable information display terminal shown in FIG. 1; FIG.
14 is a flowchart for explaining a display direction change and maintenance flow corresponding to the state (handheld state) of the portable information display terminal shown in FIG. 1;

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings.

First, with reference to FIGS. 1-12, the structure of the portable information display terminal 1 which concerns on one Embodiment of this invention is demonstrated.

As shown in FIG. 1 and FIG. 2, the portable information display terminal 1 according to the embodiment of the present invention includes a liquid crystal display unit 10 (see FIG. 1) for displaying information, and a liquid crystal display unit 10. It is mainly comprised by the frame 20 provided in the surface. In addition, the liquid crystal display part 10 is an example of the "display part" of this invention, and the frame 20 is an example of the "case" of this invention. The portable information display terminal 1 is configured to be usable in a state held by the user (see FIGS. 3 and 4), and is mounted on the frame 20 and the liquid crystal display unit 10. It is comprised so that it may be used also in the state (refer FIG. 5) standing up, and the state in which the frame 20 and the liquid crystal display part 10 were laid on the mounting surface 100 (refer FIG. 6). In addition, the state gripped by the user is an example of the "predetermined use state" and "third use state" of the present invention, and the state in which the frame 20 and the liquid crystal display unit 10 are placed on the mounting surface 100 is It is an example of the "first use state" of this invention. In addition, the state which laid the frame 20 and the liquid crystal display part 10 on the mounting surface 100 is an example of the "second use state" of this invention.

The portable information display terminal 1 is configured to be able to connect to the Internet. The portable information display terminal 1 is configured to be able to use a reception and playback output function, a mail function, a video chat function, and a voice chat function of streaming distribution by connecting to the Internet. The portable information display terminal 1 is configured to be used as a remote controller such as a media player and a television device (not shown) by shifting to the remote controller mode even when the Internet connection is not made. In addition, the portable information display terminal 1 can display a calendar, a clock, etc. by small application software (gadget) in the state which mounted the frame 20 and the liquid crystal display part 10 (refer FIG. 5). Do.

Next, the structure of the liquid crystal display part 10 and the frame 20 of the portable information display terminal 1 is demonstrated in detail. As shown in FIG. 1, the liquid crystal display unit 10 has a touch panel function, and the user is configured to allow operation according to an application program by pressing an operation button 10a displayed on the liquid crystal display unit 10. have. Moreover, the camera unit 11 is provided in the arrow X1 direction side of the liquid crystal display part 10. The camera unit 11 has a function of capturing the face of the user, for example, when using the portable information display terminal 1 in a state held by the user. In addition, the camera unit 11 is an example of the "imaging part" of this invention.

In addition, the microphone unit 12 is provided in the vicinity of the camera unit 11. The microphone unit 12 has a function of inputting voice, for example, during voice chat and video chat.

In addition, the frame 20 is formed of resin. 1 and 2, a plurality of protrusions 21, 22, and 23 are integrally provided on the surface on the side opposite to the surface on which the liquid crystal display portion 10 of the frame 20 is provided. . The protrusions 21 and 22 are provided so as to extend in the width direction (Y direction) of the frame 20 near both end portions in the longitudinal direction (X direction) of the frame 20. In addition, as shown in FIG. 6, the projection part 21 (refer FIG. 2) and 22 are respectively an edge part from one end side (arrow Y1 direction side) of the width direction (Y direction) of the frame 20, respectively. It is comprised so that thickness may gradually increase toward a side (arrow Y2 direction side). That is, the projections 21 and 22 are each seen from the other side (arrow Y2 direction side) of the frame 20 in the longitudinal direction (arrow X1 direction and arrow X2 direction) of the frame 20, respectively. It is comprised so that it may become wedge-shaped in taper shape toward an edge toward the arrow Y1 direction side).

By configuring the protrusions 21 and 22 as described above, as shown in Fig. 5, the portable information display terminal 1 is placed with the face on the arrow Y2 direction side of the protrusion 21 and the protrusion 22 downward. By placing on the mounting surface 100, the protrusions 21 and 22 can support the frame 20 in a state where the frame 20 and the liquid crystal display unit 10 are upright. In addition, as shown in FIG. 6, the protrusions 21 (see FIG. 2) and 22 are inclined to the frame 20 and the liquid crystal display unit 10 at a predetermined angle θ with respect to the mounting surface 100. It is possible to support the frame 20.

In addition, by configuring the protrusions 21 and 22 as described above, as shown in FIG. 3, the protrusions 21 and 22 allow the frame 20 and the liquid crystal display unit 10 to be operated in the longitudinal direction (the X direction). As viewed from the side, the user can grasp with both hands. In addition, as shown in FIG. 4, the projection part 22 can hold | grip with one hand (left hand), making the longitudinal direction (X direction) of the frame 20 and the liquid crystal display part 10 into a vertical direction.

Moreover, as shown in FIG. 2, the projection part 23 is in the vicinity of the other end (arrow Y2 direction edge part) of the width direction (Y direction) of the frame 20, and is between the projection parts 21 and 22. As shown in FIG. It is installed. Inside the protrusion 23, a secondary battery (lithium ion battery) for supplying power to the portable information display terminal 1 is built in (stored).

In addition, infrared communication units 31 and 32 are incorporated in the end faces of the other end side (arrow Y2 direction side) of the protrusions 21 and 22, respectively. These infrared communication units 31 and 32 are configured to emit infrared rays including a predetermined signal (remote control signal) capable of operating a media player, a television device (not shown), or the like in the remote control mode described later.

Moreover, as shown in FIG. 1, the various switches 33 for information processing apparatus modes are provided in the part of the liquid-crystal display part 10 of the longitudinal direction (X direction) of the arrow X2 direction side. The various switches 33 for the information processing device mode are switches used in the information processing device mode for processing mail, video, voice chat and the like, respectively. In addition, the four-way movement switch 34 (selection switch) is provided in the vicinity of the arrow X2 direction side of the various switches 33 for the information processing apparatus mode. Moreover, the determination switch 35 is provided in the center part of the 4-way movement switch 34. These four-way movement switches 34 and determination switches 35 are configured to be usable in both the remote control mode and the information processing device mode, respectively.

Moreover, the remote control mode transition switch 36 which can switch a remote control mode and an information processing apparatus mode is provided in the arrow Y2 direction side of the 4-way movement switch 34. As shown in FIG. In addition, on the arrow Y1 direction side of the four-way movement switch 34, a function switch for returning the operation screen displayed on the display unit of the remote control operation target device (television, etc.) in the remote control mode to the previous one from the present state. (37) is provided.

In addition, as shown in FIG. 5, a plurality of connecting portions 40 are provided in the side surface portion 24 on the arrow X1 direction side of the frame 20. This connecting portion 40 includes two USB connecting portions 41 and 42, an HDMI connecting portion 43, an audio cable connecting portion 44, and a power supply connector 45.

Next, the internal structure of the portable information display terminal 1 is demonstrated. As shown in FIG. 7, the frame 20 of the portable information display terminal 1 includes a control unit (CPU) 51 and a storage unit (memory) 52 that are in charge of controlling the portable information display terminal 1. ) And the inclination sensor 53 are provided. The storage unit 52 stores an application program executed by the control unit 51. In addition, the inclination sensor 53 is an example of the "state detection sensor" of this invention.

Here, in this embodiment, the inclination sensor 53 has a function of acquiring the inclination of the frame 20 (refer FIG. 1). In addition, the tilt sensor 53 is a state in which the frame 20 and the liquid crystal display 10 are placed on the mounting surface 100 (hereinafter, referred to as an upright state (see FIG. 5)), the frame 20 and the liquid crystal display unit. A state in which 10 is laid on the mounting surface 100 (hereinafter referred to as a laid state (see FIG. 6)) and a state in which the frame 20 is held and used by a user's hand (hereinafter, referred to as handheld state (FIG. 3) and (see FIG. 4). Incidentally, the tilt sensor 53 includes the frame 20 and the liquid crystal display 10 as well as the upright state (see FIG. 5), the lying down state (see FIG. 6), and the handheld state (see FIG. 3 and FIG. 4). It is comprised so that detection of the state (not used state) (refer FIG. 8) which was laid so as to face the mounting surface 100 is possible.

Moreover, the inclination in the upright state (refer FIG. 5), the inclination in the lying down state (refer FIG. 6), and the upright state (not in use state) (refer FIG. 8) by the external shape of the frame 20 mentioned above. Inclination of the frame 20 is different from each other by more than 90 degrees with respect to the mounting surface 100 of the frame 20, so that the control unit 51 is easily based on another inclination with respect to the mounting surface 100 of the frame 20. It is possible to identify and specify each state. In addition, the inclination in the state which uses the frame 20 and the liquid crystal display part 10 on the mounting surface 100 is an example of the "first inclination" of this invention, and the frame 20 and the liquid crystal display part 10 Is an example of the "second inclination" of the present invention.

In addition, in the handheld state (see FIGS. 3 and 4), since the detected value detected by the tilt sensor 53 changes for each detection time due to the subtle movement of the user, the controller 51 is in a state of standing, It is possible to distinguish between lying down and lying down (unused) states. In addition, even when the inclination sensor 53 is in the handheld state (see FIGS. 3 and 4), the use state in the vertical direction in which the longitudinal direction of the frame 20 is used vertically (hereinafter, in the vertical hold state (FIG. 4) and a use state (hereinafter referred to as a grabbing state (see Fig. 3)) in the transverse direction used by laying the longitudinal direction of the frame 20 sideways. 3 and 4, since the liquid crystal display 10 is rotated about 90 degrees, the inclination sensor 53 is different from the vertical and the intercepted states. It is possible to easily determine the inclination and specify it.

Here, in this embodiment, the control part 51 is a detection result of the use state of the frame 20 and the liquid crystal display part 10 by the inclination sensor 53, or the upright state (nonuse state), and the camera unit 11 Is used to determine and specify the use state or upright state (not in use state) of the frame 20 and the liquid crystal display unit 10 based on the detection result of the face direction of the user detected by the face detection function. . And the control part 51 is comprised so that the control which switches the screen display direction of the liquid crystal display part 10 may be performed based on the detection result by the said inclination sensor 53, and the detection result of the user's face direction.

Specifically, when the posture (state) of the portable information display terminal 1 is changed by the user, the control unit 51 is in a state of standing up based on the detection result by the tilt sensor 53 (see FIG. 5), It is possible to determine and specify one of the states of the lying down state (see FIG. 6), the handheld state (see FIGS. 3 and 4), and the upright state (unused state) (see FIG. 8). And the control part 51 discriminates | determines that it is in the upright state (refer FIG. 5) or lying down (refer FIG. 6) based on the detection result by the inclination sensor 53, and, in the specific case, by the inclination sensor 53 Based on a detection result, it is comprised so that the screen display direction of the liquid crystal display part 10 may be switched corresponding to the upright state (refer FIG. 5) or the lying down state (refer FIG. 6). In other words, when the posture (state) of the portable information display terminal 1 is changed by the user, the control unit 51 detects that the tilt sensor 53 is not in the handheld state. The control which switches the screen display direction of the liquid crystal display part 10 is comprised based on the detection result by (1).

In addition, the control part 51 determines that it is a handheld state (refer FIG. 3 and FIG. 4) based on the detection result by the inclination sensor 53, and, in the specific case, the handheld detected by the inclination sensor 53 It is configured to prioritize the detection result of the user's face direction over the state, and to switch to the screen display direction corresponding to the user's face direction. Specifically, as shown in FIG. 9 and FIG. 10, the control unit 51 has a function of detecting the direction of the face of the user captured by the camera unit 11 by the face detection function. When determining that the up-down direction is a direction substantially coincident with the width direction (Y direction) of the liquid crystal display unit 10, the display unit is configured to display the screen display by setting the width direction (Y direction) of the liquid crystal display unit 10 in the up-down direction. have.

In this case, the control unit 51 is between about -45 degrees to about +45 degrees with respect to the reference line (single-dotted line) in which the direction of the face of the user extends along the width direction (Y direction) of the liquid crystal display unit 10 (see FIG. 10). In the case of inclining at a height), the width direction (Y direction) of the liquid crystal display unit 10 is set in the up and down direction so as to display the screen display. 11 and 12, when the controller 51 determines that the up and down direction of the face of the user is substantially the same direction as the longitudinal direction (X direction) of the liquid crystal display unit 10, the liquid crystal display unit ( The length direction (X direction) of 10) is set to an up-down direction, and it is comprised so that a screen display may be displayed. Further, the control unit 51 is between about -45 degrees to about +45 degrees with respect to the reference line (single-dotted line) in which the direction of the face of the user extends along the longitudinal direction (X direction) of the liquid crystal display unit 10 (see FIG. 12). In the case of tilting at, the length direction (X direction) of the liquid crystal display unit 10 is set in the up and down direction so as to display the screen display.

Here, as shown in FIG. 12, the camera unit 11 is disposed outside the liquid crystal display unit 10 along a reference line extending along the longitudinal direction (X direction) of the liquid crystal display unit 10. That is, in the portable information display terminal 1, particularly when the longitudinal direction (X direction) is set in the vertical direction, about -45 degrees to about +45 degrees in the horizontal direction (Y direction) with respect to the camera unit 11. Even if the direction of the face of the user is inclined, the state in which the vertical direction of the screen display corresponds to the longitudinal direction is maintained.

In addition, the control unit 51 is configured to automatically start an application program corresponding to a specific use state or to perform control for shifting to the standby mode. Specifically, the control unit 51 is configured to start an application program that does not presuppose to be operated by the user in the case of being specified as the upright state (see FIG. 5). Moreover, the control part 51 is comprised so that the application program on the assumption that a user may operate may be started, in the case of being specified as the lying state (refer FIG. 6). Further, the control unit 51 is configured to start an application program on the premise that the user operates even in the case of specifying the handheld state (see FIGS. 3 and 4). In addition, the application program corresponding to a specific use state is preset by the user.

In addition, the controller 51 determines whether the inclination value detected by the inclination sensor 53 is constantly changing little by little, so that the portable information display terminal 1 is placed on the mounting surface 100 (FIG. 5). 6 and 8) or the state held by the user (state of FIGS. 3 and 4). When the inclination value detected by the inclination sensor 53 is constantly changing little by little, the control part 51 is comprised so that the portable information display terminal 1 may be judged as a state hold | gripped by the user. Moreover, when the inclination value detected by the inclination sensor 53 is stable, the control part 51 is comprised so that it may be determined that the portable information display terminal 1 is mounted on the mounting surface 100.

In addition, in this embodiment, the control part 51 is in the state which the frame 20 and the liquid crystal display part 10 faced with the mounting surface 100 by the inclination sensor 53 (unused state) (refer FIG. 8). Is specified to control the transition to the above standby mode. In this case, the control unit 51 is configured not to start the application program used by the user, unlike in the use state (upright state, lying down state and handheld state).

In addition, in this embodiment, when the inclination value of the handheld state is detected by the inclination sensor 53, the control unit 51 has the same inclination value as in the upright state (unused state) (see Fig. 8). Even if detected, it is configured not to enter the standby mode. In this case, the control part 51 is comprised so that the liquid crystal display part 10 may display the screen display based on the detection result of a user's face direction. That is, in the state where the user is holding the frame 20, the control unit 51 enters the standby mode in any state, including the case where the inclination of the upright state (unused state) with respect to the frame 20 is detected. It is configured to perform control that does not shift.

Next, with reference to FIGS. 3-8, 13, and 14, the display direction change and maintenance flow corresponding to the state of the portable information display terminal 1 which concerns on this embodiment are demonstrated.

As shown in FIG. 13, the control part 51 recognizes that the inclination value acquired by the inclination sensor 53 changed (event occurrence), and the display corresponding to the use state of the portable information display terminal 1 is shown. The direction change and maintenance flow is disclosed.

First, in step S1, the inclination value acquired from the inclination sensor 53 is recognized (evaluated) by the control part 51 (refer FIG. 7), and the inclination value is memorize | stored in the memory | storage part 52. FIG. In step S2, the state where the portable information display terminal 1 stands (see Fig. 5) and the lying state (see Fig. 6) is based on the state of the stored past inclination value and the change of the inclination value stored this time. It is determined whether one of the up state (unused state) (see FIG. 8) and the handheld state (see FIG. 3 and FIG. 4). That is, when the stored inclination value and the stored inclination value are changing little by little, it is determined as a handheld state. In addition, when the stored inclination value and the presently stored inclination value do not change little by little, and the inclination value stored this time is in the range of the inclination value of the upright state, it is determined as a standing state. Similarly, if the tilt value stored this time is within the range of the tilt value in the lying state, it is determined to be in the laid state, and if the tilt value stored this time is within the range of the tilt value in the up state (unused state), It is determined by the state (unused state).

Then, in step S3, it is determined by the control part 51 whether the determined state was changed from the state before the inclination value acquired by the inclination sensor 53 changed (before the event occurrence). And if it is determined in step S3 that the determined state is not changed from the state before the inclination value acquired by the inclination sensor 53 has changed (before the occurrence of an event), the process proceeds to step S4. In step S4, since the state is not changed, the application program is not changed, and the application program is maintained as it is, and the procedure proceeds to step S5. And in step S5, the display direction displayed on the liquid crystal display part 10 is also not changed, it is maintained as it is, and the display direction change and maintenance flow corresponding to the state of the portable information display terminal 1 are complete | finished.

In addition, in step S3, when it is determined that the determined state is changed from the state before the inclination value acquired by the inclination sensor 53 changed (before the event occurrence), it progresses to step S6. In step S6, the control unit 51 determines whether the changed state is a state in which the frame 20 is held and used by the user's hand (handheld state (see FIGS. 3 and 4)). When it is determined in step S6 that the changed state is a handheld state, the process proceeds to step S21 (see FIG. 14) to be described later. If it is determined in step S6 that the changed state is not a handheld state, the flow proceeds to step S7.

And in step S7, is the state which the state which changed by the control part 51 the state in which the frame 20 and the liquid crystal display part 10 were placed so as to oppose the mounting surface 100 (unused state) (refer FIG. 8)? It is determined whether or not. And if it is determined in step S7 that the changed state is an upright state (nonuse state), the process proceeds to step S8. In step S8, the control unit 51 shifts to the standby mode, and the display direction change and maintenance flow corresponding to the state of the portable information display terminal 1 ends. In addition, in step S7, when it is determined that the changed state is not an upright state (nonuse state), it progresses to step S9. In addition, in the process flow after determination of "no" in said step S6 (when it judges that it is not a handheld state), it is based on the detection result by the inclination sensor 53, without starting the camera unit 11. The control which switches the screen display direction of the liquid crystal display part 10 is performed.

Then, in step S9, the control part 51 determines whether the application program corresponding to the changed state is set. That is, in step S9, it is determined whether or not the application program which automatically starts each of the upright state, the lying down state, and the handheld state is set by the user. And if it is determined in step S9 that the application program corresponding to the changed state is not set, it progresses to step S4 and step S5 mentioned above and changes the display direction corresponding to the state of the portable information display terminal 1. And the maintenance flow ends. If it is determined in step S9 that the application program corresponding to the changed state is set, the process proceeds to step S10.

In step S10, the control unit 51 determines whether the set application program is the same application program as the application program currently being used. If it is determined in step S10 that the set application program is the same application program as the application program currently being used, there is no need to change the application program. Therefore, the process proceeds to step S4 and step S5 described above, and displays the portable information. The display direction change and maintenance flow corresponding to the state of the terminal 1 ends. In addition, in step S10, when it is determined that the set application program is not the same application program as the application program currently being used, it progresses to step S11.

Thereafter, in step S11, the application program set by the user corresponding to the changed state is started, and the flow proceeds to step S12. In step S12, the change or display direction is maintained in the display direction corresponding to the state, and the display direction change and maintenance flow corresponding to the state of the portable information display terminal 1 ends. For example, in the case of changing from the lying state of the lying state or the handheld state to the upright state, the display direction displayed on the liquid crystal display 10 is changed by being rotated 180 degrees. In the case of the handheld state, the display direction displayed on the liquid crystal display 10 is changed by being rotated by 90 degrees or 270 degrees when it is changed from the vertical position to the vertical position. In the case where the state of the handheld is changed from the obstructed state to the laid state, the display direction displayed on the liquid crystal display unit 10 remains unchanged.

Next, with reference to FIG. 14, the process flow about the case where the control part 51 judges that the changed state is a handheld state in step S6 is demonstrated in detail.

As shown in FIG. 14, when it is determined that the changed state is the handheld state in step S6 (see FIG. 13), the state in which the detection function of the use state by the tilt sensor 53 is maintained in step S21. In this case, the camera unit 11 is activated by the control unit 51. The flow then advances to step S22. In addition, in the process flow after step S22, even when the inclination of the state which laid down with respect to the frame 20 (unused state) is detected by the inclination sensor 53, it is the same as that of step S8 (refer FIG. 13) mentioned above. The control for switching the screen display direction of the liquid crystal display unit 10 is performed based on the detection result of the camera unit 11 without shifting to the standby mode.

After that, in step S22, the control unit 51 determines whether the face direction of the user could be detected based on the data picked up by the camera unit 11. When it is determined in step S22 that the user's face direction can be detected, the process proceeds to step S23. And in step S23, the screen display displayed on the liquid crystal display part 10 is changed or maintained by the control part 51 to the display direction corresponding to the direction of a user's face, and the state of the portable information display terminal 1 The corresponding display direction change and maintenance flow ends. For example, in the case of changing from the upright state to the intermittent state of the handheld state, the display direction displayed on the liquid crystal display 10 is rotated 180 degrees. In addition, in the case of changing from the intercepting state in the upright state, the lying down state, or the handheld state to the vertically held state in the handheld state, the display direction displayed on the liquid crystal display unit 10 is rotated by 90 degrees or 270 degrees. In addition, when it is changed from the down state to the interception state among the handheld states, the display direction displayed on the liquid crystal display unit 10 remains unchanged.

If it is determined in step S22 that the face direction of the user cannot be detected, the flow proceeds to step S24. And in step S24, based on the inclination value detected by the inclination sensor 53 by the control part 51, whether the detected inclination value changed more than the predetermined inclination range from the inclination value detected last time. It is determined whether or not. That is, it is determined whether the user has moved the portable information display terminal 1 in a large angle range. And if it is determined in step S24 that the detected inclination value has changed within the predetermined angle range from the inclination value detected last time, the flow proceeds to step S25. And in step S25, the screen display direction currently displayed on the liquid crystal display part 10 is maintained, without changing the screen display direction of the liquid crystal display part 10, and respond | corresponding to the state of the portable information display terminal 1 The display direction change and maintenance flow ends.

In addition, in step S24, when it is determined that the detected inclination value changed from the inclination value detected last time more than a predetermined angle range based on the inclination value detected by the inclination sensor 53, it progresses to step S26. Proceed. And in step S26, by using the face detection function by the control part 51, the face direction of a user is detected again.

In step S27, it is determined again whether or not the direction of the face of the user can be detected. When it is determined in step S27 that the user's face direction can be detected, the process proceeds to step S23 described above. Then, in step S23, the screen display displayed on the liquid crystal display unit 10 is changed or maintained in the display direction corresponding to the direction of the face of the user, and the display direction is changed and maintained corresponding to the state of the portable information display terminal 1. The flow ends.

If it is determined in step S27 that the user's face direction cannot be detected, the flow proceeds to step S28. And in step S28, the screen display direction displayed on the liquid crystal display part 10 is changed based on the inclination value detected by the inclination sensor 53 of the state in which the detection function was maintained, and the portable information display terminal ( The display direction change and maintenance flow corresponding to the state of 1) ends.

In the present embodiment, as described above, the screen display direction of the liquid crystal display unit 10 is switched based on the detection result of the user's face direction detected by the face detection function and the detection result by the tilt sensor 53. Thus, unlike the case where the image display direction of the liquid crystal display unit 10 is switched based only on the detection result of the face direction of the user detected by the face detection function, the face direction of the user captured by the camera unit 11 is changed. Even if it cannot detect, the inclination sensor 53 which detects the inclination of the frame 20 can detect what state (posture) of the frame 20 is. Thereby, even when the direction of the face of the user captured by the camera unit 11 cannot be detected, the screen can be displayed in an appropriate display direction based on the state (posture) detected by the tilt sensor 53. have.

In addition, in the present embodiment, as described above, after the use state of the frame 20 and the liquid crystal display unit 10 is detected by the tilt sensor 53, based on the detection result by the tilt sensor 53, The tilt sensor 53 is performed prior to the start of the camera unit 11 by performing control (determination in step S6 shown in FIG. 13) to determine whether to detect the direction of the face of the user by the camera unit 11. ), The use state of the frame 20 and the liquid crystal display unit 10 can be detected, and it can be determined whether or not the camera unit 11 needs to be activated in accordance with the detection result by the tilt sensor 53. As a result, when it is not necessary to detect the direction of the face of the user by the camera unit 11, the operation processing for unnecessarily starting the camera unit 11 is not performed, so that the screen is displayed in the proper display direction. The operation can be performed quickly.

In addition, in the present embodiment, as described above, when a predetermined use state (handheld state) is detected by the inclination sensor 53, the face of the user is more than the use state detected by the inclination sensor 53. By prioritizing the detection result of the direction and switching to the screen display direction corresponding to the user's face direction, the screen display direction based on the detection result of the user's face direction and the screen display based on the inclination by the inclination sensor 53 In the case of a predetermined use state (hand-held state) where the direction is likely to be different, the detection result of the face direction is given priority, so that it can be displayed as the screen display direction more suited to the actual use mode.

In addition, in the present embodiment, as described above, when the use state (handheld state) of gripping and using the frame 20 by hand is detected, the user is used more than the use state detected by the tilt sensor 53. The tilt sensor 53 is used in the case where the frame 20 is laid down and used in the state where the frame 20 is held by hand by giving priority to the detection result of the face direction and switching to the screen display direction corresponding to the user's face direction. In the detection result based on the inclination of the user, it is difficult to determine how the user views the screen. Therefore, when the frame 20 is held by hand, the face direction of the user is detected and the face direction of the user is detected. By switching to the screen display direction corresponding to, it can be displayed as an appropriate screen display direction suitable for a more practical use mode.

In addition, in this embodiment, as mentioned above, based on the data of the user's face image picked up by the camera unit 11, the user's face direction is the up-down direction of the liquid crystal display part 10 (the Y-direction, Screen display of the liquid crystal display unit 10 when inclined within a predetermined angle range with respect to the reference line along the X direction in FIG. 12 (one dashed line shown on the liquid crystal display unit 10 in FIGS. 10 and 12). By keeping the direction unchanged, it is possible to avoid a situation in which the screen display direction is frequently switched in strict response to a state in which the user's face direction does not completely coincide in the up and down direction of the liquid crystal display unit 10. Thereby, the operability of the portable information display terminal 1 by a user can be improved as much as switching operation of a display screen is not frequently performed.

In addition, in the present embodiment, as described above, the face direction of the user is formed by configuring the predetermined angle range as the angle range in which the user's face direction is equally inclined at about 45 degrees in the left and right directions perpendicular to the reference line. Even if it is inclined in either of the left and right directions with respect to the reference line, it is possible to determine whether or not the screen display direction is switched with almost the same sensitivity. Therefore, the operability of the portable information display terminal 1 can be made uniform regardless of the inclination direction of a face direction.

In addition, in this embodiment, as above-mentioned, the camera unit 11 is arrange | positioned outside the liquid crystal display part 10 along a reference line, and specification of the user's face direction by the camera unit 11 is carried out. Since it can carry out centering on the reference line along the up-down direction of (10), the inclination direction of a user's face direction can be detected with high precision.

In addition, in this embodiment, when it is detected that it is not the use state (handheld state) which grasps and uses the frame 20 by hand by the inclination sensor 53 as mentioned above, the inclination sensor 53 is carried out. The control which switches the screen display direction of the liquid crystal display part 10 is performed based on the detection result by this. In this way, when it is detected that the frame 20 is not held by the hand, it is considered that the frame 20 is fixedly placed on the mounting surface 100 or the like. And when the frame 20 is fixedly mounted on the mounting surface 100, etc., the relationship of the direction of the liquid crystal display part 10 and the user's face direction when a user sees the liquid crystal display part 10 is fixed. In addition, since the user's face cannot be detected more often than when used by holding by hand, in this case, the liquid crystal is used by using the detection result of the tilt sensor 53 without using the face detection function. By performing a control for switching the screen display direction of the display unit 10, the screen can be displayed in an appropriate display direction.

In the present embodiment, as described above, when it is detected by the inclination sensor 53 that the frame 20 is not in a use state in which the frame 20 is held by hand, the tilt is performed without starting the camera unit 11. Based on the detection result by the sensor 53, the control which switches the screen display direction of the liquid crystal display part 10 is performed. As a result, the operation processing for unnecessarily starting the camera unit 11 is not performed, so that the operation of displaying the screen in the proper display direction can be performed quickly. In addition, the power consumption of the portable information display terminal 1 can be reduced as long as the camera unit 11 is not activated.

In the present embodiment, as described above, when the tilt sensor 53 detects at least the handheld state, the detection result of the user's face direction is given priority to display the screen corresponding to the user's face direction. When the screen display direction of the liquid crystal display unit 10 is changed in the direction and it is detected that the upright state or lying down state is inclined by the inclination sensor 53, the liquid crystal is based on the detection result by the inclination sensor 53. By switching the screen display direction of the display unit 10, the tilt sensor 53 displays the screen in the proper display direction when the frame 20 is in an upright state and in a laid state placed on the mounting surface 100. can do. In the case of the handheld state in which the frame 20 is grasped by hand, the screen can be displayed in an appropriate display direction consistent with the face direction of the user, based on the detection result of the face direction of the user.

In addition, in the present embodiment, as described above, the tilt sensor 53 detects that the frame 20 is not in a handheld state held by the user, and the liquid crystal display 10 is placed on the mounting surface 100. In the case where the tilt of the face down state (unused state) is detected, the device shifts to the standby mode without using the face detection function and is detected as a handheld state by the tilt sensor 53 and is also placed upside down. When the inclination of the state (nonuse state) is detected, the liquid crystal display unit 10 displays the screen display based on the detection result of the user's face direction without shifting to the standby mode. Thereby, when it is detected that the tilt sensor 53 is not in the handheld state and the tilt of the upright state (unused state) is detected, the user thinks that the portable information display terminal 1 is not used. In this case, the power saving of the portable information display terminal 1 can be achieved by shifting to the standby mode. On the other hand, even when it is detected by the inclination sensor 53 that the inclined state (nonuse state) is inclined, when it is detected that it is a handheld state, the user is using the portable information display terminal 1 ( For example, it is considered that the user is lying on his back and looking upwards, so that the screen is displayed in an appropriate display direction that matches the user's face direction based on the detection result of the user's face direction. can do.

In addition, in the present embodiment, as described above, when the screen display based on the detection result of the user's face direction is displayed on the liquid crystal display unit 10 without shifting to the standby mode, the frame by the tilt sensor 53 ( By maintaining the function of detecting the use state of the liquid crystal display unit 10 and the liquid crystal display 10, the camera unit 11 is unlikely to detect the user's face in the state where the frame 20 is held by the user. Even under the circumstances, since the use state (posture) of the frame 20 and the liquid crystal display unit 10 can be immediately detected using the inclination sensor 53 in which the detection function is maintained, an operation of displaying the screen in the proper display direction Can be surely performed.

In the present embodiment, as described above, the frame 20 is configured to have an external shape that can be installed on the mounting surface 100 such that the inclination in the upright state and the inclination in the lying down state are different inclinations. By this, since the frame 20 can be installed on the mounting surface 100 at a different inclination in the upright state and in a lying down state, based on the outer shape of the frame 20, based on the detection result by the inclination sensor 53, The up state and the down state can be easily distinguished and specified, and the screen can be displayed in an appropriate display direction corresponding to the up state and the down state.

In addition, in the present embodiment, as described above, based on the inclination of the frame 20 which is 90 degrees or more in the upright state and the lying down state based on the outer shape of the frame 20 acquired by the inclination sensor 53. By determining the upright state and the lying down state so as to be able to specify, the upright state and the lying down state can be reliably discriminated and detected according to the difference in the inclination of 90 degrees or more based on the outer shape of the frame 20.

In the present embodiment, as described above, when the user cannot detect the face direction of the user from the face data of the user captured by the camera unit 11 in the state of holding the frame 20. In the case where it is determined that the inclination value detected by the inclination sensor 53 is within the predetermined angle range from the inclination value detected last time, the display direction of the liquid crystal display unit 10 is maintained without switching. Thereby, when the inclination value detected this time by the inclination sensor 53 in the state in which the user is holding the frame 20 falls within the predetermined angle range from the inclination value detected last time, the inclination value last time Since the inclination does not change greatly from the inclination when this is detected, it is considered that the relative positional relationship between the user and the portable information display terminal 1 does not change significantly. In this case, the screen can be displayed in an appropriate display direction that matches the direction of the face of the user by maintaining the screen display direction of the liquid crystal display unit 10 without switching.

In the present embodiment, as described above, when the user cannot detect the face direction of the user from the face data of the user captured by the camera unit 11 in the state of holding the frame 20. In the case where it is detected that the inclination value detected by the inclination sensor 53 is changing beyond the predetermined angle range from the inclination value detected last time, the user's face detection function of the camera unit 11 And to detect the face direction again. Thereby, when the inclination value detected this time by the inclination sensor 53 changes by more than a predetermined angle range from the inclination value detected last time, while the user is holding the frame 20, the last time. Since the inclination is greatly changed from the inclination when the inclination value is detected, it is considered that the relative positional relationship between the user and the portable information display terminal 1 is greatly changing or the user is changing the direction in which the frame 20 is held. do. In this case, by detecting the face direction of the user again by the face detection function, the screen can be displayed in an appropriate display direction consistent with the face direction of the user, based on the detected result of the detected face direction of the user.

In the present embodiment, as described above, when the face direction of the user is detected again by the face detection function, when the face direction of the user cannot be detected, based on the detection result by the tilt sensor 53. By configuring the screen display direction of the liquid crystal display unit 10 to be switched, in a situation where the frame 20 is held by the user, the camera unit 11 may not be able to redetect the direction of the user's face. In addition, since the use state (posture) of the frame 20 and the liquid crystal display part 10 can be detected immediately using the inclination sensor 53, the operation which displays a screen in a suitable display direction can be performed without interrupting.

In addition, in the present embodiment, as described above, the inclination angle before the use state stored in the storage unit (memory) 52 is changed and the inclination angle after the use state stored in the storage unit 52 is changed. By determining and specifying the standing state and the lying down state, and determining and specifying the use state of gripping and using the frame 20 by hand, based on the change of the tilt angle before and after the use state is changed, The portable information display terminal 1 can reliably discriminate and specify the above three use states.

In addition, in the present embodiment, as described above, when the inclination angle detected by the inclination sensor 53 changes with time within a predetermined range, the use state in which the frame 20 is gripped by hand and used. When the tilt angle detected by the tilt sensor 53 does not change with time within a predetermined range, the upright or lying down state is determined and specified, thereby determining the temporal angle of the tilt angle. By acquiring the change, the use state of the portable information display terminal 1 can be more accurately determined and specified.

In addition, it should be thought that embodiment disclosed this time is an illustration and restrictive at no points. The scope of the present invention is shown not by the description of the above embodiments but by the claims, and includes all changes within the meaning and range equivalent to the claims.

For example, although the said embodiment showed the example which detected the direction of a user's face using the face detection function only in the case of the handheld state which grasps and uses a frame with a user's hand, this invention is limited to this. It doesn't work. Even in a state other than the handheld state in which the frame is held by the user's hand, the face direction of the user may be detected using the face detection function.

In addition, although the said embodiment showed about the example using the inclination sensor 53 as an example of the state detection sensor of this invention, this invention is not limited to this. For example, in order to detect the state of the portable information display terminal 1, you may use sensors other than inclination sensors, such as an acceleration sensor.

In addition, in the said embodiment, the inclination sensor 53 stands up and uses the frame 20 and the liquid crystal display part 10 on a mounting surface, and the frame 20 and the liquid crystal display part 10 are mounted on the mounting surface 100. FIG. Lie down state to use lying down, hand-held state to use by holding the frame 20 by hand and upside down state in which the frame 20 and the liquid crystal display 10 are placed upside down to face the mounting surface (100) Although the example which detects only any one was shown, this invention is not limited to this. For example, in the upright, lying down, handheld, and upside down states, in addition to standing up, lying down, handheld, and upright (unused), such as holding a portable information display terminal on a wall You may make it detect other states (nonuse state).

In addition, in the said embodiment, the inclination sensor 53 puts the frame 20 and the liquid crystal display part 10 on the mounting surface 100, and uses the upright state, and when the frame 20 and the liquid crystal display part 10 are mounted ( Although the example which comprised the frame 20 by the external shape which can be mounted in the lying state used lying down on 100) was shown, this invention is not limited to this. By attaching a stand or the like of a separate member to the frame (case), the tilt sensor 53 stands up and uses the frame 20 and the liquid crystal display 10 on the mounting surface 100, and the frame 20 and the liquid crystal. The display unit 10 may be placed in a flat state to be used by lying on the mounting surface 100.

Moreover, although the said embodiment showed the example which performs remote control control of a control object apparatus by emitting infrared rays containing a remote control signal to a control object apparatus in the remote control mode, this invention is not limited to this. For example, remote control of the control target device may be performed by using wireless communication standards such as Bluetooth (registered trademark) and Zigbee (registered trademark).

In addition, in the said embodiment, for the convenience of description, although the process operation of the control part was described in the event drive at the time of starting, the process operation of the start transition was demonstrated using the flowchart which described the flow drive, but this invention It is not limited to this. The processing operation of the control unit may be performed in a complete event drive type, may be performed in a complete flow drive type, or may be performed in parallel processing.

Claims (20)

A display unit 10 for displaying information,
A case 20 in which the display unit is installed on a surface thereof;
A state detection sensor 53 for detecting at least a use state of the case and the display unit by detecting an inclination of the case;
An imaging unit 11 capable of imaging the face of the user;
The display unit detects the face direction by a face detection function based on the data of the face of the user picked up by the imaging unit, and based on the detection result of the face direction and the detection result by the state detection sensor, the display unit. Control unit 51 for controlling to switch the screen display direction of the
The portable information display terminal 1 provided with. The method of claim 1,
The control unit detects the face direction of the user by the imaging unit based on a detection result by the state detection sensor after detecting the use state of the case and the display unit by the state detection sensor. A portable information display terminal configured to perform control for determining whether or not. The method of claim 1,
When the predetermined use state is detected by the state detection sensor, the control unit gives priority to the detection result of the face direction of the user over the use state detected by the state detection sensor, and corresponds to the face direction of the user. And a portable information display terminal configured to control to switch to a screen display direction. The method of claim 3,
The predetermined use state is a use state in which the case is held and used by hand,
When the use state of gripping and using the case by hand is detected, the control unit gives priority to the detection result of the face direction of the user over the use state detected by the state detection sensor, and thus, to the face direction of the user. A portable information display terminal configured to perform control for switching to a corresponding screen display direction. 5. The method of claim 4,
When the controller determines that the direction of the face of the user is inclined within a predetermined angle range with respect to the reference line along the vertical direction of the display unit based on the data of the face of the user captured by the imaging unit, A portable information display terminal configured to perform control to hold the display unit without changing the screen display direction. The method of claim 5,
And the predetermined angle range is an angle range in which the direction of the face of the user is inclined approximately equally to the left and right directions perpendicular to the reference line. The method according to claim 6,
And the imaging unit is disposed outside the display unit along the reference line. 5. The method of claim 4,
The control unit switches the screen display direction of the display unit on the basis of the detection result by the state detection sensor when it is detected by the state detection sensor that the case is not in a use state in which the case is held by hand. A portable information display terminal configured to perform control. 9. The method of claim 8,
When it is detected by the state detection sensor that the case is not in a use state in which the case is held by hand, the control unit does not start the imaging unit, and based on a detection result by the state detection sensor, the display unit does not start. A portable information display terminal configured to perform control for switching the screen display direction. The method of claim 3,
The state detection sensor includes: a first use state in which the case and the display unit stand on the mounting surface by detecting the inclination of the case; a second use state in which the case and the display unit are laid on the mounting surface; It is provided in order to detect which use state among the 3rd use states which hold | grip and use the said case as said predetermined use state by hand,
When the state detection sensor detects that the third use state is at least, the control unit gives priority to the detection result of the face direction of the user and switches to the screen display direction corresponding to the face direction of the user. And when it is detected by the state detection sensor that the first use state or the second use state is detected, control is performed to switch the screen display direction of the display unit based on a detection result by the state detection sensor. The portable information display terminal which is comprised. The method of claim 3,
In addition to the predetermined use state, the state detection sensor is configured to detect a state in which at least the display unit is placed so as to face the mounting surface,
The control unit detects that the face is not in the predetermined use state held by the user by the state detection sensor, and when the inclination of the state in which the display unit faces up to the mounting surface is detected, the face is detected. In the standby mode without using the detection function, the state detection sensor detects that the case is held in the predetermined use state by the user, and the display unit is in an upright state to face the mounting surface. And carry out control for displaying on the display unit a screen display based on a detection result of the direction of the face of the user without shifting to the standby mode when a tilt is detected. 12. The method of claim 11,
The control unit controls the use state of the case and the display unit by the state detection sensor when performing the control to display the screen display based on the detection result of the face direction of the user without shifting to the standby mode. A portable information display terminal configured to perform control for holding a function of detecting. The method of claim 3,
The state detection sensor includes a first use state in which at least the case and the display unit are placed on the mounting surface by detecting the inclination of the case, and a second use state in which the case and the display unit are laid on the mounting surface. It is provided in order to detect which use state of the 3rd use state which hold | grips and uses the said case as said predetermined use state by hand,
The case is configured such that the first inclination in the first use state and the second inclination in the second use state have an external shape that can be installed on the mounting surface such that the inclination is different from each other. The method of claim 13,
The case is configured such that the first inclination and the second inclination are different from each other by more than 90 degrees.
The said control part is based on the inclination of the said case different from the said 1st use state based on the outer shape of the said case acquired by the said state detection sensor, and the said 90th degree or more of the said 2nd use state, and the said 1st use. A portable information display terminal configured to determine a state and the second use state so as to be specified. The method of claim 1,
When the control unit cannot detect the face direction of the user from the face data of the user picked up by the imaging unit when the use state of gripping and using the case by hand by the state detection sensor is detected, And when it is determined by the state detection sensor that the inclination value detected this time is within a predetermined angle range from the inclination value detected last time, control is performed to maintain the screen display direction without changing the display unit. Mobile information display terminal. 16. The method of claim 15,
When the control unit cannot detect the direction of the face of the user from the face data of the user captured by the imaging unit, the inclination value detected by the state detection sensor is predetermined from the inclination value detected last time. The portable information display terminal is configured to perform control for detecting the direction of the face of the user again by the face detection function when it is detected that the change is over the angle range. 17. The method of claim 16,
The control unit is configured to perform a control to hold a function of detecting the case and the use state of the display unit by the state detection sensor when detecting the face direction of the user by the face detection function.
On the basis of the detection result by the state detection sensor, when the control unit determines that the face direction of the user cannot be detected as a result of performing control of detecting the face direction of the user again by the face detection function, And a portable information display terminal configured to control to switch the screen display direction of the display unit. The method of claim 1,
Further comprising a storage unit 52 for storing the inclination angle detected by the state detection sensor,
The state detection sensor includes a first use state in which at least the case and the display unit are placed on the mounting surface by detecting the inclination of the case, and a second use state in which the case and the display unit are laid on the mounting surface. It is provided in order to detect which use state of the 3rd use state which hold | grips and uses the said case as said predetermined use state by hand,
The controller determines the first use state and the second use state by comparing an inclination angle before the use state stored in the storage unit with the inclination angle after the use state stored in the storage unit is changed. And specifying the third use state in which the case is gripped by hand and used for identification. 19. The method of claim 18,
The control unit determines and specifies the third use state of gripping and using the case by hand when the inclination angle detected by the state detection sensor changes with time within a predetermined range. And a portable information display configured to discriminate and specify the first use state or the second use state when the inclination angle detected by the state detection sensor does not change with time within the predetermined range. terminal. The method of claim 1,
The state detection sensor includes a tilt sensor.

Images