JP2009130816A - Portable terminal device, screen display switching method, program, and computer readable recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable terminal device and the like, appropriately grasping a direction of the portable terminal device to a user during utilization, switching screen display without performing notification operation, and arbitrarily switching the screen display while viewing video contents being displayed in real time. <P>SOLUTION: A portable terminal device includes: an imaging means which images a user to capture image information; a face recognizing means for recognizing a face structure of the user from the image information captured by the imaging means to acquire face information; a case direction detecting means for detecting a direction of a case of the portable terminal device to the user during utilization, based on the face information of the user acquired by the face recognizing means; and a switching control means for switching display of video contents onto a display means, based on the direction of the case detected by the case direction detecting means. While an application is activated, various operations by the imaging means, the face recognizing means, the case direction detecting means and the switching control means, are performed to switch the display of the video contents. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a mobile terminal device, a screen display switching method, a program, and a computer-readable recording medium, and in particular, a mobile terminal device having a function of reproducing video content such as digital terrestrial broadcasting or video data downloaded from the Internet in real time. The present invention relates to a technique preferably applied to the above.

  The current mainstream mobile phone is designed on the assumption that a user uses it vertically, and a display device such as an LCD (Liquid Crystal Display) is arranged vertically. On the other hand, television broadcast images are horizontally long images. For this reason, when watching a TV on a mobile phone, it is necessary to display a horizontally long broadcast video in a reduced size so that it fits in a vertically long display device, and the broadcast video cannot be displayed on the entire display device. It was. Further, by reducing the video content in order to display the horizontally long video content, the vertically long display device cannot be used effectively.

  As a means for solving this problem, it is known that the broadcast video is rotated and displayed so that the long sides of the display device and the broadcast video are in the same direction. The telephone user had to make some notification to the mobile phone. For example, when the mobile phone user presses a button on the mobile phone to notify the start of viewing on the landscape screen, the mobile phone rotates and displays the broadcast video, and the mobile phone user turns the mobile phone in the same direction as the broadcast video. I watched it while holding it. As another method, for example, a rotation mechanism and a rotation detection function are provided on the display device mounting hinge, and the mobile phone user rotates the display device to notify the start of viewing on the landscape screen, and the mobile phone broadcasts the video. I watched by rotating and displaying.

  However, the above-described methods are the same in that the mobile phone user needs to notify the start of viewing on the landscape screen, and the notification operation for starting viewing on the landscape screen is troublesome. In addition, when functions are assigned to most operation buttons for television viewing or the like, there is a problem that buttons for executing the notification operation are not available.

  On the other hand, for example, Patent Document 1 discloses a portable terminal capable of automatically switching the image display to a vertical display or a horizontal display according to the rotation angle of the casing. In the mobile terminal, the rotation angle of the terminal housing is acquired by the rotation sensor, and the display size is set in the display processing unit according to the rotation angle, and the display direction for displaying the image in the forward direction is set. The display direction and the display size that are optimal for the rotation angle of the display unit that rotates integrally with the housing are automatically switched.

For example, Patent Document 2 discloses a mobile terminal device capable of displaying information on the display screen in a desired orientation according to the positional relationship between the display screen of the display unit of the mobile terminal device and the user. In the mobile terminal device, information on the user's face is acquired based on an image captured by the camera unit provided in the main body, and the relative position relationship between the orientation of the user's face and the main body is determined by the main control unit. The display direction of information on the display screen is determined in accordance with the positional relationship, and control is performed so that the screen is displayed in the display direction by the display control unit.
JP 2006-53427 A JP 2007-17596 A

  However, in the invention disclosed in Patent Document 1, for example, even when the user is viewing the mobile terminal while moving, the angle information of the terminal housing may be acquired by the rotation sensor, and the user's mobile terminal There is a possibility that the screen display may be switched even though the direction of operating is not changed. That is, it seems difficult to switch the screen display according to an appropriate relative positional relationship between the user and the mobile terminal.

  On the other hand, in the invention disclosed in Patent Document 2, although it is possible to appropriately grasp the relative positional relationship between the user and the mobile terminal, switching of the screen display according to the positional relationship is performed only at the start of the application. Executed. For this reason, for example, while viewing video content displayed on the screen in real time, such as a digital terrestrial television broadcast, the user cannot change the screen display at any time.

  Therefore, the present invention appropriately grasps the orientation of the mobile terminal device with respect to the user in use, can switch the screen display without performing a notification operation, and can arbitrarily display the screen while viewing the video content displayed in real time. It is an object of the present invention to provide a mobile terminal device capable of switching display, a screen display switching method in the mobile terminal device, and the like.

  In order to achieve such an object, a first portable terminal device of the present invention is a portable terminal device that stores an application including a program for reproducing video content in real time and displays data processed by the application on a display means. An image capturing unit that captures an image of the user and acquires image information, a face recognition unit that recognizes the face structure of the user from the image information acquired by the image capturing unit, and acquires face information; Based on the user's face information, the body direction detecting means for detecting the orientation of the housing of the mobile terminal device with respect to the user in use, and the video content on the display means based on the orientation of the housing detected by the body direction detecting means Switching control means for switching the display of the image, the imaging means, the face recognition means, It performs various operations by the detection means, and switching control means, for displaying the switching of the video contents.

  The first screen display switching method of the present invention is a screen display switching method in a portable terminal device that stores an application including a program for reproducing video content in real time and displays data processed by the application on a display means. Acquired by the imaging step of imaging the user and acquiring the image information, the face recognition step of acquiring the face information by recognizing the face structure of the user from the image information acquired by the imaging step, and the face recognition step Based on the user's face information, the body direction detecting step for detecting the body direction of the mobile terminal device with respect to the user in use, and the video content to the display means based on the body direction detected by the body direction detecting step A switching control step for switching the display of Te, imaging step, face recognition step performs various operations by the housing orientation detection step, and the switching control step, perform display switching of the video content.

  Further, a first program of the present invention is a program in a portable terminal device that stores an application including a program for reproducing video content in real time and displays data processed by the application on a display means. An imaging function for capturing a user and acquiring image information, a face recognition function for recognizing the user's facial structure from the image information acquired by the imaging function, and acquiring the face information, and a user's face acquired by the face recognition function Based on the information, the body direction detection function for detecting the orientation of the body of the mobile terminal device with respect to the user in use, and the display of the video content on the display means based on the orientation of the body detected by the body direction detection function Switching control function for switching, and the imaging function and facial recognition while the application is running Function performs various operations by the housing orientation detection function, and switching control functions to execute the display switching of the video contents to the computer.

  The first recording medium of the present invention is a computer-readable recording medium on which the above program is recorded.

  ADVANTAGE OF THE INVENTION According to this invention, the direction of the portable terminal device with respect to the user in use can be appropriately grasped, the screen display can be switched without performing a notification operation, and an arbitrary screen can be displayed while viewing video content displayed in real time. A portable terminal device capable of switching display, a screen display switching method in the portable terminal device, and the like are provided.

  In the present invention, as shown in FIG. 1, the mobile terminal device 1 includes a main control unit 2, a storage unit 3, a display unit 4, an imaging unit 5, a face recognition unit 6, a housing direction detection unit 7, and a switching control unit 8. Prepare. The main control means 2 controls the overall operation of the mobile terminal device 1, the storage means 3 stores an application including a program for reproducing video content in real time, and the display means 4 displays data processed by the application on the screen. The imaging unit 5 captures the user in use as a subject and acquires image information, and the face recognition unit 6 recognizes the face structure of the user from the image information and acquires face information. The chassis direction detection means 7 detects the orientation of the terminal chassis relative to the user being used based on the user's face information, and the switching control means 8 switches the screen display of the video content to the display means 4 based on the orientation of the terminal chassis. Do. The operations of the imaging unit 5, the face recognition unit 6, the frame direction detection unit 7, and the switching control unit 8 are performed even during application activation, and display switching of video content is performed based on the orientation of the terminal cabinet with respect to the user. .

  In this way, in the present invention, for example, when viewing a TV broadcast on a mobile phone, the use of the camera's face recognition function determines whether the viewing style is viewing on a portrait screen or viewing on a landscape screen, The display contents are automatically switched for the display device. That is, in the mobile phone to which the present invention is applied, the camera is activated during TV viewing, the mobile phone user is photographed to perform face recognition, and whether or not the user's photographed image and the upward direction of the display device match. Detect. For example, when it is detected that the captured image of the mobile phone user and the upward direction of the display device do not match and are in landscape orientation, the broadcast video is rotated and displayed so that it can be correctly viewed in landscape orientation.

  In the present invention, when the user rotates the mobile terminal device so as to have a landscape screen by the above-described method, the viewing direction that has been required so far is automatically displayed by rotating the display direction of the broadcast video. Viewing on a landscape screen can be performed without a notification operation for starting. Further, by using the face recognition function (imaging means, face recognition means) of the camera instead of the rotation sensor, it is possible to appropriately grasp the orientation of the mobile terminal device with respect to the user in use. And while the application is running, users can shoot, face recognition, body orientation detection, and screen display switching at any time, so they can watch the video content displayed in real time in any desired style. It becomes possible to do.

  Hereinafter, a mobile phone will be described as an embodiment of the present invention with reference to FIGS.

  First, the configuration of the mobile phone according to the present embodiment will be described. FIG. 2 is a functional block diagram showing a schematic configuration of the mobile phone according to the present embodiment. The cellular phone 100 includes a telephone radio unit 12, a telephone voice processing unit 13, a voice input / output unit 14, a TV radio unit 16, a TV video / audio processing unit 17, a control unit 18, a camera 23, a display unit 24, a memory 25, and an operation. It has a section 26 and is configured by connecting each section around the control section 18. The control unit 18 includes a camera control unit 19, a display direction determination unit 20, a display control unit 21, and an operation control unit 22. The memory 25 corresponds to the storage unit 3 in FIG. 1, and the display unit 24 corresponds to the display unit 4 in FIG. The camera 23 and the camera control unit 19 correspond to the imaging unit 5 in FIG. 1, the display direction determination unit 20 corresponds to the face recognition unit 6 and the body direction detection unit 7 in FIG. 1, and the display control unit 21 in FIG. Corresponds to the switching control means 8.

  The telephone wireless unit 12 is connected to a transmission / reception antenna 11 for transmitting and receiving telephone radio waves. The received wave received by the transmission / reception antenna 11 is demodulated by the telephone radio unit 12, subjected to processing such as encoding / decoding by the telephone voice processing unit 13, and the received received sound is output from the voice input / output unit 14. Communicated to the user. In addition, since the structure and operation | movement regarding the telephone call of these portable telephones are known, detailed description is abbreviate | omitted.

  The TV radio unit 16 is connected to a receiving antenna 15 that receives radio waves for television broadcasting. The received wave received by the receiving antenna 15 is demodulated by the TV radio unit 16 and decoded by the TV video / audio processing unit 17. The broadcast audio obtained by these processes is the audio input / output unit 14. Therefore, the broadcast video is output from the display unit 24, respectively. Note that the configuration and operation related to the reception of the television broadcast and the output of the broadcast video and the broadcast audio are well known and will not be described.

  The control unit 18 is a core that controls the functions of the mobile phone 100 and controls the entire operation. In addition, the camera control unit 19, the display direction determination unit 20, the display control unit 21, and the operation control unit 22 perform screen display according to the present invention. Perform the switching process. The camera control unit 19 receives an image from the camera 23 and takes a picture. The display direction determination unit 20 performs face recognition from the image captured by the camera control unit 19 and determines the display direction of the television broadcast video. The display control unit 21 rotates the television broadcast video according to the determination of the display direction determination unit 20 and causes the display unit 24 to display it. The operation control unit 22 uses the operation unit 26 to operate the mobile phone function as instructed by the mobile phone user. The memory 25 is a memory for storing a memory dial, a television channel setting, and the like.

  Next, the screen display switching of the television broadcast video in this embodiment will be described. FIG. 3 is a diagram illustrating a state of displaying a television broadcast video in each state. FIG. 3A shows a state of viewing on a horizontally long screen. By viewing the display device (the display unit 24 in FIG. 2, the same applies hereinafter) in a landscape orientation, broadcast images can be displayed on the display device. It shows how it is. That is, only the broadcast video is displayed on the display device for viewing on the landscape screen.

  FIG. 3B shows a state of viewing on a vertically long screen, in which a horizontally long broadcast image is displayed using a part of the display area of the display device. In the example of FIG. 3B, the display screen is divided into four areas: a video area, a caption area, a BML (Broadcast Markup Language) browser area, and other areas, and a broadcast video and related information are displayed. That is, when viewing on a vertically long screen, related information is displayed in addition to the broadcast video, making it easy to perform basic operations when using the TV function.

  As described above, in this embodiment, it is detected that the mobile phone user has moved the mobile phone from the state of the vertically long screen of FIG. 3B to the state of the horizontally long screen of FIG. Switching methods. Hereinafter, the display switching operation will be described in detail with reference to FIGS.

  FIG. 4 is a diagram illustrating a state in which a user is watching a television broadcast in a state where the mobile phone has a portrait screen. FIG. 4B shows the positional relationship between the mobile phone and the mobile phone user during viewing on a vertically long screen. When viewing on a vertically long screen, the upward direction for the mobile phone (display unit 24) coincides with the upward direction for the user. Therefore, when the user is photographed from the camera 23 provided in the mobile phone in the state of FIG. 4B, the user's face is correctly displayed on the display unit 24 in the upward direction. FIG. 4A shows the state of the user's image taken as described above and taken by the camera.

  The mobile phone grasps the user's face structure by performing image recognition processing such as face recognition on the image taken as shown in FIG. 4A, and indicates the user's upward direction (direction pointing above the head). When it is detected and the short side corresponds to the user's upward direction on the display screen, it is determined that the television viewing is being performed on the vertically long screen. Then, as a screen display for a vertically long screen, a broadcast video is displayed in the video area, and related information such as a subtitle and a URL (Uniform Resource Locator) is displayed in the subtitle area and the BML browser area. Note that it is also possible to display only the broadcast video without displaying the related information.

  FIG. 5 is a diagram illustrating a state in which a user is watching a television broadcast in a state where the mobile phone has a horizontally long screen. FIG. 5B shows the positional relationship between the mobile phone and the mobile phone user during viewing on the landscape screen. When viewing on a horizontally long screen, the upward direction for the mobile phone (display unit 24) (the upward direction when used in a vertically long shape) does not match the upward direction for the user. Therefore, when the user is photographed from the camera 23 provided in the mobile phone in the state of FIG. 5B, the user's face is seen when viewed in a normal state in which the mobile phone is operated (the display unit 24 is in a vertically long state). Is displayed in a state rotated about 90 degrees. FIG. 5A shows the state of the user's image taken as described above and taken by the camera.

  The mobile phone grasps the user's face structure by performing image recognition processing such as face recognition on the image taken as shown in FIG. 5A, and indicates the user's upward direction (direction pointing above the head). It is detected, and it is determined that the television viewing is being performed on the landscape screen when the long side matches the user's upward direction on the display screen. That is, it is detected that the user's face is sideways, and it is determined that the television viewing is performed on the landscape screen. Then, a broadcast video is displayed in a video area that occupies the entire display screen as a screen display for a horizontally long screen.

  Next, the function assignment change of the operation buttons in the present embodiment will be described. In the present embodiment, in addition to the screen display switching of the display contents for the display device, the function assigned to the operation button is switched. That is, the function assigned to the physically arranged buttons is automatically switched between viewing on a vertically long screen and viewing on a horizontally long screen.

  FIG. 6 is a diagram showing the state of operation buttons physically arranged on the mobile phone, and FIG. 7 is a diagram showing a table of functions assigned to the operation buttons physically arranged. In the table of FIG. 7, different functions are assigned to the same operation buttons depending on whether the television is viewed on a vertically long screen or the television is viewed on a horizontally long screen.

  For example, the function 1 of the button A when viewing the portrait screen is assigned to the button C when viewing the landscape screen, and the function 4 of the button D when viewing the portrait screen is assigned to the button A when viewing the landscape screen. In addition, the function 6 of the button F in the portrait screen is the button H in the landscape screen, the function 7 of the button G in the portrait screen is the button K in the landscape screen, and the function 8 of the button H in the portrait screen is the landscape screen. Assigned to each hour button N. In this way, by assigning functions so that the arrangement of functions corresponding to the arrangement of the operation buttons before switching is maintained as much as possible after switching, the operation is similar to the normal operation (vertical screen). Operations can be performed when viewing a landscape screen.

  In the assignment table, the function sequence for the portrait screen is rotated horizontally and assigned to each button as a function assignment for viewing the landscape screen. As shown in FIG. 7, physical buttons and portrait screen viewing are set. The function assignment at the time and the function assignment at the time of viewing the landscape screen are generated in association with each other. In the example of the present embodiment, only two function assignments for a portrait screen and a landscape screen are shown. However, a portrait screen rotated clockwise by 0 degrees, a landscape screen rotated by 90 degrees, and a portrait screen rotated by 180 degrees At this time, the table may be generated by arbitrarily setting the function assignment in the case of a horizontally long screen rotated by 270 degrees.

  In the present embodiment, the mobile phone assigns the function to the operation button using the function assignment table based on the determination result of whether the user is watching the television on the portrait screen or watching the television on the landscape screen. Make changes. The function allocation is changed at the same timing as the screen display switching of the display contents for the display device. As a result, even when the mobile phone is rotated and the television is viewed, the key operation can be performed in the same manner as before the screen display is switched, leading to an improvement in operability.

  Subsequently, operations of screen display switching and function assignment change in the present embodiment will be described. FIG. 8 is a flowchart showing the flow of the screen display and function assignment switching operation in the present embodiment.

  First, when the application is activated and TV viewing is started (start), the camera is activated (S11), and the mobile phone user is photographed (S12). Thereafter, the orientation of the display screen is determined by image recognition processing such as face recognition using the photographed user image information (S13).

  When it is determined that the orientation of the display screen is vertically long, that is, it is determined that the TV viewing is performed on the vertically long screen (step S13 / YES), broadcast video for viewing the vertically long screen is displayed on the screen (S14). Further, function allocation for viewing a vertically long screen is performed on the operation buttons using an allocation table as shown in FIG. 7 (S15). On the other hand, when the determination result is in the landscape display direction, that is, when it is determined that the television viewing is performed on the landscape screen (NO in step S13), the broadcast video screen display for viewing the landscape screen is displayed. (S16). Further, function assignment for viewing the landscape screen is performed on the operation buttons using the assignment table as shown in FIG. 7 (S17).

  Finally, loop determination is performed to repeat the above operation while watching TV (S18). That is, when the television viewing is not finished (step S18 / NO), the user's shooting and display orientation are determined, and screen display and function assignment switching based on the determination result are repeated (steps S12 to S17). On the other hand, when it is determined that the television viewing is finished (step S18 / YES), the activated camera is terminated (S19), and the television viewing is terminated (END).

  In this embodiment, since the display direction of the video content and the function assigned to the operation button can be automatically switched while the application is activated, for example, a mobile phone can be used as follows. The application launch operation is performed by holding the mobile phone in portrait orientation, and when viewing video content thereafter, the user selects whether to view on the portrait screen or landscape view, and arbitrarily changes the orientation of the phone. Can watch. The display state of the portrait screen and landscape screen can be switched over and over again, and the function assignments of the operation buttons are changed according to the display state, so that the operability is improved and it is suitable for actual use. Become.

  Furthermore, in the present embodiment, it is possible to display different display contents on the display screen for viewing on a vertically long screen and viewing on a horizontally long screen. This has the following advantages especially when viewing digital TV broadcasting such as One Seg on a mobile phone. When viewing on a vertically long screen where basic operations are performed, broadcast video, program information, subtitles, and a BML browser are displayed to facilitate searching for a program to be viewed. Also, when you are looking for a program you want to watch and want to watch it in earnest, you can rotate the mobile phone in the direction that becomes a landscape screen, so that only the most important broadcast video in broadcast viewing is left on the display device. It can be projected.

  According to the present embodiment, when switching from a portrait screen to a landscape screen during television viewing, it is possible to omit an operation for switching notification to the mobile phone. The reason is that the mobile phone determines whether it is viewing on a vertically long screen or on a horizontally long screen while watching TV, and switches the display content on the display screen.

  Further, according to the present embodiment, even when the mobile phone is rotated during the television viewing so as to shift from the vertically long screen to the horizontally long screen, intuitive button operations can always be performed. The reason for this is to determine whether the mobile phone is viewing on the vertical screen or viewing on the horizontal screen while watching TV, and change the function assignment of the physically arranged buttons according to the state. It is.

  The above-described embodiment is a preferred embodiment of the present invention, and the scope of the present invention is not limited to the above-described embodiment alone, and various modifications are made without departing from the gist of the present invention. Implementation is possible. For example, in the above embodiment, the screen display switching when viewing a TV broadcast on a mobile phone has been described. However, the present invention is also applicable to the case of displaying video data downloaded from the Internet, video content such as a video viewer, and still images. Can be applied. In addition to the mobile phone described in the above embodiment, the mobile terminal device to which the present invention is applied is a mobile device equipped with a camera function, such as a PDA (Personal Digital Assistants), a portable TV, a portable navigation device, a portable game device, Electronic notebooks, electronic dictionaries, etc. are also included.

  In other words, the mobile phone in the above-described embodiment operates by processing, means, and functions executed by the computer (control unit 18) according to program instructions. The program sends a command to each component of the computer, and uses the predetermined processing and functions as described above, for example, the user's image information acquired by the camera control unit 19 by the display direction determination unit 20. Image recognition processing such as recognition is performed to determine the orientation of the display screen, and the display control unit 21 performs processing to switch the screen display of display content (video content) based on the determination result. As described above, the processes and means in the above-described embodiment are realized by specific means in which the program and the computer cooperate.

  Then, for example, a computer (CPU) of a mobile phone reads out the program code stored in the storage medium via a computer-readable recording medium that records the program code of the software that realizes the functions of the above-described embodiment, that is, the storage medium. The object of the present invention can also be achieved by executing. Further, the program can be loaded and executed directly on a computer through a communication line without going through a recording medium, and the object of the present invention can be achieved similarly.

  In this case, the program code itself read from the storage medium or loaded and executed through the communication line realizes the functions of the above-described embodiment. And the storage medium which memorize | stored the program code comprises this invention.

  Examples of the storage medium for supplying the program code include a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a nonvolatile memory card, a ROM, and a magnetic tape. Can be used.

It is the figure which showed the structure of the portable terminal device which concerns on embodiment of this invention. It is a functional block diagram showing a schematic configuration of a mobile phone according to an embodiment of the present invention. It is a figure for demonstrating the screen display switching of the television broadcast image | video in embodiment of this invention. It is a figure for demonstrating the screen display switching of the television broadcast image | video in embodiment of this invention. It is a figure for demonstrating the screen display switching of the television broadcast image | video in embodiment of this invention. It is a figure for demonstrating the function allocation change of the operation button in embodiment of this invention. It is a figure for demonstrating the function allocation change of the operation button in embodiment of this invention. It is the flowchart which showed the flow of the switching operation | movement of the screen display and function assignment in embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Portable terminal device 2 Main control means 3 Memory | storage means 4 Display means 5 Imaging means 6 Face recognition means 7 Body direction detection means 8 Switching control means 11 Transmission / reception antenna 12 Telephone radio | wireless part 13 Telephone voice processing part 14 Voice input / output part 15 Reception antenna Reference Signs List 16 TV wireless unit 17 TV video / audio processing unit 18 control unit 19 camera control unit 20 display direction determination unit 21 display control unit 22 operation control unit 23 camera 24 display unit 25 memory 26 operation unit 100 mobile phone

Claims (15)

A portable terminal device that stores an application including a program for reproducing video content in real time and displays data processed by the application on a display means,
Imaging means for imaging a user and obtaining image information;
Face recognition means for recognizing a user's face structure from image information acquired by the imaging means and acquiring face information;
On the basis of the user's face information acquired by the face recognition means, a chassis direction detection means for detecting the orientation of the chassis of the mobile terminal device with respect to the user in use;
Switching control means for switching the display of the video content on the display means based on the orientation of the housing detected by the housing direction detection means,
A portable terminal device which performs display switching of the video content by performing various operations by the imaging unit, the face recognition unit, the body direction detection unit, and the switching control unit during the activation of the application.   2. The switch control unit according to claim 1, wherein the switching control unit changes and switches a function assigned to each operation key included in the operation unit based on the orientation of the housing detected by the housing direction detection unit. Mobile terminal device.   The portable terminal device according to claim 1 or 2, wherein the switching control unit changes the display content on the display unit based on the orientation of the casing detected by the casing direction detection unit.   The portable terminal device according to any one of claims 1 to 3, wherein the switching control unit switches a function assigned to each operation key simultaneously with display switching of the video content.   The switching control means is based on a function assignment table representing a relationship between the orientation of the chassis and the functions assigned to the operation keys, and the orientation of the chassis detected by the chassis direction detection means. 5. The mobile terminal device according to claim 1, wherein the function assigned to the operation key is switched.   The switching control means displays the video content and related information of the content on the display means when the orientation of the chassis detected by the chassis direction detection means is vertically long, and is detected by the chassis direction detection means. 6. The mobile terminal device according to claim 1, wherein only the video content is displayed on the display unit when the orientation of the casing is horizontally long.   The switching control means switches to a portrait screen display when the user's upward direction grasped from the face information acquired by the face recognition means matches the short side of the display screen of the display means, The portable terminal device according to any one of claims 1 to 6, wherein when the direction coincides with a long side of the display screen, the screen is switched to a landscape screen display.   The mobile terminal device according to claim 1, wherein the application receives a television broadcast and causes the display unit to display the content as video content. A screen display switching method in a mobile terminal device that stores an application including a program for reproducing video content in real time and displays data processed by the application on a display means,
An imaging step of imaging a user and acquiring image information;
A face recognition step of recognizing a user's face structure from the image information obtained by the imaging step to obtain face information;
Based on the user's face information acquired by the face recognition step, a body direction detection step for detecting the orientation of the body of the mobile terminal device with respect to the user in use;
A switching control step of switching the display of the video content on the display means based on the orientation of the housing detected by the housing direction detection step,
A screen display switching method characterized by performing various operations by the imaging step, the face recognition step, the body direction detection step, and the switching control step and switching the display of the video content during the activation of the application. .   The switching control step changes and switches the function assigned to each operation key provided in the operation means based on the orientation of the housing detected by the housing direction detection step. Screen display switching method.   11. The screen display switching method according to claim 9, wherein the switching control step changes a display content on the display unit based on a direction of the casing detected by the casing direction detection step. . A program in a portable terminal device that stores an application including a program for reproducing video content in real time and displays data processed by the application on a display means,
On the computer,
An imaging function for imaging a user and acquiring image information;
A face recognition function for recognizing a user's face structure from image information obtained by the imaging function and obtaining face information;
Based on the user's face information acquired by the face recognition function, a chassis direction detection function for detecting the orientation of the chassis of the mobile terminal device with respect to the user in use;
A switching control function for switching the display of the video content on the display means based on the orientation of the casing detected by the casing direction detection function;
A program for causing a computer to perform display switching of the video content by performing various operations by the imaging function, the face recognition function, the chassis direction detection function, and the switching control function while the application is running. .   13. The switching control function according to claim 12, wherein the function assigned to each operation key of the operating means is changed and switched based on the orientation of the chassis detected by the chassis direction detection function. Program.   The program according to claim 12 or 13, wherein the switching control function changes a display content on the display unit based on a direction of the casing detected by the casing direction detection step.   The computer-readable recording medium which recorded the program of any one of Claim 12 to 14.

Images