JP5339445B2 - Terminal device and program - Google Patents

Description

  The present invention relates to a terminal device and a program for displaying display information on a display unit capable of three-dimensional display.

  2. Description of the Related Art Conventionally, there are various technologies for displaying information such as images (still images, moving images), texts, menus, and the like on a flat display unit in a three-dimensional display (3D display) so that the user can view stereoscopically. For example, there is a technique in which an object in two-dimensional (2D) display information is given a visual effect that makes it appear three-dimensional, and the object is made three-dimensional. The technique using polygons is an example of this technique. There is also a technique that uses parallax of the user's right eye and left eye. That is, when the display information for the right eye and the display information for the left eye that are slightly shifted from each other are prepared and the two pieces of display information are displayed at the same time, the display information for the right eye is visible to the right eye and not to the left eye. In order to prevent the display information for the left eye from being seen by the left eye but from the right eye, the electronic parallax barrier (switching liquid crystal panel) that blocks the light path is placed at an appropriate position to display the display information in three dimensions. It is a technology that I tried to show.

  In any of the 3D display technologies described above, there is a parameter called 3D depth indicating the depth of 3D or the degree of popping out, and the larger the 3D depth, the deeper the display information appears to the user or the more the popping out. Become. On the other hand, as the 3D depth is smaller, the display information appears shallower or does not appear to protrude so much, and when the 3D depth is zero, it appears as 2D (that is, 2D display). 2. Description of the Related Art Conventionally, there is known a display system that appropriately converts a flat (2D) / stereoscopic (3D) image and displays it using an electronic parallax barrier (see Patent Document 1).

JP 2006-121553 A

  By the way, displaying the display information in 3D is not always the best, and it may also cause the user to see an image that is difficult to view, and the 3D processing consumes a lot of power. It is not preferable in terms of power consumption to always perform 3D display.

  An object of the present invention is to realize appropriate display without causing the user to feel bothered when displaying display information on a display unit capable of 3D display.

  In order to solve the above-described problem, the invention described in claim 1 is a terminal device that displays display information on a display unit capable of three-dimensional display, and detects whether or not the terminal device is in a handheld state. A hand-held detecting means, a determining means for determining the appropriateness of the display information in the three-dimensional display based on a detection result of whether or not the hand-held state is detected by the hand-held detecting means, and the three-dimensional display determined by the determining means Determining means for determining display control when displaying the display information on the display section based on the appropriateness in the display, and a display for displaying the display information on the display section according to the display control determined by the determining means And a control means.

  As an invention dependent on claim 1, the detection means detects whether or not the terminal device is in a hand-held state based on a contact method when a human body contacts the terminal device. The invention according to claim 2 may be used.

As an invention dependent on claim 1 or 2, the determining means causes the display unit to display the display information two-dimensionally or three-dimensionally based on the appropriateness of the three-dimensional display determined by the determining means. The invention according to claim 3 , wherein display control for determining whether to display is determined.

As an invention dependent on claim 1 or 2, the determination means as display control when displaying the display information on the display unit based on the appropriateness in the three-dimensional display determined by the determination means. The depth of three-dimensional display is determined, and the display control unit displays the display information on the display unit at the depth of three-dimensional display determined by the determining unit. The invention described in item 4 may be used.

According to a fourth aspect of the present invention, the display control unit further includes a content storage unit that stores a plurality of types of content having a plurality of actual data with different depths of three-dimensional display as the display information, and the display control unit includes the content storage unit When displaying a content selected as a display target from a plurality of types of content stored in the means, actual data corresponding to the depth of the three-dimensional display determined by the determination means is read as the display target content it may be an invention of claim 5, wherein the said display information so as to display the three-dimensional on the display unit Te.

As a subordinate invention according to claim 5 , the determination means determines the depth of the three-dimensional display when it is determined that the determination means is not suitable for the three-dimensional display as appropriate in the three-dimensional display determined by the determination means. The invention according to claim 6 may determine the weak depth.

The invention according to claim 1 or 2, further comprising receiving means for receiving content as the display information, wherein the display control means is a display control in which the content received by the receiving means is determined by the determining means. The display according to claim 7 may be displayed on the display unit in real time.

In order to solve the above-described problem, the invention according to claim 8 detects whether or not the terminal device for displaying the display information on the display unit capable of three-dimensional display is in a handheld state with respect to the computer. The display information based on the function, the function of determining the appropriateness of the display information in the three-dimensional display based on the detection result of whether or not the handheld state, and the appropriateness of the determined three-dimensional display A program for realizing a function of determining display control when displaying the image on the display unit and a function of displaying the display information on the display unit according to the determined display control.

  According to the present invention, when display information is displayed on a display unit capable of 3D display, an appropriate display can be realized without causing the user to feel bothersome, and it is rich in practicality. Become.

The block diagram which showed the communication network system which can use the mobile telephone applied as a terminal device. FIG. 2 is a block diagram showing basic components of the mobile phone 1. The figure for demonstrating the display control information storage part M3. The flowchart which showed the display control process started execution by starting viewer applications, such as a television application. 6 is a flowchart for explaining in detail display control determination processing (step A7 in FIG. 4) for determining display control in accordance with the “hand-held state”. 5 is a flowchart for explaining in detail display control determination processing (step A8 in FIG. 4) for determining display control according to “time zone”. 6 is a flowchart for explaining in detail display control determination processing (step A9 in FIG. 4) for determining display control in accordance with “user”. The figure for demonstrating the content memory | storage part M4 in 2nd Embodiment. The flowchart which showed the display control process started in response to content reproduction operation in 2nd Embodiment.

(Embodiment 1)
The first embodiment of the present invention will be described below with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone as a terminal device, and FIG. 1 is a block diagram showing a communication network system in which the mobile phone can be used.
The mobile phone 1 is, for example, a foldable type in which two housings (an operation unit housing and a display unit housing) are attached so that they can be opened and closed (foldable). The mobile phone 1 includes a call function, an e-mail function, In addition to the Internet connection function (Web access function) and camera function, it is equipped with a TV function, a 3D (three-dimensional) display function, a recording function, etc. that can receive and watch digital TV broadcasts (for example, one-segment digital terrestrial TV broadcasts). It has been. The 3D display function does not display display information (contents) such as moving images, still images, texts, menus, etc. in 2D (two-dimensional) by a parallax barrier method using the parallax of the left and right eyes, but 3D depth or popping This is a function of displaying at a 3D depth indicating the degree of.

  When the mobile phone 1 is connected to the wireless communication network (mobile communication network) 2 from the nearest base station 2A and exchange 2B, the mobile phone 1 can communicate with another mobile phone 1 via the wireless communication network 2. It becomes a state. In addition, when the mobile phone 1 is connected to the Internet 3 via the wireless communication network 2, the mobile phone 1 can access and browse a Web site, and from the information distribution device 4, movies, still images, music, news, music, etc. The multimedia content can be downloaded and played back via the Internet 3 and the wireless communication network 2 for streaming.

  The mobile phone 1 receives terrestrial digital broadcasting (broadcast content) transmitted from the TV station 5 via the transmission antenna 6, but via the wireless communication network 2 and the Internet 3 like Internet radio. The digital broadcast can be downloaded and received from the information distribution device 4. As described above, the mobile phone 1 can receive broadcast content via a TV function or the like, and can download and receive streaming content via an Internet connection function. In addition, various contents can be acquired from a recording medium 7 such as a removable portable memory card, or from an external device 8 such as another mobile phone via short-range communication such as Bluetooth (registered trademark) communication or infrared communication. Various contents can be acquired.

FIG. 2 is a block diagram showing basic components of the mobile phone 1.
The central control unit 11 operates by supplying power from a power supply unit 12 including a secondary battery, and controls the overall operation of the mobile phone 1 according to various programs in the storage unit 13 and a memory. Etc. The storage unit 13 includes a program storage unit M1, various information temporary storage units M2, a display control information storage unit M3, a content storage unit M4 used in a second embodiment to be described later, and the like. Note that the storage unit 13 may include a removable portable memory (recording medium) such as an SD card or an IC card, or may be on a predetermined external server (not shown).

  The program storage unit M1 stores programs and various applications for realizing the present embodiment in accordance with the operation procedures shown in FIGS. 4 to 7, and stores information necessary for the programs. ing. The various information temporary storage unit M2 is a work area that temporarily stores various information necessary for the mobile phone 1 to operate, such as flag information, timer information, and screen information. The display control information storage unit M3 will be described in detail later.

  The other application processing related unit 14 stores information related to application processing such as an electronic mail function, an Internet connection function, a camera function, and a television function, and performs control related to the processing. The radio communication unit 15 includes a radio unit, a baseband unit, a demultiplexing unit, and the like. For example, during operation of a call function, an e-mail function, an Internet connection function, etc., data is transmitted to and received from the nearest base station 2A. When the call function is in operation, a signal is taken from the receiving side of the baseband unit and demodulated into a received baseband signal, and then the voice is output from the calling speaker SP via the audio signal processing unit 16. The input audio data from the microphone MC is taken from the audio signal processing unit 16 and encoded into a transmission baseband signal, which is then given to the transmission side of the baseband unit and transmitted from the antenna AT1.

  The TV broadcast receiving unit 17 constitutes a TV function and can receive not only one-segment terrestrial digital TV broadcasts for communication terminal devices but also program information such as an electronic program guide (EPG information). This television broadcast receiving unit 17 extracts a broadcast signal of a channel selected in advance from the television broadcast signal received by the television antenna AT2, and receives the received broadcast signal by OFDM ( It has a digital circuit unit that performs demodulation (orthogonal frequency division multiplexing), decodes the multiplexed broadcast signal into video, audio, and data (character data), decodes the compressed data, and the like.

  The imaging processing unit 18 constitutes a camera function capable of photographing a moving image in addition to still image photographing, and constitutes an in-camera and an out-camera although not shown. The in-camera is an imaging unit for a videophone that captures the face of the user, and the out-camera is a normal imaging unit that captures the outside world. For example, when two casings (an operation unit casing and a display unit casing) constituting the mobile phone device are attached so as to be openable and closable (foldable), The in-camera is a camera arranged on the inner side (display screen side) of the display unit casing, and the out-camera is a camera arranged on the outer side (opposite side of the in-camera) of the display unit casing.

  The imaging processing unit 18 includes a photographic lens, a lens / mirror block such as a mirror, an imaging device, and a driving system thereof, as well as a distance measuring sensor, a light amount sensor, an analog processing circuit, a signal processing circuit, a compression / expansion circuit, and the like. The optical zoom is adjusted and controlled, the auto focus for adjusting the focus for imaging, or the manual focus by manual operation is adjusted and controlled, and the shutter drive control, exposure, white balance, and the like are controlled. The in-camera described above is used not only for videophones but also for user identification. When the user's face is photographed by the in-camera, the control unit 1 Analyzing the face image and comparing the result of the analysis with pre-registered face information (not shown) identifies who the user is and what age group the user falls into Or to guess.

  The display unit 19 corresponding to 3D display uses high-definition liquid crystal and displays display information (contents) such as character information, a standby image, a television image, and a photographed image, and is displayed on the surface of the display unit 19. Is provided with a liquid crystal layer for generating a parallax barrier (not shown) to enable 3D display. The 2D / 3D conversion processing unit 20 converts 2D content into right-eye content and left-eye content according to 3D depth, converts 3D content into another 3D depth content, or converts 3D content into 2D content. The content converted by the 3D conversion processing unit 20 is displayed in 3D or 2D on the display unit 19.

  The operation unit 21 inputs dial input, character input, command input, and the like. The central control unit 11 executes processing according to an input operation signal from the operation unit 21. The notification unit 22 includes a sound speaker, an LED (light emitting diode) lamp, and a vibration motor (not shown). The notification unit 22 is driven when an incoming call is received to notify an incoming call, and is also driven when an alarm is notified. The touch sensor unit 23 has a configuration in which a human body contact unit (transparent touch sensor) is disposed on both sides of the operation unit casing constituting the mobile phone 1, and the central control unit 11 is in contact with the touch sensor unit 23. Whether or not the mobile phone 1 is in a handheld state is detected based on the above.

  In order to detect a hand-held state, for example, by providing a style detection unit (not shown), folding of two casings (an operation unit casing and a display unit casing) constituting the mobile phone 1 is opened. When it is detected that the human body is in contact with the touch sensor unit 23 provided on both sides of the operation unit casing, and detects that it is in a handheld state. It may be. Further, the touch sensor unit 23 is used when detecting whether or not the mobile phone 1 is in a handheld state as described above, and the user touches the touch sensor unit 23 in order to identify the user of the mobile phone 1. It is also used when fingerprint information is collected from the touched part. In this case, the central control unit 11 analyzes the fingerprint information (user's biometric information) from the touch sensor unit 23, and collates the analysis result with previously registered fingerprint information (not shown). The user is trying to identify someone. The time measuring unit 24 constitutes a clock that measures the current time (including day of the week, date in addition to hour, minute, second), and the central control unit 11 determines whether the current time corresponds to a predetermined time zone. I am doing so.

FIG. 3 is a diagram for explaining the display control information storage unit M3.
In addition to indicating whether the content is to be displayed in 2D or 3D based on the appropriateness in 3D display of the content when the display target content is displayed on the display unit 19, the display control information storage unit M <b> 3 displays 3D. In the case of displaying, the display control information indicating how much depth (strength) the 3D depth is displayed is stored, and “appropriate condition” and “display control information” are stored in association with each other. It has become. The contents of the display control information storage unit M3 are arbitrarily set by manual operation. The central control unit 11 refers to the display control information storage unit M3 to determine whether or not the broadcast content or streaming content received as a display target is suitable for 3D display, and displays the content according to the suitability for the 3D display. The control is determined, and the content is displayed in 2D or 3D on the display unit 19 in accordance with the display control.

  In other words, the display control information storage unit M3 includes a reference table T5 in addition to the type table T1 and the appropriate condition tables T2, T3, and T4. The type table T1 stores the types of “appropriate conditions”, and “hand-held state” that uses whether or not the mobile phone 1 is in a hand-held state based on the state of contact with the touch sensor unit 23; Who is the user who sees the content display using the mobile phone 1 and the “time zone” in which an appropriate condition is whether or not the current time measured by the time measuring unit 24 falls within a predetermined time zone? “Users (individuals / attributes)” whose aptitude condition is a person with what kind of attribute is stored. The “setting flag” associated with “handheld state”, “time zone”, and “user (individual / attribute)” as the type of “appropriate condition” indicates which aptitude condition is valid. This flag “1” indicates that the fitness condition is currently valid. In the example shown in the drawing, “hand-held state” indicates that the fitness condition is currently valid.

  The table according to suitability condition T2 stores “display control information” according to “time zone” of “suitability condition”. For example, “meal time zone”, “hobby time zone” can be used as the user's life time zone. 1 ”,“ Hobby time zone 2 ”,... Are stored, and“ Meal time zone ”is, for example,“ 7: 0 to 8:00 ”,“ 12: 0 to 13:00 ”,“ 19:00 ” To 20:00 ". The “time zone” as the “appropriate condition” is arbitrarily set by manual operation, and the “hobby time zone 1” is, for example, “every Wednesday 20: “00 to 22:00” and “hobby time zone 2” indicate that “every Friday 21: 00 to 23:00” is a time zone for watching a movie program. “Display control information” is used when determining display control in accordance with a time zone corresponding to the current time, and includes “2D / 3D” indicating whether 2D display or 3D display is performed. When displaying, it has “3D depth” indicating how much depth (strength) 3D depth is displayed according to the suitability.

  “3D Depth” indicates the 3D depth of the content or the degree of pop-up. “Level 3”, “Level 2”, “Level 1”, and Level 0 are set, and level 3> The relationship is level 2> level 1> level 0. Note that “level 0” indicates that the 3D depth is “level 0 (zero)” and 2D (plane), and the content whose “3D depth” is “level 0” is displayed in 2D. In the illustrated example, “2D” is stored in “2D / 3D” and “level 0” is stored in “3D depth” corresponding to each “meal time zone”. Also, “2D” is stored in “2D / 3D” corresponding to “hobby time zone 1”, “level 0” is stored in “3D depth”, and “hobby time zone 2” is supported. Then, “3D” is stored in “2D / 3D”, and “level 2” is stored in “3D depth”. That is, display control such as 3D display is performed when watching television broadcasting in earnest, and 2D display is performed otherwise.

  The appropriate condition table T3 is configured to store “display control information” according to “user (individual)” of “appropriate condition”. The “user (individual)” as the “appropriate condition” is arbitrarily set by manual operation, and each individual (family, friend) who may watch TV broadcast using the mobile phone 1. For example, “grandmother”, “father”, “mother”, “brother”, “sister”, and the like are stored. The “display control information” is used when determining display control according to a user who views a television broadcast or the like using the mobile phone 1, and “2D” similar to the above-described appropriate condition table T 2. / 3D "and" 3D depth ". In the illustrated example, “2D” is stored in “2D / 3D” corresponding to “grandmother” and “level 0” is stored in “3D depth” in consideration of the health condition of the eye, the growth period, and the like. “3D” is stored in “2D / 3D” corresponding to “Father” and “Brother”, “Level 3” is stored in “3D Depth”, and “Mother” is stored. “3D” is stored in “2D / 3D”, “Level 2” is stored in “3D Depth”, and “2D / 3D” is stored in “2D / 3D”. “3D” is stored, and “Level 1” is stored in “3D depth”.

  The appropriate condition condition table T4 is configured to store “display control information” in accordance with “user (attribute)” of “appropriate condition”. The “user (attribute)” as the “appropriate condition” is arbitrarily set by manual operation, and the attribute (age) of a user who may watch a television broadcast using the mobile phone 1. Layer), for example, “under 12 years old”, “12 years old and under 65 years old”, and “65 years old and over”. The “display control information” is used when determining display control according to the attribute of the user who views the television broadcast or the like using the mobile phone 1, and is the same as the table T2 by aptitude condition described above. “2D / 3D” and “3D depth”. In the illustrated example, “2D” is stored in “2D / 3D” and “3D depth” corresponding to “under 12 years old” and “over 65 years old” in consideration of the growth period and the like. “Level 0” is stored, “3D” is stored in “2D / 3D”, and “Level 2” is stored in “3D depth” corresponding to “12 years old and under 65 years old” .

  The reference table T5 is referred to when determining a method for specifying a user (individual / attribute) who views a television broadcast or the like by using the mobile phone 1, and the “determination method” and “setting flag” are referred to. It has the structure which has. The “determination method” includes “manual operation” in which information for identifying a user (individual / attribute) is obtained by manual operation and the user (individual / attribute) by collecting the user's fingerprint. “Auto 1” for a method for obtaining information for specifying, and “Auto 2” for a method for obtaining information for identifying a user (individual / attribute) by analyzing an image obtained by photographing a user's face. "have. The “setting flag” corresponding to this “determination method” is a flag indicating which one is valid, and in the illustrated example, “Auto 2” is the currently valid “determination method”. .

Next, the operation concept of the mobile phone 1 in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Moreover, the operation | movement according to the above-mentioned program code transmitted via transmission media, such as a network, can also be performed sequentially. The same applies to other embodiments described later. In addition to the recording medium, an operation peculiar to the present embodiment can be executed using a program / data supplied externally via a transmission medium.
FIG. 4 is a flowchart showing an outline of the operation of the characteristic part of the present embodiment in the overall operation of the cellular phone 1. When the flow of FIG. Return to (omitted).

FIG. 4 is a flowchart showing a display control process that is started when a viewer application such as a TV application is started.
First, in response to the content reception / playback operation (real-time playback operation), the central control unit 11 checks whether the television function is activated (step A1). If the television function is activated (YES in step A1). As a display target content, reception of broadcast content (2D display content) from the television broadcast receiving unit 17 is started (step A2). When the Internet connection function is activated (NO in step A1), reception of streaming content (2D display content) from the wireless communication unit 15 as display target content is started (step A3).

  Then, the “setting flag” in the type table T1 constituting the display control information storage unit M3 is referred to (step A4), and the “appropriate condition” in which the “setting flag” is “1” is “hand-held state”. (Step A5) or whether it is a "time zone" or "user" (step A6). Now, if the “suitability condition” with the “setting flag” being “1” is “hand-held state” (YES in step A5), the process proceeds to a display control determination process for determining display control according to the “hand-held state” ( If it is “time zone” (YES in step A6), the process proceeds to display control determination processing for determining display control according to “time zone” (step A8), and if “user” (step A7) The process proceeds to a display control determination process for determining display control according to “user” (NO in A6) (step A9).

FIG. 5 is a flowchart for explaining in detail the display control determination process (step A7 in FIG. 4) for determining display control according to the “hand-held state”.
First, in a state where the touch sensor unit 23 is operated (step B1), the central control unit 11 acquires a contact state with the touch sensor unit 23 disposed on both sides of the operation unit casing (step B2). ) Based on this contact state, it is detected whether or not the mobile phone 1 is in the “hand-held state” (step B3). In this case, when the contact to the touch sensor unit 23 is not detected, or even when contact is detected, it is not a contact situation corresponding to a holding method in which an appropriate viewing distance can be stably secured when viewing a 3D display. Sometimes, it is determined that it is not in the “handheld state”.

  If it is not “hand-held” (NO in step B3), it is determined that it is not suitable for 3D display, and “level 0” is determined as 3D depth to display received content in 2D (step B5). If it is determined that it is in a state (YES in step B3), it is determined that it is suitable for 3D display, and “level 2” is determined as the 3D depth for displaying the received content in 3D (step B4). Note that the 3D depth in the handheld state is not limited to “level 2” but may be “level 1” or “level 3”. Then, the 3D depth determined as described above is temporarily stored in the various information temporary storage unit M2 (step B6).

FIG. 6 is a flowchart for explaining in detail the display control determination process (step A8 in FIG. 4) for determining the display control according to the “time zone”.
First, the central control unit 11 obtains the current time from the time measuring unit 24 (step C1), and then checks whether or not there is a table T2 classified by suitability conditions for time zones (step C2). Here, if the table T2 by suitability condition is manually created and “display control information” is set in association with “time zone” (YES in step C2), the “time zone” corresponding to the current time is set. The presence or absence of this is examined (step C3). Here, if one of the “time zones” is applicable (YES in step C3), “3D depth” is read from “display control information” associated with the “time zone”, and the received content Is determined as a 3D depth for 3D display (step C4). For example, if the current time is “Friday 21:00:00 to 23:00”, it corresponds to “Hobby time zone 2”, and therefore “Level 2” is determined as “3D depth”.

  Further, when the suitability condition table T2 is not set (NO in step C2), or when the suitability condition table T2 is set, the current time does not correspond to any “time zone” ( NO in step C3), it is checked whether it is a midnight time zone or an early morning time zone (step C6). If it is a midnight time zone or an early morning time zone (YES in step C6), it is determined that it is not suitable for 3D display, and the received content is “Level 0” is determined as the 3D depth for 2D display (step C7). If it is not a midnight time zone or an early morning time zone (NO in step C6), “level 2” is determined as the 3D depth for displaying the received content in 3D (step C8). The 3D depth in this case is not limited to “level 2” but may be “level 1” or “level 3”. Then, the 3D depth determined as described above is temporarily stored in the various information temporary storage unit M2 (step C5).

FIG. 7 is a flowchart for explaining in detail the display control determination process (step A9 in FIG. 4) for determining the display control in accordance with the “user”.
First, the central control unit 11 refers to the “setting flag” in the reference table T5 (step D1), and determines whether or not the “determination method” with the “setting flag” being “1” is “automatic 1”. It is checked (step D2), and it is checked whether it is "automatic 2" or "manual operation" (step D3). If the “setting flag” is “1” and the “determination method” is “automatic 1” (YES in step D2), the touch sensor unit 23 is operated (step D4), and then the fingerprint is printed from the touch sensor unit 23. Information is acquired (step D5), and fingerprint authentication processing is performed based on the fingerprint information (step D6).

  In this case, the fingerprint information from the touch sensor unit 23 is analyzed, and the fingerprint authentication process is performed by collating the analysis result with the registered fingerprint information. If it is determined not to do so (NO in step D7), “level 0” is determined as the 3D depth in order to display the received content in 2D (step D8). If it is determined that the fingerprint information is registered (YES in step D7), the user is specified and the appropriate condition condition table T3 is referred to based on the user (step D9). ), “3D depth” of the corresponding “display control information” is read out and determined as 3D depth for displaying the received content in 3D (step D10). For example, if the user is “father”, “level 3” is determined as “3D depth” corresponding to the user, and “level 0” is determined as “3D depth” corresponding to “grandmother”. The

  If the “setting flag” is “1” and the “determination method” is “automatic 2” (YES in step D3), the in-camera of the imaging processing unit 18 is operated (step D11). And after acquiring the face image image | photographed with the in-camera (step D12), it moves to the next face authentication process (step D13). In this case, face authentication processing is performed by analyzing the face image from the in-camera and comparing the analysis result with face information registered in advance. If it is determined that the face information is registered (YES in step D14), the user is identified and the appropriate condition condition table T3 is referred to based on the user. (Step D9), the “3D depth” of the corresponding “display control information” is read and determined as the 3D depth for displaying the received content in 3D (step D10). For example, if the user is “father”, “level 3” is determined as the “3D depth” corresponding to the user.

  On the other hand, if it is determined that the face information does not correspond to the registered face information (NO in step D14), the age group of the user is determined by analyzing the face image from the in-camera. An estimation process is performed (step D15). In this case, the age group is estimated by comprehensively judging the condition of gray hair, thin hair, number of wrinkles, skin looseness, etc. If the estimation is impossible (NO in step D16), the received content is “Level 0” is determined as the 3D depth for 2D display (step D17), but if estimation is possible (YES in step D16), refer to the table T4 by suitability condition based on this estimated age group. (Step D18), the “3D depth” of the corresponding “display control information” is read and determined as the 3D depth for displaying the received content in 3D (step D19). For example, if “less than 12 years old” or “65 years old or older”, “level 0” is determined as the 3D depth, and if “12 years old or older and less than 65 years old”, “level 2” is determined as the 3D depth. The

  If the “setting flag” is “1” and the “determination method” is “manual operation” (NO in step D3), the process waits for input of information for identifying the individual user (step D20). If there is no information input by manual operation (NO in step D20), “level 0” is determined as the 3D depth to display the received content in 2D (step D21), but if there is information input (step D20). YES), by referring to the appropriate condition condition table T3 based on this input information (step D22), the “3D depth” of the corresponding “display control information” is read, and the received content is displayed in 3D depth. (Step D23). Then, the 3D depth determined as described above is temporarily stored in the various information temporary storage unit M2 (step C24).

  When such display control determination processing (steps A7 to A9 in FIG. 4) is completed, the “3D depth” in the temporary storage is read (step A10 in FIG. 4), and it is checked whether it is “level 0” (step A11). ). Now, if “3D depth” is “level 0” (YES in step A11), the process proceeds to 2D display of received content. At this time, if a parallax barrier is generated on the surface of the display unit 19, After erasing the parallax barrier (step A12), the received content is displayed in 2D on the display unit 19 (step A13). The process returns to the above-described step A13 until the end of the received content is detected or a user operation for instructing the display end is performed (step A14).

  If “3D depth” is not “level 0” (NO in step A11), a parallax barrier is generated on the surface layer of the display unit 19 (step A15), and the received content (2D content) is set to “3D depth”. The content is converted into the corresponding 3D display content (step A16). At that time, the 2D / 3D conversion processing unit 20 performs processing for converting the 2D received content into the right-eye content and the left-eye content according to the 3D depth, and thus acquires the converted received content, 3D display is performed on the display unit 19 at the above-mentioned “3D depth” (step A17). Then, the process returns to step A17 described above until the end of the received content is detected or a user operation for instructing the display end is performed (step A18). Note that the display control process in FIG. 4 ends in response to the end detection in step A14 or step A18 described above.

  As described above, in the first embodiment, the central control unit 11 of the mobile phone 1 determines whether the display target content is appropriate for 3D display based on whether the mobile phone 1 is in a handheld state. Since the content is displayed on the display unit 19 in accordance with the display control determined according to the suitability for 3D display, whether or not the mobile phone 1 is in a handheld state without causing the user to feel bothered. Depending on the situation, it is possible to realize appropriate display according to the user's intentions from easy-to-view 2D display to realistic 3D display, and it is advantageous in terms of power consumption. It will be rich in nature.

  Since whether or not the mobile phone 1 is in a hand-held state is detected based on how the human body comes into contact with the mobile phone 1, the hand-held state can be reliably detected.

  Since the appropriateness in the 3D display is determined based on the current time measured by the timekeeping unit 24, the content is displayed on the display unit 19 in accordance with the display control determined according to the suitability in the 3D display. It is possible to realize appropriate display according to the user's intention from easy-to-view 2D display to realistic 3D display according to the current time without making the user feel bothersome. However, it has advantages such as advantages and is practical.

  Since the time zone is arbitrarily set by manual operation as an appropriate condition for determining the suitability in 3D display, 3D display can be performed in the time zone desired by the user by the setting.

  The user who views the content display using the mobile phone 1 is specified, the appropriateness in the 3D display is determined based on the user, and the content is determined according to the display control determined in accordance with the suitability in the 3D display. Is displayed on the display unit 19, so that the user does not feel bothersome, and appropriate to the user's intentions from easy-to-view 2D display to realistic 3D display depending on the user. Realizing the display has advantages such as being advantageous in terms of power consumption, and is practical.

  Since the user's attributes (age group) are specified, for example, when the user is a child, considering the development of the eyes, when the user is an elderly person, considering the eye fatigue, the display is easy to see in 2D. It is possible to switch to 3D display with a sense of reality in other age groups.

  Since the user is specified based on the biometric information (fingerprint information) of the user, the user can be specified reliably.

  Since the user is specified based on the photographed image obtained by photographing the user, the user can be appropriately specified without requiring any operation from the user.

  Since whether the content is to be displayed in 2D or 3D is controlled based on the suitability in 3D display, it is possible to appropriately switch between 2D display and 3D display.

  Since the 3D depth indicating the 3D depth and the degree of popping out is determined and displayed in 3D according to the suitability in 3D display, the 3D depth can be controlled.

  Since the received content is displayed on the display unit 19 in real time according to the appropriateness of the received content in 3D display, even when broadcasting content or the like is output in real time, the 2D display is easy to see and the 3D display is realistic. Appropriate display can be realized.

  In the above-described first embodiment, the received content for 2D display is converted into the content for 3D display and displayed in 3D, but the content for 2D display (broadcast content) having the same content at the same time is used. In the mobile phone 1 capable of receiving 3D display content (broadcast content), 2D / 3D display may be switched between 2D display broadcast content and 3D display broadcast content as simulcast. . This is not limited to the case of broadcast content, and even when 2D display content and 3D display content are included as streaming content received from the wireless communication unit 15, the content is switched to 2D / You may make it display 3D.

(Embodiment 2)
Hereinafter, a second embodiment of the present invention will be described with reference to FIGS.
In the first embodiment described above, a case has been shown in which broadcast content or the like is received and reproduced and output in real time while determining the suitability of the content in 3D display. In the second embodiment, a television broadcast is provided. This shows a case where content stored in advance (accumulated), such as content recorded by receiving and recorded by a camera, is displayed on the display unit 19. In the first embodiment described above, 2D display content is converted into 3D display content and displayed in 3D. However, appropriate 2D can be obtained by reading out 2D / 3D content stored in advance. / 3D display. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 8 is a diagram for explaining the content storage unit M4 in the second embodiment.
The content storage unit M4 stores display information (contents) to be displayed on the display unit 19. For example, information such as moving images, still images, music, and news from the information distribution device 4 is transmitted to the Internet 3 and the wireless communication network. 2, and information recorded by recording and recording broadcast programs received by the television broadcast receiver 17 is stored as contents. The content storage unit M4 is configured to store “title”, “type”, “actual data”, “3D depth”, and the like corresponding to the “information ID” for identifying the content.

  “Title” indicates a title related to the content, and in the illustrated example, “Two-dimensional code”, “Athletic meet 2008”, “J-League watching **”, “Sample video **”, “Sample still image **” .... “Type” is type information indicating whether the content is moving image content or still image content. “Real data” is actual data of content, and there are contents having only “3D depth” of actual data with “level 0 (for 2D display)” and other contents having actual data of each 3D depth. That is, even if the content is the same, there are contents each having actual data (including 2D display) for each 3D depth, and there are contents having only actual data having a 3D depth of level 0 (2D display). Note that “level 0 (2D)” indicates that the 3D depth is “level 0 (zero)” and is 2D (plane).

  In this way, even for content of the same content, a plurality of “real data” of various 3D depths are prepared, and the central control unit 11 has a predetermined 3D depth of the plurality of “real data”. "Real data" is selected, and the "real data" is read from the content storage unit M4 and displayed on the display unit 19 in 3D. In this case, in the “actual data” of 3D depth not stored in the content storage unit M4, 2D data having the same content is converted into data of a predetermined 3D depth and displayed in 3D. .

FIG. 9 is a flowchart showing display control processing that is started in response to a content reproduction operation in the second embodiment.
First, in response to the content reproduction operation, the central control unit 11 reads the “title” in the content storage unit M4 and displays the menu (step E1), and then a desired content as a display target is displayed from the menu screen. When selected by a user operation (step E2), the selected content is specified as a display target (step E3).

  Then, with reference to the “setting flag” of the type table T1 constituting the display control information storage unit M3 (step E4), the “suitability condition” with the “setting flag” being “1” is “hand-held state”. Or whether it is a “time zone” or “user” (step E6). Now, if the “appropriate condition” with the “setting flag” being “1” is “hand-held state” (YES in step E5), the process proceeds to a display control determination process for determining display control according to the “hand-held state” ( Step A7) If “time zone” (YES in step E6), the process proceeds to display control determination processing for determining display control according to “time zone” (step E8), and if “user” (step E7) NO at E6), the process proceeds to a display control determination process for determining display control according to "user" (step E9). Note that each of the display control determination processes described above is the same as the display control determination process illustrated in FIGS. 5 to 7 described in the first embodiment, and thus the description thereof is omitted.

  When such display control determination processing (steps E7 to E9) ends, the temporarily stored “3D depth”, that is, “3D depth” determined by the display control determination processing is read (step E10). It is checked whether it is “level 0” (step E11). If the determined 3D depth is “level 0” (YES in step E11), the content storage unit M4 is searched. As a result, if 2D “actual data” is stored (YES in step E12). The “actual data” is read (step E13). If the 2D “actual data” is not stored (NO in step E12), the 2D / 3D conversion processing unit 20 converts the 3D “actual data” into the 2D. Data is converted (step E14).

  Instead of converting 3D “actual data” into 2D data, the “actual data” having the weakest (close to 2D) depth is selected from a plurality of “actual data” having different 3D depths. You may make it convert into data. Then, the process proceeds to 2D display. At this time, if a parallax barrier is generated on the surface of the display unit 19, the parallax barrier is deleted (step E15), and then the content is displayed on the display unit 19 in 2D. (Step E16). Thereafter, until the end of content display is instructed (YES in step E17), the selected content is displayed in 2D (steps E16 and E17).

  If the determined 3D depth is not “level 0” (NO in step E11), the content storage unit M4 is searched to check whether there is 3D “actual data” corresponding to the determined 3D depth (step E18). Note that “actual data” includes content having only real data with “3D depth” of “level 0” and content having actual data of each 3D depth. Check for actual data. If 3D “actual data” corresponding to the determined 3D depth is stored (YES in step E18), the “actual data” is read (step E19), and the process proceeds to 3D display. After the parallax barrier is generated on the surface layer of the display unit 19 (step E21), 3D display is performed on the display unit 19 (step E22). Thereafter, the selected content is displayed in 3D (steps E22 and E23) until an operation for instructing the end of the content display is performed (YES in step E23).

  If 3D “actual data” corresponding to the determined 3D depth is not stored (NO in step E18), that is, only “actual data” of another 3D depth (for example, depth level “1”) is stored. If not, the 2D / 3D conversion processing unit 20 converts the “real data” of another 3D depth into content of the determined 3D depth (step E20). In the same manner as described above, a parallax barrier is generated on the surface layer of the display unit 19 (step E21), and then 3D is displayed on the display unit 19 (step E22). Thereafter, the selected content is displayed in 3D (steps E22 and E23) until an operation for instructing the end of the content display is performed (YES in step E23).

  As described above, in the second embodiment, the 3D depth determined according to the suitability for 3D display is selected from the content storage unit M4 that stores content having a plurality of actual data with different 3D depths. Since the actual data (2D / 3D) to be read is read out and displayed as appropriate 2D / 3D, if there is appropriate actual data among the contents stored (stored) in advance, select it as the display target Appropriate 2D / 3D display can be performed without performing 2D / 3D conversion on the content that has been made.

  In addition, since content that is not suitable for 3D display is displayed at a weak 3D depth (for example, level 0), it is possible to perform display at an appropriate 3D depth, for example, 3D at a 3D depth of level 0. Display (that is, pseudo 2D display) can also be performed.

  In addition, the second embodiment has the same effect as the first embodiment described above, and the user's intention is from easy-to-see 2D display to realistic 3D display without making the user feel bothersome. Appropriate display along the line can be realized, and there is an effect that it is advantageous in terms of power consumption, and it is rich in practicality.

  In each of the above-described embodiments, the 3D content is displayed simultaneously with the right-eye content and the left-eye content corresponding to the 3D depth, and a parallax barrier corresponding to the 3D depth is displayed so that they can be viewed correctly in 3D. Although the method of generating the 3D display on the surface layer of the display unit 19 has been illustrated, any 3D display method may be used, such as a method of performing the 3D display by applying a visual effect that makes the content look 3D. .

  In addition, the storage unit 13 may be any external storage device such as a memory card or an external hard disk. The display unit 19 may be an arbitrary external display device such as an external monitor. The terminal device is not limited to the mobile phone 1 and may be any terminal device such as a personal computer, a PDA, a digital camera, or a music player. Furthermore, it is not limited to a folding type terminal device, but may be an arbitrary housing structure such as a straight type, a slide type, or a spin top type.

  Further, the “device” and “machine” shown in each of the above-described embodiments may be separated into a plurality of housings by function, and are not limited to a single housing. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

DESCRIPTION OF SYMBOLS 1 Mobile phone 2 Wireless communication network 3 Internet 4 Information delivery apparatus 11 Central control part 13 Storage part 15 Wireless communication part 17 Television broadcast receiving part 18 Imaging process part 19 Display part 20 3D conversion process part 21 Operation part 23 Touch sensor part M1 program Storage unit M3 Display control information storage unit M4 Content storage unit T1 Type table T2, T3, T4 Appropriate condition table T5 Reference table

Claims (8)

A terminal device that displays display information on a display unit capable of three-dimensional display,
Hand-holding detecting means for detecting whether or not the terminal device is in a hand-held state;
Discriminating means for discriminating the appropriateness in the three-dimensional display of the display information based on the detection result of whether or not the handheld state by the handheld detection means,
Determining means for determining display control when displaying the display information on the display unit based on the appropriateness in the three-dimensional display determined by the determining means;
Display control means for displaying the display information on the display unit according to the display control determined by the determination means;
A terminal device comprising: The detection means detects whether or not the terminal device is in a handheld state based on a contact method when a human body contacts the terminal device.
The terminal device according to claim 1, which is configured as described above. The determining means determines display control whether to display the display information two-dimensionally or three-dimensionally on the display unit based on the appropriateness in the three-dimensional display determined by the determining means.
The terminal device according to claim 1 , wherein the terminal device is configured as described above. The determining means determines the depth of the three-dimensional display as display control when displaying the display information on the display unit based on the appropriateness in the three-dimensional display determined by the determining means,
The display control means causes the display unit to display the display information at the depth of the three-dimensional display determined by the determination means.
The terminal device according to claim 1 , wherein the terminal device is configured as described above. The display information further includes content storage means for storing a plurality of types of content having a plurality of actual data with different depths of three-dimensional display,
When the display control means displays a content selected as a display target from among a plurality of types of content stored in the content storage means, the three-dimensional display determined by the determination means as the display target content Reading out the actual data corresponding to the depth of the display and displaying the display information three-dimensionally on the display unit,
The terminal device according to claim 4, which is configured as described above. The determining means determines a weak depth as the depth of the three-dimensional display when it is determined that the three-dimensional display is not suitable as the appropriateness in the three-dimensional display determined by the determining means.
The terminal device according to claim 5, which is configured as described above. A receiving means for receiving content as the display information;
The display control means causes the display unit to display the content received by the receiving means in real time according to the display control determined by the determining means.
The terminal device according to claim 1 , wherein the terminal device is configured as described above. Against the computer,
A function of detecting whether or not the terminal device that displays the display information on the display unit capable of three-dimensional display is in a handheld state;
A function of determining the appropriateness in the three-dimensional display of the display information based on the detection result of whether or not the handheld state;
A function for determining display control when displaying the display information on the display unit based on the appropriateness in the determined three-dimensional display;
A function of causing the display unit to display the display information according to the determined display control;
A program to realize

Images