JP5349658B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

Embodiments described herein relate generally to an information processing apparatus , an information processing method, and a program for processing image information.

  In recent years, various technologies have been put into practical use that allow 3D images to be displayed on video display devices such as television receivers, but devices capable of displaying 3D images on information processing devices such as personal computers have been developed. Has been. In such a video display device, for example, a user perceives a three-dimensional video (stereoscopic video) using a left-eye video and a right-eye video based on binocular parallax. Since the information processing apparatus executes various applications, depending on the application or the content to be displayed, there are cases where three-dimensional display is impossible or two-dimensional display is more appropriate. In addition, a small portable information processing apparatus may have difficulty in viewing a 3D image depending on the direction of operation. For this reason, it may not be appropriate to design the information processing apparatus so that it is always displayed in three dimensions.

JP 2010-108203 A

  The conventional information processing apparatus has a problem that it is desired to use two-dimensional display and three-dimensional display properly depending on circumstances.

An object of the present invention is to provide an information processing apparatus , an information processing method, and a program capable of switching between two-dimensional display and three-dimensional display.

According to the embodiment, the information processing apparatus includes a display unit, a detector, and a control unit. The display unit can perform two-dimensional display or three-dimensional display. Detector for detecting whether the display unit is in a vertical state or a horizontal state. The control unit includes a function of determining whether or not an application to be executed is a predetermined application. When the detector detects that the display unit is in a horizontal state, the control unit sets the display unit to two-dimensional display, and During execution, the display unit is set to three-dimensional display regardless of the detection result of the detector.

1 is a perspective view showing an appearance of an information processing apparatus according to an embodiment. The block diagram which shows the system configuration | structure of the information processing unit of one Embodiment. FIG. 3 is a block diagram showing a software configuration of the video reproduction application in FIG. 2. The figure which shows an example of the display mode of one Embodiment. The figure which shows the other example of the display mode of one Embodiment. The perspective view which shows the external appearance of the information processing apparatus which concerns on other embodiment.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 is a perspective view illustrating an appearance of an information processing apparatus according to an embodiment. The information processing apparatus looks like a notebook-type personal computer, for example, but does not include a hardware keyboard unlike a normal personal computer. The information processing apparatus includes a first display unit 14 and a second unit 12 each including a first display unit 14 and a second display unit 16 each composed of an LCD (liquid crystal display) panel. The first display unit 14 and the second display unit 16 also have a touch panel function. By displaying the keyboard image on the first display unit 14 and the second display unit 16, the first display unit 14 and the second display unit 16 can be used as a software keyboard.

  The first display unit 14 and the second display unit 16 have a lenticular lens for three-dimensional display on the front surface of the LCD panel. The lenticular lens reduces the resolution during two-dimensional display, and the outline of characters and the like may be jagged. In order to prevent this, it is conceivable that an electrode is provided on the lenticular lens and control is performed so as not to produce a lens effect when a predetermined voltage is applied to the electrode. However, a normal lenticular lens may be provided if the resolution of the display unit is high and there is no hindrance to two-dimensional display.

  The second unit 12 is attached to the first unit 10 so as to be rotatable between an open position where the upper surface of the first unit 10 is exposed and a closed position covering the upper surface of the first unit 10. For example, when using the information processing apparatus as a notebook type personal computer, the first display unit 14 of the first unit 10 is used as a software keyboard, and characters and images are displayed only on the second display unit 16 of the second unit 12. Is displayed. Alternatively, when the information processing apparatus is used as an electronic book reader, both the first display unit 14 and the second display unit 16 display characters and images. A power button 20 is provided on the housing of the first unit 12. Two-dimensional / three-dimensional switching buttons 18 and 19 are provided on the housings of the first unit 10 and the second unit 12.

  The information processing unit that is the main unit of the information processing apparatus may be provided in each of the first unit 10 and the second unit 12, or may be provided in only one of them. As an example, FIG. 2 shows information processing units provided in the first unit 10 and the second unit 12, respectively.

  The information processing unit includes a CPU 20, a north bridge 22, a main memory 24, a graphics controller 26, a video memory (VRAM) 28, an LCD 30 (display units 14 and 16 in FIG. 1), a lenticular lens 32 with electrodes, a south bridge 36, and a BIOS. ROM 38, solid state drive (SSD) 40, lens controller 42, acceleration sensor 44, embedded controller / keyboard controller (EC / KBC) 46 (including touch panel controller 48), keyboard (KB) button 50, home button 52, power supply The button 20 (in the case of the information processing unit of the first unit 10) includes 2D / 3D switching buttons 18 and 19, a vibration module 56, and the like. The LCD 30 also includes a touch panel 34.

  The SSD 40 is a storage device that replaces the hard disk device, and the CPU 20 executes an operating system (OS) 24D and application programs loaded from the SSD 40 to the main memory 24. The application programs include a video playback application 24A, a software keyboard application 24B, a character input application 24C, and the like. The video playback application 24A and the software keyboard application 24B include 2D-3D conversion modules 25A and 25B that convert 2D image data into 3D image data.

  The video playback application 24A is software having a function for viewing video content data. The video reproduction application 24A is a live reproduction process for viewing broadcast program data received by a TV tuner (not shown), a recording process for recording the received broadcast program data on the SSD 40, and broadcast program data / video data recorded on the SSD 40. A reproduction process for reproducing the video content data, a reproduction process for reproducing the video content data received via the network, and the like are executed.

  The 2D-3D conversion modules 25A and 25B convert the 2D video included in the video content data into a 3D video in real time in order to view the 3D video.

  The CPU 20 also executes a BIOS (Basic Input / Output System) stored in the BIOS-ROM 38. The BIOS is a program for hardware control.

  The north bridge 22 is a bridge device that connects the local bus of the CPU 20 and the south bridge 36. The north bridge 22 also includes a memory controller that controls access to the main memory 24. The north bridge 22 also has a function of executing communication with the graphics controller 26.

  The graphics controller 26 is a device that controls the first and second display units (LCD 30). A display signal generated by the graphics controller 26 is sent to the LCD 30, and the LCD 30 displays an image based on the display signal. The graphics controller 26 is also connected to the lenticular lens 32.

  The south bridge 36 controls each device on a peripheral component interconnect (PCI) bus and a low pin count (LPC) bus. The south bridge 36 incorporates an IDE (Integrated Drive Electronics) controller for controlling the SSD 40 and a memory controller for controlling access to the BIOS-ROM 38. Further, the south bridge 36 has a function of executing communication with the lens controller 42 and the acceleration sensor 44. The lens controller 42 applies a predetermined voltage to the electrodes of the lenticular lens 32 during two-dimensional display so as not to cause a lens effect.

  The acceleration sensor 44 detects the direction (horizontal state or vertical state) of the first unit 10 and the second unit 12. When the display panel is in a horizontal state, it is difficult to view the image three-dimensionally, so the display of the first display unit 14 and the second display unit 16 is displayed in two dimensions according to the orientation of the first unit 10 and the second unit 12. And a three-dimensional display.

  The embedded controller / keyboard controller 46 is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard buttons 50 on the software keyboard are integrated. The embedded controller / keyboard controller 46 also includes a touch panel controller 48 for controlling the touch panel 34. A home button 52 and a power button 20 are also connected to the embedded controller / keyboard controller 46.

  The vibration module 56 is provided for a haptic feedback function that can be set as an option of the software keyboard function. When this function is on, the vibration module 56 vibrates when any key on the software keyboard is touched. Thereby, the 1st unit 10 and the 2nd unit 12 vibrate at the time of key operation, and the operation feeling of a software keyboard improves. For this reason, the vibration module 56 may be provided in one of the information processing units of the first unit and the second unit.

  FIG. 3 is a block diagram showing the software configuration of the video playback application 24A. The video decoder 62 performs a decoding process on the input 2D video data.

  In the case of two-dimensional display, the video data output from the video decoder 62 is supplied to the renderer 72 via the image quality adjustment unit 78 without passing through the 2D-3D conversion module 25A. In the case of 3D display, the video data output from the video decoder 62 is supplied to the renderer 72 via the 2D-3D conversion module 25A without going through the image quality adjustment unit 78.

  In the 2D-3D conversion module 25A, the IP conversion unit 64 performs IP (interlace / progressive) conversion on the decoded video data, and generates video data in which a shift that is a source of generating a parallax image is corrected. The depth estimation unit 66 uses the corrected video data after IP conversion output from the IP conversion unit 64 to analyze each image frame of the video data, thereby obtaining a depth position for each pixel included in each image frame. Is estimated. For example, the depth estimation unit 66 estimates the depth position for each pixel using a motion between image frames, a difference between pixel values in the image frame, and the like. The disparity vector map generation unit 68 generates a disparity vector map that is binocular disparity with respect to the depth position based on the estimated depth position for each pixel.

  The parallax image generation unit 70 uses the corrected video data after IP conversion output from the IP conversion unit 64 and the parallax vector map output from the parallax vector map generation unit 68 to generate a three-dimensional image at the depth position. A plurality of parallax images having parallax for display are generated. The parallax image generation unit 70 displays two parallax images, a left-eye image and a right-eye image, in the case of glasses-type three-dimensional display, and the number of parallax images corresponding to the number of parallaxes in the case of naked-eye type three-dimensional display. Is generated. The output of the parallax image generation unit 70 is supplied to the renderer 72.

  The image quality adjustment unit 78 executes various image quality adjustment processes. The output of the image quality adjustment unit 78 is also supplied to the renderer 72.

  The renderer 72 performs a drawing process on the output of the parallax image generation unit 70 or the output of the image quality adjustment unit 78. The pixel arrangement conversion unit 74 converts the rendered parallax image into a pixel arrangement for two-dimensional display or three-dimensional display. The display driver 76 performs two-dimensional display processing or three-dimensional display processing based on the output from the pixel arrangement conversion unit 74.

  Here, switching between the two-dimensional display / three-dimensional display processing of the first unit 10 and the second unit 12 will be described.

  First, since the two-dimensional / three-dimensional switching buttons 18 and 19 are provided on the housings of the first unit 10 and the second unit 12, respectively, the display on the first display unit 14 and the second display unit 16 is displayed on the user. Can be arbitrarily switched between 2D display and 3D display, and video viewing that matches the user's preference is realized. Note that the operation member for designating the two-dimensional display / three-dimensional display by the user is not limited to the dedicated buttons 18 and 19, and a key for that purpose may be provided on a software keyboard described later, or a predetermined key operation may be performed. It may be realized by a combination.

  Next, an example of automatically switching to 2D display / 3D display without user setting will be described.

  Two-dimensional display / 3-dimensional display can be switched based on the type of application executed by the information processing units of the first unit 10 and the second unit 12. For example, when an application relating to character editing (for example, a character input application 24C) is being executed, two-dimensional display is selected, and when an application relating to an image (eg, the image reproduction application 24A) is being executed, three-dimensional display is selected. You may be made to do. Alternatively, the two-dimensional display / three-dimensional display can be switched based on the type of content displayed by the information processing units of the first unit 10 and the second unit 12. For example, two-dimensional display may be selected when displaying a still image, and three-dimensional display may be selected when displaying a moving image. This makes it possible to automatically realize optimal video viewing according to the active window application or content type without user settings.

  In the two-screen information processing apparatus shown in FIG. 1, various usage forms are assumed. As in the case of a normal notebook PC, as shown in FIG. 4 (a), when placed on a desk and used in a landscape orientation, the lower display unit 14 is in a horizontal state, and the image can be viewed three-dimensionally. Since the user mainly visually recognizes the upper display unit 16, the lower display unit 14 may be set to two-dimensional display when the acceleration sensor 44 of the lower unit detects a horizontal state. Since the upper display unit 16 is in a substantially vertical state, it is easy to view an image three-dimensionally, and since the user mainly views the upper display unit 16, the acceleration sensor 44 of the upper unit does not detect the horizontal state. The upper display unit may be set to three-dimensional display.

  On the other hand, as shown in FIG. 4 (b), when used in a portrait orientation while being held with both hands, both the display units 14 and 16 are in a substantially vertical state, so that three-dimensional viewing of the video is easy. Since the user visually recognizes both screens, both can be set to three-dimensional display.

  In this way, by switching between 2D display and 3D display according to the horizontal / vertical state detected by the acceleration sensor 44, it is possible to view a video in an optimal display format that suits the usage pattern without the need for user settings. .

  In addition, since the two-screen information processing apparatus does not include a hardware keyboard, it has a software keyboard application 24B for displaying a keyboard on the screen for key input. Software keyboard applications can also display in 3D. Since an image is determined for the software keyboard, it is possible to generate a parallax image in advance, so that the 2D-3D conversion module 25B shown in FIG. 3 can be dispensed with. FIG. 5A shows an example in which the software keyboard is three-dimensionally displayed. In FIG. 4A, the lower display unit 14 displays two-dimensionally. However, since the parallax image of the software keyboard that can be stereoscopically viewed can be created, the display unit that displays the software keyboard is in the detection state of the acceleration sensor 44. Regardless of whether 3D display is set.

  When the software keyboard is displayed three-dimensionally, as shown in FIG. 5B, when the touch panel controller 48 detects that a certain key is touched, the display of the key is switched to the pressed image. By displaying, key input can be displayed in an easy-to-understand manner, and a more realistic operation feeling of the software keyboard can be obtained.

  A tactile feedback function can be set as an option in the software keyboard application. When this function is on, the vibration module 56 vibrates when any key on the software keyboard is touched. Thereby, the first unit 10 and the second unit 12 vibrate when a key is operated, and a more realistic operation feeling of the software keyboard can be obtained. Therefore, when the haptic feedback function and the three-dimensional display function are interlocked and the haptic feedback function of the software keyboard application is set to ON, the software keyboard may be automatically displayed in three dimensions.

  Although some criteria of automatic setting of two-dimensional display and three-dimensional display have been described, not only setting based on any one of these criteria alone, but also two-dimensional based on a combination of these multiple criteria Display and three-dimensional display may be set automatically.

  The above description relates to a two-screen information processing apparatus including separate LCD panels in which the first and second display units are provided in the first and second units, respectively. As shown in FIG. An example in which one display panel of the information processing apparatus is divided into first and second display units according to regions is also possible. FIG. 6 shows the external appearance of an information processing apparatus 92 with a display unit made up of a single LCD panel. As in the case of FIG. 1, the display unit is provided with a lenticular lens with electrodes on the LCD panel and has a touch panel function. The display unit includes two areas 86 and 88, and the areas 86 and 88 correspond to the display units 14 and 16 of FIG. The division of the region is not limited to equal division, and each size may be freely set by an application. The casing of the information processing apparatus 92 is provided with a power switch 93 and two-dimensional / three-dimensional switching buttons 91 and 92. The two-dimensional / three-dimensional switching buttons 91 and 92 are operation members for the user to set display of the display areas 86 and 88. 2 is provided for each of the areas 86 and 88 in the housing of the information processing apparatus 92. However, the acceleration sensor 44 and the vibration module 56 are provided only in one of the information processing units in the areas 86 and 88.

  The operation of the information processing apparatus 92 in FIG. 6 is the same as that of the two-screen information processing apparatus described in FIGS. Also in the embodiment shown in the figure, the 2D / 3D display can be switched by the user's designation using the 2D / 3D switching buttons 91, 92, etc., and video viewing that matches the user's preference is realized. In addition, 2D / 3D display is automatically performed according to the active window application or content type, according to the orientation of the display panel, or according to the tactile feedback function setting of the software keyboard. Can be switched automatically.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof. For example, the number of display units is not limited to two and may be three or more. Although an example in which one application or processing unit corresponds to one display unit has been described, the display by the same application may be partially switched to 2D / 3D display. Moreover, although it demonstrated that the information processing part shown in FIG. 2 was provided for every display part, CPU20, the main memory 24, SSD40, BIOS-ROM38, etc. may be common. Further, in the embodiment of FIG. 1 as well, a modification in which one display panel is divided into first and second display portions by regions as in FIG. 6 is possible. A specific example of the three-dimensional display is not limited to the parallax image method, and any stereoscopic image display method can be applied.

  Note that all the procedures of the video reproduction process of the present embodiment can be executed by software. For this reason, it is possible to easily realize the same effect as that of the present embodiment simply by installing and executing this program on a normal computer through a computer-readable storage medium storing a program for executing the video reproduction processing procedure. Can do.

  14, 16 ... display unit, 18 ... 2D-3D switching button, 24 ... main memory, 24A ... video playback application, 24B ... software keyboard application, 24C ... character input application, 25A, 25B ... 2D-3D conversion module, 44 ... Acceleration sensor 46 ... Embedded controller / keyboard controller 56 ... Vibration module 64 ... IP conversion unit 66 ... Depth estimation unit 68 ... Parallax vector map generation unit 70 ... Parallax image generation unit 72 ... Renderer

Claims (8)

A display unit capable of two-dimensional display or three-dimensional display;
A detector for detecting whether the display unit is in a horizontal state or a vertical state;
Including a function of determining whether or not an application to be executed is a predetermined application, and when the detector detects that the display unit is in a horizontal state, the display unit is set to two-dimensional display, and the predetermined application During the execution of, regardless of the detection result of the detector, the control unit for setting the display unit to three-dimensional display,
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the predetermined application displays a keyboard image three-dimensionally on the display unit and displays the touched key in the keyboard image in a depressed state. The information processing apparatus according to claim 2 , further comprising a vibration module that vibrates when any key in the keyboard image is touched.   The said display part is equipped with the lenticular killer lens which can adjust a lens effect with the applied voltage, and when set to two-dimensional display, the voltage which reduces a lens effect is applied to this lenticular killer lens. Information processing device.   The information processing apparatus according to claim 1, wherein when the detector detects that the display unit is in a vertical state, the control unit sets the display unit to a three-dimensional display. A second display unit capable of two-dimensional display or three-dimensional display;
A second detector for detecting whether the second display unit is in a horizontal state or a vertical state;
Including a function of determining whether or not an application to be executed with respect to the second display unit is a predetermined application, and when the second detector detects that the second display unit is in a horizontal state, When the second display unit is set to two-dimensional display and the application to be executed with respect to the second display unit is the predetermined application , the second display unit is independent of the detection result of the second detector. A second control unit for setting the display unit to three-dimensional display;
The information processing apparatus according to claim 1, further comprising: Detecting whether a display unit capable of two-dimensional display or three-dimensional display is in a horizontal state or a vertical state;
Determining whether or not an application to be executed is a predetermined application, and when the display unit is detected to be in a horizontal state, the display unit is set to a two-dimensional display and displayed while the predetermined application is being executed. Setting the display unit to a three-dimensional display regardless of whether the unit is in a horizontal state or a vertical state;
An information processing method comprising: Computer
A detector for detecting whether a display unit capable of two-dimensional display or three-dimensional display is in a horizontal state or a vertical state;
Including a function of determining whether or not an application to be executed is a predetermined application, and when the detector detects that the display unit is in a horizontal state, the display unit is set to two-dimensional display, and the predetermined application During the execution of, regardless of the detection result of the detector, the control unit for setting the display unit to three-dimensional display,
Program to make it function.

Images