WO2005036469A1

WO2005036469A1 - 3-dimensional display system, data distribution device, terminal device, data processing method, program, and recording medium

Info

Publication number: WO2005036469A1
Application number: PCT/JP2004/012935
Authority: WO
Inventors: Jun Hamachi; Hiroyuki Kanza; Atsushi Ono
Original assignee: Sharp Kabushiki Kaisha
Priority date: 2003-10-08
Filing date: 2004-09-06
Publication date: 2005-04-21
Also published as: JP2005135375A

Abstract

[PROBLEMS] To provide a 3-dimensional display system including a data distribution device for distributing image data assuming 3-dimensional display so as to obtain 3-dimensional display at the terminal device side, wherein the protrusion amount of an area in the image can be modified at the terminal device side. [MEANS FOR SOLVING THE PROBLEMS] The data distribution device distributes first left-eye data, first right-eye data, and single-eye-formatted data in which the protrusion amount is fixed when 3-dimensionally displayed. The terminal device (200) includes: a single-eye image processing unit (222) for generating second left-eye data and second right-eye data from the single-eye-formatted data according to the set protrusion amount; a left-eye image processing unit (224) for combining the first left-eye data and the second left-eye data; and a right-eye image processing unit (225) for combining the first right-eye data and the second right-eye data. The data thus generated is 3-dimensionally displayed on a display unit (250).

Description

Specification

Stereoscopic display system, data distribution device, terminal device, data processing method, program and recording medium

Technical field

The present invention generally relates to a stereoscopic display system for stereoscopically displaying an image, a data distribution device, a terminal device, a data processing method, a program, and a recording medium, and more specifically, to a partial area of an image. The present invention relates to a stereoscopic display system, a data distribution device, a terminal device, a data processing method, a program, and a recording medium, which are improved so that the pop-out amount can be changed on the terminal side.

Background art

[0002] In general, information processing related to images requires a lot of system resources, especially large capacity memory, so it is difficult to perform processing on information terminals such as mobile phones with limited system resources. It may be. In such a situation, the server that transmits the image data performs comparative processing (volume rendering processing) in the image processing, generates two-dimensional image data, and stores the generated image data in information. Patent Literature 1 discloses a video data display client and a video data generation server that transmit data to the terminal and perform relatively light processing (display of received data or polygon rendering) on the information terminal. It has been disclosed.

[0003] On the other hand, various methods for displaying an image in a three-dimensional manner have long been studied, for example, a method using various glasses and a method not using a megane. As a method that does not use glasses, there is a method that uses a parallax between the left and right eyes to show an image in three dimensions (parallax barrier method, lenticular method, etc.). It is now possible to display images stereoscopically even on a computerized information terminal. In view of such circumstances, services for distributing image data assuming three-dimensional display to small and lightweight information terminals have been started (for example, Non-Patent Document 1). Non-Patent Document 1 discloses a service for distributing stereoscopic display image data created in a 3D data format that can be reproduced and displayed on a specific mobile phone. 3D data format of this background technology Since the server has already arranged various objects, the process of displaying them on the terminal side is light. For this reason, it is possible to display a stereoscopic image on an information terminal having a small processing capacity.

Patent Document 1: JP 2002-230578 A

Non-patent document 1: Shigehiro Kawamura, "Hudson, 3D standby image service on the new mobile phone" SH251iS ", [online], November 15, 2002, HUDSON SOFT, [Search August 28, 2003] , <URL:

HYPERLINK "http: //www.mainichi.co.jp/life/hobby/game/news/news/2002/11/15— 3.html http://www.mainichi.co.jp/life/hobby/game /news/news/2002/ll/15-J.html

>

Disclosure of the invention

[0004] However, the technique of Patent Document 1 described above is a technique in a server'client system that performs computer graphic rendering processing such as volume rendering and Z polygon rendering, and uses image data (3D display) for stereoscopic display. Hereinafter, it will not be referred to as “3D data”.) Also, in the technology of Non-Patent Document 1, the pop-out amount of an object when the image is stereoscopically displayed on the terminal side is fixed as a whole, and the terminal device side changes the pop-out amount for a partial area of the image. Had the problem that it was not possible. If the terminal device has a high processing capability, it is possible to execute the change of the pop-out amount even with a slight load of image processing, but in the terminal such as the above-mentioned mobile phone, the capacity of the mountable memory is limited. There is a general requirement that the processing load on the terminal be limited as much as possible.

[0005] The present invention has been made in view of the above-described problems, and in particular, even when a terminal device having a limited system resource such as a memory is used, the terminal pops out of a partial area of an image. An object of the present invention is to provide a stereoscopic display system, a data distribution device, a terminal device, a data processing method, a program, and a recording medium that can change the amount.

[0006] In order to solve the above problems, a stereoscopic display system of the present invention distributes data assuming stereoscopic display in a data distribution device, and acquires the distributed data on a terminal device side, The present invention relates to a three-dimensional display system for three-dimensional display. And the above data The distribution device can change the first left-eye data and the first right-eye data in which the pop-out amount when stereoscopically displayed is fixed, and a format that allows the terminal device to change the pop-out amount. And the terminal device obtains the second data for the left eye and the second data for the right eye according to the set pop-out amount, and obtains the second data for the left eye and the second data for the right eye. The stereoscopic display is characterized by using synthesized data generated by synthesizing the first left-eye data, the second right-eye data, and the first right-eye data.

[0007] According to this configuration, the terminal device can change the pop-out amount for the portion based on the changeable data, so that the pop-out amount can be changed for a partial area of the image.

[0008] It should be noted that image data can be distributed and acquired between the data distribution device and the terminal device while being connected to various wired and wireless networks, such as the Internet and a LAN. . However, the scope of application of the present invention is not limited to this, and the connection between the data distribution device and the terminal device may be a connection other than a network, or may be connected via various recording media in a state where both are connected. This includes the case where data is distributed and obtained by using the Internet. For example, a manufacturer stores and sells image data to be distributed on a recording medium such as a memory stick by using the data distribution apparatus according to the present invention, and a user who purchases the recording medium uses a terminal such as a mobile phone. This is intended to include the case where image data is read into a device and displayed.

[0009] Image data for two-dimensional display can be used as an example of changeable data. A method of acquiring image data for three-dimensional display from image data for two-dimensional display is described in, for example, Japanese Patent Application Laid-Open No. 8-63615. In the terminal device, the second left-eye data and the second right-eye data are generated from the two-dimensional display image data so that the stereoscopic display is performed with the set pop-out amount. Can be. The adjustment of the pop-out amount can be realized by adjusting the horizontal relative distance between the second left-eye data and the second right-eye data.

[0010] Further, with regard to the specific setting of the pop-out amount, means for setting on the terminal device side (methods such as buttons and switches, voice input, and handwritten character input are not particularly limited). It is preferable to provide them from the viewpoint of changing the amount of protrusion on the terminal device side. However, as the initial value, the changeable data includes the information regarding the pop-out amount set above.

In addition, the terminal device can generate the second left-eye data and the second right-eye data with reference to the information included in the changeable data.

[0011] The data distribution device may distribute the first left-eye data and the first right-eye data as independent data, respectively, or the first left-eye data and The first data for the right eye may be distributed as one data in a specific format.

[0012] A data distribution device according to the present invention is a data distribution device for distributing data assuming three-dimensional display, wherein a part of an object included in the data has a fixed amount of projection when stereoscopically displayed. It is characterized in that it is distributed in the left-right binocular format including the data for the eye and the data for the right eye, and the other part is distributed in a format that allows the terminal device to change the pop-out amount. "Distribution" is not limited to transmission in a state where it is connected to a network or the like, but includes storage in a recording medium or the like as described above.

[0013] Further, the data distribution device can also distribute data describing information on the pop-out amount of data in a format in which the pop-out amount can be changed on the terminal device side. In the embodiment of the present invention described below, the specific processing contents to be performed on the distribution device side and the terminal device side, including information on the pop-out amount, are described in a text format called “script”, and are combined with the 3D data. The information on the contents of processing, etc., to be transmitted is not limited to the text format and may be in other formats.

[0014] The data distribution device may further include means for making an inquiry to the terminal device, performing matching, and changing the type of data to be distributed to the terminal device based on a result of the inquiry and matching.

[0015] A terminal device according to the present invention relates to a terminal device that acquires data assuming stereoscopic display and processes the data. Then, as the data assuming the stereoscopic display, the terminal device includes, for some of the objects included in the data, the first left-eye data having a fixed amount of pop-out when stereoscopically displayed and the first left-eye data. The right and left binocular format including the data for the right eye, and for other parts, the pop-out amount can be changed on the terminal device side. From the first data acquisition means for acquiring data in a usable format and the data in a format in which the pop-out amount can be changed on the terminal device side, according to the set pop-out amount.

Second data acquisition means for acquiring the second left-eye data and the second right-eye data, the first left-eye data, the second left-eye data, and the first right-eye data. And synthesizing means for synthesizing the data for the right eye and the data for the second right eye, respectively.

Here, the first data obtaining means obtains image data for two-dimensional display as data in a format in which the pop-out amount can be changed on the terminal device side. The second acquisition unit is configured to generate, from the image data for two-dimensional display, second left-eye data and second right-eye data so as to be stereoscopically displayed with a set pop-out amount. Includes parts. Since the amount of image data for two-dimensional display is small, it is suitable for reducing the load on the network. However, when it is not necessary to consider the load on the network (particularly when distribution is performed via a recording medium, etc.), if the data is in a format that allows the amount of pop-out to be changed on the terminal device side, it is regarded as changeable data. However, the present invention is not limited to the two-dimensional display data.

[0017] Preferably, the data obtained by the first obtaining unit includes information for setting a pop-out amount of data in a format in which the pop-out amount can be changed on the terminal device side, The terminal device may include extraction means for extracting information for setting the pop-out amount from the data acquired by the first acquisition means. However, as described above, it is also possible to provide a pop-out amount setting means on the terminal device side, and when the setting means power and the pop-out amount are not set, the distribution device power also includes the pop-out amount included in the distributed data. Can be performed according to the following.

Note that the terminal device according to the present invention may include a display unit for displaying an image in a three-dimensional manner by using the data combined by the combining unit, but the display unit may be provided separately.

In the data processing method according to the present invention, first, on the side that distributes data assuming stereoscopic display, the first left-eye data in which the amount of projection when stereoscopic display is fixed is fixed. And the first right-eye data and a format that allows the terminal device to change the pop-out amount Deliver modifiable data. Then, on the side that has acquired the distributed data, a setting step of setting the pop-out amount, and acquiring the changeable data force second left-eye data and second right-eye data in accordance with the set pop-out amount And a combining step of combining the second left-eye data and the first left-eye data, and the second right-eye data and the first right-eye data, respectively.

[0020] A first program according to the present invention provides a computer with a process for acquiring first left-eye data and first right-eye data having a fixed amount of pop-out, and image data for two-dimensional display. Generating second left-eye data and second right-eye data from the first data, the first left-eye data and the second left-eye data, and the first right-eye data. A combining process for combining the data with the second right-eye data, the third left-eye data and the third right-eye data obtained by the combining process, and image data for two-dimensional display. And 3D data generation processing for generating data assuming stereoscopic display. This program implements the functions of the data distribution device.

[0021] A second program according to the present invention provides a computer with a process of acquiring first left-eye data and first right-eye data having a fixed amount of pop-out, and an image data for two-dimensional display. A second left-eye data and a second right-eye data from the two-dimensional display image data based on the acquired pop-out amount and the acquired pop-out amount. A process of generating data, and a combining process of combining the first left-eye data and the second left-eye data, and the first right-eye data and the second right-eye data, respectively. Are executed. This program is a program that implements the functions of the terminal device according to the present invention.

Further, a recording medium according to the present invention is characterized by recording any one of the first and second programs according to the present invention.

According to the stereoscopic display system of the present invention, the data distributed from the data distribution device includes the first left-eye data and the first right-eye data in which the pop-out amount at the time of stereoscopic display is fixed. Data and changeable data in a format that allows the amount of pop-out to be changed on the terminal device side. Then, the terminal device obtains the changeable data force second left-eye data and second right-eye data according to the pop-out amount set by the terminal device, and further obtains the data. Then, the second left-eye data and the first left-eye data, and the second right-eye data and the first right-eye data are respectively synthesized, and a stereoscopic image is generated using the generated synthesized data. Display. As a result, there is an effect that it is possible for the terminal device to change the pop-out amount for a portion based on the changeable data, that is, for a part of the image.

Brief Description of Drawings

FIG. 1 is a diagram illustrating an overall configuration of a stereoscopic image stereoscopic display system according to a first embodiment.

FIG. 2 is a functional block diagram for describing a configuration of server 100.

FIG. 3 is a functional block diagram for describing a configuration of terminal device 200.

FIG. 4 is a diagram showing an example of the contents of a script.

FIG. 5 is a diagram showing a description of each tag of XML describing a script in the first embodiment.

FIG. 6 is a flowchart for explaining processing contents on the server 100 side.

FIG. 7 is a diagram for explaining a process of arranging binocular format data on the server 100 side.

FIG. 8 is a diagram for explaining a process of arranging monocular format data on a server 100 side.

FIG. 9 is a flowchart for explaining processing on the terminal device 200 side.

FIG. 10 is a diagram for explaining specific processing contents on the terminal device 200 side.

FIG. 11 is a diagram showing an application example of the present invention on the WWW according to the second embodiment.

FIG. 12 is a diagram showing an example of an extended HTML according to the second embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

Example 1

(1) Overall Configuration of Stereoscopic Display System

FIG. 1 is a diagram showing an overall configuration of a stereoscopic image stereoscopic display system according to Embodiment 1 of the present invention. The stereoscopic display system of the present embodiment includes an image data script storage unit 110. The server 100 as a data distribution device for distributing 3D data and the terminal device 200 having a display unit for displaying image data distributed from the server 100 are connected to the Internet. Connected via a network 300 such as The image data script storage unit 110 stores image data (image data based on the distributed 3D data) composed of each object assuming three-dimensional display and how to process the image data. “Object placement description script” (hereinafter, also simply referred to as “script”) in which is described. At least a part of the image data can be stereoscopically displayed as it is, but the amount of protrusion of the object included in the image is fixed. Another part of the image data is stored in the form of two-dimensional display data as data in a format in which the pop-out amount can be changed on the terminal device 200 side. The server 100 performs processing for arranging image data, generates 3D data to be distributed, and distributes the generated 3D data to the terminal device 200.

[0027] (2) Configuration of server 100

FIG. 2 is a functional block diagram for describing the configuration of server 100.

[0029] As described above, the image data script storage unit 110 stores the image data and the script composed of the respective objects. Among the image data, there are left-eye data and right-eye data for stereoscopic display (both are referred to as “left and right binocular format data”). When data in a binocular format are prepared, data for two-dimensional display (hereinafter, data in a “monocular format”) is included.

[0030] In the present embodiment, image data as acquired using, for example, a stereo camera is assumed as the data in the left-right binocular format. Normally, only data in the left-right binocular format is used for stereoscopic display. Cannot change the pop-out amount of each object. However, in the stereoscopic display system of the present embodiment, in addition to data in a format in which the pop-out amount can be changed (data in which monocular format data is converted to a format capable of stereoscopic display, data in left and right binocular formats, Includes data in a format in which the amount of protrusion can be changed by changing the horizontal relative distance of the data corresponding to the eyes, etc. (hereinafter also referred to as “changeable data”) in the 3D data. By performing synthesis processing of the data of the left and right binocular format with fixed pop-out amount and changeable data, it is possible to change the pop-out amount with respect to a partial area of the image on the terminal device side. It is possible. The server 100 of this embodiment performs various processes for generating 3D data, including a data separation processing unit 121, a monocular image arrangement processing unit 122, and a binocular image arrangement processing unit 123. . Each of these processing units may be actually realized by running a program on a processor such as a CPU, or may perform processing using dedicated hardware. The data separation processing unit 121 acquires the image data and the script from the image data object storage unit 110, and performs the separation processing of the image data according to the contents of the script. The contents of the script will be described later in detail. If the data included in the 3D data is monocular data, it is sent to the monocular image arrangement processing unit 122, and if it is data of the left and right binocular formats, it is sent to the binocular image arrangement processing unit 123. The data separation processing unit 121 performs processing with reference to a script. The script 124 is also transmitted to the terminal device 200 via the output control unit 125 and the network 300 together with the 3D data for which the arrangement processing has been completed. More detailed contents of the arrangement processing for the data in the monocular format and the data in the left-right binocular format executed by the server 100 will be described later.

(3) Configuration of Terminal Device 200

Next, the configuration of the terminal device 200 will be described. FIG. 3 is a functional block diagram illustrating a configuration of the terminal device 200 according to the present embodiment. The terminal device 200 includes a display unit 250 capable of stereoscopic display, and a display control unit 240 for controlling display on the display unit 250, and a data separation unit for processing 3D data distributed from the server 100 side. The image processing apparatus includes a unit 221, a monocular image processing unit 222, a parallax adjusting unit 223, a left eye image processing unit 224, and a right eye image processing unit 225. The terminal device 200 acquires the 3D data and the script to which the power of the server 100 is also distributed, via the input control unit 226 via the network 300 such as the Internet.

[0034] The data separation unit 221 separates the distributed data into the script 227, data in the left-right binocular format, and data in the monocular format. In the present embodiment, basically, no processing is performed on the left and right binocular format data in the distributed 3D data on the terminal device 200 side, and the data in the left and right binocular format is a monocular image. It is the subject of synthesis processing with the left-eye data and right-eye data generated from the data. The monocular image processing unit 222 converts the received monocular format data into a format that can be displayed three-dimensionally with reference to the contents of the script 227, and also sets the parallax information (the amount of pop-out is input) via the parallax adjustment unit 223. Information) , And generates left-eye data and right-eye data that are stereoscopically displayed with the specified pop-out amount. Note that the parallax adjustment unit 223 holds information indicating the pop-out amount input by the user via various input devices such as buttons and switches.

[0035] The left-eye image processing unit 224 and the right-eye image processing unit 225 refer to the contents of the script 227 and execute the first left-eye and right-eye binocular data included in the distributed 3D data. The ophthalmic data and the first right-eye data are combined with the monocular-format data force generated second left-eye data and the second right-eye data, respectively, and the final left-eye data is synthesized. Eye data and right-eye data are generated and sent to the display control unit 240. By displaying the transmitted data on the display unit 250, the user can see a stereoscopically displayed image. In the displayed image, the pop-out amount of a part of the image (in this embodiment, the area transmitted in the monocular format) was adjusted based on the pop-out amount set on the terminal device 200 side. It becomes an image.

(4) Object placement description script! / Pote

Here, more specific contents of the script will be described. The script includes information necessary for processing of arranging each object on the server 100 side, processing of monocular format data on the terminal device 200 side, synthesizing processing of left-eye data and right-eye data, and the like. Is described. FIG. 4 shows an example of the contents of the script. In this embodiment, the script is described in XML (Extensible Markup Language) format (see line 00). Hereinafter, the script will be described with reference to the description of each tag shown in FIG.

[0038] The script <obj-rend> (see line 01) is the root element of the script of this embodiment. There is ku data> as a child element of ku obj-rend>. The description on the data transmitted in the left-right binocular format when transmitted from the server 100 is also described in the power on the 02th line by the 16th line. These data are described as a “mode” attribute on the 02th line indicating that the data is in the left-right binocular format.

[0039] In line 05, the object information is described as a child element of each data information element data>object>object> by line 12, and three objects of image information are described in this object. It is written (line 06 to line 11). These three pieces of image information are used by the server 100 to generate image data in the left-right binocular format. Information. Lines 07 and 09 describe information about data originally in the left-right binocular format (for example, image data obtained using a stereo camera or the like). The description on line 07 (type = "left") relates to the data for the left eye, and offset-x and offset-y are the cutout positions when cutting out the filemap image specified by "name". (See Figure 5). “Width” and “height” are information indicating the width and height of the region to be cut out (see FIG. 5). The left-eye data and right-eye data may be used by cutting out the same position from different files as shown in the example in Fig. 4, or by cutting out different areas of the same file and using the left and right binocular format. In some cases. It is also conceivable to cut out another area of another file. The script can flexibly define the processing when generating data in the left and right binocular format from the image file card.

The eleventh line describes information on the data for the left eye and the data for the right eye and the data of the monocular format synthesized on the server 100 side. In this row, disparity information ("parallax") is defined in addition to the information indicating the above-described cutout area, and the server 100 generates the information and the image data in the left-right binocular format. In the conversion process from the monocular format to the left and right binocular format, for example, the method described in JP-A-8-63615 can be applied. The left-eye data and the right-eye data are combined from the left-right binocular format data obtained by the conversion with a horizontal relative distance such that the pop-out amount indicated by the parallax attribute is obtained. The left and right binocular format data to be finally distributed is generated. In this embodiment, the terminal device 200 does not change the pop-out amount for this data.

The description (option) on the fifteenth line is information that is referred to when the terminal device 200 performs the image combining process. The data information (data>) needs to be described by the number of data distributed from the server 100 to the terminal device 200. In the example of FIG. 4, in addition to the data of the left and right binocular format described above, In the following, monocular format data (corresponding to an area where the amount of pop-out can be changed on the side of the terminal device 200) described below is distributed, and image compositing processing is performed on the side of the terminal device 200 as described later. Is The position of the superimposition ("X" and "y") at that time and information ("priority") indicating which area is to be arranged in front are described as option>. [0042] The 17th line of the script in Fig. 4 also describes the monocular format data included in the 3D data up to the 28th line. On the 21st and 22nd lines, two image files are defined, and the server 100 combines these two images to generate one monocular data. Since the meaning of each parameter has already been described, the description is omitted here.

On the 27th line, the "parallax" attribute is described as <option>! This is the initial pop-out amount at the time of conversion to the left-right binocular format on the terminal device side. If the pop-out amount is not set in the parallax adjustment unit 223 of the terminal device 200, this attribute Is performed according to the following.

(5) Processing on the server 100 side

Next, specific processing contents on the server 100 side in the present embodiment will be described. As described above, the server 100 performs processing of arranging image data while referring to the contents of the script to generate 3D data, and transmits the generated 3D data to the terminal device 200 side. FIG. 6 is a flowchart for explaining the processing content on the side of the laser 100. The server 100 first reads the script (S101), and then reads the first image data (in the example of the script in FIG. 4, the file name “i001.png”) (S102). Furthermore, as a result of referring to the contents of the script, if the read image data is to be arranged in the left and right binocular format (S103: YES), the arrangement process is performed in the left and right binocular format (S104). . In the example of FIG. 4, it is determined which to proceed with reference to the “mode” attribute of the data> element. Here, the arrangement processing in the left and right binocular format will be described first.

FIG. 7 is a diagram for explaining an object arranging process in the left-right binocular format. In the example of the script in Fig. 4, the file names “i001.png”, “i002.png”, and “i003. This is monocular data. First, the object is cut out from the image file according to the description of the script, and the data of the monocular format is further converted to the left and right binocular format.

Next, the data in the left and right binocular format obtained by conversion from the data in the monocular format and the data in the left and right binocular format for which the original force is also prepared (file names “i001.png”, “i002. png " ). During this synthesis processing, the value of the parallax attribute specified for the file name “i003.png” is referenced. The layout processing of the left and right binocular format as described above (S104) 1S <data> element is defined as the "mode" attribute (mode = "3d"). The left and right binocular data that is distributed in the 3D data is generated.

[0047] If the image data read in step S102 is not the target of the left-right binocular layout processing (S103: NO), specifically, the "mode" attribute of the data> element (m If the file is defined as ode = “2d”), the layout processing is performed in the monocular format (S105). FIG. 8 is a diagram for explaining the arrangement processing in the monocular format. In the example script shown in Fig. 4, two images with the final name “i004.pngj (star)” and “i005.png” (month) are subject to the monocular layout processing. In the same way as in the method, clipping and synthesizing are performed to generate monocular format data that is distributed in 3D data. The "priority" attribute is referred to which one is to be placed in front.

[0048] When the processing is completed for all the files described in the above-described arrangement processing power script (S106: YES), the finally generated 3D data (data in the left-right binocular format and data in the monocular format) is output. Is transmitted to the terminal device 200 side (S107).

Note that the server distributes the first left-eye data and the first right-eye data included in the data of the left-right binocular format to the terminal device 200 as independent data. Alternatively, the first left-eye data and the first right-eye data may be distributed as one data in a specific format. In other words, the server may transmit the data in the left and right binocular format in two files, or may transmit the data in one file in a specific format.

[0050] Also, in the above-described arrangement processing in the monocular format, when there are two or more data in the monocular format to be arranged, and when the sizes of the extracted images are all the same, there is no problem!

When the 1S sizes are different, it is important to determine where to overlap. The staribut according to the present embodiment does not hold a parameter indicating the reference in this case. However, for example, the arrangement processing is performed such that predetermined reference points such as an upper left corner, an upper right corner, and a center point are overlapped. It is possible to deal with it, and configure the script to retain the coordinates of the reference point. A little.

[0051] (6) Processing contents on the terminal device 200 side

Next, the content of the processing on the terminal device 200 side that has received the 3D data will be described. FIG. 9 is a flowchart for explaining the processing content on the terminal device 200 side.

[0053] The terminal device 200 receives the script and the 3D data transmitted from the server 100.

(S201), the image data is also sequentially extracted from the 3D data (S202). Here, what is extracted is the number specified in the data> element. In the example of the script in FIG. 4, the data in the left and right binocular format of “id =“ 001 ”” and “id = The monocular format data of "002" is sequentially extracted. FIG. 10 is a diagram for explaining specific processing contents for sequentially extracted data.

[0054] Referring to the contents of the script, if the extracted data is monocular data (S203: YES), a process of converting the data into monocular format data and data in left and right binocular formats is performed. Specifically, information on monocular format data, in particular, the content of “option” is read from the script (S204), and conversion processing to the left and right binocular format is performed (S205). At this time, if the pop-out amount is set in the parallax adjustment unit 223, the conversion process is performed based on the set pop-out amount, and if not, the script (line 27 in the example of FIG. 4). ), The conversion process is performed based on the pop-out amount specified as the “parallax” attribute.

[0055] The left-right binocular format data generated on the terminal device 200 side from the monocular format data is temporarily stored in a memory (FIG. 3) in preparation for a combining process with the left-right binocular format data distributed from the server 100 side. (Not shown) (S206), and when the processing is completed for all data (S207: YES), information on image composition is read from the script (S208). In the present embodiment, the left and right binocular data to which the power of the server 100 is also distributed are not processed (S203: NO), and are generated from the monocular data on the terminal device 200 side. It is the subject of synthesis processing with left and right binocular format data. In step S208, in the example of the script in FIG. 4, the information (“X” and “y”) of the “option” element described on the 15th and 27th lines, particularly ) And the “priority” attribute.

The data distributed based on the read information and the data generated on the terminal device 200 side are combined (left-eye image processing unit 224 and right-eye image processing unit 225), and the final left eye Data and right eye data are generated (S209). By displaying the generated data on the display unit 250, an image is stereoscopically displayed (S210). In the displayed image, the terminal device 200 also converts the monocular power to the amount of projection of a part displayed in three dimensions, that is, the amount of projection of a part of the image. The terminal device 200 or a script (in the example of FIG. 4) The amount of protrusion is specified in (27th line).

Example 2

In the present embodiment, an application example of the present invention in a WWW (World Wide Web) will be described.

Referring to FIG. 11, extended WWW server 21 checks the user agent in response to a data request from WWW browsers 29 and 30 running on the terminal, and determines in WW WWW browser 29 and Determines whether 30 is a powerful 3D extended browser.

When the WWW server 21 determines that the WWW browser 29 is a 3D-extended WWW browser, the WWW server 21 responds to the request by the terminal by requesting the “first left-eye data and right-eye data” that are 3D-extended data. The data 22 ”, the“ monocular format data 25 ”of which the pop-out amount can be changed, and the“ page data 26 in 3D extended version HTML ”are transmitted to the corresponding terminal via the network 28.

[0060] The "3D extended WWW browser 29" on the terminal receiving the data parses and renders "page data 26 in 3D extended version HTML". That is, the server 21 receives the “first left-eye data and right-eye data 22” distributed, and the client (browser) combines the first left-eye data and right-eye data 22 respectively. The generated composite data is displayed in 3D as indicated by reference symbol A. The client (browser) also receives the “monocular format data 25” distributed from the server 21 and combines the second left-eye data and right-eye data, respectively. Display in 3D as shown. Furthermore, part of the “page data 26 in 3D extended version HTML” distributed from the server 21 is used as text data, and the client (browser) combines the second left-eye data and right-eye data, respectively, The generated composite data is displayed in 3D as indicated by reference numeral C.

[0061] On the other hand, when the WWW server 21 determines that the WWW browser 30 is a normal browser, the WWW server 21 responds to the request for terminal power in a normal display format (such as CiPEG, GIF, or PNG). `` Normal data 23 '', `` Monocular format data 25 '', `` Normal HTML page data 27 '' that can be displayed with ordinary browsers such as MS Internet Explorer, Mozilla, Opera, etc. Is transmitted to the corresponding terminal via the network 28.

[0062] The ordinary browser 30 on the terminal that has received the data parses the "normal HTML base data 27", renders it, and performs normal (2D) display as indicated by the reference numeral D.

Next, an example of the extended HTML will be described.

[0064] Referring to Fig. 12, the html> tag on line 01 indicates that the script is an HTML script

[0065] The head> tag on line 02 and line 04 indicates header information. The title name of this HTML is specified by the title> tag in the header information.

[0066] The body> tag on the 05th line indicates that it is the body text thereafter.

[0067] The object> tag on the seventh line indicates that mime-type data of "left and right binocular format" of "image3DZ3di" "img-datal.3di〃 is displayed in 3D. The "image3D / 3di" of type e is just an example and is not particularly distributed!

[0068] In the ex—3D—object> tag on the 11th line, “img—dat a2.png” is specified as “monocular format” data, and this is the 3D data with the pop-out amount specified by the attribute “parallax” Is displayed as.

[0069] In the ex- 3D-text> tag on the 14th line, the text enclosed by the tag is displayed in 3D with the amount of protrusion specified by the attribute "paral lax".

[0070] The <body> tag on the 16th line indicates the end of the body.

[0071] The Zhtml> tag on the 17th line indicates the end of the HTML script.

Although the present invention has been described based on the embodiments, the following modified examples can be considered.

(Modification)

[0074] (1) In the embodiment described above, the power of the server 100 is also included in a part of the 3D data to be distributed. Including the monocular format data, the terminal device 200 generates the left and right binocular format data from the monocular format data on the side of the monocular format data. By adjusting the relative distance in the direction, the amount of protrusion of a part of the image is changed. However, when it is not necessary to consider the network load, for example, when the data distribution device stores 3D data on a recording medium and the terminal device reads 3D data from the recording medium, the monocular format is used. Not only the data but also the data of the left-right binocular format that can change the pop-out amount on the terminal device side may be used. In addition, any format of data can be used as long as the terminal device can change the pop-out amount. That is, the data to be distributed is not limited to image data. For example, if the data is text, it is also possible to use a character code or the like. On the terminal device side, it is possible to change the pop-out amount by developing the code into an image, converting it into a binocular format, and adjusting the relative distance in the horizontal direction.

(2) In the above-described stereoscopic display system, the processing of the single-eye format data as the processing on the server 100 side is performed between the generated left-right binocular format data and the originally prepared left-right binocular format data. In a general-purpose information processing terminal equipped with a display device such as a liquid crystal display device as a combination process, a distribution process of generated data, and a process on the terminal device 200 side, both left and right based on the set pop-out amount. The processing including the processing of generating eye format data and the processing of synthesizing images can also be realized by operating a program that causes a processor to execute these processings on a processor such as a CPU. In such a case, the server 100 and the terminal device 200 store, for example, a program storage unit that stores the above-described program, a memory that reads out the program and temporarily stores the program, and a program that is stored in the memory. An executing processor is provided. Software including such a program may be sold in a state recorded on a computer-readable recording medium such as a flexible disk or a CD-ROM, or may be sold on a wired or wired network including a network such as the Internet. In some cases, it is supplied to a computer held by the user via a wireless transmission medium.

Note that the recording medium on which the program is recorded is a recording medium that is configured to be separable from the apparatus main body that can read software from the recording medium. Tapes such as magnetic tapes and cassette tapes, magnetic disks such as flexible disks and hard disks, and disk systems for optical disks such as CD-ROMZMOZMDZDVD, IC cards (including memory cards) Cards such as Z-optical cards, or mask ROMs Any medium such as a fixed memory, including a semiconductor memory such as an EEPROM, an EPROM, an EEPROM, and a flash ROM may be used.

Further, the program of the present invention supplied via the recording medium and the transmission medium as described above does not necessarily include all programs for realizing the stereoscopic display system of the present invention. ) And other general-purpose software, as appropriate, as well as the case of realization using dedicated hardware.

[0077] The embodiments disclosed this time are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

Industrial applicability

The present invention can be applied to, for example, a stereoscopic display system or the like that distributes image data assumed to be stereoscopically displayed in a data distribution device and stereoscopically displays the image data on the terminal device side.

Claims

The scope of the claims

[1] In a three-dimensional display system that distributes data assuming three-dimensional display in a data distribution device, acquires the distributed data on a terminal device side, and performs three-dimensional display, the data distribution device performs The first data for the left eye and the first data for the right eye in which the pop-out amount is fixed, and changeable data in a format that allows the terminal device to change the pop-out amount, and

The terminal device obtains second left-eye data and second right-eye data from the changeable data in accordance with the set pop-out amount, and acquires the second left-eye data and the first left-eye data. Stereoscopic display using synthesized data generated by synthesizing the data for use, the second right-eye data, and the first right-eye data, respectively.

[2] The stereoscopic display system according to claim 1, wherein

The changeable data is image data for two-dimensional display,

In the terminal device, the second left-eye data and the second right-eye data are displayed from the two-dimensional display image data so as to be stereoscopically displayed at the set pop-out amount. Generate.

[3] The stereoscopic display system according to claim 2, wherein

The changeable data includes information on the set pop-out amount, and the terminal device refers to the information included in the changeable data, and refers to the second left-eye data and the second right-eye data. Generate data.

[4] The stereoscopic display system according to claim 1,

The data distribution device distributes the first left-eye data and the first right-eye data as independent data, respectively, or the first left-eye data and the first right-eye data. Distribute data as a single data in a specific format.

[5] A data distribution device that distributes data assuming three-dimensional display!

Some of the objects included in the data are delivered in a left-right binocular format including left-eye data and right-eye data with a fixed amount of pop-out when displayed in 3D. In addition, the terminal device is characterized in that the terminal device is distributed in a format in which the pop-out amount can be changed.

[6] The data distribution device according to claim 5,

The data distribution device further distributes data describing information relating to the pop-out amount of data in a format in which the pop-out amount can be changed on the terminal device side.

[7] The data distribution device according to claim 5,

The data distribution device further includes means for making an inquiry to the terminal device and changing a type of data to be distributed to the terminal device based on a result of the inquiry.

[8] In a terminal device that acquires data assuming a stereoscopic display and processes the data, a part of an object included in the data as the data assuming the stereoscopic display is displayed as a stereoscopic display. Is a left-right binocular format that includes the first left-eye data and the first right-eye data in which the pop-out amount is fixed. For other parts, the pop-out amount is changed on the terminal device side. A first data acquisition means for acquiring data in a format capable of

Second data acquisition for acquiring second left-eye data and second right-eye data in accordance with the set pop-out amount from data in a format in which the pop-out amount can be changed on the terminal device side Means,

A synthesizing means for synthesizing the first left-eye data, the second left-eye data, the first right-eye data, and the second right-eye data.

[9] The terminal device according to claim 8, wherein

The first data acquisition means acquires image data for two-dimensional display as data in a format in which the amount of pop-out can be changed on the terminal device side,

The second data acquisition means is configured to display the second left-eye data and the second right-eye data such that the two-dimensional display image data is stereoscopically displayed at the set pop-out amount. A generation unit for generating data is included.

[10] The terminal device according to claim 8, wherein

The data obtained by the first data obtaining means includes information for setting a pop-out amount of data in a format in which the pop-out amount can be changed on the terminal device side. The terminal device includes an extracting unit that extracts information for setting the pop-out amount from the data acquired by the first data acquiring unit.

[11] The terminal device according to claim 8, wherein

The terminal device includes a pop-out amount setting unit that sets a pop-out amount of data in a format in which the pop-out amount can be changed on the terminal device side.

[12] The terminal device according to claim 8, wherein

A display unit for displaying an image in a three-dimensional manner based on the data synthesized by the synthesizing unit.

[13] On the side that distributes data that assumes stereoscopic display,

The first data for the left eye and the first data for the right eye, in which the pop-out amount in stereoscopic display is fixed, and the changeable data in a format in which the pop-out amount can be changed on the terminal device side are distributed. ,

On the side that acquired the distributed data,

A setting step for setting a pop-out amount;

An obtaining step of obtaining second left-eye data and second right-eye data from the changeable data according to the set pop-out amount;

Performing a synthesizing step of synthesizing the second left-eye data and the first left-eye data, and the second right-eye data and the first right-eye data, respectively. Data processing method.

[14] On the computer,

A process of acquiring first left-eye data and first right-eye data having a fixed pop-out amount;

A process of generating second left-eye data and second right-eye data from the two-dimensional display image data;

A combining process of combining the first left-eye data and the second left-eye data, and the first right-eye data and the second right-eye data, respectively.

3D data for generating data assuming a three-dimensional display by combining the third left-eye data and the third right-eye data obtained by the combining process and image data for two-dimensional display A program that executes a generation process.

[15] On the computer,

A process of acquiring image data for two-dimensional display,

A process of acquiring the set pop-out amount,

A process of generating second left-eye data and second right-eye data from the two-dimensional display image data based on the acquired pop-out amount;

A program for executing a combining process of combining the first left-eye data and the second left-eye data, and the first right-eye data and the second right-eye data, respectively.

[16] A computer-readable recording medium on which the program according to claim 14 is recorded.