KR101314601B1 - apparatus for transmitting contents, apparatus for outputting contents, method for transmitting contents and method for outputting contents - Google Patents

Abstract

The present invention relates to a content delivery device, a content presentation device, a content delivery method, and a content presentation method. According to the present invention, the 3D image and the 2D image can be displayed together on the screen, and only a portion of the screen where the 3D image is located can be activated to enable the user to view both images simultaneously by activating a barrier panel for the 3D image. have. On the contrary, when the barrier panel is activated on the entire screen to display the 3D image, the barrier panel is deactivated only in the portion where the 2D image is located so that the 3D image is visible only where the 3D image is located and the plane image is positioned. The place can make the two-dimensional image visible. Therefore, the line of sight of the portion where the three-dimensional image is located can be focused, and the three-dimensional image can be seen more vividly than the two-dimensional image.

Stereoscopic 3D 3D barrier binocular object image

Description

Apparatus for transmitting contents, apparatus for outputting contents, method for transmitting contents and method for outputting contents}

1 is a conceptual diagram in which a three-dimensional image on the screen is expressed as two two-dimensional images

FIG. 2 is a plan view illustrating the image display conceptual diagram of FIG. 1.

3 is a diagram for describing in depth information when a stereoscopic image is recognized through a screen;

4 is a flowchart illustrating an embodiment of an image transmission method according to the present invention.

5 is a flowchart illustrating another embodiment of an image transmission method according to the present invention.

6 is a diagram illustrating an example of a structure of an image object when transmitting an image according to an embodiment of the image transmitting method according to the present invention.

7 is a flowchart illustrating still another embodiment of the image transmitting method according to FIG. 6.

8 is a flowchart illustrating an embodiment of an image receiving method according to the present invention.

9 is a flowchart illustrating another embodiment of an image receiving method according to the present invention.

10 is a flowchart illustrating still another embodiment of an image receiving method according to the present invention.

11 is a diagram illustrating a process of obtaining an image object from an MPEG-2 TS format signal including a BIFS format signal for transmitting and receiving an image object.

12 illustrates an embodiment of an image transmitting apparatus according to the present invention.

13 illustrates an embodiment of an image receiving apparatus according to the present invention.

The present invention relates to an image transmission and reception method and an image transmission and reception apparatus, and more particularly, to an image transmission and reception method and an image transmission and reception apparatus capable of expressing a realistic and lively image to focus the gaze of an image receiver.

When transmitting and receiving a conventional image over a wired or wireless network, a two-dimensional image is compressed and transmitted, and the compressed two-dimensional image is restored to display a two-dimensional image that is visually identical to the two-dimensional image. However, the expressed two-dimensional image is not realistic because it is expressed in a plane, and there is a problem that the viewer of the image does not deliver a special three-dimensional feeling beyond the plane.

In order to express more realistic images, various methods of constructing a 3D image, compressing it, and transmitting the same have been devised. Unlike two-dimensional images, three-dimensional images can add more liveliness or realism to focus the viewer's attention. However, the 3D image may not only have a limitation in transmission bandwidth, but may also be inconvenient when the receiver views only the 3D image even when the 3D image is transmitted to overcome the limitation. For example, when the image to be displayed is a three-dimensional image, the viewer of the image feels all the images as a three-dimensional image, and thus, when the text and the like are displayed on the screen, the text may not be properly recognized. Since the text must be expressed in two dimensions, the meaning transfer function is more clear. When the text is viewed through the three-dimensional image, it may be inconvenient to recognize the text and the resolution may be low.

That is, even if the 3D image and the 2D image are simultaneously displayed, the displayed image may be viewed as a 3D image or only as a 2D image to the receiver.

The present invention is to solve the above problems and to express and transmit and display an image in a new way, an object of the present invention is to provide an image transmission and reception method and an image transmission and reception apparatus that can focus the gaze of the image receiver.

Another object of the present invention is to provide an image transmitting / receiving method and an image transmitting / receiving apparatus capable of displaying a three-dimensional and realistic image.

It is still another object of the present invention to provide an image transmission / reception method and an image transmission / reception apparatus for displaying a two-dimensional image and a three-dimensional image on a single screen.

In order to achieve the above object, the present invention includes generating depth map information for the 2D image and the 2D image, and multiplexing depth map information for the 2D image and the 2D image. And converting the two-dimensional image and the converted form of data into a transmission data form.

In another aspect, the present invention means that a pair of image objects capable of displaying a 3D image, a 2D image object, and a pair of image objects are a pair of image objects capable of displaying a 3D image. Generating dimension information and location information on the screen of the image objects, converting the generated image objects and the location information into a signal format for image transmission, and transmitting the converted format signal. It provides an image transmission method comprising the step.

In still another aspect, the present invention provides an image receiving method for displaying an image through a barrier panel on a screen, comprising: image objects including a 3D image object and an object description including position information of the 3D image object Receiving information, generating a right image object and a left image object for generating a 3D image from the received 3D image object, synthesizing the generated image object pixel by pixel, and And activating only a barrier corresponding to a position on a screen according to the position information included in the object description information among the barriers to display the synthesized image.

In still another aspect, the present invention provides an image receiving method for displaying an image through a barrier panel on a screen, comprising: receiving a signal including a two-dimensional image and depth map information of the two-dimensional image; Obtaining the 2D image and the depth map information from the received signal, generating a left image and a right image for displaying a 3D image using the 2D image and the depth map information, and generating the generated image. Comprising the step of synthesizing the pixel by pixel and the image receiving method for activating the barrier of the barrier panel corresponding to the position of the depth value means that the three-dimensional image of the depth map information.

In still another aspect, the present invention provides an image receiving method for displaying an image through a barrier panel on a screen, comprising: a pair of image objects for displaying one three-dimensional image, the pair of image objects Receiving and decoding a signal including identifier information indicating an image for displaying a 3D image and position information of the image objects, and synthesizing the pair of image objects to form a single image for displaying a 3D image And generating the generated image by activating only a barrier at a position corresponding to the position information among barriers of the barrier panel.

In another aspect, the present invention provides a signal receiver for receiving a signal multiplexed with image objects including the three-dimensional image object and the respective position information of the image object, the received position information of the image object and the image object A demultiplexer for separating and outputting the respective signals, and decoding the image objects outputted by the demultiplexer and the position information of the image objects, and using the 3D image object among the decoded objects to generate the 3D image object. An image decoder for generating a left image object and a right image object for display, and synthesizing the generated left image object and the right image object in units of pixels and displaying the image objects outputted by the image decoder. As it is located on the display unit and activated An image receiving apparatus including a barrier panel capable of separating an incident time and a barrier panel controller for activating only a barrier corresponding to position information of a three-dimensional image object decoded by the image decoder among barriers of the barrier panel; to provide.

In another aspect, the present invention is a signal receiver for receiving a signal including a two-dimensional image and depth map (depth map) information for the two-dimensional image, and separately outputs the received two-dimensional image and depth map information A demultiplexer to decode the two-dimensional image and the depth map information output by the demultiplexer, and generate the two-dimensional image as an image including a three-dimensional image by using the depth map information; The part where the 3D image is located in the image is an image decoder for generating a composite image of a left image and a right image for the 3D image, a display unit for displaying image objects output by the image decoder, and an active part on the display unit. A barrier panel capable of separating incident time and a barrier of the barrier panel It provides an image receiving apparatus comprising a barrier panel controller for enabling only barrier to the position of the synthetic image for three-dimensional image of the said image decoding portion decoding.

In another aspect, the present invention provides a signal receiving unit for receiving a signal multiplexed with the image objects including the three-dimensional image object and the respective position information of the image object, the position of the received image object and the image object A demultiplexer for separating and outputting the respective information; decoding the image objects outputted by the demultiplexer and position information of the image objects, and using the 3D image object among the decoded objects; An image decoder for generating a left image object and a right image object for expressing the image, and synthesizing the generated left image object and the right image object in units of pixels and displaying the image objects output by the image decoder. As it is located on the display unit and activated An image receiving apparatus including a barrier panel capable of separating an incident time and a barrier panel controller for activating only a barrier corresponding to position information of a three-dimensional image object decoded by the image decoder among barriers of the barrier panel; to provide.

In yet another aspect, the present invention provides an image storage unit for storing image objects including a right image object, a left image object, object description information including on-screen position information of the image objects, and the image. An image information generation unit for generating identifier information of an object, and image information corresponding to the image objects stored in the image storage unit among the image objects stored in the image storage unit and the image information generated by the image information generation unit An apparatus for transmitting an image includes a multiplexer for changing a transmission data format, an image object multiplexed by the multiplexer, and a transmitter for transmitting the objects.

Hereinafter, with reference to the accompanying drawings, preferred embodiments of the present invention that can specifically realize the above object will be described.

First, a three-dimensional image that can be transmitted and received in order to easily describe the present invention will be described. Hereinafter, the 3D image generically refers to an image that appears three-dimensionally. In addition, in the following description, the image refers to an image displayed to the receiver. For example, when the sender transmits the text in the form of a receiver, the image may be displayed to the receiver. do. That is, the image below refers to an image of the receiver visual center that the receiver can recognize from the screen, and even though the sender does not generate and transmit an individual image for the transmission object, the receiver receives the transmission object and visualizes the image. If it can be recognized as an image, it is included in the following image.

Combining two two-dimensional images can be expressed as a three-dimensional image. If the left and right eyes of a person see one image, each eye sees a slightly different image. That is, the image seen by the right eye and the image seen by the left eye are different from each other by the distance difference between the two eyes. In the above three-dimensional image, a single image is displayed when the eyes of the left and right eyes of the human being are respectively displayed in the left and right directions, but the binocular parallax gives the two images visually synthesized. Means image. The binocular parallax represents the difference between the right eye and the left eye's view of objects. Hereinafter, an image viewed by the left eye (hereinafter referred to as a left image) among the images forming the 3D image is represented by an L index, and an image viewed by the right eye (hereinafter referred to as a right image) is represented by an R index.

FIG. 1 illustrates a conceptual diagram in which a 3D image on a screen is displayed to explain an example of viewing a 3D image with two 2D images displayed on a screen. Referring to Figure 1 describes the principle of presenting the image as follows.

Barrier panels are located on the screen to display three-dimensional images. The barrier panel may separate the incident time point and generate binocular disparity accordingly, so that the image displayed on the screen may be viewed as a three-dimensional image. After synthesizing the image (R) seen by the right eye and the image (L) seen by the left eye, the synthesized image may be viewed as a three-dimensional image.

In one image, the image of the right eye and the image of the left eye are prepared, and the left image L and the right image R are synthesized in units of pixels and displayed on the screen. The barrier panel may separate the incident time so that the time coming from the right eye is a pixel by the right image, and the time coming from the left eye is a pixel by the left image so that binocular disparity may occur. Therefore, when a person perceives an image synthesized in units of pixels through the barrier panel, the 3D image may be displayed. A method of synthesizing two images on a pixel-by-pixel basis may use an interpolation method for pixels, but there may be various methods depending on how the image is formed. In FIG. 1, b denotes a barrier interval of the barrier panel, g denotes a gap between the barrier panel and the screen, and z denotes a distance from the position seen by a person.

As shown in FIG. 1, when the right image R and the left image L are disposed in pixel units, the barrier panel includes pixels included in the right image R for the right eye, and the left eye for the left. The pixel R included in the image may be activated to correspond to each other. In particular, the barrier panel may generate binocular disparity by activating only the portion of the screen where the 3D image is located. Since the barrier panel is not activated, the part where the 2D image is displayed on the screen is transmitted to the eyes of the viewer as it is. A method of activating only the barrier panel of the portion where the 3D image is located will be described with reference to FIG. 13.

When displaying two-dimensional and three-dimensional images on the screen in units of objects, the barrier panel may use location information assigned to each object. That is, when the positional information of the image assigned to the object unit of the image is transmitted to the barrier panel, the barrier panel may activate only a part of the barrier panel corresponding to each 3D image object from the positional information of the object. In contrast, the portion of the barrier panel corresponding to the two-dimensional image object is not activated. Therefore, the two-dimensional image and the three-dimensional image can be simultaneously displayed, and even if the three-dimensional image and the two-dimensional image move with time, since the barrier panel is activated adaptively to the positional information about each object, Two-dimensional images can be displayed simultaneously. When the barrier panel is activated, the barrier panel can separate the incident time. When the two-dimensional image is displayed as it is, the barrier panel is inactivated, and thus the incident time is not separated.

2 is a plan view illustrating a concept according to the image display method according to the present invention. The diagonally-marked portion of the pixels on the screen indicates pixels obtained from the right image, and the portions indicated by dashed lines represent pixels obtained from the left image. In the image displayed on the screen, the right image and the left image are synthesized pixel by pixel. In Figure 1 it is described that the incident time is separated to facilitate understanding of the present invention. Meaning that the barrier panel is driven to separate the incident time means that an image region formed by the pixels belonging to the right image (shown by a diagonal line) and an image region formed by the pixels belonging to the left image (shown by a dotted line) (b) means that the human eyes accept different images. Therefore, by synthesizing two different images received from two eyes by a human brain, the image displayed on the screen can be recognized as a three-dimensional image.

According to the present invention, the 3D image and the 2D image can be displayed together on the screen, and only a portion of the screen where the 3D image is located can be activated to enable the user to view both images simultaneously by activating a barrier panel for the 3D image. have. On the contrary, when the barrier panel is activated on the entire screen to display the 3D image, the barrier panel is deactivated only in the portion where the 2D image is located so that the 3D image is visible only where the 3D image is located and the plane image is positioned. The place can make the two-dimensional image visible. As illustrated in FIG. 2, the barrier panel may be activated corresponding to pixels of an image displayed on a display device such as a TFT-LCD. Then, only a part of the barrier panel may be activated or deactivated by using position information corresponding to each pixel of the display apparatus displaying the 3D image. Therefore, the barrier panel is activated by synchronizing the pixels where the 3D image is located and the corresponding portions of the barrier panel of the display device with each other in synchronization with each other. It can be seen as a three-dimensional image. Therefore, the line of sight of the portion where the three-dimensional image is located can be focused, and the three-dimensional image can be seen more vividly than the two-dimensional image.

3 is a diagram for describing depth information when a stereoscopic image is recognized through a screen. Depth information will be described with reference to FIG. 3. When the human eye recognizes a three-dimensional sense of an image displayed on the screen, the three-dimensional sense may be felt as depth information of the image. In FIG. 3, p denotes depth information on a feeling of indentation perceived by a person, z denotes a distance between a human eye and a screen, e denotes a distance between two eyes of a person, and d denotes the eyes of the human eyes. Indicate the distance when condensed. FIG. 3A illustrates a case where the depth of an object that a person feels is farther than the screen, and FIG. 3B illustrates a case where the depth of an object that a person feels is closer than the screen. When a 2D image is displayed on the screen, the depth information according to FIG. 3 (a) or (b) of the 2D image is obtained and reflected in the 2D image, thereby displaying the 2D image as a 3D image. Hereinafter, the depth information described in FIG. 3 is referred to as depth information or thickness information for each image, and the depth information for the entire screen is referred to as depth map information.

Disclosed is an image transmission / reception method of the present invention for displaying a three-dimensional image and a two-dimensional image.

VRML (virtual reality modeling language), XML (extensible markup language), OpenGL, mesa (computer language), libraries, programs, etc. can be used to implement 3D images. . The 3D image may be displayed on a virtual 3D space using a means such as VRML (extensionable markup language), XML, OpenGL, or mesa. VRML, XML, and the like may implement a three-dimensional image in units of objects included in the image. The three-dimensional image may be transmitted in an image transmission format such as BIFS (binary for scenes).

When the image including the 3D image is received, the 3D image may be displayed only on a part of the screen, thereby increasing the concentration of the gaze compared to the surroundings and displaying a more vibrant image. Therefore, the gaze can be focused and the 3D image can be more realistically felt than when only the 2D image is displayed on the screen or only the 3D image is displayed on the screen. In addition, a two-dimensional image such as text may be viewed as a plane so that there may be no misunderstanding of the meaning transmission, and the problem that the three-dimensional image is visually degraded may be eliminated.

Hereinafter, an image transmitting / receiving method and an image receiving apparatus according to the present invention capable of displaying a two-dimensional image and a three-dimensional image together are disclosed.

4 is a flowchart illustrating an embodiment of an image transmission method according to the present invention. An embodiment of an image transmission method according to the present invention will be described with reference to FIG. 4.

A planar two-dimensional image and a stereoscopic three-dimensional image are respectively generated (S10). Here, if the 2D image is an image that can be displayed on the entire screen, the 3D image may be an image that can be displayed on a portion of the screen. On the contrary, if the 3D image is an image that can be displayed on the entire screen, the 2D image may be an image that can be displayed on a part of the screen.

Hereinafter, a case where the 3D image is displayed on a part of the screen will be described as an example. The 3D image may be an image of an object unit of expression, such as VRML or XML.

If the 3D image object is transmitted so that the 3D image is displayed on a part of the screen, information necessary for object description, which is information for receiving the transmitted 3D image object and converting the image to the actual screen, is generated. Hereinafter, information necessary for object description is information for expressing a combination of units of images on a screen and is called object description information. For example, object description information about an object that is an image individual unit includes thickness information or position information of an image object. When receiving and displaying a 3D image, a 3D image may be displayed by rendering the 3D image using the object description information.

The 3D image of the object unit, the object description information including the position information of the image, and the 2D image may be converted into a format for image transmission (S20). For example, a three-dimensional image of an object unit may be converted into BIFS, which is one of formats for image transmission and reception. The 3D image and the 2D image do not necessarily have the same transmission / reception format. For example, a three-dimensional image of an object unit may be converted into BIFS, and the two-dimensional image may be converted into an MPEG-2 transport stream (TS) format and transmitted. Data in BIFS format representing a three-dimensional image of an object unit may also be converted back to MPEG-2 TS format and transmitted.

Data including the 3D image of the object unit converted for image transmission, object description information of the 3D image, and the 2D image object is transmitted (S30).

Therefore, when receiving and displaying three-dimensional image, object description information of the three-dimensional image, and data including the two-dimensional image object, respectively, the two-dimensional image and the three-dimensional image object are position information of the three-dimensional image object. Can be expressed according to the object description information, including.

5 is a flowchart illustrating another embodiment of an image transmission method according to the present invention. Another embodiment of the image transmission method according to the present invention will be described with reference to FIG. 5. In the embodiment of FIG. 5, an example of transmitting a 4D image to a part of the screen is disclosed.

By using the 2D image and the depth map information, the 3D image can be expressed. Here, the depth map information means depth information according to a three-dimensional sense of distance with respect to the two-dimensional image. For example, assume that the depth map information has an 8-bit value between -128 and 127. The portion where the depth map information of a part of the two-dimensional image has a value of 0 bits is viewed as a planar image having the same sense of distance as the image, and a portion other than zero indicates that there is a visual distance along the perspective with respect to the two-dimensional image. For example, a positive bit value may be visually preceding the two-dimensional image, and a negative bit value may be visually behind the two-dimensional image, or vice versa. By using the depth map information representing the difference between the two-dimensional image and the visual distance perspective of the two-dimensional image as a contour line, it is possible to implement the three-dimensional image. One depth map may be used to three-dimensionally display one image object, and one two-dimensional image may be realized as a three-dimensional image using two depth map information. For example, if one depth map has depth information indicating a visually near side position, and another depth map has depth information visually indicating a far side position, the image is determined by the difference between the near and far positions. The thickness information of may be expressed.

As described above, when the image is transmitted, two-dimensional images that can be displayed on the entire screen and depth map information of the two-dimensional images are generated (S50).

The 2D image and the depth map information of the 2D image may be converted into a format for data transmission (S60). For example, the 2D image and the depth map information may be converted into the MPEG-2 TS format. For example, the depth map information may be in the form of a packetized elementary stream (PES) of MPEG-2 TS or may be in the form of an MPEG-2 TS private section.

Then, the two-dimensional image and the data of the format in which the depth map information for the two-dimensional image is converted are transmitted (S70). Therefore, when data including the 2D image and the depth map information is received, a portion of the 2D image in which the depth information by the depth map information is not 0 may be expressed as a 3D image. The image transmitted by FIG. 5 may be received according to the embodiment of FIG. 9.

6 is a view showing an example of an image structure for explaining another embodiment of an image transmission method according to the present invention. The object may include an image together with an audio object to form a single image. The objects of the image may have a hierarchical structure, and the structure may change with time. That is, objects included in the hierarchical structure may be newly added or removed over time. By compositing objects according to the above hierarchical structure, one image can be formed. For example, when an image of an object unit of a hierarchical structure is transmitted according to a format to BIFS, an elementary stream identifier (ES_ID), which is an identifier for each object, may be assigned. The BIFS format can give each object an ES_ID of 2 bytes. When an image object is identified by the ES_ID, a bit value indicating whether each image object is a 2D image object or a 3D image object can be inserted. have.

The hierarchical structure of the object of the image shown in the example of FIG. 6 includes the first object 1, the second object 11, the third object 12, the fourth object 121, the fifth object 122, and the first object. The sixth object 123, the seventh object 124, the eighth object 1234r, and the ninth object 1234l. The first object is a top-level object, and the second object 11 and the third object 12 are connected to the first object 1. The third object 12 is connected to the fourth object 121, the fifth object 122, the sixth object 123, and the seventh object 124, respectively, and the sixth object 123 is formed of a third object 12. It is connected with 8 objects and 9th objects. In the case of transmitting the image objects as shown in FIG. 6, when the scene description information of the connection structure of each image object is transmitted together, the receiver may reproduce the image using the image object and the scene description information of the image object. . In the example of FIG. 6, two two-dimensional image objects of the eighth object 1234r and the ninth object 1234l are synthesized to form one three-dimensional image object.

An image transmission format such as BIFS may include an identifier field (called ES_ID in the case of BIFS) for each image object. In the case of BIFS, two bytes are allocated as an identifier field (ES_ID) for the object. Therefore, when identifier information is set to a bit value in 2 bytes, it is possible to identify whether each object identifier is an image object for a stereoscopic image. For example, an identifier may be assigned whether a 2D image object or a 3D image object depends on whether the most significant bit is 0 or 1. If the corresponding object is a 3D image object, it may represent that the left image is 0 when the next bit value is 0 and the right image is 1.

As another example, a bit value at a specific position is assigned for a pair image of a three-dimensional image. That is, the bit value of a specific position among the bit values of the identifier of the ES_ID of any one object (1234r in FIG. 6) located in the hierarchical structure as shown in FIG. 6 indicates that the object (1234r in FIG. 6) is a three-dimensional image. In case of the right image (or left image), the object below the object may be set to be the left image (or right image).

As shown in FIGS. 1 and 2, when the eighth object for the right image and the ninth object for the left image are synthesized, one 3D image object may be expressed.

On the other hand, each image object has positional information on the screen display. Two two-dimensional images synthesized into one three-dimensional image may have the same location information on the screen. In the example of FIG. 6, the eighth object 1234r is connected to a subordinate object of the sixth object 123, and the ninth object 1234l is connected to a subordinate object of the eighth object 1234r. When the eighth object 1234r is a left image that can be a three-dimensional image object, and the ninth object 1234l is a right image that can be a three-dimensional image object, the three-dimensional image object is assigned to ES_ID, which is an identifier of each object. The two images may be set as a pair of three-dimensional image object. When receiving an image object, by composing and rendering objects of two three-dimensional images in a hierarchical structure, the two objects may be synthesized and expressed as one three-dimensional image. Since the remaining objects are two-dimensional image objects, they can be expressed as planar images.

FIG. 7 is a flowchart illustrating still another embodiment of an image transmission method using the connection structure and identifier information of the image object of FIG. 6. First, at least one pair of image objects and two-dimensional image objects to be three-dimensional image objects are prepared (S110).

The pair of one or more image objects, the two-dimensional image object, and the location information of the image objects, which become the three-dimensional image object, may be converted into an image transmission format (S120). For example, in BIFS format, 3D image objects and 2D image objects can be converted. The converted image transmission format includes an identifier of each image object and object description information of the image object. The identifier of the image object may include an identifier that may indicate that the image object is a pair of image objects of the three-dimensional image object. In addition, position information on the screen may be set for each image object.

In operation S130, data having an image transmission format including a 2D image object, an image object that becomes a 3D image object, and position information of the image objects is transmitted. If the image according to the embodiment of FIG. 7 is received, two three-dimensional image objects may be synthesized in units of pixels from the same location information when displayed on the screen, and the barrier panel may be activated in response to the location information of the synthesized image object. . A detailed description thereof is provided in FIG. 11.

8 is a view showing an embodiment of an image receiving method according to the present invention. An embodiment of an image receiving method according to the present invention will be described with reference to FIG. 8. The embodiment of FIG. 8 describes a case of receiving and displaying an image transmitted by the embodiment of FIG. 4.

First, the 3D image of the object unit, the object description information including the position information of the 3D image and the 2D image are respectively obtained from the received data (S210). Since the two-dimensional image can also be transmitted in object units, if the received two-dimensional image is in object units, object description information of the two-dimensional image can be obtained from the received data. If the received data may be transmitted in a transmission format such as BIFS, an example of S 210 which obtains each image from BIFS format data transmitted by being included in the MPEG-2 TS is described in detail in FIG. 11.

Converts the received three-dimensional image object into two two-dimensional images of the right image and the left image, and combines the converted two-dimensional images pixel by pixel so that it can be seen as one three-dimensional image object. Each image is generated (S220).

The two-dimensional image synthesized in the step S220 and the two-dimensional image received in the step S210 are respectively expressed, and the location information of the object description information on the three-dimensional image received in the step S210 corresponds to the location information. The barrier panel is activated at the position (S230). Since the two-dimensional image objects generated in step S220 are generated from the three-dimensional image object received in step S210, the two-dimensional image generated in step S220 using the location information of the three-dimensional image object received in step S210. Can expose an object. According to the present exemplary embodiment, since the barrier panel is activated by the barrier panel from the position information of the image object that becomes the three-dimensional image, the barrier panel can view the three-dimensional image through the activated barrier panel, and the rest of the two-dimensional image.

9 is a view showing another embodiment of an image receiving method according to the present invention. An embodiment of an image receiving method according to the present invention will be described with reference to FIG. 9. 9 illustrates a case of receiving and displaying an image transmitted by the embodiment of FIG. 5.

First, data including a 2D image and depth map information of the 2D image is received (S250). As described in the embodiment of FIG. 5, the depth map information on the 2D image and the 2D image may be transmitted as MPEG-2 TS information.

A right image and a left image of the 3D image object, which may be generated from the received 2D image and the depth map information on the received 2D image, are respectively generated (S260). The generated right image and the left image are synthesized and expressed in units of pixels, and the barrier panel of a portion corresponding to a portion where the depth map information is not 0 is activated (S270).

10 is a flowchart illustrating another embodiment of an image receiving method according to the present invention. Another embodiment of the image receiving method according to the present invention will be described with reference to FIG. 10. 10 illustrates an example of receiving and displaying an image transmitted according to the embodiment of FIG. 6.

From the received data, pair image (right image and left image) for the 2D image object and the 3D image object and object description information including the position information of the image objects are obtained by decoding (S310). The 2D image object, the right and left images of the 3D image object, and object description information of the image objects may be received in an MPEG-2 TS format capable of transmitting a BIFS format stream.

The pair image objects for the 3D image object are synthesized in pixel units to generate one 2D image object (S320).

The synthesized image is displayed in operation S320 by activating a barrier panel corresponding to the position of the object of the image synthesized on a pixel basis from the position information included in the object description information of the image object (S330). In this case, the 2D image object may be displayed without activating the barrier panel according to the corresponding position information.

As described above, two image objects may be used to display the three-dimensional image object. When the 3D image object is displayed as two image objects, only some objects included in the image object may be displayed as images in 3D. When the 3D image is expressed in units of objects of the image, the 3D image may be displayed on the entire screen according to the size and position of the object to be transmitted and received, or the 3D image may be displayed on a part of the screen. When the 3D image is displayed in the unit of an object constituting the screen, a binary format object representation frame type BIFS (Binary Format for Scenes) can be used to identify the object unit to be transmitted and received.

An example of receiving an image object using Binary Format for Scenes (BIFS) will be described in order to easily understand an embodiment of the present invention for transmitting and receiving an image.

11 illustrates a process of obtaining an image object from an MPEG-2 TS format signal including a BIFS format signal for transmitting and receiving an image object. When a MPEG-2 format video signal including an image is obtained, a program association table (PAT) having a PID (packet identifier) of 0x0000 is obtained from the MPEG-2 TS, and the PID of a program in the PAT and a corresponding program map table (PMT) is obtained. Is obtained (ⓞ). Find PMT from the obtained PID (①). Obtain IOD_descriptor in PMT (②). An ES_Descriptor related to a scene description and an object description (ojbect description) included in an initial object descriptor (IOD) is obtained (3). The ES_ID is obtained from the ES_Descriptor information obtained in ③, and then the corresponding elementary stream information is found in the descriptor loop (④). The PID corresponding to the ES_ID and the stream type (Stream_type) are obtained from the found elementary stream information, and then packets corresponding to the PID are found from the transport stream (⑤). An ObjectDescriptor including an object information stream is obtained using the ObjectDescriptorID (6). The scene is expressed using the correlation between the ES_ID included in the ObjectDescriptor and the PID obtained in ⑤ (⑦). Obtain BIFS animation data using object description information (⑧). When you receive BIFS animation data, you can implement an image object from the received data.

12 is a diagram illustrating an embodiment of an image transmitting apparatus according to the present invention. An embodiment of an image transmitting apparatus according to the present invention will be described with reference to FIG. 12. In order to easily describe an embodiment of the image transmitting apparatus according to the present invention, an image transmitting apparatus transmitting MPEG-2 TS will be described as an example.

The image storage unit 110 stores the generated image. Here, the embodiment of FIG. 12 discloses an example of transmitting an image according to FIG. 6. The image stored by the image storage unit 110 may be a 2D image in the unit of a frame picture or may be a 2D image in the unit of an object. In addition, the image stored by the image storage unit 110 may be received and stored in the already generated image, or may be a temporary storage of the image generated in real time. The image storage unit 110 may store a 3D image of an object unit or store a left image and a right image of an object unit for displaying a 3D image. The image information generation unit 120 generates object description information of each image stored in the image storage unit 110. The object description information may include location information on the screen of each image object. The image information generator 120 may generate identifier information on the image object stored by the image storage unit 110, location information of the image object, and information on a connection structure between each image object. The image information generator 120 may generate identifier information, location information, and connection structure of the left image object and the right image object for displaying a 3D image.

The multiplexer 130 multiplexes information such as image descriptions stored by the image storage unit 110 and object description information about each image object generated by the image information generation unit 120. For example, if the image object and the object description information stored by the image storage unit 110 are transmitted in the MPEG-2 TS format, the image object and the object description information of the object are multiplexed into packetized stream information or section information. Can be.

The transmitter 140 transmits multiplexed image objects and image information about the objects. The transmitter 140 may perform error correction encoding and interleaving on the image and its image information when necessary for image transmission.

13 is a view showing an embodiment of an image receiving apparatus according to the present invention. An embodiment of an image receiving apparatus according to the present invention will be described with reference to FIG. 13 as follows. 13 may receive a transmission image according to FIGS. 4 to 6.

First, an example of receiving an image to be transmitted according to the embodiment of FIG. 4 will be described. The signal receiver 210 receives a video signal including object description information about the 2D image, the 3D image object, and the 3D image object. The 2D image may be a 2D image object or may be a frame picture or a field picture of the 2D image. When the 2D image is an image object, the object description information also includes description information about the 2D image object. In the following description, a two-dimensional image is assumed to be a frame image, but those skilled in the art can easily understand that the two-dimensional image is an object.

The demultiplexer 220 demultiplexes the 2D image, the 3D image object, and the object description information included in the video signal, respectively, and outputs the demultiplexed image to the image decoder 225. For example, the demultiplexer 220 may demultiplex two-dimensional images, three-dimensional image objects, and object description information according to the image object receiving process described with reference to FIG. 11. When the image decoder 225 receives the 3D image object, the image decoder 225 decodes the 3D image object and based on the 3D image object decoded so that the image object is displayed as a 3D image through the barrier panel 260. To generate the left and right images for that image object, respectively. The image decoder 225 may render the 3D image object to generate the left image and render the right image. Then, the rendered left image and the right image are synthesized in pixel units and transmitted to the display unit 240. Two images can be synthesized using a variety of interpolation methods. When the image decoder 225 receives the 2D image, the image decoder 225 decodes the received image and outputs the decoded image to the display unit 240.

The display unit 240 may display a two-dimensional image output by the image decoder 225 and an image synthesized in pixel units. The image synthesized by the image decoder 225 and the position of the image are determined by the position information based on the received 3D image object and object description information.

According to the above assumption, the two-dimensional image output by the image decoder 225 is an image displayed on the entire display unit 240, and the composite image for the three-dimensional image displayed by the image decoder 225 is displayed on the display unit ( Part of 240). Therefore, the composite image for the two-dimensional image output from the image decoder 225 and the three-dimensional image displayed by the image forming unit 230 are overlapped in the display unit 240. When the display unit 240 receives an image from the image forming unit 230, the display unit 240 prioritizes the image received from the image forming unit 230 and overlaps with the image forming unit 230. Display a composite image received from

The barrier panel controller 250 receives the position information of the 3D object included in the object description information from the image decoder 225 and activates the barrier of the position of the barrier panel 260 corresponding to the position information. Therefore, when viewing the image displayed by the display unit 240, the portion of the screen where the barrier panel 260 is not activated may view the two-dimensional image displayed by the display unit 240, and the barrier panel 260 is activated. A portion of the screen may be viewed through the display unit 240 and the barrier panel 260 to view a 3D image. Therefore, the 2D image and the 3D image may be viewed together through one display unit 250. Since the barrier panel controller 250 controls the barrier panel 260 according to the position information of the 3D image object expressed from the image decoder 225, the barrier panel controller 250 corresponds to the position even if the position of the 3D image changes over time. Only the barrier of the barrier panel 260 may be activated. That is, since the area of the 3D image displayed on the display unit 250 and the active area of the barrier panel 260 are synchronized with time, even if the 3D image moving on the display unit 250 is moved, Only where it is located, the barrier panel 260 is activated. Therefore, even a moving three-dimensional image, only the three-dimensional image can be seen as a stereoscopic image, and the two-dimensional image is expressed in the remaining areas. Even when a moving image of the moving 3D image object is received, the moving 3D image may be expressed within the 2D image.

If the embodiment of the image receiving apparatus according to the present invention receives the two-dimensional image and the depth map information of the image according to the embodiment of Figure 5, the demultiplexer 220 is an image decoding unit for each of the two-dimensional image and depth map information Send to 225. The image decoding unit 225 decodes the 2D image and the depth map information to generate a left image and a right image so that the received 2D image may be viewed as a 3D image according to the depth map information. The image decoder 225 may transmit the position information of the portion of the decoded depth map information that is not 0 (that is, the portion of the received image that is a 3D image) to the barrier panel controller 250. The image decoder 225 generates a left image and a right image for the 3D image when there is a non-zero portion of the depth map information among the images to be decoded and displayed. Here, the left image and the right image are expressed as images using the same pixel value at the portion where the depth is 0, but are images having different pixel values due to binocular disparity at portions where the depth is not zero. The image decoder 225 combines the left image and the right image into one image on a pixel-by-pixel basis in order to display the image on the display 240. In particular, the image area of the portion having a depth of zero may be synthesized in units of pixels. As described above, in the synthesis of the left image and the right image, various interpolation methods may be used. For example, one column of the image region may be interpolated from pixels of the right image, and neighboring columns of the column may be interpolated to pixels of the left image to generate one image in an area having a depth of zero. The image decoder 225 expresses the synthesized image on the display 240.

The display unit 240 displays an image displayed by the image decoding unit 225. The barrier panel controller 250 receives the position information of the 3D image based on the depth map information decoded by the image decoder 225, and the barrier panel 260 is activated so that the barrier of the barrier panel 260 is activated at a portion whose depth is not zero. Control 260. Accordingly, the synthesized image is displayed in the image portion of the image displayed by the display 240 whose depth is not 0. The barrier panel 260 may activate only a barrier corresponding to an image portion of which the depth is not 0, so that only a part of the images activated by the barrier 240 may be expressed as a 3D image.

When the present embodiment receives the image according to the embodiment of FIG. 6, the image decoder 225 generates only the 3D image object among the received image objects as an object for the left image and a right image object, and then the left image. Combine the object and the right image object into one image object. Then, the image object synthesized for the 3D image object and the other 2D image object are composed and rendered on one screen and displayed on the display unit 240. The barrier panel controller 250 receives position information on the 3D image object from the image decoder 240 and activates only the barrier at the position. Therefore, the 2D image object among the images displayed on the display 240 may be viewed as a planar image, and the 3D image by the 3D image object may be viewed through the same screen. Even if the composite image for the 3D image is dynamic with time, the barrier of the barrier panel is adaptively activated to the positional information of the composite image for the 3D image, so that the 3D image and the 2D image can be simultaneously viewed. Therefore, it is possible to increase the discrimination ability of the 3D image, and even if the text is displayed separately, the text is displayed in the same principle as the 2D image, and since the text is not displayed as the 3D image, the text is properly displayed due to the 3D image. The problem does not arise.

It is easy for a person skilled in the same technical field to change or modify the present invention from the present patent specification. Therefore, although an embodiment of the present invention has been specifically described above, it will be understood that various changes may be made without departing from the spirit and scope of the present invention, and should be considered within the spirit and scope of the present invention.

The effects of the image transmitting and receiving method and the image transmitting and receiving apparatus according to the present invention described above are as follows.

First, the image transmission / reception method and the image transmission / reception apparatus according to the present invention can focus the eyes of the image receiver.

Second, according to the image transmission and reception method and the image transmission and reception apparatus according to the present invention it is possible to display a three-dimensional and realistic image.

Third, the image transmission / reception method and the image transmission / reception apparatus according to the present invention can display two-dimensional images and three-dimensional images on one screen.

Claims (20)

First content that can be expressed as a 3D image using two 2D images with binocular disparity, second content that can be expressed as a 2D image, and whether or not to express the content Generating content presentation information including information and location information on a screen of the first content and the second content; Converting the generated first content and second content into a binary format for scene (BIFS) image transfer format; Converting the content presentation information into a data format for transmission; And And transmitting a signal including the first content and the second content converted to the BIFS image transmission format and the content presentation information and the content presentation information converted to the data format for transmission. The content presentation information may include a field indicating whether an image included in the first content is for 3D content according to binocular disparity, and each of the two 2D images when the first content is 3D content according to binocular disparity. And a field indicating whether the image is a left image or a right image. The method of claim 1, And the BIFS image transmission format includes information on a connection structure of the contents. The first content of the BIFS image transmission format that can be expressed as a three-dimensional image by using two two-dimensional image with binocular disparity, the second content of the BIFS image transmission format that can be expressed as a two-dimensional image and the content of the content Receiving a signal including information on whether to display information and content presentation information including location information on a screen of the first content and the second content, The content presentation information may include a field indicating whether an image included in the first content is for 3D content according to binocular disparity, and the two two-dimensional fields when the first content is 3D content according to binocular disparity. A field indicating whether each image is a left image or a right image; Storing the contents; And And displaying the stored contents on a screen according to the contents expression information, and expressing the first contents in a three-dimensional area on the partial portion of the screen. The method of claim 3, And the BIFS image transfer format includes information on a connection structure of the contents. The method of claim 3, The displaying of the content may include activating only a barrier located in a portion of the screen. A content storage unit for storing first content that can be expressed as a 3D image and second content that can be expressed as a 2D image using two 2D images having binocular parallax; A content presentation information generation unit generating content presentation information including information on whether the contents are displayed and location information on the screen of the first content and the second content; A multiplexer converting the generated contents into a binary format for scene (BIFS) image transmission format and converting the content presentation information into a signal format for transmission, wherein the content presentation information is an image included in the first content. And a field indicating whether the two-dimensional images are left or right images when the first content is three-dimensional content according to binocular disparity; And And a transmission unit for transmitting the converted format signal. The method according to claim 6, And the BIFS image transmission format includes information on a connection structure of the contents. The first content of the BIFS image transmission format that can be expressed as a three-dimensional image by using two two-dimensional image with binocular disparity, the second content of the BIFS image transmission format that can be expressed as a two-dimensional image and the content of the content A receiving unit for receiving a signal including information on whether or not to display and content presentation information including location information on the screen of the first content and the second content; The content presentation information may include a field indicating whether an image included in the first content is for 3D content according to binocular disparity, and the two two-dimensional fields when the first content is 3D content according to binocular disparity. A field indicating whether each image is a left image or a right image; A demultiplexer which demultiplexes the contents and the content presentation information; And a display unit for displaying the first content in a three-dimensional area on a portion of a screen according to the content presentation information. 9. The method of claim 8, And the BIFS image transmission format includes information on a connection structure of the contents. 9. The method of claim 8, The display unit includes a barrier panel for activating only the barrier located in the partial region of the screen. delete delete delete delete delete delete delete delete delete delete

Images