JP2013207454A - Receiving device, transmitting device, receiving method, receiving program, and recording medium storing receiving program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a receiving device which can display image information such as a three-dimensional image operable on the receiving side by superposing it on broadcast video information and a receiving method, a receiving program and a recording medium storing the receiving program therein, as well as provide a transmitting device which can give a broadcast allowing image information to be synthesized by the receiving device without performing spatial recognition processing.SOLUTION: In a receiving device 10, a caption-ARDecoder 15 acquires information on the position and posture of UserObject from a received DRCS (Dynamically Re-definable Character Set), a 3DMapper 18 reads out UserObject from a UserObject storage unit 16 and disposes it on the basis of the acquired information on the position and posture of UserObject, and a VideoDecoder 13 outputs decoded video information after superposing the disposed UserObject on it.

Description

  The present invention relates to a receiving apparatus, a transmitting apparatus, a receiving method, a receiving program and a recording medium storing the receiving program, and a transmitting apparatus that broadcasts the video content.

  In recent years, as part of augmented reality technology (also referred to as AR technology), virtual digital information such as a three-dimensional image is superimposed and displayed on an image taken by a camera or the like. .

  For example, in Patent Document 1, when virtual digital information is superimposed on a captured image (real space information), not only position information and posture information but also gravity information is reflected in the virtual digital information. It is described that the same movement as an object in real space is given.

JP 2011-197777 A

  In games and the like, a technique described in Patent Document 1 is applied to display a 3D image or the like superimposed on a game screen or the like. Conventionally, content is only viewed by a viewer, and is basically a one-way medium.

  In recent years, for example, in terrestrial digital broadcasting and the like, programs (video contents) that allow viewers to participate by using data broadcasting have been broadcast. This is basically displaying character information and the like, and selecting and operating it on the viewer side with a remote controller (remote controller) or the like, and the sense of immersion in the video content was poor.

  Therefore, even if a three-dimensional image is displayed on the television screen as image information, a complicated operation is difficult with a remote control of a receiving device such as a television. Even if a three-dimensional image can be operated with the remote control, It may feel annoying to learn how to operate.

  Therefore, the present invention has been made in view of the above problems, and for example, image information such as a three-dimensional image that can be operated on the reception side can be displayed superimposed on video information to be broadcast. PROBLEM TO BE SOLVED: To provide a receiving device, a receiving method, a receiving program and a recording medium storing the receiving program, and a transmitting device capable of performing broadcasting capable of synthesizing image information without performing space recognition processing in the receiving device. And

  In order to solve the above-described problem, a receiving apparatus according to claim 1 is a receiving apparatus including a receiving unit that receives a broadcast signal including video information, a motion recognition unit that recognizes the movement of an object, An image information acquisition unit that acquires image information that operates in conjunction with movement, and the image information acquired by the image information acquisition unit operates in conjunction with movement recognized by the motion recognition unit, and the reception unit And a display control unit that is superimposed on video information included in the received broadcast signal and displayed on the display unit.

  The transmission device according to claim 6 is information for displaying image information different from the video information in a superimposed manner on the broadcast signal in a transmission device including a transmission unit that transmits a broadcast signal including video information. A display information acquisition unit that acquires certain display information is provided, and the transmission unit includes the display information acquired by the display information acquisition unit and transmits the broadcast information.

  The receiving method according to claim 7 is a receiving method of a receiving device including a receiving unit that receives a broadcast signal including video information, and a motion recognition step for recognizing the motion of the object, and in conjunction with the motion of the object. An image information acquisition step for acquiring operating image information, and a display for displaying the image information acquired in the image information acquisition step on the display unit by superimposing the image information on the broadcast signal received by the reception unit And a control process.

1 is a block diagram of a receiving device and a transmitting device according to an embodiment of the present invention. It is explanatory drawing of the data field of DRCS. 3 is a flowchart illustrating a transmission operation of the transmission device illustrated in FIG. 1. 3 is a flowchart illustrating a reception operation of the reception device illustrated in FIG. 1. 3 is a flowchart illustrating a motion detection operation of the receiving apparatus illustrated in FIG. 1. It is explanatory drawing which showed superimposing UserObject on video information.

  Hereinafter, a receiving apparatus according to an embodiment of the present invention will be described. A receiving apparatus according to an embodiment of the present invention recognizes the movement of an object such as a person in a motion recognition unit, and converts the image information acquired by the image information acquisition unit into a movement recognized by the motion recognition unit in a display control unit. Since they are operated in conjunction with each other, it is possible to superimpose and display image information linked to the movement of a person or the like (viewer) on video content broadcast by television broadcasting or the like. Therefore, the viewer can be immersed and enjoyed with the broadcast content.

  Further, the display control unit further includes a display information extraction unit that extracts display information of the image information included in the broadcast signal, and the display control unit superimposes the image information on the video information based on the display information extracted by the display information extraction unit. You may make it display on a display part. Naturally, image information to be superimposed by the receiving device is not taken into consideration in the video content to be broadcast such as conventional television broadcasting. For this reason, it is necessary to generate information such as a position where image information is displayed in the receiving apparatus, and this processing may be burdened. Therefore, by including the display information of the image information in the broadcast signal and extracting it by the display information extraction unit, it is not necessary for the receiving device to generate information such as the display position of the image information, and the processing of the receiving device is reduced. Can do.

  Further, the display information may be information indicating the position and orientation when the image information is displayed in the display information. In this way, when the image information is three-dimensional image information, the position and orientation in which the image information is displayed can be determined, and space recognition processing can be performed in the receiving device. Since it is not necessary to calculate the position and orientation, it is possible to synthesize image information without applying a load even in a television broadcast in which video changes in real time.

  Further, the display information may be included in an area where caption information of video information is inserted. In this way, display information can be included in an area that does not affect video, audio, or the like in an existing data area, and display information can be included without defining a new data area.

  Further, the image information may be information indicating an anthropomorphic shape image. By doing so, anthropomorphic image information such as an avatar can be operated on a television screen or the like in conjunction with the movement of the user or the like, and the content can be enjoyed more.

  The transmission apparatus according to the present embodiment acquires display information that is information for combining and displaying image information different from video information on a broadcast signal in a display information acquisition unit, and the display information acquisition unit acquires in a transmission unit Since the received display information is included in the broadcast signal and transmitted, the receiving device performs spatial recognition processing in order to transmit the display information that is information for combining and displaying the image information in the broadcast signal. Therefore, it is possible to broadcast video information that can synthesize image information.

  A receiving method according to an embodiment of the present invention recognizes the motion of an object in a motion recognition process, and links the image information acquired in the image information acquisition process in the display control process with the motion recognized in the motion recognition process. Therefore, it is possible to superimpose and display image information linked to the movement of a person or the like (viewer) on video content broadcast by television broadcasting or the like. Therefore, the viewer can be immersed and enjoyed with the broadcast content.

  A reception program according to an embodiment of the present invention may cause a computer to execute the reception method described above. By doing so, since the display information of the image information is included in the video information using the computer, the video content broadcast by the television broadcast or the like is linked to the movement of the person (viewer) Image information can be superimposed and displayed. Therefore, the viewer can be immersed and enjoyed with the broadcast content.

  Further, the reception program described above may be stored in a computer-readable recording medium. In this way, the program can be distributed as a single unit in addition to being incorporated in the device, and version upgrades can be easily performed.

  A receiving apparatus 10 and a transmitting apparatus 20 according to an embodiment of the present invention will be described with reference to FIGS. As shown in FIG. 1, the receiving device 10 includes a TS receiving unit 11, a separating unit 12, a VideoDecoder 13, an AudioDecoder 14, a caption-ARDDecoder 15, a UserObject storage unit 16, an image analyzing unit 17, a 3DApper 18, and a Video. And an output unit 19.

  The TS receiver 11 demodulates, for example, a terrestrial digital broadcast wave received by an antenna (not shown), takes out a transport stream (TS) as a broadcast signal, and outputs the transport stream to the separator 12.

  The separation unit 12 includes a demultiplexer that separates the transport stream. The separating unit 12 separates into a video PES (Packetized Elementary Stream), an audio PES, a subtitle PES, and the like based on the header portion of the received transport stream. The video PES, audio PES, and subtitle PES include a PTS (Presentation Time Stamp) that is time information for synchronous reproduction. The separated video PES is output to the VideoDecoder 13, the audio PES is output to the AudioDecoder 14, and the subtitle PES is output to the subtitle PES-ARDDecoder 15. The TS receiver 11 and the separator described above function as a receiver that receives a broadcast signal including video information.

  The video decoder 13 decodes (decodes) the video PES output from the separation unit 12, extracts video information, and outputs the video information to the video output unit 19.

  The AudioDecoder 14 decodes the audio PES output from the separation unit 12, extracts audio information, and outputs the audio information to the outside from an audio output unit or the like (not shown).

  The subtitle-ARD Decoder 15 decodes the subtitle PES output from the separation unit 12, extracts subtitle information or AR information, and outputs the subtitle information or the AR information to the 3DMpaper 18. For example, in subtitle information sent by terrestrial digital broadcasting, DRCS (Dynamically Re-definable Character) that expresses external characters based on character broadcasting and data broadcasting character encoding standards in addition to ordinary characters (text). Set) is included. DRCS represents characters or symbols as bitmap data.

  In the present embodiment, position and orientation information when a UserObject (to be described later) is superimposed on video information is inserted into the DRCS data field of the caption information. The caption PES-ARD Decoder 15 extracts the position and orientation information as AR information and outputs it to the 3D Mapper 18. That is, the position and orientation information when the UserObject is superimposed on the video information is the display information of the claims, that is, the information indicating the position and orientation when displayed in the image information. The display information is included in the area where the caption information of the broadcast signal is inserted. Note that the position and orientation information when the UserObject is superimposed on the video information is hereinafter referred to as the position and orientation information of the UserObject.

  The UserObject storage unit 16 includes a memory or the like in which UserObject as image information is stored. UserObject is three-dimensional image information in the present embodiment, and specifically, for example, image information of anthropomorphic shape such as an avatar.

  The image analysis unit 17 detects the movement of a person such as a user photographed by the camera 30 connected to the receiving apparatus 10 and outputs the detected movement to the 3D Mapper 18. Specifically, a person is recognized from an image taken by the camera 30, the operation is detected by motion capture or the like, and is output to the 3D Mapper 18.

  The 3D Mappeder 18 arranges the UserObject read from the UserObject storage unit 16 in a predetermined position on the screen of the video information decoded by the VideoDecoder 13 based on the position and attitude information of the UserObject output from the subtitle-ARDDecoder 15. Then, the information of the video in which the UserObject is arranged is output to the Video output unit 19. Also. The 3DMapper 18 operates UserObject based on the motion detection information output from the image analysis unit 17.

  The video output unit 19 superimposes (combines) the information of the UserObject output from the 3D Mapper 18 on the video information output from the VideoDecoder 13 and outputs the information to an external display device or the like. Since the UserObject is arranged at a predetermined position in the video information by the 3D Mapper 18, the Video output unit 19 may simply superimpose (superimpose and combine).

  The camera 30 is an imaging device that captures a person such as a user, for example, and includes a camera that can capture a moving image so that the image analysis unit 17 can detect a motion. Note that the camera 30 and the receiving device 10 may be connected by wire or may be wireless.

  The transmission device 20 includes a VideoEncoder 21, an AudioEncoder 22, a caption-AREncoder 23, a mixing unit 24, and a TS transmission unit 25.

  The VideoEncoder 21 receives a video signal to be transmitted, and, for example, in the case of terrestrial digital broadcasting, the video encoder 21 is encoded by an encoding method defined in the MPEG-2 (Moving Picture Experts Group phase 2) standard, generates a video PES, and mixes the video signal. 24.

  The audio encoder 22 receives an audio signal to be transmitted. For example, in the case of terrestrial digital broadcasting, the audio encoder 22 is encoded by an AAC (Advanced Audio Coding) method, generates an audio PES, and outputs the audio PES to the mixing unit 24.

  The subtitle-AREncoder 23 receives subtitle information to be transmitted, converts information such as external characters other than ordinary characters into a DRCS format, generates a subtitle PES, and outputs the subtitle PES to the mixing unit 24. In addition, the caption-AREncoder 23 not only converts the original caption information into the DRCS format, but can easily superimpose image information such as UserObject on the video transmitted from the transmission apparatus 20 on the reception apparatus 10 side. Further, the position and orientation information of UserObject can be converted (included) into the DRCS format. Whether to include subtitles in the DRCS or information on the position and orientation of the UserObject may be specified by inputting switching information from the outside in advance. That is, the subtitle-AREncoder 23 functions as a display information acquisition unit that acquires display information that is information for displaying image information different from video information superimposed on a broadcast signal.

  The mixing unit 24 includes a multiplexer that mixes the video PES output from the VideoEncoder 21, the audio PES output from the AudioEncoder 22, and the subtitle PES output from the subtitle PES-AREncoder 23, generates a transport stream, and transmits TS To the unit 25.

  The TS transmission unit 25 modulates the transport stream output from the mixing unit 24 and transmits it from a not-shown antenna or the like using a predetermined carrier wave. That is, the mixing unit 24 and the TS transmission unit 25 function as a transmission unit that transmits display information acquired by the display information acquisition unit together with video information in a broadcast signal.

  Next, refer to FIG. 2 for the DRCS data format generated by the above-mentioned caption-AREncoder 23 and decoded by the DRCSDecoder 15 and how the position and orientation information of the UserObject is included in the data format in the present invention. I will explain.

  FIG. 2 shows a DRCS data format. The DRCS is composed of a NumberOfCode, a CharacterCode, a NumberOfFont, a fontId, a mode, a depth, a width, a height, and a plurality of patternData.

  NumberOfCode represents the number of external characters. CharacterCode represents an external character code. NumberOfFont represents the total number of fonts. fontId represents the identification of the font. “mode” represents a transmission mode. Depth represents the tone depth of the font. The width represents the horizontal size of the DRCS graphic. “height” represents the vertical size of the DRCS figure. patternData represents data of a DRCS graphic pattern.

  Among these data, fontId is data indicating whether or not the position and orientation information of the UserObject is included, and the information of the position and orientation of the UserObject is included in the patternData.

  The fontId is normally designated as “0”, and even if a value other than “0” is designated, the receiving side regards it as “0”. Therefore, by specifying a value other than “0” in this fontId, It is possible to indicate whether information on the position and orientation of the UserObject is included. That is, in the case of the receiving apparatus according to the present embodiment, when a predetermined value other than “0” is set in the fontId, it can be recognized that the position and orientation information of the UserObject is set. In the conventional receiving apparatus, even if a predetermined value other than “0” is set in the fontId, it is regarded as “0” forcibly, so that the operation is not affected.

  In patternData, information on the position and orientation of UserObject is included. The position and orientation information is data indicating in what position the UserObject should be placed on the screen of the television broadcast, for example, coordinate information of X, Y, and Z as the position, Each information of Pitch, Roll, and Pan is designated by 1 byte as the posture. Therefore, in this embodiment, the position and orientation information can be represented by 6 bytes (for 6 patternData in the case of FIG. 2).

  Next, the transmission operation in the transmission apparatus 20 having the above-described configuration is illustrated in the flowchart of FIG. 3, the reception operation in the reception apparatus 10 is illustrated in FIG. 4, and the motion detection operation of a person photographed by the camera 30 in the reception apparatus 10 is illustrated. 5 will be described with reference to the respective flowcharts. In the transmission operation and the reception operation, description will be made centering on the generation of caption information by DRCS and the operation of arranging UserObject from the caption information and superimposing it on the video information. Transmission / reception of video information and audio information is well known. Since it is the same as transmission / reception in terrestrial digital broadcasting, description thereof is omitted.

  First, the transmission operation in the transmission device 20 of FIG. 3 will be described. In step S11, information on the position and orientation of the UserObject is input to the caption-AREncoder 23, and the process proceeds to step S12. As for the position and orientation information of the UserObject, for example, the image information captured by a television camera or the like of a broadcasting station (not shown) is spatially recognized by a three-dimensional space recognition device or the like, and the image information such as the UserObject is superimposed on the receiving side. Information on the position and orientation at the time may be generated and input to the caption-AREncoder 23.

  Next, in step S12, the position and orientation information input to the subtitle-AREEncoder 23 in step S11 is converted to be included in the DRCS data field, and the process proceeds to step S13. In this step, a predetermined value other than “0” is set in the above-described fontId, and the position and orientation data of the UserObject are set in the patternData.

  Next, in step S13, a caption PES is generated by the caption-AREncoder 23, and the process proceeds to step S24.

  Next, in step S <b> 14, the mixing unit 24 generates a transport stream (TS) and transmits it from the TS transmission unit 25.

  Next, the receiving operation in the receiving apparatus of FIG. 4 will be described. In step S21, the TS receiving unit 11 receives the transport stream and proceeds to step S22.

  Next, in step S22, the separation unit 12 separates the transport stream into video PES, audio PES, and subtitle PES, and the process proceeds to step S23.

  Next, in step S23, the subtitle PES is decoded (decoded) by the subtitle-ARD Decoder 15 and the process proceeds to step S24. That is, the subtitle-ARD Decoder 15 functions as a display information extraction unit that extracts display information of image information included in the broadcast signal.

  Next, in step S24, it is determined whether or not the information on the position and orientation of the UserObject is detected from the DRCS decoded in step S23. If it is detected (in the case of Yes), the process proceeds to step S25. In the case of No), the process proceeds to step S27. Whether or not the position and orientation information of the UserObject is detected may be determined based on whether or not the fontId is a predetermined value other than “0” as described above.

  Next, in step S25, based on the information on the position and orientation of the UserObject detected in step S24, it is arranged at a predetermined position in the video information with a predetermined posture, and the process proceeds to step S26. Further, the UserObject (for example, a humanoid avatar as a three-dimensional stereoscopic image) arranged in this step operates in accordance with the movement of an object such as a person photographed by the camera 30 according to the flowchart of FIG. 5 described later. . In the present embodiment, the operation is in accordance with the movement of an object such as a person photographed by the camera 30, but it does not move exactly the same as the person photographed by the camera 30 but interlocks with the movement of the person or the like. To do something.

  Next, in Step S26, the UserObject arranged in Step S25 is superimposed on the video information decoded by the VideoDecoder 13 by the Video output unit 19 and output to a display device or the like. By doing in this way, as shown in FIG. 6, the avatar in a coordinate system undetermined state is superimposed and displayed on video information. That is, since the 3D Mapper 18 is arranged based on the display information extracted by the subtitle-ARD Decoder 15 and the video output unit 19 superimposes the image information operated by the operating unit on the video information received by the receiving unit, the 3D Mapper 18 and the Video output unit 19 functions as a display control unit. Moreover, this step S26 becomes a display control process.

  On the other hand, in Step S27, since the information of the position and orientation of UserObject is not detected, normal DRCS subtitle processing is performed.

  Next, a motion detection operation in the receiving apparatus in FIG. 5 will be described. In step S31, an image (moving image) captured by the camera 30 is input to the image analysis unit 17, and the process proceeds to step S31.

  Next, in step S32, the image analysis unit 17 detects (recognizes) the movement of the person included in the image from the image input in step S31, and outputs information indicating the movement, posture, and the like to the 3D Mapper 18. Proceed to S33. That is, the image analysis unit 17 functions as a motion recognition unit that recognizes the movement of an object, and this step is a motion recognition process.

  Next, in step S33, the 3DMapper 18 reads the UserObject from the UserObject storage unit 16, and based on the information indicating the motion and posture input from the image analysis unit 17 in step S32, UserObject is reflected to reflect the motion. To work. That is, the 3D Mapper 18 functions as an image information acquisition unit that acquires image information that operates in conjunction with the movement of the object, and this step is an image information acquisition step. Further, the 3D Mapper 18 also functions as a display control unit that operates the image information acquired by the image information acquisition unit in conjunction with the movement recognized by the motion recognition unit, and this step is also a display control process.

  As is clear from the above description of the flowchart, the receiving apparatus 10 performs the receiving operation and the motion detecting operation at the same time.

  As described above, for example, in a song program, the avatar linked to the movement of the viewer is displayed on the stage where the singer stands, and the viewer moves according to the swing of the singer, so that the camera 30 The avatar can also move in accordance with the movement of the viewer photographed in, and the viewer can feel more like singing with the singer and can be more immersed in the content.

  According to the present embodiment, the receiving apparatus 10 acquires the position and orientation information of the UserObject from the DRCS received by the subtitle-ARDDecoder 15, reads out the UserObject from the UserObject storage unit 16 using the 3D Manager 18, and acquires the position and orientation of the UserObject acquired. Since the UserObject arranged based on the information and decoded on the video information decoded by the VideoDecoder 13 is superimposed and output, the UserObject is moved with respect to the video content broadcast by the television broadcast or the like. UserObject can be easily operated because it can be displayed in conjunction with. Therefore, the viewer can be immersed and enjoyed with the broadcast content.

  In addition, it is not necessary to perform space recognition processing for placing the UserObject on the receiving apparatus 10 side, and when the UserObject such as an avatar is superimposed on the broadcast video information, it can be superimposed without performing the space recognition processing. Therefore, it is possible to reduce the processing load of the receiving apparatus even in a television broadcast in which video changes in real time. In addition, since the display information includes position and orientation information, UserObject can be appropriately displayed.

  Also, since the position and orientation information of UserObject is inserted into DRCS, display information can be included in an area that does not affect video, audio, etc. in the existing data area, and a new data area is defined. Display information can be included. Also, by including it in the DRCS that is part of the caption information, it is possible to synchronize with the video information using the PTS included in the caption PES, and to change the layout and orientation of the UserObject according to the video information. Can do.

  In addition, since the transmission apparatus 20 transmits information on the position and orientation of the UserObject when superimposing it on the video information, the caption-AREncoder 23 includes the DRCS in the transport stream and transmits the DRCS in the transport stream. Therefore, it is possible to perform broadcasting in which the UserObject can be superimposed without performing spatial recognition processing in the receiving apparatus 10.

  It is possible to specify a plurality of DRCS data formats shown in FIG. 2 in the caption information. Therefore, a plurality of types of position and orientation information are inserted into the caption information, and any of the header information of the caption information is selected. It may be specified whether to select.

  In the above-described embodiment, the human object is a human avatar as the UserObject. However, the present invention is not limited thereto, and other forms such as an animal may be used. That is, UserObject may be an image that can operate in conjunction with the movement of an object such as a person photographed by the camera 30.

  In the above-described embodiment, the UserObject is stored in the UserObject storage unit 16, but may be acquired via an external storage device, an external network, or the like.

  In the above-described embodiments, the description has been mainly made on the terrestrial digital broadcast. However, the present invention is not limited thereto, and any broadcast including video information such as a satellite broadcast may be used. Further, the position and orientation information of the UserObject is not limited to be included in the DRCS, but may be included in other areas. For example, in the subtitle information, it is possible to specify the font and display position of the subtitle to be displayed. Using this display position, the position information of the UserObject is specified, and the posture information is inserted into the code specification portion of the font. . Then, by setting the size information to the size of the second character of the subtitle character, for example, it becomes possible to insert display information equivalent to the position and orientation information of the UserObject into the subtitle information.

  In addition, the present invention can be configured as a reception program by configuring the above-described flowchart of FIG. 4 as a program that runs on a computer. That is, the subtitle-ARD Decoder 15, the image analysis unit 17, 3D Mapper 18, and the Video output unit 19 may be configured as a program that causes a computer to function.

  According to the embodiment described above, the following receiving device 10, receiving method, and transmitting device 20 are obtained.

(Supplementary Note 1) In the receiving apparatus 10 including the TS receiving unit 11 and the separating unit 12 that receive a transport stream including video information,
An image analysis unit 17 for recognizing a person's movement;
3D Mapper 18 that acquires UserObject that operates in conjunction with the movement of a person,
The UserObject acquired by the 3D Mapper 18 is operated in conjunction with the movement recognized by the image analysis unit 17 and superimposed on the video information included in the transport stream received by the TS reception unit 11 and the separation unit 12 and displayed on the display unit A 3D Mapper 18 and a Video output unit 19,
A receiving apparatus 10 comprising:

(Supplementary Note 2) In the reception method of the reception apparatus 10 including the TS reception unit 11 and the separation unit 12 that receive a transport stream including video information,
Step S32 for recognizing the movement of a person;
Step S33 for obtaining a UserObject that operates in conjunction with the movement of a person;
The UserObject acquired in step S25 is operated in conjunction with the movement recognized in step S32, and is superimposed on the video information included in the broadcast signal received by the TS receiver 11 and the separator 12, and is displayed on the display unit. , S33,
A receiving method comprising:

  According to the receiving device 10 and the receiving method, UserObject linked to the movement of a person or the like (viewer) can be superimposed and displayed on video content broadcast by television broadcasting or the like. Therefore, the viewer can be immersed and enjoyed with the broadcast content.

(Supplementary Note 3) In the transmission device 20 including the mixing unit 24 and the TS transmission unit 25 that transmit a transport stream including video information,
A subtitle PES-AREncoder 23 that obtains information on the position and orientation of UserObject, which is information for displaying a UserObject different from the video signal on the transport stream,
The mixing unit 24 and the TS transmission unit 25 transmit information including the position and orientation information of the UserObject acquired by the subtitle PES-AREncoder 23 in the transport stream.
A transmitting apparatus 20 characterized by that.

  According to this transmission apparatus 20, in order to transmit the information of the position and orientation of the UserObject in the transport stream, the transport stream that can superimpose the UserObject without performing the spatial recognition process in the reception apparatus 10 is broadcast. can do.

  In addition, the Example mentioned above only showed the typical form of this invention, and this invention is not limited to an Example. That is, various modifications can be made without departing from the scope of the present invention.

10 Receiving Device 11 TS Receiver (Receiver)
12 Separation unit (reception unit)
15 Subtitle-ARD Decoder (Display Information Extraction Unit)
17 Image analysis unit (motion recognition unit)
18 3D Mapper (image information acquisition unit, operation unit, display control unit)
19 Video output unit (display control unit)
20 Transmitter 23 Subtitle-AREncoder (Display Information Acquisition Unit)
24 Mixer (transmitter)
25 TS transmitter (transmitter)
S23 DRCS decoding (display information extraction process)
S25 UserObject arrangement (image information acquisition process)
S26 Superimposition (display control process)
S32 Motion recognition (motion recognition process)
S33 Motion reflection (display control process)

Claims (9)

In a receiving device including a receiving unit that receives a broadcast signal including video information,
A motion recognition unit for recognizing the movement of an object;
An image information acquisition unit that acquires image information that operates in conjunction with the movement of the object;
The image information acquired by the image information acquisition unit is operated in conjunction with the motion recognized by the motion recognition unit, and is superimposed on the video information included in the broadcast signal received by the reception unit and displayed on the display unit A display control unit
A receiving apparatus comprising: A display information extraction unit that extracts display information of the image information included in the broadcast signal;
The display control unit causes the display unit to display the image information superimposed on the video information based on the display information extracted by the display information extraction unit.
The receiving apparatus according to claim 1.   The receiving apparatus according to claim 2, wherein the display information is information indicating a position and a posture when displayed in the image information.   The receiving apparatus according to claim 2 or 3, wherein the display information is included in an area in which caption information of the broadcast signal is inserted.   The receiving apparatus according to claim 1, wherein the image information is information indicating an anthropomorphic shape image. In a transmission device including a transmission unit that transmits a broadcast signal including video information,
A display information acquisition unit that acquires display information that is information for displaying the image information different from the video information superimposed on the broadcast signal;
The transmission unit includes the display information acquired by the display information acquisition unit and transmits it in the broadcast signal.
A transmission apparatus characterized by the above. In a receiving method of a receiving device including a receiving unit that receives a broadcast signal including video information,
A motion recognition process for recognizing the motion of an object;
An image information acquisition step of acquiring image information that operates in conjunction with the movement of the object;
The image information acquired in the image information acquisition step is operated in conjunction with the motion recognized in the motion recognition step, and is superimposed on the video information included in the broadcast signal received by the reception unit and displayed on the display unit A display control process for
A receiving method comprising:   A receiving program that causes a computer to execute the receiving method according to claim 7.   A computer-readable recording medium storing the receiving program according to claim 8.

Images