JP6366070B2 - A text content generation device, a transmission device, a reception device, and a program. - Google Patents

Description

  The present invention relates to a text content generation device, a transmission device, a reception device, and a program. The present invention particularly relates to the generation, transmission, and reception of broadcast content.

  Television broadcast signals include text data called subtitles. A television broadcast receiving apparatus has a function of receiving a broadcast signal, extracting text data such as subtitles from the broadcast signal, and displaying the extracted text so as to overlap the video. At this time, if the resolution of the video assumed in the situation in which the subtitle text or the like was produced and the resolution of the video when actually broadcasted, the subtitle text is not displayed in the originally intended area. Can happen.

  As a technique for solving such a problem, in Patent Document 1 (particularly, paragraph 0017), a caption analysis unit (806) analyzes caption data, and based on the analysis result, a caption display determination unit (807) A configuration is described in which it is determined whether or not a caption enters the display area, and the caption display position correction unit (808) corrects the display position.

JP 2010-245618 A

  However, the technique described in Patent Document 1 has a problem that the processing for analyzing caption data on the receiving device side is complicated, and the processing load for the analysis and correction is large. Also, the resolution of the broadcast video to be played back on the receiving device side when the broadcast signal propagation status changes in a situation where the broadcast video resolution is dynamically switched or hierarchical transmission is being performed in order to implement multi-service organization However, in such a case, there is a problem that determination and correction processing related to subtitle display must be performed each time.

  For this reason, it can be considered that information relating to the resolution of the broadcast video and information relating to the resolution of the text display such as captions are included in the broadcast signal itself. However, as a facility on the broadcast side (such as a transmission device), the conventional technique has a problem that there is no mechanism for supplying information related to the resolution of text display such as subtitles for such a purpose.

  The present invention has been made on the basis of the above problem recognition, and is a text that can correctly supply information relating to the display resolution of text content (such as captions and character superimposes) to a transmission device that transmits a broadcast signal. A content generation device (or program) and a transmission device are provided. The present invention also provides a receiving device (or program) that receives the broadcast signal.

  [1] In order to solve the above-described problem, a text content generation device according to an aspect of the present invention includes a resolution setting unit that sets resolution information related to screen resolution, text, and information related to the placement of the text on the screen. A text data generation unit that generates text content data including the resolution information set by the resolution setting unit, and the text content data generated by the text data generation unit is supplied to a broadcast transmission facility. And a data exchange unit for transmission.

  [2] Further, according to an aspect of the present invention, in the text content generation device, the text data generation unit generates the text content data by including information on the presentation time of the text.

  [3] Further, according to an aspect of the present invention, in the text content generation device, the text data generation unit includes the resolution information in a header portion of the text content data described in a timed text markup language. It is characterized by that.

  [4] One embodiment of the present invention is a program for causing a computer to function as the text content generation device described above.

[5] Further, according to one aspect of the present invention, text content data including text, information regarding the arrangement of the text on the screen, and resolution information indicating resolution when the text is displayed on the screen is externally received. A text acquisition unit to be acquired, and a multiplexing unit that generates a broadcast signal obtained by multiplexing the text, video, and audio, and includes the resolution information included in the acquired text content data in the broadcast signal And a transmission unit that transmits the broadcast signal generated by the multiplexing unit.
[6] According to another aspect of the present invention, a receiving unit that receives a broadcast signal, a separating unit that separates the broadcasting signal received by the receiving unit, and a video signal separated by the separating unit, A video processing unit for decoding, a text processing unit that receives text content that is at least one of subtitles and character supervisions separated by the separation unit, and outputs the text content including resolution information of the text content; A presentation control unit that, when the resolution of the video and the resolution of the text content are different, changes the resolution of the text content to match the resolution of the video, and outputs the video and the text content in an overlapping manner; , A receiving device.
[7] One embodiment of the present invention is a program for causing a computer to function as the receiving device.

  According to the present invention, resolution information of text content can be supplied to a transmission device. Further, since such a transmission apparatus can transmit the broadcast signal including the resolution information of the text content, it is not necessary for the reception apparatus to analyze the caption data or the like in order to estimate the resolution.

It is a block diagram which shows schematic function structure of the text content production | generation apparatus and transmission apparatus by embodiment of this invention. FIG. 3 is a block diagram illustrating a schematic functional configuration of a receiving apparatus that receives a signal transmitted from the transmitting apparatus according to the embodiment and displays video, text content, and the like. It is an example of a screen for demonstrating the overlay process performed by the presentation control part by the embodiment. It is a figure which shows the correspondence for the presentation control part by the same embodiment to perform the resolution adjustment between content, and shows the case where the resolution of a text content is united with the resolution of a broadcast video. It is a figure which shows the correspondence for the presentation control part by the same embodiment to perform the resolution adjustment between content, and shows the case where the resolution of a broadcast image is matched with the resolution of a text content. It is a figure which shows the correspondence for the presentation control part by the same embodiment to perform the resolution adjustment between content, and shows the case where an image (video) with a higher resolution is matched with a lower resolution. It is a figure which shows the correspondence for the presentation control part by the same embodiment to perform the resolution adjustment between content, and shows the case where an image (video) with a lower resolution is matched with a higher resolution.

Next, embodiments of the present invention will be described with reference to the drawings.
[Embodiment]
FIG. 1 is a block diagram illustrating a schematic functional configuration of a text content generation device and a transmission device that constitute equipment of a broadcasting station as an embodiment. As illustrated, the text content generation device 1 includes a text editing unit 11, a resolution setting unit 12, a text data generation unit 14, and a data exchange unit 15. The transmission apparatus 2 includes an audio acquisition unit 21, a video acquisition unit 22, a text acquisition unit 23, a control information setting unit 24, a multiplexing unit 25, a modulation unit 26, and a transmission unit 27. Consists of.

First, the text content generation device 1 side will be described.
The text content generation device 1 generates text content such as subtitles and superimpose characters. Here, the subtitle is text related to the content of the broadcast program, and is displayed on the video screen on the receiving device side. Also, the text super is text that is not directly related to the content of the broadcast program, and is displayed on the receiving device side so as to be superimposed on the video of the broadcast program. Here, “super” is an abbreviation derived from “superimpose” (superposition). A typical example of subtitles is text (displaying Japanese speech with Japanese characters) expressing the content of speech. In addition, as a subtitle application, for example, a Japanese translation text in a program broadcast in English sound may be displayed. A typical example of a character supermarket is a news bulletin or an emergency earthquake bulletin transmitted in the middle of a broadcast program. Subtitles and superimposes belong to text assets in the broadcast signal. The function of each part constituting the text content generation device is as follows.

  The text editing unit 11 edits text. The text editing unit 11 edits text data displayed as subtitles or character supervisions, for example, by accepting input of new text data or changing part of existing text data based on a user operation. To do. Further, the text editing unit 11 sets the layout and character attributes (color, font type, font size, etc.) for displaying the text based on the operation by the user. The text editing unit 11 passes the text that is the result of the editing operation and information about its layout to the text data generation unit 14.

  The resolution setting unit 12 sets a resolution for displaying text as a caption or a character superimposition. This is a setting of resolution information related to the resolution of the screen displaying the text content. That is, the resolution setting unit 12 sets the resolution for displaying the text content. The resolution is represented by the number of pixels on the screen on the receiving device side. For example, there are three resolutions: horizontal 1920 pixels × vertical 1080 pixels (so-called “2K”), horizontal 3840 pixels × vertical 2160 pixels (so-called “4K”), and horizontal 7680 pixels × vertical 4320 pixels (so-called “8K”). is there.

  The text data generation unit 14 generates text data based on the information about the text, layout, etc. passed from the text editing unit 11 and the resolution setting by the resolution setting unit 12. In the present embodiment, the text data generation unit 14 generates data described in TTML (Timed Text Markup Language) at this time. TTML is a markup language provided with tag information for designating a presentation time. Further, a text layout (arrangement on the screen, etc.) can be specified by TTML.

Further, the text data generation unit 14 adds information related to the resolution of the screen at the time of displaying the text in a form embedded in (or attached to) the text data to be generated. As an example, the text data generation unit 14 adds resolution information as meta data to the header portion of a TTML format file. A specific example is data such as “<meta name =" resolution "content =" 7680 "/>". In the case of this example, information of a data name “resolution” (resolution) and a value “7680” is added in a meta tag. This value “7680” represents the number of pixels in the horizontal direction on the screen. The data representing the resolution is not limited to the number of pixels in the horizontal direction, and the number of pixels in the vertical direction may be used. Further, the resolution may be expressed using an index value corresponding to a combination of the number of pixels in the vertical direction and the horizontal direction.
That is, the text data generation unit 14 generates text content data including text, information regarding the arrangement of the text on the screen, and resolution information set by the resolution setting unit 12. Note that the text content data described in TTML includes information related to the text presentation time. That is, the text data generation unit 14 generates text content data including text presentation time information.

  The data exchange unit 15 has a function of exchanging text content data generated by the text data generation unit 14 with an external device. Specifically, the data exchange unit 15 passes the generated text data to the transmission device 2. In other words, the data exchange unit 15 transmits the text content data generated by the text data generation unit 14 in order to supply the broadcast transmission facility.

Next, the transmitting apparatus 2 side will be described.
The transmission apparatus 2 is an apparatus that transmits a television broadcast signal.
The sound acquisition unit 21 acquires the sound of the broadcast program from the outside and encodes it using a predetermined encoding method.
The video acquisition unit 22 acquires a video of a broadcast program from the outside, and encodes it using a predetermined encoding method. At this time, the video has a predetermined resolution (for example, horizontal 7680 pixels × vertical 4320 pixels).

The text acquisition unit 23 acquires text content data from the data exchange unit 15 of the text content generation device 1. As described above, the text content data includes, in addition to the text itself, information relating to layout, information relating to character attributes, and information relating to the resolution of display of the text content. Information relating to the display resolution is stored as an example in the header portion of data in TTML format.
That is, the text acquisition unit 23 externally outputs text content data including text, information regarding the arrangement of the text on the screen, and resolution information indicating the resolution when the text is displayed on the screen (on the text content generation device 1 side). Get from.
The control information setting unit 24 sets various control information related to broadcasting.

The multiplexing unit 25 includes encoded audio data passed from the audio acquisition unit 21, encoded video data passed from the video acquisition unit 22, text content data passed from the text acquisition unit 23, The control information passed from the control information setting unit 24 is multiplexed. The multiplexing unit 25 generates multiplexed data according to a predetermined transmission system for broadcasting. Examples of the transmission method used include MMT (MPEG Media Transport), MPEG-2 TS (Moving Picture Experts Group-2 Transport Stream), and RTP (Real-time Transport Protocol).
That is, the multiplexing unit 25 generates a broadcast signal obtained by multiplexing text, video, and audio, and includes the resolution information included in the acquired text content data in the broadcast signal.

The modulator 26 is multiplexed by the multiplexer 25 and modulates data for transmission.
The transmission unit 27 transmits the signal output from the modulation unit 26. The broadcast signal transmitted from the transmission unit 27 is transmitted as a radio wave, an electric signal on a cable, or an optical signal.

  As described above, in this embodiment, the text content generation device 1 can supply the transmission device 2 with resolution information for displaying the text content. Further, based on the resolution information supplied from the text content generation device 1, the transmission device 2 includes the resolution information of the text content in the broadcast signal and transmits the broadcast signal. As a result, on the receiving device (television receiver) side, the resolution of the text content intended by the creator can be obtained without analyzing the coordinate information of the text content itself.

Next, a receiving apparatus that receives a broadcast signal transmitted from the transmitting apparatus 2 will be described.
FIG. 2 is a block diagram showing a schematic functional configuration of the receiving apparatus. The receiving device 5 includes a receiving unit 51, a separation unit 52, a video / audio processing unit 53 (video processing unit), a text processing unit 54, a presentation control unit 55, and an output unit 56. The

The receiver 51 receives the digital broadcast signal from the transmitter 2 and demodulates it.
The separating unit 52 separates the broadcast signal received by the receiving unit 51 into video, audio, text, and control information. The separation unit 52 outputs the separated video, audio, text (text content), and control information.
The video / audio processing unit 53 receives and decodes the video and audio signals separated by the separation unit 52, respectively. The video / audio processing unit 53 passes each of the decoded video and audio to the presentation control unit 55. These video and audio are associated with information indicating the presentation timing.
That is, the video / audio processing unit 53 receives and decodes the video signal separated by the separation unit 52.

The text processing unit 54 receives the text content separated by the separation unit 52, and passes the text content (caption or character super) to the presentation control unit 55. The text content is described in the TTML format. That is, the text content is associated with information indicating the presentation timing. The text content data includes layout information and character attribute information. Further, the text content data includes display resolution information on the screen. The text processing unit 54 passes information on the display resolution of the text to the presentation control unit 55.
That is, the text processing unit 54 receives the text content separated by the separation unit 52 and is at least one of subtitles and superimpose characters, and outputs the text content including the resolution information of the display on the screen of the text content. .

The presentation control unit 55 outputs content such as video, audio, and text from the output unit 56 in accordance with the designated presentation time. Note that the presentation control unit 55 acquires the information on the resolution of the video and the information on the resolution of the text content, and superimposes (overlays) both of the display contents, and passes them to the output unit 56. The presentation control unit 55 adjusts the resolution of the video of the television broadcast and the resolution of the display of the text content and overlays both. Specifically, the presentation control unit 55 determines the resolution between the video and the output image of the text content based on the text resolution information passed from the text processing unit 54 and the video resolution restored by the video / audio processing unit 53. Process to match. Details of the resolution adjustment will be described later.
That is, the presentation control unit 55 outputs the video and text content in an overlapping manner.
The output unit 56 outputs the video passed from the presentation control unit 55 and the overlaid text content on the screen. Further, the output unit 56 outputs the voice delivered from the presentation control unit 55 from a speaker or the like.

Next, details of processing for overlaying broadcast video and text content will be described.
FIG. 3 is a diagram illustrating an example of a screen for explaining overlay processing by the presentation control unit 55. FIG. 2A shows a video image of television broadcasting. FIG. 4B shows an example of text content. FIG. 3C shows a state in which a television broadcast video and a text content are superimposed and displayed.

  The creators of the text content shown in FIGS. 2B and 2C perform production intended to arrange the text content in a balanced manner in the entire screen. The presentation control unit 55 controls the overlay so that both are displayed in good balance as shown in FIG. 5C even when the resolution of the video of the TV broadcast is different from the output resolution of the text content. To do. In other words, as a result of such control by the presentation control unit 55, the text content is prevented from being displayed outside the screen, or the text content is prevented from being displayed in a reduced size more than necessary on the screen.

When the video resolution and the text content resolution are different, the presentation control unit 55 changes the text content resolution to match the video resolution.
That is, when the resolution of the video and the resolution of the text content are different, the presentation control unit 55 changes the resolution of the text content so as to match the resolution of the video, and outputs the video and the text content in an overlapping manner.
Conversely, the presentation control unit 55 may change the video resolution to match the resolution of the text content. In these cases, the presentation control unit 55 appropriately upsamples or downsamples the content to be changed.
4 and 5 show the correspondence relationship of the resolution adjustment of the content by the presentation control unit 55. FIG. FIG. 4 is a correspondence diagram when the presentation control unit 55 matches the resolution of the text content with the resolution of the broadcast video. FIG. 5 is a correspondence diagram when the presentation control unit 55 matches the resolution of the broadcast video to the resolution of the text content. The presentation control unit 55 may use either method of FIG. 4 or FIG.

  FIG. 4 shows a two-dimensional table, where the horizontal direction corresponds to the resolution of the text content, and the vertical direction corresponds to the resolution of the broadcast video. In this example, the resolution of the text content and the resolution of the broadcast video are 1920 pixels × 1080 pixels (so-called “2K”), 3840 pixels × 2160 pixels (so-called “4K”), 7680 pixels × 4320 pixels. There are three types of pixels (so-called “8K”). However, the types of resolution are not limited to these three types, and other resolutions may be used. When the correspondence relationship of FIG. 4 is used, the text content is appropriately upsampled or downsampled to match the resolution of the broadcast video. If the output resolution from the application and the resolution of the broadcast video are originally equal, overlay is performed without changing the resolution. As shown in FIG. 4, when the resolution of the broadcast video is (4-1) horizontal 1920 pixels × vertical 1080 pixels, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 1920 pixels × vertical 1080. Pixel. Also, (4-2) when the resolution of the broadcast video is horizontal 3840 pixels × vertical 2160 pixels, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 3840 pixels × vertical 2160 pixels. Further, (4-3) when the resolution of the broadcast video is horizontal 7680 × vertical 4320, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 7680 pixels × vertical 4320 pixels.

  FIG. 5 is also a two-dimensional table similar to FIG. 4, and has three resolutions: horizontal 1920 pixels × vertical 1080 pixels, horizontal 3840 pixels × vertical 2160 pixels, and horizontal 7680 pixels × vertical 4320 pixels. In the case of using the correspondence relationship of FIG. 5, the presentation control unit 55 matches the resolution of the text content by appropriately upsampling or downsampling the broadcast video. When the resolution of the text content is equal to the resolution of the broadcast video, the overlay is performed without changing the resolution. As shown in FIG. 5, (5-1) when the resolution of the text content is 1920 horizontal pixels × 1080 vertical pixels, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is 1920 horizontal pixels × vertical 1080 pixels. Pixel. Further, (5-2) when the resolution of the text content is horizontal 3840 pixels × vertical 2160 pixels, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 3840 pixels × vertical 2160 pixels. Further, (5-3) when the resolution of the text content is horizontal 7680 × vertical 4320, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 7680 pixels × vertical 4320 pixels.

Further, the presentation control unit 55 may determine which content resolution is to be dynamically adjusted according to the actual resolution of each content.
6 and 7 are diagrams illustrating the correspondence relationship of the resolution adjustment of the content by the presentation control unit 55. FIG. FIG. 6 is a correspondence diagram in the case where the presentation control unit 55 matches content with a higher resolution to a content with a lower resolution. FIG. 7 is a correspondence diagram in the case where the presentation control unit 55 matches content with a lower resolution to a content with a higher resolution. The presentation control unit 55 may use one of the methods in FIG. 6 or FIG. 7 instead of the method in FIG. 4 or FIG.

  FIG. 6 shows a two-dimensional table. The horizontal direction corresponds to the output resolution of the text content, and the vertical direction corresponds to the resolution of the broadcast video. In this example, the output resolution of the text content and the resolution of the broadcast video are three types: 1920 horizontal pixels × 1080 vertical pixels, 3840 horizontal pixels × 2160 vertical pixels, 7680 horizontal pixels × 4320 vertical pixels. However, the types of resolution are not limited to these three types, and other resolutions may be used. When the correspondence relationship of FIG. 6 is used, the presentation control unit 55 matches the lower resolution by down-sampling the higher-resolution content out of the output from the text content and the output from the broadcast video. If the output resolution of the text content and the resolution of the broadcast video are the same, the overlay is performed without changing the resolution. As shown in FIG. 6, (6-1) an image (video) passed from the presentation control unit 55 to the output unit 56 when either the text content resolution or the broadcast video resolution is 1920 pixels wide × 1080 pixels high. The resolution is 1920 pixels wide × 1080 pixels vertical. (6-2) When either one of the resolution of the text content and the resolution of the broadcast video is horizontal 3840 pixels × vertical 2160 pixels, and the other resolution is horizontal 3840 pixels × vertical 2160 pixels or more The resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 3840 pixels × vertical 2160 pixels. (6-3) When both the resolution of the text content and the resolution of the broadcast video are horizontal 7680 × vertical 4320, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 7680 pixels × vertical 4320 pixels. It is.

  FIG. 7 is also a two-dimensional table similar to FIG. 6, and has three resolutions: horizontal 1920 pixels × vertical 1080 pixels, horizontal 3840 pixels × vertical 2160 pixels, and horizontal 7680 pixels × vertical 4320 pixels. In the case of using the correspondence relationship of FIG. 7, the presentation control unit 55 matches the higher resolution by up-sampling the content with the lower resolution out of the output from the text content and the output from the broadcast video. If the output resolution of the text content and the resolution of the broadcast video are the same, the overlay is performed without changing the resolution. As shown in FIG. 7, (7-1) an image (video) passed from the presentation control unit 55 to the output unit 56 when either the text content resolution or the broadcast video resolution is 7680 pixels × 4320 pixels. The resolution is 7680 pixels by 4320 pixels. (7-2) When either one of the resolution of the text content or the resolution of the broadcast video is horizontal 3840 pixels × vertical 2160 pixels and the other resolution is horizontal 3840 pixels × vertical 2160 pixels or less The resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is horizontal 3840 pixels × vertical 2160 pixels. Further, (7-3) when both the resolution of the text content and the resolution of the broadcast video are 1920 × 1080 in the horizontal direction, the resolution of the image (video) passed from the presentation control unit 55 to the output unit 56 is 1920 pixels × vertical. 1080 pixels.

  In addition, you may make it implement | achieve the whole or one part of the function of the text content production | generation apparatus in the embodiment mentioned above, the transmission apparatus, and the receiving apparatus with a computer. In that case, the program for realizing the control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible disk, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, a “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory inside a computer system serving as a server or a client in that case may be included, and a program that holds a program for a certain period of time. The program may be a program for realizing a part of the above-described functions, or may be a program that can realize the above-described functions in combination with a program already recorded in a computer system.

The present invention can also be implemented in the following modifications.
For example, in the above embodiment, the text data generation unit 14 adds resolution information as meta data to the header portion of a TTML file. Instead, the information regarding the resolution at the time of displaying the text content may be added to other parts and passed from the text content generation device 1 to the transmission device 2.
For example, the resolution information of the text content may be stored using a tag other than “meta” in the header portion of the TTML data.
For example, the resolution information of the text content may be stored in a portion other than the header of the TTML data.
For example, the resolution information of the text content may be stored in the comment area in the TTML data.
For example, the resolution information of the text content may be added as a file different from the TTML data.
Further, the resolution information of the text content may be passed to the transmitting apparatus 2 side by other methods.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

  The present invention can be used for television broadcasting and other video distribution businesses.

DESCRIPTION OF SYMBOLS 1 Text content generation apparatus 2 Transmission apparatus 5 Reception apparatus 11 Text editing part 12 Resolution setting part 14 Text data generation part 15 Data exchange part 21 Audio | voice acquisition part 22 Image | video acquisition part 23 Text acquisition part 24 Control information setting part 25 Multiplexing part 26 Modulation unit 27 Transmission unit 51 Reception unit 52 Separation unit 53 Video / audio processing unit (video processing unit)
54 Text Processing Unit 55 Presentation Control Unit 56 Output Unit

Claims (2)

A receiver for receiving broadcast signals;
A separator for separating the broadcast signal received by the receiver;
A video processing unit for receiving and decoding a video signal separated by the separation unit;
A text processing unit that receives the text content that is at least one of subtitles or character supervision separated by the separation unit, and outputs the text content including information on the resolution of the text content;
As the processing for matching the resolution of the video and the text content based on the resolution information of the video decoded by the video processing unit and the resolution information of the text content passed from the text processing unit, the video When the resolution of the text content is different from the resolution of the text content, the resolution of the text content is changed to match the resolution of the video by up-sampling or down-sampling the text content, and the video and the text content are A presentation control unit that outputs in a superimposed manner;
A receiving apparatus comprising:   A program for causing a computer to function as the receiving device according to claim 1.

Images