JP5409082B2 - Video processing apparatus and control method thereof - Google Patents

Description

  The present invention relates to a digital television broadcast receiving apparatus that executes a subtitle display process of digital television broadcast and a control method thereof.

  In recent years, in the field of digital television broadcasting, research and development of higher resolution video than conventional high-definition video (HD (High Definition)) (1920 × 1020) has been progressing. Among them are digital cinema (3840x2160) and Super Hi-Vision (SHV (Super Hi-Vision)) (7680x4320). Display devices and transmission devices that support SHV video will be announced and SHV broadcasting will be started in the future. It is.

  When SHV broadcasting is started, a receiving device having a display device that supports SHV video can receive the SHV broadcast and display the SHV video. However, the entire SHV video cannot be displayed by a receiving device having a display device that can display only video up to the resolution of the existing HD video (hereinafter referred to as “HD receiving device”).

  Therefore, when displaying the SHV video on the display device of the HD receiving device, the HD receiving device may extract the resolution range (partial range) of the HD video from the SHV video (or discard the outside of the range) and display it. is assumed. In this case, it is assumed that a particularly notable range in the SHV video is extracted with the resolution of the HD video (hereinafter “cutout”). For example, in the case of a soccer game in which the SHV video overlooks the entire field, it is assumed that the soccer ball is always cut out so as to be projected.

  In recent years, improvements in accessibility (ease of use) in consideration of persons with disabilities have been required of all products and systems, and digital television broadcasting and related products are no exception. In digital television broadcasting, caption display is important for people with hearing impairments, and the number of caption broadcast programs has increased considerably. Subtitle display is an essential function also in the above-mentioned SHV broadcast. Subtitles are usually located near the speaker (sound source) and do not hide important parts of the video (such as human faces) so that it is easy to determine who (what) is the word (speech). Is displayed.

FIG. 1 is a diagram illustrating an example of an SHV video displaying subtitles.
The SHV video 100 displays subtitles 120, 121, 122, and 123. Further, a range of a screen (hereinafter referred to as “cutout screen”) displayed on the display device of the HD receiving device is indicated by a cutout range 110 (cutout position 111).
FIG. 2 is a diagram showing a range in which the subtitles 120 to 123 are included in the cutout screen. In FIG. 2, the hatched portion of the subtitle indicates that it is outside the cutout range 110.

  FIG. 18 is a diagram showing an image displayed on the display device of the existing HD receiver after the SHV image 100 of FIG. In FIG. 18, all subtitles are displayed for the subtitle 120, only a part of the subtitles are displayed for the subtitles 122 and 123, and all subtitles are not displayed for the subtitle 121. As described above, when the SHV video displaying subtitles is cut out and displayed, the subtitles are partially missing or all the subtitles are not displayed, and the contents of the subtitles cannot be read.

  Japanese Patent Application Laid-Open No. 2004-151867 executes a change in the subtitle display position and display mode depending on the resolution mismatch between the broadcast video and the display device and the display mode.

Japanese Patent Laid-Open No. 08-154216

  However, in Patent Document 1, when the broadcast video and the display device have different aspect ratios, the broadcast video is horizontally compressed, the subtitles are displayed in the vertical reading direction at the right end of the horizontal compressed video, and the position and display form of the subtitles are displayed. To change. That is, Patent Document 1 does not change the display position based on the position information of the caption, but always displays the caption at the same position on the screen. Therefore, according to Patent Document 1, it is not possible to improve the position of a caption that is cut out from an arbitrary position of the SHV video.

To solve the problems described above, the image processing apparatus of an embodiment of the present invention is a video processing apparatus for processing a video signal, the caption analysis to analyze the placement of the subtitle data multiplexed into a video signal means, and placement of the caption data, based on the positional relationship between the part of the display area of the image according to the video signal, whether to change the display position of the subtitles to be displayed based on the subtitle data A subtitle display determining unit for determining, a subtitle display position correcting unit for changing the display position of the subtitle based on a result determined by the subtitle display determining unit, and a subtitle whose display position has been changed and a subtitle which has not been changed. Subtitle character color changing means for making colors different .

  According to the present invention, subtitle data displayed across the boundary of the cut-out screen is analyzed by analyzing the arrangement information of the subtitle data displayed on the cut-out screen, and performing display position correction, character size change, and character color change. Can be eliminated. Accordingly, it is possible to display proper subtitles on the cut-out screen. Moreover, even if the cutout position changes after the caption display, the caption visibility and convenience for the user can be improved because the caption is displayed as it is for the designated caption presentation time.

It is a figure showing an example of the SHV image | video which displayed the subtitle. It is a figure showing the range where the subtitles are in the cutout screen. It is a block diagram showing the basic composition of the digital television broadcast receiver which concerns on Embodiment 1 of this invention. It is a figure showing the data structure of PES. It is a figure showing the data structure of subtitle data. It is a figure which shows allocation of the data group identification with respect to caption data. It is a figure showing a caption plane and a caption display area. It is a figure showing the display section of a subtitle character. It is a flowchart showing the operation | movement of the caption processing based on Embodiment 1 of this invention. It is the figure which combined and represented the cut-out screen and subtitle display area of FIG. It is a figure showing the example of a display of the cut-out screen at the time of implementing Embodiment 1 of this invention. It is a block diagram showing the basic composition of the digital television broadcast receiver which concerns on Embodiment 2 of this invention. It is a flowchart showing operation | movement of the caption processing based on Embodiment 2 of this invention. It is a figure showing the example of a display of the cut-out screen at the time of implementing Embodiment 2 of this invention. It is a block diagram showing the basic composition of the digital television broadcast receiver which concerns on Embodiment 3 of this invention. It is a flowchart showing operation | movement of the caption processing based on Embodiment 3 of this invention. It is a figure showing the example of a display of the cut-out screen at the time of implementing Embodiment 3 of this invention. It is the figure showing the image which cut out SHV image | video by the conventional method and displayed on the display apparatus of HD receiver.

<Embodiment 1>
In the first embodiment, when an SHV video is received by the HD receiver and the SHV video is cut out with the resolution of the HD video, subtitles that do not fit within the cutout range are determined, and the display position is corrected to display all subtitles. The case will be described. A case where subtitles are not displayed will also be described.

[Basic configuration of digital TV broadcast receiver]
FIG. 3 is a block diagram showing the basic configuration of the digital television broadcast receiver according to this embodiment.
The input unit 801 receives a high-frequency digital broadcast signal transmitted from the transmission side (broadcast station) via an antenna terminal and a tuner (not shown). The signal input unit 801 performs A / D conversion on the received digital broadcast signal, and then demodulates the signal subjected to digital modulation processing on the transmission side. Examples of the digital modulation method include 32 APSK (32-Ary Amplitude and Phase Shift Keying), 16 APSK (16-Ary APSK), and QPSK (Quadrature Phase Shift Keying). The signal input unit 801 performs forward error correction (FEC) decoding on the demodulated digital broadcast signal, and TS (Transport
Stream) signal is restored, and the TS signal is transmitted to the separation unit 802.
The separation unit 802 discriminates the type of component (video, audio, broadcast data, etc.) of the TS signal received from the input unit 801 based on the stream ID 302 of the PES 300 to be described later, and sends it to each processing unit according to the type of component. Send.

A display area storage unit 803 (display area storage means) stores a cutout position and a cutout size (display area) for cutting out the HD video from the SHV video. The cut-out position is designated by the user through an operation of a remote controller (not shown), or is designated by a broadcast signal such as SI (Service Information) from the transmission side.
The data processing unit 804 performs processing corresponding to the broadcast data received from the separation unit 802. The received data includes SI (Service Information) and PSI (Program Specific Information), which are information on the selected service (broadcast station) and programs.
The video decoding unit 805 includes MPEG2, H.264, and the like. A video stream encoded by a high-efficiency encoding method such as H.264 is received from the separation unit 802 and decoded into video data. The video decoding unit 805 stores the video data extracted based on the information on the extraction position and the extraction size stored in the display area storage unit 803 in the internal video plane memory, and responds to the output request from the synthesis unit 810. Output the stored video data.

A caption analysis unit 806 (caption analysis means) analyzes constituent elements (such as subtitle data arrangement information) of the caption management data 406 and caption text data 415.
The subtitle display determination unit 807 (subtitle display determination means) is based on the subtitle sentence data 415 analyzed by the subtitle analysis unit 806 and is within the range of the cut-out screen in which the subtitle is stored in the display region storage unit 803 (in the display region). Determine whether to enter. The subtitle display determination unit 807 determines whether to change the subtitle display position based on the positional relationship between the subtitle data arrangement information and the cut-out screen (display area), and whether to display the subtitle. judge.
A subtitle display position correction unit 808 (subtitle display position correction means) changes the subtitle display determination unit 807 so that the subtitle display position that does not fall within the cutout screen range falls within the cutout screen range.
The subtitle display unit 809 has a subtitle plane memory for writing a character bitmap. Bitmap data is generated by a character rasterizer (a processing unit that creates a bitmap corresponding to the character code) from the character code of the caption data determined to be displayed by the caption analysis unit 806 and the caption display determination unit 807. The character code is recorded in a flash memory (not shown). The bitmap data is written at the subtitle plane position corresponding to the display position obtained by the subtitle display position correction unit 808. Also, the caption display unit 809 measures the time indicated by the caption text data 415 when the screen deletion (CS) of the extended control code (CSI) is detected, or measures the period indicated by the time control (TIME) of the extended control code, and sets it as the end time. If it becomes, the subtitle sentence is cleared. The caption display unit 809 outputs the content of the caption plane memory stored in response to the output request from the synthesis unit 810.

The synthesizing unit 810 requests the video decoding unit 805 to output a video plane to obtain a video plane. Similarly, a subtitle plane is obtained by requesting the subtitle display unit 809 to output a subtitle plane. The synthesizing unit 810 generates video data by converting and synthesizing the video plane and the caption plane to the HD resolution, and outputs the generated video data to the video output unit 811.
The video output unit 811 converts the video data generated by the synthesis unit 810 into a video signal and outputs the video signal to a display device (not shown).
The audio decoding unit 812 is an MPEG2 AAC (Advanced
Audio Coding), an audio stream encoded and formatted by linear PCM or the like is decoded, and the decoded audio data is output to the audio output unit 813.
The audio output unit 813 converts the audio data output from the audio decoding unit 812 into an audio signal, and outputs the audio signal to an audio generator such as a speaker (not shown).

[Composition of subtitle data]
In digital television broadcasting, each component such as video, audio, and broadcast data is multiplexed and transmitted by a multiplexing method called MPEG2 system (Moving Picture Experts Group 2 Systems). Each component is encoded in a format called an elementary stream (ES (Elementary Stream)), and is then converted into a PES (Packetized).
It is divided and packetized into units called Elementary Stream).

FIG. 4 is a diagram showing the data structure of PES.
The PES 300 includes a packet start code prefix 301, a stream ID 302, a PES packet length 303, and a PES data area 304. The packet start code prefix 301 indicates the start of the PES, and the stream ID 302 indicates the type of data. The PES packet length 303 indicates the length of the PES data area 304, and the PES data area 304 accommodates compressed video data, audio data, subtitle data, and the like.

FIG. 5 is a diagram showing the data structure of caption data accommodated in the PES data area 304. The caption data is data-grouped by a data group configuration as shown in FIG. 4, and one caption data is composed of a maximum of 256 data groups.
A data group identification (DGI) 401 identifies the type of caption management data and caption text data. FIG. 6 shows assignment of data group identification to each caption data. As shown in FIG. 6, it is possible to transmit subtitle sentences in up to 8 languages such as Japanese and English. Each time the subtitle management data is updated, the data group is switched to set A and set B and transmitted.
The data group version (DG Version) 402 indicates the version of the data group, and 1 is added every time the data content is updated in the same DGI.

A data group link number (DG Link number) 403 divides subtitle data into a plurality of data groups and transmits the subtitle data when transmitting a large amount of subtitle data that cannot be accommodated in one data group.
The last data group link number (Last DG Link number) 404 defines the link number of the last data group of the caption data to which the data group belongs.
A data group size (DGS) 405 indicates the number of bytes of subsequent data group data.
Data group data (DGD) 406 and 415 store two types of data group data, caption management data 406 and caption text data 415 identified by DGI 401.
Redundant bits (CRC) 413 and 420 are 16-bit cyclic redundancy check codes. The coding period of the CRC code is from DGI 401 to the end of data group data 406 or 415 (data unit 412 or 419).

The configuration of the caption management data 406 will be described.
The subtitle management data 406 is composed of a subtitle management data header indicating the language type, transmission mode, etc. of the subtitle being broadcast, followed by zero or one or more data units.
A time control mode (TMD) 407 indicates a time control mode at the time of reception and reproduction, and can specify “asynchronous with clock of reproduction time”, “synchronization of reproduction time with PTS (Presentation Time Stamp)”, and the like.
The number of languages (num_language) 408 is the number of languages included in the subtitle elementary stream (ES), and is a maximum of eight.
Language information 409 specifies a display mode and a display condition for each language.
A display format (Format) 410 specifies the resolution of a subtitle plane for generating a television display screen by combining with video (moving image plane), graphics (character / graphic plane), photograph, etc. (still image plane).
A data unit loop length 411 defines the total byte length of the subsequent data unit 412.

The configuration of the caption text data 415 will be described.
The caption text data 415 is a main part of the caption, and is composed of a caption text data header including presentation time information for taking presentation timing, followed by one or a plurality of data unit groups.
The time control mode (TMD) 416 indicates a time control mode at the time of reception and reproduction, and is the same as the time control mode (TMD) 407 of the caption management data 406.
The presentation start time (STM) 417 indicates the presentation start time of the subsequent caption text.
Data unit loop length 418 defines the total byte length of the following data unit 419.

A configuration of the data unit 421 (412 and 419) used in the caption management data 406 and the caption sentence data 415 will be described.
The data unit separation code (data unit separator) 422 is a code for separating data units and is 0x1F.
A data unit parameter (data unit parameter) 423 identifies the type of data unit such as a text or a color map.
The data unit size (data unit size) 424 indicates the number of bytes of the subsequent data unit data 425.
Data unit data (data unit data byte) 425 stores data unit data to be transmitted in this field. The caption extended control code (CSI) and the character code are stored in the data unit data and transmitted.

[Display subtitle text]
FIG. 7 is a diagram showing a caption plane and a caption display area.
As shown in FIG. 7, subtitle characters are displayed by setting a subtitle display area 601 in the subtitle plane 600 and expanding the subtitle characters into a bitmap in the subtitle display area 601.
The caption display area 601 is designated by the display position designation SDP 602 and the display configuration dot designation SDF 601 which are extended control codes (CSI) stored in the data unit data 425 with the upper left of the caption plane 600 as the origin. The SDP 602 is the position coordinate of the upper left corner of the caption display area 601 and is designated by the number of horizontal dots 604 and the number of vertical lines 603. Also, the SDF 601 is designated by the horizontal dot number 606 / vertical dot number 605 of the caption display area 601.

  The subtitle character information is designated by the character configuration dot designation SSM, the character spacing designation SHS, and the line spacing designation SVS of the extended control code (CSI) stored in the data unit data 425. Subtitle characters including the space between characters are treated as display sections, and the display sections differ between horizontal writing and vertical writing.

FIG. 8 is a diagram showing an example of a horizontal writing and vertical writing display section for subtitle characters. A horizontal display section 700 is shown on the left side, and a vertical writing display section 710 is shown on the right side.
In the case of the horizontal writing display section 700, the display section character direction size 701 is obtained by adding a font horizontal direction size 704 and character intervals 707 and 708. The display section row direction size 702 is obtained by adding the font vertical direction size 703 and the line intervals 705 and 706. The movement position reference point 709 is a reference point for moving after expanding a character and developing the next character.
In the case of the vertically written display section 710, the display section character direction size 712 is obtained by adding a font vertical direction size 713 and character intervals 715 and 716. The display partition line direction size 711 is obtained by adding a font horizontal direction size 714 and line intervals 717 and 718. The movement position reference point 719 is a reference point for moving after expanding a character and developing the next character.

[Subtitle processing]
FIG. 9 is a flowchart showing the operation of the caption processing of this embodiment.
The subtitle analysis unit 806 performs the processing in steps 901 to 907.
In step 901, the PES 300 is received from the separation unit 802, and the PES data area 304 is extracted from the PES.
In step 902, the DGI 401 is checked to determine the types of the caption management data 406 and the caption sentence data 415 of the group A and the group B.
If it is the caption management data 406 in step 902, the process proceeds to step 903, the following values set in the caption management data 406 are extracted and stored, and then the process returns to step 901.

-Subtitle plane resolution (horizontal writing, vertical writing)
・ Subtitle display area (position, size)
-Character size-Character spacing specification / line spacing specification

On the other hand, if it is the caption text data 415 in step 902, the process proceeds to step 904 and the caption presentation start time is obtained from TMD 416 and STM 417.

In step 905, an extended control code (CSI) and a character code are extracted from the data unit data 425 of the caption text data 415.
In step 906, the display section 700 or 710 is obtained based on the character code extracted in step 905 and the horizontal / vertical writing, character size, character spacing, and line spacing stored in step 903. When the extended control code includes a character size (small size SSZ, medium size MSZ, designated size SZX), each display section is obtained.
In step 907, it is determined whether or not the CSI extracted in step 905 is screen erasure (CS). If it is not CS, the process proceeds to step 909, and if it is CS, the process proceeds to step 908.
In step 908, the caption display unit 809 clears the caption plane and information for controlling display of the caption.

The subtitle display determination unit 807 performs the processing in steps 909 to 911.
In steps 909 to 911, the inclusion relationship between the caption text displayed in the caption display area obtained in step 906 and the cut-out screen stored in the display area storage unit 803 (positional relationship between the arrangement information of the caption data and the display area) Check out.

FIG. 10 is a diagram showing the cutout screen and the caption display area in FIG. 1 together. 10 shows only the display section of the caption 123 and the caption display area 602 for convenience of explanation, the same applies to the captions 120, 121, and 122.
In FIG. 10, the cut-out position 111 of the cut-out screen is represented by a horizontal coordinate 1001 and a vertical coordinate 1002, and the cut-out size of the cut-out screen is represented by a horizontal dot number 1003 and a vertical line number 1004. . The cut-out position 111 of the cut-out screen and the cut-out size of the cut-out screen are stored in the display area storage unit 803 and are read and used.
It is assumed that the inclusive relation is examined not for the entire display area 602 but for a portion including the subtitle text display section as a comparison target.

When the position where the subtitle 123 is displayed in the SHV video range 100 is Cx, Cy and the range is Cw, Ch, the following is obtained.

Position: Cx = SDP603 (number of horizontal dots)
Cy = SDP604 (number of vertical lines)
Range: Cw = Horizontal display partition character direction size 701 × N
Ch = Horizontal display section row direction size 702 × M
(N = number of characters (10 for subtitle 123))
(M = number of lines (1 for subtitle 123))

The inclusion relationship is determined as follows.

[A]
Ex <Cx and (Cx + Cw) <(Ex + Ew)
And Ey <Cy and (Cy + Ch) <(Ey + Eh)
Then, "Subtitle text is within the range of the cutout screen"
However,
Ex = Horizontal coordinate 1001 of the cutout position 111 on the cutout screen
Ey = Vertical coordinate 1002 of the cutout position 111 on the cutout screen
Ew = number of horizontal dots 1003 in the cutout size of the cutout screen
Eh = number of lines in the vertical direction of the cutout size of the cutout screen 1004
[B]
(Cx + Cw-1) <Ex
Or (Cy + Ch-1) <Ey
Or (Ex + Ew-1) <Cx
Or (Ey + Eh-1) <Cy
Then, "Subtitle text is out of range of clipped screen"
[C]
If it is neither [a] nor [b]
"Subtitle text is partially included in the cutout screen"

In step 909, it is checked whether or not all of the caption text is within the range of the cutout screen (the above [a]) (caption 120 in FIGS. 1 and 2). If all of the caption text is within the cutout screen range, the process proceeds to step 913.
In step 910, it is checked whether or not all of the caption text is outside the range of the cutout screen ([b] above) (caption 121 in FIGS. 1 and 2). If all of the subtitle sentences are outside the range of the cutout screen, the process proceeds to step 915.

In step 911, when the subtitle sentence straddles the boundary of the cutout screen ([c] above), the percentage of the entire subtitle sentence is calculated within the range of the cutout screen as follows.

<Horizontal direction> (W is the ratio of subtitle sentences within the cut-out screen range)
[C1]
Cx <Ex and (Cx + Cw-1) <(Ex + Ew-1)
Then W = ((Cx + Cw-1)-(Ex-Cx)) / Cw
[C2]
Ex <Cx and (Cx + Cw-1) <(Ex + Ew-1)
Then W = 1
[C3]
Ex <Cx and (Ex + Ew-1) <(Cx + Cw-1)
Then W = ((Cx + Cw−1) − ((Ex + Ew−1) −Cx + 1)) / Cw

<Vertical direction> (The ratio that falls within the cut-out screen range is H)
[C4]
Cy <Ey and (Cy + Ch-1) <(Ey + Eh-1)
If H = ((Cy + Ch-1)-(Ey-Cy)) / Ch
[C5]
Ey <Cy and (Cy + Ch-1) <(Ey + Eh-1)
Then H = 1
[C6]
Ey <Cy and (Ey + Eh-1) <(Cy + Ch-1)
If H = ((Cy + Ch−1) − ((Ey + Eh−1) −Cy + 1)) / Ch

Percentage within range = W x H x 100 (unit:%)

If 50% (predetermined ratio) or more of the entire caption text is within the cutout screen range, it is determined that the caption display position is to be changed, and the process proceeds to step 912. This corresponds to the caption 123 shown in FIGS.
If less than 50% (predetermined ratio) of the entire caption text is within the cutout screen range, it is determined that no caption is displayed, and the process proceeds to step 915.

In step 912, the subtitle display position correcting unit 808 corrects the coordinates of the subtitle display area so that the subtitle sentence enters the cut-out screen.
The correction is performed as follows according to the determination results of [c1] to [c6] described above.

[C1] Cx = Ex
[C2] No correction [c3] Cx = (Ex + Ew-1) -Cw
[C4] Cy = Ey
[C5] No correction [c6] Cy = (Ey + Eh-1) -Ch

Steps 913 to 916 are performed by the caption display unit 809.
In step 913, the character bitmap of the caption text is written in the caption character plane.
In step 914. The time control (TIME) of the extended control code is taken out, and the presentation time for each subtitle is stored in the work memory in the subtitle display unit 809.
In step 915, the subtitle presentation time stored in the work memory is checked to determine whether there is a subtitle whose presentation time has ended. If there is a subtitle whose presentation time has ended, the flow proceeds to step 916.
In step 916, the subtitle character plane whose presentation time has ended is cleared.
The processing from step 901 to step 916 is repeated until the presentation of caption data ends.

  As described above, when this embodiment is executed, the caption text of FIG. 1 is displayed as shown in FIG. The display position of the caption 123 is changed and the entire caption is displayed. On the other hand, the captions 121 and 122 are not displayed.

<Embodiment 2>
In the second embodiment, when the SHV video is cut out in the HD receiving device, the subtitle text size that does not include all of the subtitle text is changed and the display position is corrected to display all of the subtitle text. The case will be described.

[Basic configuration of digital TV broadcast receiver]
FIG. 12 is a block diagram showing a basic configuration of a digital television broadcast receiving apparatus according to this embodiment. The configuration of the present embodiment is different from that of the first embodiment only in that a subtitle character changing unit 1201 is added to the block diagram of the first embodiment.
The subtitle character changing unit 1201 (subtitle character changing means) changes the subtitle display determining unit 807 according to the ratio that does not enter the character size of the subtitle that does not fall within the range of the cut-out screen.
The subtitle display position correcting unit 808 changes the display position of the subtitle whose character size has been changed by the subtitle character changing unit 1201 so as to fall within the range of the cutout screen.

[Subtitle processing]
FIG. 13 is a flowchart showing the operation of the caption processing of this embodiment. The operation of this embodiment is different from that of Embodiment 1 only in that the character size is changed when the subtitle does not fall within the range of the cutout screen. Therefore, the description of the operations common to the first embodiment is omitted as appropriate.
In the first embodiment, in step 911 in FIG. 9, when the subtitles straddle the boundary of the cutout screen, the ratio of the subtitles falling within the cutout screen range is 50% (predetermined rate) or less or less than 50%. Judgment was made if there was. However, in the second embodiment, all the subtitles that span the boundary of the cut-out screen are displayed with the character size changed, so that the determination in step 911 is not necessary.

  In step 1301, the subtitle character changing unit 1201 determines that the portion of the subtitle text that has been determined to be not within the cutout screen range by the subtitle display determination unit 807 is the subtitle text. Calculate what percentage. The calculation method uses [c1] to [c6] of the first embodiment.

Next, the subtitle character changing unit 1201 obtains the character size by multiplying the character size specified by the extended control code by the ratio.
For example, it is assumed that, as a result of the calculation, portions within the cutout screen range of the captions 122 and 123 in FIG. 2 are 25% and 75%, respectively, and the designated character size is 36 dots. In this case, the character sizes of the captions 122 and 123 are 9 dots and 7 dots, respectively.
However, the character size (standard character size) that can be used in subtitles is defined as follows in the standard, so a character size close to the following character size is selected.

16 dots, 20 dots, 24 dots, 30 dots, 36 dots

Therefore, the caption 122 has 16 dots and the caption 123 has 30 dots.
In the standard, small characters whose character direction and line direction are half of the standard character size can be used. However, when the character size of the number of dots of small characters is used, it is not possible to deal with the case where the small character is specified. Therefore, change of the character size is selected from the standard sizes.

Next, the subtitle display position correction unit 808 corrects the coordinates of the display area so that the subtitle text falls within the range of the cutout screen in consideration of the selected character size.
The correction is performed as follows according to the determination results of [c1] to [c6] of the first embodiment.

[C1] Cx = Ex
[C2] No correction [c3] Cx = (Ex + Ew-1) -cw
[C4] Cy = Ey
[C5] No correction [c6] Cy = (Ey + Eh-1) -ch

However,
cw
= Horizontally written display partition character size 701 × N for the character size after change
(N = number of characters) (10 for subtitle 123)
ch
= Horizontally written display partition line direction size 702 × M for the changed character size
(M = number of lines) (1 for subtitle 123)

  As described above, when the second embodiment is implemented, the caption text of FIG. 1 is displayed as shown in FIG. In the subtitles 122 and 123, the text size and display position are changed, and the full text is displayed. Also, the subtitle 121 is not displayed.

<Embodiment 3>
In the third embodiment, when the SHV video is cut out in the HD receiving device, the subtitle text color that does not contain all of the subtitle text is changed within the cutout screen range, the display position is corrected, and all the subtitle text is displayed. Explain the case

[Basic configuration of digital TV broadcast receiver]
FIG. 15 is a block diagram showing a basic configuration of a digital television broadcast receiving apparatus according to this embodiment. The configuration of this embodiment is different from that of the first embodiment only in that a subtitle character color changing unit 1501 is added to the block diagram of the first embodiment.
The subtitle character color changing unit 1501 (subtitle character color changing means) changes the subtitle display determining unit 807 according to the ratio of the subtitle character color that does not fall within the cutout screen range. Thereby, the subtitle character color changing unit 1501 changes the character color between the subtitle whose display position is changed and the subtitle which is not changed.
The caption display position correcting unit 808 changes the display position of the caption whose character color has been changed by the caption character color changing unit 1501 so as to fall within the range of the cutout screen.

[Subtitle processing]
FIG. 16 is a flowchart showing the operation of the caption processing of this embodiment. The operation of this embodiment is different from that of the first embodiment only in that the character color is changed when the subtitle does not fall within the range of the cutout screen. Therefore, the description of the operations common to the first embodiment is omitted as appropriate.
In the present embodiment, the character color is changed depending on whether or not the subtitle completely falls within the range of the cut-out screen, so the determinations in steps 910 and 911 in FIG. 9 are not necessary.

In step 1701, the subtitle character color changing unit 1501 calculates the percentage of the entire subtitle sentence that is within the cutout screen range as follows.

<Horizontal direction> (W is within the range)
[C11]
Cx <Ex and (Cx + Cw-1) <(Ex + Ew-1)
Then W = ((Cx + Cw-1)-(Ex-Cx)) / Cw
[C12]
Ex <Cx and (Cx + Cw-1) <(Ex + Ew-1)
Then W = 1
[C13]
Ex <Cx and (Ex + Ew-1) <(Cx + Cw-1)
Then W = ((Cx + Cw−1) − ((Ex + Ew−1) −Cx + 1)) / Cw
[C14]
(Cx + Cw-1) <Ex
Then W = 0
[C15]
(Ex + Ew-1) <Cx
Then W = 0

<Vertical direction> (The ratio in the range is H)
[C16]
Cy <Ey and (Cy + Ch-1) <(Ey + Eh-1)
If H = ((Cy + Ch-1)-(Ey-Cy)) / Ch
[C17]
Ey <Cy and (Cy + Ch-1) <(Ey + Eh-1)
Then H = 1
[C18]
Ey <Cy and (Ey + Eh-1) <(Cy + Ch-1)
If H = ((Cy + Ch−1) − ((Ey + Eh−1) −Cy + 1)) / Ch
[C19]
(Cy + Ch-1) <Ey
Then W = 0
[C20]
(Ey + Eh-1) <Cy
Then W = 0

Percentage within range = W x H x 100 (unit:%)

The caption character color is changed as follows by multiplying the set character color by the ratio.

Subtitle character setting color = (R, G, B)
Changed character color = (Rxr, Gxr, Bxr)
R, G, B: 3 primary colors (red, blue, green)
r: Ratio within range (%)

For example, as a result of the calculation, portions within the cutout screen range of the captions 121, 122, and 123 in FIG. 2 are 0%, 25%, and 75%, respectively, and the caption character setting color is black (R, R, Suppose G, B = 0, 0, 0). In this case, the character colors of the captions 121, 122, and 123 are as follows.

Subtitle 121 = (255, 255, 255)
Subtitle 122 = (191, 191, 191)
Subtitle 123 = (63, 63, 63)

Next, the subtitle display position correcting unit 808 corrects the coordinates of the display area so that all subtitle sentences are included in the cutout screen.
The correction method is as follows according to the determination results of [c11] to [c20] described above.

[C11] Cx = Ex
[C12] No correction [c13] Cx = (Ex + Ew-1) -Cw
[C14] Cx = Ex
[C15] Cx = (Ex + Ew-1) -Cw
[C16] Cy = Ey
[C17] No correction [c18] Cy = (Ey + Eh-1) -Ch
[C19] Cy = Ey
[C20] Cy = (Ey + Eh-1) -Ch

  As described above, when the third embodiment is implemented, the caption text of FIG. 1 is displayed as shown in FIG. The subtitles 121, 122, and 123 are changed in character color and display position, and the full text is displayed. In FIG. 17, the subtitle character color is not displayed correctly, but has the character color described above.

  In addition to the character color changing method described above, it is also effective to classify subtitles that fall within the cutout screen range, subtitles that fall outside the range, and subtitles that cross the boundary, and change the subtitle character color for each classified subtitle. It is a form. The character color may be different for subtitles other than subtitles that fall within the range or boundary of the cut-out screen. In the case of subtitles that cross the boundary, it is also an effective embodiment to provide a difference in character color tone between subtitles that fall within the cutout screen range and subtitles that fall outside the range.

100 SHV video range 110 HD video range 111 Cutout position 120, 121, 122, 123 Subtitle

Claims (18)

A video processing device for processing a video signal,
Subtitle analysis means for analyzing the arrangement of subtitle data multiplexed in a video signal;
Subtitle display for determining whether or not to change the display position of the subtitle displayed based on the subtitle data based on the positional relationship between the arrangement of the subtitle data and the display area of a part of the video related to the video signal A determination means;
Subtitle display position correcting means for changing the display position of the subtitle based on the result determined by the subtitle display determining means;
A video processing apparatus comprising: subtitle character color changing means for changing a character color between a subtitle whose display position is changed and a subtitle which is not changed. When it is determined by the caption display determination means to change the display position of the caption displayed based on the caption data,
The video processing according to claim 1, wherein the subtitle display position correction unit changes the display position of the subtitle so that a subtitle displayed based on the subtitle data is displayed in the display area. apparatus.   The video processing apparatus according to claim 1, further comprising: a display area storage unit that stores a partial range of the video related to the video signal as the display area.   The video processing apparatus according to claim 1, further comprising subtitle character changing means for changing a character size of the subtitle. A video processing device for processing a video signal,
Subtitle analysis means for analyzing the arrangement of subtitle data multiplexed in a video signal;
Subtitle display for determining whether or not to change the display position of the subtitle displayed based on the subtitle data based on the positional relationship between the arrangement of the subtitle data and the display area of a part of the video related to the video signal A determination means;
Subtitle display position correction means for changing the display position of the subtitle based on the result determined by the subtitle display determination means,
The video processing apparatus according to claim 1, wherein the subtitle display determination unit determines to change the display position of the subtitle when a predetermined ratio of the displayed subtitles is within the display area.   The video processing apparatus according to claim 5, wherein the subtitle display determination unit determines that the subtitle is not displayed when a predetermined ratio of the displayed subtitles is not included in the display area. When it is determined by the caption display determination means to change the display position of the caption displayed based on the caption data,
The subtitle display position correcting unit changes the display position of the subtitle so that a subtitle displayed based on the subtitle data is displayed in the display area. Video processing device.   8. The video processing apparatus according to claim 5, further comprising display area storage means for storing a partial range of a video image related to the video signal as the display area. 9.   The video processing apparatus according to claim 5, further comprising subtitle character changing means for changing a character size of the subtitle. A control method of a video processing apparatus for processing a video signal,
An analysis process for analyzing the arrangement of subtitle data multiplexed in the video signal;
A determination step of determining whether or not to change a display position of the subtitle displayed based on the subtitle data based on a positional relationship between the arrangement of the subtitle data and a partial display area of the video related to the video signal. When,
A subtitle display position changing step of changing the display position of the subtitle based on the determined result;
A method for controlling a video processing apparatus, comprising: a subtitle character color changing step of changing a character color between a subtitle whose display position is changed and a subtitle which is not changed. The pre-Symbol-size constant step, if it is determined to change the display position of the subtitles to be displayed on the basis of the subtitle data,
The video processing according to claim 10, wherein, in the subtitle display position changing step, the subtitle display position is changed so that a subtitle displayed based on the subtitle data is displayed in the display area. Control method of the device.   12. The method of controlling a video processing apparatus according to claim 10, further comprising a storage step of storing a partial range of the video related to the video signal in the storage means as the display area.   The method of controlling a video processing apparatus according to claim 10, further comprising a step of changing a character size of the caption. A control method of a video processing apparatus for processing a video signal,
A subtitle analysis step for analyzing the arrangement of subtitle data multiplexed in the video signal;
The arrangement of the subtitle data, based on the positional relationship between the part of the display area of the image according to the video signal, determine you determine whether to change the display position of the subtitles to be displayed based on the subtitle data Regular process,
Based on the result determined in the previous SL-size constant step has a subtitle display position change step of changing the display position of the subtitles,
Prior SL-size constant step, the control method of a video processing apparatus and determines that if a predetermined percentage of the total subtitles to be displayed is contained in the display area, to change the display position of the subtitles. Prior SL-size constant step, when a predetermined percentage of the entire subtitle is displayed not in the display area, the image processing apparatus according to claim 14, wherein the determining not to display the subtitles Control method. The pre-Symbol-size constant step, if it is determined to change the display position of the subtitles to be displayed on the basis of the subtitle data,
The display position of the subtitle is changed in the subtitle display position changing step so that a subtitle displayed based on the subtitle data is displayed in the display area. Control method of video processing apparatus.   17. The method of controlling a video processing apparatus according to claim 14, further comprising a display area storing step of storing a part of a video range related to the video signal as the display area. The control method of the video processing device according to claim 14, further comprising a subtitle character changing step of changing a character size of the subtitle.

Images