JP6095051B2 - TV system - Google Patents

Description

  The present invention relates to a television system.

  In recent years, digital broadcasting has been performed in which video / audio signals and content information signals are compressed and broadcast using digital signal compression technology. Here, the content information is, for example, a program name, program content, program start time, program duration, program genre information, and the like.

  Here, instead of watching TV alone, multiple people may watch it. At this time, there is a case where one TV screen is simultaneously viewed by a person with color blindness and a person with no color blindness.

  Patent Document 1 discloses an invention of a digital broadcast receiving apparatus that makes it easy to see display characters and the like so that even a person with color blindness can comfortably view a data broadcast or the like.

JP 2003-78835 A

  However, the method using a digital broadcast receiver described in Patent Document 1 is an operation of a digital broadcast receiver alone, and generates an image that is easy to see for a color blind person by performing color conversion on the entire screen. is there. For this reason, when a person who is not color-blind and a person who is not color-blind are watching at the same time, it is necessary for the person who is not color-blind to continue watching the color-converted video. Here, an image that has been color-converted by a color blind person may feel unnatural for those who are not color blind. Accordingly, it has been desired that the video displayed on the television device is displayed so that desired information can be easily obtained for a person with color blindness and that there is little discomfort for a person without color blindness.

The television system according to the present invention is a television system including a television device and a terminal device, wherein the television device generates display data based on received video data, and the display data. A television display unit for displaying the information, a layout information extraction unit for extracting information on the screen layout of the video data as layout information, and data generation for generating information on a layout screen that can be displayed on the terminal device based on the layout information It includes a part, wherein the terminal device includes a terminal display unit for displaying the layout screen based on information on the layout screen from the television apparatus receives the area selection operation of the user, of among the layout screen 1 or chromatic selection area-information creating unit that creates a selection area information select multiple regions, the The television device further on the basis of the said selected area information from the terminal device, image color to generate the color conversion information perform color conversion for color defectives the video data within the selected area It has a conversion part, and the display data generation part generates display data based on the color conversion information created in the video color conversion part in addition to the received video data.
As a result, the user can designate a location where color conversion is desired and can perform color conversion only at the designated location.

  It is easy for a color blind person to obtain desired information, and an image with little discomfort can be displayed for a person who is not color blind.

1 is a block diagram showing a configuration of a television system according to a first exemplary embodiment. FIG. 6 is an example of layout information after color conversion converted into two colors according to the first embodiment; FIG. 10 is a diagram of another example of post-color conversion layout information converted into two colors according to the first embodiment. It is a figure at the time of selecting the area | region on the screen upper left in the display part of the terminal device concerning Embodiment 1. FIG. 3 is a flowchart according to the television system according to the first exemplary embodiment. 3 is a flowchart according to the television system according to the first exemplary embodiment. FIG. 3 is an example of a display unit of the television device after color conversion according to the first embodiment is performed. It is a block diagram which shows the structure of the television system concerning Embodiment 2. 10 is a flowchart of the television system according to the second embodiment. 10 is a flowchart of the television system according to the second embodiment.

Embodiment 1
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration of the television system 1.

  The television system 1 includes a television device 11 and a terminal device 12. The television apparatus 11 includes a receiver 21, a decoder 22, a display data generation unit 23, a television display unit 24, a layout information extraction unit 25, a layout color conversion unit 26, a data generation unit 27, and a transmission unit 28. A video color conversion unit 29 and a color conversion table 30.

  The receiver 21 receives video data transmitted from an external transmission station. Here, the video data received by the receiver 21 includes video information, broadcast content information, and the like, and is encoded for efficient wireless transmission. The digital broadcast signal naturally includes audio data, but the audio signal processing is not the main part of the present embodiment, and the audio signal processing may be performed using an existing technique, and thus the description thereof is omitted. The receiver 21 outputs the received video data to the decoder 22.

  The decoder 22 decodes the video data input from the receiver 21 and generates decode information. The decoder 22 outputs the video data generated by decoding and the content information described in BML (Broadcast Markup Language) to the display data generation unit 23. Further, the decoder 22 outputs the content information to the layout information extraction unit 25.

The display data generation unit 23 receives data from the decoder 22, the layout information extraction unit 25, and a selection area information creation unit 34 described later. More specifically, the display data generation unit 23 receives the decoded video data and content information data from the decoder 22. Further, the display data generation unit 23 receives layout information from the layout information extraction unit 25. Further, the display data generation unit 23 receives information on the region selected by the user from the selection region information creation unit 34. The layout information and selection area information will be described later.
The display data generation unit 23 generates display data based on the data input from the decoder 22, the layout information extraction unit 25, and the selection area information creation unit 34, and outputs the display data to the video color conversion unit 29. In addition, the display data generation unit 23 receives color conversion information from the video color conversion unit 29 . The display data generation unit 23 generates a drive signal based on the generated display data and the color conversion information from the video color conversion unit 29 and outputs the drive signal to the television display unit 24.
The display data generation unit 23 generates a drive signal to display based on the decode information input from the decoder 22 when the region selection information is not input from the selection region information generation unit 34, and the television display unit 24. In other words, the display data generation unit 23 generates a drive signal and outputs it to the television display unit 24 so as to present the original color specified in the BML document.

  The television display unit 24 is a display that operates based on the drive signal input from the display data generation unit 23.

  The layout information extraction unit 25 receives broadcast content information from the decoder 22. The layout information extraction unit 25 extracts layout information from the content information described in BML text. The layout information extraction unit 25 outputs the extracted layout information to the display data generation unit 23. Further, the layout information extraction unit 25 outputs the layout information to the layout color conversion unit 26.

  The layout color conversion unit 26 receives layout information from the layout information extraction unit 25. The layout color conversion unit 26 converts the color information of the content included in the layout information. Here, the layout color conversion unit 26 generates post-color conversion layout information in which colors are converted to make the layout appear for the color blind person. More specifically, the layout color conversion unit 26 generates post-color conversion layout information converted into black and white. FIG. 2 is an example of layout information after color conversion that has been converted to black and white. FIG. 3 is another example of layout information after color conversion. The layout color conversion unit 26 outputs post-color conversion layout information to the data generation unit 27. More details will be described later together with a flowchart.

  The data generation unit 27 generates display data that can be displayed on the terminal device 12 based on the post-color conversion layout information input from the layout color conversion unit 26. Typically, the data generation unit 27 is an HTML data generation unit, and generates an HTML document. The data generation unit 27 outputs the generated display data to the transmission unit 28.

  The transmission unit 28 outputs the display data input from the data generation unit 27 to the terminal device 12. Typically, the transmission unit 28 outputs an HTML document to the terminal device 12 in accordance with HTTP (HyperText Transfer Protocol). Thereby, the television apparatus 11 functions as a Web server.

The video color conversion unit 29 performs color conversion on the display data generated by the display data generation unit 23. More specifically, the video color conversion unit 29 receives display data from the display data generation unit 23 and uses the color conversion table 30 based on selection area information input from a selection area information creation unit 34 described later. Color conversion is performed on the selected area to generate color conversion information . The video color conversion unit 29 outputs the color conversion information to the display data generation unit 23.

  The color conversion table 30 provides color conversion rules to the video color conversion unit 29. Typically, the color conversion rule provided by the color conversion table 30 stores a rule for converting a color that is difficult for a visually-impaired person to visually recognize into a color that is easily visible.

  The terminal device 12 is a small and lightweight terminal that can be carried by the user, and is typically a smartphone or a tablet. The terminal device 12 includes a receiving unit 31, a terminal display unit 32, an input detection unit 33, and a selection area information creation unit 34.

  The reception unit 31 receives display data from the transmission unit 28. The receiving unit 31 outputs display data to the terminal display unit 32.

  The terminal display unit 32 is a display that performs screen display based on the display data input from the receiving unit 31. Here, typically, the display data input to the terminal display unit 32 is an HTML document described to display the layout in two colors of black and white. The terminal display unit 32 displays a layout expressed in black and white using a web browser.

  The input detection unit 33 includes an input unit 331 and a detection unit 332.

  The input unit 331 is an input unit by a user. Typically, the input unit 331 is a touch panel provided on the display screen. The user compares the video displayed on the television display unit 24 with the layout screen displayed on the terminal display unit 32 and inputs a range in which color conversion is desired using the input unit 331. For example, the input unit 331 acquires a trajectory of an operation by a user operation. FIG. 4 shows an example in which the user selects the upper left area of the screen from the layout screen displayed on the terminal display unit 32, and the dotted circle indicates the locus of the operation by the user.

  The detection unit 332 detects block elements included in the trajectory based on the trajectory input by the input unit 331. The detection means 332 outputs the detected block element information to the selection area information creation unit 34. Typically, the block element is a rectangular area for each element. In other words, the detection unit 332 outputs information on one or more rectangular areas to the selection area information creation unit 34.

  The selection area information creation unit 34 generates selection area information based on the information about the rectangular area input from the detection unit 332. The selection area information creation unit 34 outputs the selection area information to the display data generation unit 23. For example, the selection area information creation unit 34 outputs layout information corresponding to the selection area to the display data generation unit 23.

  Next, the operation of the television system 1 will be described. 5 and 6 are operation flowcharts of the television system 1.

  The receiver 21 receives video data transmitted from an external transmitting station (step S11).

  The decoder 22 decodes the video data input from the receiver 21 and generates decode information (step S12). Next, the process proceeds to step S13 and step S16. Typically, the processing from step S13 and the processing from step S16 are performed in parallel.

  The television apparatus 11 determines the input state of the selection area information from the selection area information creation unit 34 to the display data generation unit 23 (step S13). Typically, step S13 is executed when the data input to the selection area information creation unit 34 is changed. If there is no input from the selection area information creation unit 34 to the display data generation unit 23 (No in step S13), the process proceeds to step S14. When there is an input from the selection area information creation unit 34 to the display data generation unit 23 (Yes in step S13), the process proceeds to step S31.

  The display data generation unit 23 generates a drive signal based on the decode information input from the decoder 22 (step S14).

  The television display unit 24 performs display based on the drive signal (step S15).

  The layout information extraction unit 25 analyzes the BML sentence input from the decoder 22 (step S16). More specifically, the layout information extraction unit 25 analyzes the BML sentence and extracts layout information based on rectangular areas indicated by the body element, div element, p element, object element, and input element that are block elements. The layout information extraction unit 25 calculates the position of the rectangle from the position characteristics, left, top, right, and bottom characteristics specified by the BML text. Here, the layout information extraction unit 25 outputs the extracted layout information to the display data generation unit 23 and the layout color conversion unit 26.

The layout color conversion unit 26 converts the color information of the content (step S17). More specifically, the layout color conversion unit 26 performs black, white, black,... In order from the parent element in the layout, regardless of the values described in color-index and background-color-index in the BML text. Generate layout information after color conversion so that colors are displayed in the order of. FIG. 2 shows post-color conversion layout information converted into two colors in order from the parent element. In FIG. 2, the black color-converted portion is indicated by hatching.
Here, the layout color conversion unit 26, when the border-width is specified in the BML sentence, border-top-color-index, border-right-color-index, border-left-color-index, border-bottom Ignores the value of -color-index and generates layout information after color conversion. For example, when the parent element of the rectangular area with the border-width specified is painted in black, the layout color conversion unit 26 paints its own border in white and paints the inside of the border in black. FIG. 3 shows layout information after color conversion in which the border is painted white and the inner side of the border is painted black. In FIG. 3, the portion that has been color-converted to white is indicated by hatching. Conversely, when the parent element is white, the layout color conversion unit 26 may paint its own border in black and paint the inside of the border in white.

  The data generation unit 27 generates an HTML document based on the post-color conversion layout information input from the layout color conversion unit 26, and transmits it to the terminal device 12 (step S18). In other words, the television apparatus 11 publishes the post-color conversion layout information shown in FIG. 2 or 3 as a Web page.

  The receiving unit 31 of the terminal device 12 receives the HTML document (step S19). In other words, the terminal device 12 acquires a web page published by the television device 11.

  The terminal display unit 32 performs display based on the description of the HTML document (step S20).

  The terminal device 12 uses the input unit 331 to determine whether or not the range in which the user desires color conversion has been input (step S21). If input (Yes in step S21), the process proceeds to step S22. If not input (No in step S21), the process returns to step S13.

  Based on the input from the input unit 331, the detection unit 332 detects a block element that performs color conversion (step S22). For example, when the locus input by the user is a dotted circle in FIG. 4, the four rectangular regions (B, C, D, E) include 50% or more. Therefore, the detection means 332 detects that the user has selected the rectangular area (B, C, D, E). The rectangular area detected here is treated as including a portion that is difficult for the user to see. The other rectangular areas (A, F, G, H, I, J, K) are not detected by the detection unit 332 because the selection range is determined to be less than 50%.

  The selection area information creation unit 34 creates selection area information from the rectangular area detected by the detection unit 332, and outputs the selection area information as a user event to the display data generation unit 23 (step S23). Thereafter, the process returns to step S13.

When there is an input from the selection area information creation unit 34 to the display data generation unit 23 (Yes in step S13), the video color conversion unit 29 inputs the display data from the display data generation unit 23, and the selection area information creation unit Color conversion is performed on the area selected in 34 based on the color conversion table 30 (step S31). The video color conversion unit 29 prepares a color lookup table (CLUT) for color blind persons for CSS, PNG, MNG, and characters, and converts them using a color different from the original designated color . The video color conversion unit 29 also converts the RGB values decoded for JPEG into colors for color blind persons based on a color conversion table 30 prepared in advance. If the currently selected selection area is different from the selection area when the previous color conversion is performed, the video color conversion unit 29 changes the color of the area where the previous color conversion is performed to the original color. Return, color conversion is performed only on the currently selected area. The video color conversion unit 29 outputs the color conversion information to the display data generation unit 23.

  The display data generation unit 23 generates a drive signal based on the color conversion information input from the video color conversion unit 29 and the display data (step S32). Thereafter, the process proceeds to step S15. FIG. 7 is an example of the screen of the television display unit 24 after the color conversion of the selected area is performed. More specifically, FIG. 7 shows a state where the color of the rectangular area (B, C, D, E) in the upper left dotted line is changed.

  As a result, the color of the data broadcast in the selected area designated by the terminal device 12 is displayed on the television device 11 in a converted state. At this time, in the television device 11, an area not designated by the terminal device 12 is displayed with the original color. In other words, the television device 11 can display an image obtained by converting the color of the minimum necessary area designated by the user. Therefore, when a person with color blindness and a person with no color blindness are watching the television apparatus 11 at the same time, it becomes easier for the person with color blindness to obtain desired information, and a person with no color blindness can view a video with few color changes. Can watch.

Embodiment 2
FIG. 8 is a configuration diagram of the television system 2 according to the second embodiment. The television system 2 includes a television device 11 and a terminal device 13. Note that components having the same functions as those of the television system 1 described in Embodiment 1 are denoted by the same reference numerals, and description thereof is omitted.

  The terminal device 13 includes a receiving unit 31, a terminal display unit 32, an input detection unit 33, a selection area information creation unit 34, and a terminal side color conversion table 35.

  The terminal-side color conversion table 35 is a color conversion table that the terminal device 13 has individually. For example, when a plurality of users each have the terminal device 13, the terminal-side color conversion table 35 stores a color conversion rule that matches the characteristics of color blindness of the user for each terminal device 13 owned by the user. Yes. The terminal side color conversion table 35 outputs the contents of the stored table to the color conversion table 30.

  Next, the operation of the television system 2 will be described. 9 and 10 are operation flowcharts of the television system 2.

  The receiver 21 receives video data transmitted from an external transmitting station (step S11).

  The decoder 22 decodes the video data input from the receiver 21 and generates decode information (step S12). Next, the process proceeds to step S13 and step S16. Typically, the processing from step S13 and the processing from step S16 are performed in parallel.

  The television apparatus 11 determines the input state of the information regarding the selection area from the selection area information creation unit 34 to the display data generation unit 23 (step S13). If there is no input from the selection area information creation unit 34 to the display data generation unit 23 (No in step S13), the process proceeds to step S14. When there is an input from the selection area information creation unit 34 to the display data generation unit 23 (Yes in step S13), the process proceeds to step S31.

  The display data generation unit 23 generates a drive signal based on the information input from the decoder 22 (step S14).

  The television display unit 24 performs display based on the drive signal (step S15).

  The layout information extraction unit 25 analyzes the BML sentence input from the decoder 22 (step S16).

  The layout color conversion unit 26 converts the color information of the content (step S17).

  The data generation unit 27 generates an HTML document based on the post-color conversion layout information input from the layout color conversion unit 26, and transmits the HTML document to the terminal device 13 (step S18).

  The receiving unit 31 of the terminal device 13 receives the HTML document (step S19).

  The terminal display unit 32 performs display based on the description of the HTML document (step S20).

  The terminal device 13 determines whether or not the user has input a range in which color conversion is desired using the input unit 331 (step S21). If input (Yes in step S21), the process proceeds to step S22. If not input (No in step S21), the process returns to step S13.

  Based on the input from the input unit 331, the detection unit 332 detects a block element that performs color conversion (step S22).

  The selection area information creation unit 34 creates selection area information from the rectangular area detected by the detection unit 332, and outputs the selection area information as a user event to the display data generation unit 23 (step S23).

  The terminal side color conversion table 35 outputs the contents of the stored table to the color conversion table 30 (step S41). Thereafter, the process returns to step S13.

  The video color conversion unit 29 receives display data from the display data generation unit 23, and generates color conversion information for the region selected by the selection region information creation unit 34 based on the color conversion table 30 (step S31). That is, the video color conversion unit 29 generates color conversion information based on the color conversion rules stored in the terminal-side color conversion table 35.

  Based on the new display data generated by performing the color conversion of the selected area on the display data input from the decoder 22 in accordance with the color conversion information input from the video color conversion unit 29, the display data generation unit 23 A drive signal is generated (step S32). Thereafter, the process proceeds to step S15.

  As a result, the color of the data broadcast in the selected area designated by the terminal device 12 is converted and displayed on the television device 11. At this time, on the television device 11, color conversion is performed based on a conversion rule that is stored in advance in the terminal device 13 in accordance with the characteristics of the color blind person, so that an image that is more easily visible to the color blind person is displayed. .

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention. For example, in the above-described operation, the television apparatus always operates as a Web server. However, the function as the Web server can be switched on and off, and only when the color conversion setting is changed, the step is turned on. It is good also as performing operation | movement after S16. In the above description, the television apparatus 11 is provided with the layout color conversion unit 26, which converts the color to black and white and outputs it to the terminal device 12. However, the layout color conversion unit 26 is provided in the terminal device 12, Color conversion may be performed on the terminal device 12 side and displayed on the terminal display unit 32. In the second embodiment, the video color conversion unit 29 refers to the color conversion table 30 after outputting the color conversion rules stored in the terminal-side color conversion table 35 to the color conversion table 30. The color conversion rule may be directly output from the side color conversion table 35 to the video color conversion unit 29. Although the detection unit 332 detects a region including 50% or more of the rectangular region as the selection region, the threshold may be a value other than 50%, and it is desirable that the user can arbitrarily set it.

DESCRIPTION OF SYMBOLS 1 Television system 2 Television system 11 Television apparatus 12 Terminal apparatus 13 Terminal apparatus 21 Receiver 22 Decoder 23 Display data generation part 24 Television display part 25 Layout information extraction part 26 Layout color conversion part 27 Data generation part 28 Transmission part 29 Video color conversion Unit 30 color conversion table 31 reception unit 32 terminal display unit 33 input detection unit 331 input unit 332 detection unit 34 selection area information creation unit 35 terminal side color conversion table

Claims (7)

A television system comprising a television device and a terminal device,
The television set is
A display data generator for generating display data based on the received video data;
A television display for displaying the display data;
A layout information extraction unit for extracting screen layout information of the video data as layout information;
A data generation unit that generates information about a layout screen that can be displayed on the terminal device based on the layout information ,
The terminal device
A terminal display unit for displaying the layout screen based on information on the layout screen from the television device;
A selection area information creation unit that accepts a user area selection operation and creates selection area information for selecting one or more areas in the layout screen ;
The television device further generates video color conversion information for performing color conversion for color blind persons on video data in the selected area based on the selection area information from the terminal device. Part
The display data generation unit generates display data based on the color conversion information created by the video color conversion unit in addition to the received video data. The television set is
Using the layout information extracted by the layout information extraction section, so users with color blindness can recognize the layout screen, to generate a color conversion after layout information perform color conversion for each area in the layout screen A layout color converter,
The terminal display unit, based on the color conversion after the layout information, and displays the color conversion layout screen,
The television system according to claim 1. The layout color conversion unit generates post-color conversion layout information to be displayed in a binary format.
The television system according to claim 2. The terminal device
An input unit that allows a user to input a range in which color conversion is desired while looking at the screen of the layout after color conversion displayed on the terminal display unit;
Detecting means for detecting a block element included in a desired range input by the user by the input means;
The selection area information creation unit generates selection area information based on the block element detected by the detection means.
The television system according to claim 2 or 3. The data generation unit further includes a data generation unit that generates an HTML document as information on the layout screen based on the layout information after color conversion generated by the layout color conversion unit,
The terminal display unit displays a screen using a web browser.
The television system of any one of Claims 2-4. The television set is
A color conversion table for storing color conversion rules for performing color conversion for color blind persons in the selected area;
The video color conversion unit generates color conversion information based on a color conversion rule of the color conversion table;
The television system of any one of Claims 1-5. The terminal device
A terminal-side color conversion table storing color conversion rules that can be changed for each terminal device;
The video color conversion unit generates color conversion information based on a color conversion rule input from the terminal-side color conversion table;
The television system of any one of Claims 1-6.

Images