JP2009005268A - Transmitter, receiver, and reproducer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a transmitter for a video signal capable of displaying supplementary information adaptable to contents of video images on the screen, a receiver for receiving and reproducing the video signal on the screen, and a reproducer for storing and reproducing the video signal on the screen. <P>SOLUTION: The transmitter 1 includes a video encoding and transmitting unit 6 for encoding and transmitting video data, a supplementary information generating unit 8 for generating supplementary information of the video data, an image analyzing unit 7 for analyzing the video data based on the information of an object image to which the supplementary information informed from the supplementary information generating unit 8 is to be added and detecting the position at which the supplementary information is to be displayed in the video image of the video data, and a supplementary information transmitting unit 9 for generating a supplementary information stream 11 which includes the supplementary information and the position at which the supplementary information is to be displayed in the video image of the video data. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a transmitting device for transmitting video signals such as digital television broadcasts and auxiliary information such as characters and graphics to be displayed on the video screen, a receiving device for receiving and reproducing and displaying and storing and reproducing and displaying the same. It is related with the reproducing | regenerating apparatus to perform.

  Conventionally, the display format of characters and graphic information is expanded or reduced to a desired position in the video screen so that characters and graphic information are not overlapped and displayed on important or valuable parts of the TV image. (For example, refer to Patent Document 1). For example, as shown in Non-Patent Document 1, subtitles and superimposes of digital broadcasting are operated in a display format and the like so that they are displayed at unobstructed positions on the video screen of television broadcasting.

  In this case, the transmission side of the television broadcast has a function of designating the display position of the subtitles and superimpose characters, and the reception side can also change the display position and size of the subtitles and superimpose characters according to user instructions. . In this way, subtitles and superimposing characters do not cause any problems regardless of where they are displayed on the screen, so the display position on the transmitting or receiving side depends on the video display status of the TV screen on which the TV video is displayed. Can be adjusted.

JP-A-5-191788 Japan Radio Industry Association Terrestrial Digital Television Broadcasting Regulations ARIB TR-B14 2.7 Edition 1st Volume (2/2) 3-88 to 3-97

  In recent years, digital terrestrial television broadcasting services that can be received and played by mobile communication terminals such as mobile phones have begun, and even on small display screens of mobile communication terminals, the visibility is good and the display of auxiliary information according to the video content is possible. It is desired. For example, when a soccer game is received by a one-segment partial reception service for digital terrestrial television broadcasting on a mobile communication terminal, the player's face and number are not clearly visible on the small display screen, so that the user can fully enjoy television broadcasting. I can't.

  On the other hand, conventionally, as described above, the purpose is to display subtitles and superimpose in a position that does not interfere with the television image, and particularly, the display is performed at a display position that is not related to the video content. There was a problem that auxiliary information such as subtitles and superimposing characters could not be displayed properly. For example, when watching a soccer game on a small display screen of a mobile communication terminal, conventionally, it is possible to put a telop of a player's name at a predetermined position on the display screen, but there are a plurality of players to display the name. It becomes difficult to distinguish which player's name is displayed. It is also possible to move the display position of the telop on the receiving side, but it becomes difficult to understand if the relationship between the video content on the screen and the telop becomes inappropriate.

  The present invention has been made to solve the above-described problems, and is a video signal transmission device capable of displaying auxiliary information in accordance with video content on a screen, and a reception device that receives and reproduces the video signal. Another object of the present invention is to obtain a playback apparatus that stores and plays back this information.

  The transmission device according to the present invention includes a video transmission unit that encodes and transmits video data, an auxiliary information generation unit that generates auxiliary information of the video data, and a target image to which auxiliary information notified from the auxiliary information generation unit is added. The video data is analyzed based on the information of the video data, and the image analysis unit that detects the location where the auxiliary information is to be displayed in the video data video, and the location where the auxiliary information is displayed in the video of the auxiliary information and video data. And an auxiliary information transmission unit that generates and transmits auxiliary information transmission data including the auxiliary information transmission data.

  According to the present invention, the video transmission unit that encodes and transmits video data, the auxiliary information generation unit that generates auxiliary information of the video data, and the information on the target image to which the auxiliary information notified from the auxiliary information generation unit is added. An image analysis unit that analyzes video data based on the video data and detects a location where auxiliary information is to be displayed in the video data video, and an auxiliary including a location where auxiliary information is to be displayed in the video of the auxiliary information and video data Since it includes an auxiliary information transmission unit that generates and transmits information transmission data, it is possible to display auxiliary information in accordance with video content on the screen by reproducing data from the video transmission unit and the auxiliary information transmission unit. There is an effect that there is.

Embodiment 1 FIG.
FIG. 1 is a diagram showing a configuration of a television broadcast transmission / reception system according to the present invention. In FIG. 1, the television broadcast transmission / reception system includes a transmission device 1, a broadcast facility 2, and a reception device 3. The transmission device 1 converts a video signal such as a television program into stream data 1a that can be transmitted and outputs the stream data 1a to the broadcasting facility 2. The broadcast facility 2 broadcasts the stream data 1 a input from the transmission device 1 on the broadcast wave 5. The receiving device 3 is a device that receives the broadcast wave 5 and displays it on its display screen. For example, the receiving device 3 is realized by a television receiver or a mobile communication terminal that supports a one-segment partial reception service.

  In the system shown in FIG. 1, the transmission apparatus 1 encodes video data constituting a television program, generates auxiliary information to be superimposed on the video data, and performs multiplexing processing together with other data constituting the television program. The output is converted into a broadcast format that can be transmitted as the broadcast wave 5 and then output. The broadcast facility 2 performs a process such as modulation on the stream data 1 a in the broadcast format input from the transmission device 1, and transmits it as a broadcast wave 5. The receiving device 3 receives the broadcast wave 5 transmitted via the broadcast facility 2, displays the video content of the multiplexed stream extracted from the broadcast format of the broadcast wave 5 on its display screen, and supplementary information Is superimposed and displayed.

  FIG. 2 is a block diagram showing the configuration of the transmission apparatus according to Embodiment 1 of the present invention. 2, the transmission device 1 includes a video encoding transmission unit (video transmission unit) 6, an image analysis unit 7, a control information input unit 8 a, an auxiliary information generation unit 8, an auxiliary information transmission unit 9, and a multiplexing unit 10. . The video encoding transmission unit 6 inputs video data defining the video content from the outside, and encodes the video data to generate a video stream for television broadcasting. The image analysis unit 7 analyzes externally input video data and detects a target image on which auxiliary information notified from the auxiliary information generation unit 8 is to be displayed.

  The control information input unit 8 a receives input of control information in various formats from the outside, and outputs the input control information to the auxiliary information generation unit 8. Note that the control information is information indicating the designation of a target image to which auxiliary information is to be added on the screen, the content of auxiliary information to be added, and the like, and is information on which auxiliary information is generated. The auxiliary information generation unit 8 generates auxiliary information to be superimposed on the video data according to the content of the control information.

  The auxiliary information transmission unit 9 inputs the position information of the target image to which the auxiliary information input from the image analysis unit 7 should be added and the auxiliary information to be added to the target image input from the auxiliary information generation unit 8. Thus, an auxiliary information stream (auxiliary information transmission data) is generated. The multiplexing unit 10 multiplexes a television broadcast video stream and an auxiliary information stream including auxiliary information to be added to an image in the video stream, and transmits the multiplexed information to the receiving side as a broadcast multiplexed stream.

Next, detailed operation of the transmission apparatus 1 will be described.
Video data to be transmitted to the transmission apparatus 1 is input to the video encoding transmission unit 6 and the image analysis unit 7, respectively. Control information defining auxiliary information to be superimposed on the video data is input to the control information input unit 8a. The The control information input unit 8 a converts the input control information into a format that can be used by the auxiliary information generation unit 8 and outputs it to the auxiliary information generation unit 8. The auxiliary information generation unit 8 generates auxiliary information to be superimposed on the video data input to the video encoding transmission unit 6 in accordance with the content of the control information input from the control information input unit 8a, and at the same time the target image for displaying the auxiliary information. Information is notified to the image analysis unit 7.

  The video encoding / transmitting unit 6 encodes the input video data, converts it into a video stream of a desired format, and outputs it to the multiplexing unit 10. On the other hand, the image analysis unit 7 analyzes the video data input together with the video encoding / transmission unit 6 based on the information of the target image notified from the auxiliary information generation unit 8, and displays the auxiliary information in the video data. The position where the image is displayed is detected, and the position information is continuously notified to the auxiliary information transmitting unit 9.

  The auxiliary information transmission unit 9 generates an auxiliary information stream from the position information continuously notified from the image analysis unit 7 and the auxiliary information output from the auxiliary information generation unit 8 and outputs the auxiliary information stream to the multiplexing unit 10. FIG. 3 is a diagram showing a transmission format of auxiliary information, and shows a configuration example of an auxiliary information stream generated by the auxiliary information transmitting unit 9. The auxiliary information stream (auxiliary information transmission data) 11 shown in FIG. 3 includes an identifier 11a, a display time 11b, a display position 11c, an auxiliary information ID 11d, and auxiliary information content 11e.

  Here, the identifier 11a is information indicating that information after the identifier 11a in the data stream is auxiliary information. The display time 11b is information indicating the time at which the auxiliary information is to be displayed. For example, if the system conforms to the MPEG-2 standard, a value such as PTS (Presentation Time Stamp) is set. The display position 11c is information for designating a position where the auxiliary information is displayed. For example, a dot position from the upper left of the video image is set. The auxiliary information ID 11d is identification information for identifying specific auxiliary information from a plurality of auxiliary information. The auxiliary information content 11e is information indicating the content displayed on the target image as auxiliary information.

  FIG. 4 is a diagram showing a display example on the receiving side including auxiliary information, and shows a case where the receiving device 3 is realized by a mobile phone or the like and a karate game is displayed on the display screen 12 thereof. In generating the auxiliary information to be superimposed on the video data, as control information, for example, the face image data of the player 11A on the left side in FIG. 4 is designated for the target image search, and the character “player name A” is used as the character supermarket. It is assumed that the process to be displayed is designated as auxiliary information content. In this case, the auxiliary information generation unit 8 gives a unique ID to the control information, notifies the image analysis unit 7 of the image data for the target image search together with the ID, and further displays the ID and auxiliary information content as auxiliary information. Notify the transmitter 9.

  The image analysis unit 7 uses the existing image recognition technology based on the target image search image data input from the auxiliary information generation unit 8 to detect a similar image from video data related to a karate game input from the outside, Position information on the screen 12 (for example, how many vertical and horizontal dots are located from the upper left of the screen 12) and the time at that time (system time of the transmission apparatus 1) are notified from the auxiliary information generation unit 8 Together with the received ID, it is periodically transmitted to the auxiliary information transmitting unit 9. It should be noted that the detected target image has its position in the video continuously specified from the feature amount of the image and the like, and is set as the display position 11 c of the auxiliary information stream 11.

  After setting the identifier 11a, the auxiliary information transmitting unit 9 sets the ID and auxiliary information content input from the auxiliary information generating unit 8 to the auxiliary information ID 11d and auxiliary information content 11e shown in FIG. The auxiliary information stream 11 is generated by setting the time notified from the display time 11b in FIG.

  Here, when there is no change in the auxiliary information content 11e and only the display position of the auxiliary information changes, the auxiliary information transmission unit 9 omits the setting of the auxiliary information content 11e when generating the auxiliary information stream 11. The display position 11c is set. In this case, on the receiving side, the auxiliary information displayed last time is specified from the content of the auxiliary information ID 11d, and the content of the auxiliary information is displayed at the position specified by the display position 11c. By doing so, the amount of information transmitted as the auxiliary information stream 11 can be reduced, and the communication band required for the transmission can be saved. In addition, it is possible to reduce the burden required for the auxiliary information analysis processing on the receiving side.

  When a video stream is input from the video encoding transmission unit 6 and an auxiliary information stream is input from the auxiliary information transmission unit 9, the multiplexing unit 10 multiplexes them and transmits them as a broadcast stream to the reception side. In addition, although an example of handling video data and auxiliary information has been shown, if there is audio, data broadcasting, program information (EPG (Electronic Program Guide)), management information, etc. in addition to these, streams are generated individually. The data is multiplexed by the multiplexing unit 10 to be a broadcast stream.

  Note that the transmission apparatus 1 may have a configuration in which the video stream and the auxiliary information stream are not multiplexed. In this case, the video encoding transmission unit 6 transmits the video stream directly to the reception side, and the auxiliary information transmission unit 9 transmits the auxiliary information stream directly to the reception side. For example, it is conceivable that video data is transmitted by a normal broadcast wave and auxiliary information is transmitted by the Internet or the like.

  In addition, when the image analysis unit 7 detects the target image from the video data and determines the position where the auxiliary information is to be displayed, a plurality of display position candidates are listed, and the auxiliary information transmission unit 9 includes the contents of one auxiliary information. On the other hand, by generating and transmitting an auxiliary information stream including a plurality of display position information, the receiving side can display auxiliary information from a plurality of display position candidates at a position desired by the viewer. For example, as a position for displaying the player name on the screen 12 shown in FIG. 4, by generating an auxiliary information stream including three types of display position candidates such as the head, the stomach, and the foot, the receiving side The degree of freedom of the display position is born. In this case, a plurality of pieces of display position information are set for the display position 11c.

  FIG. 5 is a block diagram showing the configuration of the receiving apparatus according to Embodiment 1 of the present invention. In FIG. 5, the reception device 3 includes a separation unit 13, a video reception decoding unit (video decoding unit) 14, an auxiliary information analysis unit 15, and a superposition unit 16. The separation unit 13 separates the multiplexed stream received from the transmission device 1 into a video stream and an auxiliary information stream. The video reception decoding unit 14 decodes the video stream input from the separation unit 13. The auxiliary information analysis unit 15 analyzes the auxiliary information stream input from the separation unit 13 and restores auxiliary information. The superimposing unit 16 performs a process of superimposing auxiliary information corresponding to the video data decoded by the video reception decoding unit 14.

Next, detailed operation of the receiving device 3 will be described.
The multiplexed stream received from the transmission device 1 is input to the separation unit 13. The separation unit 13 separates the input multiplexed stream into a video stream and an auxiliary information stream, outputs the video stream to the video reception decoding unit 14, and outputs the auxiliary information stream to the auxiliary information analysis unit 15. For example, the video stream and the auxiliary information stream are separated from the multiplexed stream based on the presence / absence of the identifier 11a included in the auxiliary information stream.

  The video receiving / decoding unit 14 decodes the video stream input from the demultiplexing unit 13 into video data that can be displayed on a screen (not shown), and then outputs the video data to the superimposing unit 16. The auxiliary information analysis unit 15 analyzes the data in the auxiliary information stream input from the separation unit 13 and extracts the display time 11b, the display position 11c, the auxiliary information ID 11d, and the auxiliary information content 11e included in the stream. Auxiliary information to be displayed on the screen is generated based on the above and output to the superimposing unit 16. The superimposing unit 16 superimposes the auxiliary information input from the auxiliary information analyzing unit 15 on the video data input from the video receiving / decoding unit 14 and outputs it as video data (display data) to be displayed on the screen.

  The operation of the auxiliary information analysis unit 15 will be described using the example of FIG. As a result of analyzing the data in the auxiliary information stream, when the “player name A” shown in FIG. 4 is set as the auxiliary information content 11e, the auxiliary information analysis unit 15 uses the predetermined character font to set the “player name A Is generated. The display position 11c of the auxiliary information stream shows the display position of the image indicating the auxiliary information content 11e. Here, position information indicating the position of the left player 11A on the screen 12 shown in FIG. 4 is set, and an image of “player name A” is displayed on the screen 12 shown in FIG. 4 according to the contents of the display position 11c. Is displayed at the position of the player 11A on the left side.

  Note that the position information set in the display position 11c can be sequentially changed in accordance with the movement of the player represented by the video stream image (the movement of the left player 11A on the screen 12 shown in FIG. 4). is there. By doing in this way, the display of “player name A” follows the movement of the player and moves.

  In the conventional auxiliary information display processing, the auxiliary information is displayed at a position that does not interfere with the video, and it is difficult to display the auxiliary information in the video in accordance with the movement of the display target. On the other hand, in the present invention, as the auxiliary information stream, the display position is set for each content of the auxiliary information in accordance with the movement of the target image in the video. Accordingly, as shown in FIG. 4, even if the left player 11A moves in the plurality of moving players 11A and 11B, the display of “player name A” follows and the right player 11B moves. When the display of “player name B” follows and moves, it is possible to display auxiliary information in accordance with the video content on the screen 12.

  When a plurality of display position candidates are set at the display position 11c in the auxiliary information stream, the auxiliary information analysis unit 15 displays the display position candidates read from the display position 11c on a display unit (not shown) for viewing. A GUI (Graphical User Interface) that allows a user to select a display position candidate using an input unit (not shown) is provided. In this way, auxiliary information can be displayed at a desired display position on the receiving side.

  In the above description, the case where characters are displayed as auxiliary information is shown, but still images and video images may be used as auxiliary information. For example, when the player name is used as auxiliary information as shown in FIG. 6, it is also possible to display auxiliary information with the team mark 11C by adding the team mark 11C of the player 11A to the auxiliary information.

  If the auxiliary information generation unit 8 extracts a still image or video image of the player's face from the video data and uses the video data of the face as auxiliary information, for example, on the screen 12 as shown in FIG. An enlarged image 11D of the face of the player 11A can be displayed on the face portion. In this way, a video screen that can be easily recognized by the viewer can be provided. Note that the still image or video image of the face portion of the player may be preset by control information.

  As described above, according to the first embodiment, the transmission apparatus 1 encodes and transmits video data, the video encoding transmission unit 6, the auxiliary information generation unit 8 that generates auxiliary information of the video data, An image analysis unit 7 for analyzing video data based on information of a target image to which auxiliary information is notified notified from the auxiliary information generation unit 8, and detecting a portion to which the auxiliary information is to be added in the video data; And an auxiliary information transmitting unit 9 that generates and transmits an auxiliary information stream 11 including a portion to which auxiliary information should be added in the video of the auxiliary information and video data. Further, the receiving device 3 receives and decodes the encoded video data, and receives and decodes the video data, and auxiliary information including the auxiliary information of the video data and the portion to which the auxiliary information is to be added in the video of the video data. Based on the analysis result of the auxiliary information analysis unit 15 and the auxiliary information analysis unit 15 that analyzes the stream and determines the content of the auxiliary information and the location to which the auxiliary information is to be added. And a superimposing unit 16 that generates and outputs display data in which auxiliary information is superimposed on the video data. As a result, the transmission device 1 transmits auxiliary information according to the content of the video image with appropriate display position information, and the reception device 3 displays the auxiliary information at the display position when displaying the video image. Therefore, even when displaying on a small display screen, the viewer can easily recognize the content of the video image.

  According to the first embodiment, the target image for displaying the auxiliary information is detected from the video image, and the display position of the auxiliary information is determined in accordance with the movement of the target image in the video image. Thus, the viewer can accurately recognize the target image in the video image. For example, when displaying the player name as auxiliary information on the images of the players 11A and 11B in the video of the karate game shown in FIG. 4, the player names can be displayed in accordance with the movements of the players 11A and 11B. Thereby, even if the karate game is displayed on the small display screen, the viewer can accurately recognize the player in the video from the player name.

Embodiment 2. FIG.
In the second embodiment, the display of auxiliary information can be changed by a user operation on the receiving side. FIG. 7 is a block diagram showing a configuration of a receiving apparatus according to Embodiment 2 of the present invention. In FIG. 7, a receiving apparatus 3A according to the second embodiment includes an input unit 17 in addition to the configuration of FIG. 5 shown in the first embodiment. The input unit 17 is a component for performing operations such as input of information and selection setting from the outside of the device 3A. The input unit 17 presents information related to auxiliary information input from the auxiliary information analysis unit 15 to the outside. The external operation corresponding to is received, and the input operation information is set in the auxiliary information analysis unit 15.

  The input unit 17 is realized as specific means in which software executed by a microcomputer mounted on the receiving device 3A and hardware such as a display device (not shown) and a remote controller of the receiving device 3A cooperate. For example, a setting screen linked to a remote control operation is displayed on a display device to provide a GUI for operations such as information input and selection. Further, the input operation may be facilitated by providing a voice recognition function for recognizing input information by using a touch panel as a display device or voice input via a microphone. Since the other components are the same as those in FIG. 5 described in the first embodiment, description thereof is omitted.

Next, the operation will be described.
When the multiplexed stream received from the transmission apparatus 1 shown in the first embodiment is input, the separation unit 13 in the reception apparatus 3A separates the multiplexed stream into a video stream and an auxiliary information stream, and the video stream is The data is output to the video receiving / decoding unit 14 and the auxiliary information stream is output to the auxiliary information analyzing unit 15. The video receiving / decoding unit 14 decodes the video stream input from the separation unit 13 to form video data that can be displayed on a screen (not shown), and then outputs the video data to the superimposition unit 16. The processing so far is the same as that in the first embodiment.

  The auxiliary information analysis unit 15 analyzes the auxiliary information stream input from the separation unit 13, and displays the display time 11b, the display position 11c, the auxiliary information ID 11d, and the auxiliary information content 11e shown in FIG. 3 in the first embodiment. Are extracted from the stream. Thereafter, the auxiliary information analysis unit 15 outputs information indicating that auxiliary information exists to the input unit 17 before generating auxiliary information to be displayed on the screen using these stream data.

  The input unit 17 uses the information input from the auxiliary information analysis unit 15 to display an operation screen on the display device and accepts an operation input from the user. For example, when the user indicates that the auxiliary information ID 11d exists and the user designates the display to be displayed at a position slightly lower than the original display position by the operation of the input unit 17, the corrected position information is received from the input unit 17 as the auxiliary information analysis. Is output to the unit 15.

  The auxiliary information analysis unit 15 corrects the position information set in the display position 11c extracted from the auxiliary information stream according to the corrected position information input from the input unit 17, generates auxiliary information to be displayed on the screen, and generates a superimposition unit. 16 is output. The superimposing unit 16 superimposes the auxiliary information input from the auxiliary information analyzing unit 15 on the video data input from the video receiving / decoding unit 14 and outputs the video data to be displayed on the screen. By doing in this way, it becomes possible to display auxiliary information according to the user's preference.

  Further, when a plurality of display position candidates are set in the display position 11c of the auxiliary information stream, the auxiliary information analysis unit 15 outputs to the input unit 17 that there are a plurality of these display position candidates. The input unit 17 indicates that there are a plurality of display position candidates on the screen so that the user can easily understand. When any of the plurality of display position candidates is selected by operating the input unit 17, information on the display position candidate is output from the input unit 17 to the auxiliary information analysis unit 15.

  By doing in this way, the user can display auxiliary information accurately in a desired display position. For example, the display of the player name in FIG. 4 shown in the first embodiment is easier to understand as it is closer to the player, but the player may be hidden by the character of the player name. In this case, a plurality of player name display position candidates for the player in the video are set, and the positional relationship between the player and the player name display is selected using the input unit 17. Thereby, it is possible to reflect a user's preference in the display of auxiliary information.

  The input unit 17 may display on the display device a screen for selecting whether or not to display auxiliary information input every moment in the auxiliary information stream. For example, when watching a soccer game with video images, it is necessary to display auxiliary information such as the player name at the beginning of the game, but if you watch the game for a certain amount of time, it will be displayed on the screen even if there is no auxiliary information such as the player name Can understand the video. Therefore, a screen for selecting whether or not auxiliary information can be displayed is displayed on the display device, and whether or not auxiliary information can be displayed is selected via the input unit 17. In this way, only information necessary for the user can be displayed.

  The input unit 17 also displays on the screen information that allows the user to specify the display size and color of the auxiliary information. When the display size or color of the auxiliary information is selected by operating the input unit 17, the selection information is output from the input unit 17 to the auxiliary information analysis unit 15.

  The auxiliary information analysis unit 15 modifies the information set in the auxiliary information content 11e extracted from the auxiliary information stream according to the selection information input from the input unit 17, generates auxiliary information to be displayed on the screen, and superimposes 16 Output to. The superimposing unit 16 superimposes the auxiliary information input from the auxiliary information analyzing unit 15 on the video data input from the video receiving / decoding unit 14 and outputs the video data to be displayed on the screen.

  In this way, it is possible to display auxiliary information according to the user's preference. For example, when displaying a player name as auxiliary information, if a user likes large characters, a font with large characters is selected. If a user likes small characters, a font with small characters is selected and auxiliary information is selected. Create If the display color, typeface, etc. of the auxiliary information can be selected, it is possible to obtain the auxiliary information display form that the user likes.

  As described above, according to the second embodiment, it is a component for performing operations such as information input and selection setting from the outside of the device 3A, and an external operation related to display of auxiliary information is received and input. Since the input unit 17 for setting the operation information in the auxiliary information analysis unit 15 is provided, the display method of the auxiliary information can be adjusted from the outside, and an easy-to-understand and easy-to-understand image can be displayed.

  Further, according to the second embodiment, the input unit 17 presents a plurality of display position candidates included in the auxiliary information stream, and sets the operation information for selecting the display position candidates in the auxiliary information analysis unit 15. Since the user can select the display position of the auxiliary information, it is possible to display an easy-to-understand and easy-to-understand image for the user.

  Further, according to the second embodiment, the input unit 17 presents a screen for selecting whether or not auxiliary information is to be displayed, and sets the operation information for selecting whether or not display is possible in the auxiliary information analyzing unit 15. Since the display or non-display of the auxiliary information can be selected by the operation, it is possible to display an image that is easy to see and understand for the user.

  Furthermore, according to the second embodiment, the input unit 17 presents a screen for selecting auxiliary information contents such as the display size and color of the auxiliary information, and the operation information selected for the auxiliary information contents is displayed as the auxiliary information analyzing unit. Therefore, the display size and color of the auxiliary information can be selected from the outside, and an easy-to-see and easy-to-understand image can be displayed.

Embodiment 3 FIG.
In the first embodiment or the second embodiment, the reception device that reproduces video data from the multiplexed stream from the transmission device in real time has been described. However, in the third embodiment, the storage unit that accumulates the multiplexed stream from the transmission device. A playback apparatus for playing back video data from stream data read from the storage unit will be described.

  FIG. 8 is a block diagram showing the configuration of a playback apparatus according to Embodiment 3 of the present invention. If the demultiplexing unit 13 directly inputs multiplexed stream data, the receiving apparatus 3 shown in Embodiment 1 or 2 above. , 3A. In FIG. 8, the playback device 4 includes a storage unit 18 in addition to the configuration of FIG. 7 shown in the second embodiment. The storage unit 18 is constructed on a storage area of a storage medium of a hard disk or an external storage device mounted on the playback device 4, and stores the multiplexed stream from the transmission device 1 shown in the first embodiment. Since the other components are the same as those in FIG. 7 shown in the second embodiment, description thereof is omitted.

Next, the operation will be described.
The separation unit 13 separates the multiplexed stream input from the storage unit 18 into a video stream and an auxiliary information stream, outputs the video stream to the video reception decoding unit 14, and outputs the auxiliary information stream to the auxiliary information analysis unit 15. . The subsequent operation is the same as the operation of the receiving apparatus 3A shown in the second embodiment. The method for accumulating the multiplexed stream in the accumulating unit 18 accumulates the multiplexed stream received from the transmission device 1 and input to the separating unit 13.

  As described above, according to the third embodiment, the playback device 4 includes the encoded video data, the auxiliary information of the video data, and the auxiliary including the portion where the auxiliary information is to be added in the video data. An accumulator 18 for accumulating an information stream, a video reception decoder 14 for decoding video data read from the accumulator 18, and ancillary information transmission data read from the accumulator 18 to analyze the contents of the auxiliary information and Auxiliary information analysis unit 15 for determining a location to which the auxiliary information should be added, and a display in which auxiliary information is superimposed on the video data decoded by the video reception decoding unit 14 based on the analysis result of the auxiliary information analysis unit 15 Since the superimposing unit 16 that generates and outputs data is provided, the accumulated multiplexed stream and auxiliary information can be reproduced in non-real time.

  In the third embodiment, the configuration in which the storage unit 18 is provided in the receiving device 3A according to the second embodiment has been described. However, the storage unit 18 may be provided in the configuration in the first embodiment.

  In the third embodiment, the example in which the multiplexed stream including the video stream and the auxiliary information stream is stored in the storage unit 18 has been described. However, when the video stream and the auxiliary information stream are transmitted separately, May be stored separately. In this case, the separation unit 13 is not used, and the video stream and the auxiliary information stream are respectively input to the video reception decoding unit 14 and the auxiliary information analysis unit 15.

It is a figure which shows the structure of the television broadcast transmission / reception system by this invention. It is a block diagram which shows the structure of the transmitter by Embodiment 1 of this invention. It is a figure which shows the transmission format of auxiliary information. It is a figure which shows the example of a display by the receiving side containing auxiliary information. It is a block diagram which shows the structure of the receiver by Embodiment 1 of this invention. It is a figure which shows the example of a display by the receiving side containing auxiliary information. It is a block diagram which shows the structure of the receiver by Embodiment 2 of this invention. It is a block diagram which shows the structure of the reproducing | regenerating apparatus by Embodiment 3 of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Transmission apparatus, 1a Stream data, 2 Broadcast equipment, 3, 3A reception apparatus, 4 Playback apparatus, 5 Broadcast wave, 6 Video encoding transmission part (video transmission part), 7 Image analysis part, 8 Auxiliary information generation part, 8a Control information input unit, 9 auxiliary information transmission unit, 10 multiplexing unit, 11 auxiliary information stream (auxiliary information transmission data), 11a identifier, 11b display time, 11c display position, 11d auxiliary information ID, 11e auxiliary information content, 11A, 11B player, 11C mark, 11D enlarged image, 12 screens, 13 separation unit, 14 video reception decoding unit (video decoding unit), 15 auxiliary information analysis unit, 16 superposition unit, 17 input unit, 18 storage unit.

Claims (10)

A video transmitter for encoding and transmitting video data;
An auxiliary information generating unit for generating auxiliary information of the video data;
An image analysis unit that analyzes the video data based on information of a target image to which the auxiliary information is notified notified from the auxiliary information generation unit, and detects a portion where the auxiliary information is to be displayed in the video data. When,
A transmission apparatus comprising: an auxiliary information transmission unit that generates and transmits auxiliary information transmission data including a portion where the auxiliary information should be displayed in the video of the auxiliary information and the video data.   When the content of the auxiliary information is the same and there is a change in the location where the auxiliary information is to be displayed, the auxiliary information transmitting unit generates and transmits auxiliary information transmission data including only the location where the auxiliary information is to be displayed. The transmission apparatus according to claim 1.   The transmission device according to claim 1 or 2, wherein the auxiliary information transmission unit generates and transmits auxiliary information transmission data including a plurality of candidates for displaying the auxiliary information.   4. The auxiliary information generation unit generates auxiliary information using at least one of a moving image and a still image that are set in advance or extracted from video data. The transmission device according to claim 1. A video decoding unit for receiving and decoding the encoded video data;
The auxiliary information of the video data and the auxiliary information transmission data including the portion where the auxiliary information is to be displayed in the video data are analyzed to determine the content of the auxiliary information and the portion where the auxiliary information is to be displayed. An auxiliary information analysis unit;
And a superimposing unit that generates and outputs display data in which the auxiliary information is superimposed on the video data decoded by the video decoding unit based on the analysis result of the auxiliary information analyzing unit. It has an input unit that accepts external operation information,
The receiving apparatus according to claim 5, wherein the auxiliary information analyzing unit determines a presentation method of the auxiliary information according to the operation information input by the input unit. The input unit presents a plurality of candidates for displaying the auxiliary information,
The receiving apparatus according to claim 6, wherein the auxiliary information analysis unit sets a location designated from the plurality of candidates by the input unit as a location where the auxiliary information is to be displayed. The input unit presents whether auxiliary information can be displayed,
The receiving apparatus according to claim 6 or 7, wherein the auxiliary information analysis unit determines whether or not the auxiliary information can be displayed according to whether or not the input is selected by the input unit. The input unit presents selection information for display contents of auxiliary information,
The said auxiliary information analysis part determines the display content of the said auxiliary information according to the display content of the auxiliary information selected by the said input part, The any one of Claims 6-8 characterized by the above-mentioned. Receiver. A storage unit for storing encoded video data, auxiliary information of the video data, and auxiliary information transmission data including a portion where the auxiliary information is to be displayed in the video data;
A video decoding unit for decoding the video data read from the storage unit;
Analyzing the auxiliary information transmission data read from the storage unit, and determining the content of the auxiliary information and the location where the auxiliary information is to be displayed; and
And a superimposing unit that generates and outputs display data in which the auxiliary information is superimposed on the video data decoded by the video decoding unit based on the analysis result of the auxiliary information analyzing unit.

Images