JP2007336478A - Output method and output apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an output method and an output apparatus in which a viewer who is viewing a television program, can view a missed caption without affecting a stream of video images if the viewer misses audio or caption of the program. <P>SOLUTION: An output apparatus 1 receives video data and audio data of which the output timing is made to correspond to the video data, from a tuner 12 or an external signal input section 13, generates character data from the received audio data and records the generated character data in a recording section 11. The output apparatus 1 then outputs characters based on the recorded character data temporally independently of the video data. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an output method for outputting video based on video data, and an output device to which the output method is applied, and in particular, an output capable of increasing the degree of freedom regarding video and audio viewing such as television broadcasting and video playback. The present invention relates to a method and an output device.

  A viewer who watches a television program may miss the audio in the program, or may miss the subtitle if the program is a movie with subtitles. In such a case, it is impossible for the viewer to view the missed audio or the missed subtitles again. Also, when multiple viewers are playing back a recorded program at the same time and one viewer misses the audio or misses the subtitles, the one viewer missed the audio Or, performing operations such as rewinding and repeated playback to watch a missed caption may interrupt the flow of the program and may be beaten depending on the relationship with other viewers.

Therefore, Patent Document 1 discloses an apparatus that compresses and records video data including audio related to a program, and re-outputs video based on the recorded video data as necessary. Patent Documents 2 and 3 disclose devices that extend the subtitle display time.
Japanese Patent Application Laid-Open No. 8-237592 JP 2002-232798 A JP 2003-333504 A

  However, since the apparatus disclosed in Patent Document 1 is substantially the same as the reproduction of a recorded program, it is effective when there is only one viewer, but when there are a plurality of viewers, The problem of repeated playback depending on the relationship with the viewer has not been solved.

  Further, the devices disclosed in Patent Document 2 and Patent Document 3 cannot be applied to a program for which no caption data exists, and the above-described problems are not solved.

  The present invention has been made in view of such circumstances, and by recording character data such as subtitles whose output timing is associated with video data and outputting the video data independently in time, The main object of the present invention is to provide an output method capable of viewing a missed caption without affecting the flow of the video, and an output device to which the output method is applied.

  Furthermore, the present invention analyzes the audio data in which the output time is associated with the video data and generates character data, so that the flow of the video is not affected even for a program that does not originally have character data. It is possible to view missed subtitles and output audio as text, so that it is possible to provide an output device that can reduce adverse effects on viewing by other viewers. To do.

  The output method according to the present invention is an output method using an output device that outputs video based on video data. Character data associated with output time is recorded in video data to be output, and the recorded character data is recorded. Characters based thereon are output temporally independent from video data.

  In the present invention, it is possible to perform output based on character data relating to the content that has already been output without affecting the flow of the video to be output.

  An output device according to the present invention, in an output device that outputs video based on video data, is independent in time from the video data and means for recording character data whose output time is associated with the video data to be output. And character data output means for outputting based on the recorded character data.

  In the present invention, it is possible to perform output based on character data relating to the content that has already been output without affecting the flow of the video to be output.

  In the output device according to the present invention, the video data includes audio data that outputs audio in synchronization with the video, and analyzes the audio data to generate character data in which an output time is associated with the video data. It is characterized by further comprising means for performing.

  In the present invention, it is possible to record audio relating to video data such as a program not associated with character data as character data that can be output independently from the video data in terms of time.

  In the output device according to the present invention, the video data includes subtitle data for outputting characters to the video, and the subtitle data is analyzed to generate character data in which the output time is associated with the video data. It is further provided with the feature.

  In the present invention, subtitles to be displayed on video can be recorded as character data that can be output independently of video data in terms of time.

  The output device according to the present invention further includes means for accepting setting of a data amount of character data to be output at the same time, and the character data output unit outputs a video indicating characters based on the character data of the set data amount. It is comprised by these.

  In the present invention, it is possible to simultaneously output characters based on a set amount of character data.

  The output device according to the present invention further includes means for generating voice data based on character data, and the character data output means is configured to output voice based on the generated voice data. To do.

  In the present invention, it is possible to output character data such as subtitles as sound.

  The output device according to the present invention comprises means for accepting designation of character data, and means for retrieving video data associated with the designated character data.

  In the present invention, video data can be searched using character data as a key.

  An output method and an output device according to the present invention are applied to an output device such as a television receiver or a recording / reproducing device that outputs video based on video data, and character data in which an output time is associated with the output video data. Are output based on the recorded character data independently of the video data in terms of time.

  With this configuration, in the present invention, the output based on the character data relating to the content that has already been output is performed without affecting the flow of the output video, so that, for example, the viewer misses the subtitles output based on the character data. In this case, it is possible to produce a superior effect such that the subtitles can be output and viewed without affecting the flow of the video.

  In particular, the present invention analyzes audio data relating to audio that is output simultaneously with video, and generates character data that associates video data with output time.

  With this configuration, according to the present invention, it is possible to re-view subtitles and view them without affecting the video flow, even for programs that are not associated with character data such as subtitles, By re-outputting as a character, even when watching a program with multiple viewers, it does not output audio that is different from the audio along the flow of the video, which affects the viewing of other viewers. Without giving it, it is possible to visually recognize the missed voice as characters, and so on.

  Further, the present invention analyzes subtitle data for displaying characters in a video, and generates character data in which the video data is associated with the output time.

  With this configuration, in the present invention, character data can be separated from video having subtitles, and characters can be output temporally independent from the video data. For example, when a viewer misses a subtitle, the flow of the video The subtitles can be re-output and viewed without affecting the output.

  In addition, the present invention has an excellent effect that, for example, it is possible to increase the degree of freedom of the viewing method by converting character data into sound and outputting it.

  Furthermore, the present invention accepts the setting of the data amount of character data to be output at the same time, and the character display time can be extended by simultaneously outputting the characters as video based on the character data of the set data amount. There are excellent effects such as making it difficult to overlook characters related to character data.

  Furthermore, according to the present invention, it is possible to improve the convenience when searching for a desired video by accepting designation of character data and enabling retrieval of video data associated with the designated character data. Etc. have excellent effects.

  Hereinafter, the present invention will be described in detail with reference to the drawings illustrating embodiments thereof. FIG. 1 is a block diagram showing the configuration of the output device of the present invention. 1, reference numeral 1 denotes an output device such as a television receiver. The output device 1 includes a control unit 10 such as a microcomputer for controlling the entire device, a recording unit 11 such as a RAM for recording various information, and an antenna. A tuner 12 that receives broadcast waves received via the signal, and an external signal input unit 13 that receives signals from an external device such as a hard disk recorder or a DVD player. The tuner 12 and the external signal input unit 13 display video. A signal including various data such as video data to be output and audio data to be output is output to the input signal selection unit 14. The input signal selection unit 14 selects a signal to be output from the received signals and outputs the selected signal to various circuits.

  The output device 1 further includes a speech synthesis timing control unit 15 that performs processing related to speech data included in the signal received by the input signal selection unit 14, and a speech output unit 16 such as a speaker that outputs speech based on the speech data. ing. The voice-related process performed by the voice synthesis time control unit 15 is a process of selecting or synthesizing the voice received from the input signal selection unit 14 and other voices while controlling the output time.

  Further, the output device 1 includes a video compression unit 17 that performs processing related to video data included in the signal received by the input signal selection unit 14, a video synthesis unit 18, and a video output such as a liquid crystal panel that outputs video based on the video data. Part 19. The video processing performed by the video compression unit 17 is a process for reducing the vertical and horizontal sizes of the video to be output based on the video data. The process related to the video performed by the video synthesizing unit 18 is a process of synthesizing the video received from the input signal selecting unit 14 via the video compressing unit 17 with another video.

  Further, the output device 1 includes a data separation unit 20 that separates caption data related to the caption from the video data when the caption to be displayed is included in the video, and a character that indicates the character by analyzing the separated caption data. The character data generated by the video analysis unit 21 is recorded in a character data recording unit provided in the recording area of the recording unit 11. Needless to say, the character data recorded in the character data recording unit is associated with video data and output time. Separation of caption data by the data separation unit 20 is a process of separating the included character data as caption data when the received video data includes character data to be captioned. In the case where the displayed video itself includes subtitles, processing for analyzing the video based on the video data and separating the character portion as subtitle data is shown.

  Furthermore, when the audio data is analog data, the output device 1 includes an audio A / D converter 22 that converts the audio data into digital data, and a voice generated by a person from the digital audio data converted by the audio A / D converter 22. And a voice section detector 24 for detecting a section that is a word generated by a person. The feature extraction section 23 and the voice section detector 24 mainly perform voice analysis. The digital audio data converted by the audio A / D converter 22 is recorded in an audio data recording unit provided in the recording unit 11. Further, the output device 1 includes voice data analyzed by the feature extraction unit 23 and the voice segment detection unit 24, and a standard model, a language model, an acoustic model, and the like extracted from the comparison data recording unit recorded in the recording unit 11 in advance. Character data for generating character data based on an analysis result by the likelihood calculation unit 25, further comprising a likelihood calculation unit 25 that compares the voice data for comparison set for each model of And a generation unit 26. Then, analysis is performed by the feature extraction unit 24, the speech section detection unit 24, and the likelihood calculation unit 25, and character data is generated by the character data generation unit 26. The generated character data is recorded in the character data recording unit of the recording unit 11. Since the audio data is output in synchronization with the video, it goes without saying that the video data and the output time are associated with the character data recorded in the character data recording unit.

  The output device 1 further includes a display character generation unit 27 that generates characters to be displayed as subtitles in the video based on the character data recorded in the character data recording unit of the recording unit 11. The generated data is output to the video composition unit 18.

  Further, the output device 1 includes an audio data generation unit 28 that generates digital audio data based on the character data recorded in the character data recording unit of the recording unit 11, and a digital data generated by the audio data generation unit 28. A voice D / A converter 29 for converting the voice data into analog, and the analog voice data converted by the voice D / A converter 29 is output to the voice synthesis timing controller 15 for voice synthesis timing control. The sound is output from the sound output unit 16 based on the output timing controlled by the unit 15. The voice data recorded in the voice data of the recording unit 11 is also output to the voice synthesis timing control unit 15 via the voice D / A conversion unit 29.

  The output device 1 further includes a video A / D conversion unit 30 that converts the analog video data received by the input signal selection unit 14 into digital data, and the video data converted into digital by the video A / D conversion unit 30. Is recorded in a video data recording unit provided in the recording unit 11.

  The output device 1 further includes a video D / A conversion unit 31 that converts digital video data recorded in the recording unit 11 into video data of the recording unit 11 into analog video data. The converted digital analog data is output to the video compression unit 17. Note that when video data such as the tuner 12 and the external signal input unit 13 is received as digital data, the video A / D conversion unit 30 and the video D / A conversion unit 31 are not necessarily required.

  Further, the output device 1 includes various push buttons for receiving various operations such as various settings and processing commands, and an operation input unit 32 such as an electromagnetic wave receiving unit for remote control. Various settings are set in the operation signal received by the operation input unit 32. The indicated signal is recorded in a setting recording unit provided in the recording unit 11.

  Next, processing of the output device 1 of the present invention will be described. FIG. 2 is a flowchart showing the character data recording process of the output device 1 of the present invention. The output device 1 of the present invention executes a character data recording process for recording character data relating to an image being output when the operation input unit 32 receives a predetermined operation. The output device 1 determines whether or not character data is included in the video data that has been accepted under the control of the control unit 10 (S101). If it is determined that character data is included (S101: YES), it is included. Is recorded in the character data recording unit of the recording unit 11 (S102), the process returns to step S101, and the subsequent processing is repeated. The character data included in the video data is, for example, when the video data is data related to text broadcasting, the character data included as text for text broadcasting whose output time is synchronized with the video data. 11 is recorded. Since the process of recording the character data is performed for each predetermined processing time unit of the video data, the process returns to step S101 after the character data recording process of step S102, and the process is performed based on the video data continuously received. repeat.

  If it is determined in step S101 that character data is not included (S101: NO), the output device 1 generates character data from data such as audio data that outputs audio in synchronization with video data, for example, by processing described later. Character data generation processing is executed (S103), the character data generated by the character data generation processing is recorded in the character data recording unit of the recording unit 11 (S102), the process returns to step S101, and the subsequent processing is repeated.

  FIG. 3 is a flowchart showing the first character data generation process of the output device 1 of the present invention. The output device 1 of the present invention executes a character data generation first process for generating character data based on voice data as the character data generation process in the character data recording process. Under the control of the control unit 10, the output device 1 analyzes the audio data relating to the audio to be output in synchronization with the video using various circuits such as the feature extraction unit 23 and the audio section detection unit 24 described above (S201). Character data based on the voice data is generated from the analysis result (S202), the process proceeds to step S102 in the character data recording process, and the generated character data is recorded in the character data recording unit of the recording unit 11 (S102). Since the sound based on the audio data is output in synchronization with the video, the output time of the character data generated based on the audio data is associated with the video data. For example, video data recorded in the video data recording unit and character data recorded in the character data recording unit have output time data used for synchronous output, so-called time stamps.

  FIG. 4 is a flowchart showing the second character data generation process of the output device 1 of the present invention. The output device 1 according to the present invention executes character data generation second processing for generating character data based on video data as character data generation processing in character data recording processing. The output device 1 determines whether or not caption data is included in the video data under the control of the control unit 10 (S301). If the output device 1 determines that caption data is included (S301: YES), the data separation circuit 20 separates the data related to the caption from the video data (S302), analyzes the separated data by the video analysis unit 21 (S303), proceeds to step S102 in the character data recording process, and generates the character data generated as the analysis result Is recorded in the character data recording section of the recording section 11 (S102).

  If it is determined in step S301 that no caption data is included (S301: NO), the process proceeds to step S102 in the character data recording process, and the subsequent processes are repeated. However, since character data to be recorded has not been generated, if it is determined that substantially no caption data is included, the process proceeds to step S101, and the subsequent processing is repeated.

  As described above, in the output device 1 of the present invention, when character data is included in video data, character data associated with an output time is recorded in the video data, and when character data is not included, audio data is recorded. Alternatively, based on the video data, character data whose output time is associated with the video data is generated and recorded. The generation of character data based on audio data and the generation of character data based on video data may be selected and executed, or both may be executed in parallel. Furthermore, even if the video data includes character data in advance, generation of character data based on the audio data and character data based on the video data is generated in parallel with the recording of the character data included in the video data in advance. And recording may be executed.

  By executing the character data recording process, the character data generation first process, and the character data generation second process described above, the character data in which the output time is associated with the video data to be output can be recorded in the recording unit 11. it can. The character data recorded in the recording unit 11 can be output temporally independent from the video data. The condition when the character data recorded in the recording unit 11 is output temporally independent from the video data is based on the setting recorded in the setting recording unit of the recording unit 11, and the operator operates the remote controller, for example. By doing so, conditions can be input.

  FIG. 5 is an explanatory diagram showing a setting screen output from the output device 1 of the present invention. The setting screen shown in FIG. 5 shows a setting operation menu displayed on the video output unit 19 as an OSD (On Screen Display) by the processing of the video composition unit 18 when the operator operates the remote controller, for example. FIG. 5A shows an initial menu, which shows options such as “subtitle display”. By selecting “subtitle display”, characters based on the character data recorded in the recording unit 11 are output as subtitles. You can make settings if you want to.

  FIG. 5B shows a menu displayed when “Subtitle display” is selected in FIG. 5A, and “Display time / line number setting”, “Display screen setting”, “Display location”, Options such as “display area” are shown.

  FIG. 5C is a menu that is displayed when “display time / number of lines” is selected in FIG. 5B, and a display condition designation field labeled “display: number of lines of time”. In addition, a setting value designation field indicated as “setting” is shown. By checking the radio button labeled “time” in FIG. 5C and instructing “setting”, the display time setting menu shown in FIG. 5D is displayed. By inputting the display time in the display time setting menu, it is possible to set the display time of characters (captions) based on the character data. Further, by checking the radio button labeled “number of rows” in FIG. 5C and instructing “setting”, the display row number setting menu shown in FIG. 5E is displayed. The number of display lines of characters based on the character data can be set by inputting the number of display lines (data amount of character data) from the display line number setting menu.

  FIG. 5F is a menu that is displayed when “display screen setting” is selected in FIG. 5B, and shows options related to the arrangement of video based on video data and characters based on character data. ing.

  FIG. 5G is a menu displayed when “display location” is selected in FIG. 5B, and it is possible to designate a display position on the display screen of characters (captions) based on character data. it can.

  FIG. 5H is a menu displayed when “display area” is selected in FIG. 5B, and the size of the display area of characters (captions) based on character data can be designated.

  When the operator performs the operation illustrated with reference to FIG. 5, the output device 1 of the present invention starts output based on the character data recorded in the recording unit 11. FIG. 6 is a flowchart showing the character output process of the output device 1 of the present invention. The output device 1 receives an operation for requesting execution of character output processing based on character data by the operation input unit 32 under the control of the control unit 10 (S401), and the video output from the video output unit 19 based on the video data. Then, it is determined whether or not it is necessary to change the video size that accompanies the character output (S402).

  If it is determined in step S402 that the video size needs to be changed (S402: YES), the output device 1 changes the video size in the video compression unit 17 (S403), and the received setting is recorded in the setting unit 11 as a setting record. The character output timing condition for the subsequent processing is set by recording in the section (S404). If it is determined in step S402 that the video size does not need to be changed (S402: NO), the video size change in step S403 is not executed.

  Then, the output device 1 reads the character data recorded in the character data recording unit of the recording unit 11 into the display character generation unit 27 based on the set output time condition (S405), and based on the read character data. The display character generation unit 27 generates a character to be displayed (output) (S406), and the generated character is combined with the video based on the video data by the video synthesis unit 18 (S407), and the video obtained by combining the characters is displayed. The video is output from the video output unit 19 (S408). Then, the process returns to step S405, character data relating to the character to be displayed next is read, and the subsequent processing is repeated.

  By the operation accepted in step S401, the output device 1 accepts the setting of output conditions such as the amount of data (number of lines) to be displayed at the same time based on the character data and the output time. Characters based on character data are characters that should be output in synchronization with video based on video data. However, by setting the output time, characters based on character data are output independently of video data. can do. The output time condition that is set is a condition that output is delayed by a predetermined time or a predetermined amount of data from the original output time associated with the video data. Output the character based on. Since the character data is generated based on, for example, sound as described above, the character relating to the sound is output as a subtitle on the screen 5 minutes after the sound is output. Output that is temporally independent from the video data of characters based on the character data is realized by recording the character data in the character data recording unit of the recording unit 11 separately from the video data while associating the character data with the video data.

  FIG. 7 is a flowchart showing an audio output process of the output device 1 of the present invention. The output device 1 of the present invention can also output voice as output based on character data. Under the control of the control unit 10, the output device 1 receives an operation for requesting execution of voice output processing based on character data at the operation input unit 32 (S501), and the setting included in the received request is set in the recording unit 11. By recording in the recording unit, the condition of the audio output timing by the subsequent processing is set (S502).

  Then, the output device 1 reads the character data recorded in the character data recording unit of the recording unit 11 into the voice data generation unit 28 based on the set output timing condition (S503), and based on the read character data. Then, the audio data generation unit 28 generates digital audio data (S504), the generated digital audio data is converted into analog audio data by the audio D / A conversion unit 29, and the audio synthesis time control unit 15 After the output timing is controlled, the sound is output from the sound output unit 16 as sound (S505). Then, the process returns to step S503, character data relating to the voice to be output next is read, and the subsequent processing is repeated.

  The output device 1 of the present invention can set the condition of the output time even when outputting the sound based on the character data, similarly to the case of outputting the character as the subtitle. Voices based on character data can be output independently in time.

  FIG. 8 is a flowchart showing video data search processing of the output device 1 of the present invention. Since the output device 1 of the present invention records character data by associating the output time with the video data, it is also possible to search the video data based on the character data. For example, the operator operates a remote controller and designates character data as characters. The output device 1 receives the designation of character data under the control of the control unit 10 (S601), and searches the video data recording unit of the recording unit 11 for video data temporally associated with the designated character data. Then, a video based on the searched video data is output from the video output unit 19 (S603).

  Next, an output example of the output device 1 of the present invention will be described. FIG. 9 is an explanatory diagram showing an output example of the output device 1 of the present invention. In FIG. 9, an area indicated as “video” indicates an area in which video based on video data is displayed. “AAAAA”, “BBBBB”, “CCCCC”, “DDDDD”, and “EEEEEE” indicate characters displayed as subtitles, and the original output timing is in the order of “AAAAA”, “BBBBB”,. is there. However, “EEEEEE” is a character whose video and output timing are synchronized, that is, a character displayed in real time. That is, the characters “AAAAA”, “BBBBB”, “CCCCC”, and “DDDDD” are characters that are output independently from the video data at a time different from the output time of the video that is originally output in synchronization. .

  FIG. 9A shows an example in which characters based on character data are displayed as subtitles at the bottom of the video. Note that subtitles may be displayed on the top or side of the video. In addition, characters displayed in real time indicated as “EEEEEE” may be emphasized as different from other characters in the display method such as the typeface and display color.

  FIG. 9B shows an example in which characters displayed in real time are displayed in a different area from other characters. FIG. 9B shows a case where, for example, only a real-time character is displayed and viewed by a plurality of people. When one viewer misses a caption, the display method is used. The previous subtitles can be displayed separately from the real time subtitles, and the subtitles can be confirmed without being confused by one viewer who missed the subtitles and other viewers. Also in the example shown in FIG. 9B, the display method of characters displayed in real time may be emphasized as different from other characters.

  FIG. 9C shows an example in which characters are displayed on the side of the video in the example shown in FIG.

  FIG. 9D shows an example in which past characters such as “AAAAA” are displayed in the upper part and real-time characters are displayed in the lower part in the example shown in FIG. 9B. As shown in FIG. 9D, the previously displayed character and the real time character are not necessarily displayed at the same position.

  FIG. 9E shows an example in which characters of each period are arbitrarily arranged and displayed at different positions.

  As shown in FIG. 9, the characters to be displayed as subtitles can be arranged at arbitrary positions in the video, and the real-time characters can be highlighted as necessary. In addition, the display method illustrated in FIG. 9 may be displayed in the state illustrated from the beginning, but only when the output device 1 accepts an operation, characters may be displayed as subtitles. May display only the first real-time characters, and may additionally display past characters as necessary.

  FIG. 10 is an explanatory diagram showing an output example of the output device 1 of the present invention. Note that the notation method such as character notation is the same as that in FIG. FIG. 10A shows an example in which the video display area and the character display area are displayed separately, with the video displayed at the top of the screen and the characters displayed at the bottom. The video display area shown in FIG. 10A is converted by the video compression unit 17 into a format different from the original image format, and the aspect ratio is different from that of the original video. Thus, the display position is adjusted from the full screen to the upper screen.

  FIG. 10B shows an example in which the aspect ratio of the video to be displayed matches the original video in the example shown in FIG.

  In FIG. 10C, the video display area and the character display area are separated, the video is displayed on the left side of the screen, and the characters are displayed on the right side of the screen. The video shown in FIG. 10C has a different aspect ratio than the original video.

  FIG. 10D shows an example in which the aspect ratio of the video to be displayed matches the original video in the example shown in FIG.

  FIG. 10E shows an example in which a character display area is a full screen, and a video display area is provided in the character display area.

  As shown in FIG. 10, the image display area and the character display area can be separated, and the image can be displayed in the character display area. Furthermore, the aspect ratio of the video can be set as appropriate. Further, the display method illustrated in FIG. 10 may be displayed in the state illustrated from the beginning, but the display method may be changed only when the output device 1 receives an operation.

  FIG. 11 is an explanatory diagram showing an output example of the output device 1 of the present invention. Note that the notation method such as character notation is the same as that in FIG. FIG. 11A shows an example in which real-time characters are provided in the video display area in the example shown in FIG.

  FIG. 11B shows an example in which real-time characters are displayed in the video display area and also displayed in the right area where past characters are displayed in the example shown in FIG. ing.

  FIG.11 (c) has shown the example which isolate | separated the real-time character from the display area of the past character in the example shown in FIG.10 (d).

  As shown in FIG. 11, the display position of the video, characters, and real-time characters can be appropriately selected. Note that the display method shown in FIG. 11 is suitable for display in which only the first real-time characters are displayed and past characters are additionally displayed.

  FIG. 12 is an explanatory diagram showing an output example of the output device 1 of the present invention. Note that the notation method such as character notation is the same as that in FIG. FIG. 12A shows that the number of characters to be displayed can be arbitrarily set in the example shown in FIG. The example shown in FIG. 10D displays five lines of characters including the real time, whereas the example shown in FIG. 12A displays three lines of characters. . The number of characters (number of lines) to be displayed can be limited by setting “display time / number of lines setting” and by limiting the amount of data recorded in the recording unit 11.

  FIG. 12B shows an example in which all character data is recorded in the recording unit 11 and characters of the number of lines set in the recorded character data are displayed.

  In FIG. 12C, all the character data is recorded in the recording unit 11, and characters of the number of lines set in the recorded character data are displayed, but a return icon indicated by “Δ: LAST” is displayed. Can be scrolled to display past characters. Conversely, when a feed icon indicated by “示 し: NEXT” is designated, the displayed characters can be scrolled to display the subsequent characters. The return icon can be eliminated and only the feed icon can be set as appropriate.

  FIG. 13 is an explanatory diagram showing an output example of the output device 1 of the present invention. FIG. 13 shows an example in which voice is displayed based on character data. FIG. 13A shows a normal output state, and real-time sound indicated as “EEEEEE” is output from the left and right speakers (audio output unit 16). FIG. 13A shows an example in which a voice based on character data to be output in the past recorded in the recording unit 11 is output from the right speaker as indicated by “AAAA”, “BBBB”,. As described above, the output device 1 of the present invention can output audio based on character data output temporally independent from video data at a time different from the output time of video that is originally output in synchronization. . Real-time audio is output from the left speaker. In addition, in order to prevent the left and right voices from being mixed and difficult to hear, the voice synthesis time control unit 15 controls the output timing of the left and right voices.

  In the above embodiment, a TV receiver is used as the output device. However, the present invention is not limited to this, and various other devices such as a DVD player or other recording / playback device can be used. It is possible to develop in various forms.

It is a block diagram which shows the structure of the output device of this invention. It is a flowchart which shows the character data recording process of the output device of this invention. It is a flowchart which shows the character data generation 1st process of the output device of this invention. It is a flowchart which shows the character data generation 2nd process of the output device of this invention. It is explanatory drawing which shows the setting screen output from the output device of this invention. It is a flowchart which shows the character output process of the output device of this invention. It is a flowchart which shows the audio | voice output process of the output device of this invention. It is a flowchart which shows the video data search process of the output device of this invention. It is explanatory drawing which shows the example of an output of the output device of this invention. It is explanatory drawing which shows the example of an output of the output device of this invention. It is explanatory drawing which shows the example of an output of the output device of this invention. It is explanatory drawing which shows the example of an output of the output device of this invention. It is explanatory drawing which shows the example of an output of the output device of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Output device 10 Control part 11 Recording part 12 Tuner 13 External signal input part 14 Input signal selection part 15 Speech synthesis time control part 16 Audio output part 17 Video compression part 18 Video synthesis part 19 Video output part 20 Data separation part 21 Video analysis 21 Unit 22 audio A / D conversion unit 23 feature extraction unit 24 audio segment detection unit 25 likelihood calculation unit 26 character data generation unit 27 display character generation unit 28 audio data generation unit 29 audio D / A conversion unit 30 video A / D conversion Section 31 Video D / A conversion section 32 Operation input section

Claims (7)

In an output method using an output device that outputs video based on video data,
Record the text data associated with the output time to the video data to be output,
An output method characterized in that characters based on recorded character data are output temporally independent from video data. In an output device that outputs video based on video data,
Means for recording character data in which output time is associated with video data to be output;
An output device comprising: character data output means for outputting based on recorded character data independently of video data in terms of time. The video data includes audio data for outputting audio in synchronization with video,
The output device according to claim 2, further comprising means for analyzing the audio data and generating character data in which an output time is associated with the video data. The video data includes subtitle data for outputting characters to the video,
The output apparatus according to claim 2, further comprising means for analyzing the caption data and generating character data in which an output time is associated with the video data. Means for receiving a setting of the amount of character data to be simultaneously output;
The output according to any one of claims 2 to 4, wherein the character data output means is configured to output an image showing characters based on character data of a set amount of data. apparatus. Means for generating voice data based on the character data;
The output device according to any one of claims 2 to 5, wherein the character data output means is configured to output a voice based on the generated voice data. Means for accepting designation of character data;
The output device according to any one of claims 2 to 6, further comprising: means for retrieving video data associated with the designated character data.

Images