JP5354145B2 - Video display device and video display method - Google Patents

Description

  The present invention relates to a video display device and a video display method, and more particularly to a video display device and a video display method for recording video content.

  A mobile phone capable of displaying a video broadcast on television (for example, 1 segment broadcast) is known. In the video, there are cases where a character string exemplified in the application place or lyrics of the prize is displayed. Since the video size of the 1-segment broadcasting is small and the display surface of the mobile phone is small, the viewer has difficulty in reading the character string displayed on the video. When the viewer does not have a recording function, the viewer cannot check the character string later. When the mobile phone has a recording function, the viewer can check the character string later by recording the video. When the mobile phone is not capable of recording video because the storage capacity of the installed storage device is insufficient, the viewer cannot confirm the content of the video later. For this reason, the mobile phone is desired to record more video content and to store the video content with a smaller amount of information.

  Japanese Patent Laid-Open No. 2005-277792 discloses that a terrestrial digital broadcast image can be displayed normally regardless of whether the display unit is used in a portrait or landscape orientation with a vertical and horizontal size of a display image of video data being constant. A communication terminal device is disclosed. The communication terminal device further controls display of an image of text data multiplexed with video data in terrestrial digital broadcasting, so that a user who mainly views video information or a user who mainly views text information. Enable TV images that are easier to see. The communication terminal device includes receiving means, display means, mechanism means, and image processing means. The receiving means receives a television broadcast in which video data and text data are multiplexed. The display means displays the image of the video data and text data received by the receiving means. The mechanism means makes it possible to set the accommodating portion accommodating the display means in the first displacement state or the second displacement state in accordance with an operation. The image processing means displays the image of the video data received by the receiving means on a part of the display area of the display means when the accommodating portion is set in the first displacement state, Image processing for displaying the image of the text data received by the receiving means in another display area is performed. The image processing means further displays the image of the video data received by the receiving means in the entire display area of the display means when the accommodating portion is set in the second displacement state, Image processing is performed to superimpose and display an image of text data received by the receiving means on an image of video data.

  Japanese Patent Application Laid-Open No. 2007-053796 discloses a communication apparatus that enables viewing of a digital broadcast and telephone "while talking", and displaying the subtitle broadcast of the digital broadcast for a minimum time. The communication apparatus includes a multiplexed data receiving unit, an extracting unit, a telephone unit, an audio output unit, and a display output unit. The multiplex data receiving unit receives multiplex data including at least audio data and video data or character data. The extraction unit extracts the audio data and the video data or the character data from the multiplexed data. The telephone unit transmits and receives telephone voice data. The voice output unit outputs either the extracted voice data extracted by the extraction unit or the telephone voice data received by the telephone unit. When the communication apparatus detects the occurrence of an event for starting reception of multiplexed data during transmission / reception of the telephone voice data, the communication apparatus continues transmission / reception of the telephone voice data and starts reception of the multiplexed data. The communication device is characterized in that the voice output unit outputs the telephone voice data, and the display output unit outputs at least one of the extracted video data and the extracted character data.

  Japanese Patent Application Laid-Open No. 2007-074528 discloses a multiplexed data recording apparatus for recording a digital broadcast for a long time even on a recording medium having a small recording capacity. The multiplexed data recording apparatus is a multiplexed data recording apparatus that records multiplexed data, and includes a recording instruction unit, a multiplexed data selection unit, and a multiplexing unit. The recording instruction means inputs multiplexed data and instructs to record only audio data, or instructs to extract only audio data and representative image data. The multiplexed data selection means extracts audio data included in the multiplexed data. The multiplexing means multiplexes the audio data and the representative image data and records them on a recording medium.

JP-A-2005-277792 JP 2007-053796 A Japanese Patent Laid-Open No. 2007-074528

  SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problem that the content of a video cannot be confirmed later, and a video display device and a video display that store the content of the video with a smaller amount of information It is to provide a method.

  A video display device according to the present invention includes a character detection unit that recognizes a character string portion in which a character string of a video is displayed as a character string, and a character string recording unit that records the character string in a storage device. ing.

  A portable communication device according to the present invention includes a portable communication unit, a character detection unit, and a character string recording unit. The mobile communication unit displays information received via the public line network on a monitor. The character detection unit recognizes the character string portion in which the character string in the video displayed on the monitor is displayed as a character string. The character string recording unit records the character string in the storage device.

  The video display method according to the present invention includes a step of recognizing a character string portion in which a character string of the video is displayed as a character string, and a step of recording the character string in a storage device.

  The video display program according to the present invention includes a program for recognizing a character string portion in which a character string in the video is displayed as a character string, and a program for recording the character string in a storage device.

  The video display device and the video display method according to the present invention can record the content of the video with a smaller amount of information by recording the character string displayed in the video.

  An embodiment of a video display device according to the present invention will be described with reference to the drawings. As shown in FIG. 1, the video display device 1 is a so-called mobile phone, and includes an operation unit 2, a communication device 3, a microphone 5, a speaker 6, a monitor 7, a tuner 8, and a storage device 12. Yes. The video display device 1 further includes an electric circuit that controls these devices. The operation unit 2 is formed from a keyboard, generates information when operated by a user, and outputs the information to the electric circuit. The communication device 3 transmits information generated by the electric circuit via the communication line network to another computer, and outputs information output from the other computer via the communication line network to the electric circuit. Examples of the communication line network include a LAN (Local Area Network), the Internet, a mobile phone communication network, and a dedicated line. The microphone 5 collects sound and outputs information indicating the sound to the electric circuit. The speaker 6 outputs sound generated by the electric circuit. The monitor 7 displays an image generated by the electric circuit. The tuner 8 receives a television broadcast selected by the electric circuit, generates broadcast data, and outputs the broadcast data to the electric circuit. Examples of the television broadcast include terrestrial analog broadcast, terrestrial digital broadcast (1-segment broadcast), and satellite broadcast. The storage device 12 records the information generated by the electric circuit on a recording medium that is removable from the video display device 1 and outputs the information recorded on the recording medium to the electric circuit. An example of the recording medium is a flash memory.

  The electric circuit includes a portable communication unit 14, a mode selection unit 15, a data analysis unit 16, an audio decoder 17, a video decoder 18, a character detection unit 10, a character string recording unit 21, a video composition unit 22, and a character string display unit 23. Is included.

  The mobile communication unit 14 causes the video display device 1 to function as a mobile phone. That is, in response to a predetermined operation input to the operation unit 2, the mobile communication unit 14 transmits the sound collected by the microphone 5 to another computer and receives it from the computer using the communication device 3. The sound is output from the speaker 6. In response to a predetermined operation input to the operation unit 2, the mobile communication unit 14 transmits an e-mail created via the operation unit 2 to another computer using the communication device 3. The electronic mail received from the computer is displayed on the monitor 7.

  The mode selection unit 15 selects a mode from a plurality of modes based on information input via the operation unit 2. The plurality of modes include a recording mode, a non-recording mode, a synthesis mode, and a non-synthesis mode.

  The data analysis unit 16 generates program information, video data, and audio data by analyzing the broadcast data generated by the tuner 8. The program information indicates information for identifying a program received by the tuner 8. The video data indicates the video received by the tuner 8. The sound data indicates the sound received by the tuner 8.

  The audio decoder 17 decodes the audio data generated by the data analysis unit 16 into audio and outputs the audio from the speaker 6. The video decoder 18 decodes the video data generated by the data analysis unit 16 into a video. The video decoder 18 further displays the video on the monitor 7 when the non-synthesis mode is selected by the mode selection unit 15.

  The character detection unit 10 recognizes the character string portion in which the character string of the video decoded by the video decoder 18 is projected as the character string. That is, the character detection unit 10 includes a video RAM (Random Access Memory) 11, a cutout engine 19, and a recognition engine 20. The video RAM 11 temporarily records the video decoded by the video decoder 18. The cutout engine 19 generates a character string portion indicating a character string displayed in the video recorded in the video RAM 11. The recognition engine 20 includes an OCR (Optical Character Reader) dictionary 24 that associates graphics with characters. The recognition engine 20 refers to the OCR dictionary 24, finds a character from the character string portion generated by the cutout engine 19, and recognizes the character string portion as a character string.

  The character string recording unit 21 records a table indicating the character string recognized by the character detection unit 10 in the storage device 12 when the recording mode is selected by the mode selection unit 15.

  When the synthesis mode is selected by the mode selection unit 15, the video synthesis unit 22 generates a synthesized video based on the video decoded by the video decoder 18 and the character string portion extracted by the clipping engine 19. The video composition unit 22 further displays the composite video on the monitor 7.

  The character string display unit 23 selects several character strings from a plurality of character strings indicated by the table recorded in the storage device 12 based on the information input to the operation unit 2, and is input via the operation unit 2. The selected character string is displayed on the monitor 7 in the displayed format. Examples of the display format include font and character size.

  FIG. 2 shows an example of the video decoded by the video decoder 18. In the video 25, a character string 26 is displayed. At this time, the cut-out engine 19 determines the characteristics of the character string from the video 25, cuts out the character string portion 27, which is an area in which the character string 26 is written, from the video 25, and is displayed on the character string portion 27. Is generated as a character string part. As its characteristics, “character strings are arranged horizontally / vertically in the same size”, “characters are basically composed of two colors of foreground color and background color” are exemplified. The character string portion 27 is formed in a rectangular shape.

  FIG. 3 shows an example of a synthesized video generated by the video synthesis unit 22 based on the video 25. The composite video 28 shows a video 25 and a frame 29. The frame 29 is formed of four line segments that form a rectangle and surrounds the character string portion 27 of the video 25.

  FIG. 4 shows a table recorded in the storage device 12. The table 31 associates the character string identifier set 32 with the character string set 33. That is, an arbitrary element in the character string identifier set 32 corresponds to one element in the character string set 33. The elements of the character string identifier set 32 indicate a character string identifier for identifying a character string recognized by the recognition engine 20, and a date and time when the character string is displayed on the video and the date and time when the character string is displayed on the video. Is shown. An element corresponding to a certain character string identifier in the character string set 33 indicates a character string identified by the character string identifier.

  The embodiment of the video display method according to the present invention is executed by the video display device 1 and includes an operation of recording a character string and an operation of displaying a character string.

  FIG. 5 shows an operation for recording the character string. In response to the user selecting a television broadcast that the user wants to view by operating the operation unit 2, the video display device 1 receives the selected television broadcast using the tuner 8 and generates broadcast data. (Step S1). The video display device 1 generates program information, video data, and audio data by analyzing the broadcast data (step S2). The video display device 1 decodes the video data into the video 25 and records the video in the video RAM 11 (step S3).

  The video display device 1 determines the mode selected by the user by operating the operation unit 2 (step S4). When the recording mode is selected by the user (step S4, YES), the video display device 1 cuts out the character string portion 27 from the video 25 recorded in the video RAM 11 (step S5). When the character string 26 is displayed on the image 25 (step S5, YES), the video display device 1 recognizes the character string portion 27 as the character string 26 (step S6).

  When the character recognized character string 26 does not match the character string previously recorded in the storage device 12 (NO in step S7), the video display device 1 associates the program information with the current date and time. The character string 26 whose character has been recognized is recorded in the storage device 12 (step S8). According to such a recording operation, the video display apparatus 1 does not repeatedly record a character string displayed one after another as exemplified by the lyrics displayed simultaneously with the song, and records it in the storage device 12. The amount of information to be processed can be further reduced.

  The video display device 1 is cut out from the video 25 recorded in the video RAM 11 when the recording mode is selected and the composition mode is selected and the character string portion 27 is found in the video. Based on the character string portion 27, a synthesized video 28 in which a frame 29 surrounding the character string 26 is synthesized with the video 25 is generated (step S9).

  The video display device 1 displays the composite video 28 on the monitor 7 when the character string portion 27 is found in the video when the recording mode is selected and the composite mode is selected. When the non-recording mode is selected or the non-synthesizing mode is selected, or when the character string portion 27 is not found in the video, the video display device 1 decodes the video decoded from the video data. 25 is displayed on the monitor 7 as it is (step S10). According to such a display operation, the user can easily know which part is detected as a character.

  According to such an operation, the video display device 1 can record the character string displayed in the video broadcast on the television according to the user's instruction in the storage device 12, compared to recording the video, Video content can be recorded with a smaller amount of information. As a result, the video display device 1 can be designed with a small recording capacity of the storage device 12 for recording video content, which is preferable.

  FIG. 6 shows an operation for displaying the character string. The user inputs the font and the character size to the video display device 1 in advance by operating the operation unit 2 (step S21). Next, the user inputs conditions by operating the operation unit 2. The video display device 1 refers to the table 31 recorded in the storage device 12, selects a character string identifier that satisfies the condition from the character string identifier set 32, and selects the selected character string from the character string set 33. A character string corresponding to the character string identifier is selected (step S22). The video display device 1 displays the selected character string on the monitor 7 with the input font and character size (step S23).

  According to such an operation of recording a character string, even if it is difficult for the user to see the character string 26 displayed on the video 25 displayed on the monitor 7, the user can read the character string 26 on the monitor 7 in a display format that is easy for the user to read. By displaying the character string, the character string can be easily confirmed.

  Further, when the storage device 12 is a recording medium that is detachable from the video display device 1, the user can perform the same operation by displaying the character string on another computer that can read the recording medium. Thus, the character string can be confirmed in an easy-to-read display format.

  Note that the video display device 1 can be applied to a device different from the mobile phone. As the device, a television having a small display surface is exemplified. Such a device can record the content of the video with a smaller amount of information in the same manner as the video display device 1, and can easily check the character string.

  FIG. 7 shows another embodiment of the video display device according to the present invention. The video display device 40 includes a storage device 41, a character detection unit 42, and a character string recording unit 43. The storage device 41 is controlled by the character string recording unit 43 in the same manner as the storage device 12 in the above-described embodiment, and records input information on a recording medium that is removable from the video display device 40. In the same manner as the character detection unit 10 in the above-described embodiment, the character detection unit 42 cuts out the character string part 27 on which the character string 26 is projected from the video 25 input from the outside, and extracts the character string part. 27 is recognized as a character string 26. The character string recording unit 43 records the character string recognized by the character detection unit 42 on the recording medium of the storage device 41.

  The video display device 40 cuts out the character string portion 27 in which the character string 26 is described from the video 25 when the video 25 is input from the outside and the character string 26 is projected on the video 25. The character string portion 27 is recognized as a character string 26. When the character recognition is executed, the video display device 40 records the character string 26 with the character recognition in the storage device 41.

  At this time, the video display device 40 can record the character string displayed in the input video in the storage device 41, and the content of the video can be recorded with a smaller amount of information compared to recording the video. Can be recorded. As a result, the video display device 40 can be designed with a small recording capacity of the storage device 41 for recording video content, which is preferable.

  Note that the character string recording unit 43 matches the character string 26 whose character has been recognized with the character string previously recorded in the storage device 41 in the same manner as the character string recording unit 21 in the above-described embodiment. The character string 26 can be prevented from being recorded in the storage device 41 when the user is on the screen. According to such a recording operation, when a video in which the same character string is displayed one after another is input, the video display device 40 does not repeatedly record the character string, and the storage device The amount of information recorded in 41 can be further reduced.

  In the video display device 40, the operation unit 2, the monitor 7, and the character display unit 23 in the above-described embodiment can be added. The character string display unit 23 selects several character strings from a plurality of character strings recorded in the storage device 41 based on information input via the operation unit 2, and is input via the operation unit 2. The selected character string is displayed on the monitor 7 in the displayed format.

  According to such an operation of recording a character string, the user displays the character string on the monitor 7 in a display format that is easy for the user to read even when the character string 26 displayed on the video 25 is difficult to see. Thus, the character string can be easily confirmed.

  The video display device 40 can be added with the monitor 7 and the video composition unit 22 in the above-described embodiment. When the character string portion 27 is found in the input video 25, the video synthesis unit 22 generates a synthesized video 28 in which a frame 29 surrounding the character string 26 is synthesized with the video 25. The video composition unit 22 further displays the synthesized composite video 28 on the monitor 7.

  Such a display operation is preferable because the user can easily know which part of the video is detected as a character. Note that the frame 29 can be replaced with another expression that allows the user to recognize the position of the character string portion 27. Examples of the expression include surrounding the character string portion 27 with an ellipse and inverting the character string portion 27.

  Note that examples of the video input to the video display device 40 include a television broadcast (for example, 1-segment broadcast) video and a recorded video. In general, when a video broadcast on a television is not recorded, the user cannot confirm a character string displayed on the video later. The video display device 40 provides the user with a character string to be displayed on the video later without recording the video when recording the character string to be displayed on the video broadcast on the storage device 41. Can do. The video display device 40 can further facilitate the use of the character string by another information processing apparatus by recording the character string on a recording medium.

  The amount of information when a character string to be projected on a video is recorded is generally smaller than the amount of information when the video is recorded. That is, the video display device 40 can store the content of the character string displayed in the video with a smaller amount of information compared to recording the video. Furthermore, the video display device 40 can increase the length of the video that is the target of recording the character string, as compared to recording the video.

  Even when the video display device 40 records in the storage device 41 a character string to be displayed in another video different from the TV broadcast video, the video display device 40 similarly makes it easier to use the character string. It is possible to save the contents of the character string displayed on the screen with a smaller amount of information.

  Still another embodiment of the video display apparatus according to the present invention is constructed by including a computer and installing software in the computer. The software includes a plurality of computer programs indicating operations performed by the electric circuit included in the video display device 1 in the above-described embodiment. That is, the software includes a mobile communication program, a mode selection program, a data analysis program, an audio decoder program, a video decoder program, a segmentation engine program, a recognition engine program, a character string recording program, a video composition program, and a character string display program. ing.

  The mobile communication program indicates an operation executed by the mobile communication unit 14. The mode selection program indicates an operation executed by the mode selection unit 15. The data analysis program indicates an operation executed by the data analysis unit 16. The audio decoder program indicates an operation executed by the audio decoder 17. The video decoder program indicates an operation executed by the video decoder 18. The cutout engine program indicates an operation executed by the cutout engine 19. The recognition engine program indicates an operation executed by the recognition engine 20. The character string recording program shows an operation executed by the character string recording unit 21. The video composition program shows an operation executed by the video composition unit 22. The character string display program indicates an operation executed by the character string display unit 23.

  Such a video display device operates in the same manner as the video display device 1 in the above-described embodiment, whereby the content of the video can be recorded with a smaller amount of information, and the character string can be more easily recorded. Can be confirmed.

FIG. 1 is a block diagram showing an embodiment of a video display device according to the present invention. FIG. 2 is a diagram illustrating an example of an image. FIG. 3 is a diagram illustrating an example of a composite video. FIG. 4 is a diagram showing a table for organizing character strings. FIG. 5 is a flowchart showing an operation for recording a character string. FIG. 6 is a flowchart showing an operation for displaying a character string. FIG. 7 is a block diagram showing another embodiment of the video display device according to the present invention.

Explanation of symbols

1: Video display device 2: Operation unit 3: Communication device 5: Microphone 6: Speaker 7: Monitor 8: Tuner 10: Character detection unit 11: Video RAM
12: Storage device 14: Mobile communication unit 15: Mode selection unit 16: Data analysis unit 17: Audio decoder 18: Video decoder 19: Extraction engine 20: Recognition engine 21: Character string recording unit 22: Video composition unit 23: Character string Display unit 24: OCR dictionary 25: Video 26: Character string 27: Character string part 28: Composite image 29: Frame 31: Table 32: Character string identifier set 33: Character string set

Claims (16)

A character recognition unit that recognizes a character string portion in which a character string of a video is displayed as the character string;
A character string recording unit for recording the character string in a storage device;
The image display device, wherein the character string recording unit does not record the new character string in the storage device when a new character string recognized after the character string is recorded matches the character string. The video display device according to claim 1,
An image display device further comprising a character string display unit for displaying the character string on a monitor in a format input via an input device. The video display device according to claim 1 or 2,
The character recognition unit includes a cut-out engine that extracts the character string portion from the video,
A video display device further comprising: a video synthesis unit that generates a synthesized video in which a figure that recognizes the position of the character string portion is arranged in the video. The video display device according to any one of claims 1 to 3,
A video display device further comprising a data analysis unit for converting a broadcast signal into the video. A mobile communication unit for displaying information received via a public network on a monitor;
A character detection unit for recognizing a character string portion in which a character string of a video displayed on the monitor is displayed as the character string;
A character string recording unit for recording the character string in a storage device;
The mobile communication device, wherein the character string recording unit does not record the new character string in the storage device when a new character string recognized after the character string is recorded matches the character string. The mobile communication device according to claim 5,
A portable communication device further comprising a character string display unit that displays the character string on a monitor in a format input via an input device. The mobile communication device according to claim 5 or 6,
The character recognition unit includes a cut-out engine that extracts the character string portion from the video,
A mobile communication device further comprising: a video composition unit that generates a composite video in which a figure that recognizes the position of the character string portion is arranged in the video. A portable communication device according to any one of claims 5 to 7,
A portable communication device further comprising a data analysis unit for converting a broadcast signal into the video. Recognizing the character string portion in which the character string of the image is projected as the character string; and
Recording the character string in a storage device;
Determining whether a new character string recognized after the character string is recorded matches the character string, and
The new character string is not recorded in the storage device when the new character string matches the character string. The video display method according to claim 9,
An image display method further comprising the step of displaying the character string on a monitor in a format input via an input device. The video display method according to claim 9 or 10,
Extracting the character string portion from the video;
And a step of generating a composite image in which a figure that recognizes the position of the character string portion is arranged in the image. The video display method according to any one of claims 9 to 11,
A video display method further comprising the step of converting a broadcast signal into the video. A video display program executed by a computer,
A character detection step for recognizing a character string portion in which a character string of the image is displayed as the character string;
A character string recording step for recording the character string in a storage device,
In the character string recording step, when the new character string recognized after the character string is recorded matches the character string, the immediately following character string is not recorded in the storage device. A video display program according to claim 13,
A video display program, further comprising: a character string display step for displaying the character string on a monitor in a format input via an input device. The video display program according to claim 13 or 14,
A step Shi cut out to extract the character string part from the image,
A video display program further comprising: a video synthesis step for generating a synthesized video in which a graphic representing the position of the character string portion is recognizable in the video. A video display program according to any one of claims 13 to 15,
A video display program further comprising a data analysis step of converting a broadcast signal into the video.

Images