US7844168B2 - Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures - Google Patents

Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures Download PDF

Info

Publication number
US7844168B2
US7844168B2 US11/472,240 US47224006A US7844168B2 US 7844168 B2 US7844168 B2 US 7844168B2 US 47224006 A US47224006 A US 47224006A US 7844168 B2 US7844168 B2 US 7844168B2
Authority
US
United States
Prior art keywords
video
picture
sub
decoded
scaling factor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased, expires
Application number
US11/472,240
Other versions
US20070292113A1 (en
Inventor
Meng-Nan Tsou
Jung-fu Hsu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Novatek Microelectronics Corp
Original Assignee
Novatek Microelectronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Novatek Microelectronics Corp filed Critical Novatek Microelectronics Corp
Assigned to CHEERTEK INC. reassignment CHEERTEK INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HSU, JUNG-FU, TSOU, MENG-NAN
Publication of US20070292113A1 publication Critical patent/US20070292113A1/en
Assigned to NOVATEK MICROELECTRONICS CORP. reassignment NOVATEK MICROELECTRONICS CORP. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHEERTEK INC.
Application granted granted Critical
Publication of US7844168B2 publication Critical patent/US7844168B2/en
Priority to US13/689,769 priority Critical patent/USRE45909E1/en
Priority to US14/469,604 priority patent/USRE46434E1/en
Ceased legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H04N7/0122—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording

Definitions

  • the invention relates to a video decoding apparatus, a video decoding method and a digital audio/video playback system and, more particularly, to a video decoding apparatus, a video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures.
  • audio and video data can be stored, transmitted and played back in digital format.
  • digital versatile disc for instance, not only can the DVD store high-quality movies, but the DVD can also store multilingual audio tracks and multiple sub-pictures for users to choose from during playback.
  • One of the major functions of sub-pictures is to act as subtitles, for example, an English film can include therein English and Chinese audio tracks, and English and Chinese subtitles, and during playback, users can choose the English audio track with Chinese subtitle, or the English audio track with English subtitle, as well as the Chinese audio track with English or Chinese subtitles. Therefore, this function facilitates internationalization of films.
  • the DVD is usually played back with only one subtitle displayed. If two or more subtitles are displayed simultaneously, there can be overlay among the subtitles, making them difficult to read, or only one of the subtitles is displayed in the overlaid region such that other subtitles cannot be completely displayed.
  • PAL Phase Alternate Line
  • NTSC National Television System Committee
  • an object of the invention is to provide a video decoding apparatus, a video decoding method and a digital audio/video system capable of controlling presentation of sub-pictures, and the apparatus, method and system are able to control the aspect ratio and the position of the sub-pictures so that the sub-pictures can be completely displayed and any overlay among multiple sub-pictures is avoided.
  • the digital audio/video playback system capable of controlling presentation of sub-pictures of the invention decodes a digital audio/video signal, and to playback an output picture and a decoded audio through a video output device and an audio output device.
  • the digital audio/video playback system includes a signal loader, a signal parser, a video decoding apparatus and an audio decoder.
  • the signal loader is utilized to receive the digital audio/video signal.
  • the signal parser is utilized to divide the digital audio/video signal into a video bit stream, a sub-picture bit stream and an audio bit stream.
  • the audio decoder receives the audio bit stream, decodes it to a decoded audio, and outputs the decoded audio to the audio output device.
  • the video decoding apparatus receives the video bit stream and the sub-picture bit stream, decodes and combines them into a picture, and outputs the combined picture to the video output device to playback.
  • the abovementioned video decoding apparatus includes: a first decoder which receives the video bit stream and decodes it in order to generate a decoded video; a second decoder which receives the sub-picture bit stream and decodes it in order to generate at least one decoded sub-picture; a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video; a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
  • the invention also discloses a video decoding method capable of controlling presentation of sub-pictures, which is utilized to decode a digital audio/video signal and to playback an output picture through a video output device.
  • the video decoding method includes: receiving a video bit stream and decoding it to generate a decoded video; receiving a sub-picture bit stream and decoding it to generate at least one decoded sub-picture; capturing the size of the decoded video and generating a first scaling factor according to the size of the output picture and the size of the decoded video; capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined
  • the video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures.
  • the video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures.
  • there is no overlay on the main video region and overlay among the sub-pictures is avoided effectively so that each of the sub-pictures is completely displayed.
  • FIG. 1 shows a block diagram of a digital audio/video playback system capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
  • FIG. 2 shows a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
  • FIG. 3 shows a flow chart of a first scaler generating a first scaling factor.
  • FIG. 4 shows a flow chart of a second scaler generating a second scaling factor
  • FIG. 5 shows a flow chart of a combiner combining the decoded video and the decoded sub-picture.
  • a digital audio/video playback system 1 capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is utilized to decode a digital audio/video signal (DAVS) and to playback an output picture and a decoded audio through a video output device 21 and an audio output device 22 , wherein the DAVS includes a video bit stream (VBS), a sub-picture bit stream (SPBS) and an audio bit stream (ABS).
  • the digital audio/video playback system 1 includes a signal loader 11 , a signal parser 12 , a video decoding apparatus 13 and an audio decoder 14 .
  • the signal loader 11 is utilized to receive DAVS. Take a DVD player for instance, the signal loader 11 may include elements like a control unit, a loading unit, a signal processing unit and more. As for Digital Video Broadcasting (DVB), the signal loader 11 may include elements like a control unit, an antenna, a signal processing unit and more. Therefore, in correspondence to different requirements, the signal loader 11 can be realized through different designs by a person skilled in the art, and thus the signal loader 11 is not explained in further detail.
  • DVD Digital Video Broadcasting
  • the signal parser 12 is utilized to divide the loaded DAVS into a VBS, a SPBS and an ABS.
  • the audio decoder 14 is utilized to receive the ABS and to decode it into a decoded audio (DA) for the audio output device to playback.
  • DA decoded audio
  • the video decoding apparatus 13 is utilized to receive and decode the VBS and the SPBS, and then the video decoding apparatus 13 combines the two into a picture for the video output device 21 to playback.
  • the video decoding apparatus 13 includes: a first decoder 131 , a second decoder 133 , a first scaler 132 , a second scaler 134 and a combiner 135 .
  • the first decoder 131 receives the VBS, decodes the VBS and outputs a decoded video (DV).
  • the second decoder 133 receives the SPBS, decodes the SPBS and outputs at least one decoded sub-picture (DSP) under the control of the user's choice; for example, the second decoder 133 can output one or a plurality of DSPs.
  • the first decoder can be an MPEG decoder, while the second decoder can be a run-length decoder.
  • the first scaler 132 is utilized to capture the size of the DV, such as the horizontal width and the vertical height, and to generate a first scaling factor according to the size of the output picture and the size of the DV.
  • the second scaler 134 is utilized to capture the size and the position of the DSP, such as the horizontal coordinate and the vertical coordinate, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio.
  • the combiner 135 sets the size of the DV according to the first scaling factor, sets the size and the position of the DSP according to the second scaling factor, combines the DV and the DSP, and outputs the combined picture to the video output device 21 to playback. The procedures for generating the first scaling factor and the second scaling factor, and for combining the DV and the DSP will be described later.
  • a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is described.
  • a VBS is received and decoded to generate a DV (S 31 )
  • a SPBS is received and decoded to generate at least one DSP (S 32 ).
  • the size of the DV is captured, and a first scaling factor is generated according to the size of an output picture and the size of the DV (S 33 ).
  • the procedure for generating the first scaling factor is described.
  • the size of the DV namely its horizontal width Vh and its vertical height Vv
  • the size of the active display area of a video output device 21 namely its horizontal width Dh and its vertical height Dv, is obtained (S 332 ).
  • the next step is to determine whether or not a film to be played supports specific video aspect ratios (S 333 ), for example the aspect ratios of modes such as letterbox or pan & scan.
  • the size of the output picture is equal to the size of the active display area of the video output device 21 , namely the horizontal width OVh of the output picture is equal to the horizontal width Dh of the active display area of the video output device 21 , and the vertical height OVv of the output picture is equal to the vertical height Dv of the active display of the video output device 21 (S 335 ).
  • the horizontal width OVh of the output picture is the product of the horizontal width Dh of the active display area of the video output device 21 and a horizontal aspect ratio VARh of the video aspect ratio
  • the vertical height OVv of the output picture is the product of the vertical height Dv of the active display area of the video output device 21 and a vertical aspect ratio VARv of the video aspect ratio (S 334 ).
  • the first scaling factor is calculated according to the size of the output picture and the size of the DV, and the first scaling factor includes a first horizontal scaling factor (SF 1 h ) and a first vertical scaling factor (SF 1 v ).
  • the SF 1 h is equal to the horizontal width OVh of the output picture divided by the horizontal width Vh of the DV.
  • the SF 1 v is equal to the vertical height OVv of the output picture divided by the vertical height Vv of the DV.
  • the step S 34 is to capture the size and the position of the DSP, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio.
  • the procedure for generating the second scaling factor is described.
  • the size and the position of the DSP namely its horizontal width SPh, its vertical height SPv, its horizontal coordinate, and its vertical coordinate, are obtained (S 341 ).
  • the sub-picture aspect ratio of the DSP which includes a horizontal aspect ratio (SPARh) and a vertical aspect ratio (SPARv) is obtained (S 342 ).
  • the next step is to determine whether the film to be played permits sub-picture scaling (S 343 ); scaling the sub-picture can result in a blurred sub-picture during playback, thus restriction on sub-picture scaling may have been added when the film was recorded.
  • a second horizontal scaling factor (SF 2 h ) and a second vertical scaling factor (SF 2 v ) of the second scaling factor are both 1 (S 345 ), namely the sub-picture is not scaled. If the sub-picture scaling is allowed for playback, the SF 2 h is equal to the SF 1 h divided by the SPARh of the sub-picture aspect ratio, and the SF 2 v is equal to the SF 1 v divided by the SPARv of the sub-picture aspect ratio.
  • the size of the DV is set according to the first scaling factor
  • the size and the position of the DSP is set according to the second scaling factor
  • the DV and the DSP are combined, and the combined picture is output to the video output device 21 to playback (S 35 ).
  • the flow of combining the DV and the DSP is depicted in FIG. 5 .
  • determine whether the DSP is for the purpose of visual effect instead of being as the sub-title (S 351 ). If yes, the relative positions between the DSP and the DV should be fixed to retain the intended visual effect, thus, the size of the DSP is set so as to precisely achieve the purpose of visual effect. If the DSP is for the purpose other than visual effect, for example as the sub-title, the size and the position of the DSP are set (S 353 ).
  • S 354 determines whether the border of the picture is determined (S 354 ); if yes, the size and the position of the DSP are re-set (S 353 ).
  • the DSP covers the main region of the DV is determined (S 355 ). For example, generally the central area of a DV is the main region, thus efforts should be made to prevent DSP from covering the central area of the DV as much as possible. If the main region of the DV is covered, the size and the position of the DSP are re-set as well (S 353 ). If the user chooses to display a plurality of DSPs, it is necessary to further determine whether there is overlay among the plurality of DSPs (S 356 ) when combining the DV and the DSPs. And if there is overlay among the plurality of DSPs, go back to step S 353 to re-set the sizes and the positions of the plurality of DSPs. After the sizes and the positions of all the DSPs are set (S 357 ), combine the DV and the DSP, and output the combined picture to the video output device 21 for playback (S 358 ).
  • the video decoding apparatus, video decoding method and digital audio/video system capable of controlling the presentation of the sub-pictures according to the invention are able to control the aspect ratio and the position of the sub-pictures so as to completely display the sub-pictures. Additionally, when a single sub-picture is displayed, the main video region is not covered, and when a plurality of sub-pictures are displayed, overlay among the plurality of sub-pictures is avoided to completely display all the sub-pictures.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Graphics (AREA)
  • Television Signal Processing For Recording (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Studio Circuits (AREA)

Abstract

A video decoding apparatus capable of controlling presentation of sub-pictures includes a first decoder, a second decoder, a first scaler, a second scaler and a combiner. The first decoder and the second decoder respectively decode a digital audio/video signal to generate a decoded video and a decoded sub-picture. In accordance with an output picture size, the decoded video size, the decoded sub-picture size and a sub-picture aspect ratio, the first scaler and the second scaler generate a first scaling factor and a second scaling factor. The combiner combines the decoded video and the decoded sub-picture according to the first scaling factor and the second scaling factor and outputs the combination thereof. A video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures are also disclosed.

Description

BACKGROUND OF THE INVENTION
a) Field of the Invention
The invention relates to a video decoding apparatus, a video decoding method and a digital audio/video playback system and, more particularly, to a video decoding apparatus, a video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures.
b) Description of the Related Art
Due to the advance of information technology, both audio and video data can be stored, transmitted and played back in digital format. Besides providing movies of better quality, audio and video data in digital format offers many additional functions. Take the digital versatile disc (DVD) for instance, not only can the DVD store high-quality movies, but the DVD can also store multilingual audio tracks and multiple sub-pictures for users to choose from during playback. One of the major functions of sub-pictures is to act as subtitles, for example, an English film can include therein English and Chinese audio tracks, and English and Chinese subtitles, and during playback, users can choose the English audio track with Chinese subtitle, or the English audio track with English subtitle, as well as the Chinese audio track with English or Chinese subtitles. Therefore, this function facilitates internationalization of films.
As common practice, even though the DVD contains multiple subtitles, the DVD is usually played back with only one subtitle displayed. If two or more subtitles are displayed simultaneously, there can be overlay among the subtitles, making them difficult to read, or only one of the subtitles is displayed in the overlaid region such that other subtitles cannot be completely displayed.
Furthermore, differently formatted DVD films can cause incomplete display of the subtitle during playback. For example, in Phase Alternate Line (PAL) standard adopted by most European countries and Australia, the resolution of the DVD film is 720×576 pixels. In National Television System Committee (NTSC) standard adopted by North America and Japan, the resolution of the DVD film is 720×480 pixels. Therefore, when a DVD film recorded according to PAL standard is played back in a playback system compliant with NTSC standard, there is a possibility that the subtitle at the lower end of the picture is cut off and cannot be displayed completely. In addition, similar problems exist when playback systems with different formats, namely 4:3 or 16:9, are used to play differently formatted DVD films.
In summary, it would be desirable if the sub-pictures can be completely displayed and overlay among multiple sub-pictures can be avoided during playback of a digital film.
SUMMARY OF THE INVENTION
In view of the problems mentioned above, an object of the invention is to provide a video decoding apparatus, a video decoding method and a digital audio/video system capable of controlling presentation of sub-pictures, and the apparatus, method and system are able to control the aspect ratio and the position of the sub-pictures so that the sub-pictures can be completely displayed and any overlay among multiple sub-pictures is avoided.
To achieve the object mentioned above, the digital audio/video playback system capable of controlling presentation of sub-pictures of the invention decodes a digital audio/video signal, and to playback an output picture and a decoded audio through a video output device and an audio output device. The digital audio/video playback system includes a signal loader, a signal parser, a video decoding apparatus and an audio decoder. The signal loader is utilized to receive the digital audio/video signal. The signal parser is utilized to divide the digital audio/video signal into a video bit stream, a sub-picture bit stream and an audio bit stream. The audio decoder receives the audio bit stream, decodes it to a decoded audio, and outputs the decoded audio to the audio output device. The video decoding apparatus receives the video bit stream and the sub-picture bit stream, decodes and combines them into a picture, and outputs the combined picture to the video output device to playback.
The abovementioned video decoding apparatus includes: a first decoder which receives the video bit stream and decodes it in order to generate a decoded video; a second decoder which receives the sub-picture bit stream and decodes it in order to generate at least one decoded sub-picture; a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video; a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
The invention also discloses a video decoding method capable of controlling presentation of sub-pictures, which is utilized to decode a digital audio/video signal and to playback an output picture through a video output device. The video decoding method includes: receiving a video bit stream and decoding it to generate a decoded video; receiving a sub-picture bit stream and decoding it to generate at least one decoded sub-picture; capturing the size of the decoded video and generating a first scaling factor according to the size of the output picture and the size of the decoded video; capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
The video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures. At the same time, when a single sub-picture or a plurality of sub-pictures are displayed, there is no overlay on the main video region and overlay among the sub-pictures is avoided effectively so that each of the sub-pictures is completely displayed.
BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 shows a block diagram of a digital audio/video playback system capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
FIG. 2 shows a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
FIG. 3 shows a flow chart of a first scaler generating a first scaling factor.
FIG. 4 shows a flow chart of a second scaler generating a second scaling factor; and
FIG. 5 shows a flow chart of a combiner combining the decoded video and the decoded sub-picture.
 DETAIL DESCRIPTION OF THE INVENTION
The video decoding apparatus, video decoding method and digital audio/video playback system capable of controlling presentation of sub-pictures according to preferred embodiments of the invention will be explained below with reference to the drawings, wherein the like numerals denote the like components.
Referring to FIG. 1, a digital audio/video playback system 1 capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is utilized to decode a digital audio/video signal (DAVS) and to playback an output picture and a decoded audio through a video output device 21 and an audio output device 22, wherein the DAVS includes a video bit stream (VBS), a sub-picture bit stream (SPBS) and an audio bit stream (ABS). The digital audio/video playback system 1 includes a signal loader 11, a signal parser 12, a video decoding apparatus 13 and an audio decoder 14.
The signal loader 11 is utilized to receive DAVS. Take a DVD player for instance, the signal loader 11 may include elements like a control unit, a loading unit, a signal processing unit and more. As for Digital Video Broadcasting (DVB), the signal loader 11 may include elements like a control unit, an antenna, a signal processing unit and more. Therefore, in correspondence to different requirements, the signal loader 11 can be realized through different designs by a person skilled in the art, and thus the signal loader 11 is not explained in further detail.
The signal parser 12 is utilized to divide the loaded DAVS into a VBS, a SPBS and an ABS. The audio decoder 14 is utilized to receive the ABS and to decode it into a decoded audio (DA) for the audio output device to playback.
The video decoding apparatus 13 is utilized to receive and decode the VBS and the SPBS, and then the video decoding apparatus 13 combines the two into a picture for the video output device 21 to playback. The video decoding apparatus 13 includes: a first decoder 131, a second decoder 133, a first scaler 132, a second scaler 134 and a combiner 135. The first decoder 131 receives the VBS, decodes the VBS and outputs a decoded video (DV). The second decoder 133 receives the SPBS, decodes the SPBS and outputs at least one decoded sub-picture (DSP) under the control of the user's choice; for example, the second decoder 133 can output one or a plurality of DSPs. The first decoder can be an MPEG decoder, while the second decoder can be a run-length decoder.
The first scaler 132 is utilized to capture the size of the DV, such as the horizontal width and the vertical height, and to generate a first scaling factor according to the size of the output picture and the size of the DV. The second scaler 134 is utilized to capture the size and the position of the DSP, such as the horizontal coordinate and the vertical coordinate, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio. The combiner 135 sets the size of the DV according to the first scaling factor, sets the size and the position of the DSP according to the second scaling factor, combines the DV and the DSP, and outputs the combined picture to the video output device 21 to playback. The procedures for generating the first scaling factor and the second scaling factor, and for combining the DV and the DSP will be described later.
Referring to FIG. 2, a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is described. First, a VBS is received and decoded to generate a DV (S31), and then a SPBS is received and decoded to generate at least one DSP (S32). Next, the size of the DV is captured, and a first scaling factor is generated according to the size of an output picture and the size of the DV (S33).
Referring to FIG. 3, the procedure for generating the first scaling factor is described. First, the size of the DV, namely its horizontal width Vh and its vertical height Vv, is obtained (S331), and the size of the active display area of a video output device 21, namely its horizontal width Dh and its vertical height Dv, is obtained (S332). The next step is to determine whether or not a film to be played supports specific video aspect ratios (S333), for example the aspect ratios of modes such as letterbox or pan & scan. If the film to be played does not support a specific display mode, the size of the output picture is equal to the size of the active display area of the video output device 21, namely the horizontal width OVh of the output picture is equal to the horizontal width Dh of the active display area of the video output device 21, and the vertical height OVv of the output picture is equal to the vertical height Dv of the active display of the video output device 21 (S335). If the film to be played supports a specific display mode, and the user chooses the specific display mode for playback, the horizontal width OVh of the output picture is the product of the horizontal width Dh of the active display area of the video output device 21 and a horizontal aspect ratio VARh of the video aspect ratio, and the vertical height OVv of the output picture is the product of the vertical height Dv of the active display area of the video output device 21 and a vertical aspect ratio VARv of the video aspect ratio (S334). Finally, the first scaling factor is calculated according to the size of the output picture and the size of the DV, and the first scaling factor includes a first horizontal scaling factor (SF1 h) and a first vertical scaling factor (SF1 v). The SF1 h is equal to the horizontal width OVh of the output picture divided by the horizontal width Vh of the DV. The SF1 v is equal to the vertical height OVv of the output picture divided by the vertical height Vv of the DV.
Referring to FIG. 2 again, the step S34 is to capture the size and the position of the DSP, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio.
Referring to FIG. 4, the procedure for generating the second scaling factor is described. First, the size and the position of the DSP, namely its horizontal width SPh, its vertical height SPv, its horizontal coordinate, and its vertical coordinate, are obtained (S341). Then, the sub-picture aspect ratio of the DSP, which includes a horizontal aspect ratio (SPARh) and a vertical aspect ratio (SPARv), is obtained (S342). The next step is to determine whether the film to be played permits sub-picture scaling (S343); scaling the sub-picture can result in a blurred sub-picture during playback, thus restriction on sub-picture scaling may have been added when the film was recorded. If sub-picture scaling is prohibited, a second horizontal scaling factor (SF2 h) and a second vertical scaling factor (SF2 v) of the second scaling factor are both 1 (S345), namely the sub-picture is not scaled. If the sub-picture scaling is allowed for playback, the SF2 h is equal to the SF1 h divided by the SPARh of the sub-picture aspect ratio, and the SF2 v is equal to the SF1 v divided by the SPARv of the sub-picture aspect ratio.
Referring to FIG. 2 again, finally, the size of the DV is set according to the first scaling factor, the size and the position of the DSP is set according to the second scaling factor, the DV and the DSP are combined, and the combined picture is output to the video output device 21 to playback (S35).
The flow of combining the DV and the DSP is depicted in FIG. 5. Firstly, determine whether the DSP is for the purpose of visual effect instead of being as the sub-title (S351). If yes, the relative positions between the DSP and the DV should be fixed to retain the intended visual effect, thus, the size of the DSP is set so as to precisely achieve the purpose of visual effect. If the DSP is for the purpose other than visual effect, for example as the sub-title, the size and the position of the DSP are set (S353). Next, whether the DSP exceeds the border of the picture is determined (S354); if yes, the size and the position of the DSP are re-set (S353). Then, whether the DSP covers the main region of the DV is determined (S355). For example, generally the central area of a DV is the main region, thus efforts should be made to prevent DSP from covering the central area of the DV as much as possible. If the main region of the DV is covered, the size and the position of the DSP are re-set as well (S353). If the user chooses to display a plurality of DSPs, it is necessary to further determine whether there is overlay among the plurality of DSPs (S356) when combining the DV and the DSPs. And if there is overlay among the plurality of DSPs, go back to step S353 to re-set the sizes and the positions of the plurality of DSPs. After the sizes and the positions of all the DSPs are set (S357), combine the DV and the DSP, and output the combined picture to the video output device 21 for playback (S358).
Regardless of what the modes the film to be displayed supports and what standards the display system complies with, the video decoding apparatus, video decoding method and digital audio/video system capable of controlling the presentation of the sub-pictures according to the invention are able to control the aspect ratio and the position of the sub-pictures so as to completely display the sub-pictures. Additionally, when a single sub-picture is displayed, the main video region is not covered, and when a plurality of sub-pictures are displayed, overlay among the plurality of sub-pictures is avoided to completely display all the sub-pictures.
While the invention has been described by way of example and in terms of the preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements apparent to those skilled in the art. For example, in the DVB system, the size and the coordinates of each object can be captured, and the size and the position of each object can be properly set for it to function properly. Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

Claims (20)

1. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
2. The video decoding apparatus as specified in claim 1, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
3. The video decoding apparatus as specified in claim 2, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display of the video output device and a vertical aspect ratio of the video aspect ratio.
4. The video decoding apparatus as specified in claim 1, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner only sets the size of the decoded video and the size of the decoded sub-picture when combining the decoded video and the decoded sub-picture.
5. The video decoding apparatus as specified in claim 1, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
6. The video decoding apparatus as specified in claim 1, wherein the first decoder is an MPEG decoder and the second decoder is a run-length decoder.
7. A digital audio/video playback system capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, and outputting a decoded audio through an audio output device, the digital audio/video playback system comprising:
a signal loader which receives the digital audio/video signal;
a signal parser which divides the digital audio/video signal into a video bit stream, a sub-picture bit stream, and an audio bit stream;
an audio decoder which receives the audio bit stream, decodes the audio bit stream to a decoded audio, and outputs the decoded audio to the audio output device; and
a video decoding apparatus, including:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the sub-picture according the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
8. The digital audio/video playback system as specified in claim 7, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
9. The digital audio/video playback system as specified in claim 8, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the height of the active display area of the video output device and a vertical aspect ratio of the video aspect ratio.
10. The digital audio/video playback system as specified in claim 7, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner only sets the size of the decoded video and the size of the decoded sub-picture when combining the decoded video and the decoded sub-picture.
11. The digital audio/video playback system as specified in claim 7, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
12. The digital audio/video playback system as specified in claim 7, wherein the first decoder is an MPEG decoder, and the second decoder is a run-length decoder.
13. The digital audio/video playback system as specified in claim 7, wherein the digital audio/video playback system is a DVD playback system or a digital video broadcasting playback system.
14. A video decoding method capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding method comprising the steps of:
receiving the video bit stream and decoding the video bit stream to generate a decoded video;
receiving the sub-picture bit stream and decoding the sub-picture bit stream to generate at least one decoded sub-picture;
capturing the size of the decoded video, and generating a first scaling factor according to the size of the output picture and the size of the decoded video;
capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and
setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
15. The video decoding method as specified in claim 14, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
16. The video decoding method as specified in claim 15, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display of the video output device and a vertical aspect ratio of the video aspect ratio.
17. The video decoding method as specified in claim 14, wherein if the decoded sub-picture is for the purpose of visual effect, only the size of the decoded video and the size of the decoded sub-picture are set when combining the decoded video and the decoded sub-picture.
18. The video decoding method as specified in claim 14, wherein the decoded sub-picture is prevented from exceeding the border of the output picture and covering the main region of the decoded video when combining the decoded video and the decoded sub-picture.
19. A video decoding method as specified in claim 14, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, overlay among the plurality of decoded sub-pictures is prevented when combining the decoded video and the decoded sub-picture.
20. The video decoding method as specified in claim 14, wherein the first decoder is an MPEG decoder, and the second decoder is a run-length decoder.
US11/472,240 2005-06-30 2006-06-20 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures Ceased US7844168B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/689,769 USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US14/469,604 USRE46434E1 (en) 2005-06-30 2014-08-27 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW94122087A 2005-06-30
TW094122087A TWI262725B (en) 2005-06-30 2005-06-30 Video decoding apparatus and digital audio and video display system capable of controlling presentation of subtitles and method thereof

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/689,769 Continuation USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US13/689,769 Reissue USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US14/469,604 Reissue USRE46434E1 (en) 2005-06-30 2014-08-27 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Publications (2)

Publication Number Publication Date
US20070292113A1 US20070292113A1 (en) 2007-12-20
US7844168B2 true US7844168B2 (en) 2010-11-30

Family

ID=37987820

Family Applications (3)

Application Number Title Priority Date Filing Date
US11/472,240 Ceased US7844168B2 (en) 2005-06-30 2006-06-20 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US13/689,769 Active 2029-09-30 USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US14/469,604 Active 2029-09-30 USRE46434E1 (en) 2005-06-30 2014-08-27 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Family Applications After (2)

Application Number Title Priority Date Filing Date
US13/689,769 Active 2029-09-30 USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US14/469,604 Active 2029-09-30 USRE46434E1 (en) 2005-06-30 2014-08-27 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Country Status (2)

Country Link
US (3) US7844168B2 (en)
TW (1) TWI262725B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100045580A1 (en) * 2006-08-30 2010-02-25 Totoku Electric Co., Ltd. Image displaying apparatus and image display program

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8953931B2 (en) * 2009-03-26 2015-02-10 Panasonic Intellectual Property Corporation Of America Video processor, video processing method, integrated circuit for video processing, video playback device
KR20120108136A (en) * 2011-03-23 2012-10-05 삼성전자주식회사 Method for processing image and devices using the method
US9693064B2 (en) * 2011-09-30 2017-06-27 Avago Technologies General Ip (Singapore) Pte. Ltd Video coding infrastructure using adaptive prediction complexity reduction
KR102028696B1 (en) * 2012-10-04 2019-10-07 삼성전자주식회사 Content processing device for processing high resolution content and method thereof
CN107004396B (en) 2014-11-21 2019-08-09 乐天株式会社 Information processing unit and information processing method
US9659570B2 (en) 2015-10-08 2017-05-23 International Business Machines Corporation Audiovisual information processing in videoconferencing
US10334238B2 (en) * 2017-01-03 2019-06-25 Black Sails Technology Inc. Method and system for real-time rendering displaying high resolution virtual reality (VR) video
CN109348276B (en) 2018-11-08 2019-12-17 北京微播视界科技有限公司 video picture adjusting method and device, computer equipment and storage medium
CN115462074A (en) * 2020-04-22 2022-12-09 瑞典爱立信有限公司 Compressed picture-in-picture signaling

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4998171A (en) * 1988-07-05 1991-03-05 Samsung Electronics Co., Ltd. Automatic shift circuit for a sub-picture screen for picture-in-picture feature
US5912710A (en) * 1996-12-18 1999-06-15 Kabushiki Kaisha Toshiba System and method for controlling a display of graphics data pixels on a video monitor having a different display aspect ratio than the pixel aspect ratio
US20020034252A1 (en) * 1998-12-08 2002-03-21 Owen Jefferson Eugene System, method and apparatus for an instruction driven digital video processor
US6678006B1 (en) * 1998-01-07 2004-01-13 Ati Technologies, Inc. Method and apparatus for video processing that includes sub-picture scaling
US6775467B1 (en) * 2000-05-26 2004-08-10 Cyberlink Corporation DVD playback system capable of playing two subtitles at the same time
US20040223745A1 (en) * 2003-01-07 2004-11-11 Pioneer Corporation Information recording medium, information reproducing apparatus and method, and computer program product
US20050169608A1 (en) * 2004-01-07 2005-08-04 Chin-Cheng Shen Method for adjusting display of sub-picture in audio/video playback device
US7062153B2 (en) * 2000-09-19 2006-06-13 Kabushiki Kaisha Toshiba Reproducing apparatus with sub-picture processing function
US20060188229A1 (en) * 2005-02-22 2006-08-24 Yoichiro Yamagata Information storage medium, information recording method, and information playback method
US20070030392A1 (en) * 2005-08-08 2007-02-08 Hiroki Mizosoe Decoding apparatus for encoded video signals

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02223286A (en) * 1989-02-23 1990-09-05 Mitsubishi Electric Corp Television receiver
JPH05304641A (en) * 1992-04-24 1993-11-16 Victor Co Of Japan Ltd Television receiver
TW318315B (en) * 1993-05-03 1997-10-21 At & T Corp
JP3378710B2 (en) * 1995-10-16 2003-02-17 三洋電機株式会社 Reduced image writing / reading method and reduced image processing circuit
JPH09294250A (en) * 1996-04-26 1997-11-11 Sony Corp Scanning line converter
JP3617573B2 (en) * 1996-05-27 2005-02-09 三菱電機株式会社 Format conversion circuit and television receiver including the format conversion circuit
JP3512969B2 (en) * 1997-01-29 2004-03-31 シャープ株式会社 Sub-picture display device
KR20000070273A (en) * 1997-11-17 2000-11-25 이데이 노부유끼 Television device, display method of television device, screen control device and screen control method
US6204887B1 (en) * 1998-12-11 2001-03-20 Hitachi America, Ltd. Methods and apparatus for decoding and displaying multiple images using a common processor
US7365757B1 (en) * 1998-12-17 2008-04-29 Ati International Srl Method and apparatus for independent video and graphics scaling in a video graphics system
US6727958B1 (en) * 1999-08-20 2004-04-27 Winbond Electronics Corp. Method and apparatus for displaying resized pictures on an interlaced target display system
US6912350B1 (en) * 1999-12-08 2005-06-28 Intel Corporation DVD subpicture rendering without loss of color resolution
KR100631499B1 (en) * 2000-01-24 2006-10-09 엘지전자 주식회사 Caption display method for digital television
JP4356202B2 (en) * 2000-06-29 2009-11-04 パナソニック株式会社 Video signal processing device
KR100364739B1 (en) 2000-08-21 2002-12-16 엘지전자 주식회사 Apparatus and method for control sub picture of tv
DE60122993T2 (en) * 2000-10-19 2007-10-18 Sanyo Electric Co., Ltd., Moriguchi Image data output device and receiving device
GB0100563D0 (en) * 2001-01-09 2001-02-21 Pace Micro Tech Plc Dynamic adjustment of on-screen displays to cope with different widescreen signalling types
JP2003037792A (en) * 2001-07-25 2003-02-07 Toshiba Corp Data reproducing device and data reproducing method
TW535413B (en) * 2001-12-13 2003-06-01 Mediatek Inc Device and method for processing digital video data
US7196733B2 (en) * 2002-01-28 2007-03-27 Canon Kabushiki Kaisha Apparatus for receiving broadcast data, method for displaying broadcast program, and computer program
JP4014495B2 (en) * 2002-11-29 2007-11-28 松下電器産業株式会社 Video display device
JP2006510977A (en) 2002-12-19 2006-03-30 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ Image scaling
JP2004208014A (en) * 2002-12-25 2004-07-22 Mitsubishi Electric Corp Subtitle display device and subtitle display program
TWI261821B (en) * 2002-12-27 2006-09-11 Toshiba Corp Information playback apparatus and information playback method
JP2004320324A (en) * 2003-04-15 2004-11-11 Funai Electric Co Ltd Disk reproducing device
US7106383B2 (en) * 2003-06-09 2006-09-12 Matsushita Electric Industrial Co., Ltd. Method, system, and apparatus for configuring a signal processing device for use with a display device
KR100512616B1 (en) * 2003-07-18 2005-09-05 엘지전자 주식회사 (An) image display device for having (a) variable screen ratio and method of controlling the same
JP2005109703A (en) * 2003-09-29 2005-04-21 Pioneer Electronic Corp Apparatus and method for outputting image, image display system, image output program and information recording medium
JP3969387B2 (en) * 2003-12-05 2007-09-05 松下電器産業株式会社 Video signal output device
US7911536B2 (en) * 2004-09-23 2011-03-22 Intel Corporation Screen filled display of digital video content
KR20070086704A (en) * 2004-12-02 2007-08-27 소니 가부시끼 가이샤 Encoding device and method, decoding device and method, program, recording medium, and data structure
US7616264B1 (en) * 2004-12-06 2009-11-10 Pixelworks, Inc. Cropped and scaled picture-in-picture system and method
JP4417854B2 (en) * 2005-01-04 2010-02-17 株式会社東芝 Playback device
US20060158557A1 (en) * 2005-01-20 2006-07-20 Shang-Chieh Wen Method and apparatus for video processing
WO2007050817A2 (en) * 2005-10-25 2007-05-03 Enuclia Semiconductor, Inc. Region or frame based aspect ratio scaling

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4998171A (en) * 1988-07-05 1991-03-05 Samsung Electronics Co., Ltd. Automatic shift circuit for a sub-picture screen for picture-in-picture feature
US5912710A (en) * 1996-12-18 1999-06-15 Kabushiki Kaisha Toshiba System and method for controlling a display of graphics data pixels on a video monitor having a different display aspect ratio than the pixel aspect ratio
US6678006B1 (en) * 1998-01-07 2004-01-13 Ati Technologies, Inc. Method and apparatus for video processing that includes sub-picture scaling
US20020034252A1 (en) * 1998-12-08 2002-03-21 Owen Jefferson Eugene System, method and apparatus for an instruction driven digital video processor
US6775467B1 (en) * 2000-05-26 2004-08-10 Cyberlink Corporation DVD playback system capable of playing two subtitles at the same time
US7062153B2 (en) * 2000-09-19 2006-06-13 Kabushiki Kaisha Toshiba Reproducing apparatus with sub-picture processing function
US20040223745A1 (en) * 2003-01-07 2004-11-11 Pioneer Corporation Information recording medium, information reproducing apparatus and method, and computer program product
US20050169608A1 (en) * 2004-01-07 2005-08-04 Chin-Cheng Shen Method for adjusting display of sub-picture in audio/video playback device
US20060188229A1 (en) * 2005-02-22 2006-08-24 Yoichiro Yamagata Information storage medium, information recording method, and information playback method
US20070030392A1 (en) * 2005-08-08 2007-02-08 Hiroki Mizosoe Decoding apparatus for encoded video signals

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100045580A1 (en) * 2006-08-30 2010-02-25 Totoku Electric Co., Ltd. Image displaying apparatus and image display program
US8259034B2 (en) * 2006-08-30 2012-09-04 Totoku Electric Co., Ltd. Image displaying apparatus and image display program

Also Published As

Publication number Publication date
US20070292113A1 (en) 2007-12-20
USRE45909E1 (en) 2016-03-01
TW200701792A (en) 2007-01-01
USRE46434E1 (en) 2017-06-13
TWI262725B (en) 2006-09-21

Similar Documents

Publication Publication Date Title
USRE45909E1 (en) Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US9451207B2 (en) Automatic subtitle resizing
KR101987820B1 (en) Content processing device for processing high resolution content and method thereof
US6297797B1 (en) Computer system and closed caption display method
ES2413529T3 (en) Device for receiving a digital information signal
JP2829962B2 (en) Television receiver
US20030189669A1 (en) Method for off-image data display
US20070253677A1 (en) System for simultaneous playback of multiple video angles from multimedia content onto a display device and method thereof
EP1897368B1 (en) A method and apparatus for displaying data content
SG173136A1 (en) Systems and methods for providing closed captioning in three-dimensional imagery
US6567097B1 (en) Display control apparatus
JP2016082541A (en) Receiver and program
JP2002016884A (en) Video signal reproducing apparatus
JPH07236100A (en) Display device
US20030025833A1 (en) Presentation of teletext displays
JP5361429B2 (en) Video playback apparatus and control method thereof
KR100253211B1 (en) Screen display control apparatus and method for display
EP1848203B2 (en) Method and system for video image aspect ratio conversion
JP2008252746A (en) Digital broadcast receiver
JP2004221751A (en) Image signal processing device
KR100499505B1 (en) Apparatus for format conversion in digital TV
JP4079721B2 (en) DVD signal output system selection device, DVD built-in multi-system TV receiver, DVD playback display device, and DVD playback device
JP4006764B2 (en) Image receiving apparatus and image display method
JP2000295527A (en) Video image compositing device
JP2003023579A (en) Digital broadcast display device

Legal Events

Date Code Title Description
AS Assignment

Owner name: CHEERTEK INC., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TSOU, MENG-NAN;HSU, JUNG-FU;REEL/FRAME:018022/0406

Effective date: 20060610

AS Assignment

Owner name: NOVATEK MICROELECTRONICS CORP., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHEERTEK INC.;REEL/FRAME:021230/0862

Effective date: 20080626

Owner name: NOVATEK MICROELECTRONICS CORP.,TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHEERTEK INC.;REEL/FRAME:021230/0862

Effective date: 20080626

STCF Information on status: patent grant

Free format text: PATENTED CASE

RF Reissue application filed

Effective date: 20121130

FPAY Fee payment

Year of fee payment: 4

RF Reissue application filed

Effective date: 20140827