USRE45909E1 - Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures - Google Patents

Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures Download PDF

Info

Publication number
USRE45909E1
USRE45909E1 US13/689,769 US201213689769A USRE45909E US RE45909 E1 USRE45909 E1 US RE45909E1 US 201213689769 A US201213689769 A US 201213689769A US RE45909 E USRE45909 E US RE45909E
Authority
US
United States
Prior art keywords
video
picture
sub
decoded
scaling factor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US13/689,769
Inventor
Meng-Nan Tsou
Jung-fu Hsu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Novatek Microelectronics Corp
Original Assignee
Novatek Microelectronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Novatek Microelectronics Corp filed Critical Novatek Microelectronics Corp
Priority to US13/689,769 priority Critical patent/USRE45909E1/en
Priority to US14/469,604 priority patent/USRE46434E1/en
Application granted granted Critical
Publication of USRE45909E1 publication Critical patent/USRE45909E1/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4347—Demultiplexing of several video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N5/4401—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H04N7/0122—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording

Definitions

  • the invention relates to a video decoding apparatus, a video decoding method and a digital audio/video playback system and, more particularly, to a video decoding apparatus, a video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures.
  • audio and video data can be stored, transmitted and played back in digital format.
  • digital versatile disc for instance, not only can the DVD store high-quality movies, but the DVD can also store multilingual audio tracks and multiple sub-pictures for users to choose from during playback.
  • One of the major functions of sub-pictures is to act as subtitles, for example, an English film can include therein English and Chinese audio tracks, and English and Chinese subtitles, and during playback, users can choose the English audio track with Chinese subtitle, or the English audio track with English subtitle, as well as the Chinese audio track with English or Chinese subtitles. Therefore, this function facilitates internationalization of films.
  • the DVD is usually played back with only one subtitle displayed. If two or more subtitles are displayed simultaneously, there can be overlay among the subtitles, making them difficult to read, or only one of the subtitles is displayed in the overlaid region such that other subtitles cannot be completely displayed.
  • PAL Phase Alternate Line
  • NTSC National Television System Committee
  • an object of the invention is to provide a video decoding apparatus, a video decoding method and a digital audio/video system capable of controlling presentation of sub-pictures, and the apparatus, method and system are able to control the aspect ratio and the position of the sub-pictures so that the sub-pictures can be completely displayed and any overlay among multiple sub-pictures is avoided.
  • the digital audio/video playback system capable of controlling presentation of sub-pictures of the invention decodes a digital audio/video signal, and to playback an output picture and a decoded audio through a video output device and an audio output device.
  • the digital audio/video playback system includes a signal loader, a signal parser, a video decoding apparatus and an audio decoder.
  • the signal loader is utilized to receive the digital audio/video signal.
  • the signal parser is utilized to divide the digital audio/video signal into a video bit stream, a sub-picture bit stream and an audio bit stream.
  • the audio decoder receives the audio bit stream, decodes it to a decoded audio, and outputs the decoded audio to the audio output device.
  • the video decoding apparatus receives the video bit stream and the sub-picture bit stream, decodes and combines them into a picture, and outputs the combined picture to the video output device to playback.
  • the abovementioned video decoding apparatus includes: a first decoder which receives the video bit stream and decodes it in order to generate a decoded video; a second decoder which receives the sub-picture bit stream and decodes it in order to generate at least one decoded sub-picture; a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video; a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
  • the invention also discloses a video decoding method capable of controlling presentation of sub-pictures, which is utilized to decode a digital audio/video signal and to playback an output picture through a video output device.
  • the video decoding method includes: receiving a video bit stream and decoding it to generate a decoded video; receiving a sub-picture bit stream and decoding it to generate at least one decoded sub-picture; capturing the size of the decoded video and generating a first scaling factor according to the size of the output picture and the size of the decoded video; capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined
  • the video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures.
  • the video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures.
  • there is no overlay on the main video region and overlay among the sub-pictures is avoided effectively so that each of the sub-pictures is completely displayed.
  • FIG. 1 shows a block diagram of a digital audio/video playback system capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
  • FIG. 2 shows a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
  • FIG. 3 shows a flow chart of a first scaler generating a first scaling factor.
  • FIG. 4 shows a flow chart of a second scaler generating a second scaling factor
  • FIG. 5 shows a flow chart of a combiner combining the decoded video and the decoded sub-picture.
  • a digital audio/video playback system 1 capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is utilized to decode a digital audio/video signal (DAVS) and to playback an output picture and a decoded audio through a video output device 21 and an audio output device 22 , wherein the DAVS includes a video bit stream (VBS), a sub-picture bit stream (SPBS) and an audio bit stream (ABS).
  • the digital audio/video playback system 1 includes a signal loader 11 , a signal parser 12 , a video decoding apparatus 13 and an audio decoder 14 .
  • the signal loader 11 is utilized to receive DAVS. Take a DVD player for instance, the signal loader 11 may include elements like a control unit, a loading unit, a signal processing unit and more. As for Digital Video Broadcasting (DVB), the signal loader 11 may include elements like a control unit, an antenna, a signal processing unit and more. Therefore, in correspondence to different requirements, the signal loader 11 can be realized through different designs by a person skilled in the art, and thus the signal loader 11 is not explained in further detail.
  • DVD Digital Video Broadcasting
  • the signal parser 12 is utilized to divide the loaded DAVS into a VBS, a SPBS and an ABS.
  • the audio decoder 14 is utilized to receive the ABS and to decode it into a decoded audio (DA) for the audio output device to playback.
  • DA decoded audio
  • the video decoding apparatus 13 is utilized to receive and decode the VBS and the SPBS, and then the video decoding apparatus 13 combines the two into a picture for the video output device 21 to playback.
  • the video decoding apparatus 13 includes: a first decoder 131 , a second decoder 133 , a first scaler 132 , a second scaler 134 and a combiner 135 .
  • the first decoder 131 receives the VBS, decodes the VBS and outputs a decoded video (DV).
  • the second decoder 133 receives the SPBS, decodes the SPBS and outputs at least one decoded sub-picture (DSP) under the control of the user's choice; for example, the second decoder 133 can output one or a plurality of DSPs.
  • the first decoder can be an MPEG decoder, while the second decoder can be a run-length decoder.
  • the first scaler 132 is utilized to capture the size of the DV, such as the horizontal width and the vertical height, and to generate a first scaling factor according to the size of the output picture and the size of the DV.
  • the second scaler 134 is utilized to capture the size and the position of the DSP, such as the horizontal coordinate and the vertical coordinate, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio.
  • the combiner 135 sets the size of the DV according to the first scaling factor, sets the size and the position of the DSP according to the second scaling factor, combines the DV and the DSP, and outputs the combined picture to the video output device 21 to playback. The procedures for generating the first scaling factor and the second scaling factor, and for combining the DV and the DSP will be described later.
  • a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is described.
  • a VBS is received and decoded to generate a DV (S 31 )
  • a SPBS is received and decoded to generate at least one DSP (S 32 ).
  • the size of the DV is captured, and a first scaling factor is generated according to the size of an output picture and the size of the DV (S 33 ).
  • the procedure for generating the first scaling factor is described.
  • the size of the DV namely its horizontal width Vh and its vertical height Vv
  • the size of the active display area of a video output device 21 namely its horizontal width Dh and its vertical height Dv, is obtained (S 332 ).
  • the next step is to determine whether or not a film to be played supports specific video aspect ratios (S 333 ), for example the aspect ratios of modes such as letterbox or pan & scan.
  • the size of the output picture is equal to the size of the active display area of the video output device 21 , namely the horizontal width OVh of the output picture is equal to the horizontal width Dh of the active display area of the video output device 21 , and the vertical height OVv of the output picture is equal to the vertical height Dv of the active display of the video output device 21 (S 335 ).
  • the horizontal width OVh of the output picture is the product of the horizontal width Dh of the active display area of the video output device 21 and a horizontal aspect ratio VARh of the video aspect ratio
  • the vertical height OVv of the output picture is the product of the vertical height Dv of the active display area of the video output device 21 and a vertical aspect ratio VARv of the video aspect ratio (S 334 ).
  • the first scaling factor is calculated according to the size of the output picture and the size of the DV, and the first scaling factor includes a first horizontal scaling factor (SF 1 h) and a first vertical scaling factor (SF 1 v).
  • the SF 1 h is equal to the horizontal width OVh of the output picture divided by the horizontal width Vh of the DV.
  • the SF 1 v is equal to the vertical height OVv of the output picture divided by the vertical height Vv of the DV.
  • the step S 34 is to capture the size and the position of the DSP, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio.
  • the procedure for generating the second scaling factor is described.
  • the size and the position of the DSP namely its horizontal width SPh, its vertical height SPv, its horizontal coordinate, and its vertical coordinate, are obtained (S 341 ).
  • the sub-picture aspect ratio of the DSP which includes a horizontal aspect ratio (SPARh) and a vertical aspect ratio (SPARv) is obtained (S 342 ).
  • the next step is to determine whether the film to be played permits sub-picture scaling (S 343 ); scaling the sub-picture can result in a blurred sub-picture during playback, thus restriction on sub-picture scaling may have been added when the film was recorded.
  • a second horizontal scaling factor (SF 2 h) and a second vertical scaling factor (SF 2 v) of the second scaling factor are both 1 (S 345 ), namely the sub-picture is not scaled. If the sub-picture scaling is allowed for playback, the SF 2 h is equal to the SF 1 h divided by the SPARh of the sub-picture aspect ratio, and the SF 2 v is equal to the SF 1 v divided by the SPARv of the sub-picture aspect ratio.
  • the size of the DV is set according to the first scaling factor
  • the size and the position of the DSP is set according to the second scaling factor
  • the DV and the DSP are combined, and the combined picture is output to the video output device 21 to playback (S 35 ).
  • the flow of combining the DV and the DSP is depicted in FIG. 5 .
  • determine whether the DSP is for the purpose of visual effect instead of being as the sub-title (S 351 ). If yes, the relative positions between the DSP and the DV should be fixed to retain the intended visual effect, thus, the size of the DSP is set so as to precisely achieve the purpose of visual effect. If the DSP is for the purpose other than visual effect, for example as the sub-title, the size and the position of the DSP are set (S 353 ).
  • S 354 determines whether the border of the picture is determined (S 354 ); if yes, the size and the position of the DSP are re-set (S 353 ).
  • the DSP covers the main region of the DV is determined (S 355 ). For example, generally the central area of a DV is the main region, thus efforts should be made to prevent DSP from covering the central area of the DV as much as possible. If the main region of the DV is covered, the size and the position of the DSP are re-set as well (S 353 ). If the user chooses to display a plurality of DSPs, it is necessary to further determine whether there is overlay among the plurality of DSPs (S 356 ) when combining the DV and the DSPs. And if there is overlay among the plurality of DSPs, go back to step S 353 to re-set the sizes and the positions of the plurality of DSPs. After the sizes and the positions of all the DSPs are set (S 357 ), combine the DV and the DSP, and output the combined picture to the video output device 21 for playback (S 358 ).
  • the video decoding apparatus, video decoding method and digital audio/video system capable of controlling the presentation of the sub-pictures according to the invention are able to control the aspect ratio and the position of the sub-pictures so as to completely display the sub-pictures. Additionally, when a single sub-picture is displayed, the main video region is not covered, and when a plurality of sub-pictures are displayed, overlay among the plurality of sub-pictures is avoided to completely display all the sub-pictures.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Graphics (AREA)
  • Television Signal Processing For Recording (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Studio Circuits (AREA)

Abstract

A video decoding apparatus capable of controlling presentation of sub-pictures includes a first decoder, a second decoder, a first scaler, a second scaler and a combiner. The first decoder and the second decoder respectively decode a digital audio/video signal to generate a decoded video and a decoded sub-picture. In accordance with an output picture size, the decoded video size, the decoded sub-picture size and a sub-picture aspect ratio, the first scaler and the second scaler generate a first scaling factor and a second scaling factor. The combiner combines the decoded video and the decoded sub-picture according to the first scaling factor and the second scaling factor and outputs the combination thereof. A video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures are also disclosed.

Description

BACKGROUND OF THE INVENTION
a) Field of the Invention
The invention relates to a video decoding apparatus, a video decoding method and a digital audio/video playback system and, more particularly, to a video decoding apparatus, a video decoding method and a digital audio/video playback system capable of controlling presentation of sub-pictures.
b) Description of the Related Art
Due to the advance of information technology, both audio and video data can be stored, transmitted and played back in digital format. Besides providing movies of better quality, audio and video data in digital format offers many additional functions. Take the digital versatile disc (DVD) for instance, not only can the DVD store high-quality movies, but the DVD can also store multilingual audio tracks and multiple sub-pictures for users to choose from during playback. One of the major functions of sub-pictures is to act as subtitles, for example, an English film can include therein English and Chinese audio tracks, and English and Chinese subtitles, and during playback, users can choose the English audio track with Chinese subtitle, or the English audio track with English subtitle, as well as the Chinese audio track with English or Chinese subtitles. Therefore, this function facilitates internationalization of films.
As common practice, even though the DVD contains multiple subtitles, the DVD is usually played back with only one subtitle displayed. If two or more subtitles are displayed simultaneously, there can be overlay among the subtitles, making them difficult to read, or only one of the subtitles is displayed in the overlaid region such that other subtitles cannot be completely displayed.
Furthermore, differently formatted DVD films can cause incomplete display of the subtitle during playback. For example, in Phase Alternate Line (PAL) standard adopted by most European countries and Australia, the resolution of the DVD film is 720×576 pixels. In National Television System Committee (NTSC) standard adopted by North America and Japan, the resolution of the DVD film is 720×480 pixels. Therefore, when a DVD film recorded according to PAL standard is played back in a playback system compliant with NTSC standard, there is a possibility that the subtitle at the lower end of the picture is cut off and cannot be displayed completely. In addition, similar problems exist when playback systems with different formats, namely 4:3 or 16:9, are used to play differently formatted DVD films.
In summary, it would be desirable if the sub-pictures can be completely displayed and overlay among multiple sub-pictures can be avoided during playback of a digital film.
SUMMARY OF THE INVENTION
In view of the problems mentioned above, an object of the invention is to provide a video decoding apparatus, a video decoding method and a digital audio/video system capable of controlling presentation of sub-pictures, and the apparatus, method and system are able to control the aspect ratio and the position of the sub-pictures so that the sub-pictures can be completely displayed and any overlay among multiple sub-pictures is avoided.
To achieve the object mentioned above, the digital audio/video playback system capable of controlling presentation of sub-pictures of the invention decodes a digital audio/video signal, and to playback an output picture and a decoded audio through a video output device and an audio output device. The digital audio/video playback system includes a signal loader, a signal parser, a video decoding apparatus and an audio decoder. The signal loader is utilized to receive the digital audio/video signal. The signal parser is utilized to divide the digital audio/video signal into a video bit stream, a sub-picture bit stream and an audio bit stream. The audio decoder receives the audio bit stream, decodes it to a decoded audio, and outputs the decoded audio to the audio output device. The video decoding apparatus receives the video bit stream and the sub-picture bit stream, decodes and combines them into a picture, and outputs the combined picture to the video output device to playback.
The abovementioned video decoding apparatus includes: a first decoder which receives the video bit stream and decodes it in order to generate a decoded video; a second decoder which receives the sub-picture bit stream and decodes it in order to generate at least one decoded sub-picture; a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video; a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
The invention also discloses a video decoding method capable of controlling presentation of sub-pictures, which is utilized to decode a digital audio/video signal and to playback an output picture through a video output device. The video decoding method includes: receiving a video bit stream and decoding it to generate a decoded video; receiving a sub-picture bit stream and decoding it to generate at least one decoded sub-picture; capturing the size of the decoded video and generating a first scaling factor according to the size of the output picture and the size of the decoded video; capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
The video decoding apparatus, method and the digital audio/video playback system capable of controlling presentation of sub-pictures according to the invention are able to control the aspect ratio and the position of sub-pictures in order to completely display sub-pictures. At the same time, when a single sub-picture or a plurality of sub-pictures are displayed, there is no overlay on the main video region and overlay among the sub-pictures is avoided effectively so that each of the sub-pictures is completely displayed.
BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 shows a block diagram of a digital audio/video playback system capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
FIG. 2 shows a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention.
FIG. 3 shows a flow chart of a first scaler generating a first scaling factor.
FIG. 4 shows a flow chart of a second scaler generating a second scaling factor; and
FIG. 5 shows a flow chart of a combiner combining the decoded video and the decoded sub-picture.
 DETAIL DESCRIPTION OF THE INVENTION
The video decoding apparatus, video decoding method and digital audio/video playback system capable of controlling presentation of sub-pictures according to preferred embodiments of the invention will be explained below with reference to the drawings, wherein the like numerals denote the like components.
Referring to FIG. 1, a digital audio/video playback system 1 capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is utilized to decode a digital audio/video signal (DAVS) and to playback an output picture and a decoded audio through a video output device 21 and an audio output device 22, wherein the DAVS includes a video bit stream (VBS), a sub-picture bit stream (SPBS) and an audio bit stream (ABS). The digital audio/video playback system 1 includes a signal loader 11, a signal parser 12, a video decoding apparatus 13 and an audio decoder 14.
The signal loader 11 is utilized to receive DAVS. Take a DVD player for instance, the signal loader 11 may include elements like a control unit, a loading unit, a signal processing unit and more. As for Digital Video Broadcasting (DVB), the signal loader 11 may include elements like a control unit, an antenna, a signal processing unit and more. Therefore, in correspondence to different requirements, the signal loader 11 can be realized through different designs by a person skilled in the art, and thus the signal loader 11 is not explained in further detail.
The signal parser 12 is utilized to divide the loaded DAVS into a VBS, a SPBS and an ABS. The audio decoder 14 is utilized to receive the ABS and to decode it into a decoded audio (DA) for the audio output device to playback.
The video decoding apparatus 13 is utilized to receive and decode the VBS and the SPBS, and then the video decoding apparatus 13 combines the two into a picture for the video output device 21 to playback. The video decoding apparatus 13 includes: a first decoder 131, a second decoder 133, a first scaler 132, a second scaler 134 and a combiner 135. The first decoder 131 receives the VBS, decodes the VBS and outputs a decoded video (DV). The second decoder 133 receives the SPBS, decodes the SPBS and outputs at least one decoded sub-picture (DSP) under the control of the user's choice; for example, the second decoder 133 can output one or a plurality of DSPs. The first decoder can be an MPEG decoder, while the second decoder can be a run-length decoder.
The first scaler 132 is utilized to capture the size of the DV, such as the horizontal width and the vertical height, and to generate a first scaling factor according to the size of the output picture and the size of the DV. The second scaler 134 is utilized to capture the size and the position of the DSP, such as the horizontal coordinate and the vertical coordinate, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio. The combiner 135 sets the size of the DV according to the first scaling factor, sets the size and the position of the DSP according to the second scaling factor, combines the DV and the DSP, and outputs the combined picture to the video output device 21 to playback. The procedures for generating the first scaling factor and the second scaling factor, and for combining the DV and the DSP will be described later.
Referring to FIG. 2, a video decoding method capable of controlling presentation of sub-pictures according to a preferred embodiment of the invention is described. First, a VBS is received and decoded to generate a DV (S31), and then a SPBS is received and decoded to generate at least one DSP (S32). Next, the size of the DV is captured, and a first scaling factor is generated according to the size of an output picture and the size of the DV (S33).
Referring to FIG. 3, the procedure for generating the first scaling factor is described. First, the size of the DV, namely its horizontal width Vh and its vertical height Vv, is obtained (S331), and the size of the active display area of a video output device 21, namely its horizontal width Dh and its vertical height Dv, is obtained (S332). The next step is to determine whether or not a film to be played supports specific video aspect ratios (S333), for example the aspect ratios of modes such as letterbox or pan & scan. If the film to be played does not support a specific display mode, the size of the output picture is equal to the size of the active display area of the video output device 21, namely the horizontal width OVh of the output picture is equal to the horizontal width Dh of the active display area of the video output device 21, and the vertical height OVv of the output picture is equal to the vertical height Dv of the active display of the video output device 21 (S335). If the film to be played supports a specific display mode, and the user chooses the specific display mode for playback, the horizontal width OVh of the output picture is the product of the horizontal width Dh of the active display area of the video output device 21 and a horizontal aspect ratio VARh of the video aspect ratio, and the vertical height OVv of the output picture is the product of the vertical height Dv of the active display area of the video output device 21 and a vertical aspect ratio VARv of the video aspect ratio (S334). Finally, the first scaling factor is calculated according to the size of the output picture and the size of the DV, and the first scaling factor includes a first horizontal scaling factor (SF1h) and a first vertical scaling factor (SF1v). The SF1h is equal to the horizontal width OVh of the output picture divided by the horizontal width Vh of the DV. The SF1v is equal to the vertical height OVv of the output picture divided by the vertical height Vv of the DV.
Referring to FIG. 2 again, the step S34 is to capture the size and the position of the DSP, and to generate a second scaling factor according to the size of the output picture, the size of the DSP and a sub-picture aspect ratio.
Referring to FIG. 4, the procedure for generating the second scaling factor is described. First, the size and the position of the DSP, namely its horizontal width SPh, its vertical height SPv, its horizontal coordinate, and its vertical coordinate, are obtained (S341). Then, the sub-picture aspect ratio of the DSP, which includes a horizontal aspect ratio (SPARh) and a vertical aspect ratio (SPARv), is obtained (S342). The next step is to determine whether the film to be played permits sub-picture scaling (S343); scaling the sub-picture can result in a blurred sub-picture during playback, thus restriction on sub-picture scaling may have been added when the film was recorded. If sub-picture scaling is prohibited, a second horizontal scaling factor (SF2h) and a second vertical scaling factor (SF2v) of the second scaling factor are both 1 (S345), namely the sub-picture is not scaled. If the sub-picture scaling is allowed for playback, the SF2h is equal to the SF1h divided by the SPARh of the sub-picture aspect ratio, and the SF2v is equal to the SF1v divided by the SPARv of the sub-picture aspect ratio.
Referring to FIG. 2 again, finally, the size of the DV is set according to the first scaling factor, the size and the position of the DSP is set according to the second scaling factor, the DV and the DSP are combined, and the combined picture is output to the video output device 21 to playback (S35).
The flow of combining the DV and the DSP is depicted in FIG. 5. Firstly, determine whether the DSP is for the purpose of visual effect instead of being as the sub-title (S351). If yes, the relative positions between the DSP and the DV should be fixed to retain the intended visual effect, thus, the size of the DSP is set so as to precisely achieve the purpose of visual effect. If the DSP is for the purpose other than visual effect, for example as the sub-title, the size and the position of the DSP are set (S353). Next, whether the DSP exceeds the border of the picture is determined (S354); if yes, the size and the position of the DSP are re-set (S353). Then, whether the DSP covers the main region of the DV is determined (S355). For example, generally the central area of a DV is the main region, thus efforts should be made to prevent DSP from covering the central area of the DV as much as possible. If the main region of the DV is covered, the size and the position of the DSP are re-set as well (S353). If the user chooses to display a plurality of DSPs, it is necessary to further determine whether there is overlay among the plurality of DSPs (S356) when combining the DV and the DSPs. And if there is overlay among the plurality of DSPs, go back to step S353 to re-set the sizes and the positions of the plurality of DSPs. After the sizes and the positions of all the DSPs are set (S357), combine the DV and the DSP, and output the combined picture to the video output device 21 for playback (S358).
Regardless of what the modes the film to be displayed supports and what standards the display system complies with, the video decoding apparatus, video decoding method and digital audio/video system capable of controlling the presentation of the sub-pictures according to the invention are able to control the aspect ratio and the position of the sub-pictures so as to completely display the sub-pictures. Additionally, when a single sub-picture is displayed, the main video region is not covered, and when a plurality of sub-pictures are displayed, overlay among the plurality of sub-pictures is avoided to completely display all the sub-pictures.
While the invention has been described by way of example and in terms of the preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements apparent to those skilled in the art. For example, in the DVB system, the size and the coordinates of each object can be captured, and the size and the position of each object can be properly set for it to function properly. Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

Claims (37)

What is claimed is:
1. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
2. The video decoding apparatus as specified in claim 1, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
3. The video decoding apparatus as specified in claim 2, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display of the video output device and a vertical aspect ratio of the video aspect ratio.
4. The video decoding apparatus as specified in claim 1, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner only sets the size of the decoded video and the size of the decoded sub-picture when combining the decoded video and the decoded sub-picture.
5. The video decoding apparatus as specified in claim 1, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
6. The video decoding apparatus as specified in claim 1, wherein the first decoder is an MPEG decoder and the second decoder is a run-length decoder.
7. A digital audio/video playback system capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, and outputting a decoded audio through an audio output device, the digital audio/video playback system comprising:
a signal loader which receives the digital audio/video signal;
a signal parser which divides the digital audio/video signal into a video bit stream, a sub-picture bit stream, and an audio bit stream;
an audio decoder which receives the audio bit stream, decodes the audio bit stream to a decoded audio, and outputs the decoded audio to the audio output device; and
a video decoding apparatus, including:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which captures the size of the decoded video and generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which captures the size and the position of the decoded sub-picture and generates a second scaling factor according to the size of the output picture, the size of the decoded sub-picture, and a sub-picture aspect ratio; and
a combiner which sets the size of the decoded video according to the first scaling factor, sets the size and the position of the sub-picture according the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
8. The digital audio/video playback system as specified in claim 7, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
9. The digital audio/video playback system as specified in claim 8, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the height of the active display area of the video output device and a vertical aspect ratio of the video aspect ratio.
10. The digital audio/video playback system as specified in claim 7, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner only sets the size of the decoded video and the size of the decoded sub-picture when combining the decoded video and the decoded sub-picture.
11. The digital audio/video playback system as specified in claim 7, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
12. The digital audio/video playback system as specified in claim 7, wherein the first decoder is an MPEG decoder, and the second decoder is a run-length decoder.
13. The digital audio/video playback system as specified in claim 7, wherein the digital audio/video playback system is a DVD playback system or a digital video broadcasting playback system.
14. A video decoding method capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding method comprising the steps of:
receiving the video bit stream and decoding the video bit stream to generate a decoded video;
receiving the sub-picture bit stream and decoding the sub-picture bit stream to generate at least one decoded sub-picture;
capturing the size of the decoded video, and generating a first scaling factor according to the size of the output picture and the size of the decoded video;
capturing the size and the position of the decoded sub-picture, and generating a second scaling factor according to the size of the output picture, the size of the decoded sub-picture and a sub-picture aspect ratio; and
setting the size of the decoded video according to the first scaling factor, setting the size and the position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
15. The video decoding method as specified in claim 14, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video; and
the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal aspect ratio and a vertical aspect ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal aspect ratio of the sub-picture aspect ratio, and the second scaling factor is equal to the first vertical scaling factor divided by the vertical aspect ratio of the sub-picture aspect ratio.
16. The video decoding method as specified in claim 15, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal aspect ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display of the video output device and a vertical aspect ratio of the video aspect ratio.
17. The video decoding method as specified in claim 14, wherein if the decoded sub-picture is for the purpose of visual effect, only the size of the decoded video and the size of the decoded sub-picture are set when combining the decoded video and the decoded sub-picture.
18. The video decoding method as specified in claim 14, wherein the decoded sub-picture is prevented from exceeding the border of the output picture and covering the main region of the decoded video when combining the decoded video and the decoded sub-picture.
19. A video decoding method as specified in claim 14, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, overlay among the plurality of decoded sub-pictures is prevented when combining the decoded video and the decoded sub-pictures.
20. The video decoding method as specified in claim 14, wherein the first decoder is an MPEG decoder, and the second decoder is a run-length decoder.
21. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate a decoded sub-picture;
a first scaler which generates a first scaling factor according to the size of the output picture and the size of the decoded video;
a second scaler which generates a second scaling factor according to a ratio of the first scaling factor and a sub-picture aspect ratio; and
a combiner which sets a displayed size of the decoded video according to the first scaling factor, sets a displayed size and a position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
22. The video decoding apparatus as specified in claim 21, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video.
23. The video decoding apparatus as specified in claim 22, wherein the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal ratio and a vertical ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical ratio of the sub-picture aspect ratio.
24. The video decoding apparatus as specified in claim 22, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display area of the video output device and a vertical ratio of the video aspect ratio.
25. The video decoding apparatus as specified in claim 21, wherein if the decoded sub-picture is for the purpose of visual effect, the combiner sets the displayed size of the decoded sub-picture according to the first scaling factor when combining the decoded video and the decoded sub-picture.
26. The video decoding apparatus as specified in claim 21, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, the combiner further sets the positions of the plurality of decoded sub-pictures so as to avoid overlay among the plurality of decoded sub-pictures.
27. A digital audio/video playback system capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, and outputting a decoded audio through an audio output device, the digital audio/video playback system comprising:
a signal loader which receives the digital audio/video signal;
a signal parser which divides the digital audio/video signal into a video bit stream, a sub-picture bit stream, and an audio bit stream;
an audio decoder which receives the audio bit stream, decodes the audio bit stream to a decoded audio, and outputs the decoded audio to the audio output device; and
a video decoding apparatus of claim 21.
28. A video decoding method capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal, outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding method comprising the steps of:
receiving the video bit stream and decoding the video bit stream to generate a decoded video;
receiving the sub-picture bit stream and decoding the sub-picture bit stream to generate a decoded sub-picture;
generating a first scaling factor according to the size of the output picture and the size of the decoded video;
generating a second scaling factor according to a ratio of the first scaling factor and a sub-picture aspect ratio; and
setting a displayed size of the decoded video according to the first scaling factor, setting a displayed size and a position of the decoded sub-picture according to the second scaling factor, combining the decoded video and the decoded sub-picture, and outputting the combined picture to the video output device.
29. The video decoding method as specified in claim 28, wherein:
the first scaling factor comprises a first horizontal scaling factor and a first vertical scaling factor, in which the first horizontal scaling factor is equal to the horizontal width of the output picture divided by the horizontal width of the decoded video, and the first vertical scaling factor is equal to the vertical height of the output picture divided by the vertical height of the decoded video.
30. The video decoding method as specified in claim 29, wherein the second scaling factor comprises a second horizontal scaling factor and a second vertical scaling factor while the sub-picture aspect ratio includes a horizontal ratio and a vertical ratio, in which the second horizontal scaling factor is equal to the first horizontal scaling factor divided by the horizontal ratio of the sub-picture aspect ratio, and the second vertical scaling factor is equal to the first vertical scaling factor divided by the vertical ratio of the sub-picture aspect ratio.
31. The video decoding method as specified in claim 29, wherein the horizontal width of the output picture is the product of the horizontal width of the active display area of the video output device and a horizontal ratio of a video aspect ratio, and the vertical height of the output picture is the product of the vertical height of the active display area of the video output device and a vertical ratio of the video aspect ratio.
32. The video decoding method as specified in claim 28, wherein if the decoded sub-picture is for the purpose of visual effect, the displayed size of the decoded sub-picture is set according to the first scaling factor when combining the decoded video and the decoded sub-picture.
33. The video decoding method as specified in claim 28, wherein the decoded sub-picture is prevented from exceeding the border of the output picture and covering the main region of the decoded video when combining the decoded video and the decoded sub-picture.
34. The video decoding method as specified in claim 28, wherein when the decoding of the sub-picture bit stream generates a plurality of decoded sub-pictures, overlay among the plurality of decoded sub-pictures is prevented when combining the decoded video and the decoded sub-pictures.
35. A video decoding apparatus capable of controlling presentation of sub-pictures, which is for decoding a digital audio/video signal and outputting an output picture through a video output device, wherein the digital audio/video signal includes a video bit stream and a sub-picture bit stream, the video decoding apparatus comprising:
a first decoder which receives the video bit stream and decodes the video bit stream to generate a decoded video;
a second decoder which receives the sub-picture bit stream and decodes the sub-picture bit stream to generate at least one decoded sub-picture;
a first scaler which generates a first scaling factor for scaling the decoded video;
a second scaler which generates a second scaling factor for scaling the decoded sub-picture, wherein the generation of the second scaling factor comprises determining the second scaling factor at least via a calculation that uses the first scaling factor; and
a combiner which sets a displayed size of the decoded video according to the first scaling factor, sets a displayed size and a position of the decoded sub-picture according to the second scaling factor, combines the decoded video and the decoded sub-picture, and outputs the combined picture to the video output device.
36. The video decoding apparatus as specified in claim 21, wherein the combiner sets the displayed size and the position of the decoded sub-picture further according to a relative position relationship between at least two of the decoded video and the at least one decoded sub-picture.
37. The video decoding method as specified in claim 28, wherein in the step of setting the displayed size and the position of the decoded sub-picture according to the second scaling factor, the displayed size and the position of the at least one decoded sub-picture are set further according to a relative position relationship between at least two of the decoded video and the at least one decoded sub-picture.
US13/689,769 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures Active 2029-09-30 USRE45909E1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/689,769 USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US14/469,604 USRE46434E1 (en) 2005-06-30 2014-08-27 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
TW094122087A TWI262725B (en) 2005-06-30 2005-06-30 Video decoding apparatus and digital audio and video display system capable of controlling presentation of subtitles and method thereof
TW94122087A 2005-06-30
US11/472,240 US7844168B2 (en) 2005-06-30 2006-06-20 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US13/689,769 USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US11/472,240 Reissue US7844168B2 (en) 2005-06-30 2006-06-20 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US11/472,240 Continuation US7844168B2 (en) 2005-06-30 2006-06-20 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Publications (1)

Publication Number Publication Date
USRE45909E1 true USRE45909E1 (en) 2016-03-01

Family

ID=37987820

Family Applications (3)

Application Number Title Priority Date Filing Date
US11/472,240 Ceased US7844168B2 (en) 2005-06-30 2006-06-20 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US13/689,769 Active 2029-09-30 USRE45909E1 (en) 2005-06-30 2012-11-30 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US14/469,604 Active 2029-09-30 USRE46434E1 (en) 2005-06-30 2014-08-27 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/472,240 Ceased US7844168B2 (en) 2005-06-30 2006-06-20 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/469,604 Active 2029-09-30 USRE46434E1 (en) 2005-06-30 2014-08-27 Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures

Country Status (2)

Country Link
US (3) US7844168B2 (en)
TW (1) TWI262725B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8259034B2 (en) * 2006-08-30 2012-09-04 Totoku Electric Co., Ltd. Image displaying apparatus and image display program
WO2010109900A1 (en) * 2009-03-26 2010-09-30 パナソニック株式会社 Video processor, video processing method, integrated circuit for video processing, video playback device
KR20120108136A (en) * 2011-03-23 2012-10-05 삼성전자주식회사 Method for processing image and devices using the method
US9693064B2 (en) * 2011-09-30 2017-06-27 Avago Technologies General Ip (Singapore) Pte. Ltd Video coding infrastructure using adaptive prediction complexity reduction
KR102028696B1 (en) * 2012-10-04 2019-10-07 삼성전자주식회사 Content processing device for processing high resolution content and method thereof
WO2016079868A1 (en) 2014-11-21 2016-05-26 楽天株式会社 Information processing device, information processing method, and information processing program
US9659570B2 (en) 2015-10-08 2017-05-23 International Business Machines Corporation Audiovisual information processing in videoconferencing
US20180189980A1 (en) * 2017-01-03 2018-07-05 Black Sails Technology Inc. Method and System for Providing Virtual Reality (VR) Video Transcoding and Broadcasting
CN109348276B (en) 2018-11-08 2019-12-17 北京微播视界科技有限公司 video picture adjusting method and device, computer equipment and storage medium
KR20220088844A (en) * 2019-08-06 2022-06-28 오피 솔루션즈, 엘엘씨 Adaptive resolution management using sub-frames
CN115462074A (en) * 2020-04-22 2022-12-09 瑞典爱立信有限公司 Compressed picture-in-picture signaling

Citations (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02223286A (en) * 1989-02-23 1990-09-05 Mitsubishi Electric Corp Television receiver
US4998171A (en) * 1988-07-05 1991-03-05 Samsung Electronics Co., Ltd. Automatic shift circuit for a sub-picture screen for picture-in-picture feature
US5467142A (en) * 1992-04-24 1995-11-14 Victor Company Of Japan, Ltd. Television receiver for reproducing video images having different aspect ratios and characters transmitted with video images
US5570126A (en) * 1993-05-03 1996-10-29 Lucent Technologies Inc. System for composing multimedia signals for interactive television services
JPH09294250A (en) * 1996-04-26 1997-11-11 Sony Corp Scanning line converter
JPH10215409A (en) * 1997-01-29 1998-08-11 Sharp Corp Sub-picture display device
US5912710A (en) * 1996-12-18 1999-06-15 Kabushiki Kaisha Toshiba System and method for controlling a display of graphics data pixels on a video monitor having a different display aspect ratio than the pixel aspect ratio
US5963221A (en) * 1995-10-16 1999-10-05 Sanyo Electric Co., Ltd. Device for writing and reading of size reduced video on a video screen by fixing read and write of alternating field memories during resize operation
US6147712A (en) * 1996-05-27 2000-11-14 Mitsubishi Denki Kabushiki Kaisha Format conversion circuit and television receiver provided therewith and method of converting video signals
US6204887B1 (en) * 1998-12-11 2001-03-20 Hitachi America, Ltd. Methods and apparatus for decoding and displaying multiple images using a common processor
US6310656B1 (en) * 1997-11-17 2001-10-30 Sony Corporation Television apparatus, display method of television apparatus and picture plane control apparatus, and method
JP2002016884A (en) * 2000-06-29 2002-01-18 Matsushita Electric Ind Co Ltd Video signal reproducing apparatus
US20020034252A1 (en) * 1998-12-08 2002-03-21 Owen Jefferson Eugene System, method and apparatus for an instruction driven digital video processor
US20020089523A1 (en) * 2001-01-09 2002-07-11 Pace Micro Technology Plc. Dynamic adjustment of on screen graphic displays to cope with different video display and/or display screen formats
JP2003037792A (en) * 2001-07-25 2003-02-07 Toshiba Corp Data reproducing device and data reproducing method
US20030113102A1 (en) * 2001-12-13 2003-06-19 Tzu-Ping Lin Apparatus and method for video data processing in digital video decoding
CN1466849A (en) 2000-08-21 2004-01-07 Lg������ʽ���� Sub picture control apparatus and method for television receivir
US6678006B1 (en) * 1998-01-07 2004-01-13 Ati Technologies, Inc. Method and apparatus for video processing that includes sub-picture scaling
US6707504B2 (en) * 2000-01-24 2004-03-16 Lg Electronics Inc. Caption display method of digital television
US6727958B1 (en) * 1999-08-20 2004-04-27 Winbond Electronics Corp. Method and apparatus for displaying resized pictures on an interlaced target display system
WO2004051992A1 (en) * 2002-11-29 2004-06-17 Matsushita Electric Industrial Co., Ltd. Video display apparatus and video display method
WO2004057532A1 (en) 2002-12-19 2004-07-08 Koninklijke Philips Electronics N.V. Image scaling
JP2004208014A (en) * 2002-12-25 2004-07-22 Mitsubishi Electric Corp Subtitle display device and subtitle display program
US6775467B1 (en) * 2000-05-26 2004-08-10 Cyberlink Corporation DVD playback system capable of playing two subtitles at the same time
US20040179824A1 (en) * 2002-12-27 2004-09-16 Yasufumi Tsumagari Information playback apparatus and information playback method
JP2004320324A (en) * 2003-04-15 2004-11-11 Funai Electric Co Ltd Disk reproducing device
US20040223745A1 (en) * 2003-01-07 2004-11-11 Pioneer Corporation Information recording medium, information reproducing apparatus and method, and computer program product
US20050001931A1 (en) * 2003-06-09 2005-01-06 Michael Kahn Method, system, and apparatus for configuring a signal processing device for use with a display device
US20050012862A1 (en) * 2003-07-18 2005-01-20 Lg Electronics Inc. Video display appliance having function of varying screen ratio and control method thereof
US20050068346A1 (en) * 2003-09-29 2005-03-31 Pioneer Corporation Image output apparatus, image output method, and image display system
US20050128349A1 (en) * 2003-12-05 2005-06-16 Hiroki Takamori Video signal output apparatus
US6912350B1 (en) * 1999-12-08 2005-06-28 Intel Corporation DVD subpicture rendering without loss of color resolution
US20050169608A1 (en) * 2004-01-07 2005-08-04 Chin-Cheng Shen Method for adjusting display of sub-picture in audio/video playback device
US7006156B2 (en) * 2000-10-19 2006-02-28 Sanyo Electric Co., Ltd. Image data output device and receiving device
US7062153B2 (en) * 2000-09-19 2006-06-13 Kabushiki Kaisha Toshiba Reproducing apparatus with sub-picture processing function
US20060188229A1 (en) * 2005-02-22 2006-08-24 Yoichiro Yamagata Information storage medium, information recording method, and information playback method
US20070030392A1 (en) * 2005-08-08 2007-02-08 Hiroki Mizosoe Decoding apparatus for encoded video signals
US7196733B2 (en) * 2002-01-28 2007-03-27 Canon Kabushiki Kaisha Apparatus for receiving broadcast data, method for displaying broadcast program, and computer program
US20070097261A1 (en) * 2005-10-25 2007-05-03 Brad Smith Region or frame based aspect ratio scaling
US7365757B1 (en) * 1998-12-17 2008-04-29 Ati International Srl Method and apparatus for independent video and graphics scaling in a video graphics system
US7616264B1 (en) * 2004-12-06 2009-11-10 Pixelworks, Inc. Cropped and scaled picture-in-picture system and method
US7911536B2 (en) * 2004-09-23 2011-03-22 Intel Corporation Screen filled display of digital video content
US7936360B2 (en) * 2005-01-04 2011-05-03 Kabushiki Kaisha Toshiba Reproducing apparatus capable of reproducing picture data
US8279938B2 (en) * 2004-12-02 2012-10-02 Sony Corporation Encoding device and method, decoding device and method, program, recording medium, and data structure

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060158557A1 (en) * 2005-01-20 2006-07-20 Shang-Chieh Wen Method and apparatus for video processing

Patent Citations (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4998171A (en) * 1988-07-05 1991-03-05 Samsung Electronics Co., Ltd. Automatic shift circuit for a sub-picture screen for picture-in-picture feature
JPH02223286A (en) * 1989-02-23 1990-09-05 Mitsubishi Electric Corp Television receiver
US5467142A (en) * 1992-04-24 1995-11-14 Victor Company Of Japan, Ltd. Television receiver for reproducing video images having different aspect ratios and characters transmitted with video images
US5570126A (en) * 1993-05-03 1996-10-29 Lucent Technologies Inc. System for composing multimedia signals for interactive television services
US5963221A (en) * 1995-10-16 1999-10-05 Sanyo Electric Co., Ltd. Device for writing and reading of size reduced video on a video screen by fixing read and write of alternating field memories during resize operation
JPH09294250A (en) * 1996-04-26 1997-11-11 Sony Corp Scanning line converter
US6147712A (en) * 1996-05-27 2000-11-14 Mitsubishi Denki Kabushiki Kaisha Format conversion circuit and television receiver provided therewith and method of converting video signals
US5912710A (en) * 1996-12-18 1999-06-15 Kabushiki Kaisha Toshiba System and method for controlling a display of graphics data pixels on a video monitor having a different display aspect ratio than the pixel aspect ratio
JPH10215409A (en) * 1997-01-29 1998-08-11 Sharp Corp Sub-picture display device
US6310656B1 (en) * 1997-11-17 2001-10-30 Sony Corporation Television apparatus, display method of television apparatus and picture plane control apparatus, and method
US6678006B1 (en) * 1998-01-07 2004-01-13 Ati Technologies, Inc. Method and apparatus for video processing that includes sub-picture scaling
US20020034252A1 (en) * 1998-12-08 2002-03-21 Owen Jefferson Eugene System, method and apparatus for an instruction driven digital video processor
US6204887B1 (en) * 1998-12-11 2001-03-20 Hitachi America, Ltd. Methods and apparatus for decoding and displaying multiple images using a common processor
US7365757B1 (en) * 1998-12-17 2008-04-29 Ati International Srl Method and apparatus for independent video and graphics scaling in a video graphics system
US6727958B1 (en) * 1999-08-20 2004-04-27 Winbond Electronics Corp. Method and apparatus for displaying resized pictures on an interlaced target display system
US6912350B1 (en) * 1999-12-08 2005-06-28 Intel Corporation DVD subpicture rendering without loss of color resolution
US6707504B2 (en) * 2000-01-24 2004-03-16 Lg Electronics Inc. Caption display method of digital television
US6775467B1 (en) * 2000-05-26 2004-08-10 Cyberlink Corporation DVD playback system capable of playing two subtitles at the same time
JP2002016884A (en) * 2000-06-29 2002-01-18 Matsushita Electric Ind Co Ltd Video signal reproducing apparatus
CN1466849A (en) 2000-08-21 2004-01-07 Lg������ʽ���� Sub picture control apparatus and method for television receivir
US7062153B2 (en) * 2000-09-19 2006-06-13 Kabushiki Kaisha Toshiba Reproducing apparatus with sub-picture processing function
US7006156B2 (en) * 2000-10-19 2006-02-28 Sanyo Electric Co., Ltd. Image data output device and receiving device
US20020089523A1 (en) * 2001-01-09 2002-07-11 Pace Micro Technology Plc. Dynamic adjustment of on screen graphic displays to cope with different video display and/or display screen formats
JP2003037792A (en) * 2001-07-25 2003-02-07 Toshiba Corp Data reproducing device and data reproducing method
US7042511B2 (en) * 2001-12-13 2006-05-09 Mediatek Inc. Apparatus and method for video data processing in digital video decoding
US20030113102A1 (en) * 2001-12-13 2003-06-19 Tzu-Ping Lin Apparatus and method for video data processing in digital video decoding
US7196733B2 (en) * 2002-01-28 2007-03-27 Canon Kabushiki Kaisha Apparatus for receiving broadcast data, method for displaying broadcast program, and computer program
US7212218B2 (en) * 2002-11-29 2007-05-01 Matsushita Electric Industrial Co., Ltd. Video display apparatus and video display method
WO2004051992A1 (en) * 2002-11-29 2004-06-17 Matsushita Electric Industrial Co., Ltd. Video display apparatus and video display method
WO2004057532A1 (en) 2002-12-19 2004-07-08 Koninklijke Philips Electronics N.V. Image scaling
JP2004208014A (en) * 2002-12-25 2004-07-22 Mitsubishi Electric Corp Subtitle display device and subtitle display program
US20040179824A1 (en) * 2002-12-27 2004-09-16 Yasufumi Tsumagari Information playback apparatus and information playback method
US20040223745A1 (en) * 2003-01-07 2004-11-11 Pioneer Corporation Information recording medium, information reproducing apparatus and method, and computer program product
JP2004320324A (en) * 2003-04-15 2004-11-11 Funai Electric Co Ltd Disk reproducing device
US20050001931A1 (en) * 2003-06-09 2005-01-06 Michael Kahn Method, system, and apparatus for configuring a signal processing device for use with a display device
US20050012862A1 (en) * 2003-07-18 2005-01-20 Lg Electronics Inc. Video display appliance having function of varying screen ratio and control method thereof
US20050068346A1 (en) * 2003-09-29 2005-03-31 Pioneer Corporation Image output apparatus, image output method, and image display system
US20050128349A1 (en) * 2003-12-05 2005-06-16 Hiroki Takamori Video signal output apparatus
US20050169608A1 (en) * 2004-01-07 2005-08-04 Chin-Cheng Shen Method for adjusting display of sub-picture in audio/video playback device
US7911536B2 (en) * 2004-09-23 2011-03-22 Intel Corporation Screen filled display of digital video content
US8279938B2 (en) * 2004-12-02 2012-10-02 Sony Corporation Encoding device and method, decoding device and method, program, recording medium, and data structure
US7616264B1 (en) * 2004-12-06 2009-11-10 Pixelworks, Inc. Cropped and scaled picture-in-picture system and method
US7936360B2 (en) * 2005-01-04 2011-05-03 Kabushiki Kaisha Toshiba Reproducing apparatus capable of reproducing picture data
US20060188229A1 (en) * 2005-02-22 2006-08-24 Yoichiro Yamagata Information storage medium, information recording method, and information playback method
US20070030392A1 (en) * 2005-08-08 2007-02-08 Hiroki Mizosoe Decoding apparatus for encoded video signals
US20070097261A1 (en) * 2005-10-25 2007-05-03 Brad Smith Region or frame based aspect ratio scaling

Also Published As

Publication number Publication date
US7844168B2 (en) 2010-11-30
USRE46434E1 (en) 2017-06-13
US20070292113A1 (en) 2007-12-20
TWI262725B (en) 2006-09-21
TW200701792A (en) 2007-01-01

Similar Documents

Publication Publication Date Title
USRE45909E1 (en) Video decoding apparatus, video decoding method, and digital audio/video playback system capable of controlling presentation of sub-pictures
US9451207B2 (en) Automatic subtitle resizing
KR101987820B1 (en) Content processing device for processing high resolution content and method thereof
US6297797B1 (en) Computer system and closed caption display method
US8269821B2 (en) Systems and methods for providing closed captioning in three-dimensional imagery
ES2413529T3 (en) Device for receiving a digital information signal
US20030189669A1 (en) Method for off-image data display
US20070253677A1 (en) System for simultaneous playback of multiple video angles from multimedia content onto a display device and method thereof
EP1897368B1 (en) A method and apparatus for displaying data content
US6567097B1 (en) Display control apparatus
JP2016082541A (en) Receiver and program
JP2002016884A (en) Video signal reproducing apparatus
JP2004194311A (en) Video playback device and video playback method
KR100253211B1 (en) Screen display control apparatus and method for display
JP5361429B2 (en) Video playback apparatus and control method thereof
EP1848203B2 (en) Method and system for video image aspect ratio conversion
JP2008252746A (en) Digital broadcast receiver
JP2004221751A (en) Image signal processing device
KR100499505B1 (en) Apparatus for format conversion in digital TV
JP4079721B2 (en) DVD signal output system selection device, DVD built-in multi-system TV receiver, DVD playback display device, and DVD playback device
JP2003023579A (en) Digital broadcast display device
JP2000295527A (en) Video image compositing device
JP2006180091A (en) Apparatus and method of compositing content
KR20040067433A (en) DVD decoder
CN1897698A (en) Video encoder, encoding method and digital video play system for controlling auxiliary-picture display

Legal Events

Date Code Title Description
MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552)

Year of fee payment: 8

CC Certificate of correction
MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12