CN105323635B - Video processing system and method - Google Patents
Video processing system and method Download PDFInfo
- Publication number
- CN105323635B CN105323635B CN201510707886.8A CN201510707886A CN105323635B CN 105323635 B CN105323635 B CN 105323635B CN 201510707886 A CN201510707886 A CN 201510707886A CN 105323635 B CN105323635 B CN 105323635B
- Authority
- CN
- China
- Prior art keywords
- video
- decoder
- audio
- module
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8166—Monomedia components thereof involving executable data, e.g. software
- H04N21/8193—Monomedia components thereof involving executable data, e.g. software dedicated tools, e.g. video decoder software or IPMP tool
Abstract
The invention discloses a video processing system, comprising: a program memory, a hardware decoding circuit and a computer; the program memory is used for storing a video processing program; the computer is used for enabling the hardware decoding circuit to decode a video file acquired from the computer by executing the video processing program; and the hardware decoding circuit is used for decoding the video file and outputting a decoded audio/video signal. The invention also provides a video processing method.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a video processing system and a video processing method.
Background
At present, the computer video technology is a digital video technology, which processes video files by a software decompression method, for example, soft decompression is implemented by player software. The soft decompression is systematic software composed of functional modules such as human-computer interaction, video search, online transmission, networking download, decoding software (realizing the functions of video file decompression, image decoding, sound decoding and the like), play control and the like, and is shown in a schematic view of a video processing system shown in fig. 1. The user carries out playing operation through decompression software, the decompression software firstly realizes the processes of man-machine interaction, file search, online transmission and networking downloading under the coordination of a CPU (central processing unit), an internal memory and a cache of a computer, then the decoding software provides video decoding instructions one by one, the CPU and the internal memory of the computer are instructed to execute the decoding instructions and simultaneously provide a playing control function, decoded signals are output in two paths, one path outputs video signals to a display card, the display card completes conversion driving of image information, the decoded video image information is output to a display and controls the display to display correctly, and finally the display displays images; the other path outputs audio signals to the sound card, the sound card completes the conversion drive of sound information, the decoded audio information is output to the sound box, and finally the sound box plays sound to realize the decoding playing process of the whole video program.
However, when the existing soft decompression technology is used to process video files, the decoding capability is limited, large video files with low compression ratio cannot be decoded, only small video files with high compression ratio can be decoded, and the lossy compression of signals of the small video files with high compression ratio forms a series of problems, such as: the problems of poor visual effect, poor definition, color distortion, brightness distortion, limited display image size and the like caused by the frequency of standard frames and poor image resolution cannot be achieved. The soft decompression technology meets the purpose of quickly acquiring information content by a user at the cost of sacrificing image display quality, and cannot meet the requirements of the user on more and more video content and higher quality.
Disclosure of Invention
It is therefore an objective of the present invention to provide a video processing system and method to improve video quality.
To achieve the above object, an embodiment of the present invention provides a video processing system, including: a program memory, a hardware decoding circuit and a computer;
the program memory is used for storing a video processing program;
the computer is used for enabling the hardware decoding circuit to decode a video file acquired from the computer by executing the video processing program;
and the hardware decoding circuit is used for decoding the video file and outputting a decoded audio/video signal.
Optionally, the program memory includes: the system comprises a system general control module, a driving program module, an interactive interface module, a click search module, a film source processing module, a communication protocol module, a network protocol module, a format protocol module, a decompression module and a decoding service module;
the computer is used for calling other software modules of the program memory through the system general control module to complete the following functions:
displaying an interactive interface on a display of the computer by using the interactive interface module, and acquiring a video click instruction triggered by a user on the interactive interface;
searching a video file corresponding to the video clicking instruction locally or on the network by using the clicking search module, and gating a program source channel corresponding to the video file by using the film source processing module;
if the video file is a local file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module, and enabling the video file to be converted according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path; if the video file is a network file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module and the network protocol module, and converting the video file according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path;
decompressing, by the decompression module, the video file acquired through the data transmission path;
and installing a video decoding driver for the hardware decoding circuit by using the driver module, so that the computer and the hardware decoding circuit can communicate by using the video decoding driver, and so that the hardware decoding circuit can decode the video file acquired from the computer by using the decoding service module after the communication is possible.
Optionally, the hardware decoding circuit includes: CPU, host interface logic circuit, auxiliary image decoder, OSD decoder, digital signal processor, data flow decoder, video decoder, audio decoder, video output interface, audio output interface in the hardware decoding circuit;
the CPU in the hardware decoding circuit is used for executing the video decoding service program stored in the decoding service module, so that other hardware modules in the hardware decoding circuit can complete the following functions by executing the video decoding service program:
the host interface logic circuit is used for acquiring the video file from the computer through the data transmission path; if the signal type of the video file is an analog signal, transmitting the video file to the digital signal processor;
the digital signal processor is used for carrying out analog-to-digital conversion on the video file;
the host interface logic circuit is used for transmitting video data about subtitles in a digital video file to a secondary image decoder, transmitting data about images and sound in the digital video file to the data stream decoder, and transmitting video data about a tuning interface in the digital video file to an OSD decoder;
the sub-picture decoder is used for decoding the video data about the subtitles;
the OSD decoder is used for decoding the video data about the tuning interface;
the data stream decoder is used for transmitting video data about images in a digital video file to the video decoder and transmitting audio data about sound in the digital video file to the audio decoder;
the video decoder is used for decoding the video data about the image;
the audio decoder for decoding the audio data regarding sound corresponding to the image data while the video decoder decodes the image data;
the video output interface is used for outputting decoded video data;
and the audio output interface is used for outputting the decoded audio data.
Optionally, the system also comprises a video converter and an audio converter;
the video converter is used for converting the digital signal output by the video output interface into an analog signal;
and the audio converter is used for converting the digital signal output by the audio output interface into an analog signal.
Optionally, the video decoder includes a sub-image decoder and a main image decoder;
the sub-image decoder is used for decoding the image data except the main image data in the digital video file;
the main image decoder is used for decoding the main image data in the digital video file.
Optionally, the audio decoder includes an AV audio decoder, an AC-3 audio decoder, a DTS audio decoder, and an MPEG-X audio decoder;
the AV audio decoder is used for decoding audio data of an AV coding mode;
the AC-3 audio decoder is used for decoding the audio data in the AC-3 coding mode;
the DTS audio decoder is used for decoding the audio data in the DTS coding mode;
the MPEG-X audio decoder is used for decoding the audio data of the MPEG or AVC standard coding mode.
Optionally, the video output interface or the video converter is connected to an image display device, the audio output interface or the audio converter is connected to a sound output device, and the program memory further includes a play control module;
and the CPU in the hardware decoding circuit is also used for calling the playing control module through the system master control module when a user triggers a playing control instruction, and controlling the display mode of the video played in the image display equipment and the sound output mode of the sound output equipment.
Optionally, the program memory and the hardware decoding circuit are connected to the computer through buses respectively.
The embodiment of the invention also provides a video processing method, which is applied to a video processing system, wherein the system comprises a program memory for storing a video processing program, a hardware decoding circuit and a computer; the method comprises the following steps:
the computer causes the hardware decoding circuit to decode a video file acquired from the computer by executing the video processing program.
Optionally, the program memory includes: the system comprises a system general control module, a driving program module, an interactive interface module, a click search module, a film source processing module, a communication protocol module, a network protocol module, a format protocol module, a decompression module and a decoding service module;
the computer causes the hardware decoding circuit to decode the video file acquired from the computer by executing the video processing program, and the method includes:
the computer calls other software modules of the program memory through the system general control module to complete the following functions:
displaying an interactive interface on a display of the computer by using the interactive interface module, and acquiring a video click instruction triggered by a user on the interactive interface;
searching a video file corresponding to the video clicking instruction locally or on the network by using the clicking search module, and gating a program source channel corresponding to the video file by using the film source processing module;
if the video file is a local file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module, and enabling the video file to be converted according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path; if the video file is a network file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module and the network protocol module, and converting the video file according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path;
decompressing, by the decompression module, the video file acquired through the data transmission path;
and installing a video decoding driver for the hardware decoding circuit by using the driver module, so that the computer and the hardware decoding circuit can communicate by using the video decoding driver, and so that the hardware decoding circuit can decode the video file acquired from the computer by using the decoding service module after the communication is possible.
Optionally, the hardware decoding circuit includes: CPU, host interface logic circuit, auxiliary image decoder, OSD decoder, digital signal processor, data flow decoder, video decoder, audio decoder, video output interface, audio output interface in the hardware decoding circuit; the hardware decoding circuit decodes the video file acquired from the computer by using the decoding service module, and comprises:
the CPU in the hardware decoding circuit executes the video decoding service program stored in the decoding service module to make other hardware modules in the hardware decoding circuit complete the following functions:
the host interface logic circuit acquires the video file from the computer through the data transmission path; if the signal type of the video file is an analog signal, transmitting the video file to the digital signal processor;
the digital signal processor performs analog-to-digital conversion on the video file;
the host interface logic circuit transmits video data about subtitles in the digital video file to a sub-image decoder, transmits data about images and sound in the digital video file to the data stream decoder, and transmits video data about a tuning interface in the digital video file to an OSD decoder;
the sub picture decoder decodes the video data on the subtitles;
the OSD decoder decodes the video data about the tuning interface;
the data stream decoder transmits video data about images in a digital video file to the video decoder, and transmits audio data about sounds in the digital video file to the audio decoder;
the video decoder decodes the video data regarding the image;
the audio decoder decodes the audio data regarding sound corresponding to the image data while the video decoder decodes the image data;
the video output interface outputs decoded video data;
the audio output interface outputs the decoded audio data.
Optionally, the system further comprises a video converter and an audio converter; the method further comprises the following steps:
the video converter converts the digital signal output by the video output interface into an analog signal;
the audio converter converts the digital signal output by the audio output interface into an analog signal.
Optionally, the video decoder includes a sub-image decoder and a main image decoder; the video decoder decoding the video data regarding the image, including:
the sub-image decoder decodes image data in the digital video file except for the main image data;
the main picture decoder decodes main picture data in a digital video file.
Optionally, the audio decoder includes an AV audio decoder, an AC-3 audio decoder, a DTS audio decoder, and an MPEG-X audio decoder; the audio decoder decoding the audio data regarding sound corresponding to the image data, including:
the AV audio decoder decodes audio data of an AV encoding mode;
the AC-3 audio decoder decodes the audio data in the AC-3 coding mode;
the DTS audio decoder decodes the audio data in the DTS coding mode;
the MPEG-X audio decoder decodes audio data in an MPEG or AVC standard encoding mode.
Optionally, the video output interface or the video converter is connected to an image display device, the audio output interface or the audio converter is connected to a sound output device, and the program memory further includes a play control module; the method further comprises the following steps:
when a user triggers a play control instruction, the CPU in the hardware decoding circuit calls the play control module through the system master control module to control the display mode of a video played in the image display equipment and control the sound output mode of the sound output equipment.
The video processing system and method provided by the embodiment of the invention enable the computer to execute the video processing program stored in the program memory, and enable the hardware decoding circuit to decode the video file acquired from the computer. Therefore, in the embodiment of the invention, the hardware decoding circuit is controlled by the video processing program to perform hard decoding on the video file, and the hardware decoding circuit has standard frame frequency and image analysis force, so that the problems of poor visual effect, poor definition, color distortion, brightness distortion, limited display image size and the like caused by the fact that the standard frame frequency and the poor image analysis force cannot be achieved when the video file is decoded by the existing soft decompression technology can be solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of a prior art video processing system;
FIG. 2 is a block diagram of a video processing system according to an embodiment of the present invention;
FIG. 3 is a second block diagram of a video processing system according to another embodiment of the present invention;
fig. 4 is a flowchart illustrating a video processing method according to an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The video processing system and the video processing method provided by the embodiment of the invention are used for carrying out hard decoding video processing on video files provided by a computer, and mainly control a hardware decoding circuit to carry out hard decoding on the video files by a video processing program. Because the hardware decoding circuit has standard frame frequency and image resolving power, the problems of poor visual effect, low definition, color distortion, brightness distortion, limited size of displayed images and the like caused by the fact that the standard frame frequency and the image resolving power cannot be achieved when the existing soft decompression technology is used for decoding the video file can be solved. In addition, the hardware decoding circuit also comprises a sub-image decoding circuit which can realize the decoding of the auxiliary image; the hardware decoding circuit also comprises a D/A digital-to-analog conversion output port, so that the digital/analog output modes of two signals of a video file are realized; the hardware decoding circuit also comprises a video/audio mixed decoding circuit, and the problem of sound image asynchronism is solved. Therefore, the embodiment of the invention performs hardware decoding processing on various video files, and can meet the requirements of more and more video contents and higher quality of users.
The following specifically describes embodiments of the present invention.
Referring to fig. 2, a schematic diagram of a video processing system according to an embodiment of the present invention is shown. The system comprises: a program memory 1, a hardware decoding circuit 2 and a computer 3.
The program memory 1 is used for storing a video processing program.
The computer 3 is configured to cause the hardware decoding circuit 2 to decode a video file acquired from the computer 3 by executing the video processing program.
And the hardware decoding circuit 2 is used for decoding the video file and outputting a decoded audio/video signal.
The video processing system in the embodiment of the invention consists of a program memory 1 and a hardware decoding circuit 2 which contain video processing programs, wherein the program memory 1 and the hardware decoding circuit 2 are respectively connected with a computer 3 through buses, and the program memory 1 and the hardware decoding circuit 2 are independent hardware which can be respectively installed on a computer mainboard.
The respective constituent modules and functions of the program memory 1, the hardware decoding circuit 2, and the computer 3 will be specifically described below.
Referring to fig. 3, a second composition diagram of a video processing system according to an embodiment of the invention is shown.
The program memory 1 is used to store a video processing program comprising the following program modules: the system comprises a system general control module 101, a driver module 102, an interactive interface module 103, a click search module 104, a film source processing module 105, a communication protocol module 106, a network protocol module 107, a format protocol module 108, a decompression module 109, a decoding service module 110 and a play control module 111.
The hardware decoding circuit 2 includes: the hardware decoding circuit includes a CPU201, a ROM202, a SDRAM203, a host interface logic 204, a sub-picture decoder 205, an OSD (on-screen display) decoder 206, a digital signal processor 208, a DRAM209, a data stream decoder 210, a video decoder 211, an audio decoder 212, a video output interface 207, and an audio output interface 213.
The computer 3 includes: display 301, display card 302, memory 303, CPU304 in the computer. The computer 3 stores therein a video file 305.
The operation principle of each functional module is described in detail below.
The computer 3 executes the video processing program stored in the program storage 1 by using the CPU304 and the memory 305 in the computer, and specifically, calls other software modules of the program storage 1 through the system general control module 101 to complete the following functions:
1. and displaying an interactive interface on the display 301 of the computer 3 by using the interactive interface module 103, and acquiring a video click instruction triggered by a user on the interactive interface.
The computer 3 calls and executes the subprogram in the interactive interface module 103 through the main program in the system main control module 101, and then an interactive interface can be displayed on the display 301 through the display card 302, and the user can select the video to be played on the interactive interface by using a mouse or finger to click, and the video click instruction is triggered.
2. The video file 305 corresponding to the video clicking instruction is searched locally or on the network by using the clicking search module 104, and the program source channel corresponding to the video file 305 is gated by using the film source processing module 105.
After obtaining the video click command, the computer 3 calls and executes the subprogram in the click search module 104 through the main program of the system general control module 101, and searches the video file 305 selected by the user locally in the computer 3, or searches the video file 305 from the network when there is no video file 305 locally, and then calls and executes the subprogram in the film source processing module 105 through the main program of the system general control module 101 to gate the program source channel (i.e. the storage location of the video file 305) of the searched video file 305.
3. If the video file 305 is a local file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module 106, and enabling the video file 305 to be converted according to a preset format by using the format protocol module 108, so that the video file after format conversion is transmitted in the data transmission path; if the video file 305 is a network file, a data transmission path corresponding to the program source channel is established by using the communication protocol module 106 and the network protocol module 107, and the format protocol module 108 is used to enable the video file 305 to be converted according to a preset format, so that the format-converted video file is transmitted in the data transmission path.
The communication protocol module 106 specifies a transmission mode of the video file 305, the network protocol module 107 specifies a network interaction mode of the video file 305, and the format protocol module 108 specifies a decoding format of the video file 305 by the hardware decoding circuit 2.
After the program source channel is selected, a data transmission path of the video file needs to be established so as to retrieve the video file 305 through the data transmission path. In specific implementation, the computer 3 calls and executes the subprograms in the communication protocol module 106, the network protocol module 107 and the format protocol module 108 through the main program of the system general control module 101.
4. The video file 305 acquired through the data transmission path is decompressed by the decompression module 109.
When the computer calls the video file 305 through the data transmission path, the computer calls and executes the subprogram in the decompression module 109 through the main program of the system main control module 101, so as to decompress the video file 305.
5. Before decoding the decompressed video file 305 by using the hardware decoding circuit 2, a video decoding driver needs to be installed for the hardware decoding circuit 2 by using the driver module 102, so that the computer 3 and the hardware decoding circuit 2 can communicate by using the video decoding driver, and so that the hardware decoding circuit decodes the video file acquired from the computer by using the decoding service module after communication is possible.
It should be noted that, it is only necessary to install the video decoding driver for the hardware decoding circuit 2 before the hardware decoding circuit 2 is used for the first time, and when the decoding circuit 2 is used for decoding later, it is not necessary to install the video decoding driver for the hardware decoding circuit 2 any more, and the video decoding driver installed for the first time is directly used.
The hardware decoding circuit 2 performs a decoding operation on the video file 305 in the following manner.
The CPU201 in the hardware decoding circuit is configured to execute the video decoding service program stored in the decoding service module 109 under cooperation of the ROM202 and the SDRAM203, so that other hardware modules in the hardware decoding circuit can perform the following functions by executing the video decoding service program:
the host interface logic 204 is configured to obtain the video file 305 from the computer 3 (via a bus interface) through the established data transmission path. And when the signal type of the video file 305 is an analog signal, transmitting the video file 305 to the digital signal processor 208; when the signal type of the video file 305 is a digital signal, the video file 305 does not need to be transferred to the digital signal processor 208, and the video file 305 is a digital video file (video data of a digital signal type).
The digital signal processor 208 is configured to perform analog-to-digital conversion on the video file 305 in cooperation with the DRAM209 to obtain a digital video file (video data of a digital signal type); the digital video file is then transferred to the host interface logic 204.
And the host interface logic 204 is configured to transmit video data about subtitles in the digital video file to the sub-picture decoder 205, and when the hardware decoding circuit 2 includes the OSD decoder 206, transmit video data about a tuning interface (e.g., a functional interface for controlling the size of video sound) in the digital video file to the OSD decoder 206.
The sub picture decoder 205 is configured to decode the video data regarding subtitles acquired from the host interface logic 204.
The OSD decoder is configured to decode the video data about the tuning interface acquired from the host interface logic 204.
The data stream decoder 210 transmits video data regarding images in a digital video file to the video decoder 211 and transmits audio data regarding sounds in a digital video file to the audio decoder 212.
And the video decoder 211 decodes the video data regarding the image, which is acquired from the data stream decoder 210.
Wherein the video decoder 211 includes a sub-image decoder and a main image decoder;
the sub-image decoder is configured to decode image data in the digital video file except for the main image data, for example, decode image data corresponding to an advertisement inserted in a video, a picture-in-picture, and the like.
The main image decoder is used for decoding the data of the main image (namely the image of the video) in the digital video file. The main image decoder may include, but is not limited to, decoding a main image in an encoding system such as MPEG-X, h.26x, and the like.
Anda the audio decoder 212, configured to decode the audio data regarding the sound, which is acquired from the data stream decoder 210 and corresponds to the image data, while the video decoder 211 decodes the image data.
Among them, the audio decoder 212 includes but is not limited to: an AV audio decoder, an AC-3 audio decoder, a DTS audio decoder, and an MPEG-X audio decoder.
The AV audio decoder is used for decoding audio data in an AV coding mode, and can realize the output of high-fidelity two-channel stereo.
The AC-3 audio decoder is used for decoding the audio data in the AC-3 coding mode, and the AC-3 audio decoder can realize the output of 5.1-channel surround sound.
The DTS audio decoder is used for decoding the audio data in the DTS coding mode, and the DTS audio decoder can realize the output of 7.1-channel surround sound.
The MPEG-X audio decoder is used for decoding the audio data of the MPEG/AVC standard coding mode. The MPEG-X audio decoder may include, but is not limited to, decoding sound data in an encoding system such as MPEG1, MPEG2, MPEG4, and the like.
It should be noted that the video decoder 211 and the audio decoder 212 decode image data and sound data simultaneously for the purpose of lip-sync.
Ninthly, the video output interface 207 is used for outputting the decoded video data (including the video data output by the sub-picture decoder 205, the OSD decoder 206 and the video decoder 211).
And audio output interface 213 for outputting decoded audio data (including audio data output by audio decoder 212).
Further, the embodiment of the present invention further includes a video converter 214 and an audio converter 215 (see fig. 2).
The video converter 214 is configured to convert the digital signal output by the video output interface 207 into an analog signal. In this way, since the present invention supports an output manner of two image signals, when an image display apparatus supporting a digital signal is employed, a digital image signal can be output to the image display apparatus through the video output interface 207; when an image display apparatus supporting an analog signal is employed, the analog image signal may be output to the image display apparatus through the video converter 214.
The audio converter 215 is configured to convert the digital signal output by the audio output interface 213 into an analog signal. In this way, since the present invention supports the output manner of two sound signals, when a sound output apparatus supporting a digital signal is employed, the digital audio signal can be output to the sound output apparatus through the audio output interface 213; when a sound output device supporting an analog signal is employed, an analog audio signal may be output to the sound output device through the audio converter 215.
Further, when the video output interface 207 or the video converter 214 is connected to an image display device, the audio output interface 213 or the audio converter 215 is connected to a sound output device; the CPU201 in the hardware decoding circuit is further configured to, when a user triggers a play control instruction (a remote controller is used to remotely control an image display device to trigger a pause instruction, a fast forward instruction, a remote controller is used to remotely control a sound output device to trigger an increase instruction or a decrease instruction, or a pause instruction, a fast forward instruction, an increase instruction or a decrease instruction, or the like is directly triggered on a video interaction interface), invoke the play control module 111 through the system general control module 101, and control a display mode of a video played in the image display device and a sound output mode of the sound output device.
Therefore, the embodiment of the invention realizes the hard decoding video processing, and the video decoding is carried out by controlling the hardware decoding circuit, so that the user can obtain smooth and clear images and beautiful image quality effects in the process of clicking and playing the video program on the computer terminal product. In addition, the embodiment of the invention also realizes the arbitrary selection of digital and analog video signals, so that a user can freely select to adopt a display or a television as a display terminal, thereby enriching the use requirements of the user; the embodiment of the invention provides a hardware basis for processing various video program sources.
Referring to fig. 4, a schematic flow chart of a video processing method according to an embodiment of the present invention is further provided, where the method is applied to the video processing system, and the system includes a program memory storing a video processing program, a hardware decoding circuit, and a computer; the method comprises the following steps:
s401: the computer causes the hardware decoding circuit to decode a video file acquired from the computer by executing the video processing program.
In an embodiment of the invention, the program memory comprises: the system comprises a system general control module, a driving program module, an interactive interface module, a click search module, a film source processing module, a communication protocol module, a network protocol module, a format protocol module, a decompression module and a decoding service module; step S401 is implemented as follows:
the computer calls other software modules of the program memory through the system general control module to complete the following functions:
displaying an interactive interface on a display of the computer by using the interactive interface module, and acquiring a video click instruction triggered by a user on the interactive interface;
searching a video file corresponding to the video clicking instruction locally or on the network by using the clicking search module, and gating a program source channel corresponding to the video file by using the film source processing module;
if the video file is a local file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module, and enabling the video file to be converted according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path; if the video file is a network file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module and the network protocol module, and converting the video file according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path;
decompressing, by the decompression module, the video file acquired through the data transmission path;
installing a video decoding driver for the hardware decoding circuit by using the driver module, so that the computer and the hardware decoding circuit can communicate by using the video decoding driver, and the hardware decoding circuit can decode the video file acquired from the computer by using the decoding service module after the communication is possible.
In an embodiment of the present invention, the hardware decoding circuit includes: CPU, host interface logic circuit, auxiliary image decoder, OSD decoder, digital signal processor, data flow decoder, video decoder, audio decoder, video output interface, audio output interface in the hardware decoding circuit; the using the decoding service module to make the hardware decoding circuit decode the video file acquired from the computer comprises:
the CPU in the hardware decoding circuit executes the video decoding program stored in the decoding service module to make other hardware modules in the hardware decoding circuit complete the following functions:
the host interface logic circuit acquires the video file from the computer through the data transmission path; if the signal type of the video file is an analog signal, transmitting the video file to the digital signal processor;
the digital signal processor performs analog-to-digital conversion on the video file;
the host interface logic circuit transmits video data about subtitles in the digital video file to a secondary image decoder, transmits video data about a human-computer interaction interface in the digital video file to an OSD decoder, and transmits data about images and sound in the digital video file to the data stream decoder;
the sub picture decoder decodes the video data on the subtitles;
the OSD decoder decodes the video data about the tuning interface; the data stream decoder transmits video data about images in a digital video file to the video decoder, and transmits audio data about sounds in the digital video file to the audio decoder;
the video decoder decodes the video data regarding the image;
the audio decoder decodes the audio data regarding sound corresponding to the image data while the video decoder decodes the image data;
the video output interface outputs decoded video data;
the audio output interface outputs the decoded audio data.
In an embodiment of the invention, the system further comprises a video converter and an audio converter; the method further comprises the following steps:
the video converter converts the digital signal output by the video output interface into an analog signal;
the audio converter converts the digital signal output by the audio output interface into an analog signal.
In an embodiment of the present invention, the video decoder includes a sub-image decoder and a main image decoder; the video decoder decoding the video data regarding the image, including:
the sub-image decoder decodes image data in the digital video file except for the main image data;
the main picture decoder decodes main picture data in a digital video file.
In the embodiment of the present invention, the audio decoder includes an AV audio decoder, an AC-3 audio decoder, a DTS audio decoder, and an MPEG-X audio decoder; the audio decoder decoding the audio data regarding sound corresponding to the image data, including:
the AV audio decoder decodes audio data of an AV encoding mode;
the AC-3 audio decoder decodes the audio data in the AC-3 coding mode;
the DTS audio decoder decodes the audio data in the DTS coding mode;
the MPEG-X audio decoder decodes audio data in an MPEG or AVC standard encoding mode.
In the embodiment of the present invention, the video output interface or the video converter is connected to an image display device, the audio output interface or the audio converter is connected to a sound output device, and the program memory further includes a play control module; the method further comprises the following steps:
when a user triggers a playing control instruction through an interactive interface, the computer calls the playing control module through the system master control module to control the display mode of a playing video in the image display equipment and control the sound output mode of the sound output equipment.
The video processing system and method provided by the embodiment of the invention enable the computer to execute the video processing program stored in the program memory, and enable the hardware decoding circuit to decode the video file acquired from the computer. Therefore, in the embodiment of the invention, the hardware decoding circuit is controlled by the video processing program to perform hard decoding on the video file, and the hardware decoding circuit has standard frame frequency and image analysis force, so that the problems of poor visual effect, poor definition, color distortion, brightness distortion, limited display image size and the like caused by the fact that the standard frame frequency and the poor image analysis force cannot be achieved when the video file is decoded by the existing soft decompression technology can be solved.
As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that all or part of the steps in the above embodiment methods can be implemented by software plus a necessary general hardware platform. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network communication device such as a media gateway, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present invention.
It should be noted that, for the method disclosed in the embodiment, since it corresponds to the system disclosed in the embodiment, the description is relatively simple, and the relevant points can be referred to the description of the system part.
It should also be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (15)
1. A video processing system, comprising: a program memory, a hardware decoding circuit and a computer;
the program memory is used for storing video processing programs and is independent hardware connected with the computer through a bus;
the computer is used for utilizing a CPU and a memory in the computer to execute the video processing program so as to enable the hardware decoding circuit to decode the video file acquired from the computer;
the hardware decoding circuit is used for decoding the video file and outputting a decoded audio/video signal;
the hardware decoding circuit includes: CPU, host interface logic circuit, digital signal processor in the said hardware decoding circuit;
the CPU in the hardware decoding circuit is used for executing the video decoding service program stored in the decoding service module included in the program memory, so that other hardware modules in the hardware decoding circuit can complete the following functions by executing the video decoding service program:
the host interface logic circuit is used for acquiring the video file from the computer through a data transmission path; if the signal type of the video file is an analog signal, transmitting the video file to the digital signal processor;
the digital signal processor is used for carrying out analog-to-digital conversion on the video file;
the host interface logic circuit is used for transmitting video data about subtitles in the digital video file to the auxiliary image decoder, transmitting data about images and sound in the digital video file to the data stream decoder, and transmitting video data about the tuning interface in the digital video file to the OSD decoder.
2. The system of claim 1, wherein the program memory comprises: the system comprises a system general control module, a driving program module, an interactive interface module, a click search module, a film source processing module, a communication protocol module, a network protocol module, a format protocol module, a decompression module and a decoding service module;
the computer is used for calling other software modules of the program memory through the system general control module to complete the following functions:
displaying an interactive interface on a display of the computer by using the interactive interface module, and acquiring a video click instruction triggered by a user on the interactive interface;
searching a video file corresponding to the video clicking instruction locally or on the network by using the clicking search module, and gating a program source channel corresponding to the video file by using the film source processing module;
if the video file is a local file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module, and enabling the video file to be converted according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path; if the video file is a network file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module and the network protocol module, and converting the video file according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path;
decompressing, by the decompression module, the video file acquired through the data transmission path;
and installing a video decoding driver for the hardware decoding circuit by using the driver module, so that the computer and the hardware decoding circuit can communicate by using the video decoding driver, and so that the hardware decoding circuit can decode the video file acquired from the computer by using the decoding service module after the communication is possible.
3. The system of claim 2, wherein the hardware decoding circuit further comprises: the system comprises a sub-image decoder, an OSD decoder, a digital signal processor, a data stream decoder, a video decoder, an audio decoder, a video output interface and an audio output interface;
the CPU in the hardware decoding circuit is further configured to execute a video decoding service program stored in the decoding service module, so that by executing the video decoding service program, other hardware modules in the hardware decoding circuit perform the following functions:
the sub-picture decoder is used for decoding the video data about the subtitles;
the OSD decoder is used for decoding the video data about the tuning interface;
the data stream decoder is used for transmitting video data about images in a digital video file to the video decoder and transmitting audio data about sound in the digital video file to the audio decoder;
the video decoder is used for decoding the video data about the image;
the audio decoder for decoding the audio data regarding sound corresponding to the image data while the video decoder decodes the image data;
the video output interface is used for outputting decoded video data;
and the audio output interface is used for outputting the decoded audio data.
4. The system of claim 3, further comprising a video converter and an audio converter;
the video converter is used for converting the digital signal output by the video output interface into an analog signal;
and the audio converter is used for converting the digital signal output by the audio output interface into an analog signal.
5. The system of claim 3, wherein the video decoder comprises a sub-picture decoder and a main picture decoder;
the sub-image decoder is used for decoding the image data except the main image data in the digital video file;
the main image decoder is used for decoding the main image data in the digital video file.
6. The system of claim 3, wherein the audio decoder comprises an AV audio decoder, an AC-3 audio decoder, a DTS audio decoder, and an MPEG-X audio decoder;
the AV audio decoder is used for decoding audio data of an AV coding mode;
the AC-3 audio decoder is used for decoding the audio data in the AC-3 coding mode;
the DTS audio decoder is used for decoding the audio data in the DTS coding mode;
the MPEG-X audio decoder is used for decoding the audio data of the MPEG or AVC standard coding mode.
7. The system of claim 3, wherein the video output interface or video converter is connected to an image display device, the audio output interface or audio converter is connected to a sound output device, and the program memory further comprises a playback control module;
and the CPU in the hardware decoding circuit is also used for calling the playing control module through the system master control module when a user triggers a playing control instruction, and controlling the display mode of the video played in the image display equipment and the sound output mode of the sound output equipment.
8. The system according to any one of claims 1 to 6, wherein the program memory and the hardware decoding circuit are connected to the computer through a bus, respectively.
9. A video processing method is applied to a video processing system, the system comprises a program memory for storing a video processing program, a hardware decoding circuit and a computer, wherein the hardware decoding circuit is independent hardware connected with the computer through a bus and comprises a CPU (Central processing Unit) in the hardware decoding circuit and a host interface logic circuit; the method comprises the following steps:
the computer utilizes a CPU and a memory in the computer to execute the video processing program to enable the hardware decoding circuit to decode the video file acquired from the computer;
the hardware decoding circuit decodes the video file acquired from the computer by using a decoding service module, and comprises:
the CPU in the hardware decoding circuit executes the video decoding service program stored in the decoding service module to make other hardware modules in the hardware decoding circuit complete the following functions:
the host interface logic circuit acquires the video file from the computer through a data transmission path; if the signal type of the video file is an analog signal, transmitting the video file to a digital signal processor;
the digital signal processor performs analog-to-digital conversion on the video file;
the host interface logic transmits video data regarding subtitles in the digital video file to the sub-picture decoder, transmits data regarding pictures and sounds in the digital video file to the data stream decoder, and transmits video data regarding the tuning interface in the digital video file to the OSD decoder.
10. The method of claim 9, wherein the program memory comprises: the system comprises a system general control module, a driving program module, an interactive interface module, a click search module, a film source processing module, a communication protocol module, a network protocol module, a format protocol module, a decompression module and a decoding service module;
the computer causes the hardware decoding circuit to decode the video file acquired from the computer by executing the video processing program, and the method includes:
the computer calls other software modules of the program memory through the system general control module to complete the following functions:
displaying an interactive interface on a display of the computer by using the interactive interface module, and acquiring a video click instruction triggered by a user on the interactive interface;
searching a video file corresponding to the video clicking instruction locally or on the network by using the clicking search module, and gating a program source channel corresponding to the video file by using the film source processing module;
if the video file is a local file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module, and enabling the video file to be converted according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path; if the video file is a network file, establishing a data transmission path corresponding to the program source channel by using the communication protocol module and the network protocol module, and converting the video file according to a preset format by using the format protocol module so that the video file after format conversion is transmitted in the data transmission path;
decompressing, by the decompression module, the video file acquired through the data transmission path;
and installing a video decoding driver for the hardware decoding circuit by using the driver module, so that the computer and the hardware decoding circuit can communicate by using the video decoding driver, and so that the hardware decoding circuit can decode the video file acquired from the computer by using the decoding service module after the communication is possible.
11. The method of claim 10, wherein the hardware decoding circuit further comprises: the system comprises a sub-image decoder, an OSD decoder, a digital signal processor, a data stream decoder, a video decoder, an audio decoder, a video output interface and an audio output interface; the method further comprises the following steps:
the CPU in the hardware decoding circuit executes the video decoding service program stored in the decoding service module to make other hardware modules in the hardware decoding circuit also complete the following functions:
the sub picture decoder decodes the video data on the subtitles;
the OSD decoder decodes the video data about the tuning interface;
the data stream decoder transmits video data about images in a digital video file to the video decoder, and transmits audio data about sounds in the digital video file to the audio decoder;
the video decoder decodes the video data regarding the image;
the audio decoder decodes the audio data regarding sound corresponding to the image data while the video decoder decodes the image data;
the video output interface outputs decoded video data;
the audio output interface outputs the decoded audio data.
12. The method of claim 11, wherein the system further comprises a video converter and an audio converter; the method further comprises the following steps:
the video converter converts the digital signal output by the video output interface into an analog signal;
the audio converter converts the digital signal output by the audio output interface into an analog signal.
13. The method according to claim 11, wherein the video decoder comprises a sub-picture decoder and a main picture decoder; the video decoder decoding the video data regarding the image, including:
the sub-image decoder decodes image data in the digital video file except for the main image data;
the main picture decoder decodes main picture data in a digital video file.
14. The method of claim 11, wherein the audio decoder comprises an AV audio decoder, an AC-3 audio decoder, a DTS audio decoder, and an MPEG-X audio decoder; the audio decoder decoding the audio data regarding sound corresponding to the image data, including:
the AV audio decoder decodes audio data of an AV encoding mode;
the AC-3 audio decoder decodes the audio data in the AC-3 coding mode;
the DTS audio decoder decodes the audio data in the DTS coding mode;
the MPEG-X audio decoder decodes audio data in an MPEG or AVC standard encoding mode.
15. The method of claim 10, wherein a video output interface or a video converter is connected to the image display device and an audio output interface or an audio converter is connected to the sound output device, the program memory further comprising a playback control module; the method further comprises the following steps:
when a user triggers a play control instruction, the CPU in the hardware decoding circuit calls the play control module through the system master control module to control the display mode of a video played in the image display equipment and control the sound output mode of the sound output equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510707886.8A CN105323635B (en) | 2015-10-27 | 2015-10-27 | Video processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510707886.8A CN105323635B (en) | 2015-10-27 | 2015-10-27 | Video processing system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105323635A CN105323635A (en) | 2016-02-10 |
| CN105323635B true CN105323635B (en) | 2020-09-25 |
Family
ID=55250093
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510707886.8A Active CN105323635B (en) | 2015-10-27 | 2015-10-27 | Video processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105323635B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6553180B1 (en) * | 1998-01-21 | 2003-04-22 | Kabushiki Kaisha Toshiba | Digital information recording/playback system and digital information recording medium |
| CN1447596A (en) * | 2002-03-20 | 2003-10-08 | Lg电子株式会社 | Multitext displaying for CD play |
| CN1588985A (en) * | 2004-07-30 | 2005-03-02 | 联合信源数字音视频技术（北京）有限公司 | Digital video-audio decoder |
| CN102609048A (en) * | 2012-03-11 | 2012-07-25 | 赵立峰 | Computer and method for playing audio and video files on demand |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101076100B (en) * | 2006-05-19 | 2011-03-23 | 北京华旗资讯数码科技有限公司 | Method and apparatus for transmitting decoded data fluid to display device |
-
2015
- 2015-10-27 CN CN201510707886.8A patent/CN105323635B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6553180B1 (en) * | 1998-01-21 | 2003-04-22 | Kabushiki Kaisha Toshiba | Digital information recording/playback system and digital information recording medium |
| CN1447596A (en) * | 2002-03-20 | 2003-10-08 | Lg电子株式会社 | Multitext displaying for CD play |
| CN1588985A (en) * | 2004-07-30 | 2005-03-02 | 联合信源数字音视频技术（北京）有限公司 | Digital video-audio decoder |
| CN102609048A (en) * | 2012-03-11 | 2012-07-25 | 赵立峰 | Computer and method for playing audio and video files on demand |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105323635A (en) | 2016-02-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7836193B2 (en) | Method and apparatus for providing graphical overlays in a multimedia system | |
| KR102212270B1 (en) | Methods, systems, and media for presenting media content using integrated content sources | |
| US11288033B2 (en) | Method for outputting audio data of applications and display device | |
| WO2021109354A1 (en) | Media stream data playback method and device | |
| CN114073098B (en) | Streaming media synchronization method and display device | |
| CN112153406A (en) | Live broadcast data generation method, display equipment and server | |
| CN112188279A (en) | Channel switching method and display equipment | |
| KR20180093702A (en) | Electronic apparatus for playing substitutional advertisement and method for controlling method thereof | |
| CN111601142B (en) | Subtitle display method and display equipment | |
| CN111601144B (en) | Streaming media file playing method and display equipment | |
| CN109547839A (en) | The dynamic previewing processing method and processing device of live content, medium, electronic equipment | |
| CN103635938B (en) | For processing the method for video streaming data, streaming client in streaming client | |
| CN105323635B (en) | Video processing system and method | |
| KR20110025367A (en) | Method and device for multimedia transcoding client | |
| CN111343498B (en) | Mute control method and device and smart television | |
| US20120106918A1 (en) | Interface device and data processing method | |
| WO2021004046A1 (en) | Audio processing method and apparatus, and display device | |
| CN111629250A (en) | Display device and video playing method | |
| JP4755717B2 (en) | Broadcast receiving terminal device | |
| CN111885415A (en) | Audio data rapid output method and display device | |
| JP2000236490A (en) | Mpeg decoder for caption display and decoding method | |
| CN114173157B (en) | Video stream transmission method and device, electronic equipment and storage medium | |
| JP2005184499A (en) | System, apparatus, and method for receiving data broadcasting | |
| CN201821444U (en) | High definition network player | |
| KR20160072895A (en) | Open platform appartus for providing real-time contents, providing system, providing method, program and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200720 Address after: 223, room two, 205, Zhuhai Road, Wendeng Economic Development Zone, Shandong, Weihai 264400, China Applicant after: Weihai Yuancheng Information Technology Co.,Ltd. Address before: 223, room two, 205, Zhuhai Road, Wendeng Economic Development Zone, Shandong, Weihai 264000, China Applicant before: Zhao Lifeng |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |