WO2017177802A1 - Audio/video playback method and apparatus, and computer storage medium - Google Patents

Audio/video playback method and apparatus, and computer storage medium Download PDF

Info

Publication number
WO2017177802A1
WO2017177802A1 PCT/CN2017/077581 CN2017077581W WO2017177802A1 WO 2017177802 A1 WO2017177802 A1 WO 2017177802A1 CN 2017077581 W CN2017077581 W CN 2017077581W WO 2017177802 A1 WO2017177802 A1 WO 2017177802A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
audio
external device
decoded
terminal
Prior art date
Application number
PCT/CN2017/077581
Other languages
French (fr)
Chinese (zh)
Inventor
刘建松
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017177802A1 publication Critical patent/WO2017177802A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
    • G06F13/4282—Bus transfer protocol, e.g. handshake; Synchronisation on a serial bus, e.g. I2C bus, SPI bus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream decryption
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F2213/0042—Universal serial bus [USB]

Definitions

  • the present invention relates to the field of multimedia technologies, and in particular, to an audio and video playing method, apparatus, and computer storage medium.
  • video terminals are more and more widely used, such as video conferencing terminals.
  • Today's video conferencing terminals include mobile terminal, tablet, personal computer (PC, Personal Computer) and other commonly used terminal devices, due to the hardware of the terminal device.
  • the device is fixed, and the decoding capability of the corresponding video conferencing terminal for audio and video is also fixed.
  • the decoding capability indicates whether the video can be reproduced from the video file. If the user uses the video conference terminal for audio and video playback, the audio and video distortion is large, indicating that the video conference terminal has poor decoding capability. If you want to upgrade the decoding capability of the video conference terminal, you need to use the video conference.
  • the hardware device of the terminal is replaced with a hardware device with stronger decoding capability. Obviously, the audio and video playback mode consumes a large amount of cost.
  • the embodiments of the present invention are directed to an audio and video playing method, apparatus, and computer storage medium, which are intended to solve the technical problem of costly decoding of audio and video by existing video conferencing terminals.
  • an audio and video playing method is provided in the embodiment of the present invention.
  • the video terminal is connected to an external device through a preset interface, and the audio and video playing method includes:
  • the video terminal sends the to-be-decoded audio and video file to the external device through the preset interface, when the audio and video file to be decoded is sent by another video terminal, for the
  • the external device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data through the preset interface, where the decoding capability of the external device is higher than the decoding of the hardware device installed by the video terminal ability;
  • the audio and video corresponding to the audio and video data is played according to the decoded audio and video data.
  • the video terminal is connected to the external device through a Universal Serial Bus (USB) interface or a network card interface.
  • USB Universal Serial Bus
  • the audio and video playing method further includes:
  • the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal;
  • the video terminal is configured to decode the to-be-decoded terminal through the preset interface. The step of transmitting the audio and video file to the external device;
  • the video terminal disconnects from the external device and outputs alarm information.
  • the audio and video playing method further includes: when receiving the audio and video file to be decoded sent by another video terminal;
  • the video terminal sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode and feedback the audio/video file to be decoded. Decoded audio and video data.
  • the audio and video playing method further includes:
  • the video terminal displays prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and the external device Parameter information corresponding to the decoding capability of the device.
  • the embodiment of the present invention further provides an audio and video playback device, where the audio and video playback device is connected to an external device through a preset interface, where the audio and video playback device includes:
  • a sending module configured to send the to-be-decoded audio and video file to the external device by using the preset interface, when the audio and video file to be decoded sent by another video terminal is received, for the external device to The audio and video file to be decoded is decoded, and the decoded audio and video data is fed back through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal;
  • the playing module is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device.
  • the audio and video playback device is connected to the external device through a USB interface or a network card interface.
  • the audio and video playback device further includes:
  • the comparison module is configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal during the connection between the audio and video playback device and the external device;
  • the sending module is further configured to: when the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the preset interface is used. Transmitting the decoded audio and video file to the external device;
  • the processing module is configured to disconnect the external device when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, and output alarm information.
  • the sending module is further configured to: when the audio and video file to be decoded includes multiple audio and video files, send the to-be-decoded video file to the external device and the installed hardware device, And the external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data.
  • the audio and video playback device further includes:
  • a display module configured to display prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device Parameter information.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the audio and video playback method according to the embodiment of the invention.
  • the audio and video playing method and device and the computer storage medium provided by the embodiment of the present invention, when the video terminal is connected to the external device, send the audio and video file to be decoded to the external device through a preset interface, where The decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, so that the external device decodes the audio and video file to be decoded and feeds back the decoded sound through the preset interface.
  • Video data when the decoded audio and video data fed back by the external device is received, playing the audio and video corresponding to the audio and video data according to the decoded audio and video data, so that when the decoding capability of the video terminal is low,
  • the audio and video files are decoded by an external device with a decoding capability higher than that of the video terminal, without replacing the hardware device, thereby reducing the cost of the video terminal for audio and video playback.
  • FIG. 1 is a schematic flow chart of a first embodiment of an audio and video playing method according to the present invention
  • FIG. 2 is a schematic structural view of an external device according to the present invention.
  • FIG. 3 is a schematic structural diagram of interaction between a video terminal and an external device according to the present invention.
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of an audio and video playback device of the present invention.
  • FIG. 1 is a schematic flowchart diagram of a first embodiment of an audio and video playing method according to the present invention.
  • the video terminal is connected to the external device through a preset interface, and the audio and video playing method includes:
  • Step S10 The video terminal sends the to-be-decoded audio and video file to the external device through the preset interface, when the audio and video file to be decoded is sent by another video terminal, for the external device.
  • the device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal.
  • the video terminal is connected to the external device through the preset interface
  • the manner in which the video terminal is connected to the external device through the preset interface includes:
  • the video terminal is connected to the external device through a USB interface. It can be understood that the video terminal is connected to the external device through the USB interface, and does not require an additional connection interface or cable, and is convenient to use. It can be plug and play, users do not need to perform any additional complicated operations, and the convenience is high;
  • the video terminal is communicably connected to the external device through a network card interface, and when the video terminal communicates with the external device through a network card interface, the video terminal can communicate through a wired communication connection manner or a wireless communication connection manner.
  • the wireless communication connection method is, for example, a Wi-Fi (Wireless-Fidelity) communication connection method, which improves the flexibility of the communication connection.
  • the external device is a multimedia codec enhancement device.
  • the external device is specifically represented by a hardware box, and the internal hardware of the box includes: a main processor chip, which is responsible for the external device. Control logic, as well as controlling the interaction of other chips and video terminals;
  • the audio processing chip is responsible for audio processing on the external device, and is mainly responsible for encoding and decoding the audio data, and interacting with the video terminal through the main processor chip;
  • the video processing chip is responsible for video processing on the external device, and is mainly responsible for The video data is encoded and decoded, and interacts with the video processor through the main processor chip;
  • the program memory chip includes two parts of a flash memory (Flash, Flash EEPROM Memory) and a memory, wherein an example of the memory can be Is a double rate synchronous dynamic random access memory (DDR, Dual Data Rate);
  • a program memory chip is a program data storage and operation chip of the external device;
  • a USB interface chip provides the USB interface capability of the external device; It
  • the external device in this embodiment adopts an integrated hardware design, and the professional multimedia processing chip and the USB universal interface or the network card interface are integrally designed into a portable hardware box, which is convenient to carry, that is, Plug and play, easy to use and so on.
  • the video terminal collects real-time images, voices, and related data information of a certain conference point, compresses and encodes, and multiplexes (that is, one channel simultaneously transmits multiple signals) and then passes through the transmission channel.
  • a terminal that is sent to another video terminal and can receive images, voice, and data information sent by other video terminals to be decomposed and decoded, and restored to the image, voice, and data of the other site, that is, the video terminal in the embodiment represents a video.
  • Conference terminal The conference video terminal includes a software video conference terminal and a hardware video conference terminal.
  • the software video conference terminal is a software video conference system that can be run on a universal terminal device, and can provide all functions of the video conference terminal;
  • the hardware video conferencing terminal is a device specially designed for video conferencing hardware devices, which adopts a professional multimedia processing chip for hardware design and can provide video conferencing functions.
  • the structure of the video terminal and the external device can be referred to FIG. 3.
  • the video terminal in this embodiment may include a video capture module, an audio capture module, and an audio editor. a decoding module, a video codec module, and a display module, that is, the video terminal can not only send the audio and video files to be decoded to the external device.
  • the device performs decoding, and may also collect audio and video data, and transmit the collected audio and video data to the external device for encoding by the external device.
  • the specific operation manner is detailed in the fourth embodiment.
  • the built-in software system is started, and then the connection state of the USB interface or the network card interface is detected, if the connection is currently connected.
  • the video terminal when receiving the to-be-decoded audio and video file sent by the other video terminal, sends the to-be-decoded audio and video file to the external device through the preset interface.
  • the external device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data through the preset interface.
  • the external device passes through a preset video processing chip and an audio processing chip.
  • the audio and video files are decoded, and the decoded audio and video data is fed back to the video terminal through the preset interface.
  • Step S20 When receiving the decoded audio and video data fed back by the external device, playing the audio and video corresponding to the audio and video data according to the decoded audio and video data.
  • the audio and video corresponding to the audio and video data may be played according to the decoded audio and video data.
  • the external device can be unplugged after the video communication is completed. At this time, the video communication process between the video terminal and the external device ends.
  • the audio and video file to be decoded is sent to the external device through a preset interface, wherein the decoding capability of the external device
  • the decoding capability of the hardware device installed by the video terminal is higher, so that the external device decodes the to-be-decoded audio and video file and feeds back through the preset interface.
  • the decoded audio and video data when the decoded audio and video data fed back by the external device is received, plays the audio and video corresponding to the audio and video data according to the decoded audio and video data, thereby realizing the decoding capability of the video terminal.
  • the audio and video files are decoded by an external device whose decoding capability is higher than the decoding capability of the video terminal, without replacing the hardware device, thereby reducing the cost of audio and video playback by the video terminal.
  • the second embodiment of the audio and video playback method of the present invention is proposed based on the first embodiment.
  • the audio and video playback method further includes:
  • the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal;
  • the video terminal is configured to decode the to-be-decoded terminal through the preset interface. The step of transmitting the audio and video file to the external device;
  • the video terminal disconnects from the external device and outputs alarm information.
  • the video terminal first identifies the decoding capability of the external device, and it can be understood that the decoding capability indicates whether the video file can be obtained from the video file.
  • the ability to reproduce the original appearance of the video, and the decoding capability is related to the parameter information such as the code rate. The higher the code rate, the stronger the decoding capability. Therefore, during the connection between the video terminal and the external device, the The video terminal first identifies the code rate in the external device, and specifically identifies the parameter information outputted in the interaction protocol, that is, the video terminal transmits the parameter information of the protocol with the external device through an interaction protocol, The decoding capability of the external device is determined from the transmitted protocol.
  • the comparison manner is to compare the code rate of the external device with the code rate of the installed hardware device to determine the magnitude relationship between the decoding capability of the external device and the installed hardware device.
  • the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, if the audio and video file to be decoded sent by another video terminal is received, the video terminal will decode the audio and video file to be decoded. And sending, by the preset interface, the external device to the external device to decode the to-be-decoded audio and video file and feed back the decoded audio and video data through the preset interface.
  • the decoding capability of the external device When the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the external device does not meet the decoding requirement of the audio and video file. At this time, the video terminal is disconnected from the external device.
  • the connection relationship of the device, and output alarm information such as output: "no external device connected” or “connected has been disconnected” and other text information, or output a preset duration such as 5 seconds (S) whistle, or By flashing a light emitting diode (LED) light preset by the video terminal.
  • connection relationship and the output of the alarm information prevent the decoding capability of the connected external device and the decoding of the video terminal are still low, and the decoding operation is still performed, thereby improving the intelligence of video decoding.
  • the connection relationship between the video terminal and the external device is not disconnected, and the video terminal passes through the installed location.
  • the hardware device decodes the to-be-decoded audio and video file to obtain the decoded audio and video data, and plays the audio and video corresponding to the audio and video data according to the decoded audio and video data.
  • the video terminal with strong decoding capability is preferentially used for decoding, thereby improving the flexibility of audio and video decoding, of course, At this time, the connection between the video terminal and the external device is not disconnected.
  • the relationship is that when the audio/video file to be decoded includes a plurality of audio and video files, the external device can share the decoding operation, which reduces the processing pressure of the video terminal.
  • the audio and video files to be decoded include multiple audio and video files.
  • the audio and video playing method further includes:
  • the video terminal sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode and feedback the audio/video file to be decoded. Decoded audio and video data.
  • the audio and video file to be decoded includes a plurality of audio and video files, that is, the audio and video files to be decoded sent by the plurality of video terminals are received at this time, or multiple received by the same video terminal are sequentially sent.
  • a video file, in which the video terminal sends each of the to-be-decoded video files to the external device and the installed hardware device, and the specific sending manner may be:
  • the device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data;
  • the one-time polling sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode the to-be-decoded audio and video file. And feeding back the decoded audio and video data;
  • the video files to be decoded are stored in the sending queue, and the audio and video files to be decoded are sequentially sent from the sending queue to the currently idle device, and the audio and video to be decoded are extracted from the sending queue when the other device is idle.
  • the file is sent to the currently idle device.
  • the current external device is decoding the previous audio and video file to be decoded, and the hardware device of the video terminal is in an idle state.
  • the audio and video to be decoded are received again, File, then it will be The received audio and video file to be decoded is sent to a hardware device of the video terminal for decoding.
  • a preset allocation policy may also be obtained, where the allocation policy is set according to a specific situation, including the foregoing three sending manners, and further includes: a. determining a waiting to be included in the waiting queue of the device. Decoding the number of audio and video files, and transmitting the to-be-decoded audio and video received again to a queue with a small number of two waiting queues; b, determining the priority in the waiting queue of the device, and receiving the received again The audio and video files to be decoded are sent to the queues with high priority in the two waiting queues. The greater the occupancy rate of the processors in the device, the lower the priority, that is, the received audio and video files to be decoded are sent. To devices with low processor occupancy.
  • each of the to-be-decoded video files may be separately sent to the external device and the installed hardware device to provide a solution.
  • the external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data, and finally the video terminal plays the audio and video corresponding to the audio and video data according to the decoded audio and video data. .
  • the audio and video file to be decoded includes a plurality of audio and video files
  • the video file to be decoded is sent to the external device and the installed hardware device, instead of all the audio and video files to be decoded.
  • Decoding intelligence when the audio and video file to be decoded includes a plurality of audio and video files, the video file to be decoded is sent to the external device and the installed hardware device, instead of all the audio and video files to be decoded.
  • the audio and video playing method further includes:
  • the video terminal displays prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device Parameter information, where the parameter information is the code rate corresponding to the decoding capability, such as a value corresponding to the code rate displayed in a preset display area. Further, the parameter information may further include a resolution, and similarly, the value corresponding to the resolution is displayed in a preset display area. It should be noted that the video terminal displays the external device connected thereto in a preset display area. The information may be displayed during the connection between the video terminal and the external device, or after the connection is successful, the audio and video file to be decoded is sent to the external device, and the external device is received. The device performs feedback during the process of decoding the decoded audio and video data.
  • the embodiment of the present invention provides a novel use scenario of a video terminal, that is, when the hardware capability of the terminal is limited, the video conference can be quickly upgraded without replacing the hardware device.
  • a way of multimedia codec capability of terminal hardware which has the advantages of convenient use, ease of use, cost saving, etc.
  • a fourth embodiment of the audio and video playback method of the present invention is proposed based on the first, second, and third embodiments.
  • the communication of the video terminal is The method also includes;
  • the video terminal collects the audio and video data to be encoded, and sends the audio and video data to be encoded to the external device through the preset interface, so that the external device encodes the audio and video data to be encoded and
  • the encoded audio and video file is fed back through the preset interface, where the coding capability of the external device is higher than the coding capability of the hardware device installed by the video terminal;
  • the encoded audio and video file fed back by the external device When the encoded audio and video file fed back by the external device is received, the encoded audio and video file is sent to other video terminals.
  • the video conference terminal encodes the to-be-coded audio and video data by using the hardware device. To obtain the encoded audio and video files, and send the encoded audio and video files to other video terminals.
  • the video terminal separately sends the audio and video data to be encoded to the external device and the installed hardware device for The external device and the hardware device encode the audio and video data and feed back the encoded audio and video data.
  • the hardware described in the external device can also be implemented by software, and the external device can even directly include an audio and video acquisition chip, etc., that is, not only the audio and video data sent by the video terminal is encoded, but also the audio and video data can be collected by the acquisition chip. Directly encode audio and video data.
  • the embodiment of the invention provides a method for directly upgrading the decoding capability of a video terminal, which can conveniently upgrade the hardware capability of the user's existing video terminal, save the user the cost of replacing the new equipment, and the present invention provides
  • the external device uses a universal USB interface and a video conferencing terminal for connection, which is convenient and quick to use, especially for the use of a general terminal device such as a mobile phone, a tablet, a PC, etc., and a software video conference, due to the hardware of the general terminal device.
  • the capability is weaker than that of the professional video conferencing terminal. Therefore, the present invention can quickly improve the multimedia codec capability of the user software video conference.
  • the embodiment of the invention further provides an audio and video playback device.
  • FIG. 4 is a schematic diagram of functional modules of the first embodiment of the audio and video playback apparatus of the present invention.
  • the functional module diagram shown in FIG. 4 is merely an exemplary diagram of a preferred embodiment, and those skilled in the art will surround the functional modules of the audio and video playback apparatus shown in FIG.
  • the new functional modules can be easily supplemented; the names of the functional modules are custom names, which are only used to assist in understanding the various program functional blocks of the audio and video playback device, and are not used to limit the technical solution of the present invention.
  • the core is the function that each functional module of the defined name has to achieve.
  • the present embodiment provides an audio and video playback device, where the audio and video playback device is connected to an external device through a preset interface, and the audio and video playback device includes:
  • the sending module 10 is configured to send the to-be-decoded audio and video file to the external device through the preset interface, when the audio and video file to be decoded sent by another video terminal is received, for the external device Decoding the audio and video file to be decoded and feeding back the decoded audio and video data through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal;
  • the playing module 20 is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device.
  • the audio and video playback device is connected to the external device through a preset interface
  • the manner in which the audio and video playback device is connected to the external device through a preset interface includes:
  • the audio and video playback device is connected to the external device through a USB interface; it can be understood that the audio and video playback device is connected to an external device through the USB interface, and does not require an additional connection interface or cable. Easy to use, it can be plug and play, users do not need to perform any additional complicated operations, and the convenience is high;
  • the audio and video playback device is communicably connected to the external device through a network card interface, and the audio and video playback device can communicate with the external device through a network card interface, and can be connected by wired communication or wirelessly.
  • the connection mode is a communication connection; the wireless communication connection mode is, for example, a Wi-Fi communication connection mode, which improves the flexibility of the communication connection.
  • the external device is a multimedia codec enhancement device.
  • the external device is specifically represented by a hardware box, and the internal hardware of the box includes: a main processor chip, which is responsible for the external device. Control logic, and control the interaction between other chips and video terminals; audio processing chip, responsible for audio processing on external devices, mainly responsible for encoding and decoding audio data, and interacting with the video terminal through the main processor chip; video processing The chip is responsible for video processing on the external device, and is mainly responsible for encoding and decoding the video data, and interacting with the video terminal through the main processor chip; the program storage chip includes two parts of the flash and the memory as a memory chip, wherein An example of the memory may be DDR; the program memory chip is a chip for storing and running program data of the external device; the USB interface chip provides the USB interface capability of the external device; and the network card chip may be added Extending the external interface of the external device to support the wireless or wired network Video terminal communication connection.
  • a main processor chip which is responsible for the external
  • the external device in this embodiment adopts an integrated hardware design, and integrates a professional multimedia processing chip and a USB universal interface or a network card interface into a portable hardware box. Provided by the style, it is easy to carry, plug and play, easy to use and so on.
  • the audio and video playback device is the video terminal, and the video terminal collects, compresses, and multiplexes real-time images, voices, and related data information of a certain conference point (ie, A channel simultaneously transmits multiple signals) and then transmitted to other video terminals through a transmission channel, and can receive images, voice and data information transmitted by other video terminals to be decomposed and decoded, and restored to the terminals of the image, voice and data of the other site.
  • the video terminal in this embodiment represents a video conference terminal.
  • the video conference terminal includes a software video conference terminal and a hardware video conference terminal.
  • the software video conference terminal is a software video conference system that can run on a universal terminal device, and can provide all functions of the video conference terminal;
  • the hardware video conferencing terminal is a device specially designed for video conferencing hardware devices, which adopts a professional multimedia processing chip for hardware design and can provide video conferencing functions.
  • the structure of the video terminal and the external device can be referred to FIG. 3.
  • the video terminal in this embodiment may include a video capture module, an audio capture module, and an audio editor.
  • the decoding module, the video codec module and the display module that is, the video terminal can not only send the audio and video files to be decoded to an external device for decoding, but also collect audio and video data, and the collected audio and video. Data is transmitted to the external device for encoding by the external device.
  • the built-in software system is started, and then the connection state of the USB interface or the network card interface is detected, if the connection is currently connected.
  • the sending module 10 sends the to-be-decoded audio and video file to the outside through the preset interface when receiving the to-be-decoded audio and video file sent by another video terminal.
  • the device is configured to decode the audio and video file to be decoded by the external device, and feed back the decoded audio and video data through the preset interface.
  • the external device passes the preset video processing chip.
  • the audio processing chip decodes the audio and video file, and feeds the decoded audio and video data to the video terminal through the preset interface.
  • the playing module 20 can play the audio and video corresponding to the audio and video data according to the decoded audio and video data. It can be understood that the external device can be unplugged after the video communication is completed. At this time, the video communication process between the video terminal and the external device ends.
  • the audio and video file to be decoded is sent to the external device through a preset interface, wherein the decoding capability of the external device
  • the decoding capability of the hardware device installed by the video terminal is higher than that, the external device decodes the audio and video file to be decoded, and feeds back the decoded audio and video data through the preset interface, and receives the received audio and video data.
  • the decoded audio and video data fed back by the external device is used, the audio and video corresponding to the audio and video data is played according to the decoded audio and video data, so that when the decoding capability of the video terminal is low, the decoding capability is higher than the video terminal.
  • the decoding device's external device decodes the audio and video files without replacing the hardware device, thereby reducing the cost of the video terminal for audio and video playback.
  • the audio and video playback device includes:
  • the comparison module is configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal during the connection between the audio and video playback device and the external device;
  • the sending module 10 is further configured to: when the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, Transmitting the to-be-decoded audio and video file to the external device by using the preset interface;
  • the processing module is configured to disconnect the external device when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, and output alarm information.
  • the decoding capability of the external device is first identified. It can be understood that the decoding capability indicates whether the video can be reproduced from the video file. The ability of the original appearance, and the decoding capability is related to the parameter information such as the code rate. The higher the code rate, the stronger the decoding capability. Therefore, in the process of connecting the video terminal and the external device, the external device is first identified.
  • the code rate in the device may be specifically identified by the parameter information outputted in the interaction protocol, that is, the video terminal transmits the parameter information of the protocol with the external device through an interaction protocol, to determine the protocol from the transmission protocol.
  • the decoding capability of the external device may be specifically identified by the parameter information outputted in the interaction protocol, that is, the video terminal transmits the parameter information of the protocol with the external device through an interaction protocol, to determine the protocol from the transmission protocol.
  • the comparison module compares the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal, and the specific comparison method is The code rate of the external device is compared with the code rate of the installed hardware device to determine the size relationship of the decoding capability of the external device and the installed hardware device.
  • the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, if the audio and video files to be decoded sent by other video terminals are received, the sending module 10 will decode the audio and video to be decoded.
  • the video playback device further includes a decoding module, configured to not disconnect the video terminal and the external device when a decoding capability of the external device is lower than or equal to a decoding capability of the installed hardware device a connection relationship, the decoding module decodes the to-be-decoded audio and video file by using the installed hardware device to obtain decoded audio and video data, and the playing module 20 plays the decoded audio and video data according to the decoded audio and video data.
  • the audio and video corresponding to the audio and video data.
  • the video terminal with strong decoding capability is preferentially used for decoding, thereby improving the flexibility of audio and video decoding, of course,
  • the connection relationship between the video terminal and the external device is not disconnected, and when the audio and video file to be decoded includes multiple audio and video files, the external device can share the decoding operation and reduce the video terminal. Processing pressure.
  • the audio and video files to be decoded include multiple audio and video files.
  • the audio and video playback device includes:
  • the sending module 10 is further configured to: when the audio and video file to be decoded includes a plurality of audio and video files, send the to-be-decoded video file to the external device and the installed hardware device for the external The device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data.
  • the audio and video file to be decoded includes a plurality of audio and video files, that is, the audio and video files to be decoded sent by the plurality of video terminals are received at this time, or multiple received by the same video terminal are sequentially sent.
  • a video file in this case, the sending module 10 sends the respective to-be-decoded video files to the external device and the installed hardware device, and the specific sending manner may be:
  • the device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data;
  • the one-time polling sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode the to-be-decoded audio and video file. And feeding back the decoded audio and video data;
  • the video files to be decoded are stored in the sending queue, and the audio and video files to be decoded are sequentially sent from the sending queue to the currently idle device, and the audio and video to be decoded are extracted from the sending queue when the other device is idle.
  • the file is sent to the currently idle device.
  • the current external device is decoding the previous audio and video file to be decoded, and the hardware device of the video terminal is in an idle state.
  • the audio and video to be decoded are received again,
  • the file, the received audio and video file to be decoded is sent to the hardware device of the video terminal for decoding.
  • the audio and video playback device may further include an obtaining module configured to acquire a preset allocation policy, where the allocation policy is set according to a specific situation, including the foregoing three sending manners, and further includes : a, determining the number of audio and video files to be decoded included in the waiting queue of the device, and transmitting the to-be-decoded audio and video received again to a queue with a small number of two waiting queues; b, determining the waiting of the device The priority of the queue, and the received audio and video files to be decoded are sent to the queues with the highest priority in the two waiting queues.
  • an obtaining module configured to acquire a preset allocation policy, where the allocation policy is set according to a specific situation, including the foregoing three sending manners, and further includes : a, determining the number of audio and video files to be decoded included in the waiting queue of the device, and transmitting the to-be-decoded audio and video received again to a queue with a small number of two waiting queues
  • each video file to be decoded can be separately Sending to the external device and the installed hardware device, for the external device and the hardware device to solve the to-be-decoded audio and video file And decoding the decoded audio and video data, and finally the video terminal plays the audio and video corresponding to the audio and video data according to the decoded audio and video data.
  • the audio and video file to be decoded includes a plurality of audio and video files
  • the video file to be decoded is sent to the external device and the installed hardware device, instead of all the audio and video files to be decoded.
  • Decoding intelligence when the audio and video file to be decoded includes a plurality of audio and video files, the video file to be decoded is sent to the external device and the installed hardware device, instead of all the audio and video files to be decoded.
  • the audio and video playback device further includes:
  • a display module configured to display prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device
  • the parameter information that is, the decoding capability corresponding code rate, such as the value corresponding to the code rate displayed in the preset display area.
  • the parameter information may further include a resolution, and similarly, the value corresponding to the resolution is displayed in a preset display area.
  • the display module displays the prompt information of the external device connected to the display device in a preset display area, and may be displayed during the connection between the video terminal and the external device, or may be After the connection is successful, the audio and video file to be decoded is sent to the external device, and the decoded audio and video data fed back by the external device is received for display.
  • the embodiment of the present invention provides a novel use scenario of a video terminal, that is, in a case where the hardware capability of the terminal is limited, and the hardware device does not need to be replaced, the device is rapidly upgraded.
  • a method of multimedia codec capability of video conference terminal hardware which has the advantages of convenient use, ease of use, cost saving, etc.
  • a fourth embodiment of the audio and video playback apparatus of the present invention is proposed based on the first, second, and third embodiments.
  • the communication of the video terminal is performed.
  • the device also includes;
  • the sending module 10 is further configured to collect audio and video data to be encoded, and send the audio and video data to be encoded to the external device through the preset interface, so that the external device can
  • the video data is encoded and the encoded audio and video text is fed back through the preset interface
  • the encoding capability of the external device is higher than the encoding capability of the hardware device installed by the video terminal;
  • the sending module 10 is further configured to send the encoded audio and video file to other video terminals when receiving the encoded audio and video files fed back by the external device.
  • the processing module is further configured to: when the coding capability of the external device is lower than or equal to the coding capability of the installed hardware device, the audio and video to be encoded by the hardware device The data is encoded to obtain an encoded audio and video file, and the encoded audio and video files are sent to other video terminals.
  • the sending module 10 is further configured to: when the to-be-encoded audio and video data includes multiple audio and video data, send each to-be-coded audio and video data to the external device and the installed hardware.
  • the audio and video data is encoded by the external device and the hardware device, and the encoded audio and video data is fed back.
  • the hardware chips described in the external device may also be implemented by software, and the external device may even directly include an audio and video acquisition chip, and the like. That is, not only the audio and video data sent by the video terminal is encoded, but also the audio and video data can be collected by the acquisition chip to directly encode the audio and video data.
  • the playing module 20, the comparing module, the processing module, the decoding module, and the obtaining module in the audio and video playing device can be used by the central processing unit (CPU, Central Processing) in the terminal in practical applications. Unit), digital signal processor (DSP), Microcontroller Unit (MCU) or Field-Programmable Gate Array (FPGA); transmitting module in the audio and video playback device 10, in practical applications, can be realized by a communication module (including: basic communication suite, operating system, communication module, standardized interface and protocol, etc.) and a transceiver antenna; the display module in the audio and video playback device is in practical application Can be achieved through the display or display.
  • CPU central processing unit
  • DSP digital signal processor
  • MCU Microcontroller Unit
  • FPGA Field-Programmable Gate Array
  • the embodiment of the invention provides a capability for directly upgrading the decoding capability of a video terminal.
  • the device can conveniently upgrade the hardware capability of the user's existing video terminal, saves the user the cost of replacing the new equipment, and the external device provided by the present invention uses a universal USB interface and a video conference terminal for connection, which is convenient and convenient to use.
  • a universal terminal device such as a mobile phone, a tablet, a PC, etc.
  • the present invention can be quickly Improve the multimedia codec capability of user software video conferencing.
  • the disclosed method and apparatus may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the modules is only a logical function division.
  • there may be another division manner for example, multiple modules or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed.
  • the communication connections between the various components shown or discussed may be indirect coupling or communication connections through some interfaces, devices or modules, and may be electrical, mechanical or otherwise.
  • the modules described above as separate components may or may not be physically separated.
  • the components displayed as modules may or may not be physical modules, that is, may be located in one place or distributed to multiple network modules; Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional module in each embodiment of the present invention may be integrated into one processing module.
  • each module may be separately used as one module, or two or more modules may be integrated into one module; the integrated module may be implemented in the form of hardware or a hardware plus software function module. Formal realization.
  • the foregoing program may be stored in a computer readable storage medium, and when executed, the program includes The foregoing steps of the method embodiment; and the foregoing storage medium includes: a removable storage device, a read-only memory (ROM), a magnetic disk or an optical disk, and the like, which can store program codes.
  • ROM read-only memory
  • the above-described integrated module of the embodiment of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a stand-alone product.
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a magnetic disk, or an optical disk.
  • the technical solution of the embodiment of the present invention passes through the case where the video terminal is connected to the external device.
  • the preset interface sends the to-be-decoded audio and video file to the external device, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, for the external device to Decoding the audio and video file for decoding, and feeding back the decoded audio and video data through the preset interface, and when receiving the decoded audio and video data fed back by the external device, playing the decoded audio and video data according to the decoded audio and video data
  • the audio and video corresponding to the audio and video data realizes that when the decoding capability of the video terminal is low, the audio and video files are decoded by an external device whose decoding capability is higher than the decoding capability of the video terminal, without replacing the hardware device, thereby reducing the The cost of audio and video playback by video terminals.

Abstract

Disclosed in embodiments of the present invention is an audio/video playback method. The method comprises: a video terminal sends, when receiving an audio/video file to be decoded that is sent from another video terminal, the audio/video file to be decoded to an external device by using a preset interface, the video terminal being connected to the external device by using the preset interface, so that the external device decodes the audio/video file to be decoded and feeds back, by using the preset interface, audio/video data obtained by means of decoding, wherein a decoding capacity of the external device is higher than a decoding capacity of a hardware device installed on the video terminal; and playing audio/video corresponding to the audio/video data according to the audio/video data obtained by means of decoding, when receiving the audio/video data that is obtained by means of decoding and fed back by the external device. Also disclosed in the embodiments of the present invention are an audio/video playback apparatus and a computer storage medium.

Description

音视频播放方法、装置及计算机存储介质Audio and video playing method, device and computer storage medium 技术领域Technical field
本发明涉及多媒体技术领域，尤其涉及一种音视频播放方法、装置及计算机存储介质。The present invention relates to the field of multimedia technologies, and in particular, to an audio and video playing method, apparatus, and computer storage medium.
背景技术Background technique
随着多媒体技术的发展，视频终端的应用越来越广泛，如视频会议终端，现在的视频会议终端包括手机、平板、个人计算机(PC，Personal Computer)等常用的终端设备，由于终端设备的硬件设备是固定不变的，相应的视频会议终端对音视频的解码能力也是固定不变的，其中，解码能力表示能否从视频文件中重现视频原貌的能力。若用户在使用视频会议终端进行音视频播放时，觉得音视频的失真较大，说明该视频会议终端的解码能力较差，若想要升级该视频会议终端的解码能力，就需要将该视频会议终端的硬件设备替换成解码能力更强的硬件设备，显然，这种音视频播放方式，所消耗的成本较大。With the development of multimedia technology, video terminals are more and more widely used, such as video conferencing terminals. Today's video conferencing terminals include mobile terminal, tablet, personal computer (PC, Personal Computer) and other commonly used terminal devices, due to the hardware of the terminal device. The device is fixed, and the decoding capability of the corresponding video conferencing terminal for audio and video is also fixed. The decoding capability indicates whether the video can be reproduced from the video file. If the user uses the video conference terminal for audio and video playback, the audio and video distortion is large, indicating that the video conference terminal has poor decoding capability. If you want to upgrade the decoding capability of the video conference terminal, you need to use the video conference. The hardware device of the terminal is replaced with a hardware device with stronger decoding capability. Obviously, the audio and video playback mode consumes a large amount of cost.
发明内容Summary of the invention
本发明实施例期望提出一种音视频播放方法、装置及计算机存储介质，旨在解决现有视频会议终端对音视频的解码所消耗的成本较大的技术问题。The embodiments of the present invention are directed to an audio and video playing method, apparatus, and computer storage medium, which are intended to solve the technical problem of costly decoding of audio and video by existing video conferencing terminals.
为实现上述目的，本发明实施例提供的一种音视频播放方法，视频终端通过预设接口与外置设备连接，所述音视频播放方法包括：To achieve the above objective, an audio and video playing method is provided in the embodiment of the present invention. The video terminal is connected to an external device through a preset interface, and the audio and video playing method includes:
在接收到其它视频终端发送的待解码音视频文件时，所述视频终端通过所述预设接口将所述待解码音视频文件发送至所述外置设备，以供所述 外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力；The video terminal sends the to-be-decoded audio and video file to the external device through the preset interface, when the audio and video file to be decoded is sent by another video terminal, for the The external device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data through the preset interface, where the decoding capability of the external device is higher than the decoding of the hardware device installed by the video terminal ability;
在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频。When the decoded audio and video data fed back by the external device is received, the audio and video corresponding to the audio and video data is played according to the decoded audio and video data.
在一实施例中，所述视频终端通过通用串行总线(USB，Universal Serial Bus)接口或网卡接口与所述外置设备进行连接。In an embodiment, the video terminal is connected to the external device through a Universal Serial Bus (USB) interface or a network card interface.
在一实施例中，所述音视频播放方法还包括：In an embodiment, the audio and video playing method further includes:
在所述视频终端与所述外置设备的连接过程中，所述视频终端将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对；During the connection between the video terminal and the external device, the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal;
在所述外置设备的解码能力高于安装的硬件设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件，执行所述视频终端通过所述预设接口将所述待解码音视频文件发送至所述外置设备的步骤；If the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video file to be decoded sent by another video terminal is received, the video terminal is configured to decode the to-be-decoded terminal through the preset interface. The step of transmitting the audio and video file to the external device;
在所述外置设备的解码能力低于安装的硬件设备的解码能力时，所述视频终端断开与所述外置设备的连接，并输出告警信息。When the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the video terminal disconnects from the external device and outputs alarm information.
在一实施例中，在待解码音视频文件包括多个音视频文件时，所述在接收到其它视频终端发送的待解码音视频文件时，所述音视频播放方法还包括；In an embodiment, when the audio/video file to be decoded includes a plurality of audio and video files, the audio and video playing method further includes: when receiving the audio and video file to be decoded sent by another video terminal;
所述视频终端将待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据。The video terminal sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode and feedback the audio/video file to be decoded. Decoded audio and video data.
在一实施例中，所述音视频播放方法还包括；In an embodiment, the audio and video playing method further includes:
所述视频终端在预设的显示区域显示与其连接的所述外置设备的提示信息，其中，所述提示信息包括所述外置设备的标识信息，以及所述外置 设备的解码能力对应的参数信息。The video terminal displays prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and the external device Parameter information corresponding to the decoding capability of the device.
本发明实施例还提出一种音视频播放装置，所述音视频播放装置通过预设接口与外置设备连接，所述音视频播放装置包括：The embodiment of the present invention further provides an audio and video playback device, where the audio and video playback device is connected to an external device through a preset interface, where the audio and video playback device includes:
发送模块，配置为在接收到其它视频终端发送的待解码音视频文件时，通过所述预设接口将所述待解码音视频文件发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力；a sending module, configured to send the to-be-decoded audio and video file to the external device by using the preset interface, when the audio and video file to be decoded sent by another video terminal is received, for the external device to The audio and video file to be decoded is decoded, and the decoded audio and video data is fed back through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal;
播放模块，配置为在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频。The playing module is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device.
在一实施例中，所述音视频播放装置通过USB接口或网卡接口与所述外置设备进行连接。In an embodiment, the audio and video playback device is connected to the external device through a USB interface or a network card interface.
在一实施例中，所述音视频播放装置还包括：In an embodiment, the audio and video playback device further includes:
比对模块，配置为在所述音视频播放装置与所述外置设备的连接过程中，将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对；The comparison module is configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal during the connection between the audio and video playback device and the external device;
所述发送模块，还配置为在所述外置设备的解码能力高于安装的硬件设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件，通过所述预设接口将所述待解码音视频文件发送至所述外置设备；The sending module is further configured to: when the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the preset interface is used. Transmitting the decoded audio and video file to the external device;
处理模块，配置为在所述外置设备的解码能力低于安装的硬件设备的解码能力时，断开与所述外置设备的连接，并输出告警信息。The processing module is configured to disconnect the external device when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, and output alarm information.
在一实施例中，所述发送模块，还配置为在待解码音视频文件包括多个音视频文件时，将待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据。 In an embodiment, the sending module is further configured to: when the audio and video file to be decoded includes multiple audio and video files, send the to-be-decoded video file to the external device and the installed hardware device, And the external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data.
在一实施例中，所述音视频播放装置还包括；In an embodiment, the audio and video playback device further includes:
显示模块，配置为在预设的显示区域显示与其连接的所述外置设备的提示信息，其中，所述提示信息包括所述外置设备的标识信息，以及所述外置设备的解码能力对应的参数信息。a display module, configured to display prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device Parameter information.
本发明实施例还提供了一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行本发明实施例所述的音视频播放方法。The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the audio and video playback method according to the embodiment of the invention.
本发明实施例提供的音视频播放方法、装置及计算机存储介质，在视频终端与外置设备连接的情况下，通过预设接口将待解码音视频文件发送至所述外置设备，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频，实现了视频终端的解码能力较低时，通过解码能力高于视频终端的解码能力的外置设备进行音视频文件的解码，而不用替换硬件设备，从而降低了视频终端进行音视频播放的成本。The audio and video playing method and device and the computer storage medium provided by the embodiment of the present invention, when the video terminal is connected to the external device, send the audio and video file to be decoded to the external device through a preset interface, where The decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, so that the external device decodes the audio and video file to be decoded and feeds back the decoded sound through the preset interface. Video data, when the decoded audio and video data fed back by the external device is received, playing the audio and video corresponding to the audio and video data according to the decoded audio and video data, so that when the decoding capability of the video terminal is low, The audio and video files are decoded by an external device with a decoding capability higher than that of the video terminal, without replacing the hardware device, thereby reducing the cost of the video terminal for audio and video playback.
附图说明DRAWINGS
图1为本发明音视频播放方法第一实施例的流程示意图；1 is a schematic flow chart of a first embodiment of an audio and video playing method according to the present invention;
图2为本发明中外置设备的结构示意图；2 is a schematic structural view of an external device according to the present invention;
图3为本发明中视频终端与外置设备进行交互的结构示意图；3 is a schematic structural diagram of interaction between a video terminal and an external device according to the present invention;
图4为本发明音视频播放装置第一实施例的功能模块示意图。4 is a schematic diagram of functional modules of a first embodiment of an audio and video playback device of the present invention.
本发明实施例目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。 The implementation, functional features and advantages of the embodiments of the present invention will be further described with reference to the accompanying drawings.
具体实施方式detailed description
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
本发明实施例提供了一种音视频播放方法。参照图1，图1为本发明音视频播放方法第一实施例的流程示意图。本实施例提供的音视频播放方法，视频终端通过预设接口与外置设备连接，所述音视频播放方法包括：The embodiment of the invention provides an audio and video playing method. Referring to FIG. 1, FIG. 1 is a schematic flowchart diagram of a first embodiment of an audio and video playing method according to the present invention. In the audio and video playing method provided by the embodiment, the video terminal is connected to the external device through a preset interface, and the audio and video playing method includes:
步骤S10，在接收到其它视频终端发送的待解码音视频文件时，所述视频终端通过所述预设接口将所述待解码音视频文件发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力。Step S10: The video terminal sends the to-be-decoded audio and video file to the external device through the preset interface, when the audio and video file to be decoded is sent by another video terminal, for the external device. The device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal.
在本实施例中，所述视频终端通过预设接口先与外置设备连接，而所述视频终端通过预设接口与所述外置设备连接的方式包括：In this embodiment, the video terminal is connected to the external device through the preset interface, and the manner in which the video terminal is connected to the external device through the preset interface includes:
所述视频终端通过USB接口与所述外置设备进行连接；可以理解的是，所述视频终端通过所述USB接口与外置设备进行连接，不需要额外的连接接口或者线缆，使用方便，可以做到即插即用，用户不需要进行任何额外的复杂操作，便捷性高；The video terminal is connected to the external device through a USB interface. It can be understood that the video terminal is connected to the external device through the USB interface, and does not require an additional connection interface or cable, and is convenient to use. It can be plug and play, users do not need to perform any additional complicated operations, and the convenience is high;
或者，所述视频终端通过网卡接口与所述外置设备通信连接，而所述视频终端通过网卡接口与所述外置设备进行通信连接时，可通过有线通信连接方式或无线通信连接方式进行通信连接；所述无线通信连接方式例如是无线保真(Wi-Fi，Wireless-Fidelity)通信连接方式，提高了通信连接的灵活性。Alternatively, the video terminal is communicably connected to the external device through a network card interface, and when the video terminal communicates with the external device through a network card interface, the video terminal can communicate through a wired communication connection manner or a wireless communication connection manner. The wireless communication connection method is, for example, a Wi-Fi (Wireless-Fidelity) communication connection method, which improves the flexibility of the communication connection.
在本实施例中，所述外置设备是多媒体编解码能力增强设备，参照图2，所述外置设备具体表现为一个硬件盒子，盒子内部硬件包括：主处理器芯片，负责外置设备上的控制逻辑，以及控制其它芯片和视频终端的交互； 音频处理芯片，负责外置设备上的音频处理，主要负责对音频数据的编码和解码，并通过主处理器芯片和视频终端交互；视频处理芯片，负责外置设备上的视频处理，主要负责对视频数据的编码和解码，并通过主处理器芯片和视频终端交互；程序存储芯片，包括作为一种存储芯片的闪存(Flash，Flash EEPROM Memory)和内存两部分，其中，内存的一种示例可以是双倍速率同步动态随机存储器(DDR，Dual Data Rate)；程序存储芯片是所述外置设备的程序数据存储和运行的芯片；USB接口芯片，提供所述外置设备的USB接口能力；另外还可以加上网卡芯片，对所述外置设备进行外部接口的扩展，以支持通过无线或者有线网络和视频终端进行通信连接。可以理解的是，本实施例中的外置设备采用一体化硬件设计，将专业的多媒体处理芯片和USB通用接口或网卡接口集成设计成一个便携式的硬件盒子的方式进行提供，具有携带方便，即插即用，使用简单等特点。In this embodiment, the external device is a multimedia codec enhancement device. Referring to FIG. 2, the external device is specifically represented by a hardware box, and the internal hardware of the box includes: a main processor chip, which is responsible for the external device. Control logic, as well as controlling the interaction of other chips and video terminals; The audio processing chip is responsible for audio processing on the external device, and is mainly responsible for encoding and decoding the audio data, and interacting with the video terminal through the main processor chip; the video processing chip is responsible for video processing on the external device, and is mainly responsible for The video data is encoded and decoded, and interacts with the video processor through the main processor chip; the program memory chip includes two parts of a flash memory (Flash, Flash EEPROM Memory) and a memory, wherein an example of the memory can be Is a double rate synchronous dynamic random access memory (DDR, Dual Data Rate); a program memory chip is a program data storage and operation chip of the external device; a USB interface chip provides the USB interface capability of the external device; It is also possible to add a network card chip and extend the external interface of the external device to support a communication connection through a wireless or wired network and a video terminal. It can be understood that the external device in this embodiment adopts an integrated hardware design, and the professional multimedia processing chip and the USB universal interface or the network card interface are integrally designed into a portable hardware box, which is convenient to carry, that is, Plug and play, easy to use and so on.
在本实施例中，所述视频终端是将某一会议点的实时图像、语音和相关的数据信息进行采集，压缩编码，多路复用(即一个信道同时传输多路信号)后通过传输信道发送给其它视频终端，并可接收其它视频终端发送的图像、语音和数据信息进行分解、解码，还原成对方会场的图像、语音和数据的终端，即本实施例中的所述视频终端表示视频会议终端。所述会议视频终端包括软件视频会议终端和硬件视频会议终端两种，其中，软件视频会议终端是一种可以运行在通用终端设备上的软件视频会议系统，可以提供视频会议终端的全部功能；而硬件视频会议终端是一种专门用于视频会议的硬件设备，采用专业的多媒体处理芯片进行硬件设计，可以提供视频会议功能的一种设备。而所述视频终端与所述外置设备的结构连接图可参照图3，从图3中可以看出是，本实施例中的所述视频终端可以包括视频采集模块、音频采集模块、音频编解码模块、视频编解码模块和显示模块，也就是说，所述视频终端不仅仅可以将待解码音视频文件发送至外置 设备进行解码，还可将采集音视频数据，并将采集的音视频数据传输至所述外置设备，以供所述外置设备进行编码，具体的操作方式在第四实施例中详述。In this embodiment, the video terminal collects real-time images, voices, and related data information of a certain conference point, compresses and encodes, and multiplexes (that is, one channel simultaneously transmits multiple signals) and then passes through the transmission channel. A terminal that is sent to another video terminal and can receive images, voice, and data information sent by other video terminals to be decomposed and decoded, and restored to the image, voice, and data of the other site, that is, the video terminal in the embodiment represents a video. Conference terminal. The conference video terminal includes a software video conference terminal and a hardware video conference terminal. The software video conference terminal is a software video conference system that can be run on a universal terminal device, and can provide all functions of the video conference terminal; The hardware video conferencing terminal is a device specially designed for video conferencing hardware devices, which adopts a professional multimedia processing chip for hardware design and can provide video conferencing functions. The structure of the video terminal and the external device can be referred to FIG. 3. As can be seen from FIG. 3, the video terminal in this embodiment may include a video capture module, an audio capture module, and an audio editor. a decoding module, a video codec module, and a display module, that is, the video terminal can not only send the audio and video files to be decoded to the external device. The device performs decoding, and may also collect audio and video data, and transmit the collected audio and video data to the external device for encoding by the external device. The specific operation manner is detailed in the fourth embodiment.
在本实施例中，在外置设备所在一端中，所述外置设备与所述视频终端连接之后，先将内置的软件系统启动，然后检测USB接口或网卡接口的连接状态，如果当前已经连接则和视频终端建立软件连接，并在连接成功之后与所述视频终端进行交互协议的传输，以将其解码能力的参数信息通过交互协议传输至视频终端，并在交互成功时，进入就绪状态，等待接收音视频数据进行解码。In this embodiment, after the external device is connected to the video terminal, the built-in software system is started, and then the connection state of the USB interface or the network card interface is detected, if the connection is currently connected. Establishing a software connection with the video terminal, and performing an interactive protocol transmission with the video terminal after the connection is successful, to transmit parameter information of the decoding capability to the video terminal through an interaction protocol, and when the interaction is successful, enter a ready state, waiting Receive audio and video data for decoding.
在本实施例中，在接收到其它视频终端发送的待解码音视频文件时，所述视频终端通过所述预设接口将所述待解码音视频文件发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，具体地，所述外置设备通过预置的视频处理芯片和音频处理芯片对所述音视频文件进行解码，并将解码后的音视频数据通过所述预设接口反馈至所述视频终端。In this embodiment, when receiving the to-be-decoded audio and video file sent by the other video terminal, the video terminal sends the to-be-decoded audio and video file to the external device through the preset interface. The external device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data through the preset interface. Specifically, the external device passes through a preset video processing chip and an audio processing chip. The audio and video files are decoded, and the decoded audio and video data is fed back to the video terminal through the preset interface.
步骤S20，在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频。Step S20: When receiving the decoded audio and video data fed back by the external device, playing the audio and video corresponding to the audio and video data according to the decoded audio and video data.
在本实施例中，在接收到所述外置设备反馈的解码后的音视频数据时，即可根据解码后的音视频数据播放所述音视频数据对应的音视频。可以理解的是，在视频通信完成后可以将外置设备拔下，此时，所述视频终端与所述外置设备的视频通信过程结束。In this embodiment, when the decoded audio and video data fed back by the external device is received, the audio and video corresponding to the audio and video data may be played according to the decoded audio and video data. It can be understood that the external device can be unplugged after the video communication is completed. At this time, the video communication process between the video terminal and the external device ends.
本实施例提出的音视频播放方法，在视频终端与外置设备连接的情况下，通过预设接口将待解码音视频文件发送至所述外置设备，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈 解码后的音视频数据，在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频，实现了视频终端的解码能力较低时，通过解码能力高于视频终端的解码能力的外置设备进行音视频文件的解码，而不用替换硬件设备，从而降低了视频终端进行音视频播放的成本。In the audio and video playing method of the embodiment, when the video terminal is connected to the external device, the audio and video file to be decoded is sent to the external device through a preset interface, wherein the decoding capability of the external device The decoding capability of the hardware device installed by the video terminal is higher, so that the external device decodes the to-be-decoded audio and video file and feeds back through the preset interface. The decoded audio and video data, when the decoded audio and video data fed back by the external device is received, plays the audio and video corresponding to the audio and video data according to the decoded audio and video data, thereby realizing the decoding capability of the video terminal. At a lower time, the audio and video files are decoded by an external device whose decoding capability is higher than the decoding capability of the video terminal, without replacing the hardware device, thereby reducing the cost of audio and video playback by the video terminal.
作为另一实施方式，为了提高音视频播放的智能性，基于第一实施例提出本发明音视频播放方法的第二实施例，在本实施例，所述音视频播放方法还包括：As another embodiment, in order to improve the intelligence of the audio and video playback, the second embodiment of the audio and video playback method of the present invention is proposed based on the first embodiment. In this embodiment, the audio and video playback method further includes:
在所述视频终端与所述外置设备的连接过程中，所述视频终端将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对；During the connection between the video terminal and the external device, the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal;
在所述外置设备的解码能力高于安装的硬件设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件，执行所述视频终端通过所述预设接口将所述待解码音视频文件发送至所述外置设备的步骤；If the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video file to be decoded sent by another video terminal is received, the video terminal is configured to decode the to-be-decoded terminal through the preset interface. The step of transmitting the audio and video file to the external device;
在所述外置设备的解码能力低于安装的硬件设备的解码能力时，所述视频终端断开与所述外置设备的连接，并输出告警信息。When the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the video terminal disconnects from the external device and outputs alarm information.
在本实施例中，在所述视频终端与所述外置设备的连接过程中，所述视频终端先识别所述外置设备的解码能力，可以理解的是，解码能力表示能否从视频文件中重现视频原貌的能力，而解码能力与码率等参数信息有关，码率越高，则解码能力越强，因此，在所述视频终端与所述外置设备的连接过程中，所述视频终端先识别所述外置设备中的码率，具体可通过交互协议中输出的参数信息进行识别，即所述视频终端通过交互协议与所述外置设备进行协议的参数信息的传输，以从传输的协议中确定所述外置设备的解码能力。在确定所述外置设备的解码能力之后，将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对，具体的 比对方式是将所述外置设备的码率与安装的硬件设备的码率进行比对，以确定所述外置设备与安装的所述硬件设备的解码能力的大小关系。在所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件，所述视频终端将所述待解码音视频文件通过所述预设接口发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据。而在所述外置设备的解码能力低于安装的硬件设备的解码能力时，说明所述外置设备不符合音视频文件的解码要求，此时，所述视频终端断开与所述外置设备的连接关系，并输出告警信息，如输出：“未连接外置设备”或“连接已经断开”等文字信息，或者是输出预设时长如5秒(S)的鸣笛声，或者是通过闪烁所述视频终端预设的发光二极管(LED，Light Emitting Diode)灯。In this embodiment, during the connection between the video terminal and the external device, the video terminal first identifies the decoding capability of the external device, and it can be understood that the decoding capability indicates whether the video file can be obtained from the video file. The ability to reproduce the original appearance of the video, and the decoding capability is related to the parameter information such as the code rate. The higher the code rate, the stronger the decoding capability. Therefore, during the connection between the video terminal and the external device, the The video terminal first identifies the code rate in the external device, and specifically identifies the parameter information outputted in the interaction protocol, that is, the video terminal transmits the parameter information of the protocol with the external device through an interaction protocol, The decoding capability of the external device is determined from the transmitted protocol. After determining the decoding capability of the external device, comparing the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal, The comparison manner is to compare the code rate of the external device with the code rate of the installed hardware device to determine the magnitude relationship between the decoding capability of the external device and the installed hardware device. When the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, if the audio and video file to be decoded sent by another video terminal is received, the video terminal will decode the audio and video file to be decoded. And sending, by the preset interface, the external device to the external device to decode the to-be-decoded audio and video file and feed back the decoded audio and video data through the preset interface. When the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the external device does not meet the decoding requirement of the audio and video file. At this time, the video terminal is disconnected from the external device. The connection relationship of the device, and output alarm information, such as output: "no external device connected" or "connected has been disconnected" and other text information, or output a preset duration such as 5 seconds (S) whistle, or By flashing a light emitting diode (LED) light preset by the video terminal.
在本实施例中，通过检测外置设备的解码能力与硬件设备的解码能力，并在所述外置设备的解码能力低于安装的硬件设备的解码能力时，断开与所述外置设备的连接关系，并输出告警信息，防止了连接的外置设备的解码能力与视频终端的解码还低时，仍然进行解码操作，从而提高了视频解码的智能性。In this embodiment, by detecting the decoding capability of the external device and the decoding capability of the hardware device, and disconnecting the external device when the decoding capability of the external device is lower than the decoding capability of the installed hardware device The connection relationship and the output of the alarm information prevent the decoding capability of the connected external device and the decoding of the video terminal are still low, and the decoding operation is still performed, thereby improving the intelligence of video decoding.
当然，在所述外置设备的解码能力低于或等于安装的所述硬件设备的解码能力时，不断开所述视频终端与所述外置设备的连接关系，所述视频终端通过安装的所述硬件设备对所述待解码音视频文件进行解码，以得到解码后的音视频数据，并根据解码后的音视频数据播放所述音视频数据对应的音视频。Of course, when the decoding capability of the external device is lower than or equal to the decoding capability of the installed hardware device, the connection relationship between the video terminal and the external device is not disconnected, and the video terminal passes through the installed location. The hardware device decodes the to-be-decoded audio and video file to obtain the decoded audio and video data, and plays the audio and video corresponding to the audio and video data according to the decoded audio and video data.
也就是说，在所述外置设备的解码能力低于所述视频终端的解码能力时，此时，优先采用解码能力强的视频终端进行解码，从而提高了音视频解码的灵活性，当然，此时先不断开所述视频终端与所述外置设备的连接 关系，后续在待解码音视频文件包括多个音视频文件时，可以由所述外置设备分担解码操作，降低了视频终端的处理压力。That is to say, when the decoding capability of the external device is lower than the decoding capability of the video terminal, at this time, the video terminal with strong decoding capability is preferentially used for decoding, thereby improving the flexibility of audio and video decoding, of course, At this time, the connection between the video terminal and the external device is not disconnected. The relationship is that when the audio/video file to be decoded includes a plurality of audio and video files, the external device can share the decoding operation, which reduces the processing pressure of the video terminal.
作为另一实施方式，为了提高音视频播放的灵活性，基于第一实施例提出本发明音视频播放方法的第三实施例，在本实施例，在待解码音视频文件包括多个音视频文件时，所述音视频播放方法还包括：As another embodiment, in order to improve the flexibility of audio and video playback, a third embodiment of the audio and video playback method of the present invention is proposed based on the first embodiment. In this embodiment, the audio and video files to be decoded include multiple audio and video files. The audio and video playing method further includes:
所述视频终端将待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据。The video terminal sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode and feedback the audio/video file to be decoded. Decoded audio and video data.
在本实施例中，在待解码音视频文件包括多个音视频文件时，即此时接收到多个视频终端发送的待解码音视频文件，或者是接收到同一个视频终端依次发送的多个视频文件，此时，所述视频终端将各个待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，具体的发送方式可以是：In this embodiment, when the audio and video file to be decoded includes a plurality of audio and video files, that is, the audio and video files to be decoded sent by the plurality of video terminals are received at this time, or multiple received by the same video terminal are sequentially sent. a video file, in which the video terminal sends each of the to-be-decoded video files to the external device and the installed hardware device, and the specific sending manner may be:
将待解码音视频文件的数量分成两部分，将分别将两部分的待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据；Dividing the number of audio and video files to be decoded into two parts, respectively, sending two parts of the video files to be decoded to the external device and the installed hardware device, respectively, for the external device and the hardware The device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data;
或者，一次性轮询将各个待解码视频文件发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据；Or, the one-time polling sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode the to-be-decoded audio and video file. And feeding back the decoded audio and video data;
或者，将各个待解码视频文件存储到发送队列中，依次从发送队列中提取待解码音视频文件发送至当前空闲的设备中，并在另一个设备空闲时再从发送队列中提取待解码音视频文件发送至当前空闲的设备中，例如，当前外置设备正在对前一个待解码音视频文件进行解码，而所述视频终端的硬件设备处于空闲状态，此时，若再接收到待解码音视频文件，则将再 接收到的待解码音视频文件发送至所述视频终端的硬件设备中进行解码。Or, the video files to be decoded are stored in the sending queue, and the audio and video files to be decoded are sequentially sent from the sending queue to the currently idle device, and the audio and video to be decoded are extracted from the sending queue when the other device is idle. The file is sent to the currently idle device. For example, the current external device is decoding the previous audio and video file to be decoded, and the hardware device of the video terminal is in an idle state. At this time, if the audio and video to be decoded are received again, File, then it will be The received audio and video file to be decoded is sent to a hardware device of the video terminal for decoding.
作为一种实施方式，还可获取预设的分配策略，所述分配策略根据具体情况进行设置，包括上文所述的三种发送方式，还包括：a、确定设备的等待队列中包含的待解码音视频文件的个数，并将再次接收到的待解码音视频发送至两个等待队列中个数少的队列中；b、确定设备的等待队列中的优先级，并将再次接收到的待解码音视频文件发送至两个等待队列中优先级高的队列中，其中，设备中处理器的占用率越大，优先级相应降低，也就是说，将接收到的待解码音视频文件发送到处理器的占用率较低的设备中。而所述视频终端在获取预设的分配策略之后，按照获取的所述分配策略，即可将各个待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据，最终所述视频终端根据解码后的音视频数据播放所述音视频数据对应的音视频。As an implementation manner, a preset allocation policy may also be obtained, where the allocation policy is set according to a specific situation, including the foregoing three sending manners, and further includes: a. determining a waiting to be included in the waiting queue of the device. Decoding the number of audio and video files, and transmitting the to-be-decoded audio and video received again to a queue with a small number of two waiting queues; b, determining the priority in the waiting queue of the device, and receiving the received again The audio and video files to be decoded are sent to the queues with high priority in the two waiting queues. The greater the occupancy rate of the processors in the device, the lower the priority, that is, the received audio and video files to be decoded are sent. To devices with low processor occupancy. After the video terminal obtains the preset allocation policy, according to the obtained allocation policy, each of the to-be-decoded video files may be separately sent to the external device and the installed hardware device to provide a solution. The external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data, and finally the video terminal plays the audio and video corresponding to the audio and video data according to the decoded audio and video data. .
在本实施例中，在待解码音视频文件包括多个音视频文件时，将待解码视频文件发送至所述外置设备以及安装的所述硬件设备中，而不是将待解码音视频文件全部发送至外置设备或视频终端的硬件设备中进行解码，而是动态的调节解码的方式，降低了所述外置设备或者所述硬件设备的处理器的处理压力，还提高了音视频文件的解码智能性。In this embodiment, when the audio and video file to be decoded includes a plurality of audio and video files, the video file to be decoded is sent to the external device and the installed hardware device, instead of all the audio and video files to be decoded. Sending to the external device or the hardware device of the video terminal for decoding, but dynamically adjusting the decoding mode, reducing the processing pressure of the external device or the processor of the hardware device, and improving the audio and video files. Decoding intelligence.
作为一种实施方式，所述音视频播放方法还包括；As an implementation manner, the audio and video playing method further includes:
所述视频终端在预设的显示区域显示与其连接的所述外置设备的提示信息，其中，所述提示信息包括所述外置设备的标识信息，以及所述外置设备的解码能力对应的参数信息，所述参数信息即所述解码能力对应码率，如在预设的显示区域显示码率对应的数值。进一步地，所述参数信息还可包括分辨率，同理，在预设的显示区域显示分辨率对应的数值。值得注意的是，所述视频终端在预设的显示区域显示与其连接的所述外置设备的提 示信息，可以在所述视频终端与所述外置设备的连接过程中进行显示，也可以是在连接成功之后，即将待解码音视频文件发送给所述外置设备，并接收所述外置设备反馈的解码后的音视频数据的过程中进行显示。The video terminal displays prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device Parameter information, where the parameter information is the code rate corresponding to the decoding capability, such as a value corresponding to the code rate displayed in a preset display area. Further, the parameter information may further include a resolution, and similarly, the value corresponding to the resolution is displayed in a preset display area. It should be noted that the video terminal displays the external device connected thereto in a preset display area. The information may be displayed during the connection between the video terminal and the external device, or after the connection is successful, the audio and video file to be decoded is sent to the external device, and the external device is received. The device performs feedback during the process of decoding the decoded audio and video data.
从上述描述过程可以看出，本发明实施例提出了一种新颖的视频终端的使用场景，即在受限于终端硬件能力有限的情况下，不需要替换硬件设备的情况下，快速提升视频会议终端硬件的多媒体编解码能力的一种方式，具有使用方便、简单易用、节省成本等优点As can be seen from the above description, the embodiment of the present invention provides a novel use scenario of a video terminal, that is, when the hardware capability of the terminal is limited, the video conference can be quickly upgraded without replacing the hardware device. A way of multimedia codec capability of terminal hardware, which has the advantages of convenient use, ease of use, cost saving, etc.
作为另一实施方式，为了提高音视频播放的灵活性，基于第一、第二、第三实施例提出本发明音视频播放方法的第四实施例，在本实施例，所述视频终端的通信方法还包括；As another embodiment, in order to improve the flexibility of audio and video playback, a fourth embodiment of the audio and video playback method of the present invention is proposed based on the first, second, and third embodiments. In this embodiment, the communication of the video terminal is The method also includes;
所述视频终端采集待编码音视频数据，并通过所述预设接口将待编码音视频数据发送至所述外置设备，以供所述外置设备对所述待编码音视频数据进行编码并通过所述预设接口反馈编码后的音视频文件，其中，所述外置设备的编码能力高于所述视频终端安装的硬件设备的编码能力；The video terminal collects the audio and video data to be encoded, and sends the audio and video data to be encoded to the external device through the preset interface, so that the external device encodes the audio and video data to be encoded and The encoded audio and video file is fed back through the preset interface, where the coding capability of the external device is higher than the coding capability of the hardware device installed by the video terminal;
在接收到所述外置设备反馈的编码后的音视频文件时，将编码后的音视频文件发送至其它视频终端。When the encoded audio and video file fed back by the external device is received, the encoded audio and video file is sent to other video terminals.
作为另一实施方式，在所述外置设备的编码能力低于或等于安装的所述硬件设备的编码能力时，所述视频会议终端通过所述硬件设备对所述待编码音视频数据进行编码，以得到编码后的音视频文件，并将编码后的音视频文件发送至其它视频终端。In another embodiment, when the coding capability of the external device is lower than or equal to the coding capability of the installed hardware device, the video conference terminal encodes the to-be-coded audio and video data by using the hardware device. To obtain the encoded audio and video files, and send the encoded audio and video files to other video terminals.
作为另一实施方式，在待编码音视频数据包括多个音视频数据时，所述视频终端将各个待编码音视频数据分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述音视频数据进行编码并反馈编码后的音视频数据。In another embodiment, when the audio and video data to be encoded includes a plurality of audio and video data, the video terminal separately sends the audio and video data to be encoded to the external device and the installed hardware device for The external device and the hardware device encode the audio and video data and feed back the encoded audio and video data.
作为另一实施方式，在本实施例中，所述外置设备中所述的几种硬件 芯片，还可通过软件进行实现，外置设备装甚至还可以直接包括音视频的采集芯片等等，即不仅实现视频终端发送的音视频数据进行编码操作，还可以由采集芯片采集音视频数据，以直接对音视频数据进行编码。In another embodiment, in the embodiment, the hardware described in the external device The chip can also be implemented by software, and the external device can even directly include an audio and video acquisition chip, etc., that is, not only the audio and video data sent by the video terminal is encoded, but also the audio and video data can be collected by the acquisition chip. Directly encode audio and video data.
本发明实施例提供了一种直接对视频终端的解码能力进行能力升级的方法，可以方便的对用户的现有视频终端进行硬件能力的升级，为用户节省更换新装备的成本，而且本发明提供的外置设备采用通用的USB接口和视频会议终端进行连接，使用方便快捷，特别是对于使用通用的终端设备例如手机、平板、PC等安装软件视频会议的使用场景，由于通用终端设备的硬件多媒体能力相对于专业视频会议终端较弱，因此，通过本发明，可以快速的提升用户软件视频会议的多媒体编解码能力。The embodiment of the invention provides a method for directly upgrading the decoding capability of a video terminal, which can conveniently upgrade the hardware capability of the user's existing video terminal, save the user the cost of replacing the new equipment, and the present invention provides The external device uses a universal USB interface and a video conferencing terminal for connection, which is convenient and quick to use, especially for the use of a general terminal device such as a mobile phone, a tablet, a PC, etc., and a software video conference, due to the hardware of the general terminal device. The capability is weaker than that of the professional video conferencing terminal. Therefore, the present invention can quickly improve the multimedia codec capability of the user software video conference.
本发明实施例还提供了一种音视频播放装置。The embodiment of the invention further provides an audio and video playback device.
参照图4，图4是本发明音视频播放装置第一实施例的功能模块示意图。Referring to FIG. 4, FIG. 4 is a schematic diagram of functional modules of the first embodiment of the audio and video playback apparatus of the present invention.
需要强调的是，对本领域的技术人员来说，图4所示功能模块图仅仅是一个较佳实施例的示例图，本领域的技术人员围绕图4所示的音视频播放装置的功能模块，可轻易进行新的功能模块的补充；各功能模块的名称是自定义名称，仅用于辅助理解该音视频播放装置的各个程序功能块，不用于限定本发明的技术方案，本发明技术方案的核心是，各自定义名称的功能模块所要达成的功能。It should be emphasized that, for those skilled in the art, the functional module diagram shown in FIG. 4 is merely an exemplary diagram of a preferred embodiment, and those skilled in the art will surround the functional modules of the audio and video playback apparatus shown in FIG. The new functional modules can be easily supplemented; the names of the functional modules are custom names, which are only used to assist in understanding the various program functional blocks of the audio and video playback device, and are not used to limit the technical solution of the present invention. The core is the function that each functional module of the defined name has to achieve.
本实施例提出一种音视频播放装置，所述音视频播放装置通过预设接口与外置设备连接，所述音视频播放装置包括：The present embodiment provides an audio and video playback device, where the audio and video playback device is connected to an external device through a preset interface, and the audio and video playback device includes:
发送模块10，配置为在接收到其它视频终端发送的待解码音视频文件时，通过所述预设接口将所述待解码音视频文件发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力； The sending module 10 is configured to send the to-be-decoded audio and video file to the external device through the preset interface, when the audio and video file to be decoded sent by another video terminal is received, for the external device Decoding the audio and video file to be decoded and feeding back the decoded audio and video data through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal;
播放模块20，配置为在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频。The playing module 20 is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device.
在本实施例中，所述音视频播放装置通过预设接口先与外置设备连接，而所述音视频播放装置通过预设接口与所述外置设备连接的方式包括：In this embodiment, the audio and video playback device is connected to the external device through a preset interface, and the manner in which the audio and video playback device is connected to the external device through a preset interface includes:
所述音视频播放装置通过USB接口与所述外置设备进行连接；可以理解的是，所述音视频播放装置通过所述USB接口与外置设备进行连接，不需要额外的连接接口或者线缆，使用方便，可以做到即插即用，用户不需要进行任何额外的复杂操作，便捷性高；The audio and video playback device is connected to the external device through a USB interface; it can be understood that the audio and video playback device is connected to an external device through the USB interface, and does not require an additional connection interface or cable. Easy to use, it can be plug and play, users do not need to perform any additional complicated operations, and the convenience is high;
或者，所述音视频播放装置通过网卡接口与所述外置设备通信连接，而所述音视频播放装置通过网卡接口与所述外置设备进行通信连接时，可通过有线通信连接方式或无线通信连接方式进行通信连接；所述无线通信连接方式例如是Wi-Fi通信连接方式，提高了通信连接的灵活性。Alternatively, the audio and video playback device is communicably connected to the external device through a network card interface, and the audio and video playback device can communicate with the external device through a network card interface, and can be connected by wired communication or wirelessly. The connection mode is a communication connection; the wireless communication connection mode is, for example, a Wi-Fi communication connection mode, which improves the flexibility of the communication connection.
在本实施例中，所述外置设备是多媒体编解码能力增强设备，参照图2，所述外置设备具体表现为一个硬件盒子，盒子内部硬件包括：主处理器芯片，负责外置设备上的控制逻辑，以及控制其它芯片和视频终端的交互；音频处理芯片，负责外置设备上的音频处理，主要负责对音频数据的编码和解码，并通过主处理器芯片和视频终端交互；视频处理芯片，负责外置设备上的视频处理，主要负责对视频数据的编码和解码，并通过主处理器芯片和视频终端交互；程序存储芯片，包括作为一种存储芯片的Flash和内存两部分，其中，内存的一种示例可以是DDR；程序存储芯片是所述外置设备的程序数据存储和运行的芯片；USB接口芯片，提供所述外置设备的USB接口能力；另外还可以加上网卡芯片，对所述外置设备进行外部接口的扩展，以支持通过无线或者有线网络和视频终端进行通信连接。可以理解的是，本实施例中的外置设备采用一体化硬件设计，将专业的多媒体处理芯片和USB通用接口或网卡接口集成设计成一个便携式的硬件盒子的方 式进行提供，具有携带方便，即插即用，使用简单等特点。In this embodiment, the external device is a multimedia codec enhancement device. Referring to FIG. 2, the external device is specifically represented by a hardware box, and the internal hardware of the box includes: a main processor chip, which is responsible for the external device. Control logic, and control the interaction between other chips and video terminals; audio processing chip, responsible for audio processing on external devices, mainly responsible for encoding and decoding audio data, and interacting with the video terminal through the main processor chip; video processing The chip is responsible for video processing on the external device, and is mainly responsible for encoding and decoding the video data, and interacting with the video terminal through the main processor chip; the program storage chip includes two parts of the flash and the memory as a memory chip, wherein An example of the memory may be DDR; the program memory chip is a chip for storing and running program data of the external device; the USB interface chip provides the USB interface capability of the external device; and the network card chip may be added Extending the external interface of the external device to support the wireless or wired network Video terminal communication connection. It can be understood that the external device in this embodiment adopts an integrated hardware design, and integrates a professional multimedia processing chip and a USB universal interface or a network card interface into a portable hardware box. Provided by the style, it is easy to carry, plug and play, easy to use and so on.
在本实施例中，所述音视频播放装置即所述视频终端，所述视频终端是将某一会议点的实时图像、语音和相关的数据信息进行采集，压缩编码，多路复用(即一个信道同时传输多路信号)后通过传输信道发送给其它视频终端，并可接收其它视频终端发送的图像、语音和数据信息进行分解、解码，还原成对方会场的图像、语音和数据的终端，即本实施例中的所述视频终端表示视频会议终端。所述视频会议终端包括软件视频会议终端和硬件视频会议终端两种，其中，软件视频会议终端是一种可以运行在通用终端设备上的软件视频会议系统，可以提供视频会议终端的全部功能；而硬件视频会议终端是一种专门用于视频会议的硬件设备，采用专业的多媒体处理芯片进行硬件设计，可以提供视频会议功能的一种设备。而所述视频终端与所述外置设备的结构连接图可参照图3，从图3中可以看出是，本实施例中的所述视频终端可以包括视频采集模块、音频采集模块、音频编解码模块、视频编解码模块和显示模块，也就是说，所述视频终端不仅仅可以将待解码音视频文件发送至外置设备进行解码，还可将采集音视频数据，并将采集的音视频数据传输至所述外置设备，以供所述外置设备进行编码。In this embodiment, the audio and video playback device is the video terminal, and the video terminal collects, compresses, and multiplexes real-time images, voices, and related data information of a certain conference point (ie, A channel simultaneously transmits multiple signals) and then transmitted to other video terminals through a transmission channel, and can receive images, voice and data information transmitted by other video terminals to be decomposed and decoded, and restored to the terminals of the image, voice and data of the other site. That is, the video terminal in this embodiment represents a video conference terminal. The video conference terminal includes a software video conference terminal and a hardware video conference terminal. The software video conference terminal is a software video conference system that can run on a universal terminal device, and can provide all functions of the video conference terminal; The hardware video conferencing terminal is a device specially designed for video conferencing hardware devices, which adopts a professional multimedia processing chip for hardware design and can provide video conferencing functions. The structure of the video terminal and the external device can be referred to FIG. 3. As can be seen from FIG. 3, the video terminal in this embodiment may include a video capture module, an audio capture module, and an audio editor. The decoding module, the video codec module and the display module, that is, the video terminal can not only send the audio and video files to be decoded to an external device for decoding, but also collect audio and video data, and the collected audio and video. Data is transmitted to the external device for encoding by the external device.
在本实施例中，在外置设备所在一端中，所述外置设备与所述视频终端连接之后，先将内置的软件系统启动，然后检测USB接口或网卡接口的连接状态，如果当前已经连接则和视频终端建立软件连接，并在连接成功之后与所述视频终端进行交互协议的传输，以将其解码能力的参数信息通过交互协议传输至视频终端，并在交互成功时，进入就绪状态，等待接收音视频数据进行解码。In this embodiment, after the external device is connected to the video terminal, the built-in software system is started, and then the connection state of the USB interface or the network card interface is detected, if the connection is currently connected. Establishing a software connection with the video terminal, and performing an interactive protocol transmission with the video terminal after the connection is successful, to transmit parameter information of the decoding capability to the video terminal through an interaction protocol, and when the interaction is successful, enter a ready state, waiting Receive audio and video data for decoding.
在本实施例中，所述发送模块10在接收到其它视频终端发送的待解码音视频文件时，通过所述预设接口将所述待解码音视频文件发送至所述外 置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，具体地，所述外置设备通过预置的视频处理芯片和音频处理芯片对所述音视频文件进行解码，并将解码后的音视频数据通过所述预设接口反馈至所述视频终端。In this embodiment, the sending module 10 sends the to-be-decoded audio and video file to the outside through the preset interface when receiving the to-be-decoded audio and video file sent by another video terminal. The device is configured to decode the audio and video file to be decoded by the external device, and feed back the decoded audio and video data through the preset interface. Specifically, the external device passes the preset video processing chip. And the audio processing chip decodes the audio and video file, and feeds the decoded audio and video data to the video terminal through the preset interface.
在本实施例中，在接收到所述外置设备反馈的解码后的音视频数据时，所述播放模块20即可根据解码后的音视频数据播放所述音视频数据对应的音视频。可以理解的是，在视频通信完成后可以将外置设备拔下，此时，所述视频终端与所述外置设备的视频通信过程结束。In this embodiment, when the decoded audio and video data fed back by the external device is received, the playing module 20 can play the audio and video corresponding to the audio and video data according to the decoded audio and video data. It can be understood that the external device can be unplugged after the video communication is completed. At this time, the video communication process between the video terminal and the external device ends.
本实施例提出的音视频播放装置，在视频终端与外置设备连接的情况下，通过预设接口将待解码音视频文件发送至所述外置设备，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频，实现了视频终端的解码能力较低时，通过解码能力高于视频终端的解码能力的外置设备进行音视频文件的解码，而不用替换硬件设备，从而降低了视频终端进行音视频播放的成本。In the audio and video playback device of the embodiment, when the video terminal is connected to the external device, the audio and video file to be decoded is sent to the external device through a preset interface, wherein the decoding capability of the external device The decoding capability of the hardware device installed by the video terminal is higher than that, the external device decodes the audio and video file to be decoded, and feeds back the decoded audio and video data through the preset interface, and receives the received audio and video data. When the decoded audio and video data fed back by the external device is used, the audio and video corresponding to the audio and video data is played according to the decoded audio and video data, so that when the decoding capability of the video terminal is low, the decoding capability is higher than the video terminal. The decoding device's external device decodes the audio and video files without replacing the hardware device, thereby reducing the cost of the video terminal for audio and video playback.
作为另一实施方式，为了提高音视频播放的智能性，基于第一实施例提出本发明音视频播放装置的第二实施例，在本实施例，所述音视频播放装置包括：As another embodiment, in order to improve the intelligence of the audio and video playback, a second embodiment of the audio and video playback device of the present invention is proposed based on the first embodiment. In this embodiment, the audio and video playback device includes:
比对模块，配置为在所述音视频播放装置与所述外置设备的连接过程中，将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对；The comparison module is configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal during the connection between the audio and video playback device and the external device;
所述发送模块10，还配置为在所述外置设备的解码能力高于安装的硬件设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件， 通过所述预设接口将所述待解码音视频文件发送至所述外置设备；The sending module 10 is further configured to: when the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, Transmitting the to-be-decoded audio and video file to the external device by using the preset interface;
处理模块，配置为在所述外置设备的解码能力低于安装的硬件设备的解码能力时，断开与所述外置设备的连接，并输出告警信息。The processing module is configured to disconnect the external device when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, and output alarm information.
在本实施例中，在所述视频终端与所述外置设备的连接过程中，先识别所述外置设备的解码能力，可以理解的是，解码能力表示能否从视频文件中重现视频原貌的能力，而解码能力与码率等参数信息有关，码率越高，则解码能力越强，因此，在所述视频终端与所述外置设备的连接过程中，先识别所述外置设备中的码率，具体可通过交互协议中输出的参数信息进行识别，即所述视频终端通过交互协议与所述外置设备进行协议的参数信息的传输，以从传输的协议中确定所述外置设备的解码能力。在确定所述外置设备的解码能力之后，所述比对模块将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对，具体的比对方式是将所述外置设备的码率与安装的硬件设备的码率进行比对，以确定所述外置设备与安装的所述硬件设备的解码能力的大小关系。在所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件，所述发送模块10将所述待解码音视频文件通过所述预设接口发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，而在所述外置设备的解码能力低于安装的硬件设备的解码能力时，说明所述外置设备不符合音视频文件的解码要求，此时，所述处理模块断开与所述外置设备的连接关系，并输出告警信息，如输出：“未连接外置设备”或“连接已经断开”等文字信息，或者是输出预设时长如5S的鸣笛声，或者是通过闪烁所述视频终端预设的LED灯。In this embodiment, in the process of connecting the video terminal and the external device, the decoding capability of the external device is first identified. It can be understood that the decoding capability indicates whether the video can be reproduced from the video file. The ability of the original appearance, and the decoding capability is related to the parameter information such as the code rate. The higher the code rate, the stronger the decoding capability. Therefore, in the process of connecting the video terminal and the external device, the external device is first identified. The code rate in the device may be specifically identified by the parameter information outputted in the interaction protocol, that is, the video terminal transmits the parameter information of the protocol with the external device through an interaction protocol, to determine the protocol from the transmission protocol. The decoding capability of the external device. After determining the decoding capability of the external device, the comparison module compares the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal, and the specific comparison method is The code rate of the external device is compared with the code rate of the installed hardware device to determine the size relationship of the decoding capability of the external device and the installed hardware device. When the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, if the audio and video files to be decoded sent by other video terminals are received, the sending module 10 will decode the audio and video to be decoded. And sending, by the preset interface, the file to the external device, where the external device decodes the audio and video file to be decoded, and feeds back the decoded audio and video data through the preset interface. When the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the external device does not meet the decoding requirement of the audio and video file. At this time, the processing module disconnects from the external device. Relationship, and output alarm information, such as output: "unconnected external device" or "connection has been disconnected" and other text information, or output a preset duration such as 5S whistle, or by flashing the video terminal Set the LED lights.
在本实施例中，通过检测外置设备的解码能力与硬件设备的解码能力，并在所述外置设备的解码能力低于安装的硬件设备的解码能力时，断开与 所述外置设备的连接关系，并输出告警信息，防止了连接的外置设备的解码能力与视频终端的解码还低时，仍然进行解码操作，从而提高了视频解码的智能性。In this embodiment, by detecting the decoding capability of the external device and the decoding capability of the hardware device, and when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, disconnecting and The connection relationship of the external device and the output of the alarm information prevent the decoding capability of the connected external device and the decoding of the video terminal are still low, and the decoding operation is still performed, thereby improving the intelligence of the video decoding.
当然，所述视频播放装置还包括解码模块，用于在所述外置设备的解码能力低于或等于安装的所述硬件设备的解码能力时，不断开所述视频终端与所述外置设备的连接关系，所述解码模块通过安装的所述硬件设备对所述待解码音视频文件进行解码，以得到解码后的音视频数据，并且所述播放模块20根据解码后的音视频数据播放所述音视频数据对应的音视频。The video playback device further includes a decoding module, configured to not disconnect the video terminal and the external device when a decoding capability of the external device is lower than or equal to a decoding capability of the installed hardware device a connection relationship, the decoding module decodes the to-be-decoded audio and video file by using the installed hardware device to obtain decoded audio and video data, and the playing module 20 plays the decoded audio and video data according to the decoded audio and video data. The audio and video corresponding to the audio and video data.
也就是说，在所述外置设备的解码能力低于所述视频终端的解码能力时，此时，优先采用解码能力强的视频终端进行解码，从而提高了音视频解码的灵活性，当然，此时，先不断开所述视频终端与所述外置设备的连接关系，后续在待解码音视频文件包括多个音视频文件时，可以由所述外置设备分担解码操作，降低了视频终端的处理压力。That is to say, when the decoding capability of the external device is lower than the decoding capability of the video terminal, at this time, the video terminal with strong decoding capability is preferentially used for decoding, thereby improving the flexibility of audio and video decoding, of course, In this case, the connection relationship between the video terminal and the external device is not disconnected, and when the audio and video file to be decoded includes multiple audio and video files, the external device can share the decoding operation and reduce the video terminal. Processing pressure.
作为另一实施方式，为了提高音视频播放的灵活性，基于第一实施例提出本发明音视频播放装置的第三实施例，在本实施例，在待解码音视频文件包括多个音视频文件时，所述音视频播放装置包括：As another embodiment, in order to improve the flexibility of audio and video playback, a third embodiment of the audio and video playback apparatus of the present invention is proposed based on the first embodiment. In this embodiment, the audio and video files to be decoded include multiple audio and video files. The audio and video playback device includes:
所述发送模块10，还配置为在待解码音视频文件包括多个音视频文件时，将待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据。The sending module 10 is further configured to: when the audio and video file to be decoded includes a plurality of audio and video files, send the to-be-decoded video file to the external device and the installed hardware device for the external The device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data.
在本实施例中，在待解码音视频文件包括多个音视频文件时，即此时接收到多个视频终端发送的待解码音视频文件，或者是接收到同一个视频终端依次发送的多个视频文件，此时，所述发送模块10将各个待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，具体的发送方式可以是： In this embodiment, when the audio and video file to be decoded includes a plurality of audio and video files, that is, the audio and video files to be decoded sent by the plurality of video terminals are received at this time, or multiple received by the same video terminal are sequentially sent. a video file, in this case, the sending module 10 sends the respective to-be-decoded video files to the external device and the installed hardware device, and the specific sending manner may be:
将待解码音视频文件的数量分成两部分，将分别将两部分的待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据；Dividing the number of audio and video files to be decoded into two parts, respectively, sending two parts of the video files to be decoded to the external device and the installed hardware device, respectively, for the external device and the hardware The device decodes the to-be-decoded audio and video file and feeds back the decoded audio and video data;
或者，一次性轮询将各个待解码视频文件发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据；Or, the one-time polling sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode the to-be-decoded audio and video file. And feeding back the decoded audio and video data;
或者，将各个待解码视频文件存储到发送队列中，依次从发送队列中提取待解码音视频文件发送至当前空闲的设备中，并在另一个设备空闲时再从发送队列中提取待解码音视频文件发送至当前空闲的设备中，例如，当前外置设备正在对前一个待解码音视频文件进行解码，而所述视频终端的硬件设备处于空闲状态，此时，若再接收到待解码音视频文件，则将再接收到的待解码音视频文件发送至所述视频终端的硬件设备中进行解码。Or, the video files to be decoded are stored in the sending queue, and the audio and video files to be decoded are sequentially sent from the sending queue to the currently idle device, and the audio and video to be decoded are extracted from the sending queue when the other device is idle. The file is sent to the currently idle device. For example, the current external device is decoding the previous audio and video file to be decoded, and the hardware device of the video terminal is in an idle state. At this time, if the audio and video to be decoded are received again, The file, the received audio and video file to be decoded is sent to the hardware device of the video terminal for decoding.
作为一种实施方式，所述音视频播放装置还可包括获取模块，配置为获取预设的分配策略，所述分配策略根据具体情况进行设置，包括上文所述的三种发送方式，还包括：a、确定设备的等待队列中包含的待解码音视频文件的个数，并将再次接收到的待解码音视频发送至两个等待队列中个数少的队列中；b、确定设备的等待队列中的优先级，并将再次接收到的待解码音视频文件发送至两个等待队列中优先级高的队列中，其中，设备中处理器的占用率越大，优先级相应降低，也就是说，将接收到的待解码音视频文件发送到处理器的占用率较低的设备中，所述发送模块10，还配置为按照获取的所述分配策略，即可将各个待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据，最终所述视频终端根据解码后的音视频数据播放所述音视频数据对应的音视频。 As an embodiment, the audio and video playback device may further include an obtaining module configured to acquire a preset allocation policy, where the allocation policy is set according to a specific situation, including the foregoing three sending manners, and further includes : a, determining the number of audio and video files to be decoded included in the waiting queue of the device, and transmitting the to-be-decoded audio and video received again to a queue with a small number of two waiting queues; b, determining the waiting of the device The priority of the queue, and the received audio and video files to be decoded are sent to the queues with the highest priority in the two waiting queues. The greater the occupancy rate of the processor in the device, the lower the priority, that is, The sending and receiving audio and video files are sent to the device with a lower occupancy rate of the processor, and the sending module 10 is further configured to: respectively, according to the obtained allocation policy, each video file to be decoded can be separately Sending to the external device and the installed hardware device, for the external device and the hardware device to solve the to-be-decoded audio and video file And decoding the decoded audio and video data, and finally the video terminal plays the audio and video corresponding to the audio and video data according to the decoded audio and video data.
在本实施例中，在待解码音视频文件包括多个音视频文件时，将待解码视频文件发送至所述外置设备以及安装的所述硬件设备中，而不是将待解码音视频文件全部发送至外置设备或视频终端的硬件设备中进行解码，而是动态的调节解码的方式，降低了所述外置设备或者所述硬件设备的处理器的处理压力，还提高了音视频文件的解码智能性。In this embodiment, when the audio and video file to be decoded includes a plurality of audio and video files, the video file to be decoded is sent to the external device and the installed hardware device, instead of all the audio and video files to be decoded. Sending to the external device or the hardware device of the video terminal for decoding, but dynamically adjusting the decoding mode, reducing the processing pressure of the external device or the processor of the hardware device, and improving the audio and video files. Decoding intelligence.
作为一种实施方式，所述音视频播放装置还包括；As an embodiment, the audio and video playback device further includes:
显示模块，配置为在预设的显示区域显示与其连接的所述外置设备的提示信息，其中，所述提示信息包括所述外置设备的标识信息，以及所述外置设备的解码能力对应的参数信息，所述参数信息即所述解码能力对应码率，如在预设的显示区域显示码率对应的数值。进一步地，所述参数信息还可包括分辨率，同理，在预设的显示区域显示分辨率对应的数值。值得注意的是，所述显示模块在预设的显示区域显示与其连接的所述外置设备的提示信息，可以在所述视频终端与所述外置设备的连接过程中进行显示，也可以是在连接成功之后，即将待解码音视频文件发送给所述外置设备，并接收所述外置设备反馈的解码后的音视频数据的过程中进行显示。a display module, configured to display prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device The parameter information, that is, the decoding capability corresponding code rate, such as the value corresponding to the code rate displayed in the preset display area. Further, the parameter information may further include a resolution, and similarly, the value corresponding to the resolution is displayed in a preset display area. It should be noted that the display module displays the prompt information of the external device connected to the display device in a preset display area, and may be displayed during the connection between the video terminal and the external device, or may be After the connection is successful, the audio and video file to be decoded is sent to the external device, and the decoded audio and video data fed back by the external device is received for display.
从上文的描述过程可以看出，本发明实施例提出了一种新颖的视频终端的使用场景，即在受限于终端硬件能力有限的情况下，不需要替换硬件设备的情况下，快速提升视频会议终端硬件的多媒体编解码能力的一种方式，具有使用方便、简单易用、节省成本等优点As can be seen from the above description process, the embodiment of the present invention provides a novel use scenario of a video terminal, that is, in a case where the hardware capability of the terminal is limited, and the hardware device does not need to be replaced, the device is rapidly upgraded. A method of multimedia codec capability of video conference terminal hardware, which has the advantages of convenient use, ease of use, cost saving, etc.
作为一种实施方式，为了提高音视频播放的灵活性，基于第一、第二、第三实施例提出本发明音视频播放装置的第四实施例，在本实施例，所述视频终端的通信装置还包括；As an embodiment, in order to improve the flexibility of audio and video playback, a fourth embodiment of the audio and video playback apparatus of the present invention is proposed based on the first, second, and third embodiments. In this embodiment, the communication of the video terminal is performed. The device also includes;
所述发送模块10，还配置为采集待编码音视频数据，并通过所述预设接口将待编码音视频数据发送至所述外置设备，以供所述外置设备对所述待编码音视频数据进行编码并通过所述预设接口反馈编码后的音视频文 件，其中，所述外置设备的编码能力高于所述视频终端安装的硬件设备的编码能力；The sending module 10 is further configured to collect audio and video data to be encoded, and send the audio and video data to be encoded to the external device through the preset interface, so that the external device can The video data is encoded and the encoded audio and video text is fed back through the preset interface The encoding capability of the external device is higher than the encoding capability of the hardware device installed by the video terminal;
所述发送模块10，还配置为在接收到所述外置设备反馈的编码后的音视频文件时，将编码后的音视频文件发送至其它视频终端。The sending module 10 is further configured to send the encoded audio and video file to other video terminals when receiving the encoded audio and video files fed back by the external device.
作为一种实施方式，所述处理模块，还配置为在所述外置设备的编码能力低于或等于安装的所述硬件设备的编码能力时，通过所述硬件设备对所述待编码音视频数据进行编码，以得到编码后的音视频文件，并将编码后的音视频文件发送至其它视频终端。In an embodiment, the processing module is further configured to: when the coding capability of the external device is lower than or equal to the coding capability of the installed hardware device, the audio and video to be encoded by the hardware device The data is encoded to obtain an encoded audio and video file, and the encoded audio and video files are sent to other video terminals.
作为一种实施方式，所述发送模块10，还配置为在待编码音视频数据包括多个音视频数据时，将各个待编码音视频数据分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述音视频数据进行编码并反馈编码后的音视频数据。As an implementation manner, the sending module 10 is further configured to: when the to-be-encoded audio and video data includes multiple audio and video data, send each to-be-coded audio and video data to the external device and the installed hardware. In the device, the audio and video data is encoded by the external device and the hardware device, and the encoded audio and video data is fed back.
作为一种实施方式，在本实施例中，所述外置设备中所述的几种硬件芯片，还可通过软件进行实现，外置设备装甚至还可以直接包括音视频的采集芯片等等，即不仅实现视频终端发送的音视频数据进行编码操作，还可以由采集芯片采集音视频数据，以直接对音视频数据进行编码。As an implementation manner, in this embodiment, the hardware chips described in the external device may also be implemented by software, and the external device may even directly include an audio and video acquisition chip, and the like. That is, not only the audio and video data sent by the video terminal is encoded, but also the audio and video data can be collected by the acquisition chip to directly encode the audio and video data.
本发明实施例中，所述音视频播放装置中的播放模块20、比对模块、处理模块、解码模块和获取模块，在实际应用中均可由所述终端中的中央处理器(CPU，Central Processing Unit)、数字信号处理器(DSP，Digital Signal Processor)、微控制单元(MCU，Microcontroller Unit)或可编程门阵列(FPGA，Field－Programmable Gate Array)实现；所述音视频播放装置中的发送模块10，在实际应用中可通过通信模组(包含：基础通信套件、操作系统、通信模块、标准化接口和协议等)及收发天线实现；所述音视频播放装置中的显示模块，在实际应用中可通过显示屏或显示器实现。In the embodiment of the present invention, the playing module 20, the comparing module, the processing module, the decoding module, and the obtaining module in the audio and video playing device can be used by the central processing unit (CPU, Central Processing) in the terminal in practical applications. Unit), digital signal processor (DSP), Microcontroller Unit (MCU) or Field-Programmable Gate Array (FPGA); transmitting module in the audio and video playback device 10, in practical applications, can be realized by a communication module (including: basic communication suite, operating system, communication module, standardized interface and protocol, etc.) and a transceiver antenna; the display module in the audio and video playback device is in practical application Can be achieved through the display or display.
本发明实施例提供了一种直接对视频终端的解码能力进行能力升级的 装置，可以方便的对用户的现有视频终端进行硬件能力的升级，为用户节省更换新装备的成本，而且本发明提供的外置设备采用通用的USB接口和视频会议终端进行连接，使用方便快捷，特别是对于使用通用的终端设备例如手机、平板、PC等安装软件视频会议的使用场景，由于通用终端设备的硬件多媒体能力相对于专业视频会议终端较弱，因此，通过本发明，可以快速的提升用户软件视频会议的多媒体编解码能力。The embodiment of the invention provides a capability for directly upgrading the decoding capability of a video terminal. The device can conveniently upgrade the hardware capability of the user's existing video terminal, saves the user the cost of replacing the new equipment, and the external device provided by the present invention uses a universal USB interface and a video conference terminal for connection, which is convenient and convenient to use. Especially for the use scenario of installing a software video conference using a universal terminal device such as a mobile phone, a tablet, a PC, etc., since the hardware multimedia capability of the universal terminal device is weak relative to the professional video conference terminal, the present invention can be quickly Improve the multimedia codec capability of user software video conferencing.
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其它变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其它要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It is to be understood that the term "comprises", "comprising", or any other variants thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or system that comprises a plurality of elements includes not only those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, item, or system. An element defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in a process, method, article, or system that includes the element, without further limitation.
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.
在本发明所提供的几个实施例中，应该理解到，所揭露的方法及装置，可以通过其他的方式实现。以上所描述的装置实施例仅仅是示意性的，例如，所述模块的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，如：多个模块或组件可以结合，或可以集成到另一个系统，或一些特征可以忽略，或不执行。另外，所显示或讨论的各组成部分相互之间的通信连接可以是通过一些接口，设备或模块的间接耦合或通信连接，可以是电性的、机械的或其他形式的。In the several embodiments provided by the present invention, it should be understood that the disclosed method and apparatus may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be another division manner, for example, multiple modules or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed. In addition, the communication connections between the various components shown or discussed may be indirect coupling or communication connections through some interfaces, devices or modules, and may be electrical, mechanical or otherwise.
上述作为分离部件说明的模块可以是、或也可以不是物理上分开的，作为模块显示的部件可以是、或也可以不是物理模块，即可以位于一个地方，也可以分布到多个网络模块上；可以根据实际的需要选择其中的部分或全部模块来实现本实施例方案的目的。The modules described above as separate components may or may not be physically separated. The components displayed as modules may or may not be physical modules, that is, may be located in one place or distributed to multiple network modules; Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外，在本发明各实施例中的各功能模块可以全部集成在一个处理模 块中，也可以是各模块分别单独作为一个模块，也可以两个或两个以上模块集成在一个模块中；上述集成的模块既可以采用硬件的形式实现，也可以采用硬件加软件功能模块的形式实现。In addition, each functional module in each embodiment of the present invention may be integrated into one processing module. In the block, each module may be separately used as one module, or two or more modules may be integrated into one module; the integrated module may be implemented in the form of hardware or a hardware plus software function module. Formal realization.
本领域普通技术人员可以理解：实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成，前述的程序可以存储于计算机可读取存储介质中，该程序在执行时，执行包括上述方法实施例的步骤；而前述的存储介质包括：移动存储设备、只读存储器(ROM，Read-Only Memory)、磁碟或者光盘等各种可以存储程序代码的介质。It will be understood by those skilled in the art that all or part of the steps of implementing the foregoing method embodiments may be performed by hardware related to program instructions. The foregoing program may be stored in a computer readable storage medium, and when executed, the program includes The foregoing steps of the method embodiment; and the foregoing storage medium includes: a removable storage device, a read-only memory (ROM), a magnetic disk or an optical disk, and the like, which can store program codes.
或者，本发明实施例上述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例所述方法的全部或部分。而前述的存储介质包括：移动存储设备、ROM、磁碟或者光盘等各种可以存储程序代码的介质。Alternatively, the above-described integrated module of the embodiment of the present invention may be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a stand-alone product. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions. A computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a mobile storage device, a ROM, a magnetic disk, or an optical disk.
本发明实施例中记载的存储器切换方法、装置只以上述实施例为例，但不仅限于此，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。The memory switching method and apparatus described in the embodiments of the present invention are only exemplified by the foregoing embodiments, but are not limited thereto, and those skilled in the art should understand that the technical solutions described in the foregoing embodiments may still be modified. Equivalent replacement of some or all of the technical features may be made without departing from the scope of the technical solutions of the embodiments of the present invention.
以上所述仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.
工业实用性Industrial applicability
本发明实施例的技术方案在视频终端与外置设备连接的情况下，通过 预设接口将待解码音视频文件发送至所述外置设备，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频，实现了视频终端的解码能力较低时，通过解码能力高于视频终端的解码能力的外置设备进行音视频文件的解码，而不用替换硬件设备，从而降低了视频终端进行音视频播放的成本。 The technical solution of the embodiment of the present invention passes through the case where the video terminal is connected to the external device. The preset interface sends the to-be-decoded audio and video file to the external device, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal, for the external device to Decoding the audio and video file for decoding, and feeding back the decoded audio and video data through the preset interface, and when receiving the decoded audio and video data fed back by the external device, playing the decoded audio and video data according to the decoded audio and video data The audio and video corresponding to the audio and video data realizes that when the decoding capability of the video terminal is low, the audio and video files are decoded by an external device whose decoding capability is higher than the decoding capability of the video terminal, without replacing the hardware device, thereby reducing the The cost of audio and video playback by video terminals.

Claims (11)

  1. 一种音视频播放方法，视频终端通过预设接口与外置设备连接，所述音视频播放方法包括以下步骤：An audio and video playing method, the video terminal is connected to an external device through a preset interface, and the audio and video playing method includes the following steps:
    在接收到其它视频终端发送的待解码音视频文件时，所述视频终端通过所述预设接口将所述待解码音视频文件发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力；The video terminal sends the to-be-decoded audio and video file to the external device through the preset interface, when the audio and video file to be decoded is sent by the other video terminal, for the external device to Decoding the audio and video file for decoding, and feeding back the decoded audio and video data through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal;
    在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频。When the decoded audio and video data fed back by the external device is received, the audio and video corresponding to the audio and video data is played according to the decoded audio and video data.
  2. 如权利要求1所述的音视频播放方法，其中，所述视频终端通过通用串行总线USB接口或网卡接口与所述外置设备进行连接。The audio and video playback method according to claim 1, wherein said video terminal is connected to said external device via a universal serial bus USB interface or a network card interface.
  3. 如权利要求1所述的音视频播放方法，其中，所述音视频播放方法还包括：The audio and video playing method of claim 1, wherein the audio and video playing method further comprises:
    在所述视频终端与所述外置设备的连接过程中，所述视频终端将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对；During the connection between the video terminal and the external device, the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal;
    在所述外置设备的解码能力高于安装的硬件设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件，执行所述视频终端通过所述预设接口将所述待解码音视频文件发送至所述外置设备的步骤；If the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video file to be decoded sent by another video terminal is received, the video terminal is configured to decode the to-be-decoded terminal through the preset interface. The step of transmitting the audio and video file to the external device;
    在所述外置设备的解码能力低于安装的硬件设备的解码能力时，所述视频终端断开与所述外置设备的连接，并输出告警信息。When the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the video terminal disconnects from the external device and outputs alarm information.
  4. 如权利要求1所述的音视频播放方法，其中，在待解码音视频文件包括多个音视频文件时，所述在接收到其它视频终端发送的待解码音视频文件时，所述音视频播放方法还包括； The audio and video playing method according to claim 1, wherein when the audio/video file to be decoded includes a plurality of audio and video files, the audio and video playback is performed when the audio and video files to be decoded sent by other video terminals are received. The method also includes;
    所述视频终端将待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据。The video terminal sends the to-be-decoded video file to the external device and the installed hardware device, so that the external device and the hardware device decode and feedback the audio/video file to be decoded. Decoded audio and video data.
  5. 如权利要求1至4任一项所述的音视频播放方法，其中，所述音视频播放方法还包括；The audio and video playing method according to any one of claims 1 to 4, wherein the audio and video playing method further comprises:
    所述视频终端在预设的显示区域显示与其连接的所述外置设备的提示信息，其中，所述提示信息包括所述外置设备的标识信息，以及所述外置设备的解码能力对应的参数信息。The video terminal displays prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device Parameter information.
  6. 一种音视频播放装置，所述音视频播放装置通过预设接口与外置设备连接，所述音视频播放装置包括：An audio and video playback device, the audio and video playback device is connected to an external device through a preset interface, and the audio and video playback device includes:
    发送模块，配置为在接收到其它视频终端发送的待解码音视频文件时，通过所述预设接口将所述待解码音视频文件发送至所述外置设备，以供所述外置设备对所述待解码音视频文件进行解码并通过所述预设接口反馈解码后的音视频数据，其中，所述外置设备的解码能力高于所述视频终端安装的硬件设备的解码能力；a sending module, configured to send the to-be-decoded audio and video file to the external device by using the preset interface, when the audio and video file to be decoded sent by another video terminal is received, for the external device to The audio and video file to be decoded is decoded, and the decoded audio and video data is fed back through the preset interface, where the decoding capability of the external device is higher than the decoding capability of the hardware device installed by the video terminal;
    播放模块，配置为在接收到所述外置设备反馈的解码后的音视频数据时，根据解码后的音视频数据播放所述音视频数据对应的音视频。The playing module is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device.
  7. 如权利要求6所述的音视频播放装置，其中，所述音视频播放装置通过USB接口或网卡接口与所述外置设备进行连接。The audio-video playback device according to claim 6, wherein said audio-video playback device is connected to said external device via a USB interface or a network card interface.
  8. 如权利要求6所述的音视频播放装置，其中，所述音视频播放装置还包括：The audio-video playback device of claim 6, wherein the audio-video playback device further comprises:
    比对模块，配置为在所述音视频播放装置与所述外置设备的连接过程中，将所述外置设备的解码能力与所述视频终端安装的硬件设备的解码能力进行比对；The comparison module is configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed by the video terminal during the connection between the audio and video playback device and the external device;
    所述发送模块，还配置为在所述外置设备的解码能力高于安装的硬件 设备的解码能力时，若接收到其它视频终端发送的待解码音视频文件，通过所述预设接口将所述待解码音视频文件发送至所述外置设备；The sending module is further configured to have higher decoding capability of the external device than installed hardware When the decoding capability of the device is received, if the audio and video file to be decoded sent by another video terminal is received, the audio and video file to be decoded is sent to the external device through the preset interface;
    处理模块，配置为在所述外置设备的解码能力低于安装的硬件设备的解码能力时，断开与所述外置设备的连接，并输出告警信息。The processing module is configured to disconnect the external device when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, and output alarm information.
  9. 如权利要求6所述的音视频播放装置，其中，所述发送模块，还配置为在待解码音视频文件包括多个音视频文件时，将待解码视频文件分别发送至所述外置设备以及安装的所述硬件设备中，以供所述外置设备以及所述硬件设备对所述待解码音视频文件进行解码并反馈解码后的音视频数据。The audio and video playback device of claim 6, wherein the sending module is further configured to send the to-be-decoded video file to the external device when the audio-video file to be decoded includes a plurality of audio and video files, and In the installed hardware device, the external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data.
  10. 如权利要求6至9任一项所述的音视频播放装置，其中，所述音视频播放装置还包括；The audio-video playback device according to any one of claims 6 to 9, wherein the audio-video playback device further comprises:
    显示模块，配置为在预设的显示区域显示与其连接的所述外置设备的提示信息，其中，所述提示信息包括所述外置设备的标识信息，以及所述外置设备的解码能力对应的参数信息。a display module, configured to display prompt information of the external device connected thereto in a preset display area, where the prompt information includes identification information of the external device, and a decoding capability of the external device Parameter information.
  11. 一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行权利要求1至5任一项所述的音视频播放方法。 A computer storage medium having stored therein computer executable instructions for performing the audio and video playback method of any one of claims 1 to 5.
PCT/CN2017/077581 2016-04-15 2017-03-21 Audio/video playback method and apparatus, and computer storage medium WO2017177802A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610235642.9A CN107302703A (en) 2016-04-15 2016-04-15 Audio and video playing method and device
CN201610235642.9 2016-04-15

Publications (1)

Publication Number Publication Date
WO2017177802A1 true WO2017177802A1 (en) 2017-10-19

Family

ID=60042351

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/077581 WO2017177802A1 (en) 2016-04-15 2017-03-21 Audio/video playback method and apparatus, and computer storage medium

Country Status (2)

Country Link
CN (1) CN107302703A (en)
WO (1) WO2017177802A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112243135A (en) * 2019-07-16 2021-01-19 腾讯科技（北京）有限公司 Multimedia playing method and device
CN116136751A (en) * 2023-04-04 2023-05-19 北京智象信息技术有限公司 Mirror image method for cross-operating system of primary screen and secondary screen

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109120939B (en) * 2018-07-16 2021-04-06 北京奇艺世纪科技有限公司 Video App decoding method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10100919A1 (en) * 2001-01-11 2002-07-25 Daimler Chrysler Ag Motor vehicle multimedia player with ability to record digital radio signals on a hard disk, e.g. MPEG2 or MP3 signals, so that they can be played back using a decoder and controller device
CN1801913A (en) * 2005-12-06 2006-07-12 浙江大学 Universal video player
CN101582281A (en) * 2009-04-17 2009-11-18 深圳市美赛达科技有限公司 Visual on-vehicle apparatus based on embedded microprocessor
CN101729875A (en) * 2008-10-24 2010-06-09 鸿富锦精密工业（深圳）有限公司 Multimedia file playing method and media playing device
CN101990124A (en) * 2009-08-05 2011-03-23 深圳市致芯微电子股份有限公司 Handheld television receiving device, system and method thereof
CN102547291A (en) * 2012-02-08 2012-07-04 中国电影科学技术研究所 Field programmable gate array (FPGA)-based joint photographic experts group (JPEG) 2000 image decoding device and method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5166021B2 (en) * 2004-05-03 2013-03-21 トムソン リサーチ ファンディング コーポレイション Method and system for enabling fast channel changes for DSL systems
KR20100132173A (en) * 2009-06-09 2010-12-17 삼성전자주식회사 Method for providing gui representing link and arrangement of devices and device using the same
CN102137255B (en) * 2010-01-21 2014-09-03 联想(北京)有限公司 Portable decoder as well as display method and display system thereof
CN101783921B (en) * 2010-02-24 2013-05-01 中兴通讯股份有限公司 Method and device for expanding video conference function to external equipment
CN102999251B (en) * 2012-10-31 2016-02-10 东莞宇龙通信科技有限公司 Terminal and equipment connection management method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10100919A1 (en) * 2001-01-11 2002-07-25 Daimler Chrysler Ag Motor vehicle multimedia player with ability to record digital radio signals on a hard disk, e.g. MPEG2 or MP3 signals, so that they can be played back using a decoder and controller device
CN1801913A (en) * 2005-12-06 2006-07-12 浙江大学 Universal video player
CN101729875A (en) * 2008-10-24 2010-06-09 鸿富锦精密工业（深圳）有限公司 Multimedia file playing method and media playing device
CN101582281A (en) * 2009-04-17 2009-11-18 深圳市美赛达科技有限公司 Visual on-vehicle apparatus based on embedded microprocessor
CN101990124A (en) * 2009-08-05 2011-03-23 深圳市致芯微电子股份有限公司 Handheld television receiving device, system and method thereof
CN102547291A (en) * 2012-02-08 2012-07-04 中国电影科学技术研究所 Field programmable gate array (FPGA)-based joint photographic experts group (JPEG) 2000 image decoding device and method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112243135A (en) * 2019-07-16 2021-01-19 腾讯科技（北京）有限公司 Multimedia playing method and device
CN116136751A (en) * 2023-04-04 2023-05-19 北京智象信息技术有限公司 Mirror image method for cross-operating system of primary screen and secondary screen
CN116136751B (en) * 2023-04-04 2023-07-25 北京智象信息技术有限公司 Mirror image method for cross-operating system of primary screen and secondary screen

Also Published As

Publication number Publication date
CN107302703A (en) 2017-10-27

Similar Documents

Publication Publication Date Title
WO2020221039A1 (en) Screen projection method, electronic device and screen projection system
TWI502977B (en) Audio/video playing device, audio/video processing device, systems, and method thereof
CN108932948B (en) Audio data processing method and device, computer equipment and computer readable storage medium
CN102667924A (en) Method and apparatus for decoding audio data
US20140347434A1 (en) Meeting terminal and traffic processing method thereof
WO2017177802A1 (en) Audio/video playback method and apparatus, and computer storage medium
CN110007893B (en) Audio output method and electronic equipment
KR20150022532A (en) Method for reproducing a content, terminal thereof, and system thereof
CN110996019A (en) Screen projection method and system based on wireless transmission and storage medium
CN111092898B (en) Message transmission method and related equipment
US11196868B2 (en) Audio data processing method, server, client and server, and storage medium
CN113038292B (en) System, method and device for monitoring audio and video transmission and playing based on browser
CN111386700A (en) Multifunctional receiving device and conference system
CN112019792A (en) Conference control method, conference control device, terminal equipment and storage medium
KR102423827B1 (en) Transmission apparatus and method for controlling the transmission apparatus thereof
EP4210344A1 (en) Audio processing method, computer-readable storage medium, and electronic device
CN103647906A (en) Multipath audio and video synthetic method for embedded hard-disk video recorder
CN111885412B (en) HDMI signal screen transmission method and wireless screen transmission device
CN101325676A (en) Device for decoding audio and video
CN112087591A (en) Interactive system and method for video conference
KR100800771B1 (en) Device and method for outputting audio data using wireless terminal
CN111556406B (en) Audio processing method, audio processing device and earphone
CN113709528A (en) Play control method, play configuration device, electronic equipment and storage medium
KR20210065636A (en) System and apparatus for real-time transmitting and receiving picture of mobile multimedia teminal
CN205123890U (en) Wireless meeting display device

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17781778

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17781778

Country of ref document: EP

Kind code of ref document: A1