CN111885415A - Audio data rapid output method and display device - Google Patents
Audio data rapid output method and display device Download PDFInfo
- Publication number
- CN111885415A CN111885415A CN202010734403.4A CN202010734403A CN111885415A CN 111885415 A CN111885415 A CN 111885415A CN 202010734403 A CN202010734403 A CN 202010734403A CN 111885415 A CN111885415 A CN 111885415A
- Authority
- CN
- China
- Prior art keywords
- audio
- low
- audio data
- player
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000004044 response Effects 0.000 claims abstract description 19
- 230000005540 biological transmission Effects 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 19
- 238000012545 processing Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 10
- 230000003993 interaction Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000006243 chemical reaction Methods 0.000 description 7
- 230000005236 sound signal Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000001360 synchronised effect Effects 0.000 description 5
- 230000003111 delayed effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 239000008186 active pharmaceutical agent Substances 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000036316 preload Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R9/00—Transducers of moving-coil, moving-strip, or moving-wire type
- H04R9/02—Details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R9/00—Transducers of moving-coil, moving-strip, or moving-wire type
- H04R9/06—Loudspeakers
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses a method for rapidly outputting audio data and display equipment, which are used for reducing the time consumption of a link of the audio data and improving the use experience of a user. The method comprises the following steps: creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state; if the low-delay mode state is started and the number of the audio tracks is 1, sending audio data to a memory through the audio tracks and creating a first low-delay player; and sending the audio data in the memory to the first low-latency player so that the first low-latency player transmits the audio data to a loudspeaker.
Description
Technical Field
The present application relates to the field of audio data output technologies, and in particular, to a method for rapidly outputting audio data and a display device.
Background
When the player plays multimedia resources, the player generally performs audio and video synchronization to ensure that the images viewed by the user on the display device and the sounds heard by the user are synchronized.
However, with the development of cloud game applications, in order to improve the user experience and enable the user to see the image more quickly, as shown in fig. 2, the player outputs the sound and the image separately without performing synchronization logic. In this scenario, it is often found that the image output is advanced, the sound output is delayed, and the image and sound are not synchronized, which results in poor user experience. Therefore, there is a need in the art for a method for outputting audio data quickly to improve the user experience.
Disclosure of Invention
The embodiment of the application provides a method for rapidly outputting audio data and display equipment, which are used for improving the use experience of a user using a cloud game application.
In a first aspect, there is provided a display device comprising:
a display;
a speaker for playing audio data;
a controller for performing: creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is 1, sending audio data to a memory through the audio tracks and creating a first low-delay player;
and sending the audio data in the memory to the first low-latency player so that the first low-latency player transmits the audio data to a loudspeaker.
In some embodiments, the controller is further configured to perform: in response to a signal to stop outputting audio data, the audio track is turned off, and the first low latency player is turned off.
In a second aspect, there is provided a display device comprising:
a display;
a speaker for playing audio data;
a controller for performing: creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is more than 1, sending audio data to a memory through the audio tracks and creating a second low-delay player;
connecting the audio track with a second low-delay player so that the second low-delay player allocates a data pool for each audio track, and the audio track sends the audio data in the memory to the data pool; and mixing the audio data in the data pool to enable the second low-delay player to send the mixed audio data to a loudspeaker.
In some embodiments, the controller is further configured to perform: in response to a signal to stop outputting audio data, the audio track is turned off, and the second low latency player is turned off.
In some embodiments, the controller is configured to execute the audio track to send the audio data in the memory to the data pool according to the following steps:
the audio track transmits the audio data to the data pool through a nested word client and a nested word server.
In some embodiments, between the step of connecting the audio tracks to a second low-latency player and the second low-latency player assigning a data pool to each audio track, the controller is further configured to perform:
the audio track sends an authentication command to a second low latency player;
if the second low-latency player authenticates, the second low-latency player allocates a pool of data for each audio track.
In a third aspect, a method for fast outputting audio data is provided, the method comprising:
creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is 1, sending audio data to a memory through the audio tracks and creating a first low-delay player;
and sending the audio data in the memory to the first low-latency player so that the first low-latency player transmits the audio data to a loudspeaker.
In a fourth aspect, a method for fast outputting audio data is provided, the method comprising:
creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is more than 1, sending audio data to a memory through the audio tracks and creating a second low-delay player;
connecting the audio track with a second low-delay player so that the second low-delay player allocates a data pool for each audio track, and the audio track sends the audio data in the memory to the data pool; and mixing the audio data in the data pool to enable the second low-delay player to send the mixed audio data to a loudspeaker.
In the above embodiments, a method for fast outputting audio data and a display device are provided to reduce the time consumption of a link of audio data and improve the user experience. The method comprises the following steps: creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state; if the low-delay mode state is started and the number of the audio tracks is 1, sending audio data to a memory through the audio tracks and creating a first low-delay player; and sending the audio data in the memory to the first low-latency player so that the first low-latency player transmits the audio data to a loudspeaker.
Drawings
Fig. 1A schematically illustrates an operation scenario between the display device 200 and the control 100;
fig. 1B is a block diagram schematically illustrating a configuration of the control apparatus 100 in fig. 1A;
fig. 1C is a block diagram schematically illustrating a configuration of the display device 200 in fig. 1A;
a block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D.
Fig. 2 is a flowchart illustrating an audio data output method;
fig. 3 is a schematic diagram illustrating a GUI provided by the display apparatus 200;
a flowchart of yet another audio data output method is illustrated in fig. 4.
Detailed Description
To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.
The terms "comprises" and "comprising," and any variations thereof, as used herein, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.
Fig. 1A is a schematic diagram illustrating an operation scenario between the display device 200 and the control apparatus 100. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.
Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.
The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.
For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200 to implement the functions of the physical keys as arranged in the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
The display apparatus 200 may be implemented as a television, and may provide an intelligent network television function of a broadcast receiving television function as well as a computer support function. Examples of the display device include a digital television, a web television, a smart television, an Internet Protocol Television (IPTV), and the like.
The display device 200 may be a liquid crystal display, an organic light emitting display, a projection display device. The specific display device type, size, resolution, etc. are not limited.
The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
Fig. 1B is a block diagram illustrating the configuration of the control device 100. As shown in fig. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.
The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a power-on interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.
Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.
And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.
The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.
The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.
The output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting an image, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the output interface 150, and display the output signal in the form of an image on the display 154, in the form of audio on the sound output interface 153, or in the form of vibration on the vibration interface 152.
And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.
A hardware configuration block diagram of the display device 200 is exemplarily illustrated in fig. 1C. As shown in fig. 1C, the display apparatus 200 may further include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio input interface 285, and a power supply 290.
The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).
The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.
The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.
In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.
The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth module 222, and a wired ethernet module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.
The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include an image collector 231, such as a camera, a video camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user. A light receiver 232 may also be included to collect ambient light intensity to adapt to changes in display parameters of the display device 200, etc.
In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.
In some other exemplary embodiments, the detector 230, which may further include a sound collector, such as a microphone, may be configured to receive a sound of a user, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.
The external device interface 240 is a component for providing the controller 210 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.
The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.
The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
As shown in FIG. 1C, controller 250 includes Random Access Memory (RAM)251, Read Only Memory (ROM)252, graphics processor 253, processor 254, power-on interface 255, and communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the power interface 255 of the processor 254 are connected by a communication bus 256.
The ROM252 stores various system boot instructions. When the power-on signal is received, the display apparatus 200 starts to be powered on, and the processor 254 executes the system boot instruction in the ROM252 and copies the operating system stored in the memory 260 to the RAM251 to start running the boot operating system. After the start of the operating system is completed, the processor 254 copies the various applications in the memory 260 to the RAM251 and then starts running the various applications.
A graphic processor 253 for generating screen images of various graphic objects such as icons, images, and operation menus. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.
A processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.
In some demonstrative embodiments, processor 254 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.
The power-up interface 255 may include a first interface through an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.
The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to an icon. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a user uttering voice.
A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.
In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.
In some embodiments, the memory 260 is specifically configured to store drivers and related data for the tuner demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, and the like, external data (e.g., audio-visual data) received from the external device interface, or user data (e.g., key information, voice information, touch information, and the like) received from the user interface.
In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.
A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.
The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer and are responsible for direct interaction with users. The application layer may include a plurality of applications such as NETFLIX applications, setup applications, media center applications, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML, Cascading Style Sheets (CSS), and JavaScript.
Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.
CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.
JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through a browser, realize the communication with the kernel layer,
the middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.
The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..
A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.
Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.
The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.
Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.
The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.
And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.
And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.
The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.
And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.
And a display 275 for receiving the image signal from the output of the video processor 270 and displaying video, images and menu manipulation interfaces. For example, the display may display video from a broadcast signal received by the tuner demodulator 210, may display video input from the communicator 220 or the external device interface 240, and may display an image stored in the memory 260. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.
And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.
The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.
Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.
In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.
And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.
And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.
When the player plays multimedia resources, the player generally performs audio and video synchronization to ensure that the images viewed by the user on the display device and the sounds heard by the user are synchronized.
However, with the development of cloud game applications, in order to improve user experience and enable users to see images more quickly, a player outputs sound and images separately without performing synchronization logic. In this scenario, it is often found that the image output is advanced, the sound output is delayed, and the image and sound are not synchronized, which results in poor user experience. Therefore, there is a need in the art for a method for outputting audio data quickly to improve the user experience.
A schematic view of a GUI provided by the display device 200 is exemplarily shown in fig. 3. As shown in fig. 3, the display device may provide a GUI to the display, which includes a play interface 41.
In some embodiments, the audio data is output over an audio track (AudioTrack) when the user uses the application. The audio data is designed according to an audio channel of an android system, an executor of an audio strategy (audioFlinger) reads from a memory between a track and the executor of the audio strategy, and the audio data is sequentially subjected to audio mixing by the executor of the audio strategy, writing into a Kernel layer (Kernel) by an audio hardware abstraction layer (audioHAL), performing a sound effect processing flow by the Kernel layer, and finally sending to a loudspeaker for outputting. Illustratively, the application may be a cloud game, and the audio data may be pcm data. The sound effect processing refers to artificial or enhanced sound used to enhance sound processing of art or other content of movies, video games, music, or other media. Because the audio data needs to be mixed by an executor of an audio strategy, written into a Kernel layer (Kernel) by an audio hardware abstraction layer (AudioHAL), subjected to a sound effect processing flow, and finally sent to a loudspeaker for output, the audio data can be output from the loudspeaker within a long time.
The embodiment of the application provides a method for rapidly outputting audio data, wherein a low-delay player is utilized to directly send the audio data to a loudspeaker, so that the time consumption of a link of the audio data can be reduced, and the use experience of a user is improved.
Referring to fig. 4, the method includes: s101, responding to a signal of output audio data, creating a sound track, and determining a low-delay mode state. In some embodiments, when the audio data needs to be played, a signal of the audio data is first output, and the signal of the audio data indicates that the audio data is to be output. The low latency mode state may be turned on or off, and may be preset according to an application, and for example, the low latency mode state of the cloud game application may be turned on. In addition, in some embodiments, the user may also set the low latency mode state according to the own requirement, and how to set the low latency mode state in the embodiments of the present application is not limited as long as the technical solution of the present application is not violated.
And S102, judging whether the low-delay mode state is started or not. And if the low-delay mode state is closed, executing according to the android system audio channel design.
S103, if the low-delay mode state is open, judging the number of the audio tracks. And S104, if the number of the audio tracks is 1, sending the audio data to a memory through the audio tracks, and creating a first low-delay player.
In order to avoid confusion of system logic, in the embodiment of the present application, when a first delay player is used, mute data corresponding to audio data is further designed according to an audio channel of an android system, where the mute data is equivalent mute data generated according to the audio data and is stored in a memory, an executor (audioflag) of an audio policy in an intermediate layer reads the mute data from the memory between a track and the executor of the audio policy, and the mute data is sequentially subjected to audio mixing by the executor of the audio policy, writing in a Kernel (Kernel layer) by an AudioHAL (audio hardware abstraction layer), performing a sound effect processing procedure by the Kernel layer, and finally sending the sound effect processing procedure to a speaker for output.
Meanwhile, S105, sending the audio data in the memory to the first low-latency player, and transmitting the audio data to the loudspeaker through the first low-latency player. Steps S101-S105 are performed by the application layer in the embodiment of the present application.
In response to a signal to stop outputting audio data, the audio track is turned off, and the first low latency player is turned off.
The embodiment of the present application further provides a method for rapidly outputting audio data, where the method includes:
in response to a signal outputting audio data, a soundtrack is created and a low latency mode state is determined. The steps are the same as those in the above embodiments, and are not described herein again.
S106, if the low-delay mode state is started and the number of the audio tracks is more than 1, sending audio data to a memory through the audio tracks, and creating a second low-delay player;
s107, all audio tracks are connected with a second low-delay player, after connection, the audio tracks send authentication commands to the second low-delay player, and if the second low-delay player passes authentication, the second low-delay player allocates a data pool for each audio track. Wherein, the step of using the second delayed player for authentication can ensure the security.
And audio data in the audio track sending memory is transmitted to the data pool through a nested word Client (Socket Client) and a nested word server (Socket server). And S108, reading audio data from the data pool corresponding to each audio track by a mixer (Audio mixer) corresponding to the second low-delay player, and mixing the audio data. The second low-latency player sends the mixed audio data to a speaker.
In response to a signal to stop outputting audio data, the audio track is turned off, and the second low latency player is turned off.
In the above embodiments, a method for fast outputting audio data and a display device are provided to reduce the time consumption of a link of audio data and improve the user experience. The method comprises the following steps: creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state; if the low-delay mode state is started and the number of the audio tracks is 1, sending audio data to a memory through the audio tracks and creating a first low-delay player; and sending the audio data in the memory to the first low-latency player so that the first low-latency player transmits the audio data to a loudspeaker.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (8)
1. A display device, comprising:
a display;
a speaker for playing audio data;
a controller for performing: creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is 1, sending audio data to a memory through the audio tracks and creating a first low-delay player;
and sending the audio data in the memory to the first low-latency player so that the first low-latency player transmits the audio data to a loudspeaker.
2. The display device according to claim 1, wherein the controller is further configured to perform: in response to a signal to stop outputting audio data, the audio track is turned off, and the first low latency player is turned off.
3. A display device, comprising:
a display;
a speaker for playing audio data;
a controller for performing: creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is more than 1, sending audio data to a memory through the audio tracks and creating a second low-delay player;
connecting the audio track with a second low-delay player so that the second low-delay player allocates a data pool for each audio track, and the audio track sends the audio data in the memory to the data pool; and mixing the audio data in the data pool to enable the second low-delay player to send the audio data after mixing to a loudspeaker.
4. The display device according to claim 3, wherein the controller is further configured to perform: in response to a signal to stop outputting audio data, the audio track is turned off, and the second low latency player is turned off.
5. The display device of claim 3, wherein the controller is configured to perform the step of sending the audio data in the audio track transmission memory to the data pool according to the following steps:
the audio track transmits the audio data to the data pool through a nested word client and a nested word server.
6. The display device of claim 3, wherein between the steps of connecting the audio tracks with a second low-latency player and assigning a data pool to each audio track by the second low-latency player, the controller is further configured to perform:
the audio track sends an authentication command to a second low latency player;
if the second low-latency player authenticates, the second low-latency player allocates a pool of data for each audio track.
7. A method for fast outputting audio data, the method comprising:
creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is 1, sending audio data to a memory through the audio tracks and creating a first low-delay player;
and sending the audio data in the memory to the first low-latency player so that the first low-latency player transmits the audio data to a loudspeaker.
8. A method for fast outputting audio data, the method comprising:
creating a soundtrack in response to a signal to output audio data, and determining a low latency mode state;
if the low-delay mode state is started and the number of the audio tracks is more than 1, sending audio data to a memory through the audio tracks and creating a second low-delay player;
connecting the audio track with a second low-delay player so that the second low-delay player allocates a data pool for each audio track, and the audio track sends the audio data in the memory to the data pool; and mixing the audio data in the data pool to enable the second low-delay player to send the mixed audio data to a loudspeaker.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010734403.4A CN111885415B (en) | 2020-07-24 | 2020-07-24 | Audio data rapid output method and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010734403.4A CN111885415B (en) | 2020-07-24 | 2020-07-24 | Audio data rapid output method and display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111885415A true CN111885415A (en) | 2020-11-03 |
| CN111885415B CN111885415B (en) | 2023-04-07 |
Family
ID=73201739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010734403.4A Active CN111885415B (en) | 2020-07-24 | 2020-07-24 | Audio data rapid output method and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111885415B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114615536A (en) * | 2022-02-25 | 2022-06-10 | 海信视像科技股份有限公司 | Display device and sound effect processing method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060239657A1 (en) * | 2005-04-08 | 2006-10-26 | Amir Geva | Dedicated digital media for playing of music and video content |
| US20070087686A1 (en) * | 2005-10-18 | 2007-04-19 | Nokia Corporation | Audio playback device and method of its operation |
| US20080168076A1 (en) * | 2007-01-08 | 2008-07-10 | Inventec Multimedia & Telecom Corporation | Digital audio ripping device |
| CN108550377A (en) * | 2018-03-15 | 2018-09-18 | 北京雷石天地电子技术有限公司 | A kind of method and system that track is switched fast |
| CN109062537A (en) * | 2018-08-30 | 2018-12-21 | 倪兴炜 | A kind of reduction method, apparatus, medium and the equipment of audio frequency delay |
| CN109144464A (en) * | 2018-08-27 | 2019-01-04 | 歌尔科技有限公司 | A kind of method, apparatus and Android device of audio output |
| CN110502207A (en) * | 2019-08-14 | 2019-11-26 | 深圳创维－Rgb电子有限公司 | Mute method, system, equipment and the storage medium of background sound |
| CN110545456A (en) * | 2018-05-29 | 2019-12-06 | 北京字节跳动网络技术有限公司 | Synchronous playing method and device of media files and storage medium |
| CN110989816A (en) * | 2019-09-24 | 2020-04-10 | 华为技术有限公司 | Application processing method and device and storage medium |
| US20200162820A1 (en) * | 2011-01-25 | 2020-05-21 | Sonos, Inc. | Playback Device Pairing |
-
2020
- 2020-07-24 CN CN202010734403.4A patent/CN111885415B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060239657A1 (en) * | 2005-04-08 | 2006-10-26 | Amir Geva | Dedicated digital media for playing of music and video content |
| US20070087686A1 (en) * | 2005-10-18 | 2007-04-19 | Nokia Corporation | Audio playback device and method of its operation |
| US20080168076A1 (en) * | 2007-01-08 | 2008-07-10 | Inventec Multimedia & Telecom Corporation | Digital audio ripping device |
| US20200162820A1 (en) * | 2011-01-25 | 2020-05-21 | Sonos, Inc. | Playback Device Pairing |
| CN108550377A (en) * | 2018-03-15 | 2018-09-18 | 北京雷石天地电子技术有限公司 | A kind of method and system that track is switched fast |
| CN110545456A (en) * | 2018-05-29 | 2019-12-06 | 北京字节跳动网络技术有限公司 | Synchronous playing method and device of media files and storage medium |
| CN109144464A (en) * | 2018-08-27 | 2019-01-04 | 歌尔科技有限公司 | A kind of method, apparatus and Android device of audio output |
| CN109062537A (en) * | 2018-08-30 | 2018-12-21 | 倪兴炜 | A kind of reduction method, apparatus, medium and the equipment of audio frequency delay |
| CN110502207A (en) * | 2019-08-14 | 2019-11-26 | 深圳创维－Rgb电子有限公司 | Mute method, system, equipment and the storage medium of background sound |
| CN110989816A (en) * | 2019-09-24 | 2020-04-10 | 华为技术有限公司 | Application processing method and device and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 老欧说安卓: ""Android开发笔记（一百二十六）自定义音乐播放器"", 《腾讯云》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114615536A (en) * | 2022-02-25 | 2022-06-10 | 海信视像科技股份有限公司 | Display device and sound effect processing method |
| CN114615536B (en) * | 2022-02-25 | 2024-05-28 | 海信视像科技股份有限公司 | Display device and sound effect processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111885415B (en) | 2023-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111200746B (en) | Method for awakening display equipment in standby state and display equipment | |
| CN112272373B (en) | Bluetooth device type switching method and display device | |
| CN111654743B (en) | Audio playing method and display device | |
| CN111601142B (en) | Subtitle display method and display equipment | |
| CN111343492B (en) | Display method and display device of browser in different layers | |
| CN111246309A (en) | Method for displaying channel list in display device and display device | |
| CN111601144B (en) | Streaming media file playing method and display equipment | |
| CN111629249B (en) | Method for playing startup picture and display device | |
| CN111045557A (en) | Moving method of focus object and display device | |
| CN112004126A (en) | Search result display method and display device | |
| CN111901653A (en) | Configuration method of external sound equipment of display equipment and display equipment | |
| CN111726673A (en) | Channel switching method and display device | |
| CN111726674B (en) | HbbTV application starting method and display equipment | |
| CN112040308A (en) | HDMI channel switching method and display device | |
| CN111857363A (en) | Input method interaction method and display equipment | |
| CN111614995A (en) | Menu display method and display equipment | |
| CN111641856A (en) | Prompt message display method for guiding user operation in display equipment and display equipment | |
| CN111526401A (en) | Video playing control method and display equipment | |
| CN111885415B (en) | Audio data rapid output method and display device | |
| CN112040285B (en) | Interface display method and display equipment | |
| CN113010074A (en) | Webpage Video control bar display method and display equipment | |
| CN113329246A (en) | Display device and shutdown method | |
| CN111757160A (en) | Method for starting sports mode and display equipment | |
| CN111601147A (en) | Content display method and display equipment | |
| CN113382291A (en) | Display device and streaming media playing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |