CN111601159B

CN111601159B - Display device, digital audio signal generation method and digital audio signal processing method

Info

Publication number: CN111601159B
Application number: CN202010458759.XA
Authority: CN
Inventors: 陈俊宁; 王建亮; 刘加山
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-05-27
Filing date: 2020-05-27
Publication date: 2022-04-01
Anticipated expiration: 2040-05-27
Also published as: CN111601159A

Abstract

The application discloses a display device and a method for generating and processing a digital audio signal, wherein a controller of the display device is used for receiving and decoding an input signal and generating the digital audio signal which carries out data transmission based on a preset bit number, wherein the main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest part of the preset bit number is used for transmitting low-frequency data; sending the digital audio signal to a power amplifier; the power amplifier is used for respectively outputting a left channel signal, a right channel signal and a bass signal to the loudspeaker according to the left channel data, the right channel data and the low-frequency data in the digital audio signal. This application uses low frequency data to fill digital audio signal's vacancy, not only improves audio data transmission efficiency, still realizes the independent transmission to low frequency data, saves low frequency filtering operation, consequently can avoid the loss of low frequency data, makes the bass effect reach the optimization.

Description

Display device, digital audio signal generation method and digital audio signal processing method

Technical Field

The present application relates to the field of internet technologies, and in particular, to a display device and a method for generating and processing a digital audio signal.

Background

An I2S (Inter-IC Sound) bus, also called an integrated circuit built-in audio bus, is a bus standard established for audio data transmission between digital audio devices, is specially used for data transmission between audio devices, and is widely used in various multimedia systems. The I2S bus transmits the clock and data signals along separate conductors, and by separating the clock and data signals, distortion induced by time differences is avoided, and resistance to audio jitter is achieved.

In the technical field of display devices, a controller (SOC) of a display device transmits digital audio signals containing left channel data and right channel data generated by the SOC to a power Amplifier (AMP) through an I2S protocol, and the power amplifier outputs left channel sound signals and right channel sound signals to a left speaker and a right speaker respectively according to the received left channel data and right channel data for playing. If bass needs to be played independently, low-frequency data needs to be filtered out from the received left channel data and right channel data through the filter device so as to output bass signals to the woofer for playing.

However, the scheme of filtering the low-frequency data from the left channel data and the right channel data is very easy to cause the loss of the low-frequency data, and is not favorable for displaying the bass effect.

Disclosure of Invention

The application provides a display device and a method for generating and processing a digital audio signal, which aim to solve the problem that low-frequency data is easily lost due to the scheme of filtering the low-frequency data from left channel data and right channel data.

In a first aspect, the present application provides a display device comprising:

a display;

a controller for receiving an input signal; decoding the input signal and generating a digital audio signal which carries out data transmission based on a preset bit number, wherein the main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest part of the preset bit number is used for transmitting low-frequency data; sending the digital audio signal to a power amplifier;

a power amplifier connected to the controller via an I2S protocol for receiving digital audio signals; and respectively outputting a left channel signal, a right channel signal and a bass signal to a loudspeaker according to the left channel data, the right channel data and the low-frequency data in the digital audio signal.

In a second aspect, the present application provides a method for generating a digital audio signal, including:

receiving an input signal;

decoding the input signal and generating a digital audio signal which carries out data transmission based on a preset bit number, wherein the main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest part of the preset bit number is used for transmitting low-frequency data;

and sending the digital audio signal to a power amplifier, wherein the power amplifier is used for respectively outputting a left channel signal, a right channel signal and a bass signal to a loudspeaker according to left channel data, right channel data and low-frequency data in the digital audio signal.

In a third aspect, the present application provides a method for processing a digital audio signal, the method comprising:

receiving a digital audio signal transmitted based on a preset bit number, wherein the main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest part of the preset bit number is used for transmitting low-frequency data;

extracting the main part from the digital audio signal for outputting a left channel signal or a right channel signal;

extracting the remaining portion from the digital audio signal for outputting the bass signal.

According to the technical scheme, the vacancy of the digital audio signal is filled by using the low-frequency data, so that the vacancy multiplexing of the digital audio signal is realized, the audio data transmission efficiency is improved, the low-frequency data is independently transmitted, and the low-frequency filtering operation is saved, so that the loss of the low-frequency data can be avoided, and the bass effect is optimized.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment;

fig. 2 is a block diagram exemplarily showing a hardware configuration of a display device 200 according to an embodiment;

fig. 3 is a block diagram exemplarily showing a hardware configuration of the control apparatus 100 according to the embodiment;

fig. 4 is a diagram exemplarily showing a functional configuration of the display device 200 according to the embodiment;

fig. 5 is a diagram exemplarily showing a software configuration in the display device 200 according to the embodiment;

fig. 6 is a diagram exemplarily showing a configuration of an application program in the display device 200 according to the embodiment;

fig. 7 schematically illustrates a user interface in the display device 200 according to an embodiment;

FIG. 8 illustrates a process for processing a digital audio signal;

fig. 9 illustrates another digital audio signal processing procedure;

fig. 10 is a flow chart illustrating a method of generating a digital audio signal;

a flow chart of a method of processing a digital audio signal is illustrated in fig. 11.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application) that is typically wirelessly controllable over a relatively short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100.

The control device 100 may control the display device 200 in a wireless or other wired manner by using a remote controller, including infrared protocol communication, bluetooth protocol communication, other short-distance communication manners, and the like. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

For example, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the display device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 300, and control the display device 200 by controlling a user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The servers 400 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like.

A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2. As shown in fig. 2, the display device 200 includes at least one of a controller 210, a tuner 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 260-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.

A display 280 for receiving the image signal from the video processor 260-1 and displaying the video content and image and components of the menu manipulation interface. The display 280 includes a display screen assembly for presenting a picture, and a driving assembly for driving the display of an image. The video content may be displayed from broadcast television content, or may be broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.

Meanwhile, the display 280 simultaneously displays a user manipulation UI interface generated in the display apparatus 200 and used to control the display apparatus 200.

And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen.

The communication interface 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a bluetooth communication protocol chip 232, a wired ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown).

The display apparatus 200 may establish control signal and data signal transmission and reception with an external control apparatus or a content providing apparatus through the communication interface 230. And an infrared receiver, an interface device for receiving an infrared control signal for controlling the apparatus 100 (e.g., an infrared remote controller, etc.).

The detector 240 is a signal used by the display device 200 to collect an external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the intensity of ambient light, and parameters such as parameter changes can be adaptively displayed by collecting the ambient light.

The image acquisition device 241, such as a camera and a camera, may be used to acquire an external environment scene, acquire attributes of a user or interact gestures with the user, adaptively change display parameters, and recognize gestures of the user, so as to implement an interaction function with the user.

In some other exemplary embodiments, the detector 240, a temperature sensor, etc. may be provided, for example, by sensing the ambient temperature, and the display device 200 may adaptively adjust the display color temperature of the image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.

In other exemplary embodiments, the detector 240, and a sound collector, such as a microphone, may be used to receive a user's voice, a voice signal including a control instruction from the user to control the display device 200, or collect an ambient sound for identifying an ambient scene type, and the display device 200 may adapt to the ambient noise.

The input/output interface 250 controls data transmission between the display device 200 of the controller 210 and other external devices. Such as receiving video and audio signals or command instructions from an external device.

Input/output interface 250 may include, but is not limited to, the following: any one or more of high definition multimedia interface HDMI interface 251, analog or data high definition component input interface 253, composite video input interface 252, USB input interface 254, RGB ports (not shown in the figures), etc.

In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned plurality of interfaces.

The tuning demodulator 220 receives the broadcast television signals in a wired or wireless receiving manner, may perform modulation and demodulation processing such as amplification, frequency mixing, resonance, and the like, and demodulates the television audio/video signals carried in the television channel frequency selected by the user and the EPG data signals from the plurality of wireless or wired broadcast television signals.

The tuner demodulator 220 is responsive to the user-selected television signal frequency and the television signal carried by the frequency, as selected by the user and controlled by the controller 210.

The tuner-demodulator 220 may receive signals in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the modulation mode can be digital modulation or analog modulation. Depending on the type of television signal received, both analog and digital signals are possible.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the input/output interface 250.

The video processor 260-1 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

Illustratively, the video processor 260-1 includes at least one of a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

The audio processor 260-2 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification processing, and the like to obtain an audio signal that can be played in the speaker.

In other exemplary embodiments, video processor 260-1 may comprise one or more chips. The audio processor 260-2 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated together with the controller 210 in one or more chips.

An audio output 272, which receives the sound signal output from the audio processor 260-2 under the control of the controller 210, such as: the speaker 272, and the external sound output terminal 274 that can be output to the generation device of the external device, in addition to the speaker 272 carried by the display device 200 itself, such as: an external sound interface or an earphone interface and the like.

The power supply provides power supply support for the display device 200 from the power input from the external power source under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply interface installed outside the display device 200 to provide an external power supply in the display device 200.

A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

For example, the user inputs a user command through the remote controller 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 210 according to the user input, and the display device 200 responds to the user input.

In some embodiments, a user may enter a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The controller 210 controls the operation of the display apparatus 200 and responds to the user's operation through various software control programs stored in the memory 290.

As shown in fig. 2, the controller 210 includes a RAM213 and a ROM214, and a graphic processor 216, a CPU processor 212, a communication interface 218, such as: a first interface 218-1 through an nth interface 218-n, and a communication bus. The RAM213 and the ROM214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If the display apparatus 200 starts power-on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM, copies the operating system stored in the memory 290 to the RAM213, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM213, and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for one operation in a standby mode or the like.

The controller 210 may control the overall operation of the display apparatus 100. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes a memory for storing various software modules for driving the display device 200. Such as: various software modules stored in memory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

Wherein the basic module is a bottom layer software module for signal communication among the various hardware in the postpartum care display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A block diagram of the configuration of the control apparatus 100 according to an exemplary embodiment is exemplarily shown in fig. 3. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control device 100 is configured to control the display device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. Such as: the user responds to the channel up and down operation by operating the channel up and down keys on the control device 100.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display apparatus 200 according to user demands.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similar to the control device 100 after installing an application that manipulates the display device 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM113 and ROM114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip, a bluetooth module, an NFC module, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the various elements of the control device 100 under the control of the controller 110. A battery and associated control circuitry.

Fig. 4 is a diagram schematically illustrating a functional configuration of the display device 200 according to an exemplary embodiment. As shown in fig. 4, the memory 290 is used to store an operating system, an application program, contents, user data, and the like, and performs system operations for driving the display device 200 and various operations in response to a user under the control of the controller 210. The memory 290 may include volatile and/or nonvolatile memory.

The memory 290 is specifically configured to store an operating program for driving the controller 210 in the display device 200, and to store various application programs installed in the display device 200, various application programs downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically used for storing drivers and related data such as the audio/video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuning demodulator 220, the input/output interface of the detector 240, and the like.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The memory 290, for example, includes at least one of a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module, and the like. The controller 210 performs functions such as: a broadcast television signal reception demodulation function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction recognition function, a communication control function, an optical signal reception function, an electric power control function, a software control platform supporting various functions, a browser function, and the like.

Fig. 5 is a block diagram illustrating a configuration of a software system in the display apparatus 200 according to an exemplary embodiment.

As shown in fig. 5, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary for data processing performed between application programs and hardware components. In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display screen, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controllable process management, including runtime applications and the like.

The event transmission system 2914, which may be implemented within the operating system 2911 or within the application program 2912, in some embodiments, on the one hand, within the operating system 2911 and on the other hand, within the application program 2912, is configured to listen for various user input events, and to refer to handlers that perform one or more predefined operations in response to the identification of various types of events or sub-events, depending on the various events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control device 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting gestures through gesture recognition, inputting sub-events through remote control key commands of the control equipment and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout manager 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, and other various execution operations related to the layout of the interface.

As shown in fig. 6, the application layer 2912 contains various applications that may also be executed at the display device 200. The application may include, but is not limited to, one or more applications such as: at least one of a live television application, a video-on-demand application, a media center application, an application center, a gaming application, and the like.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 7. As shown in fig. 7, the user interface includes a plurality of view display areas, illustratively, a first view display area 201 and a play screen 202, wherein the play screen includes a layout of one or more different items. And a selector in the user interface indicating that the item is selected, the position of the selector being movable by user input to change the selection of a different item.

It should be noted that the multiple view display areas may present display screens of different hierarchies. For example, a first view display area may present video chat project content and a second view display area may present application layer project content (e.g., web page video, VOD presentations, application screens, etc.).

Optionally, the different view display areas are presented with different priorities, and the display priorities of the view display areas are different among the view display areas with different priorities. If the priority of the system layer is higher than that of the application layer, when the user uses the acquisition selector and picture switching in the application layer, the picture display of the view display area of the system layer is not blocked; and when the size and the position of the view display area of the application layer are changed according to the selection of the user, the size and the position of the view display area of the system layer are not influenced.

The display frames of the same hierarchy can also be presented, at this time, the selector can switch between the first view display area and the second view display area, and when the size and the position of the first view display area are changed, the size and the position of the second view display area can be changed along with the change.

In some embodiments, any one of the regions in fig. 7 may display a picture captured by the camera.

In the I2S standard, both the hardware interface specification and the format of the digital audio data are specified. I2S has 3 main signals, serial clock SCLK, frame clock LRCK (also known as WS) and serial data SDATA, respectively. The serial clock SCLK is also called a Bit Clock (BCLK), that is, the serial clock SCLK has 1 pulse corresponding to each bit of data of the digital audio, and the frequency of the SCLK is 2 × sampling frequency × sampling bit number; the frame clock LRCK is used for switching data of the left channel and the right channel, the data of the right channel is transmitted when the LRCK is 1, the data of the left channel is transmitted when the LRCK is 0, and the frequency of the LRCK is equal to the sampling frequency; serial data SDATA, which is audio data represented by two's complement. Sometimes, in order to make the synchronization between systems better, it is necessary to transmit a signal MCLK, called the master Clock, also called the system Clock (Sys Clock), which is 256 times or 384 times the sampling frequency.

Regardless of how many bits of valid data are in the signal in I2S format, the most significant bit of data always appears at the 2 nd SCLK pulse after the LRCK change (i.e., the start of a frame). This allows the number of significant bits to be different between the receiving side and the transmitting side.

In some embodiments, if the number of significant bits that the receiving end can handle is less than that of the transmitting end, the redundant low-order data in the data frame can be discarded; on the contrary, if the receiving end can process more significant digits than the transmitting end, the rest bits can be self-complemented. The synchronization mechanism facilitates interconnection of digital audio devices without causing data skew. In order to ensure correct transmission of the digital audio signal, the transmitting end and the receiving end should use the same data format and length.

Referring to fig. 8, in some embodiments, a controller (e.g., controller 210 shown in fig. 2) of the display device transmits digital audio signals containing left channel data and right channel data generated by the controller via I2S protocol to a power amplifier, and the power amplifier outputs left channel sound signals and right channel sound signals to a left speaker and a right speaker for playing according to the received left channel data and right channel data, respectively. If bass needs to be played independently, low-frequency data needs to be filtered out from the received left channel data and right channel data through the filter device so as to output bass signals to the woofer for playing.

In the above embodiment, the scheme of filtering the low-frequency data from the left channel data and the right channel data is very easy to cause the loss of the low-frequency data, and is not favorable for displaying the bass effect.

The inventor found in the process of solving the above problems that there is a certain amount of bit redundancy in the transmission of audio data using the I2S protocol, for example, I2S supports 24-bit transmission, while in the actual transmission of left/right channel data, only 16 bits are used, and the remaining 8 bits are usually self-complemented (e.g. filled with 0) by the receiving end.

Based on this, in some embodiments, a way of transmitting 2.1 channel data (i.e., left channel data, right channel data, and low frequency data) through the I2S channel is provided, that is, while transmitting the left/right channel data through the I2S, the low frequency data is transmitted to the frequency amplifier together by using the redundant bits in the digital audio signal, so that separate transmission of the low frequency data is realized, instead of filtering the low frequency data from the left/right channel data, thereby avoiding loss of the low frequency data, and facilitating presentation of bass effect.

In some embodiments, the controller is connected to an audio processor (e.g., the audio processor 260-2 shown in fig. 2), a power amplifier (not shown in the figure) and an audio output (e.g., the audio output 270 shown in fig. 2), receives an externally input audio signal through the audio processor, performs decompression and decoding according to a standard codec protocol of the input signal, performs noise reduction, digital-to-analog conversion, amplification processing, and the like to obtain a digital audio signal, and transmits the digital audio signal to the power amplifier; the power amplifier processes the received digital audio signal and outputs a sound signal which can be played in a loudspeaker.

In some embodiments, under the control of the controller, the audio processor receives an input signal, decodes the received input signal, and generates a digital audio signal for data transmission based on a preset number of bits (or a preset bit rate, such as 16bit or 24bit), wherein a main part (data bits) of the preset number of bits is used for transmitting left channel data or right channel data, and a remaining part (data bits) of the preset number of bits is used for transmitting low-frequency data; the digital audio signal is sent to a power amplifier.

For example, the SDATA format for transmission based on the predetermined number of bits N is as follows, where the 1 st bit to the (N-i-1) th bit are the main portion and the (N-i) th to the nth bit are the remaining portions.

In some embodiments, the digital audio signal comprises a left channel signal segment and a right channel signal segment, and the low frequency data comprises a low bit portion and a high bit portion. The left channel signal segment comprises a main part and a residual part, wherein the main part is used for transmitting left channel data, and the residual part is used for transmitting a high-order part of low-frequency data; the right channel signal segment includes a main portion for transmitting right channel data and a remaining portion for transmitting high order portions of low frequency data.

For example, the SDATA format for transmission based on the preset number of bits N is as follows, where, for the left channel signal segment and the right channel signal segment, the 1 st bit to the (N-i-1) th bit are the main part, and the (N-i) th to the nth bit are the remaining parts.

In the above embodiment, the vacancy of the digital audio signal is filled with the low-frequency data, so that not only is the multiplexing of the vacancy of the digital audio signal realized and the transmission efficiency of the audio data improved, but also the independent transmission of the low-frequency data is realized and the low-frequency filtering operation is saved, thereby avoiding the loss of the low-frequency data and optimizing the bass effect.

In some embodiments, the digital audio signal is transmitted based on 24-bit data, and the bit rate thereof is 24 bits, in the 24-bit data, the first 16 bits are used as a main part for transmitting left channel data or right channel data, and the last 8 bits are used as a remaining part for transmitting low-frequency data. In some embodiments, the bit rate of the low frequency data is 16, and in the 16-bit data, the last 8 bits are the lower portion transmitted in the remaining portion of the right channel signal segment and the first 8 bits are the upper portion transmitted in the remaining portion of the left channel signal segment.

For example, the SDATA format for transmitting data based on 24 bits is as follows, wherein, for the left channel signal segment and the right channel signal segment, the 1 st bit to the 16 th bit (i.e., the first 16 bits) are the main portions, and the 17 th bit to the 24 th bit (i.e., the last 8 bits) are the remaining portions.

In the above embodiment, the first 8 bits of the low frequency data are 1-8 bits, and the last 8 bits are 9-16 bits.

In some embodiments, under the control of the controller, the power amplifier receives a digital audio signal transmitted based on the I2S protocol and outputs a left channel signal, a right channel signal, and a bass signal to the speaker according to left channel data, right channel data, and low frequency data in the digital audio signal, respectively.

In some embodiments, under control of the controller, the power amplifier extracts a main portion from the digital audio signal for outputting a left channel signal or a right channel signal; for example, when a left channel signal segment transmitted based on 24-bit data is received, the front 16-bit data is extracted from the left channel signal segment and used for outputting a left channel sound signal to a left speaker for playing, and when a right channel signal segment transmitted based on 24-bit data is received, the front 16-bit data is extracted from the right channel signal segment and used for outputting a right channel sound signal to a right speaker for playing.

In some embodiments, under control of the controller, the power amplifier extracts a remaining portion from the digital audio signal for outputting the bass signal. For example, when a left channel signal segment transmitted based on 24-bit data is received, the last 8-bit data is extracted from the left channel signal segment, and when a right channel signal segment transmitted based on 24-bit data is received, the last 8-bit data is extracted from the right channel signal segment; and outputting bass signals to the woofer according to the 16bit data extracted from the left channel signal section and the right channel signal section.

In some embodiments, a left bass signal is output to a left woofer and a right bass signal identical to the left bass signal is output to a right woofer according to low frequency data extracted from the digital audio signal.

Illustratively, one bass signal data format is as follows:

referring to fig. 9, in some embodiments, the audio output of the display device includes a left speaker for playing a left channel sound signal input by the power amplifier, a right speaker for playing a right channel sound signal input by the power amplifier, a left woofer for playing a left bass signal input by the power amplifier, and/or a right woofer for playing a right bass signal input by the power amplifier.

According to the above embodiments, the present application also provides a method for generating a digital audio signal, which is applied to an audio processor. Fig. 10 is a flowchart of a method for generating a digital audio signal according to some exemplary embodiments of the present application, as shown in fig. 10, the method may include:

step 101, receiving an input signal.

And 102, decoding the input signal and generating a digital audio signal for data transmission based on a preset bit number, wherein a main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest of the preset bit number is used for transmitting low-frequency data.

In some embodiments, the digital audio signal comprises a left channel signal segment and a right channel signal segment, the low frequency data comprising a low bit portion and a high bit portion; the main portion of the left channel signal segment is used for transmitting the left channel data, the remaining portion of the left channel signal segment is used for transmitting the high-order portion of the low-frequency data, the main portion of the right channel signal segment is used for transmitting the right channel data, and the remaining portion of the right channel signal segment is used for transmitting the low-order portion of the low-frequency data.

In some embodiments, the digital audio signal is data-transmitted based on 24-bit data, the first 16 bits of the 24-bit data being a main portion for transmitting left channel data or right channel data, and the last 8 bits of the 24-bit data being a remaining portion for transmitting low-frequency data; the low frequency data includes 16 bits of data, the last 8 bits of the 16 bits of data being a lower portion for transmission in the remaining portion of the right channel signal segment, and the first 8 bits of the 16 bits of data being an upper portion for transmission in the remaining portion of the left channel signal segment.

And 103, sending the digital audio signal to a power amplifier, wherein the power amplifier is used for respectively outputting a left channel signal, a right channel signal and a bass signal to a loudspeaker according to left channel data, right channel data and low-frequency data in the digital audio signal.

According to the above embodiments, the present application also provides a method for processing a digital audio signal, which is applied to a power amplifier. Fig. 11 is a flowchart illustrating a method for processing a digital audio signal according to some exemplary embodiments of the present application, where as shown in fig. 11, the method may include:

step 111, receiving a digital audio signal transmitted based on a preset number of bits, wherein a main part of the preset number of bits is used for transmitting left channel data or right channel data, and a remaining part of the preset number of bits is used for transmitting low-frequency data;

step 112, extracting the main part from the digital audio signal for outputting a left channel signal or a right channel signal; extracting the remaining portion from the digital audio signal for outputting the bass signal.

In some embodiments, the digital audio signal comprises a left channel signal segment and a right channel signal segment, the low frequency data comprising a low bit portion and a high bit portion; a main portion of the left channel signal segment is used for transmitting the left channel data, a remaining portion of the left channel signal segment is used for transmitting a high-order portion of the low-frequency data, a main portion of the right channel signal segment is used for transmitting right channel data, and a remaining portion of the right channel signal segment is used for transmitting a low-order portion of the low-frequency data;

extracting a high-order portion of the low-frequency data from the left channel signal and a low-order portion of the low-frequency data from the right channel signal; according to the low-order part with the high-order part, generate left bass signal and with the right bass signal of left bass signal carrying the same data, left bass signal is used for exporting to left woofer, right bass signal is used for exporting to right woofer.

And 113, outputting the left channel signal, the right channel signal and the bass signal to a loudspeaker.

In some embodiments, the audio output of the display device includes a left speaker, a right speaker, a left woofer, and a right woofer, the left channel sound signal being output to the left speaker, the right channel sound signal being output to the right speaker, the left woofer being output to the left woofer, the right woofer being output to the right woofer.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments of the audio digital signal generating and processing method provided by the present invention when executed, and when the controller of the display device provided by the present application runs the computer program instructions, the controller executes the steps in which the controller provided by the present application is configured. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

The same and similar parts in the various embodiments in this specification may be referred to each other. In particular, for the embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the description in the method embodiments.

The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.

Claims

1. A display device, comprising:

a display;

a controller for receiving an input signal; decoding the input signal and generating a digital audio signal which carries out data transmission based on a preset bit number, wherein the main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest part of the preset bit number is used for transmitting low-frequency data;

sending the digital audio signal to a power amplifier, wherein the digital audio signal comprises a left channel signal segment and a right channel signal segment, and the low-frequency data comprises a low-bit part and a high-bit part; a main portion of the left channel signal segment is used for transmitting the left channel data, a remaining portion of the left channel signal segment is used for transmitting a high-order portion of the low-frequency data, a main portion of the right channel signal segment is used for transmitting right channel data, and a remaining portion of the right channel signal segment is used for transmitting a low-order portion of the low-frequency data;

2. The display device according to claim 1, wherein the power amplifier outputs a left channel signal, a right channel signal, and a bass signal according to left channel data, right channel data, and low frequency data in the digital audio signal, respectively, and comprises:

3. The display device of claim 2, wherein the power amplifier extracts the remaining portion from a digital audio signal for outputting the bass signal, comprising:

extracting a high-order portion of the low-frequency data from the left channel signal and a low-order portion of the low-frequency data from the right channel signal;

according to the low-order part with the high-order part, generate left bass signal and with the right bass signal of left bass signal carrying the same data, left bass signal is used for exporting to left woofer, right bass signal is used for exporting to right woofer.

4. The display device according to any one of claims 1 to 3, wherein the digital audio signal is subjected to data transmission based on 24-bit data, wherein the first 16 bits of the 24-bit data are for transmitting left channel data or right channel data, and the last 8 bits of the 24-bit data are for transmitting low-frequency data;

the low frequency data includes 16 bits of data, the last 8 bits of the 16 bits of data being a lower portion for transmission in the remaining portion of the right channel signal segment, and the first 8 bits of the 16 bits of data being an upper portion for transmission in the remaining portion of the left channel signal segment.

5. A method of generating a digital audio signal, the method comprising:

receiving an input signal;

decoding the input signal and generating a digital audio signal which carries out data transmission based on a preset bit number, wherein the main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest part of the preset bit number is used for transmitting low-frequency data; wherein the digital audio signal comprises a left channel signal segment and a right channel signal segment, and the low frequency data comprises a low order portion and a high order portion;

a main portion of the left channel signal segment is used for transmitting the left channel data, a remaining portion of the left channel signal segment is used for transmitting a high-order portion of the low-frequency data, a main portion of the right channel signal segment is used for transmitting right channel data, and a remaining portion of the right channel signal segment is used for transmitting a low-order portion of the low-frequency data;

6. The method according to claim 5, wherein the digital audio signal is data-transmitted based on 24 bits of data, the first 16 bits of the 24 bits of data are for transmitting left channel data or right channel data, and the last 8 bits of the 24 bits of data are for transmitting low-frequency data;

7. A method of processing a digital audio signal, the method comprising:

receiving a digital audio signal transmitted based on a preset bit number, wherein the main part of the preset bit number is used for transmitting left channel data or right channel data, and the rest part of the preset bit number is used for transmitting low-frequency data; the digital audio signal comprises a left channel signal segment and a right channel signal segment, and the low-frequency data comprises a low-order part and a high-order part;

the remaining portion is extracted from the digital audio signal for outputting a bass signal.

8. The method of claim 7,

said extracting said remaining portion from said digital audio signal for outputting said bass signal, comprising: