CN113515249B

CN113515249B - Device for supporting variable refresh rate signal for intelligent display equipment

Info

Publication number: CN113515249B
Application number: CN202110622550.7A
Authority: CN
Inventors: 杨元成; 姜建德
Original assignee: Qingdao Xinxin Microelectronics Technology Co Ltd
Current assignee: Qingdao Xinxin Microelectronics Technology Co Ltd
Priority date: 2021-06-04
Filing date: 2021-06-04
Publication date: 2023-10-24
Anticipated expiration: 2041-06-04
Also published as: CN113515249A

Abstract

The application relates to the technical field of communication and discloses a device for supporting a variable refresh rate signal for intelligent display equipment. Thereby enabling the device to support both variable and fixed refresh rate signals.

Description

Device for supporting variable refresh rate signal for intelligent display equipment

Technical Field

The application relates to the technical field of communication, in particular to a device for supporting variable refresh rate signals for intelligent display equipment.

Background

With the push of the HDMI2.1 (high definition multimedia interface ) standard, in addition to the function of displaying a high resolution signal and a high refresh rate signal through a smart display device, the display of a variable refresh rate (VRR, variable refresh rate) signal makes the user experience better, and especially for game players, the variable refresh rate signal makes the game picture feel higher, which can reduce or eliminate the problems of picture lag, jamming, and frame tearing. However, the current device supporting the variable refresh rate signal can only support the variable refresh rate signal, the device supporting the fixed refresh rate signal can only support the fixed refresh rate signal, and the device supporting the variable refresh rate signal has higher cost due to higher configuration, so that a device capable of supporting both the variable refresh rate signal and the fixed refresh rate signal is needed.

Disclosure of Invention

The embodiment of the application provides a device for supporting variable refresh rate signals for intelligent display equipment, which can support both variable refresh rate signals and fixed refresh rate signals.

An embodiment of the present application provides an apparatus for supporting a variable refresh rate signal for an intelligent display device, including: the device comprises a first channel selection unit, a first processing unit, a second processing unit and a brightness compensation unit;

the first channel selecting unit is configured to transmit the first fixed refresh rate signal to the first processing unit if the received input signal is a first fixed refresh rate signal, and transmit the first variable refresh rate signal to the second processing unit if the received input signal is a first variable refresh rate signal;

the first processing unit is used for optimizing the image quality of the first fixed refresh rate signal to obtain a second fixed refresh rate signal, and inputting the second fixed refresh rate signal to the second processing unit;

the second processing unit is configured to perform signal model fusion and brightness adjustment on the second fixed refresh rate signal to obtain a third fixed refresh rate signal, and input the third fixed refresh rate signal to the brightness compensation unit; performing signal model fusion and brightness adjustment on the first variable refresh rate signal to obtain a second variable refresh rate signal, and inputting the second variable refresh rate signal to a first display;

The brightness compensation unit is configured to perform brightness compensation on the third fixed refresh rate signal to obtain a fourth fixed refresh rate signal, and input the fourth fixed refresh rate signal to the first display.

In some possible embodiments, the apparatus further comprises: a second channel selection unit, a third processing unit, and a fourth processing unit;

the second processing unit is further configured to input the second variable refresh rate signal to the second channel selection unit if the second variable refresh rate signal does not match the first display;

the brightness compensation unit is further configured to input the fourth fixed refresh rate signal to the second channel selection unit if the fourth fixed refresh rate signal is not matched with the first display;

the second channel selecting unit is configured to transmit the fourth fixed refresh rate signal to the third processing unit if the received signal is the fourth fixed refresh rate signal; transmitting the second variable refresh rate signal to the fourth processing unit if the received signal is the second variable refresh rate signal;

the third processing unit is configured to perform optimization processing on the image quality of the fourth fixed refresh rate signal to obtain a fifth fixed refresh rate signal, and input the fifth fixed refresh rate signal to the fourth processing unit;

The fourth processing unit is configured to perform brightness adjustment and timing control processing on the second variable refresh rate signal or the fifth fixed refresh rate signal, and input a signal obtained by the processing to a second display.

In some possible embodiments, the first processing unit comprises: the device comprises a first image preprocessing subunit, a first cache subunit, a first image color adjustment subunit and a first motion estimation and compensation subunit;

the first buffer subunit is configured to buffer the first fixed refresh rate signal with a specified frame number;

the first image preprocessing subunit is configured to obtain the first fixed refresh rate signal from the first cache subunit, perform noise reduction processing on the first fixed refresh rate signal, obtain a sixth fixed refresh rate signal, and input the sixth fixed refresh rate signal to the first image color adjustment subunit;

the first image color adjustment subunit is configured to perform color enhancement processing on the sixth fixed refresh rate signal to obtain a seventh fixed refresh rate signal, and input the seventh fixed refresh rate signal to the first motion estimation and compensation subunit;

The first motion estimation and compensation subunit is configured to perform motion estimation and motion compensation on the seventh fixed refresh rate signal to obtain the second fixed refresh rate signal, and input the second fixed refresh rate signal to the second processing unit.

In some possible embodiments, the second processing unit comprises: a signal model fusion subunit, a first local backlight control subunit;

the signal model fusion subunit is configured to perform signal model fusion on the received second fixed refresh rate signal or the received first variable refresh rate signal, and input the fused signal to the first local backlight control subunit;

the first local backlight control subunit is configured to perform brightness adjustment on the fused second fixed refresh rate signal to obtain the third fixed refresh rate signal, and input the third fixed refresh rate signal to the brightness compensation unit; and performing brightness adjustment on the fused first variable refresh rate signal to obtain the second variable refresh rate signal, and inputting the second variable refresh rate signal to the first display.

In some possible embodiments, the third processing unit includes: the second image preprocessing subunit, the second buffer subunit, the second image color adjustment subunit and the second motion estimation and compensation subunit;

the second buffer subunit is configured to buffer the fourth fixed refresh rate signal with a specified frame number;

the second image preprocessing subunit is configured to obtain the fourth fixed refresh rate signal from the second cache subunit, perform noise reduction processing on the fourth fixed refresh rate signal, obtain an eighth fixed refresh rate signal, and input the eighth fixed refresh rate signal to the second image color adjustment subunit;

the second image color adjustment subunit is configured to perform color enhancement processing on the eighth fixed refresh rate signal to obtain a ninth fixed refresh rate signal, and input the ninth fixed refresh rate signal to the second motion estimation and compensation subunit;

the second motion estimation and compensation subunit is configured to perform motion estimation and motion compensation on the ninth fixed refresh rate signal to obtain the fifth fixed refresh rate signal, and input the fifth fixed refresh rate signal to the fourth processing unit.

In some possible embodiments, the fourth processing unit comprises: a second local backlight control subunit, a timing control subunit;

the second local backlight control subunit is configured to perform brightness adjustment on the second variable refresh rate signal or perform brightness adjustment on the fifth fixed refresh rate signal;

the time sequence control subunit is used for performing time sequence control processing on the adjusted second variable refresh rate signal or the adjusted fifth fixed refresh rate signal, and inputting the processed signal to the second display.

In some possible embodiments, the apparatus further comprises a first selector switch and a second selector switch; the first display supports the second variable refresh rate signal when the first selection switch is in a conducting state, and supports the fourth fixed refresh rate signal when the second selection switch is in a conducting state;

if the first display displays the second variable refresh rate signal, the first selection switch is turned on to output the second variable refresh rate signal to the first display through the first selection switch;

And if the first display displays the fourth fixed refresh rate signal, the second selection switch is conducted so as to output the fourth fixed refresh rate signal to the first display through the second selection switch.

In some possible embodiments, the first variable refresh rate signal is a mknrhz variable refresh rate signal, m is a positive integer greater than or equal to 4, and n is any positive integer within the range of (1, 144).

In some possible embodiments, the second display displays a variable refresh rate signal of mKnHz, m being a positive integer greater than or equal to 4, n being any positive integer within the range of (1, 144).

In some possible embodiments, the apparatus further comprises: the HDMI is connected with the first channel selection unit, supports a variable refresh rate signal of mKnHz, wherein m is a positive integer greater than or equal to 4, and n is any positive integer in the range of (1, 144).

Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

An application environment schematic diagram according to some embodiments is exemplarily shown in fig. 1;

a hardware configuration block diagram of a smart display device 200 according to some embodiments is illustrated in fig. 2;

a schematic structural diagram of an apparatus 400 supporting a variable refresh rate signal according to some embodiments is illustrated in fig. 3;

a specific structural schematic of a first processing unit 402 in an apparatus 400 according to some embodiments is schematically shown in fig. 4;

a specific structural schematic of the first processing unit 402 in the apparatus 400 according to some embodiments is schematically shown in fig. 5;

a specific structural schematic diagram of the second processing unit 403 in the apparatus 400 according to some embodiments is schematically shown in fig. 6;

a schematic diagram of the structure of the SOC chip and the first display according to some embodiments is exemplarily shown in fig. 7;

A schematic structural diagram of an apparatus 400 supporting a variable refresh rate signal according to some embodiments is illustrated in fig. 8;

a schematic structural diagram of an apparatus 400 supporting a variable refresh rate signal according to some embodiments is illustrated in fig. 9;

a partial schematic diagram of an apparatus 400 supporting a variable refresh rate signal according to some embodiments is schematically illustrated in fig. 10;

a schematic of the structure of the SOC chip, the FRC chip, and the second display according to some embodiments is exemplarily shown in fig. 11.

Detailed Description

For the purposes of making the objects, embodiments and advantages of the present application more apparent, an exemplary embodiment of the present application will be described more fully hereinafter with reference to the accompanying drawings in which exemplary embodiments of the application are shown, it being understood that the exemplary embodiments described are merely some, but not all, of the examples of the application.

Based on the exemplary embodiments described herein, all other embodiments that may be obtained by one of ordinary skill in the art without making any inventive effort are within the scope of the appended claims. Furthermore, while the present disclosure has been described in terms of an exemplary embodiment or embodiments, it should be understood that each aspect of the disclosure can be practiced separately from the other aspects.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," "second," "third," and the like in the description and in the claims and drawings are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated (Unless otherwise indicated). It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprising," "including," "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such as, for example, products or devices that contain a series of components are not necessarily limited to those explicitly listed, but may include other components not explicitly listed or inherent to such products or devices.

The term "module" as used in this disclosure refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the function associated with that element.

The term "remote control" as used herein refers to a component of an electronic device (such as the smart display device disclosed herein) that can be controlled wirelessly, typically over a relatively short distance. Typically, the electronic device is connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in a general remote control device with a touch screen user interface.

A schematic diagram of an operational scenario between a smart display device and a control means according to an embodiment is schematically shown in fig. 1. As shown in fig. 1, a user may operate the smart display device 200 through the mobile terminal 1002 and the control apparatus 1001.

In some embodiments, the control device 1001 may be a remote controller, and the communications between the remote controller and the smart display device include infrared protocol communications or bluetooth protocol communications, and other short-range communications, and the smart display device 200 is controlled by a wireless or other wired manner. The user may control the smart display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. Such as: the user can input corresponding control instructions through volume up-down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, on-off keys and the like on the remote controller, so as to realize the function of controlling the intelligent display device 200.

In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the smart display device 200. For example, the smart display device 200 is controlled using an application running on the smart device. The application program, by configuration, can provide various controls to the user in an intuitive User Interface (UI) on a screen associated with the smart device.

In some embodiments, the mobile terminal 1002 may install a software application with the smart display device 200, and implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the control instruction protocol can be established between the mobile terminal 1002 and the intelligent display device 200, the remote control keyboard is synchronized to the mobile terminal 1002, and the functions of controlling the intelligent display device 200 are realized by controlling the user interface on the mobile terminal 1002. The audio and video contents displayed on the mobile terminal 1002 can also be transmitted to the intelligent display device 200, so as to realize the synchronous display function.

The audio and video game pictures displayed in the PS5 game machine are transmitted to the intelligent television to realize the synchronous display function. Specifically, the PS5 game machine reads the SOC EDID information (system on chip Extended display identification data, system chip extended display identification data) in the smart tv, determines to transmit the variable refresh rate signal to the smart tv according to the SOC EDID information, and displays the variable refresh rate signal through the smart tv.

As also shown in fig. 1, the smart display device 200 is also in data communication with the server 400 via a variety of communication means. The smart display device 200 may be allowed to make communication connections through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the smart display device 200. By way of example, the smart display device 200 receives software program updates, or accesses a remotely stored digital media library by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers. Other web service content such as video on demand and advertising services are provided through the server 400.

The intelligent display device 200 can be a liquid crystal display, an OLED display or a projection intelligent display device. The particular smart display device type, size, resolution, etc. are not limited, and those skilled in the art will appreciate that the smart display device 200 may be modified in performance and configuration as desired.

The smart display device 200 may additionally provide a smart network television function of a computer support function, including, but not limited to, a network television, a smart television, an Internet Protocol Television (IPTV), etc., in addition to a broadcast receiving television function.

A hardware configuration block diagram of the smart display device 200 according to an exemplary embodiment is illustrated in fig. 2.

In some embodiments, the smart display apparatus 200 includes therein at least one of a controller 250, a modem 210, a communicator 220, a detector 230, an input/output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, a user interface 265, and an external device interface 240.

In some embodiments, the display 275 is configured to receive image signals from the first processor output, and to display video content and images and components of the menu manipulation interface.

In some embodiments, display 275 includes a display screen assembly for presenting pictures, and a drive assembly for driving the display of images.

In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network server side transmitted from the network communication protocol may be displayed.

In some embodiments, the display 275 is used to present a user-manipulated UI interface generated in the smart display device 200 and used to control the smart display device 200.

In some embodiments, depending on the type of display 275, a drive assembly for driving the display is also included.

In some embodiments, display 275 is a projection display and may further include a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi chip, a bluetooth communication protocol chip, a wired ethernet communication protocol chip, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver.

In some embodiments, the smart display device 200 may establish control signal and data signal transmission and reception between the communicator 220 and the external control device 1001 or the content providing device.

In some embodiments, the user interface 265 may be used to receive infrared control signals from the control device 1001 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is a signal that the smart display device 200 uses to capture an external environment or interact with the outside.

In some embodiments, the detector 230 includes an optical receiver, a sensor for capturing the intensity of ambient light, a parameter change may be adaptively displayed by capturing ambient light, etc.

In some embodiments, the image collector 232 in the detector 230, such as a camera, a video camera, etc., may be used to collect external environmental scenes, collect attributes of a user or interact gestures with the user, adaptively change display parameters, and recognize user gestures to implement interaction with the user.

In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing ambient temperature.

In some embodiments, the smart display device 200 may adaptively adjust the display color temperature of the image. The smart display device 200 may be adjusted to display a colder color temperature tone of the image, for example, when the temperature is higher, or the smart display device 200 may be adjusted to display a warmer color tone of the image, for example, when the temperature is lower.

In some embodiments, the detector 230 may further include a sound collector 231, such as a microphone, which may be used to collect voice data, and when the user speaks the instruction in a voice manner, the microphone may be capable of collecting voice data including the instruction spoken by the user. For example, the sound collector 231 may collect a voice signal including a control instruction for a user to control the smart display device 200, or collect an ambient sound for recognizing an ambient scene type, so that the smart display device 200 may adapt to ambient noise.

In some embodiments, as shown in fig. 2, the input/output interface 255 is configured to enable data transfer between the controller 250 and external other devices or other controllers 250. Such as receiving video signal data and audio signal data of an external device, command instruction data, or the like.

In some embodiments, external device interface 240 may include, but is not limited to, the following: any one or more interfaces of a high definition multimedia interface HDMI interface, an analog or data high definition component input interface, a composite video input interface, a USB input interface, an RGB port, and the like can be used. The plurality of interfaces may form a composite input/output interface.

In some embodiments, as shown in fig. 2, the modem 210 is configured to receive the broadcast television signal by a wired or wireless receiving manner, and may perform modulation and demodulation processes such as amplification, mixing, and resonance, and demodulate the audio/video signal from the plurality of wireless or wired broadcast television signals, where the audio/video signal may include a television audio/video signal carried in a television channel frequency selected by a user, and an EPG data signal.

In some embodiments, the frequency point demodulated by the modem 210 is controlled by the controller 250, and the controller 250 may send a control signal according to the user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

In some embodiments, the broadcast television signal may be classified into a terrestrial broadcast signal, a cable broadcast signal, a satellite broadcast signal, an internet broadcast signal, or the like according to a broadcasting system of the television signal. Or may be differentiated into digital modulation signals, analog modulation signals, etc., depending on the type of modulation. Or it may be classified into digital signals, analog signals, etc. according to the kind of signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like. In this way, the set-top box outputs the television audio and video signals modulated and demodulated by the received broadcast television signals to the main body equipment, and the main body equipment receives the audio and video signals through the first input/output interface.

In some embodiments, the controller 250 controls the operation of the smart display device and responds to the user's operations by various software control programs stored on the memory. The controller 250 may control the overall operation of the smart display device 200. For example: in response to receiving a user command to select to display a UI object on the display 275, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., mouse, keyboard, touch pad, etc.) connected to the smart display device 200 or a voice command corresponding to a voice uttered by the user.

As shown in fig. 2, the controller 250 includes at least one of a random access Memory 251 (Random Access Memory, RAM), a Read-Only Memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a graphics processor (Graphics Processing Unit, GPU), a central processing unit 254 (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication Bus 256 (Bus), which connects the respective components.

In some embodiments, RAM 251 is used to store temporary data for the operating system or other on-the-fly programs.

In some embodiments, ROM 252 is used to store instructions for various system boots.

In some embodiments, ROM 252 is used to store a basic input output system, referred to as a basic input output system (Basic Input Output System, BIOS). The system comprises a drive program and a boot operating system, wherein the drive program is used for completing power-on self-checking of the system, initialization of each functional module in the system and basic input/output of the system.

In some embodiments, upon receipt of the power-on signal, the smart display device 200 power starts up and the CPU runs the system boot instructions in ROM 252 to copy temporary data of the operating system stored in memory into RAM 251 in order to start up or run the operating system. When the operating system is started, the CPU copies temporary data of various applications in the memory to the RAM 251, and then, facilitates starting or running of the various applications.

In some embodiments, CPU processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and one or more sub-processors. A main processor for performing some operations of the smart display device 200 in a pre-power-up mode and/or displaying a picture in a normal mode. One or more sub-processors for one operation in a standby mode or the like.

In some embodiments, the graphics processor 253 is configured to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The device comprises an arithmetic unit, wherein the arithmetic unit is used for receiving various interaction instructions input by a user to carry out operation and displaying various objects according to display attributes. And a renderer for rendering the various objects obtained by the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, video processor 270 is configured to receive external video signals, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, etc., according to standard codec protocols for input signals, and may result in signals that are directly displayable or playable on smart display device 200.

In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio/video data stream, such as the input MPEG-2, and demultiplexes the input audio/video data stream into video signals, audio signals and the like.

And the video decoding module is used for processing the demultiplexed video signals, including decoding, scaling and the like.

And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display.

The frame rate conversion module is configured to convert the input video frame rate, for example, converting the 60Hz frame rate into the 120Hz frame rate or the 240Hz frame rate, and the common format is implemented in an inserting frame manner.

The display format module is used for converting the received frame rate into a video output signal, and changing the video output signal to a signal conforming to the display format, such as outputting an RGB data signal.

In some embodiments, the graphics processor 253 may be integrated with the video processor, or may be separately configured, where the integrated configuration may perform processing of graphics signals output to the display, and the separate configuration may perform different functions, such as gpu+ FRC (Frame Rate Conversion)) architecture, respectively.

In some embodiments, the audio processor 280 is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing, so as to obtain a sound signal that can be played in a speaker.

In some embodiments, video processor 270 may include one or more chips. The audio processor may also comprise one or more chips.

In some embodiments, video processor 270 and audio processor 280 may be separate chips or may be integrated together with the controller in one or more chips.

In some embodiments, the audio output, under the control of the controller 250, receives sound signals output by the audio processor 280, such as: the speaker 286, and an external sound output terminal of the generating device that can output to an external device, other than the speaker carried by the smart display device 200 itself, for example: external sound interface or earphone interface, etc. can also include the close range communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.

The power supply 290 supplies power input from an external power source to the smart display device 200 under the control of the controller 250. The power supply 290 may include a built-in power circuit installed inside the smart display device 200, or may be an external power installed in the smart display device 200, and provides a power interface of an external power supply in the smart display device 200.

The user interface 265 is used to receive an input signal from a user and then transmit the received user input signal to the controller 250. The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.

In some embodiments, a user inputs a user command through the control device 1001 or the mobile terminal 1002, and the user input interface responds to the user input through the controller 250.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

Memory 260 includes storage for various software modules for driving smart display device 200. Such as: various software modules stored in the first memory, including: at least one of a base module, a detection module, a communication module, a display control module, a browser module, various service modules, and the like.

The base module is a bottom software module for signal communication between the various hardware in the smart display device 200 and for sending processing and control signals to the upper modules. The detection module is used for collecting various information from various sensors or user input interfaces and carrying out digital-to-analog conversion and analysis management.

For example, the voice recognition module includes a voice analysis module and a voice instruction database module. The display control module is used for controlling the display to display the image content, and can be used for playing the multimedia image content, the UI interface and other information. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. And the service module is used for providing various services and various application programs. Meanwhile, the memory 260 also stores received external data and user data, images of various items in various user interfaces, visual effect maps of focus objects, and the like.

With the push of the HDMI2.1 standard, in addition to the function of displaying a high resolution signal and a high refresh rate signal through the smart display device, the display of the variable refresh rate (VRR, variable refresh rate) signal makes the user experience better, and especially for game players, the variable refresh rate signal makes the game picture feel higher, which can reduce or eliminate the problems of picture lag, stuck and frame tearing. However, the current device supporting the variable refresh rate signal can only support the variable refresh rate signal, the device supporting the fixed refresh rate signal can only support the fixed refresh rate signal, and the device supporting the variable refresh rate signal has higher cost due to higher configuration, so that a device capable of supporting both the variable refresh rate signal and the fixed refresh rate signal is needed.

In order to solve the above problems, the present application transmits a received first fixed refresh rate signal to a first processing unit through a first channel selection unit, transmits a received first variable refresh rate signal to a second processing unit, processes the first fixed refresh rate signal through the first processing unit, the second processing unit and a brightness compensation unit, and displays the first fixed refresh rate signal through a first display, or processes the first variable refresh rate signal through the second processing unit and displays the first variable refresh rate signal through the first display. Thereby enabling the device to support both variable and fixed refresh rate signals.

After the design idea of the embodiment of the present application is introduced, some simple descriptions are made below for application scenarios applicable to the technical solution of the embodiment of the present application, and it should be noted that the application scenarios described below are only used for illustrating the embodiment of the present application and are not limiting. In the specific implementation, the technical scheme provided by the embodiment of the application can be flexibly applied according to actual needs.

The present application provides an apparatus 400 for supporting a variable refresh rate signal for an intelligent display device, as shown in FIG. 3, comprising: a first channel selection unit 401, a first processing unit 402, a second processing unit 403, and a luminance compensation unit 404.

The first channel selecting unit 401 is configured to transmit the first fixed refresh rate signal to the first processing unit 402 if the received input signal is the first fixed refresh rate signal, and transmit the first variable refresh rate signal to the second processing unit 403 if the received input signal is the first variable refresh rate signal.

Here, the first variable refresh rate signal is a variable refresh rate signal of mknrhz, m is a positive integer greater than or equal to 4, and n is any one positive integer within the range of (1, 144). The device can support variable refresh rate signals with different resolution requirements because the first variable refresh rate signal supported by the device can maximally reach 4K144Hz and can support variable refresh rate signals less than or equal to 4K144 Hz.

Illustratively, a 4K120Hz VRR signal is input to the first channel selection unit 401 through an HDMI2.1 interface, a 4K60Hz non-VRR signal is input to the first channel selection unit 401 through an interface such as DTV (Digital Video Broadcasting, digital video broadcast)/USB (Universal Serial Bus ), and the like, and the first channel selection unit 401 transmits the 4K120Hz VRR signal to the second processing unit 403 if receiving the 4K120Hz VRR signal. The first channel selection unit 401 transmits the non-VRR signal of 4K60Hz to the first processing unit 402 if it receives the non-VRR signal of 4K60Hz, i.e. the fixed refresh rate signal.

The first processing unit 402 is configured to perform optimization processing on the image quality of the first fixed refresh rate signal, obtain a second fixed refresh rate signal, and input the second fixed refresh rate signal to the second processing unit 403.

Specifically, as shown in fig. 4, the first processing unit 402 includes: the first image preprocessing subunit 4021, the first buffer subunit 4022, the first image color adjustment subunit 4023, and the first motion estimation and compensation subunit 4024.

The first buffering subunit 4022 is configured to buffer a first fixed refresh rate signal with a specified frame number.

The first image preprocessing subunit 4021 is configured to obtain a first fixed refresh rate signal from the first cache subunit 4022, perform noise reduction processing on the first fixed refresh rate signal, obtain a sixth fixed refresh rate signal, and input the sixth fixed refresh rate signal to the first image color adjustment subunit 4023. The specific method of the noise reduction process is not limited herein, and may be adjusted according to actual application.

In addition, the first image preprocessing subunit 4021 may be further configured to convert the interlaced signal in the first fixed refresh rate signal into the progressive signal before performing the noise reduction processing on the first fixed refresh rate signal, so as to further improve the image quality effect of the signal. The specific method of de-interlacing is not limited herein, and may be adjusted according to the actual application.

After the noise reduction processing is performed on the first fixed refresh rate signal, the method is further used for performing super-resolution processing on the noise reduced signal so as to facilitate the improvement of details of the signal. Similarly, the specific method of the super-resolution processing is not limited herein, and may be adjusted according to the actual application.

After the super-resolution processing, the method is also used for amplifying or reducing the signal so as to further improve the image quality effect of the signal. The specific method of signal amplification or reduction is not limited, and can be adjusted according to actual application.

Illustratively, as shown in fig. 5, the first image preprocessing subunit 4021 includes a de-interlacing subunit 40211, a noise reduction subunit 40212, a super-resolution subunit 40213, and a scaling subunit 40214. The de-interlacing sub-unit 40211 processes a signal, converts an interlaced signal into a progressive signal, the noise reduction sub-unit 40212 performs noise reduction processing on the signal, the super-resolution sub-unit 40213 performs detail improvement on the signal, and the scaling sub-unit 40214 performs zooming in or zooming out on the signal.

The first image color adjustment subunit 4023 is configured to perform color enhancement processing on the sixth fixed refresh rate signal to obtain a seventh fixed refresh rate signal, and input the seventh fixed refresh rate signal to the first motion estimation and compensation subunit 4024.

Illustratively, as shown in fig. 5, the first image color adjustment subunit 4023 includes a contrast processing subunit 40231, a color enhancer unit 40232, and a color space conversion subunit 40233. The contrast processing subunit 40231 is configured to perform contrast processing on the signal, the color enhancer subunit 40232 is configured to perform color enhancement processing on the signal, and the color space conversion subunit 40233 is configured to perform spatial conversion processing on the signal, which is not limited to the specific processing method of color enhancement described above, and may be adjusted according to practical situations.

The processing of the image by each subunit in the first processing unit enables the image to have lower image quality noise and more saturated image color, and brings better viewing experience for users.

The first motion estimation and compensation subunit 4024 is configured to perform motion estimation and motion compensation on the seventh fixed refresh rate signal to obtain a second fixed refresh rate signal, and input the second fixed refresh rate signal to the second processing unit 403.

The second processing unit 403 is configured to perform signal model fusion and brightness adjustment on the second fixed refresh rate signal to obtain a third fixed refresh rate signal, and input the third fixed refresh rate signal to the brightness compensation unit 404; and carrying out signal model fusion and brightness adjustment on the first variable refresh rate signal to obtain a second variable refresh rate signal, and inputting the second variable refresh rate signal to the first display.

Specifically, as shown in fig. 6, the second processing unit 403 includes: a signal model fusion subunit 4031, a first local backlight control subunit 4032.

The signal model fusion subunit 4031 is configured to perform signal model fusion on the received second fixed refresh rate signal or the received first variable refresh rate signal, and input the fused signal to the first local backlight control subunit 4032.

Specifically, the signal model fusion subunit 4031 performs signal model fusion on the second fixed refresh rate signal or the first variable refresh rate signal and an OSD signal (on-screen display, screen menu adjustment mode), where the OSD signal is determined according to the image of the input signal. In addition, after the OSD signal is determined, before the signal model fusion, the OSD signal may be subjected to image quality processing. The specific image quality processing method is not limited to this, and may be adjusted according to the actual application scenario.

Exemplary signal model fusion has many methods, including simple average fusion, weighted fusion, voting fusion, and the like, and more complex Blending and Stacking. The specific method of signal model fusion is not limited herein, and may be adjusted according to practical applications.

The first local backlight control subunit 4032 is configured to perform brightness adjustment on the fused second fixed refresh rate signal to obtain a third fixed refresh rate signal, and input the third fixed refresh rate signal to the brightness compensation unit 404; and performing brightness adjustment on the fused first variable refresh rate signal to obtain a second variable refresh rate signal, and inputting the second variable refresh rate signal to the first display.

The backlight brightness of the image can be adjusted through further processing of the image by each subunit in the second processing unit, and better viewing experience is brought to the user.

Here, the apparatus may further include an SPI interface (serial peripheral interface ), a CPU interface (central processing unit, central processing unit), an I2C interface (serial transmission bus), a UART interface (universal asynchronous receiver Transmitter, universal Asynchronous Receiver/Transmitter), PWM control (pulse width modulation ), and a key_adc interface. The input signal is transmitted to the first local backlight control subunit 4032, for example, through an SPI interface, so that the first local backlight control subunit 4032 performs brightness adjustment on the second fixed refresh rate signal or the fused first variable refresh rate signal.

The brightness compensation unit 404 is configured to perform brightness compensation on the third fixed refresh rate signal to obtain a fourth fixed refresh rate signal, and input the fourth fixed refresh rate signal to the first display.

In an embodiment of the present application, the device composed of the first channel selection unit 401, the first processing unit 402, the second processing unit 403, and the brightness compensation unit 404 is an internal structure of an SOC chip, and the SOC chip supports a signal of the maximum output 16 channels according to VBO (V-by-One, V-by-One HS is a signal transmission interface standard applicable to flat panel displays developed by the japan sienna electronics company (THine Electornics).

The device also comprises a first selection switch 408 and a second selection switch 409; the first display supports the second variable refresh rate signal when the first selection switch 408 is in the on state and the fourth fixed refresh rate signal when the second selection switch 409 is in the on state.

If the first display displays the second variable refresh rate signal, the first selection switch 408 is turned on to output the second variable refresh rate signal to the first display through the first selection switch 408;

if the first display displays the fourth fixed refresh rate signal, the second selection switch 409 is turned on to output the fourth fixed refresh rate signal to the first display through the second selection switch 409.

As shown in fig. 7, when the first selection switch 408 is in the on state, the SOC chip outputs a variable refresh rate signal of 16 channels according to VBO, and when the second selection switch 409 is in the on state, the SOC chip outputs a fixed refresh rate signal of 8 channels according to VBO, or outputs a fixed refresh rate signal of 12 channels according to P2P (point to point), for example.

By conducting the first selection switch or the second selection switch in the device, the device can display a fixed refresh rate signal and a variable refresh rate signal by using the first display, the device has 16-channel transmission data channels, when the VBO outputs the 16-channel variable refresh rate signal, the variable refresh rate signal uses all the 16-channel transmission data channels to carry out signal transmission, when the VBO outputs the 8-channel fixed refresh rate signal or the P2P outputs the 12-channel fixed refresh rate signal, the fixed refresh rate signal uses part of the 16-channel transmission data channels to carry out signal transmission, and the device can adapt to displays displayed by different signal resolution functions through multiplexing the transmission data channels and can support signals with different resolutions.

In one embodiment of the present application, the apparatus further comprises: and the HDMI is connected with the first channel selection unit, supports a variable refresh rate signal of mKnHz, wherein m is a positive integer greater than or equal to 4, and n is any positive integer in the range of (1, 144).

Specifically, the HDMI interface may be an HDMI2.1 interface, where the HDMI2.1 interface is connected to the first channel selection unit 401, the HDMI2.1 interface supports a variable refresh rate signal of mKnHz, m is a positive integer greater than or equal to 4, n is any positive integer within a range of (1, 144), and a signal transmission speed of the HDMI2.1 interface is at least 8Gbps. Here, 8Gbps, that is, 8Gbit of data can be transmitted per second.

By setting the signal transmission speed of the HDMI2.1 interface and setting the variable refresh rate signal supported by the HDMI2.1 interface, the device can support both a fixed refresh rate signal and a variable refresh rate signal.

As shown in fig. 8, for an input signal other than the 4k120hz VRR signal, the input signal is input to the first channel selection unit 401 through an interface such as DTV (Digital Video Broadcasting, digital video broadcast)/USB (Universal Serial Bus ) or the like, and the non-4 k120hz VRR signal is transmitted to the first processing unit 402 through the first channel selection unit 401.

Then sequentially passes through a first image preprocessing subunit 4021, such as pre_pq (prepositive picture quality, PRE-image processing), a first buffer subunit 4022, such as DDR (Double Data Rate SDRAM, memory), a first image color adjustment subunit 4023, such as post_pq (Post picture quanlity, post-image processing), a first motion estimation and compensation subunit 4024, such as MEMC (Motion Estimate and Motion Compensation, motion estimation and motion compensation), to process signals, then transmits the processed signals to a second processing unit 403, sequentially passes through a signal model fusion subunit 4031, such as Blending, a first local backlight control subunit 4032, such as LDC (local dimming controller, local backlight control), and then passes through a brightness compensation unit 404, such as DEMURA, to process non-VRR signals, and finally displays the processed signals on a first display.

Here, fig. 8 further includes an SPI interface, a CPU interface, an I2C interface, a UART interface, PWM control, and a key_adc interface, which can input signal data to the LDC.

For the input signal of the 4K120Hz VRR signal, the input signal is input to the first channel selection unit 401 through the HDMI2.1 interface, in order to reduce the signal delay problem of the link, the 4K120Hz VRR signal is transmitted to the second processing unit 403 through the first channel selection unit 401, the VRR signal is processed only through the second processing unit 403, and finally, the VRR signal is displayed through the first display, so that the hysteresis and tearing phenomenon of the image quality display can be reduced, and better viewing experience is brought to the user.

In addition, the device only supporting the fixed refresh rate signal can only be applied to middle-end products, such as middle-end game products, the device only supporting the variable refresh rate signal can only be applied to high-end products, such as high-end game products, and the device can support both the fixed refresh rate signal and the variable refresh rate signal, so that the device can be applied to both the middle-end products and the high-end products, in addition, the device can adapt to displays with different signal resolution functions through multiplexing transmission data channels, and can support signals with different resolutions, thereby reducing the period of development and authentication, reducing the research and development cost, and solving the problem of poor generalization.

If the second variable refresh rate signal does not match the first display or the fourth fixed refresh rate signal does not match the first display, as shown in fig. 9, the apparatus further includes: a second channel selection unit 405, a third processing unit 406, and a fourth processing unit 407.

The brightness compensation unit 404 is further configured to input a fourth fixed refresh rate signal to the second channel selection unit 405.

The second processing unit 403 is further configured to input a second variable refresh rate signal to the second channel selection unit 405.

A second channel selecting unit 405, configured to transmit a fourth fixed refresh rate signal to the third processing unit 406 if the received signal is the fourth fixed refresh rate signal; if the received signal is the second variable refresh rate signal, the second variable refresh rate signal is transmitted to the fourth processing unit 407.

Illustratively, the second channel selection unit 405, if it receives a 4K120Hz VRR signal, transmits the 4K120Hz VRR signal to the fourth processing unit 407. The second channel selection unit 405, if receiving a 4K60Hz non-VRR signal, i.e. a fixed refresh rate signal, transmits the 4K60Hz non-VRR signal to the third processing unit 406.

The third processing unit 406 is configured to perform optimization processing on the image quality of the fourth fixed refresh rate signal, obtain a fifth fixed refresh rate signal, and input the fifth fixed refresh rate signal to the fourth processing unit 407.

Specifically, the third processing unit 406 includes: a second image preprocessing subunit 4061, a second buffer subunit 4062, a second image color adjustment subunit 4063, and a second motion estimation and compensation subunit 4064;

a second buffering subunit 4062, configured to buffer a fourth fixed refresh rate signal for a specified frame number;

A second image preprocessing subunit 4061, configured to obtain a fourth fixed refresh rate signal from the second cache subunit 4062, perform noise reduction processing on the fourth fixed refresh rate signal, obtain an eighth fixed refresh rate signal, and input the eighth fixed refresh rate signal to the second image color adjustment subunit 4063;

a second image color adjustment subunit 4063, configured to perform color enhancement processing on the eighth fixed refresh rate signal to obtain a ninth fixed refresh rate signal, and input the ninth fixed refresh rate signal to the second motion estimation and compensation subunit 4064;

the processing of each subunit in the third processing unit on the image ensures that the image has lower image quality noise and more saturated image color, and also brings better viewing experience for users.

The second motion estimation and compensation subunit 4064 is configured to perform motion estimation and motion compensation on the ninth fixed refresh rate signal to obtain a fifth fixed refresh rate signal, and input the fifth fixed refresh rate signal to the fourth processing unit 407.

Here, since the processing procedure of the non-VRR signal by the third processing unit 406 is the same as the processing procedure of the non-VRR signal by the first processing unit 402, reference may be made to the processing procedure of the non-VRR signal by the first processing unit 402, which is not described herein.

The fourth processing unit 407 is configured to perform brightness adjustment and timing control processing on the second variable refresh rate signal or the fifth fixed refresh rate signal, and input a signal obtained by the processing to the second display.

Specifically, the fourth processing unit 407 includes: a second local backlight control subunit 4071, a timing control subunit 4072;

a second local backlight control subunit 4071, configured to perform brightness adjustment on the second variable refresh rate signal or perform brightness adjustment on the fifth fixed refresh rate signal;

the timing control subunit 4072 is configured to perform timing control processing on the adjusted second variable refresh rate signal or the adjusted fifth fixed refresh rate signal, and input the processed signal to the second display.

The backlight brightness of the image can be adjusted through further processing of the image by each subunit in the fourth processing unit, and better viewing experience is brought to the user.

As shown in fig. 10, for the non-4 k120hz VRR signal output from the luminance compensation unit 404, it is transmitted to the third processing unit 406 through the second channel selection unit 405. The signal is sequentially processed by a second image preprocessing subunit 4061, such as pre_pq (prepositive picture quality, PRE-image processing), a second buffer subunit 4062, such as DDR (Double Data Rate SDRAM, memory), a second image color adjustment subunit 4063, such as post_pq (Post picture quanlity, post-image processing), a second motion estimation and compensation subunit 4064, such as MEMC (Motion Estimate and Motion Compensation, motion estimation and motion compensation), in the third processing unit 406, and then transmitted to the fourth processing unit 407, and sequentially processed by a second local backlight subunit 4071, such as LDC (local dimming controller, local backlight control), a timing control subunit 4072, such as Tcon, in the fourth processing unit 407, for non-VRR signal processing, and finally displayed by a second display.

For the 4k120hz VRR signal output by the second processing unit 403, in order to reduce the signal delay problem of the link, the 4k120hz VRR signal is transmitted to the fourth processing unit 407 through the second channel selecting unit 405, and the VRR signal is processed only by the fourth processing unit 407 and finally displayed through the second display.

And aiming at the situation that the second variable refresh rate signal or the fourth fixed refresh rate signal is not matched with the first display, the second channel selection unit, the third processing unit and the fourth processing unit are designed to process the second variable refresh rate signal or the fourth fixed refresh rate signal, and display the second variable refresh rate signal or the fourth fixed refresh rate signal in the second display, so that the device can be suitable for different displays.

In one embodiment of the present application, the second display displays a variable refresh rate signal of mknrhz, m is a positive integer greater than or equal to 4, and n is any one positive integer within the range of (1, 144).

By determining configuration parameters of the second display, an applicable device can be configured for the second display, and the variable refresh rate signal can be better displayed by using the second display.

In an embodiment of the present application, the device formed by the second channel selection unit 405, the third processing unit 406, and the fourth processing unit 407 is formed by an internal structure of an FRC chip (Frame Rate Conversion ), and the FRC chip supports a 16-channel signal of 4K120Hz output according to VBO, supports a MEMC function of 4K120Hz, and supports a VBO/P2P output of 4K120 Hz.

Illustratively, as shown in fig. 11, the SOC chip inputs a signal through the HDMI2.1 interface, and outputs a 16-channel signal to the FRC chip according to the VBO, and the FRC chip outputs a signal to the second display for display according to the VBO/P2P.

The device can be applied to chip products or complete machine products which support HDMI2.1 interface input signals and need 4K120Hz variable refresh rate signal functions.

Claims

1. An apparatus for supporting a variable refresh rate signal for a smart display device, comprising: the device comprises a first channel selection unit, a first processing unit, a second processing unit and a brightness compensation unit;

2. The apparatus of claim 1, wherein the apparatus further comprises: a second channel selection unit, a third processing unit, and a fourth processing unit;

3. The apparatus of claim 1, wherein the first processing unit comprises: the device comprises a first image preprocessing subunit, a first cache subunit, a first image color adjustment subunit and a first motion estimation and compensation subunit;

4. The apparatus of claim 1, wherein the second processing unit comprises: a signal model fusion subunit, a first local backlight control subunit;

5. The apparatus of claim 2, wherein the third processing unit comprises: the second image preprocessing subunit, the second buffer subunit, the second image color adjustment subunit and the second motion estimation and compensation subunit;

6. The apparatus of claim 2, wherein the fourth processing unit comprises: a second local backlight control subunit, a timing control subunit;

7. The apparatus of claim 1, further comprising a first selector switch and a second selector switch; the first display supports the second variable refresh rate signal when the first selection switch is in a conducting state, and supports the fourth fixed refresh rate signal when the second selection switch is in a conducting state;

8. The apparatus of claim 1, wherein the first variable refresh rate signal is a mknrhz variable refresh rate signal, m is a positive integer greater than or equal to 4, and n is any positive integer within the range of (1, 144).

9. The apparatus of claim 2, wherein the second display displays a variable refresh rate signal of mKnHz, m being a positive integer greater than or equal to 4, n being any positive integer within the range of (1, 144).

10. The apparatus of claim 1, wherein the apparatus further comprises: the HDMI is connected with the first channel selection unit, supports a variable refresh rate signal of mKnHz, wherein m is a positive integer greater than or equal to 4, and n is any positive integer in the range of (1, 144).