CN111638864A

CN111638864A - Volume control method of display equipment and display equipment

Info

Publication number: CN111638864A
Application number: CN202010386772.9A
Authority: CN
Inventors: 朱子鸣; 李双增
Original assignee: Qingdao Hisense Media Network Technology Co Ltd
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2020-05-09
Filing date: 2020-05-09
Publication date: 2020-09-08

Abstract

The application discloses a volume control method of display equipment and the display equipment, which are used for realizing direct interaction between the display equipment and other equipment in the same local area. The method comprises the following steps: when detecting that the DIAL communication connection is established between the application on the equipment and the application on other equipment, responding to a first control instruction sent by the other equipment, and playing the content displayed on the other equipment on the equipment; responding to a second control instruction sent by the other equipment, and adjusting the playing volume of the equipment; and when detecting that the application on the equipment and the application on other equipment disconnect the established DIAL communication connection, the equipment restores the playing volume before receiving the first control instruction.

Description

Volume control method of display equipment and display equipment

Technical Field

The present application relates to the field of display technologies, and in particular, to a volume control method for a display device and a display device.

Background

The primary role of the DIAL (Discovery And Launch, shortly called DIAL) protocol is to find And connect an application on the first screen device among applications on the second screen device, that is, the application on the second screen device establishes DIAL communication connection with the application on the first screen device, based on which, a user can control the first screen device through the application on the second screen device, for example, control the playing progress of multimedia content displayed on the first screen device.

However, at present, the process of establishing DIAL communication connection by applications on different devices and the control process all need to rely on an application server as a communication bridge, which may result in that the above functions cannot be implemented when the network state is not good or the connection between the application and the application server is in a problem.

Disclosure of Invention

The embodiment of the application provides a volume control method of a display device and the display device, which are used for realizing direct interaction between the display device and other devices in the same local area.

In a first aspect, there is provided a display device comprising:

a display for displaying a graphical user interface;

a controller for performing:

when detecting that the DIAL communication connection is established between the application on the equipment and the application on other equipment, responding to a first control instruction sent by the other equipment, and playing the content displayed on the other equipment on the equipment;

responding to a second control instruction sent by the other equipment, and adjusting the playing volume of the equipment;

and when detecting that the application on the equipment and the application on other equipment disconnect the established DIAL communication connection, the equipment restores the playing volume before receiving the first control instruction.

In some embodiments, the controller further performs:

responding to a connection request sent by other equipment, and if the connection request is legal, acquiring a random identification code from the connection request;

and sending the acquired random identification code to the other equipment, so that the other equipment determines that DIAL communication connection is established between the application of the equipment and the application on the display equipment when the random identification code sent by the equipment is compared to be consistent with the received random identification code, and sends an indication message indicating that DIAL communication connection is established to the display equipment.

In some embodiments, the controller specifically performs:

responding to a second control instruction which is sent by the other equipment and indicates to increase the playing volume, and checking whether the current playing volume of the equipment is larger than a set first volume threshold value;

if yes, discarding the second control instruction for indicating to increase the playing volume;

and if not, executing the second control instruction for indicating to increase the playing volume.

In some embodiments, the controller further performs:

and when the current playing volume of the equipment is detected to be larger than a set first volume threshold value, displaying a prompt message for prompting that the playing volume exceeds a comfortable volume range on the display.

In some embodiments, the controller specifically performs:

responding to a second control instruction which is sent by the other equipment and indicates to reduce the playing volume, and checking whether the current playing volume of the equipment is smaller than a set second volume threshold value;

if yes, displaying a prompt message for prompting that the playing volume is lower than the comfortable volume range on the display, and executing a second control instruction for instructing to reduce the playing volume;

and if not, directly executing the second control instruction for indicating to reduce the playing volume.

In some embodiments, the controller further performs:

recording a current signal channel before responding to a first control instruction sent by the other equipment;

when it is detected that the application on the device disconnects the established DIAL communication connection with the application on the other device, the multimedia content provided by the recorded signal channel is played on the device.

In a second aspect, a volume control method of a display device is provided, including:

In some embodiments, the method further comprises:

In some embodiments, the adjusting the playback volume of the device in response to the second control instruction sent by the other device includes:

In some embodiments, the method further comprises:

By applying the embodiment, the display device and other devices in the same local area can be directly interacted without depending on an application server, so that the stability of a communication process can be improved, and the communication efficiency can be improved.

Drawings

Fig. 1A schematically illustrates an operation scenario between the display device 200 and the control 100;

fig. 1B is a block diagram schematically illustrating a configuration of the control apparatus 100 in fig. 1A;

fig. 1C is a block diagram schematically illustrating a configuration of the display device 200 in fig. 1A;

a block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D.

FIG. 2A is a schematic view of a display interface of an application on a second screen device;

FIG. 2B is a schematic diagram of another display interface for an application on a second screen device;

FIG. 3 is a flow diagram for DIAL communication connection establishment between an application at the DIAL Server side and an application at the DIAL Client side;

FIG. 4 is a schematic diagram of a graphical user interface 400 displaying content provided by a second screen device on a first screen device;

FIG. 5 is a schematic diagram of a process for establishing DIAL communication connections between applications in the present application;

FIG. 6 is a schematic diagram of the DIAL Server side architecture;

FIG. 7 is a flowchart of an embodiment of a volume control method for a display device of the present application;

fig. 8 is a schematic diagram of a graphical user interface 800 for providing content for recorded signal channels.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

The terms "comprises" and "comprising," and any variations thereof, as used herein, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Fig. 1A is a schematic diagram illustrating an operation scenario between the display device 200 and the control apparatus 100. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200 to implement the functions of the physical keys as arranged in the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may be implemented as a television, and may provide an intelligent network television function of a broadcast receiving television function as well as a computer support function. Examples of the display device include a digital television, a web television, a smart television, an Internet Protocol Television (IPTV), and the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, a projection display device. The specific display device type, size, resolution, etc. are not limited.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

Fig. 1B is a block diagram illustrating the configuration of the control device 100. As shown in fig. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.

The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.

Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.

And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.

The output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting an image, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the output interface 150, and display the output signal in the form of an image on the display 154, in the form of audio on the sound output interface 153, or in the form of vibration on the vibration interface 152.

And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.

A hardware configuration block diagram of the display device 200 is exemplarily illustrated in fig. 1C. As shown in fig. 1C, the display apparatus 200 may further include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio input interface 285, and a power supply 290.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.

The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include an image collector 231, such as a camera, a video camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user. A light receiver 232 may also be included to collect ambient light intensity to adapt to changes in display parameters of the display device 200, etc.

In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.

In some other exemplary embodiments, the detector 230, which may further include a sound collector, such as a microphone, may be configured to receive a sound of a user, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

The external device interface 240 is a component for providing the controller 210 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in fig. 1C, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.

The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.

A graphic processor 253 for generating screen images of various graphic objects such as icons, images, and operation menus. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.

A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to an icon. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a user uttering voice.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, the memory 260 is specifically configured to store drivers and related data for the tuner demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, and the like, external data (e.g., audio-visual data) received from the external device interface, or user data (e.g., key information, voice information, touch information, and the like) received from the user interface.

In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer and are responsible for direct interaction with users. The application layer may include a plurality of applications such as NETFLIX applications, setup applications, media center applications, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML, Cascading Style Sheets (CSS), and JavaScript.

Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.

CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.

JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through a browser, realize the communication with the kernel layer,

the middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..

A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

And a display 275 for receiving the image signal from the output of the video processor 270 and displaying video, images and menu manipulation interfaces. For example, the display may display video from a broadcast signal received by the tuner demodulator 210, may display video input from the communicator 220 or the external device interface 240, and may display an image stored in the memory 260. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

Audio output interface 285 receives audio signals from the output of audio processor 280. For example, the audio output interface may output audio in a broadcast signal received via the tuner demodulator 210, may output audio input via the communicator 220 or the external device interface 240, and may output audio stored in the memory 260. The audio output interface 285 may include a speaker 286, or an external audio output terminal 287, such as an earphone output terminal, that outputs to a generating device of an external device.

In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

With the development of science and technology and the continuous improvement of user requirements, many manufacturers advocate multi-screen interaction, such as interaction between a television and a mobile phone, so that a user can directly control the television by using the mobile phone, for example, adjusting the volume of the television, adjusting the audio and video playing progress of the television, switching the image mode of the television, and the like.

In some embodiments, multi-screen interaction between the television and the handset may be implemented based on the DIAL protocol. The main role of the DIAL protocol is to discover and connect applications on a first screen device among applications on a second screen device, that is, the applications on the second screen device establish DIAL communication connection with the applications on the first screen device, where the first screen device generally refers to a large-screen device such as a television, and the second screen device refers to a small-screen device such as a mobile phone. It should be understood that the first screen device and the second screen device are not strictly limited. The application referred to herein is an application supporting the DIAL protocol (hereinafter, simply referred to as an application), and examples thereof include YouTube and Netflix.

In the DIAL protocol, there are two key terms: DIAL Server and DIAL Client. In some embodiments, the DIAL Server is integrated in the first screen device, or integrated in an application of the first screen device, to implement a DIAL Server; the DIAL client is integrated in the application of the second screen device to realize the DIAL client. Based on this, when the first screen device and the second screen device implement multi-screen interaction based on the DIAL protocol, the interaction between the DIAL Server and the DIAL Client is actually implemented.

In some embodiments, the process of discovering and connecting applications on a first screen device among applications on a second screen device is as follows:

first, an application on the second screen device, i.e., an application on the DIAL Client side, is started, for example, YouTube is started. Illustratively, the user may launch the application by triggering an application icon on the second screen device.

Next, if the application on the first screen device, i.e. the application on the DIAL Server side, is not started yet, at this time, the application on the DIAL Server side may be started first. Illustratively, as shown in fig. 2A, a schematic view of a display interface of an application on a second screen device is shown. In practice, the user may trigger the icon 210 on the display interface shown in fig. 2A, and when the icon 210 is triggered, it indicates that the user intends to control the application launch on the first screen device through the second screen device, at which time the display interface as illustrated in fig. 2B will be presented on the second screen device.

As shown in fig. 2B, the display interface includes a list, and all devices supporting DIAL function in the same local area network as the second screen device, which are found by the second screen device using DIAL device search function, are displayed in the list. Accordingly, the user may select a device in the list, for example, "H-Roku TV," which is the first screen device to be controlled. At this time, the second screen device sends a control instruction indicating application start to the first screen device selected by the user, and it can be understood that, in fact, the second screen device sends a control instruction indicating application start to the DIALServer on the first screen device through the DIAL Client.

In some embodiments, after receiving a control instruction indicating application start, the DIAL Server, that is, the first screen device first checks validity of the control instruction, for example, checks whether the application indicated by the control instruction is a registered application of the home terminal, and if so, determines that the control instruction is valid, and at this time, may start the application in response to the control instruction; if not, the control instruction is determined to be illegal, at which point the control instruction may be discarded. For example, assuming that the registered applications of the DIAL Server side include Netflix and YouTube, when the application indicated by the control instruction is Amazon, the control instruction is determined to be illegal; when the application indicated by the control instruction is Netflix, the control instruction is determined to be legal.

After the application of the DIAL Server terminal is started, DIAL communication connection between the application of the DIAL Server terminal and the application of the DIAL Client terminal can be established through the flow shown in FIG. 3.

As shown in fig. 3, the DIAL Client (i.e., the second screen device) sends a connection request to the DIAL Server (i.e., the first screen device), where the connection request carries a pairing code, and after receiving the connection request, the DIAL Server acquires the pairing code from the connection request, and generates a URL address based on the pairing code, where the URL address carries the pairing code exemplarily. Then, the DIALServer side sends the generated URL address to an application Server (the application Server refers to a Server corresponding to an application), and the application Server analyzes the received URL address to obtain a pairing code, and establishes a DIAL communication connection between an application of the DIAL Client side and an application of the DIAL Server side based on the pairing code.

It should be noted that, in some embodiments, the DIAL Client may also carry the pairing code in the control instruction indicating the application start, so that the application start and the DIAL communication connection establishment at the DIAL Server may be completed in one go.

In some embodiments, after the DIAL communication connection is established between the application of the DIAL Server and the application of the DIAL Client, the application of the DIAL Client may push the currently displayed content to the DIAL Server, so as to display the graphical user interface of the content provided by the second screen device on the DIAL Server, i.e., the first screen device, for example, as shown in fig. 4, a schematic diagram of the graphical user interface 400 of the content provided by the second screen device on the first screen device.

In some embodiments, for some specific applications, for example YouTube, after the application on the second screen device establishes the DIAL communication connection with the application on the first screen device, the user may also control the first screen device through the application on the second screen device, for example, adjust the playing volume of the first screen device, progress the audio and video playing, switch the image mode, and the like.

However, whether the second screen device pushes multimedia content to the first screen device or controls the first screen device through the application on the second screen device, similar to the connection process illustrated in fig. 3, it is necessary to rely on the application Server as a communication bridge between the DIAL Client and the DIAL Server, that is, the DIAL Client needs to send a control instruction to the application Server, and the application Server interacts with the DIAL Server based on the control instruction to implement an operation corresponding to the control instruction, for example, control the first screen device to play content currently displayed by the second screen device, adjust the play volume of the first screen device, and the like.

Therefore, at present, the interaction between the DIAL Client and the DIAL Server, including the connection process and the process of controlling the first screen device where the DIAL Server is located through the application of the DIAL Client, needs to rely on the application Server as a communication bridge, so that the interaction between the DIAL Client and the DIAL Server cannot be realized when the network state is not good or the connection between the application and the application Server is in a problem.

Based on this, the application provides a volume control method of a display device. According to the method, the display device can be used as the first screen device, and other devices in the same local area network as the display device, such as the intelligent device 100B, can directly control the playing volume of the display device without using an application server, so that the stability of a communication process is improved, and the communication efficiency is improved.

First, how to establish a DIAL communication connection between applications between a display device and other devices in the same lan in the volume control method for a display device provided in the present application is described below:

referring to fig. 5, a schematic diagram of a process for establishing DIAL communication connection between applications in the present application is shown, comprising the following steps:

step 51, the other device sends a connection request to the display device.

In some embodiments, other devices, such as smart devices, may generate a random identification code using the device model number, the version number of the application.

Step 52, after the display device receives the connection request, it checks whether the connection request is legal.

As to how to check whether the connection request is legal, refer to the above description, and are not described herein again.

And step 53, when the display device verifies that the connection request is legal, acquiring the random identification code from the connection request.

Step 54, the display device rejects the connection request when it is verified that the connection request is illegal.

And step 55, the display device sends the acquired random identification code to other devices.

Step 56, the other device compares whether the random identification code sent by itself is consistent with the received random identification code.

And step 57, when the random identification code transmitted by the other device is compared to be consistent with the received random identification code, the other device determines that the DIAL communication connection is established between the application of the other device and the application on the display device and transmits an indication message indicating that the DIAL communication connection is established to the display device.

As can be seen from the flow shown in fig. 5, according to the method provided by the present application, direct communication can be performed between the display device and other devices in the same lan without depending on an application server, so that DIAL communication connection between applications of both parties is established.

In the following, the schematic structure diagram of the DIAL Server illustrated in fig. 6 is described how, in the volume control method for a display device provided in the present application, in a case where an application on the display device and an application on another device have established DIAL communication connection, controlling the playback volume of the display device through the other device is implemented:

other equipment sends a control instruction to the display equipment, the DIAL Server terminal integrated on the display equipment monitors the control instruction through mongoose, then the DIAL Server terminal analyzes the control instruction through a DIAL service module, and whether the control instruction is legal or not is verified. When the control instruction is verified to be legal, a callback function of a specific application is called to execute the control instruction, for example, "yt _ callbacks" in fig. 6 refers to a callback function of YouTube, and "nf _ callbacks" refers to a callback function of Netflix. When the "DIAL service" module calls the callback function of a specific application, the interface between the application and the system platform is realized through an interface which is built in the DIAL Server and is used for interfacing with the system platform, such as the "DIAL interface" module, and an application management module (APM).

In some embodiments, the verifying whether the control instruction is legal may further include, in addition to the verification method described above: and checking whether the specific operation corresponding to the control instruction is the registration operation of the DIAL Server, if so, determining that the control instruction is legal, and otherwise, determining that the control instruction is illegal. For example, the registration operation of the DIAL Server side includes: adjusting the volume of the equipment and the playing mode of the equipment, and determining that the control instruction is illegal when the specific operation corresponding to the control instruction is the adjustment of the playing progress; and when the specific operation corresponding to the control instruction is to adjust the volume of the equipment, determining that the control instruction is legal.

As can be seen from the above description, according to the method provided by the application, the display device and other devices in the same local area network can be directly interacted without depending on an application server as a communication bridge, so that the stability and efficiency of controlling the display device through applications on other devices can be improved, and the user experience can be improved.

The method provided by the present application is illustrated below:

referring to fig. 7, a flowchart of an embodiment of a volume control method for a display device of the present application includes the following steps:

and step 71, when detecting that the DIAL communication connection is established between the application on the equipment and the application on the other equipment, responding to a first control instruction sent by the other equipment, and playing the display content on the other equipment on the equipment.

In some embodiments, when an application on the display device has established a DIAL communication connection with an application on the other device, the user may send a first control instruction to the display device through the application on the other device to instruct the display device to play the display content on the other device.

In some embodiments, the other device, upon detecting that the own application has established a DIAL communication connection with the application on the display device, may automatically send a first control instruction to the display device to instruct the display device to play the display content on the other device.

For example, the first control instruction may carry content currently displayed by the application on the other device.

Illustratively, as shown in FIG. 4, a schematic view of a graphical user interface 400 for playing content on a display device that is displayed on another device.

And step 72, responding to a second control instruction sent by other equipment, and adjusting the playing volume of the equipment.

In some embodiments, in order to prevent the playback volume of the display device from continuously increasing due to the misoperation of the user and affecting the user experience, it is proposed that: a comfortable volume range is set on the display device, for example, 30-70 dB. Based on this, after determining that the received second control instruction for instructing to adjust the playing volume is received, if the second control instruction is for instructing to increase the playing volume, the display device may check whether the current playing volume is greater than a set first volume threshold, for example, 70dB, and if not, the display device executes the second control instruction; if yes, the current playing volume of the display device is high, and therefore a prompting message for prompting a user that the current playing volume of the display device exceeds a comfortable volume range is displayed on the display; further, as an optional implementation manner, the display device may also discard the second control instruction, so as to avoid that the user experience is affected by too large volume.

If the second control instruction is used to instruct to lower the playback volume, the display device may check whether the current playback volume is less than a set second volume threshold, for example, 30dB, and if not, the display device executes the second control instruction; if so, it means that the current playback volume of the display device is low, and thus a prompt message is displayed on the display for prompting the user that the current playback volume of the display device is below the comfortable volume range. Further, as an optional implementation manner, the display device may also discard the second control instruction or execute the second control instruction.

And 73, when detecting that the application on the equipment is disconnected from the connected DIAL communication connection with the application on other equipment, the equipment restores the playing volume before receiving the first control instruction.

The process of the DIAL Client side application disconnecting the DIAL communication connection with the DIAL Server side application is as follows:

in some embodiments, the applications of the DIAL Client may be closed by the user first. After the application is closed, the DIALClient end can send a disconnection request to the DIAL Server end, and after the DIAL Server end receives the disconnection request, the DIAL Server end executes an application exit process to close the application.

In some embodiments, the user may also directly close the application on the DIAL Server side, for example, the user may press an "exit key" on the control device 100A to send a control instruction indicating to close the application to the display apparatus 200 (i.e., the display apparatus 200 is used as the first screen device), and the display apparatus 200 closes the application in response to the control instruction.

In some embodiments, after the application of the DIAL Server is closed, the application of the DIAL Client is not automatically closed. For example, an indication message indicating that the DIAL connection has been disconnected may be displayed on a display interface of the DIAL Client application.

In some embodiments, the sound effects will be different due to different media formats, and therefore, the user's requirements for the playing volume of the display device when playing multimedia content provided by different signal sources are different, for example, the user is used to set the playing volume of the display device to 40dB when watching tv broadcast, and to set the playing volume of the display device to 60dB when watching multimedia content provided by other devices through the display device. Therefore, the application also provides that the display device can record the current signal channel and the current playing volume before receiving the first control instruction sent by other devices. On this basis, when the display device detects that an application on the device disconnects an established DIAL communication connection from an application on another device, the signal source may be switched back to establishing a channel between the DIAL communication connections, i.e., displaying a graphical user interface on the display where the recorded signal channel provides content, e.g., as shown in fig. 8, a schematic diagram of a graphical user interface 800 providing content for the recorded signal channel, and adjusting the playback volume to the playback volume prior to establishing the DIAL communication connection, i.e., adjusting the playback volume to the recorded playback volume, e.g., automatically adjusting the playback volume from 60dB to 40 dB.

Those skilled in the art can understand that the user operation can be saved and the user experience can be improved through the embodiments.

It can be seen from the above embodiments that, by the method provided by the present application, direct interaction between the display device and other devices in the same local area can be achieved, and no application server is required, which can improve stability of the communication process and improve communication efficiency.

While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims

1. A display device, comprising:

a display for displaying a graphical user interface;

a controller for performing:

2. The display device according to claim 1, wherein the controller further performs:

3. The display device according to claim 1, wherein the controller specifically performs:

if yes, displaying a prompt message for prompting that the playing volume exceeds the comfortable volume range on the display, and discarding the second control instruction for indicating to increase the playing volume;

4. The display device according to claim 1, wherein the controller specifically performs:

5. The display device according to claim 1, wherein the controller further performs:

6. A volume control method of a display device, comprising:

7. The method of claim 6, further comprising:

8. The method according to claim 6, wherein the adjusting the playing volume of the device in response to the second control instruction sent by the other device comprises:

9. The method according to claim 6, wherein the adjusting the playing volume of the device in response to the second control instruction sent by the other device comprises:

10. The method of claim 6, further comprising: