CN112929724A

CN112929724A - Display device, set top box and far-field pickup awakening control method

Info

Publication number: CN112929724A
Application number: CN202011643691.9A
Authority: CN
Inventors: 吴汉勇; 贾亚洲; 刘承龙
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-12-31
Filing date: 2020-12-31
Publication date: 2021-06-08
Anticipated expiration: 2040-12-31
Also published as: CN112929724B

Abstract

The application discloses a far-field pickup awakening control method for display equipment, which is characterized in that a communication connection with a set top box is established based on the set top box inserted into an external device interface of the display equipment; sending an instruction for inquiring opposite-end information to the set top box, wherein the opposite-end information comprises the following three information: whether the set top box supports far-field pickup, whether a far-field pickup function of the set top box is turned on, and whether a far-field pickup awakening word of the set top box is the same as that of the display device; and when at least one of the opposite-end information is negative, the display device responds to the far-field awakening sound signal based on an externally input far-field awakening sound signal. Under the condition that the display device and the set-top box have the same awakening words, the method can prevent the display device and the set-top box from being awakened at the same time, so that the trouble caused to a user is eliminated. In addition, the application also discloses a far-field pickup awakening control method of the set top box, display equipment and the set top box.

Description

Display device, set top box and far-field pickup awakening control method

Technical Field

The application relates to the technical field of far-field pickup, in particular to a far-field pickup awakening control method for display equipment. In addition, the application also relates to a far-field pickup awakening control method for the set top box. Moreover, the application also relates to a display device. Finally, the application also relates to a set top box.

Background

With the increasing number of intelligent devices in a home, the situation of repeated functions may occur on products of the same brand. Taking a television and an intelligent OTT box as examples, the awakening words of products of the same brand are the same under the general condition, when the awakening words are used for awakening equipment in a living room, because two intelligent equipment, namely an intelligent television and an intelligent box, exist in the living room and all support voice awakening, the two equipment can be awakened, when a user uses the television to watch network programs, the user hopes to awaken the television instead of the box, and when the user uses the OTT box externally connected with an HDMI channel of the television to watch programs, the user hopes to awaken the box instead of the box. The user may be bothered if awakened at the same time.

Similarly, if the television and the intelligent box of different brands are involved and the awakening words of the television and the intelligent box are the same, the same problem also exists, and the description is omitted.

Disclosure of Invention

The first technical problem to be solved by the present application is to provide a far-field pickup wake-up control method for a display device, which can avoid the display device and a set-top box from being woken up at the same time under the condition that wake-up words of the display device and the set-top box are the same, thereby eliminating the trouble to a user. In addition, a second technical problem to be solved in the present application is to provide a far-field pickup wake-up control method for a set-top box. Furthermore, a third technical problem to be solved in the present application is to provide a display device. Finally, a fourth technical problem to be solved in the present application is to provide a set top box.

In order to solve the first technical problem, the present application provides a far-field pickup wake-up control method for a display device, which establishes a communication connection with a set-top box based on the set-top box into which an external device interface of the display device is inserted;

sending an instruction for inquiring opposite-end information to the set top box, wherein the opposite-end information comprises the following three information:

whether the set top box supports far-field pickup, whether a far-field pickup function of the set top box is turned on, and whether a far-field pickup awakening word of the set top box is the same as that of the display device;

and when at least one of the opposite-end information is negative, the display device responds to the far-field awakening sound signal based on an externally input far-field awakening sound signal.

In order to solve the second technical problem, the present application provides a far-field pickup wake-up control method for a set-top box, which establishes a communication connection with a display device based on an external device interface of the display device;

receiving an instruction for inquiring opposite terminal information sent by the display device, wherein the opposite terminal information comprises the following three information:

and when at least one of the opposite-end information is negative, the set top box does not respond to the externally input far-field awakening sound signal.

In order to solve the third technical problem, the present application provides a display device, including:

a sound collector configured to collect an external sound signal;

an external device interface configured to be connected with an external set-top box;

a controller configured to:

In order to solve the fourth technical problem, the present application provides a set top box, including:

a sound collector configured to collect an external sound signal;

a set-top box apparatus interface configured to connect with an external display device;

a controller configured to:

The technical effects of the embodiments of the present application are described below:

in an embodiment, the far-field pickup wake-up control method for the display device provided by the application establishes a communication connection with a set-top box based on the set-top box into which an external device interface of the display device is inserted; sending an instruction for inquiring opposite-end information to the set top box, wherein the opposite-end information comprises the following three information: whether the set top box supports far-field pickup, whether a far-field pickup function of the set top box is turned on, and whether a far-field pickup awakening word of the set top box is the same as that of the display device; and when at least one of the opposite-end information is negative, the display device responds to the far-field awakening sound signal based on an externally input far-field awakening sound signal. When all three pieces of information of the opposite terminal are yes, judging whether the current display equipment is under a communication channel of an external device interface where the set top box is located; if yes, controlling the set top box to respond to a far-field awakening sound signal input from the outside; and if not, responding to a far-field awakening sound signal input from the outside by the display equipment.

In summary, under the condition that the display device and the set-top box have the same wake-up word, the method can avoid the two wake-up words from being simultaneously awakened, thereby eliminating the trouble caused to the user.

In addition, the technical effects of the far-field pickup awakening control method for the set top box, the display device and the set top box provided by the application are the same as those of the far-field pickup awakening control method for the set top box, and are not repeated herein.

Drawings

In order to more clearly illustrate the embodiments of the present application or the implementation manner in the related art, a brief description will be given below of the drawings required for the description of the embodiments or the related art, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art according to the drawings.

FIG. 1 illustrates an operational scenario between a display device and a control apparatus according to some embodiments;

fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;

FIG. 5 illustrates an icon control interface display of an application in display device 200, in accordance with some embodiments;

FIG. 6 illustrates a network architecture diagram of some embodiments;

fig. 7 is a schematic diagram illustrating a connection relationship between a display device and a set-top box according to an embodiment of the present application;

FIG. 8 is a logic flow diagram of a far field pick-up wake-up control method for a display device in an embodiment of the present application;

fig. 9 is a logic flow diagram of a far-field pick-up wake-up control method for a set-top box in an embodiment of the present application;

FIG. 10 is a timing diagram illustrating signaling between a display device and a set-top box according to an embodiment of the present application;

fig. 11 is a logic flow diagram of a wake-up control method for far-field pickup in accordance with yet another embodiment of the present application;

fig. 12 is a logic flow diagram of a wake-up control method for far-field pickup according to yet another embodiment of the present application.

Detailed Description

In order to make the technical solution better understood by those skilled in the art, the technical solution in the embodiment of the present application will be clearly and completely described below with reference to the attached drawings in the embodiment of the present application.

In some of the flows described in the specification and claims of this application and in the above-described figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, the number of operations, e.g., 101, 102, etc., merely being used to distinguish between various operations, and the number itself does not represent any order of performance. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any inventive step, are within the scope of the present application.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200.

In some embodiments, the smart device 300 (e.g., mobile terminal, tablet, computer, laptop, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the display device 200 may be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received by a module configured inside the display device 200 to obtain the voice command, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller comprises a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving the display of an image, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

In some embodiments, the display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the external control apparatus 100 or the server 400 through the communicator 220.

In some embodiments, the user interface may be configured to receive control signals for controlling the apparatus 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any of a number of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying the operation of connecting to the hyperlink page, document, image, etc. or executing the program corresponding to the icon.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module, such as an image synthesizer, is used for carrying out superposition mixing processing on the GUI signal which is input by the user or generated by the image generator and the video image after the zooming processing so as to generate an image signal for display. And the frame rate conversion module is used for converting the input video frame rate. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A common presentation form of a User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs, system setting programs, clock programs or the like of the operating system; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in the process of execution through the API interface.

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the various applications and the general navigation fallback functions, such as controlling exit, open, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.

In some embodiments, the system runtime layer provides support for an upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

In some embodiments, the display device may directly enter the interface of the preset vod program after being activated, and the interface of the vod program may include at least a navigation bar 510 and a content display area located below the navigation bar 510, as shown in fig. 5, where the content displayed in the content display area may change according to the change of the selected control in the navigation bar. The programs in the application layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can also be further displayed after the application control in the navigation bar is selected.

In some embodiments, the display device may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface, a live tv interface, and the like, and after a user selects a different signal source, the display may display content obtained from the different signal source. May be used.

For the purpose of clearly illustrating the embodiments of the present application, some explanations of related terms are given below.

Entity: it is intended to refer to things that exist objectively and that can be distinguished from each other, including specific persons, things, mechanisms, abstract concepts, and the like.

Knowledge graph: is essentially a semantic network that can represent semantic relationships between entities. Entities are used as vertexes or nodes in the knowledge graph, and relationships are used as edges. The knowledge graph can be constructed in various ways, and the embodiment of the application does not point to how to construct the knowledge graph, so the detailed description is not provided.

For clarity of explanation of the embodiments of the present application, a speech recognition network architecture provided by the embodiments of the present application is described below with reference to fig. 6.

Referring to fig. 6, fig. 6 is a schematic diagram of a voice recognition network architecture according to an embodiment of the present application. In fig. 6, the smart device is used to receive input information and output a processing result of the information. The voice recognition service equipment is electronic equipment with voice recognition service deployed, the semantic service equipment is electronic equipment with semantic service deployed, and the business service equipment is electronic equipment with business service deployed. The electronic device may include a server, a computer, and the like, and the speech recognition service, the semantic service (also referred to as a semantic engine), and the business service are web services that can be deployed on the electronic device, wherein the speech recognition service is used for recognizing audio as text, the semantic service is used for semantic parsing of the text, and the business service is used for providing specific services such as a weather query service for ink weather, a music query service for QQ music, and the like. In one embodiment, there may be multiple entity service devices deployed with different business services in the architecture shown in fig. 6, and one or more function services may also be aggregated in one or more entity service devices.

In some embodiments, the following describes an example of a process for processing information input to a smart device based on the architecture shown in fig. 6, where the information input to the smart device is an example of a query statement input by voice, the process may include the following three processes:

[ Speech recognition ]

The intelligent device can upload the audio of the query sentence to the voice recognition service device after receiving the query sentence input by voice, so that the voice recognition service device can recognize the audio as a text through voice recognition service and then return the text to the intelligent device. In one embodiment, before uploading the audio of the query statement to the speech recognition service device, the smart device may perform denoising processing on the audio of the query statement, where the denoising processing may include removing echo and environmental noise.

[ semantic understanding ]

The intelligent device uploads the text of the query sentence identified by the voice identification service to the semantic service device, and the semantic service device performs semantic analysis on the text through semantic service to obtain the service field, intention and the like of the text.

[ semantic response ]

And the semantic service equipment issues x query instructions to corresponding business service equipment according to semantic analysis results of the text of the query statement so as to obtain query results given by the business service. The intelligent device can obtain the query result from the semantic service device and output the query result. As an embodiment, the semantic service device may further send a semantic parsing result of the query statement to the intelligent device, so that the intelligent device outputs a feedback statement in the semantic parsing result.

It should be noted that the architecture shown in fig. 6 is only an example, and is not intended to limit the scope of the present application. In the embodiments of the present application, other architectures may also be used to implement similar functions, for example: all or part of the three processes can be completed by the intelligent terminal, and are not described herein.

Referring to fig. 7, fig. 7 is a schematic diagram illustrating a connection relationship between a display device and a set-top box according to an embodiment of the present application.

In some embodiments, a display device provided herein includes a far-field MIC for picking up sound in the far-field; the set top box provided by the application comprises a far-field MIC and is also used for picking up sound in the far field. The display device is in communication connection with the set-top box through an external device interface. As an example, as shown in fig. 7, the external device interface may be an HDMI interface. In addition, it should be noted that the display device may be a television, or may be other devices that play audio and video media content, which is not limited in this application.

It should be further noted that, in the present application, the set-top box may be an OTT set-top box, may also be an IPTV box, and may also be other types of television boxes, which is not limited in the present application. A set-top box refers to a high-definition terminal device for a user to watch online videos (such as high-definition live television, drama, movie, art, and the like) through internet connection, and the set-top box is developed to be simply understood as an internet television set-top box.

Referring to fig. 8, fig. 8 is a logic flow diagram of a wake-up control method for far-field sound pickup of a display device according to an embodiment of the present application.

In one embodiment, the present application provides a far-field pickup wake-up control method for a display device, including the following steps:

s101, establishing communication connection with a set-top box based on the set-top box inserted into an external device interface of the display equipment;

here, it should be noted that, as an example, the external device interface may be an HDMI interface. The display equipment is connected with the set-top box through the external device interface, and performs interactive transmission of information instructions, interactive transmission of contents and the like.

Here, a communication connection manner between the display device and the set-top box may be specifically designed, please refer to fig. 10, where fig. 10 is a signaling timing diagram between the display device and the set-top box in an embodiment of the present application.

In some embodiments, the "establishing a communication connection with a set-top box based on the set-top box into which an external device interface of the display apparatus is inserted" includes:

based on a consumer electronics control communication link, the display device sends the generated first random information to the set top box and receives second random information generated by the set top box;

the display equipment starts network monitoring and receives first random information which is sent by the set top box and attempts network connection; and after the connection is successful, returning the second random information to the set top box, thereby establishing the network-based communication connection between the display equipment and the set top box.

Specifically, as shown in fig. 10, R1 denotes the first random information, and R2 denotes the second random information. Furthermore, the "consumer electronics control communication link" is explained as follows:

CEC, collectively referred to as Consumer Electronics Control, is a Consumer Electronics Control channel. The mutual interaction and control among the devices on the HDMI CEC Network can be controlled through the channel. The role of CEC is that a user can control a plurality of CEC-enabled smart devices using one remote controller, thereby eliminating the need to use a plurality of remote controllers to control the devices, such as: television (TV), set-top box products, audio and video players, etc. The HDMI-CEC function allows a user to control devices connected to the HDMI interface using a CEC signal.

In this step, after the set-top BOX (i.e. BOX in the figure) is connected to the display device (i.e. TV in the figure), both parties generate random numbers R1 and R2 (which may be extended to unique identification codes such as UUID, etc.), respectively, and each sends this random number to the opposite party via the consumer electronics control communication link (i.e. HDMI-CEC link). At this time, since the HDMI line is of a direct connection at both ends, there is no third party on the line.

Then, the arbitrary end starts the network monitoring service, the other end uses the random number R1 received in the previous step as the authentication identifier to try connection, and after the connection is successful, checks whether the replied random number is the R2 sent by the arbitrary end. For example, if a network monitoring service can be started at one end of a display device, the display device starts network monitoring and receives first random information of network connection attempt sent by the set top box; and after the connection is successful, returning the second random information to the set top box, thereby establishing the network-based communication connection between the display equipment and the set top box.

Of course, it is also possible that the set-top box side initiates the network listening service, and such an embodiment will be described in detail below.

After this step is completed, the BOX establishes a network-based communication link with the TV end.

The other connection path is changed to only the link establishment method after CEC, for example, both sides are connected to the same wide area network server. Or directly using CEC for data exchange (communication performance is slower than that of a network).

In addition, in the present application, the communication connection established between the display device and the set-top box is referred to as including CEC, a network, or other links that can connect the two parties together and have been authenticated.

After the step S102 is completed, the present application further includes the following steps:

s102, sending an instruction for inquiring opposite-end information to the set top box, wherein the opposite-end information comprises the following three information:

and S103, when at least one of the opposite-end information is negative, responding the far-field awakening sound signal by the display equipment based on an externally input far-field awakening sound signal.

in this step, after one end of the display device is in communication connection with one end of the set-top box, the display device sends an instruction for inquiring the information of the opposite end to the set-top box. Here, explanation is made on "opposite end": the display device and the set-top box are respectively provided with two ends, and the two sides are mutually provided with an opposite end, so that the opposite end of the display device is the set-top box, and the opposite end of the set-top box is the display device. In this step, the instruction for inquiring the information at the opposite end sent by the display device, that is, the instruction for inquiring the information at the set top box end sent by the display device.

Here, the peer-to-peer information on the set-top box side includes at least three types as follows:

whether the set top box supports far-field pickup, whether the far-field pickup function of the set top box is turned on, and whether a far-field pickup awakening word of the set top box is the same as that of the display device.

Obviously, if any of the above three types of peer information relating to the set-top box is negative, there is no need to coordinate far-field wake-up between the display device and the set-top box. For example, if the set-top box does not support far-field pickup, only the display device supports far-field pickup, and thus there is certainly no far-field wake-up collision at this time. In addition, if the set-top box supports far-field pickup, but the far-field pickup function of the set-top box is turned off at this time, obviously, there will be no far-field wake-up collision at this time.

Further, if the set-top box supports far-field pickup and the far-field pickup function of the set-top box is turned on at this time, but the far-field pickup wake-up word of the set-top box is different from that of the display device, for example, the wake-up word of the display device is "hello, haixin duet" and the wake-up word of the set-top box is "hello, tv box". Obviously, when the user says "hello, haixin is small", the display device is awakened, and the conflict with the set-top box can not happen.

Thus, further design may be made on the basis of the above-described embodiment. For example, when all three pieces of information of the opposite-end information are yes, whether the current display device is in a communication channel of an external device interface where the set top box is located is judged;

if yes, controlling the set top box to respond to a far-field awakening sound signal input from the outside;

and if not, responding to a far-field awakening sound signal input from the outside by the display equipment.

In this embodiment, when all three pieces of information in the peer-to-peer information are yes, that is:

the set-top box supports far-field sound pickup;

the far-field pickup function of the set-top box is turned on

The far-field pickup awakening words of the set top box are the same as those of the display device, for example, "you are good, and the amount of the haixin is small".

Clearly, when the user plans to wake up the television, say "hello, little confident", there is a chance of wake-up conflicts between the display device and the set-top box.

However, the following determination is made to determine whether there is indeed a wake-up collision between the two:

judging whether the current display equipment is under a communication channel of an external device interface where the set top box is located;

Here, it should be noted that, as an example, it is determined whether the display device is currently under a communication channel of an interface of an external device where the set top box is located, that is, whether the display device is under a communication channel of an HDMI where the set top box is located:

if so, it indicates that the current display device plays the video content in the set-top box delivered via the HDMI interface, that is, the current display device may be considered to be operating in the set-top box mode, and thus, the set-top box should respond to the externally input far-field wake-up sound signal at this time.

If not, it indicates that the video content in the set-top box, which is not delivered via the HDMI interface, is played by the current display device, and is the content downloaded by the display device itself from the internet or other content, that is, the current display device may be considered to be operating in the mode of its own display device, and therefore, the display device should respond to the externally input far-field wake-up sound signal at this time.

Further, it should be noted that, since the TV side (i.e., the side of the display device) is the side that actively controls the display content, the TV side currently displays "non-HDMI" or "HDMI".

The case of "non-HDMI" includes, without limitation, home page, application, web video, ATV, DTV, etc., when, as also stated above, the display device is not under the communication channel of the HDMI in which the set-top box is located.

In the case of "HDMI", at this time, that is, as mentioned above, the display device is under the communication channel of the HDMI in which the set-top box is located.

However, since there may be multiple input devices to the TV (e.g., a set-top box, multiple game machines, a computer, etc. connected to the same TV), the process of determining the "HDMI content source for display" should be entered. Thus, the present application also includes the steps of:

when a plurality of external device interfaces of the display device are connected with external input devices, the step of judging whether the display device is currently located under a communication channel of the external device interface where the set-top box is located includes:

receiving a data signal with identification information sent by the set top box, and based on a preset identification rule:

when the data signal is identified to carry the identification information, the current display equipment is under a communication channel of an external device interface where the set top box is located;

and when the data signal is identified not to carry the identification information, the current display equipment is not under the communication channel of the external device interface where the set top box is located.

In the above step, when the external data interface is HDMI, device identification can be performed using the HDMI data itself.

In this scheme, a specific mark (for example, R1 in fig. 10, but it may also be other marks) may be added to the HDMI signal sent by the BOX, and the TV recognizes this mark, so that it can know that what is currently being decoded and played is the content of the connected BOX. The schemes for adding markers are:

the labeling schemes include the following:

first, various algorithms (e.g., lsb) are used to steganographically in the video frame, or to directly modify some of the content of the video frame (e.g., the lowest order bits are all changed to 1).

The second, placed in the Vendor Specific info frame of the data island period of the HDMI data.

In addition, the following judgment scheme can be adopted:

currently, the display equipment records the currently played multi-frame image data;

receiving specific frame image data sent by the set top box in the same time period;

comparing the specific frame image data with the multi-frame image data one by one;

when the matching is successful, the current display equipment is under the communication channel of the external device interface where the set top box is located;

and when the matching is unsuccessful, the display equipment is not under the communication channel of the external device interface where the set top box is located.

In the above steps, the specific process is as follows: when the TV is switched to the HDMI channel to play, multi-frame image data are continuously recorded, the BOX end sends certain frame data during playing to the TV through the data path established in the step 1, and after the TV receives the data, the data are matched with the recorded images one by one. If the matching is successful, the currently played content is considered as the connected BOX.

In addition, the application also provides an embodiment of a far-field pickup awakening control method for the set top box. Specifically, please refer to fig. 9, fig. 9 is a logic flow diagram of a wake-up control method for far-field pickup of a set-top box according to an embodiment of the present application.

In one embodiment, as shown in fig. 9, a far-field pickup wake-up control method for a set-top box includes:

step S2O 1: establishing a communication connection with the display apparatus based on an external device interface of the display apparatus;

step S2O 2: receiving an instruction for inquiring opposite terminal information sent by the display device, wherein the opposite terminal information comprises the following three information:

step S2O 3: and when at least one of the opposite-end information is negative, the set top box does not respond to the externally input far field awakening sound signal.

In some embodiments, when all three pieces of information of the opposite-end information are yes, determining whether the display device is in a communication channel of an interface of an external device where the set top box is located;

if yes, receiving a control command of the display equipment, and responding to a far-field awakening sound signal input from the outside;

and if not, receiving a control command of the display equipment, and not responding to the far-field awakening sound signal input from the outside.

In some embodiments, when a plurality of external device interfaces of the display apparatus are connected to the external input apparatus, the determining whether the display apparatus is currently located under a communication channel of the external device interface where the set-top box is located includes:

sending a data signal with identification information to the display device, based on a predetermined recognition rule,

when the display equipment identifies that the data signal carries the identification information, the display equipment is currently under a communication channel of an external device interface where the set top box is located;

and when the display equipment identifies that the data signal does not carry the identification information, the display equipment is not under the communication channel of the external device interface where the set top box is located.

transmitting specific frame image data to the display device;

the display equipment compares the specific frame of image data with the multi-frame image data recorded by the display equipment one by one;

In some embodiments, the "establishing a communication connection with the display apparatus based on an external device interface of the display apparatus" includes:

based on a consumer electronics control communication link, the set top box sends the generated second random information to the display device and receives the first random information generated by the display device;

the set top box starts network monitoring and receives second random information which is sent by the display equipment and attempts network connection; and after the connection is successful, returning the first random information to the display equipment, thereby establishing the network-based communication connection between the set top box and the display equipment.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the above-described working process and technical effects of the far-field sound pickup wake-up control method for the set-top box may refer to a corresponding process and technical effects in an embodiment of the far-field sound pickup wake-up control method for the display device, and are not described herein again.

Referring to fig. 11 and 12, fig. 11 is a logic flow diagram of a wake-up control method for far-field pickup according to still another embodiment of the present application; fig. 12 is a logic flow diagram of a wake-up control method for far-field pickup according to yet another embodiment of the present application.

In an embodiment, as shown in fig. 11, the far-field pickup wake-up control method provided by the present application includes:

1. first, it was confirmed that the display device, i.e., the television, supports far-field pickup;

2. when the HDMI cable is inserted, the two parties exchange information, and the two ends take the device information (that is, the display device takes the opposite end information of the set-top box, and the set-top box takes the opposite end information of the display device, the specific method refers to the embodiment of the method above)

3. And respectively inquiring whether the opposite terminal equipment supports far-field pickup, and if one terminal does not support far-field pickup, stopping logic. If all the information is supported, continuing to perform a conflict negotiation process.

Continuing, as shown in figure 12,

4. the television is used as a main device, the box is used as a slave device, the next communication is started, and the method and the process for establishing the communication connection between the television and the box can refer to the embodiment of the method.

5. If the television is not started and the box cannot receive information, the default state is to respond to the voice awakening word for awakening.

6. If the television is started, the television judges that the current time is under the HDMI channel where the box is located, if the current time is not under the HDMI channel, information is transmitted to the box, and the box is told not to respond to the awakening words; the specific implementation method of this step can refer to the foregoing method embodiments.

7. If the television is currently under the HDMI channel where the box is located, the television transmits information to the box to tell the box to respond to the awakening word, and the television does not respond to the awakening word.

8. If the box is powered off and the television cannot monitor the box signal, the television responds to the awakening word.

In addition, the present application also provides a display device, characterized by comprising:

a sound collector configured to collect an external sound signal;

a controller configured to:

Moreover, this application still provides a set-top box, includes:

a sound collector configured to collect an external sound signal;

a controller configured to:

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes and technical effects of the display device and the set top box described above may refer to the corresponding processes and technical effects in the foregoing method embodiments, and are not described herein again.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Reference throughout this specification to "embodiments," "some embodiments," "one embodiment," or "an embodiment," etc., means that a particular feature, component, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, appearances of the phrases "in various embodiments," "in some embodiments," "in at least one other embodiment," or "in an embodiment," or the like, throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, components, or characteristics may be combined in any suitable manner in one or more embodiments. Thus, without limitation, a particular feature, component, or characteristic illustrated or described in connection with one embodiment may be combined, in whole or in part, with a feature, component, or characteristic of one or more other embodiments. Such modifications and variations are intended to be included within the scope of the present application.

Moreover, those skilled in the art will appreciate that aspects of the present application may be illustrated and described by several patentable species or situations, including any new and useful combination of processes, machines, manufacture, or materials, or any new and useful improvement thereof. Accordingly, various aspects of the present application may be embodied entirely in hardware, entirely in software (including firmware, resident software, micro-code, etc.), or in a combination of hardware and software. The above hardware or software may be referred to as "data blocks," modules, "" engines, "" terminals, "" components, "or" systems. Furthermore, aspects of the present application may be represented as a computer product, including computer readable program code, embodied in one or more computer readable media.

It is to be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The above description is merely exemplary of the present application and is presented to enable those skilled in the art to understand and practice the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some of the technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A far-field pick-up wake-up control method for a display device,

establishing communication connection with a set top box based on the set top box into which an external device interface of the display equipment is inserted;

2. The far-field pickup wake-up control method for a display device according to claim 1,

when all three pieces of information of the opposite terminal are yes, judging whether the current display equipment is under a communication channel of an external device interface where the set top box is located;

3. The far-field pickup wake-up control method for a display device according to claim 2,

4. The far-field pickup wake-up control method for a display device according to claim 2,

5. The wake-on-far-field pickup control method for a display device according to any one of claims 1 to 4, wherein the "establishing a communication connection with a set-top box based on the set-top box into which an external device interface of the display device is inserted" comprises:

6. A far-field pickup wake-up control method for a set-top box,

establishing a communication connection with the display apparatus based on an external device interface of the display apparatus;

7. The far-field pickup wake-up control method for a set-top box according to claim 6, wherein when all three pieces of information of the opposite-end information are yes, it is determined whether the display device is under a communication channel of an interface of an external apparatus where the set-top box is located;

8. The far-field pickup wake-up control method for a set-top box according to claim 7,

9. The far-field pickup wake-up control method for a set-top box according to claim 7,

transmitting specific frame image data to the display device;

10. The far-field pickup wake-up control method for the set-top box according to any one of claims 6 to 9, wherein the "establishing a communication connection with the display apparatus based on an external device interface of the display apparatus" comprises:

11. A display device, comprising:

a sound collector configured to collect an external sound signal;

a controller configured to:

12. A set top box, comprising:

a sound collector configured to collect an external sound signal;

a controller configured to: