CN113010074A

CN113010074A - Webpage Video control bar display method and display equipment

Info

Publication number: CN113010074A
Application number: CN202110437876.2A
Authority: CN
Inventors: 吴金旺; 罗一龙
Original assignee: Hisense Electronic Technology Shenzhen Co ltd
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2021-04-22
Filing date: 2021-04-22
Publication date: 2021-06-22

Abstract

The application discloses a webpage Video control bar display method and display equipment, which are used for triggering a webpage Video to enter a voice mode and receiving a voice command input through the voice control equipment, if the current simulated mouse is further detected to be in a webpage entering state, a simulated mouse moving HOVER _ MOVE event in an interface range where the webpage Video is located is generated according to a period, so that the simulated mouse periodically MOVEs on an interface of the webpage Video, and the Video control bar in the webpage can be triggered through the simulated mouse time, so that when the simulated mouse periodically MOVEs, the Video control bar can be triggered to be displayed in the interface range where the webpage Video is located, and a user can visually know the operation supported by the webpage Video through the displayed control bar when using a voice control function.

Description

Webpage Video control bar display method and display equipment

Technical Field

The application relates to the technical field of internet, in particular to a webpage Video control bar display method and display equipment.

Background

After the Video starts playing the Video in the web page, the Video control bar is normally hidden actively so as not to affect the user to watch the Video, and at this time, if the user needs to operate the playing state of the Video, such as muting, pausing, fast forwarding and fast rewinding, etc., the user needs to move a mouse or activate a keyboard to operate, and the Video control bar can be displayed on the interface, so that the user can know the operation of controlling the playing state of the Video which can be currently used.

However, if the user operates the playing state of the Video through the voice function, the web page does not display the Video control bar, and at this time, the user cannot know which operations are supported by the Video played in the current web page. For example, when the Video in the current webpage does not support full-screen playing, because the user cannot know that the Video in the current webpage does not support full-screen playing from the Video control bar when using the voice function, at this time, if the user inputs a voice instruction for instructing to play the Video in full-screen, the current webpage does not respond to the voice instruction, which causes a trouble that whether the voice function is available or not for the user.

Disclosure of Invention

The application discloses a webpage Video control bar display method and display equipment, which are used for displaying a Video control bar when a user uses a voice function, so that the user can visually know the operation supported by a webpage Video.

According to a first aspect of embodiments of the present application, there is provided a display apparatus including:

a display;

a controller coupled with the display and configured to:

when the voice control equipment is detected to be activated, triggering the webpage Video to enter a voice mode, wherein the voice mode is used for controlling the playing state of the webpage Video through a voice instruction;

when the fact that the webpage Video enters the voice mode is determined, and a voice command input through voice control equipment is received, if the fact that a current simulated mouse is in a webpage entering state is detected, a simulated mouse moving HOVER _ MOVE event in an interface range where the webpage Video is located is generated according to a first period, so that the simulated mouse MOVEs on the interface of the webpage Video, a Video control bar is triggered to be displayed in the interface range where the webpage Video is located through a display, and the first period is smaller than or equal to the hiding time of the set Video control bar after the Video control bar is triggered to be displayed.

According to a second aspect of the embodiments of the present application, there is provided a method for displaying a Video control bar of a web page, the method including:

when the fact that the webpage Video enters the voice mode is determined, and a voice command input through voice control equipment is received, if the fact that a current simulated mouse is in a webpage entering state is detected, a simulated mouse moving HOVER _ MOVE event in an interface range where the webpage Video is located is generated according to a first period, so that the simulated mouse MOVEs on the interface of the webpage Video, a Video control bar is triggered to be displayed in the interface range where the webpage Video is located, and the first period is smaller than or equal to the hiding time of the set Video control bar after the Video control bar is triggered to be displayed.

The technical scheme provided by the embodiment of the application can have the following beneficial effects:

according to the technical scheme, in the scheme provided by the application, when the voice control device is detected to be activated, the web page Video is triggered to enter the voice mode, and when it is determined that the web page Video enters the voice mode and a voice instruction input through the voice control device is received, if it is further detected that the current simulated mouse is in a state of entering the web page, a simulated mouse movement HOVER _ MOVE event within the interface range of the web page Video is generated according to a first period so as to simulate the periodic movement of the mouse on the interface of the web page Video, since the Video control bar in the web page can be triggered by the simulated mouse time, when the simulated mouse movement HOVER _ MOVE event within the interface range of the web page Video is generated, the Video control bar is triggered to be displayed within the interface range of the web page Video, so that when a user uses the voice control function, the operation supported by the webpage video can be intuitively known through the displayed control bar.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments consistent with the present application and together with the application, serve to explain the principles of the application.

Fig. 1A is a schematic diagram illustrating an operation scenario between the display device 200 and the control apparatus 100;

fig. 1B is a block diagram schematically illustrating a configuration of the control apparatus 100 in fig. 1A;

fig. 1C is a block diagram schematically illustrating a configuration of the display device 200 in fig. 1A;

FIG. 1D is a block diagram illustrating an architectural configuration of an operating system in memory of display device 200;

FIG. 2 is a flowchart of a method for displaying a Video control bar of a web page according to the present application;

FIG. 3 is a schematic diagram of a full screen display interface of a web Video provided by the present application;

fig. 4 is a schematic interface diagram of non-full screen display of a web page Video provided by the present application.

Detailed Description

To make the objects, embodiments and advantages of the present application clearer, the following description of exemplary embodiments of the present application will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is to be understood that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without making any inventive step, are within the scope of protection of the present application. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in this application are used for distinguishing between similar or analogous objects or entities and are not necessarily meant to define a particular order or sequence Unless otherwise noted (Unless thermally induced). It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

In order to facilitate understanding of the embodiments provided in the present application, the following first describes the structure of the display device and the interaction process between the display device and the control device:

fig. 1A is a schematic diagram illustrating an operation scenario between the display device 200 and the control apparatus 100. As shown in fig. 1A, the control apparatus 100 and the display device 200 may communicate with each other in a wired or wireless manner.

Among them, the control apparatus 100 is configured to control the display device 200, which may receive an operation instruction input by a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an intermediary for interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

The control device 100 may be a remote controller 100A, which includes infrared protocol communication or bluetooth protocol communication, and other short-distance communication methods, etc. to control the display apparatus 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

The control device 100 may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like. For example, the display device 200 is controlled using an application program running on the smart device. The application program may provide various controls to a user through an intuitive User Interface (UI) on a screen associated with the smart device through configuration.

For example, the mobile terminal 100B may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 100B may be caused to establish a control instruction protocol with the display device 200 to implement the functions of the physical keys as arranged in the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

The display apparatus 200 may be implemented as a television, and may provide an intelligent network television function of a broadcast receiving television function as well as a computer support function. Examples of the display device include a digital television, a web television, a smart television, an Internet Protocol Television (IPTV), and the like.

The display device 200 may be a liquid crystal display, an organic light emitting display, a projection display device. The specific display device type, size, resolution, etc. are not limited.

The display apparatus 200 also performs data communication with the server 300 through various communication means. Here, the display apparatus 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display apparatus 200. By way of example, the display device 200 may send and receive information such as: receiving Electronic Program Guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The servers 300 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

Fig. 1B is a block diagram illustrating the configuration of the control device 100. As shown in fig. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.

The controller 110 includes a Random Access Memory (RAM)111, a Read Only Memory (ROM)112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components of the communication cooperation, external and internal data processing functions.

Illustratively, when an interaction of a user pressing a key disposed on the remote controller 100A or an interaction of touching a touch panel disposed on the remote controller 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction and transmit the signal to the display device 200.

And a memory 120 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 120 may store various control signal commands input by a user.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the control apparatus 100 transmits a control signal (e.g., a touch signal or a button signal) to the display device 200 via the communicator 130, and the control apparatus 100 may receive the signal transmitted by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

The user input interface 140 may include at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like, so that a user can input a user instruction regarding controlling the display apparatus 200 to the control apparatus 100 through voice, touch, gesture, press, and the like.

The output interface 150 outputs a user instruction received by the user input interface 140 to the display apparatus 200, or outputs an image or voice signal received by the display apparatus 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 generating vibration, a sound output interface 153 outputting sound, a display 154 outputting an image, and the like. For example, the remote controller 100A may receive an output signal such as audio, video, or data from the output interface 150, and display the output signal in the form of an image on the display 154, in the form of audio on the sound output interface 153, or in the form of vibration on the vibration interface 152.

And a power supply 160 for providing operation power support for each element of the control device 100 under the control of the controller 110. In the form of a battery and associated control circuitry.

A hardware configuration block diagram of the display device 200 is exemplarily illustrated in fig. 1C. As shown in fig. 1C, the display apparatus 200 may further include a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, a display 275, an audio processor 280, an audio input interface 285, and a power supply 290.

The tuner demodulator 210 receives the broadcast television signal in a wired or wireless manner, may perform modulation and demodulation processing such as amplification, mixing, and resonance, and is configured to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., EPG data).

The tuner demodulator 210 is responsive to the user selected frequency of the television channel and the television signal carried by the frequency, as selected by the user and controlled by the controller 250.

The tuner demodulator 210 can receive a television signal in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be adopted; and can demodulate the analog signal and the digital signal according to the different kinds of the received television signals.

In other exemplary embodiments, the tuning demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a television signal after modulation and demodulation, and inputs the television signal into the display apparatus 200 through the external device interface 240.

The communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the display apparatus 200 may transmit content data to an external apparatus connected via the communicator 220, or browse and download content data from an external apparatus connected via the communicator 220. The communicator 220 may include a network communication protocol module or a near field communication protocol module, such as a WIFI module 221, a bluetooth communication protocol module 222, and a wired ethernet communication protocol module 223, so that the communicator 220 may receive a control signal of the control device 100 according to the control of the controller 250 and implement the control signal as a WIFI signal, a bluetooth signal, a radio frequency signal, and the like.

The detector 230 is a component of the display apparatus 200 for collecting signals of an external environment or interaction with the outside. The detector 230 may include an image collector 231, such as a camera, a video camera, etc., which may be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and the function of acquiring the attribute of the user or interacting gestures with the user so as to realize the interaction between the display equipment and the user. A light receiver 232 may also be included to collect ambient light intensity to adapt to changes in display parameters of the display device 200, etc.

In some other exemplary embodiments, the detector 230 may further include a temperature sensor, such as by sensing an ambient temperature, and the display device 200 may adaptively adjust a display color temperature of the image. For example, when the temperature is higher, the display apparatus 200 may be adjusted to display a color temperature of an image that is cooler; when the temperature is lower, the display device 200 may be adjusted to display a warmer color temperature of the image.

In some other exemplary embodiments, the detector 230, which may further include a sound collector, such as a microphone, may be configured to receive a sound of a user, such as a voice signal of a control instruction of the user to control the display device 200; alternatively, ambient sounds may be collected that identify the type of ambient scene, enabling the display device 200 to adapt to ambient noise.

The external device interface 240 is a component for providing the controller 210 to control data transmission between the display apparatus 200 and an external apparatus. The external device interface 240 may be connected to an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired/wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 240 may include: a High Definition Multimedia Interface (HDMI) terminal 241, a Composite Video Blanking Sync (CVBS) terminal 242, an analog or digital Component terminal 243, a Universal Serial Bus (USB) terminal 244, a Component terminal (not shown), a red, green, blue (RGB) terminal (not shown), and the like.

The controller 250 controls the operation of the display device 200 and responds to the operation of the user by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in fig. 1C, the controller 250 includes a Random Access Memory (RAM)251, a Read Only Memory (ROM)252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. The RAM251, the ROM252, the graphic processor 253, and the CPU processor 254 are connected to each other through a communication bus 256 through a communication interface 255.

The ROM252 stores various system boot instructions. When the display apparatus 200 starts power-on upon receiving the power-on signal, the CPU processor 254 executes a system boot instruction in the ROM252, copies the operating system stored in the memory 260 to the RAM251, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 254 copies the various application programs in the memory 260 to the RAM251 and then starts running and starting the various application programs.

A graphic processor 253 for generating screen images of various graphic objects such as icons, images, and operation menus. The graphic processor 253 may include an operator for performing an operation by receiving various interactive instructions input by a user, and further displaying various objects according to display attributes; and a renderer for generating various objects based on the operator and displaying the rendered result on the display 275.

A CPU processor 254 for executing operating system and application program instructions stored in memory 260. And according to the received user input instruction, processing of various application programs, data and contents is executed so as to finally display and play various audio-video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some initialization operations of the display apparatus 200 in the display apparatus preload mode and/or operations of displaying a screen in the normal mode. A plurality of or one sub-processor for performing an operation in a state of a standby mode or the like of the display apparatus.

The communication interface 255 may include a first interface to an nth interface. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Where the object may be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object is, for example, an operation of displaying a link to a hyperlink page, document, image, or the like, or an operation of executing a program corresponding to an icon. The user input command for selecting the GUI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch panel, etc.) connected to the display apparatus 200 or a voice command corresponding to a user uttering voice.

A memory 260 for storing various types of data, software programs, or applications for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. And the term "memory" includes the memory 260, the RAM251 and the ROM252 of the controller 250, or a memory card in the display device 200.

In some embodiments, the memory 260 is specifically used for storing an operating program for driving the controller 250 of the display device 200; storing various application programs built in the display apparatus 200 and downloaded by a user from an external apparatus; data such as visual effect images for configuring various GUIs provided by the display 275, various objects related to the GUIs, and selectors for selecting GUI objects are stored.

In some embodiments, the memory 260 is specifically configured to store drivers and related data for the tuner demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, and the like, external data (e.g., audio-visual data) received from the external device interface, or user data (e.g., key information, voice information, touch information, and the like) received from the user interface.

In some embodiments, memory 260 specifically stores software and/or programs representing an Operating System (OS), which may include, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. Illustratively, the kernel may control or manage system resources, as well as functions implemented by other programs (e.g., the middleware, APIs, or applications); at the same time, the kernel may provide an interface to allow middleware, APIs, or applications to access the controller to enable control or management of system resources.

A block diagram of the architectural configuration of the operating system in the memory of the display device 200 is illustrated in fig. 1D. The operating system architecture comprises an application layer, a middleware layer and a kernel layer from top to bottom.

The application layer, the application programs built in the system and the non-system-level application programs belong to the application layer and are responsible for direct interaction with users. The application layer may include a plurality of applications such as NETFLIX applications, setup applications, media center applications, and the like. These applications may be implemented as Web applications that execute based on a WebKit engine, and in particular may be developed and executed based on HTML, Cascading Style Sheets (CSS), and JavaScript.

Here, HTML, which is called HyperText Markup Language (HyperText Markup Language), is a standard Markup Language for creating web pages, and describes the web pages by Markup tags, where the HTML tags are used to describe characters, graphics, animation, sound, tables, links, etc., and a browser reads an HTML document, interprets the content of the tags in the document, and displays the content in the form of web pages.

CSS, known as Cascading Style Sheets (Cascading Style Sheets), is a computer language used to represent the Style of HTML documents, and may be used to define Style structures, such as fonts, colors, locations, etc. The CSS style can be directly stored in the HTML webpage or a separate style file, so that the style in the webpage can be controlled.

JavaScript, a language applied to Web page programming, can be inserted into an HTML page and interpreted and executed by a browser. The interaction logic of the Web application is realized by JavaScript. The JavaScript can package a JavaScript extension interface through a browser, realize the communication with the kernel layer,

the middleware layer may provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as multimedia and hypermedia information coding experts group (MHEG) middleware related to data broadcasting, DLNA middleware which is middleware related to communication with an external device, middleware which provides a browser environment in which each application program in the display device operates, and the like.

The kernel layer provides core system services, such as: file management, memory management, process management, network management, system security authority management and the like. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: provide display driver for the display, provide camera driver for the camera, provide button driver for the remote controller, provide wiFi driver for the WIFI module, provide audio driver for audio output interface, provide power management drive for Power Management (PM) module etc..

A user interface 265 receives various user interactions. Specifically, it is used to transmit an input signal of a user to the controller 250 or transmit an output signal from the controller 250 to the user. For example, the remote controller 100A may transmit an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by the user to the user interface 265, and then the input signal is transferred to the controller 250 through the user interface 265; alternatively, the remote controller 100A may receive an output signal such as audio, video, or data output from the user interface 265 via the controller 250, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on the display 275, and the user interface 265 receives the user input commands through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of a selector in the GUI to select different objects or items.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 270 is configured to receive an external video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 275.

Illustratively, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is configured to demultiplex an input audio/video data stream, where, for example, an input MPEG-2 stream (based on a compression standard of a digital storage media moving image and voice), the demultiplexing module demultiplexes the input audio/video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, for example, convert a frame rate of an input 60Hz video into a frame rate of 120Hz or 240Hz, where a common format is implemented by using, for example, an interpolation frame method.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

And a display 275 for receiving the image signal from the output of the video processor 270 and displaying video, images and menu manipulation interfaces. For example, the display may display video from a broadcast signal received by the tuner demodulator 210, may display video input from the communicator 220 or the external device interface 240, and may display an image stored in the memory 260. The display 275, while displaying a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, the display 275 may include a display screen assembly for presenting a picture and a driving assembly for driving the display of an image. Alternatively, a projection device and projection screen may be included, provided display 275 is a projection display.

The audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played by the speaker 286.

Illustratively, audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), high efficiency AAC (HE-AAC), and the like.

Audio output interface 285 receives audio signals from the output of audio processor 280. For example, the audio output interface may output audio in a broadcast signal received via the tuner demodulator 210, may output audio input via the communicator 220 or the external device interface 240, and may output audio stored in the memory 260. The audio output interface 285 may include a speaker 286, or an external audio output terminal 287, such as an earphone output terminal, that outputs to a generating device of an external device.

In other exemplary embodiments, video processor 270 may comprise one or more chips. Audio processor 280 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated with the controller 250 in one or more chips.

And a power supply 290 for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display apparatus 200 or may be a power supply installed outside the display apparatus 200.

For the convenience of understanding the embodiments provided in the present application, the technical solutions in the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. Referring to fig. 2, fig. 2 is a flowchart of a method for displaying a Video control bar of a web page according to an embodiment of the present disclosure. As an embodiment, the flow shown in fig. 2 may be applied to the display device as described above.

As shown in fig. 2, the process may include the following steps:

step 201, when detecting that the voice control device is activated, triggering the web Video to enter a voice mode, where the voice mode is used to control the playing state of the web Video through a voice instruction.

In a specific implementation, when a user activates the voice control device through a key for activating a voice function on the voice control device, the key value is recorded to indicate that the voice control device is activated, for example, when a key value is recorded as 1, the voice control device is indicated to be activated, and when the key value is 0, the voice control device is indicated to be inactivated.

In the embodiment of the application, when the webpage Video is triggered to enter the voice mode, a state value used for indicating that a browser playing the webpage Video enters the voice mode is generated, wherein the state value can take a value of 1 when the browser is indicated to enter the voice mode, and can take a value of 0 when the browser is indicated to exit the voice mode. It should be noted that, when the browser enters the voice mode, the web Video browsed through the browser also enters the voice mode.

Here, the entering of the web Video into the voice mode means that the user can input a voice command through the voice control device to control the playing state of the web Video. For example, when the user inputs a voice command of "fast forward at 2 × speed", if the web Video supports fast forward at 2 × speed, the Video will be played in a fast forward at 2 × speed.

Step 202, when it is determined that the web Video enters the voice mode and a voice instruction input through the voice control device is received, if it is detected that the current simulated mouse is in a state of entering the web, generating a simulated mouse moving HOVER _ MOVE event within an interface range where the web Video is located according to a first period to simulate the movement of the mouse on the interface of the web Video, and triggering the Video control bar to be displayed within the interface range where the web Video is located, wherein the first period is less than or equal to the hiding time of the set Video control bar after the Video control bar is triggered to be displayed.

As an embodiment, in this step 202, when generating the simulated mouse MOVE home _ MOVE event, it is necessary to determine the interface range where the web page Video is located. Therefore, in this embodiment, before the event simulating the mouse movement home _ MOVE is generated, it is determined whether the current web page Video is played in a full screen mode, and if so, the coordinate value of any position on the current web page is selected to generate the event simulating the mouse movement home _ MOVE.

In this embodiment, the full screen state of the web Video is shown in fig. 3, and at this time, the screen of the entire display device is an interface of the web Video, so that when the simulated mouse movement home _ MOVE event is generated, coordinate values (for example, coordinates (x1, y1) in fig. 3) of any position on the screen of the display device may be randomly selected, and the simulated mouse movement home _ MOVE event is generated according to the coordinate values. Here, when the simulated mouse movement home _ MOVE event is generated according to the coordinates (x1, y1) as in fig. 3, it represents that the simulated mouse is moved to a place on the web page where the coordinates (x1, y1) are located.

Optionally, when the simulated mouse movement home _ MOVE event is generated according to the first cycle, the coordinate value used for generating the simulated mouse movement home _ MOVE event in each cycle is different from the coordinate value used in the previous cycle, for example, when the previous cycle simulates the position of the mouse movement (x1, y1) according to the coordinates (x1, y1), the current cycle may simulate the position of the mouse movement (x2, y2) according to the coordinates (x2, y2) to simulate the mouse sliding on the interface.

As another embodiment, if the current web Video is not played in full screen, selecting a coordinate value of any position in the web Video page to generate a simulated mouse movement home _ MOVE event according to the range covered by the web Video in the page.

In this embodiment, a non-full screen state of the web Video is shown in fig. 4, as shown in fig. 4, an interface of the web Video only occupies a part of an upper left corner of the web, and at this time, if the web is an interface designed by using JavaScript codes, coordinates in the interface of the web Video can be obtained according to the JavaScript codes (for example, (x3, y3), (x4, y4) in fig. 4), or a Video rendering layer position can be obtained through a browser kernel to determine a position where the interface of the web Video is located.

Thus, the flow shown in fig. 2 is completed.

As can be seen from the process shown in fig. 2, in the embodiment of the present application, when it is detected that the voice control device is activated, the web Video is triggered to enter the voice mode, and when it is determined that the web Video enters the voice mode, and a voice instruction input through the voice control device is received, if it is further detected that the current simulated mouse is in a state of entering a web page, a simulated mouse movement home _ MOVE event within an interface range where the web Video is located is generated according to a first cycle, so as to simulate that the mouse periodically MOVEs on the interface of the web Video, since the Video control bar in the web page can be triggered by the simulated mouse event, when the simulated mouse movement home _ MOVE event within the interface range where the web Video is located is generated, the Video control bar is triggered to be displayed within the interface range where the web Video is located, so that a user uses the voice control function, the operation supported by the webpage video can be intuitively known through the displayed control bar.

It should be noted that, in this embodiment of the application, when it is determined that the web page Video ENTERs the voice mode, but a voice command input through the voice control device is not received, the simulated mouse entering into the home _ ENTER event may be periodically generated according to a second period, so that the simulated mouse maintains a state of entering into the web page when the web page Video ENTERs the voice mode, where a value of the second period may be the same as or different from a value of the first period, and during a period of generating the simulated mouse entering into the home _ ENTER event, if a voice command input through the voice control device is received, the simulated mouse entering into the home _ ENTER event is stopped, the simulated mouse moving home _ MOVE event is started according to the first period, until a voice command currently input through the voice control device by a user has completed inputting, and the voice command is stopped being input again, the simulated mouse moving home _ MOVE event may be stopped being generated, and starting to generate a simulated mouse entry HOVER _ ENTER event according to a second period.

Further, when detecting that the simulated mouse generated by the web Video EXITs from the voice mode (for example, detecting that the state value of the voice mode changes and indicating that the voice mode currently EXITs), if the current user is inputting a voice instruction, the simulated mouse moving HOVER _ MOVE event may be stopped from being generated and the voice mode may be exited, at which point the Video control bar currently displayed will be automatically hidden from the interface of the web Video after the hiding time, and if the current user does not input a voice instruction, the simulated mouse may be stopped from entering the HOVER _ ENTER event and the voice mode may be exited.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display;

a controller coupled with the display and configured to:

2. The display device of claim 1, wherein the controller generates a simulated mouse MOVE (HOVER _ MOVE) event within the interface of the web Video, comprising:

and judging whether the Video of the current webpage is played in a full screen mode or not, and if so, selecting a coordinate value of any position on the current webpage to generate a simulated mouse moving HOVER _ MOVE event.

3. The display device according to claim 2, wherein if the current web Video is not played in full screen, the controller generates a simulated mouse movement HOVER _ MOVE event within an interface range where the web Video is located, including:

and selecting a coordinate value at any position in the webpage Video page to generate a simulated mouse moving HOVER _ MOVE event according to the coverage range of the webpage Video in the page.

4. The display device according to claim 1, wherein when it is determined that the web page Video enters the voice mode but a voice instruction input through the voice control device is not received, the controller is further configured to:

and generating a simulation mouse entering HOVER _ ENTER event according to a second period in a timing mode so that the simulation mouse keeps entering a webpage state when entering a voice mode for a webpage Video, wherein the second period is the same as or different from the first period.

5. The display device of claim 1, wherein if it is detected that the web Video exits the voice mode, the controller is further configured to:

and generating an event of simulating mouse EXIT HOVER _ EXIT, and stopping generating the event of simulating mouse movement HOVER _ MOVE so as to hide the currently displayed Video control bar from the interface of the webpage Video after the hiding time.

6. A method for displaying a Video control bar of a webpage is characterized by comprising the following steps:

7. The method of claim 6, wherein generating the simulated mouse MOVE HOVER _ MOVE event within the interface range of the web Video comprises:

8. The method of claim 7, wherein if the current web Video is not played in full screen, said generating a simulated mouse movement HOVER _ MOVE event within an interface range of the web Video comprises:

9. The method of claim 6, wherein when it is determined that the web page Video enters the voice mode but a voice command input through the voice control device is not received, the method further comprises:

10. The method of claim 6, wherein if it is detected that the web Video exits the audio mode, the method further comprises: