WO2021218477A1 - Display method and display device - Google Patents

Display method and display device Download PDF

Info

Publication number
WO2021218477A1
WO2021218477A1 PCT/CN2021/081641 CN2021081641W WO2021218477A1 WO 2021218477 A1 WO2021218477 A1 WO 2021218477A1 CN 2021081641 W CN2021081641 W CN 2021081641W WO 2021218477 A1 WO2021218477 A1 WO 2021218477A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
web page
control
instruction
web
Prior art date
Application number
PCT/CN2021/081641
Other languages
French (fr)
Chinese (zh)
Inventor
李双增
董杰
张继栋
赵显芬
Original Assignee
青岛海信传媒网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202010364189.8A external-priority patent/CN111526401B/en
Priority claimed from CN202010490514.5A external-priority patent/CN111601149B/en
Application filed by 青岛海信传媒网络技术有限公司 filed Critical 青岛海信传媒网络技术有限公司
Publication of WO2021218477A1 publication Critical patent/WO2021218477A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering

Definitions

  • This application relates to the field of terminal interaction technology, and in particular to a display method and display device.
  • the scene where users play webpage videos through browsers on smart TVs is becoming more and more popular.
  • Users usually use a remote control device to control the display of a smart TV.
  • the common control method is also to control the remote control device.
  • the user After entering the webpage video playback interface, if the user wants to control the playback of the currently playing video, he needs to use the existing HTML controls on the webpage to operate. For example, if the user wants to pause the video, he needs to manipulate the remote control device, move the virtual mouse to the pause icon on the page, and click the pause icon to pause the video.
  • the embodiment of the present application provides a display method and a display device.
  • a video playback control method including:
  • the key input is an instruction for the selector to select the first broadcast control control among a plurality of web page controls
  • a first operation corresponding to the first broadcast control control is performed;
  • the first broadcast control control is used for instructing Control web video broadcast control;
  • the key input is an instruction to perform the first operation
  • the first operation for controlling the web page video playback is performed.
  • a video playback control method including:
  • the key input is an instruction to perform an operation
  • a control for controlling the web page video broadcast and the current state is executed. Different target operations.
  • a display device including:
  • a display the user displays a web page; the web page includes a plurality of web controls;
  • the first broadcast control control is used to instruct to control the web video broadcast control;
  • the key input is an instruction to perform the first operation
  • the first operation for controlling the web page video playback is performed.
  • a display device including:
  • the key receiving module is used to receive user input by pressing the keys on the control device;
  • An instruction parsing module used to identify the instruction corresponding to the key input
  • the playback control module is used to execute:
  • the instruction parsing module When the instruction parsing module recognizes that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video and the current state of the web page video is determined, it executes the control for controlling the web page video broadcast and the Describe target operations with different current states.
  • FIG. 1A exemplarily shows a schematic diagram of an operation scene between a smart TV and a control device
  • FIG. 1B exemplarily shows a configuration block diagram of the control device 100 in FIG. 1A;
  • FIG. 1C exemplarily shows a configuration block diagram of the smart TV 200 in FIG. 1A;
  • FIG. 1D exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the smart TV 200
  • FIG. 1E exemplarily shows a schematic diagram of a control device 100 configured to control a display device 200;
  • FIG. 2A, FIG. 2B, FIG. 2C, FIG. 2D, FIG. 2E, FIG. 2F, and FIG. 2G illustrate schematic diagrams of a GUI 400 provided by the display device 200 by operating the control device 100;
  • FIG. 3A exemplarily shows a logical schematic diagram of initializing the Player Controller module at the same time as the browser webpage is loaded;
  • FIG. 3B exemplarily shows a schematic diagram of the logic principle of the realization of the video playback control method
  • FIG. 3C exemplarily shows a schematic diagram of the implementation logic principle of another video playback control method
  • FIG. 4A exemplarily shows a flowchart of a video playback control method
  • FIG. 4B exemplarily shows a flowchart of a video playback control method
  • FIG. 5 exemplarily shows a schematic diagram of the main page of the operation guide when the network is not connected
  • FIG. 6 exemplarily shows a schematic diagram of refreshing the main page of the operation guide
  • FIG. 7 exemplarily shows a schematic diagram of the main page of the operation guide when the network is connected
  • FIG. 8 exemplarily shows a schematic diagram of the sub-page of the operation guide when the network is connected
  • FIG. 9 exemplarily shows a schematic diagram of a display interface of an enlarged view of a two-dimensional code
  • FIG. 10 exemplarily shows a schematic diagram of a terminal device scanning a two-dimensional code
  • FIG. 11 exemplarily shows a schematic diagram of displaying an operation guide in a terminal device
  • FIG. 12 exemplarily shows a flowchart of an operation guide display method
  • FIG. 13 exemplarily shows a schematic diagram of the updated page of the two-dimensional code.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.
  • gesture used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
  • FIG. 1A exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device 100.
  • the control device 100 and the display device 200 can communicate in a wired or wireless manner.
  • control device 100 is configured to control the display device 200, which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and act as an intermediary for the interaction between the user and the display device 200 effect.
  • the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.
  • the control device 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 in a wireless or other wired manner.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc.
  • the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.
  • the control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like.
  • a smart device such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like.
  • an application program running on a smart device is used to control the display device 200.
  • the application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication.
  • the mobile terminal 100B can establish a control instruction protocol with the display device 200, and realize the functions of the physical keys arranged on the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B.
  • the audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.
  • the display device 200 can be implemented as a television, and can provide a smart network television function with a broadcast receiving television function and a computer support function.
  • Examples of display devices include digital TV, Internet TV, smart TV, Internet Protocol TV (IPTV), and so on.
  • the display device 200 may be a liquid crystal display, an organic light emitting display, or a projection display device.
  • the specific display device type, size and resolution are not limited.
  • the display device 200 also performs data communication with the server 300 through a variety of communication methods.
  • the display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 300 may provide various contents and interactions to the display device 200.
  • the display device 200 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library.
  • EPG electronic program guide
  • the server 300 can be one group or multiple groups, and can be one type or multiple types of servers.
  • the server 300 provides other network service contents such as video-on-demand and advertising services.
  • FIG. 1B exemplarily shows a configuration block diagram of the control device 100.
  • the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.
  • the controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a communication interface, and a communication bus.
  • RAM random access memory
  • ROM read only memory
  • the controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components, and external and internal data processing functions.
  • the controller 110 may control to generate a signal corresponding to the detected interaction, and This signal is sent to the display device 200.
  • the memory 120 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110.
  • the memory 120 can store various control signal instructions input by the user.
  • the communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110.
  • the control device 100 sends a control signal (such as a touch signal or a button signal) to the display device 200 via the communicator 130, and the control device 100 can receive the signal sent by the display device 200 via the communicator 130.
  • the communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132.
  • the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module.
  • a radio frequency signal interface a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.
  • the user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can input user instructions for controlling the display device 200 to the control device through voice, touch, gesture, pressing, etc. 100.
  • the output interface 150 outputs a user instruction received by the user input interface 140 to the display device 200, or outputs an image or voice signal received by the display device 200.
  • the output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibration, a sound output interface 153 that outputs a sound, a display 154 that outputs an image, and the like.
  • the remote controller 100A can receive output signals such as audio, video, or data from the output interface 150, and display the output signals as images on the display 154, as audio on the sound output interface 153, or as vibration on the vibration interface 152. form.
  • the power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110.
  • the form can be battery and related control circuit.
  • FIG. 1C exemplarily shows a block diagram of the hardware configuration of the display device 200.
  • the display device 200 may further include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, and a display 275.
  • the tuner and demodulator 210 which receives broadcast television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television selected by the user from multiple wireless or cable broadcast television signals
  • modulation and demodulation processing such as amplification, mixing and resonance
  • the audio and video signals carried in the frequency of the channel, as well as additional information (such as EPG data).
  • the tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.
  • the tuner and demodulator 210 can receive signals in many ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting; and according to different modulation types, it can be digital modulation or analog Modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.
  • different broadcasting formats of TV signals such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting
  • modulation types it can be digital modulation or analog Modulation method
  • received TV signals, analog signals and digital signals can be demodulated.
  • the tuner demodulator 210 may also be in an external device, such as an external set-top box.
  • the set-top box outputs a TV signal after modulation and demodulation, and is input to the display device 200 through the external device interface 240.
  • the communicator 220 is a component used to communicate with external devices or external servers according to various types of communication protocols.
  • the display device 200 may transmit content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220.
  • the communicator 220 may include a network communication protocol module such as a WIFI module 221, a Bluetooth communication protocol module 222, and a wired Ethernet communication protocol module 223 or a near field communication protocol module, so that the communicator 220 can receive the control device 100 according to the control of the controller 250 Control signals, and implement the control signals as WIFI signals, Bluetooth signals, radio frequency signals, etc.
  • the detector 230 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside.
  • the detector 230 may include an image collector 231, such as a camera, a camera, etc., which can be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect the attributes of the user or interact with the user gestures to achieve Display the function of interaction between the device and the user. It may also include a light receiver 232 for collecting the ambient light intensity to adapt to changes in display parameters of the display device 200 and so on.
  • the detector 230 may also include a temperature sensor.
  • the display device 200 may adaptively adjust the display color temperature of the image. Exemplarily, when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be colder; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be warmer.
  • the detector 230 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, may be used to collect The environmental sound of the environmental scene type is recognized, so that the display device 200 can adapt to the environmental noise.
  • a sound collector such as a microphone
  • the user's voice such as a voice signal of a control instruction for the user to control the display device 200
  • the display device 200 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, may be used to collect The environmental sound of the environmental scene type is recognized, so that the display device 200 can adapt to the environmental noise.
  • the external device interface 240 is a component that provides the controller 210 to control the data transmission between the display device 200 and external devices.
  • the external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
  • the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, and a component (Component) Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.
  • HDMI high-definition multimedia interface
  • CVBS composite video blanking synchronization
  • USB universal serial bus
  • Component Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.
  • the controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
  • various software control programs such as an operating system and various application programs
  • the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256.
  • RAM random access memory
  • ROM read only memory
  • CPU CPU processor
  • communication interface 255 a communication bus 256.
  • the RAM 251, the ROM 252, the graphics processor 253, and the CPU processor 254 communication interface 255 are connected via a communication bus 256.
  • ROM252 used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 254 runs the system start-up instruction in the ROM 252 to copy the operating system stored in the memory 260 to the RAM 251 to start running the start-up operating system. After the operating system is started, the CPU processor 254 copies the various application programs in the memory 260 to the RAM 251, and then starts to run and start the various application programs.
  • the graphics processor 253 is used to generate screen images of various graphics objects, such as icons, images, and operation menus.
  • the graphics processor 253 may include an arithmetic unit, which is used to perform operations by receiving various interactive instructions input by the user, and then display various objects according to display attributes; and a renderer, which is used to generate various objects obtained based on the arithmetic unit, and perform operations The rendered result is displayed on the display 275.
  • the CPU processor 254 is configured to execute operating system and application program instructions stored in the memory 260. And according to the received user input instructions, to execute various applications, data and content processing, so as to finally display and play various audio and video content.
  • the CPU processor 254 may include multiple processors.
  • the multiple processors may include a main processor and multiple or one sub-processors.
  • the main processor is configured to perform some initialization operations of the display device 200 in the display device preloading mode, and/or, to display screen operations in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode of the display device.
  • the communication interface 255 may include the first interface to the nth interface. These interfaces may be network interfaces connected to external devices via a network.
  • the controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
  • the object can be any one of the selectable objects, such as a hyperlink or an icon.
  • the operation related to the selected object for example, the operation of displaying the page, document, image, etc. connected to the hyperlink, or the operation of executing the program corresponding to the icon.
  • the user input command for selecting the GUI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
  • the memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200.
  • the memory 260 may include volatile and/or non-volatile memory.
  • the term “memory” includes the memory 260, the RAM 251 and ROM 252 of the controller 250, or the memory card in the display device 200.
  • the memory 260 is specifically used to store the operating program that drives the controller 250 in the display device 200; to store various application programs built in the display device 200 and downloaded from an external device by the user; and to store the configuration provided by the display 275 Data such as various GUIs, various objects related to the GUI, and visual effect images of the selector used to select GUI objects.
  • the memory 260 is specifically used to store drivers and related data of the tuner and demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, etc. , External data (such as audio and video data) received from the external device interface or user data (such as button information, voice information, touch information, etc.) received from the user interface.
  • External data such as audio and video data
  • user data such as button information, voice information, touch information, etc.
  • the memory 260 specifically stores software and/or programs for representing an operating system (OS). These software and/or programs may include, for example, a kernel, middleware, application programming interface (API), and/or application.
  • OS operating system
  • these software and/or programs may include, for example, a kernel, middleware, application programming interface (API), and/or application.
  • the kernel can control or manage system resources and functions implemented by other programs (such as the middleware, API, or application program); at the same time, the kernel can provide interfaces to allow middleware, API, or application program access control To control or manage system resources.
  • FIG. 1D exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200.
  • the operating system architecture consists of the application layer, the middleware layer, and the kernel layer from top to bottom.
  • Application layer system built-in applications and non-system-level applications belong to the application layer, which is responsible for direct interaction with users.
  • the application layer can include multiple applications, such as NETFLIX applications, settings applications, media center applications, and so on. These applications can be implemented as Web applications, which are executed based on the WebKit engine, and specifically can be developed and executed based on HTML, Cascading Style Sheets (CSS) and JavaScript.
  • Web applications which are executed based on the WebKit engine, and specifically can be developed and executed based on HTML, Cascading Style Sheets (CSS) and JavaScript.
  • CSS Cascading Style Sheets
  • HTML HyperText Markup Language
  • HTML tags are used to describe text, graphics, animations, sounds, tables, For links, the browser will read the HTML document, explain the content of the tags in the document, and display it in the form of a web page.
  • CSS the full name of Cascading Style Sheets (Cascading Style Sheets), is a computer language used to express the style of HTML documents, and can be used to define style structures, such as fonts, colors, and positions. CSS styles can be directly stored in HTML web pages or in separate style files to achieve control over styles in web pages.
  • JavaScript is a language used in web page programming, which can be inserted into HTML pages and interpreted and executed by the browser.
  • the interaction logic of the web application is implemented through JavaScript.
  • JavaScript can encapsulate the JavaScript extension interface through the browser to realize the communication with the kernel layer,
  • the middleware layer can provide some standardized interfaces to support the operation of various environments and systems.
  • the middleware layer can be implemented as the Multimedia and Hypermedia Information Coding Expert Group (MHEG) of the middleware related to data broadcasting, and can also be implemented as the DLNA middleware of the middleware related to external device communication, and can also be implemented as providing Display the middleware of the browser environment in which each application in the device runs.
  • MHEG Multimedia and Hypermedia Information Coding Expert Group
  • the kernel layer provides core system services, such as file management, memory management, process management, network management, system security authority management and other services.
  • the kernel layer can be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
  • the kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provide WIFI driver, audio driver for audio output interface, power management driver for power management (PM) module, etc.
  • device driver services for various hardware, such as: providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provide WIFI driver, audio driver for audio output interface, power management driver for power management (PM) module, etc.
  • the user interface 265 receives various user interactions. Specifically, it is used to send the input signal of the user to the controller 250, or to transmit the output signal from the controller 250 to the user.
  • the remote control 100A may send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 through the controller 250, and display the received output signal or output the received output signal as audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI.
  • GUI graphical user interface
  • the user interface 265 may receive user input commands for controlling the position of the selector in the GUI to select different objects or items.
  • the user may input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through the sensor to receive the user input command.
  • the video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • the video signal displayed or played directly on the display 275.
  • the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the demultiplexing module is used to demultiplex the input audio and video data stream, such as the input MPEG-2 stream (based on the compression standard of digital storage media moving images and voice), then the demultiplexing module will demultiplex it Multiplexed into video signals and audio signals, etc.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image synthesis module such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to the user input or itself, so as to generate an image signal for display.
  • the frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to a frame rate of 120Hz or 240Hz, and the usual format is realized by such as frame interpolation.
  • the display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.
  • the display 275 is used to receive the image signal output from the video processor 270 to display video, image, and menu control interface.
  • the display may display the video in the broadcast signal received from the tuner and demodulator 210, may also display the video input from the communicator 220 or the external device interface 240, and may also display the image stored in the memory 260.
  • the display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
  • the display 275 may include a display screen component for presenting a picture and a driving component for driving image display.
  • the display 275 may also include a projection device and a projection screen.
  • the audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be stored in the speaker 286 The audio signal to be played.
  • the audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.
  • AAC Advanced Audio Coding
  • HE-AAC High Efficiency AAC
  • the audio output interface 285 is used to receive audio signals output from the audio processor 280.
  • the audio output interface can output audio in the broadcast signal received via the tuner demodulator 210, can also output audio input via the communicator 220 or the external device interface 240, and can also output audio stored in the memory 260.
  • the audio output interface 285 may include a speaker 286, or an external audio output terminal 287 output to a generator of an external device, such as a headphone output terminal.
  • the video processor 270 may include one or more chips.
  • the audio processor 280 may also include one or more chips.
  • the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller 250 in one or more chips.
  • the power supply 290 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 250.
  • the power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.
  • the control device 100 of the display device 200 is implemented as a remote controller, which includes a play button, a pause button, a play pause button, a stop button, and backwards for selecting the playback control function.
  • a (fast rewind) button, a forwards button, etc. to prompt the user that the display device 200 can perform a playback control function adapted to the corresponding button by operating the button on the control device 100.
  • control device 100 is not limited to supporting the remote control to perform the playback control operation of the webpage video by means of buttons, but can also use the communication mechanism between the local area networks to perform the playback control operation of the webpage video being played by the display device through other operating terminals.
  • the operation terminal can be connected to the commands supported in the Command Parser module.
  • the function information corresponding to the above-mentioned playback control function has a mapping relationship with the key information on the control device 100. Specifically, when the display device 200 receives the key event value corresponding to each key on the control device 100 input by the user, the display device 200 can perform the function operation corresponding to the key event value based on the mapping relationship, which can facilitate the user to Visually, the buttons on the control device 100 are matched with each playback control function.
  • the display device 200 can receive the key event value of the button, search for and execute the function corresponding to the received key event value from the mapping information, and intuitively consider
  • the buttons on the control device 100 correspond to the playback control functions to perform desired functions.
  • FIGS. 2A-2G exemplarily show schematic diagrams of a GUI 400 provided by the display device 200 by operating the control device 100.
  • the display device displays a webpage main page 41 on the display, which may be a video playback page of a video website.
  • the webpage main page 41 shown in FIG. 2A includes a video playback area, a webpage option area, and a video details area.
  • the video playback area includes a video playback screen, and the bottom of the video playback screen is provided with a progress bar, a pause playback icon, and a fast forward icon.
  • a video screen is being played in the video playback area of FIG. 2A.
  • the user wants to fast forward or rewind the video, he needs to place the virtual mouse on the progress bar and move the progress bar to realize fast forward or rewind.
  • the user wants to pause or play the video, he needs to move the virtual mouse to the pause icon and click the pause icon to pause the video.
  • the size of the progress bar and icon is relatively small on the main page of the web page. By moving the virtual mouse to the progress bar or icon, the expected video playback control operation can be realized, which is difficult to operate.
  • FIG. 2A when the user presses the pause button on the control device, as shown in FIG. 2B, the display device responds to the command input by the button to control the pause of the current video, and directly controls the pause of the current video without moving the virtual mouse.
  • the pause icon On the pause icon, the user does not need to make the next click operation, and the pause operation can be realized.
  • a pause instruction icon When the current video is paused, a pause instruction icon will be superimposed on the current video screen.
  • the main web page 41 may also be a non-video playback page, for example, it may be a detailed introduction page of a certain video as shown in FIG. 2G.
  • the main page of the webpage shown in FIG. 2G does not include video images.
  • the display device ignores the user Video playback control instructions input by pressing the above keys.
  • a JavaScript-based Player Controller (play control) module can be injected into the loaded webpage through plug-in mechanisms such as NPAPI/PPAPI.
  • the Player Controller module registers a callback interface to the browser core and calls back through this The interface receives messages from the underlying system to the Player Controller module through the browser kernel.
  • the function of the Player Controller module is to control the playback of the video in the webpage through the interface of the standard HTML5 VIDEO control.
  • the messages that the Player Controller module pays attention to can be play, pause, play pause, stop, backwards, forwards, and so on.
  • the browser webpage is loaded and the Player Controller module is initialized at the same time.
  • the webpage is loaded through the browser startup module, and then the loaded webpage is parsed by the browser parsing module, and the Player Controller module is loaded at the same time.
  • the browser rendering module renders the webpage, and displays the webpage after rendering.
  • the Player Controller module callbacks the registration message to the browser message processing module.
  • the button receiving module obtains the video playback pause control instruction corresponding to the play pause button input by the user by pressing the play pause button on the control device, and sends the video playback pause control instruction to the command analysis module.
  • the key receiving module may receive different playback control commands, including at least one of a playback command, a pause command, a playback pause command, a stop command, a rewind command, and a fast forward command.
  • the command analysis module can analyze these instructions and generate corresponding messages.
  • the command analysis module analyzes the video pause control instruction and converts it into a play pause message. And send the play pause message to the browser message processing module, and finally call back to the Player Controller module.
  • the play pause message is sent to the browser kernel through the browser receiving message interface.
  • the Player Controller module obtains the play pause message through the callback interface of the browser kernel.
  • the Player Controller module controls the playback of the video elements in the current webpage according to the play pause message.
  • the control device sets the play pause function on the same button, and what the Player Controller module obtains is a play pause message. It is necessary to analyze the play pause message according to the state of the video element in the current webpage, and then perform the corresponding broadcast control operation on the video element. If the video element in the current webpage is in the playing state, the Player Controller module controls the video element in the current webpage to pause playing according to the play pause message. If the video element in the current webpage is in the paused playback state, the Player Controller module controls the playback of the video element in the current webpage according to the play pause message.
  • the button receiving module obtains the video playback fast-forward control instruction corresponding to the Forwards button input by the user by pressing the Forwards button on the control device, and sends the video playback fast-forward control instruction to the command analysis module.
  • the command analysis module analyzes the video fast-forward control command and converts it into a Forwards message. And send the Forwards message to the browser message processing module, and finally call back to the Player Controller module.
  • the Forwards message is sent to the browser kernel through the browser receiving message interface.
  • the Player Controller module obtains the Forwards message through the callback interface of the browser kernel.
  • the Player Controller module controls the fast forward of the video elements in the current webpage according to the Forwards message.
  • the Player Controller module when the browser injects the Player Controller module, the Player Controller module will initialize and obtain the non-hidden video tags in the current webpage. If there is a non-hidden video tag in the current webpage, the video element corresponding to the video tag is saved to the Player Controller module. If there is no non-hidden video tag in the current webpage, the Player Controller module will get empty.
  • the Player Controller module receives the play pause message, it will first determine whether the Player Controller module saves video elements. If a video element is stored in the Player Controller module, control the video element to pause playback. If there are no video elements stored in the Player Controller module, the processing of the pause message will be skipped. If there are no video elements stored in the Player Controller module, it means that the current web page currently has no actions related to video playback, for example, there is no video screen in a text-only web page.
  • the Player Controller module needs to obtain the non-hidden video tags in the current webpage again.
  • the video playback control instruction corresponding to the button input by the user by pressing the button on the control device is acquired, and the playback of the video element in the current webpage is controlled according to the video playback control instruction.
  • the user needs to control the video playback in the webpage, there is no need to move the focus to the control. Only by pressing the corresponding video playback control button on the control device, the expected video playback control effect can be realized, the operation is simple, and the user's experience in video playback control is improved.
  • 4A-4B exemplarily show a flowchart of a method for controlling video playback.
  • the method includes the following steps S51 to S54:
  • Step S51 Display a web page on the display, the web page contains multiple web controls
  • Step S52 Receive user input by pressing a button on the control device; for example, as shown in FIG. 1E, the control device 100 configured to control the display device 200 is implemented as a remote controller, which includes a pause button for selecting a playback control function , Start button, fast forward button, fast reverse button, etc.
  • a button on the control device for example, as shown in FIG. 1E, the control device 100 configured to control the display device 200 is implemented as a remote controller, which includes a pause button for selecting a playback control function , Start button, fast forward button, fast reverse button, etc.
  • FIG. 2A when the user presses the pause button on the control device, an instruction to pause the video playback corresponding to the pause button input by the user by pressing the pause button on the control device is obtained.
  • Step S53 When recognizing that the key input is an instruction to instruct the selector to select the first broadcast control control among a plurality of web page controls, perform a first operation corresponding to the first broadcast control control; the first broadcast control control Used to indicate and control web video broadcast control;
  • Step S54 When it is recognized that the key input is an instruction to perform the first operation, if it is determined that the web page contains a web page video, perform the first operation for controlling the web page video broadcast control.
  • the display device directly controls the current video to be paused in response to the command input by the button to control the pause of the current video, without the need to move the virtual mouse to the pause icon, and the user does not need to do it.
  • the pause operation can be realized.
  • a pause instruction icon will be superimposed on the current video screen.
  • the method includes the following steps:
  • S62 Receive user input by pressing keys on the control device; for example, as shown in FIG. Start button, fast forward button, fast reverse button, etc.
  • start button for example, as shown in FIG.
  • fast forward button for example, the user presses the pause button on the control device
  • the command to pause the video playback corresponding to the pause button input by the user by pressing the pause button on the control device is obtained.
  • the button receiving module obtains the video playback pause control instruction corresponding to the play pause button input by the user by pressing the play pause button on the control device, and sends the video playback pause control instruction to the command analysis module.
  • the command analysis module analyzes the video pause control instruction and converts it into a play pause message. And send the play pause message to the browser message processing module, and finally call back to the Player Controller module.
  • the play pause message is sent to the browser kernel through the browser receiving message interface.
  • the Player Controller module obtains the play pause message through the callback interface of the browser kernel.
  • the Player Controller module controls the playback of the video elements in the current webpage according to the play pause message.
  • the control device sets the play pause function on the same button, and what the Player Controller module obtains is a play pause message. It is necessary to analyze the play pause message according to the state of the video element in the current webpage, and then perform the corresponding broadcast control operation on the video element. If the video element in the current webpage is in the playing state, the Player Controller module controls the video element in the current webpage to pause playing according to the play pause message. If the video element in the current webpage is in the paused playback state, the Player Controller module controls the playback of the video element in the current webpage according to the play pause message.
  • the control can be controlled according to the fast forward instruction Fast forward web video. If it is recognized that the key input is an instruction to perform a rewind operation, if it is determined that the web page contains a web video, and it is determined that the web video is in a playing state, the web video can be controlled to rewind according to the fast forward instruction.
  • some built-in applications are preset, and the built-in applications do not depend on the network.
  • the user can open the application and view related information and resources in the application.
  • smart TVs generally have built-in electronic manual (E-manual) applications, that is, operation guides, and some graphical user interfaces that prompt and guide users to operate are preset in the E-manual application, and HTML is loaded through the browser
  • E-manual applications that is, operation guides, and some graphical user interfaces that prompt and guide users to operate are preset in the E-manual application, and HTML is loaded through the browser
  • the contents of the operation guide are displayed in the form of page data or PDF format files.
  • This application mainly aims at the problems existing when the display device displays the operation guide, and provides corresponding solutions.
  • FIG. 5 exemplarily shows the main page displayed when the operation guide is opened.
  • the main page may include "LiveTV” (LiveTV), “Connection”, “Multi_screen”, “Smart Functions”, “Picture and Sound”, “Accessibility and System”, “Solving Problems” (Troubleshooting) and "Using the E-manual” (Using the E-manual) and other sub-page options, when the display device is not connected to the network, each page of the E-manual application (including the main page and each sub-page) does not display two-dimensional Code, that is, when the user is not connected to the Internet, the user only sees the information resources preset in the operation guide, which are inherent information resources of the operation guide pre-stored in the display device, and these information resources cannot be changed and updated.
  • the connection status of the display device is detected. If the connection status is detected as the network is connected, the URL request corresponding to the operation guide is sent to the server, and the server obtains the latest operation guide of the display device according to the URL request Content, and send the corresponding QR code URL; the display device generates the QR code after receiving the URL, as shown in Figure 6, the operation guide needs to refresh the page of the E-manual application under the network.
  • the refreshed page will display the generated QR code.
  • a thumbnail of the QR code can be displayed at the specified location of the page. Refer to the page shown in Figure 7, the specified location is In the upper right corner of the page, the thumbnail of the QR code reduced by a certain multiple is displayed in the upper right corner of the page.
  • the thumbnail of the QR code can be regarded as the QR code identification and the entrance to push the operation guide to the terminal device. Go to the two-dimensional code identification to know that the two-dimensional code can be scanned by the terminal device to view the latest operation guide content in the terminal device. At this time, the operation guide displayed by the terminal device includes the full content of the main page and sub-pages.
  • the terminal device described in this application may be a smart phone, a tablet, or other electronic devices with a QR code scanning function, and the terminal device may support systems such as IOS and Android.
  • the thumbnail of the QR code can not only be displayed on the main page of the operation guide. After the user clicks to enter each sub-page, the sub-page must also display the thumbnail of the QR code at the specified location, so that the user opens the operation guide Any page can scan the QR code at any time. As shown in Figure 8, taking “Real-time TV” as an example, click the "Real-time TV” option on the main page to enter the "Real-time TV” sub-page. The left side of the "Real-time TV” sub-page displays channel search, channel editing, and channel List and other options. After clicking any option on the left side of the sub-page, the corresponding information resources will be displayed on the left side of the sub-page.
  • QR code logo in this embodiment is visually presented in the form of a thumbnail.
  • the QR code logo can be in other forms, such as text display. "Scan the QR code” is not limited in the embodiment of this application.
  • the user can click the thumbnail/logo of the QR code by remote control or touch control, as shown in Figure 9, after the thumbnail of the QR code is clicked, it will An enlarged view of the QR code is displayed on the upper level of the current page.
  • Below the enlarged view of the QR code can be configured prompt information to guide the user to operate.
  • the prompt message in Figure 9 is "Please use your terminal to scan the QR code, that is The operation guide can be displayed on the terminal, and the prompt information can be adaptively set according to the actual application.
  • the user uses the QR code scanning function in the terminal device, such as using the "scan" of the WeChat and other applications to scan the QR code.
  • the terminal device can automatically scan And recognize the QR code, and then display the latest content of the pushed operation guide (that is, the online operation guide) in the content area of the terminal device; if the shooting environment is dark, you can click "Tap to illuminate”. Turn on the flash and increase the illumination to ensure that the QR code can be recognized.
  • the display form of the operation guide in the terminal is not limited, and the page settings, layout, and resource display of the operation guide should be subject to the actual application.
  • the user After the user successfully scans the QR code, in order to make the enlarged image of the QR code no longer cover the application page, it is necessary to hide the enlarged image of the QR code so that the QR code is displayed as a thumbnail again. At this time, the user can Click the enlarged image of the QR code to hide the enlarged image of the QR code.
  • This method is mainly based on the user’s manual operation; or the terminal device automatically generates the scanned instruction information in response to the successful scanning of the QR code, and The scanned instruction information is sent to the display device. After the display device receives the scanned instruction information, it can control to hide the enlarged view of the QR code, and then resume the normal page display of the operation guide. This form eliminates the need for the user to manually hide the QR code. Enlarged view of the code. It should be noted that the manner of hiding the enlarged view of the two-dimensional code is not limited to that described in this embodiment, and other forms, such as gesture control, other designated operation forms, etc., may also be adopted in practical applications.
  • Figure 12 shows an embodiment of an operation guide display method.
  • the key is to display a two-dimensional code on a graphical user interface corresponding to the operation guide through a display device, and the terminal scans the two-dimensional code to push the information resources of the latest operation guide to Terminal, the method is configured to be executed by the controller 250 of the display device, that is, the controller 250 is the execution subject of the method, and the method includes the following program steps:
  • Step S101 In response to the first input instruction, display a graphical user interface corresponding to the operation guide for guiding the user to use the function of the display device.
  • Step S102 Detect the network connection status of the display device.
  • the first input instruction is an operation instruction input when the user starts the operation guide function.
  • the user interface 265 of the display device can receive the first operation instruction.
  • Input instruction or, for a display device that supports screen touch, the user generates the first input instruction when touching the application icon of the operation guide.
  • the preset pages and information resources of the operation guide are pre-stored in the memory of the display device for easy recall and display at any time, and the operation guide can be loaded and displayed when the display device is not connected to the network.
  • the user graphical interface corresponding to the operation guide needs to be first displayed on the display.
  • the graphical user interface may be the main page of the operation guide or a sub-page entered according to the user operation.
  • the display device receives the first input When instructing, it is also necessary to detect the network connection status of the display device.
  • the network connection status includes the network connected and the network disconnected, and step S101 and step S102 can be executed at the same time. You can directly detect the network status of the entire device in a conventional way; or use HTTP (Hyper Text Transfer Protocol) to request a lightweight page to detect the network status.
  • HTTP Hyper Text Transfer Protocol
  • the method of using HTTP to request a lightweight page to detect the connection status is specifically: controlling the browser to access the lightweight page; when the lightweight page is accessed normally, the resources and information of the lightweight page can be displayed normally , It is detected that the network status is network connected; when the lightweight page displays an access error or no network connection prompt, that is, the lightweight page displays abnormally, the network status is detected as network disconnected, light
  • the access speed of the weight page is fast, which can improve the detection efficiency of the connection status, such as the Baidu page.
  • step S103 it is judged whether the network connection status is that the network is connected. If it is, that is, when it is detected that the network connection state is that the network is connected, step S104 is executed; otherwise, if it is detected that the network connection state is that the network is not connected, step S107 is executed.
  • Step S104 Send a URL request corresponding to the operation guide in the server to the server.
  • the operation guide When it is detected that the display device is connected to the network, the operation guide will first load the information resources of the display operation guide on the machine according to the country, language, device brand and other information, that is, after the operation guide is started and the QR code is not obtained, the display will display Preset page of operation guide. At the same time, the URL request corresponding to the QR code and the operation guide is sent to the server through the Https network.
  • the URL request will carry the brand, model of the display device and the attribute information of the device itself, as well as the country, language and other information; the server responds to the URL request ,
  • the latest operation guide content adapted to the display device will be obtained, and the URL (Uniform Resource Locator, uniform resource locator) corresponding to the QR code will be issued to the display device according to the obtained latest operation guide content.
  • URL Uniform Resource Locator, uniform resource locator
  • Step S105 Receive the URL issued by the server, and generate a QR code according to the URL.
  • the two-dimensional code corresponding to the operation guide is generated according to the URL. After the image of the two-dimensional code is obtained, the page of the operation guide can be refreshed.
  • Step S106 Control the display to display the two-dimensional code on a graphical user interface corresponding to the operation guide, so that the user can scan the two-dimensional code with a terminal device to view the operation guide.
  • a thumbnail of the QR code will be displayed at its designated location, and other pages of the operation guide need to be synchronized to add the thumbnail of the QR code at the designated location. For example, if the current page of the operation guide is the main page, then You need to add a thumbnail of the QR code in the upper right corner of the main page, and simultaneously add the thumbnail of the QR code in the upper right corner of each sub-page under the main page, so that when the user clicks to enter any sub-page, it will be You can see the QR code thumbnail displayed in the upper right corner, so that the user can scan the QR code on any page of the operation guide. After scanning, the terminal device will immediately display the information resources of the pushed operation guide.
  • the connection status of the display device is detected. If it is detected that the network is connected, a URL request is sent to the server, and then the generated QR code is displayed according to the URL of the QR code issued by the server . After the terminal device scans the QR code, the information resources included in the pushed operation guide can be displayed on the terminal device. The server can issue the URL of the corresponding QR code according to the latest content of the operation guide. As long as the display device is connected to the network, the content of the operation guide can be updated synchronously through the QR code and pushed to the terminal device. After scanning the QR code, the latest operation guide content will be displayed.
  • the display device side displays the original content of the operation guide when it is preset, and the two-dimensional code is added to the operation guide adaptively through the network.
  • the user can refer to the guidance of the operation guide displayed on the terminal device, and operate and set the display device at the same time to realize the display device Pushing to the resources of the terminal improves the experience function of the operation guide, and improves the interaction between the display device and the terminal, and the actual application experience of the user is better.
  • the user browses the page of the operation guide, he can see the thumbnail of the QR code displayed at the specified location of the page.
  • the user can input the second input instruction, which is the operation input when the user enlarges the QR code Instructions, for example, the user can click the thumbnail of the QR code by remote control or touch control, etc.
  • the thumbnail of the QR code is clicked, the enlarged view of the QR code will be displayed on the upper layer of the current page, and the enlargement of the QR code will be displayed.
  • Below the figure can be configured with prompt information to guide the user's operation.
  • the enlarged image of the QR code is relative to the thumbnail.
  • the enlarged image can be the original QR code image obtained after the QR code URL is generated, or the thumbnail is appropriately enlarged by a certain multiple, but the image must be clear In order to ensure the accuracy of QR code recognition, it is also necessary to ensure that the size of the enlarged image is moderate and not too large or too small.
  • the enlarged image of the QR code needs to be hidden, that is, the QR code is restored to be displayed as a thumbnail, which is convenient for the user to view the page
  • the user can input the third input instruction, which is the operation instruction input when the user hides the enlarged view of the QR code.
  • the user can click on the QR code by remote control or touch control. Enlarge the image to hide the enlarged image of the QR code.
  • This method is mainly based on the user's manual operation; or the terminal device automatically generates the scanned instruction information in response to the successful scanning of the QR code, and sends the scanned instruction information
  • the display device side after the display device receives the scanned instruction information, it can control to hide the enlarged view of the QR code, and then resume the normal page display of the operation guide.
  • This form eliminates the need for the user to manually hide the enlarged view of the QR code.
  • the manner of hiding the enlarged view of the two-dimensional code is not limited to that described in this embodiment, and other forms, such as gesture control, other designated operation forms, etc., may also be adopted in practical applications.
  • the display and hiding effects of the enlarged image of the QR code are not limited.
  • the enlarged image of the QR code is displayed in the form of pop-up, slide-out or gradually enlarged, and the effect of gradually shrinking, dissolving, blurring, etc. is used to hide the QR code. Zoom in.
  • Step S107 the two-dimensional code is not displayed on the graphical user interface corresponding to the operation guide.
  • the operation guide application When the display device is not connected to the network, the operation guide application will continue to display the information resources preset on the machine loaded according to the country, language, device brand and other information, that is, it will display the page preset in the operation guide.
  • the home page preset in the operation guide The QR code is not displayed on the face and each sub-page.
  • the connection status of the display device may change. For example, when the user starts the operation guide, the display device is not connected to the network, but the device is connected to the network during the operation guide, that is, the connection status is switched from the network disconnected. If the network is connected, then you need to follow the above steps to display the thumbnail of the QR code on the refreshed page; if the network status changes from network connected to network disconnected, because the QR code scanning depends on the terminal device
  • the network (such as 4G, 5G or WIFI, etc.) is not the network of the display device, so the display device can maintain the display of the QR code thumbnail displayed at the moment before the network is disconnected. Therefore, the network status in this application does not use a one-time acquisition method, but adaptively adjusts the display of the QR code according to changes in the network status.
  • the method of real-time monitoring of network status changes can be adopted. Once the broadcast information of network status changes is monitored, the page displayed on the display needs to be updated according to the newly acquired network status; or, the network monitoring network periodically is used.
  • the network connection state of the display device is obtained every preset time.
  • the preset time can be adaptively set according to factors such as the actual network environment and application requirements, for example, 60 seconds.
  • the QR code when the display device is running the operation guide application, and the display device is always connected to the network during this period, the QR code can be updated online in time, for example, the server detects the operation of a display device If the content of the guide is updated, the URL of a new QR code adapted to the operation guide of the display device can be generated based on the updated content, and the URL of the new QR code can be issued to the display device. The URL of the QR code is refreshed to refresh the page to update the displayed QR code thumbnail. After the QR code is updated, the user can be prompted, as shown in Figure 13, such as scrolling on the page or popping up a prompt message.
  • the prompt message is "The QR code has been updated, you can scan the new QR code to view the latest operation guide", the prompt message can be adapted according to the actual application. It should be noted that the display and update mode of the two-dimensional code can be flexibly set according to actual applications, and is not limited to that described in this embodiment.
  • this application also provides a computer storage medium, where the computer storage medium can store an operation guide that guides users to use the functions of the display device, and can also store a program.
  • the program execution may include the program steps of the operation guide display method that the controller 250 is configured to execute.
  • the computer storage medium may be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM), etc.

Abstract

Embodiments of the present application relate to the technical field of display, and in particular to a display method and a display device. The display method comprises: receiving a key input of a user by pressing a control apparatus; when identifying that the key input instructs a selector to select an instruction of a first playback control in multiple webpage controls, performing a first operation corresponding to the first playback control, the first playback control being used for instructing to control webpage video playback; and when identifying that the key input instructs to perform the first operation, if a webpage is determined to comprise a webpage video, performing the first operation for controlling the webpage video playback.

Description

一种显示方法及显示设备Display method and display device
本申请要求在2020年6月2日提交中国专利局、申请号为202010490514.5申请名称为“一种操作指南显示方法及显示设备”的优先权;本申请要求在2020年4月30日提交中国专利局、申请号为202010364189.8申请名称为“一种视频播放控制方法及显示设备”的优先权;其全部内容通过引用结合在本申请中。This application requires the priority to be submitted to the Chinese Patent Office on June 2, 2020, the application number is 202010490514.5, and the application titled "An operation guide display method and display device"; this application requires a Chinese patent to be filed on April 30, 2020 The office and the application number is 202010364189.8 and the priority of the application title is "a video playback control method and display device"; the entire content of which is incorporated into this application by reference.
技术领域Technical field
本申请涉及终端交互技术领域,特别涉及一种显示方法及显示设备。This application relates to the field of terminal interaction technology, and in particular to a display method and display device.
背景技术Background technique
目前,用户在智能电视上,通过浏览器播放网页视频的场景越来越普及。用户通常利用遥控装置控制智能电视的显示,对智能电视上网页视频的播放,常用控制手段也是操控遥控装置。进入网页视频播放界面后,用户如果想要对当前播放的视频进行播放控制,需要借助网页上已有的HTML控件进行操作。例如,用户如果想要暂停播放视频时,需要操控遥控装置,将虚拟鼠标移动到页面上的暂停图标,点击暂停图标,从而使视频暂停播放。At present, the scene where users play webpage videos through browsers on smart TVs is becoming more and more popular. Users usually use a remote control device to control the display of a smart TV. For the playback of webpage videos on the smart TV, the common control method is also to control the remote control device. After entering the webpage video playback interface, if the user wants to control the playback of the currently playing video, he needs to use the existing HTML controls on the webpage to operate. For example, if the user wants to pause the video, he needs to manipulate the remote control device, move the virtual mouse to the pause icon on the page, and click the pause icon to pause the video.
发明内容Summary of the invention
本申请实施例提供了一种显示方法及显示设备。The embodiment of the present application provides a display method and a display device.
一方面,提供一种视频播放控制方法,包括:On the one hand, a video playback control method is provided, including:
在显示器上显示网页页面,所述网页页面中包含多个网页控件;Displaying a web page on the display, the web page including a plurality of web controls;
接收用户通过按压控制装置上的按键输入;Receive user input by pressing a button on the control device;
在识别所述按键输入为指示选择器选择多个网页控件中第一播控控件的指令时,执行与所述第一播控控件对应的第一操作;所述第一播控控件用于指示控制网页视频播控;When it is recognized that the key input is an instruction for the selector to select the first broadcast control control among a plurality of web page controls, a first operation corresponding to the first broadcast control control is performed; the first broadcast control control is used for instructing Control web video broadcast control;
在识别所述按键输入为指示执行第一操作时,若确定所述网页页面中包含网页视频,则执行用于控制网页视频播控的第一操作。When it is recognized that the key input is an instruction to perform the first operation, if it is determined that the web page contains a web page video, the first operation for controlling the web page video playback is performed.
第二方面,提供一种视频播放控制方法,包括:In a second aspect, a video playback control method is provided, including:
在显示器上显示网页页面,所述网页页面中包含多个网页控件;Displaying a web page on the display, the web page including a plurality of web controls;
接收用户通过按压控制装置上的按键输入;Receive user input by pressing a button on the control device;
识别所述按键输入对应的指令;Identifying the instruction corresponding to the key input;
在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作。When it is recognized that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video and the current state of the web page video is determined, then a control for controlling the web page video broadcast and the current state is executed. Different target operations.
第三方面,提供一种显示设备,包括:In a third aspect, a display device is provided, including:
显示器,用户显示网页页面;所述网页页面中包含多个网页控件;A display, the user displays a web page; the web page includes a plurality of web controls;
控制器,用于执行:Controller, used to execute:
接收用户通过按压控制装置上的按键输入;在识别所述按键输入为指示选择器选择多个网页控件中第一播控控件的指令时,执行与所述第一播控控件对应的第一操作;所述第一播控控件用于指示控制网页视频播控;Receive user input by pressing a button on the control device; when recognizing that the button input is an instruction to instruct the selector to select the first broadcast control control among a plurality of web controls, perform a first operation corresponding to the first broadcast control control ; The first broadcast control control is used to instruct to control the web video broadcast control;
在识别所述按键输入为指示执行第一操作时,若确定所述网页页面中包含网页视频,则执行用于控制网页视频播控的第一操作。When it is recognized that the key input is an instruction to perform the first operation, if it is determined that the web page contains a web page video, the first operation for controlling the web page video playback is performed.
第四方面,提供一种显示设备,包括:In a fourth aspect, a display device is provided, including:
显示器,用于显示网页页面;所述网页页面中包含多个网页控件;A display for displaying a web page; the web page includes a plurality of web controls;
按键接收模块,用于接收用户通过按压控制装置上的按键输入;The key receiving module is used to receive user input by pressing the keys on the control device;
指令解析模块,用于识别所述按键输入对应的指令;An instruction parsing module, used to identify the instruction corresponding to the key input;
播放控制模块,用于执行:The playback control module is used to execute:
在指令解析模块识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作。When the instruction parsing module recognizes that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video and the current state of the web page video is determined, it executes the control for controlling the web page video broadcast and the Describe target operations with different current states.
附图说明Description of the drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简要介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域的普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative labor.
图1A中示例性示出了智能电视与控制装置之间操作场景的示意图;FIG. 1A exemplarily shows a schematic diagram of an operation scene between a smart TV and a control device;
图1B中示例性示出了图1A中控制装置100的配置框图;FIG. 1B exemplarily shows a configuration block diagram of the control device 100 in FIG. 1A;
图1C中示例性示出了图1A中智能电视200的配置框图;FIG. 1C exemplarily shows a configuration block diagram of the smart TV 200 in FIG. 1A;
图1D中示例性示出了智能电视200存储器中操作系统的架构配置框图;FIG. 1D exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the smart TV 200;
图1E中示例性示出了配置为控制显示设备200的控制装置100的示意图;FIG. 1E exemplarily shows a schematic diagram of a control device 100 configured to control a display device 200;
图2A、图2B、图2C、图2D、图2E、图2F、图2G中示例性示出了通过操作控制装置100而使显示设备200提供的一个GUI400的示意图;2A, FIG. 2B, FIG. 2C, FIG. 2D, FIG. 2E, FIG. 2F, and FIG. 2G illustrate schematic diagrams of a GUI 400 provided by the display device 200 by operating the control device 100;
图3A中示例性示出了浏览器网页加载同时初始化Player Controller模块的逻辑示意图;FIG. 3A exemplarily shows a logical schematic diagram of initializing the Player Controller module at the same time as the browser webpage is loaded;
图3B中示例性示出了视频播放控制方法实现逻辑原理示意图;FIG. 3B exemplarily shows a schematic diagram of the logic principle of the realization of the video playback control method;
图3C中示例性示出了另一种视频播放控制方法实现逻辑原理示意图;FIG. 3C exemplarily shows a schematic diagram of the implementation logic principle of another video playback control method;
图4A中示例性示出了视频播放控制方法的流程图;FIG. 4A exemplarily shows a flowchart of a video playback control method;
图4B中示例性示出了视频播放控制方法的流程图;FIG. 4B exemplarily shows a flowchart of a video playback control method;
图5中示例性示出了未连接网络时操作指南的主页面的示意图;FIG. 5 exemplarily shows a schematic diagram of the main page of the operation guide when the network is not connected;
图6中示例性示出了操作指南的主页面的刷新示意图;FIG. 6 exemplarily shows a schematic diagram of refreshing the main page of the operation guide;
图7中示例性示出了已连接网络时操作指南的主页面的示意图;FIG. 7 exemplarily shows a schematic diagram of the main page of the operation guide when the network is connected;
图8中示例性示出了已连接网络时操作指南的子页面的示意图;FIG. 8 exemplarily shows a schematic diagram of the sub-page of the operation guide when the network is connected;
图9中示例性示出了二维码的放大图的显示界面示意图;FIG. 9 exemplarily shows a schematic diagram of a display interface of an enlarged view of a two-dimensional code;
图10中示例性示出了终端设备扫描二维码的示意图;FIG. 10 exemplarily shows a schematic diagram of a terminal device scanning a two-dimensional code;
图11中示例性示出了终端设备中显示操作指南的示意图;FIG. 11 exemplarily shows a schematic diagram of displaying an operation guide in a terminal device;
图12中示例性示出了一种操作指南显示方法的流程图;FIG. 12 exemplarily shows a flowchart of an operation guide display method;
图13中示例性示出了二维码更新后的页面示意图。FIG. 13 exemplarily shows a schematic diagram of the updated page of the two-dimensional code.
具体实施方式Detailed ways
为使本申请示例性实施例的目的、技术方案和优点更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施例中的技术方案进行清楚、完整地描述,显然,所描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。In order to make the purpose, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the exemplary embodiments of the present application. Obviously The described exemplary embodiments are only a part of the embodiments of the present application, rather than all of the embodiments.
基于本申请中示出的示例性实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。此外,虽然本申请中公开内容按照示范性一个或几个实例来介绍,但应理解,可以就这些公开内容的各个方面也可以单独构成一个完整技术方案。Based on the exemplary embodiments shown in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application. In addition, although the disclosure in this application is introduced in accordance with one or several exemplary examples, it should be understood that various aspects of these disclosures can also be individually constituted as a complete technical solution.
本申请中使用的术语“包括”和“具有”以及他们的任何变形,意图在于覆盖但不排他的包含,例如,包含了一系列组件的产品或设备不必限于清楚地列出的那些组件,而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。The terms "including" and "having" and any variations of them used in this application are intended to cover but not exclusively include. For example, a product or device that includes a series of components is not necessarily limited to those clearly listed, and Yes may include other components that are not clearly listed or are inherent to these products or devices.
本申请中使用的术语“模块”,是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合,能够执行与该元件相关的功能。The term "module" used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.
本申请中使用的术语“手势”,是指用户通过一种手型的变化或手部运动等动作,用于表达预期想法、动作、目的/或结果的用户行为。The term "gesture" used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
图1A中示例性示出了显示设备200与控制装置100之间操作场景的示意图。如图1A所示,控制装置100和显示设备200之间可以有线或无线方式进行通信。FIG. 1A exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device 100. As shown in FIG. 1A, the control device 100 and the display device 200 can communicate in a wired or wireless manner.
其中,控制装置100被配置为控制显示设备200,其可接收用户输入的操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起着用户与显示设备200之间交互的中介作用。如:用户通过操作控制装置100上频道加减键,显示设备200响应频道加减的操作。Among them, the control device 100 is configured to control the display device 200, which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and act as an intermediary for the interaction between the user and the display device 200 effect. For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.
控制装置100可以是遥控器100A,包括红外协议通信或蓝牙协议通信,及其他短距离通信方式等,通过无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令,来控制显示设备200。如:用户可以通过遥控器上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令,来实现控制显示设备200的功能。The control device 100 may be a remote controller 100A, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the display device 200 in a wireless or other wired manner. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.
控制装置100也可以是智能设备,如移动终端100B、平板电脑、计算机、笔记本电脑等。例如,使用在智能设备上运行的应用程序控制显示设备200。该应用程序通过配置可以在与智能设备关联的屏幕上,通过直观的用户界面(UI)为用户提供各种控制。The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, and the like. For example, an application program running on a smart device is used to control the display device 200. The application can be configured to provide users with various controls through an intuitive user interface (UI) on the screen associated with the smart device.
示例性的,移动终端100B可与显示设备200安装软件应用,通过网络通信协议实现连接通信,实现一对一控制操作的和数据通信的目的。如:可以使移动终端100B与显示设备200建立控制指令协议,通过操作移动终端100B上提供的用户界面的各种功能键或虚拟按钮,来实现如遥控器100A布置的实体按键的功能。也可以将移动终端100B上显示的音视频内容传输到显示设备200上,实现同步显示功能。Exemplarily, the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B can establish a control instruction protocol with the display device 200, and realize the functions of the physical keys arranged on the remote control 100A by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B. The audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.
显示设备200可被实施为电视,可提供广播接收电视功能以及计算机支持功能的智能网络电视功能。显示设备示例的包括,数字电视、网络电视、智能电视、互联网协议电视(IPTV)等。The display device 200 can be implemented as a television, and can provide a smart network television function with a broadcast receiving television function and a computer support function. Examples of display devices include digital TV, Internet TV, smart TV, Internet Protocol TV (IPTV), and so on.
显示设备200,可以是液晶显示器、有机发光显示器、投影显示设备。具体显示设备类型、尺寸大小和分辨率等不作限定。The display device 200 may be a liquid crystal display, an organic light emitting display, or a projection display device. The specific display device type, size and resolution are not limited.
显示设备200还与服务器300通过多种通信方式进行数据通信。这里可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器300可以向显示设备200提供各种内容和互动。示例的,显示设备200可以发送和接收信息,例如:接收电子节目指南(EPG)数据、接收软件程序更新、或访问远程储存的数字媒体库。服务器300可以一组,也可以多组,可以一类或多类服务器。通过服务器300提供视频点播和 广告服务等其他网络服务内容。The display device 200 also performs data communication with the server 300 through a variety of communication methods. Here, the display device 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 300 may provide various contents and interactions to the display device 200. For example, the display device 200 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The server 300 can be one group or multiple groups, and can be one type or multiple types of servers. The server 300 provides other network service contents such as video-on-demand and advertising services.
图1B中示例性示出了控制装置100的配置框图。如图1B所示,控制装置100包括控制器110、存储器120、通信器130、用户输入接口140、输出接口150、供电电源160。FIG. 1B exemplarily shows a configuration block diagram of the control device 100. As shown in FIG. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.
控制器110包括随机存取存储器(RAM)111、只读存储器(ROM)112、处理器113、通信接口以及通信总线。控制器110用于控制控制装置100的运行和操作,以及内部各部件之间的通信协作、外部和内部的数据处理功能。The controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components, and external and internal data processing functions.
示例性的,当检测到用户按压在遥控器100A上布置的按键的交互或触摸在遥控器100A上布置的触摸面板的交互时,控制器110可控制产生与检测到的交互相应的信号,并将该信号发送到显示设备200。Exemplarily, when an interaction of a user pressing a button arranged on the remote control 100A or an interaction of touching a touch panel arranged on the remote control 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction, and This signal is sent to the display device 200.
存储器120,用于在控制器110的控制下存储驱动和控制控制装置100的各种运行程序、数据和应用。存储器120,可以存储用户输入的各类控制信号指令。The memory 120 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 120 can store various control signal instructions input by the user.
通信器130在控制器110的控制下,实现与显示设备200之间控制信号和数据信号的通信。如:控制装置100经由通信器130将控制信号(例如触摸信号或按钮信号)发送至显示设备200上,控制装置100可经由通信器130接收由显示设备200发送的信号。通信器130可以包括红外信号接口131和射频信号接口132。例如:红外信号接口时,需要将用户输入指令按照红外控制协议转化为红外控制信号,经红外发送模块进行发送至显示设备200。再如:射频信号接口时,需将用户输入指令转化为数字信号,然后按照射频控制信号调制协议进行调制后,由射频发送端子发送至显示设备200。The communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the control device 100 sends a control signal (such as a touch signal or a button signal) to the display device 200 via the communicator 130, and the control device 100 can receive the signal sent by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module. For another example, in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.
用户输入接口140,可包括麦克风141、触摸板142、传感器143、按键144等中至少一者,从而用户可以通过语音、触摸、手势、按压等将关于控制显示设备200的用户指令输入到控制装置100。The user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can input user instructions for controlling the display device 200 to the control device through voice, touch, gesture, pressing, etc. 100.
输出接口150,通过将用户输入接口140接收的用户指令输出至显示设备200,或者,输出由显示设备200接收的图像或语音信号。这里,输出接口150可以包括LED接口151、产生振动的振动接口152、输出声音的声音输出接口153和输出图像的显示器154等。例如,遥控器100A可从输出接口150接收音频、视频或数据等输出信号,并且将输出信号在显示器154上显示为图像形式、在声音输出接口153输出为音频形式或在振动接口152输出为振动形式。The output interface 150 outputs a user instruction received by the user input interface 140 to the display device 200, or outputs an image or voice signal received by the display device 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibration, a sound output interface 153 that outputs a sound, a display 154 that outputs an image, and the like. For example, the remote controller 100A can receive output signals such as audio, video, or data from the output interface 150, and display the output signals as images on the display 154, as audio on the sound output interface 153, or as vibration on the vibration interface 152. form.
供电电源160,用于在控制器110的控制下为控制装置100各元件提供运行电力支持。形式可以为电池及相关控制电路。The power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. The form can be battery and related control circuit.
图1C中示例性示出了显示设备200的硬件配置框图。如图1C所示,显示设备200中可以进一步包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、存储器260、用户接口265、视频处理器270、显示器275、音频处理器280、音频输入接口285、供电电源290。FIG. 1C exemplarily shows a block diagram of the hardware configuration of the display device 200. As shown in FIG. 1C, the display device 200 may further include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, and a display 275. , Audio processor 280, audio input interface 285, power supply 290.
调谐解调器210,通过有线或无线方式接收广播电视信号,可以进行放大、混频和谐振等调制解调处理,用于从多个无线或有线广播电视信号中解调出用户所选择的电视频道的频率中所携带的音视频信号,以及附加信息(例如EPG数据)。The tuner and demodulator 210, which receives broadcast television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television selected by the user from multiple wireless or cable broadcast television signals The audio and video signals carried in the frequency of the channel, as well as additional information (such as EPG data).
调谐解调器210,可根据用户选择,以及由控制器250控制,响应用户选择的电视频道的频率以及该频率所携带的电视信号。The tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.
调谐解调器210,根据电视信号的广播制式不同,可以接收信号的途径有很多种,诸如:地面广播、有线广播、卫星广播或互联网广播等;以及根据调制类型不同,可以数字 调制方式或模拟调制方式;以及根据接收电视信号的种类不同,可以解调模拟信号和数字信号。The tuner and demodulator 210 can receive signals in many ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting; and according to different modulation types, it can be digital modulation or analog Modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.
在其他一些示例性实施例中,调谐解调器210也可在外部设备中,如外部机顶盒等。这样,机顶盒通过调制解调后输出电视信号,经过外部装置接口240输入至显示设备200中。In some other exemplary embodiments, the tuner demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a TV signal after modulation and demodulation, and is input to the display device 200 through the external device interface 240.
通信器220,是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如显示设备200可将内容数据发送至经由通信器220连接的外部设备,或者,从经由通信器220连接的外部设备浏览和下载内容数据。通信器220可以包括WIFI模块221、蓝牙通信协议模块222、有线以太网通信协议模块223等网络通信协议模块或近场通信协议模块,从而通信器220可根据控制器250的控制接收控制装置100的控制信号,并将控制信号实现为WIFI信号、蓝牙信号、射频信号等。The communicator 220 is a component used to communicate with external devices or external servers according to various types of communication protocols. For example, the display device 200 may transmit content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220. The communicator 220 may include a network communication protocol module such as a WIFI module 221, a Bluetooth communication protocol module 222, and a wired Ethernet communication protocol module 223 or a near field communication protocol module, so that the communicator 220 can receive the control device 100 according to the control of the controller 250 Control signals, and implement the control signals as WIFI signals, Bluetooth signals, radio frequency signals, etc.
检测器230,是显示设备200用于采集外部环境或与外部交互的信号的组件。检测器230可以包括图像采集器231,如相机、摄像头等,可以用于采集外部环境场景,以自适应变化显示设备200的显示参数;以及用于采集用户的属性或与用户交互手势,以实现显示设备与用户之间互动的功能。还可以包括光接收器232,用于采集环境光线强度,以自适应显示设备200的显示参数变化等。The detector 230 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside. The detector 230 may include an image collector 231, such as a camera, a camera, etc., which can be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect the attributes of the user or interact with the user gestures to achieve Display the function of interaction between the device and the user. It may also include a light receiver 232 for collecting the ambient light intensity to adapt to changes in display parameters of the display device 200 and so on.
在其他一些示例性实施例中,检测器230,还可以包括温度传感器,如通过感测环境温度,显示设备200可自适应调整图像的显示色温。示例性的,当温度偏高的环境时,可调整显示设备200显示图像色温偏冷色调;当温度偏低的环境时,可以调整显示设备200显示图像色温偏暖色调。In some other exemplary embodiments, the detector 230 may also include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. Exemplarily, when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be colder; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be warmer.
在其他一些示例性实施例中,检测器230,还可以包括声音采集器,如麦克风,可以用于接收用户的声音,如用户控制显示设备200的控制指令的语音信号;或者,可以采集用于识别环境场景类型的环境声音,实现显示设备200可以自适应环境噪声。In some other exemplary embodiments, the detector 230 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, may be used to collect The environmental sound of the environmental scene type is recognized, so that the display device 200 can adapt to the environmental noise.
外部装置接口240,是提供控制器210控制显示设备200与外部设备间数据传输的组件。外部装置接口240可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等外部设备连接,可接收外部设备的诸如视频信号(例如运动图像)、音频信号(例如音乐)、附加信息(例如EPG)等数据。The external device interface 240 is a component that provides the controller 210 to control the data transmission between the display device 200 and external devices. The external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
其中,外部装置接口240可以包括:高清多媒体接口(HDMI)端子241、复合视频消隐同步(CVBS)端子242、模拟或数字分量端子243、通用串行总线(USB)端子244、组件(Component)端子(图中未示出)、红绿蓝(RGB)端子(图中未示出)等任一个或多个。Among them, the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, and a component (Component) Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.
控制器250,通过运行存储在存储器260上的各种软件控制程序(如操作系统和各种应用程序),来控制显示设备200的工作和响应用户的操作。The controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.
如图1C所示,控制器250包括随机存取存储器(RAM)251、只读存储器(ROM)252、图形处理器253、CPU处理器254、通信接口255、以及通信总线256。其中,RAM251、ROM252以及图形处理器253、CPU处理器254通信接口255通过通信总线256相连接。As shown in FIG. 1C, the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. Among them, the RAM 251, the ROM 252, the graphics processor 253, and the CPU processor 254 communication interface 255 are connected via a communication bus 256.
ROM252,用于存储各种系统启动指令。如在接收到开机信号时,显示设备200电源开始启动,CPU处理器254运行ROM252中的系统启动指令,将存储在存储器260的操作系统拷贝至RAM251中,以开始运行启动操作系统。当操作系统启动完成后,CPU处理器254再将存储器260中各种应用程序拷贝至RAM251中,然后,开始运行启动各种应用程 序。ROM252, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 254 runs the system start-up instruction in the ROM 252 to copy the operating system stored in the memory 260 to the RAM 251 to start running the start-up operating system. After the operating system is started, the CPU processor 254 copies the various application programs in the memory 260 to the RAM 251, and then starts to run and start the various application programs.
图形处理器253,用于产生各种图形对象的屏幕图像,如图标、图像以及操作菜单等。图形处理器253可以包括运算器,用于通过接收用户输入各种交互指令进行运算,进而根据显示属性显示各种对象;以及包括渲染器,用于产生基于运算器得到的各种对象,将进行渲染的结果显示在显示器275上。The graphics processor 253 is used to generate screen images of various graphics objects, such as icons, images, and operation menus. The graphics processor 253 may include an arithmetic unit, which is used to perform operations by receiving various interactive instructions input by the user, and then display various objects according to display attributes; and a renderer, which is used to generate various objects obtained based on the arithmetic unit, and perform operations The rendered result is displayed on the display 275.
CPU处理器254,用于执行存储在存储器260中的操作系统和应用程序指令。以及根据接收的用户输入指令,来执行各种应用程序、数据和内容的处理,以便最终显示和播放各种音视频内容。The CPU processor 254 is configured to execute operating system and application program instructions stored in the memory 260. And according to the received user input instructions, to execute various applications, data and content processing, so as to finally display and play various audio and video content.
在一些示例性实施例中,CPU处理器254,可以包括多个处理器。多个处理器可包括一个主处理器以及多个或一个子处理器。主处理器,用于在显示设备预加载模式中执行显示设备200的一些初始化操作,和/或,在正常模式下显示画面的操作。多个或一个子处理器,用于执行在显示设备待机模式等状态下的一种操作。In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is configured to perform some initialization operations of the display device 200 in the display device preloading mode, and/or, to display screen operations in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode of the display device.
通信接口255,可包括第一接口到第n接口。这些接口可以是经由网络被连接到外部设备的网络接口。The communication interface 255 may include the first interface to the nth interface. These interfaces may be network interfaces connected to external devices via a network.
控制器250可以控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器275上显示的GUI对象的用户输入命令,控制器250便可以执行与由用户输入命令选择的对象有关的操作。The controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.
其中,该对象可以是可选对象中的任何一个,例如超链接或图标。该与所选择的对象有关的操作,例如显示连接到超链接页面、文档、图像等操作,或者执行与图标相对应的程序的操作。该用于选择GUI对象的用户输入命令,可以是通过连接到显示设备200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者是与用户说出语音相对应的语音命令。Among them, the object can be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object, for example, the operation of displaying the page, document, image, etc. connected to the hyperlink, or the operation of executing the program corresponding to the icon. The user input command for selecting the GUI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
存储器260,用于存储驱动和控制显示设备200运行的各种类型的数据、软件程序或应用程序。存储器260可以包括易失性和/或非易失性存储器。而术语“存储器”包括存储器260、控制器250的RAM251和ROM252、或显示设备200中的存储卡。The memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or non-volatile memory. The term “memory” includes the memory 260, the RAM 251 and ROM 252 of the controller 250, or the memory card in the display device 200.
在一些实施例中,存储器260具体用于存储驱动显示设备200中控制器250的运行程序;存储显示设备200内置的和用户从外部设备下载的各种应用程序;存储用于配置由显示器275提供的各种GUI、与GUI相关的各种对象及用于选择GUI对象的选择器的视觉效果图像等数据。In some embodiments, the memory 260 is specifically used to store the operating program that drives the controller 250 in the display device 200; to store various application programs built in the display device 200 and downloaded from an external device by the user; and to store the configuration provided by the display 275 Data such as various GUIs, various objects related to the GUI, and visual effect images of the selector used to select GUI objects.
在一些实施例中,存储器260具体用于存储调谐解调器210、通信器220、检测器230、外部装置接口240、视频处理器270、显示器275、音频处理器280等的驱动程序和相关数据,从外部装置接口接收的外部数据(例如音视频数据)或用户接口接收的用户数据(例如按键信息、语音信息、触摸信息等)。In some embodiments, the memory 260 is specifically used to store drivers and related data of the tuner and demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, etc. , External data (such as audio and video data) received from the external device interface or user data (such as button information, voice information, touch information, etc.) received from the user interface.
在一些实施例中,存储器260具体存储用于表示操作系统(OS)的软件和/或程序,这些软件和/或程序可包括,例如:内核、中间件、应用编程接口(API)和/或应用程序。示例性的,内核可控制或管理系统资源,以及其它程序所实施的功能(如所述中间件、API或应用程序);同时,内核可以提供接口,以允许中间件、API或应用程序访问控制器,以实现控制或管理系统资源。In some embodiments, the memory 260 specifically stores software and/or programs for representing an operating system (OS). These software and/or programs may include, for example, a kernel, middleware, application programming interface (API), and/or application. Exemplarily, the kernel can control or manage system resources and functions implemented by other programs (such as the middleware, API, or application program); at the same time, the kernel can provide interfaces to allow middleware, API, or application program access control To control or manage system resources.
图1D中示例性示出了显示设备200存储器中操作系统的架构配置框图。该操作系统架构从上到下依次是应用层、中间件层和内核层。FIG. 1D exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200. The operating system architecture consists of the application layer, the middleware layer, and the kernel layer from top to bottom.
应用层,系统内置的应用程序以及非系统级的应用程序都属于应用层,其负责与用户进行直接交互。应用层可包括多个应用程序,如NETFLIX应用程序、设置应用程序、媒体中心应用程序等。这些应用程序可被实现为Web应用,其基于WebKit引擎来执行,具体可基于HTML、层叠样式表(CSS)和JavaScript来开发并执行。Application layer, system built-in applications and non-system-level applications belong to the application layer, which is responsible for direct interaction with users. The application layer can include multiple applications, such as NETFLIX applications, settings applications, media center applications, and so on. These applications can be implemented as Web applications, which are executed based on the WebKit engine, and specifically can be developed and executed based on HTML, Cascading Style Sheets (CSS) and JavaScript.
这里,HTML,全称为超文本标记语言(HyperText Markup Language),是一种用于创建网页的标准标记语言,通过标记标签来描述网页,HTML标签用以说明文字、图形、动画、声音、表格、链接等,浏览器会读取HTML文档,解释文档内标签的内容,并以网页的形式显示出来。Here, HTML, the full name of HyperText Markup Language (HyperText Markup Language), is a standard markup language used to create web pages. Web pages are described through markup tags. HTML tags are used to describe text, graphics, animations, sounds, tables, For links, the browser will read the HTML document, explain the content of the tags in the document, and display it in the form of a web page.
CSS,全称为层叠样式表(Cascading Style Sheets),是一种用来表现HTML文件样式的计算机语言,可以用来定义样式结构,如字体、颜色、位置等的语言。CSS样式可以直接存储与HTML网页或者单独的样式文件中,实现对网页中样式的控制。CSS, the full name of Cascading Style Sheets (Cascading Style Sheets), is a computer language used to express the style of HTML documents, and can be used to define style structures, such as fonts, colors, and positions. CSS styles can be directly stored in HTML web pages or in separate style files to achieve control over styles in web pages.
JavaScript,是一种应用于Web网页编程的语言,可以插入HTML页面并由浏览器解释执行。其中Web应用的交互逻辑都是通过JavaScript实现。JavaScript可以通过浏览器,封装JavaScript扩展接口,实现与内核层的通信,JavaScript is a language used in web page programming, which can be inserted into HTML pages and interpreted and executed by the browser. The interaction logic of the web application is implemented through JavaScript. JavaScript can encapsulate the JavaScript extension interface through the browser to realize the communication with the kernel layer,
中间件层,可以提供一些标准化的接口,以支持各种环境和系统的操作。例如,中间件层可以实现为与数据广播相关的中间件的多媒体和超媒体信息编码专家组(MHEG),还可以实现为与外部设备通信相关的中间件的DLNA中间件,还可以实现为提供显示设备内各应用程序所运行的浏览器环境的中间件等。The middleware layer can provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer can be implemented as the Multimedia and Hypermedia Information Coding Expert Group (MHEG) of the middleware related to data broadcasting, and can also be implemented as the DLNA middleware of the middleware related to external device communication, and can also be implemented as providing Display the middleware of the browser environment in which each application in the device runs.
内核层,提供核心系统服务,例如:文件管理、内存管理、进程管理、网络管理、系统安全权限管理等服务。内核层可以被实现为基于各种操作系统的内核,例如,基于Linux操作系统的内核。The kernel layer provides core system services, such as file management, memory management, process management, network management, system security authority management and other services. The kernel layer can be implemented as a kernel based on various operating systems, for example, a kernel based on the Linux operating system.
内核层也同时提供系统软件和硬件之间的通信,为各种硬件提供设备驱动服务,例如:为显示器提供显示驱动程序、为摄像头提供摄像头驱动程序、为遥控器提供按键驱动程序、为WIFI模块提供WIFI驱动程序、为音频输出接口提供音频驱动程序、为电源管理(PM)模块提供电源管理驱动等。The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: providing display drivers for displays, camera drivers for cameras, button drivers for remote controls, and WIFI modules Provide WIFI driver, audio driver for audio output interface, power management driver for power management (PM) module, etc.
用户接口265,接收各种用户交互。具体的,用于将用户的输入信号发送给控制器250,或者,将从控制器250的输出信号传送给用户。示例性的,遥控器100A可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户接口265,再由用户接口265转送至控制器250;或者,遥控器100A可接收经控制器250处理从用户接口265输出的音频、视频或数据等输出信号,并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。The user interface 265 receives various user interactions. Specifically, it is used to send the input signal of the user to the controller 250, or to transmit the output signal from the controller 250 to the user. Exemplarily, the remote control 100A may send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 through the controller 250, and display the received output signal or output the received output signal as audio or vibration.
在一些实施例中,用户可在显示器275上显示的图形用户界面(GUI)输入用户命令,则用户接口265通过GUI接收用户输入命令。确切的说,用户接口265可接收用于控制选择器在GUI中的位置以选择不同的对象或项目的用户输入命令。In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of the selector in the GUI to select different objects or items.
或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户接口265通过传感器识别出声音或手势,来接收用户输入命令。Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through the sensor to receive the user input command.
视频处理器270,用于接收外部的视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频数据处理,可得到直接在显示器275上显示或播放的视频信号。The video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal displayed or played directly on the display 275.
示例的,视频处理器270,包括解复用模块、视频解码模块、图像合成模块、帧率转 换模块、显示格式化模块等。For example, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
其中,解复用模块,用于对输入音视频数据流进行解复用处理,如输入MPEG-2流(基于数字存储媒体运动图像和语音的压缩标准),则解复用模块将其进行解复用成视频信号和音频信号等。Among them, the demultiplexing module is used to demultiplex the input audio and video data stream, such as the input MPEG-2 stream (based on the compression standard of digital storage media moving images and voice), then the demultiplexing module will demultiplex it Multiplexed into video signals and audio signals, etc.
视频解码模块,用于对解复用后的视频信号进行处理,包括解码和缩放处理等。The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频图像进行叠加混合处理,以生成可供显示的图像信号。An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to the user input or itself, so as to generate an image signal for display.
帧率转换模块,用于对输入视频的帧率进行转换,如将输入的60Hz视频的帧率转换为120Hz或240Hz的帧率,通常的格式采用如插帧方式实现。The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to a frame rate of 120Hz or 240Hz, and the usual format is realized by such as frame interpolation.
显示格式化模块,用于将帧率转换模块输出的信号,改变为符合诸如显示器显示格式的信号,如将帧率转换模块输出的信号进行格式转换以输出RGB数据信号。The display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.
显示器275,用于接收源自视频处理器270输出的图像信号,进行显示视频、图像以及菜单操控界面。例如,显示器可以显示来自调谐解调器210接收的广播信号中的视频,也可以显示来自通信器220或外部装置接口240输入的视频,还可以显示在存储器260中存储的图像。显示器275,同时显示显示设备200中产生且用于控制显示设备200的用户操控界面UI。The display 275 is used to receive the image signal output from the video processor 270 to display video, image, and menu control interface. For example, the display may display the video in the broadcast signal received from the tuner and demodulator 210, may also display the video input from the communicator 220 or the external device interface 240, and may also display the image stored in the memory 260. The display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
以及,显示器275可以包括用于呈现画面的显示屏组件以及驱动图像显示的驱动组件。或者,倘若显示器275为一种投影显示器,还可以包括一种投影装置和投影屏幕。And, the display 275 may include a display screen component for presenting a picture and a driving component for driving image display. Alternatively, if the display 275 is a projection display, it may also include a projection device and a projection screen.
音频处理器280,用于接收外部的音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换、和放大处理等音频数据处理,得到可以在扬声器286中播放的音频信号。The audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be stored in the speaker 286 The audio signal to be played.
示例性的,音频处理器280可以支持各种音频格式。例如MPEG-2、MPEG-4、高级音频编码(AAC)、高效AAC(HE-AAC)等格式。Exemplarily, the audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.
音频输出接口285,用于接收源自音频处理器280输出的音频信号。例如,音频输出接口可以输出经由调谐解调器210接收的广播信号中的音频,也可以输出经由通信器220或外部装置接口240输入的音频,还可以输出在存储器260中存储的音频。音频输出接口285可包括扬声器286,或输出至外接设备的发生装置的外接音响输出端子287,如耳机输出端子。The audio output interface 285 is used to receive audio signals output from the audio processor 280. For example, the audio output interface can output audio in the broadcast signal received via the tuner demodulator 210, can also output audio input via the communicator 220 or the external device interface 240, and can also output audio stored in the memory 260. The audio output interface 285 may include a speaker 286, or an external audio output terminal 287 output to a generator of an external device, such as a headphone output terminal.
在其他一些示例性实施例中,视频处理器270可以包括一个或多个芯片组成。音频处理器280,也可以包括一个或多个芯片组成。In some other exemplary embodiments, the video processor 270 may include one or more chips. The audio processor 280 may also include one or more chips.
以及,在其他一些示例性实施例中,视频处理器270和音频处理器280,可以为单独的芯片,也可以与控制器250一起集成在一个或多个芯片中。And, in some other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller 250 in one or more chips.
供电电源290,用于在控制器250的控制下,将外部电源输入的电力为显示设备200提供电源供电支持。供电电源290可以是安装在显示设备200内部的内置电源电路,也可以是安装在显示设备200外部的电源。The power supply 290 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.
需要说明的是,为了选择并执行显示设备200提供的网页视频所需的播放控制功能(例如暂停播放、开始播放、快进播放、快退播放等),如图1E所示,被配置为控制显示设备200的控制装置100中实施为一个遥控器,其包括用于选择播放控制功能的play(播放)按键、pause(暂停)按键、play pause(播放暂停)按键、stop(停止)按键、backwards(快退)按键、forwards(快进)按键等,以向用户提示可以通过操作控 制装置100上的按键而使显示设备200执行与对应按键适配的播放控制功能。这里,控制装置100不局限于支持遥控器以按键的方式对网页视频进行播放控制操作,也可以利用局域网间通信机制,通过其他操作终端对显示设备正在播放的网页视频进行播放控制操作,只需要操作终端对接Command Parser(命令分析)模块中支持的命令即可。It should be noted that in order to select and execute the playback control functions (such as pause playback, start playback, fast forward playback, fast backward playback, etc.) required for the webpage video provided by the display device 200, as shown in FIG. 1E, it is configured to control The control device 100 of the display device 200 is implemented as a remote controller, which includes a play button, a pause button, a play pause button, a stop button, and backwards for selecting the playback control function. A (fast rewind) button, a forwards button, etc., to prompt the user that the display device 200 can perform a playback control function adapted to the corresponding button by operating the button on the control device 100. Here, the control device 100 is not limited to supporting the remote control to perform the playback control operation of the webpage video by means of buttons, but can also use the communication mechanism between the local area networks to perform the playback control operation of the webpage video being played by the display device through other operating terminals. The operation terminal can be connected to the commands supported in the Command Parser module.
这里,上述播放控制功能对应的功能信息与控制装置100上的按键信息具有映射关系。具体的,当显示设备200接收到用户输入的与控制装置100上各个按键对应的键事件值时,显示设备200可以基于该映射关系执行与键事件值对应的功能操作,这样,能够便于用户可视的将控制装置100上的按键与各播放控制功能进行匹配。Here, the function information corresponding to the above-mentioned playback control function has a mapping relationship with the key information on the control device 100. Specifically, when the display device 200 receives the key event value corresponding to each key on the control device 100 input by the user, the display device 200 can perform the function operation corresponding to the key event value based on the mapping relationship, which can facilitate the user to Visually, the buttons on the control device 100 are matched with each playback control function.
这样,用户通过按压控制装置100上具有其期望执行功能的按键,显示设备200可以接收该按键的键事件值,从映射信息中搜索并执行与接收的键事件值对应的功能,直观地考虑了控制装置100上的按键与播放控制功能对应来执行期望的功能。In this way, by pressing the button with the desired function on the control device 100, the display device 200 can receive the key event value of the button, search for and execute the function corresponding to the received key event value from the mapping information, and intuitively consider The buttons on the control device 100 correspond to the playback control functions to perform desired functions.
图2A-2G中示例性示出了通过操作控制装置100而使显示设备200提供的一个GUI400的示意图。FIGS. 2A-2G exemplarily show schematic diagrams of a GUI 400 provided by the display device 200 by operating the control device 100.
如图2A所示,显示设备在显示器上显示一网页主页面41,可以是某视频网站的视频播放页面,图2A所示的网页主页面41包括视频播放区域、网页选项区域以及视频详情区域。其中,视频播放区域包括视频播放画面,视频播放画面的底部设置有进度条、暂停播放图标、快进图标。图2A的视频播放区域正在播放一视频画面。相关技术中,用户如果想要快进或者快退视频,则需要将虚拟鼠标放置在进度条上,移动进度条来实现快进或者快退。用户如果想要暂停或者播放视频,需要将虚拟鼠标移动到暂停播放图标,点击暂停播放图标实现视频暂停。进度条和图标尺寸在网页主页面上显示位置较小,通过将虚拟鼠标移动到进度条或者图标上,来实现预想的视频播放控制操作,操作难度较大。As shown in FIG. 2A, the display device displays a webpage main page 41 on the display, which may be a video playback page of a video website. The webpage main page 41 shown in FIG. 2A includes a video playback area, a webpage option area, and a video details area. Among them, the video playback area includes a video playback screen, and the bottom of the video playback screen is provided with a progress bar, a pause playback icon, and a fast forward icon. A video screen is being played in the video playback area of FIG. 2A. In the related art, if the user wants to fast forward or rewind the video, he needs to place the virtual mouse on the progress bar and move the progress bar to realize fast forward or rewind. If the user wants to pause or play the video, he needs to move the virtual mouse to the pause icon and click the pause icon to pause the video. The size of the progress bar and icon is relatively small on the main page of the web page. By moving the virtual mouse to the progress bar or icon, the expected video playback control operation can be realized, which is difficult to operate.
在图2A中,当用户按压控制装置上的暂停按键,如图2B所示,显示设备响应于该按键输入的控制当前视频暂停播放的指令,直接控制当前视频暂停播放,不需要将虚拟鼠标移动到暂停图标上,更不需要用户做出下一步的点击操作,就能够实现暂停操作。暂停播放当前视频的同时,在当前视频画面上叠加显示暂停播放指示图标。In FIG. 2A, when the user presses the pause button on the control device, as shown in FIG. 2B, the display device responds to the command input by the button to control the pause of the current video, and directly controls the pause of the current video without moving the virtual mouse. On the pause icon, the user does not need to make the next click operation, and the pause operation can be realized. When the current video is paused, a pause instruction icon will be superimposed on the current video screen.
在图2B中,当用户按压控制装置上的播放按键,如图2A所示,显示设备响应于该按键输入的控制当前视频开始播放的指令,直接控制当前视频开始播放,不需要将虚拟鼠标移动到播放图标上,同样也不需要用户做出下一步的点击操作,就能够实现开始播放操作。开始播放当前视频的同时,之前显示在当前视频画面上的暂停播放指示图标消失。In Figure 2B, when the user presses the play button on the control device, as shown in Figure 2A, the display device responds to the instruction input by the button to control the current video to start playing, and directly controls the current video to start playing without moving the virtual mouse On the play icon, the user does not need to make the next click operation to start the play operation. When starting to play the current video, the pause indicator icon previously displayed on the current video screen disappears.
在图2A中,当用户按压控制装置上的快进按键,如图2C所示,显示设备响应于该按键输入的控制当前视频快进的指令,直接控制当前视频快进播放,快进播放的同时,在当前视频画面上叠加显示快进播放指示图标。放开快进按键之后,如图2D所示,视频画面上的快进播放指示图标消失,并且当前播放进度从10分50秒快进到11分10秒。In Figure 2A, when the user presses the fast forward button on the control device, as shown in Figure 2C, the display device responds to the command input by the button to control the fast forward of the current video and directly controls the fast forward playback of the current video. At the same time, a fast-forward playback indicator icon is superimposed on the current video screen. After releasing the fast-forward button, as shown in Figure 2D, the fast-forward playback indication icon on the video screen disappears, and the current playback progress is fast-forwarded from 10 minutes and 50 seconds to 11 minutes and 10 seconds.
在图2A中,当用户按压控制装置上的快退按键,如图2E所示,显示设备响应于该按键输入的控制当前视频快退的指令,直接控制当前视频快退播放,快退播放的同时,在当前视频画面上叠加显示快退播放指示图标。放开快退按键之后,如图2F所示,视频画面上的快退播放指示图标消失,并且当前播放进度从10分50秒快退到10分30秒。In Figure 2A, when the user presses the fast-rewind button on the control device, as shown in Figure 2E, the display device directly controls the fast-rewind playback of the current video in response to the command input by the button to control the fast-rewind of the current video. At the same time, the fast-reverse playback indicator icon is superimposed on the current video screen. After releasing the fast-rewind button, as shown in Figure 2F, the fast-rewind playback indication icon on the video screen disappears, and the current playback progress fast-rewinds from 10 minutes and 50 seconds to 10 minutes and 30 seconds.
在一些实施例中,网页主页面41还可以是非视频播放页面,比如可以是如图2G所示的某一视频的详情介绍页。图2G所示的网页主页面不包括视频画面。在图2G中,当用户 按压控制装置上的选择播放控制功能的暂停按键、开始按键、快进按键、快退按键等按键中的任意一个,由于当前主页面不包括视频画面,显示设备忽略用户通过按压上述按键输入的视频播放控制指令。In some embodiments, the main web page 41 may also be a non-video playback page, for example, it may be a detailed introduction page of a certain video as shown in FIG. 2G. The main page of the webpage shown in FIG. 2G does not include video images. In Figure 2G, when the user presses any one of the pause button, start button, fast forward button, fast reverse button and other buttons on the control device that selects the playback control function, since the current main page does not include video images, the display device ignores the user Video playback control instructions input by pressing the above keys.
上述实施例的视频播放控制方法实现逻辑原理如下所示:The implementation logic principle of the video playback control method of the foregoing embodiment is as follows:
当浏览器加载网页时,可通过NPAPI/PPAPI等插件机制将一个基于JavaScript的Player Controller(播放控制)模块注入所加载的网页,该Player Controller模块注册一个回调接口至浏览器内核,并通过此回调接口接收底层系统通过浏览器内核传递给Player Controller模块的消息。其中,Player Controller模块的功能在于通过标准HTML5的VIDEO控件的接口,对网页中的视频进行播放控制。Player Controller模块关注的消息可以是play(播放)、pause(暂停)、play pause(播放暂停)、stop(停止)、backwards(快退)、forwards(快进)等。When the browser loads a webpage, a JavaScript-based Player Controller (play control) module can be injected into the loaded webpage through plug-in mechanisms such as NPAPI/PPAPI. The Player Controller module registers a callback interface to the browser core and calls back through this The interface receives messages from the underlying system to the Player Controller module through the browser kernel. Among them, the function of the Player Controller module is to control the playback of the video in the webpage through the interface of the standard HTML5 VIDEO control. The messages that the Player Controller module pays attention to can be play, pause, play pause, stop, backwards, forwards, and so on.
如图3A所示的浏览器网页加载同时初始化Player Controller模块的逻辑示意图,浏览器启动时,通过浏览器启动模块加载网页,之后通过浏览器解析模块解析加载的网页,同时加载Player Controller模块。解析出网页后,浏览器渲染模块渲染网页,完成渲染后显示网页。同时,Player Controller模块将注册消息回调给浏览器消息处理模块。As shown in FIG. 3A, the browser webpage is loaded and the Player Controller module is initialized at the same time. When the browser is started, the webpage is loaded through the browser startup module, and then the loaded webpage is parsed by the browser parsing module, and the Player Controller module is loaded at the same time. After the webpage is parsed, the browser rendering module renders the webpage, and displays the webpage after rendering. At the same time, the Player Controller module callbacks the registration message to the browser message processing module.
如图3B所示的视频播放控制方法实现逻辑原理示意图。按键接收模块获取用户通过按压控制装置上的play pause按键,输入的与play pause按键相对应的视频播放暂停控制指令,并将该视频播放暂停控制指令发送给命令分析模块。这里,由于按键接收模块可能接收到不同的播放控制指令,包括:播放指令、暂停指令、播放暂停指令、停止指令、后退指令以及快进指令中的至少一种。命令分析模块可以对这些指令进行分析,生成对应的消息。The schematic diagram of the logic principle of the video playback control method shown in FIG. 3B. The button receiving module obtains the video playback pause control instruction corresponding to the play pause button input by the user by pressing the play pause button on the control device, and sends the video playback pause control instruction to the command analysis module. Here, because the key receiving module may receive different playback control commands, including at least one of a playback command, a pause command, a playback pause command, a stop command, a rewind command, and a fast forward command. The command analysis module can analyze these instructions and generate corresponding messages.
沿用上述实施例,命令分析模块分析该视频暂停控制指令,转化为play pause消息。并且将play pause消息发送给浏览器消息处理模块,最后回调给Player Controller模块。具体的,通过浏览器接收消息接口,将play pause消息发送至浏览器内核。Player Controller模块通过浏览器内核的回调接口获取play pause消息。Player Controller模块根据play pause消息控制当前网页中的视频元素的播放。Following the foregoing embodiment, the command analysis module analyzes the video pause control instruction and converts it into a play pause message. And send the play pause message to the browser message processing module, and finally call back to the Player Controller module. Specifically, the play pause message is sent to the browser kernel through the browser receiving message interface. The Player Controller module obtains the play pause message through the callback interface of the browser kernel. The Player Controller module controls the playback of the video elements in the current webpage according to the play pause message.
这里,控制装置是将播放暂停功能设置在同一个按键上,Player Controller模块获取到的是一个play pause消息。需要根据当前网页中的视频元素的状态,对该play pause消息进行分析,再对视频元素做出对应的播控操作。如果当前网页中的视频元素处于正在播放状态,Player Controller模块根据该play pause消息控制当前网页中的视频元素暂停播放。如果当前网页中的视频元素处于暂停播放状态,则Player Controller模块根据play pause消息控制当前网页中的视频元素播放。Here, the control device sets the play pause function on the same button, and what the Player Controller module obtains is a play pause message. It is necessary to analyze the play pause message according to the state of the video element in the current webpage, and then perform the corresponding broadcast control operation on the video element. If the video element in the current webpage is in the playing state, the Player Controller module controls the video element in the current webpage to pause playing according to the play pause message. If the video element in the current webpage is in the paused playback state, the Player Controller module controls the playback of the video element in the current webpage according to the play pause message.
如图3C所示的另外一种视频播放控制方法实现逻辑原理示意图。按键接收模块获取用户通过按压控制装置上的Forwards按键,输入的与Forwards按键相对应的视频播放快进控制指令,并将该视频播放快进控制指令发送给命令分析模块。命令分析模块分析该视频快进控制指令,转化为Forwards消息。并且将Forwards消息发送给浏览器消息处理模块,最后回调给Player Controller模块。具体的,通过浏览器接收消息接口,将Forwards消息发送至浏览器内核。Player Controller模块通过浏览器内核的回调接口获取Forwards消息。Player Controller模块根据Forwards消息控制当前网页中的视频元素的快进。As shown in FIG. 3C, a schematic diagram of the logic principle of another video playback control method is realized. The button receiving module obtains the video playback fast-forward control instruction corresponding to the Forwards button input by the user by pressing the Forwards button on the control device, and sends the video playback fast-forward control instruction to the command analysis module. The command analysis module analyzes the video fast-forward control command and converts it into a Forwards message. And send the Forwards message to the browser message processing module, and finally call back to the Player Controller module. Specifically, the Forwards message is sent to the browser kernel through the browser receiving message interface. The Player Controller module obtains the Forwards message through the callback interface of the browser kernel. The Player Controller module controls the fast forward of the video elements in the current webpage according to the Forwards message.
在一些实施例中,浏览器注入Player Controller模块时,Player Controller模块会进行 初始化,并获取当前网页中非隐藏状态的视频标签。如果当前网页中存在非隐藏状态的视频标签,则将该视频标签相对应的视频元素保存至Player Controller模块。如果当前网页不存在非隐藏状态的视频标签,则Player Controller模块获取为空。Player Controller模块在获取到play pause消息时,会首先判断Player Controller模块是否保存有视频元素。如果Player Controller模块中保存有视频元素,则控制该视频元素暂停播放。如果Player Controller模块中未保存有视频元素,则跳出该pause消息的处理。如果Player Controller模块中未保存有视频元素,说明当前网页目前没有与视频播放相关的动作,比如纯文字的网页中没有视频画面。In some embodiments, when the browser injects the Player Controller module, the Player Controller module will initialize and obtain the non-hidden video tags in the current webpage. If there is a non-hidden video tag in the current webpage, the video element corresponding to the video tag is saved to the Player Controller module. If there is no non-hidden video tag in the current webpage, the Player Controller module will get empty. When the Player Controller module receives the play pause message, it will first determine whether the Player Controller module saves video elements. If a video element is stored in the Player Controller module, control the video element to pause playback. If there are no video elements stored in the Player Controller module, the processing of the pause message will be skipped. If there are no video elements stored in the Player Controller module, it means that the current web page currently has no actions related to video playback, for example, there is no video screen in a text-only web page.
这里,由于网页包含的内容有可能随着时间推移发生变化(比如当前网页在某一时刻没有与视频播放相关的动作,在用户刷新网页后又出现与视频播放相关的动作),因此每一次用户按压控制装置上的视频播放控制相关按键时,Player Controller模块均需要重新获取一次当前网页中非隐藏状态的视频标签。Here, since the content contained in the webpage may change over time (for example, the current webpage has no action related to video playback at a certain moment, and there are actions related to video playback after the user refreshes the webpage), so every time the user When the video playback control related buttons on the control device are pressed, the Player Controller module needs to obtain the non-hidden video tags in the current webpage again.
在上述实施例中,获取用户通过按压控制装置上的按键,输入的与所述按键相对应的视频播放控制指令,根据所述视频播放控制指令,控制当前网页中视频元素的播放。用户在需要控制网页中的视频播放时,不需要将焦点移动到控件上。只需要按压控制装置上相应的视频播放控制按键,就能够实现预想的视频播放控制效果,操作简单,提高用户对于视频播放控制体验度。In the above embodiment, the video playback control instruction corresponding to the button input by the user by pressing the button on the control device is acquired, and the playback of the video element in the current webpage is controlled according to the video playback control instruction. When the user needs to control the video playback in the webpage, there is no need to move the focus to the control. Only by pressing the corresponding video playback control button on the control device, the expected video playback control effect can be realized, the operation is simple, and the user's experience in video playback control is improved.
图4A-4B示例性示出了视频播放控制方法的流程图。4A-4B exemplarily show a flowchart of a method for controlling video playback.
结合图4A的方法来说,该方法包括以下步骤S51~S54:In combination with the method in FIG. 4A, the method includes the following steps S51 to S54:
步骤S51:在显示器上显示网页页面,所述网页页面中包含多个网页控件;Step S51: Display a web page on the display, the web page contains multiple web controls;
步骤S52:接收用户通过按压控制装置上的按键输入;例如如图1E所示,被配置为控制显示设备200的控制装置100中实施为一个遥控器,其包括用于选择播放控制功能的暂停按键、开始按键、快进按键、快退按键等。例如,在图2A中,当用户按压控制装置上的暂停按键,获取用户通过按压控制装置上的暂停按键,输入的与暂停按键相对应的视频暂停播放的指令。Step S52: Receive user input by pressing a button on the control device; for example, as shown in FIG. 1E, the control device 100 configured to control the display device 200 is implemented as a remote controller, which includes a pause button for selecting a playback control function , Start button, fast forward button, fast reverse button, etc. For example, in FIG. 2A, when the user presses the pause button on the control device, an instruction to pause the video playback corresponding to the pause button input by the user by pressing the pause button on the control device is obtained.
步骤S53:在识别所述按键输入为指示选择器选择多个网页控件中第一播控控件的指令时,执行与所述第一播控控件对应的第一操作;所述第一播控控件用于指示控制网页视频播控;Step S53: When recognizing that the key input is an instruction to instruct the selector to select the first broadcast control control among a plurality of web page controls, perform a first operation corresponding to the first broadcast control control; the first broadcast control control Used to indicate and control web video broadcast control;
步骤S54:在识别所述按键输入为指示执行第一操作时,若确定所述网页页面中包含网页视频,则执行用于控制网页视频播控的第一操作。Step S54: When it is recognized that the key input is an instruction to perform the first operation, if it is determined that the web page contains a web page video, perform the first operation for controlling the web page video broadcast control.
沿用上述实施例,如图2B所示,显示设备响应于该按键输入的控制当前视频暂停播放的指令,直接控制当前视频暂停播放,不需要将虚拟鼠标移动到暂停图标上,更不需要用户做出下一步的点击操作,就能够实现暂停操作。暂停播放当前视频的同时,在当前视频画面上叠加显示暂停播放指示图标。Following the above-mentioned embodiment, as shown in Fig. 2B, the display device directly controls the current video to be paused in response to the command input by the button to control the pause of the current video, without the need to move the virtual mouse to the pause icon, and the user does not need to do it. After the next click operation, the pause operation can be realized. When the current video is paused, a pause instruction icon will be superimposed on the current video screen.
结合图4B的方法来说,所述方法包括以下步骤:With reference to the method in FIG. 4B, the method includes the following steps:
S61:在显示器上显示网页页面,所述网页页面中包含多个网页控件;S61: Display a web page on the display, where the web page includes multiple web controls;
S62:接收用户通过按压控制装置上的按键输入;例如如图1E所示,被配置为控制显示设备200的控制装置100中实施为一个遥控器,其包括用于选择播放控制功能的暂停按键、开始按键、快进按键、快退按键等。例如,在图2A中,当用户按压控制装置上的暂停按键,获取用户通过按压控制装置上的暂停按键,输入的与暂停按键相对 应的视频暂停播放的指令。S62: Receive user input by pressing keys on the control device; for example, as shown in FIG. Start button, fast forward button, fast reverse button, etc. For example, in Fig. 2A, when the user presses the pause button on the control device, the command to pause the video playback corresponding to the pause button input by the user by pressing the pause button on the control device is obtained.
S63:识别所述按键输入对应的指令;S63: Identify the instruction corresponding to the key input;
S64:在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作。S64: When it is recognized that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video, and the current state of the web page video is determined, execute the control for controlling the web page video broadcast and the Target operations with different current states.
例如,如图3B所示的视频播放控制方法实现逻辑原理示意图。按键接收模块获取用户通过按压控制装置上的play pause按键,输入的与play pause按键相对应的视频播放暂停控制指令,并将该视频播放暂停控制指令发送给命令分析模块。命令分析模块分析该视频暂停控制指令,转化为play pause消息。并且将play pause消息发送给浏览器消息处理模块,最后回调给Player Controller模块。具体的,通过浏览器接收消息接口,将play pause消息发送至浏览器内核。Player Controller模块通过浏览器内核的回调接口获取play pause消息。Player Controller模块根据play pause消息控制当前网页中的视频元素的播放。For example, as shown in FIG. 3B, the schematic diagram of the logic principle of the video playback control method is realized. The button receiving module obtains the video playback pause control instruction corresponding to the play pause button input by the user by pressing the play pause button on the control device, and sends the video playback pause control instruction to the command analysis module. The command analysis module analyzes the video pause control instruction and converts it into a play pause message. And send the play pause message to the browser message processing module, and finally call back to the Player Controller module. Specifically, the play pause message is sent to the browser kernel through the browser receiving message interface. The Player Controller module obtains the play pause message through the callback interface of the browser kernel. The Player Controller module controls the playback of the video elements in the current webpage according to the play pause message.
这里,控制装置是将播放暂停功能设置在同一个按键上,Player Controller模块获取到的是一个play pause消息。需要根据当前网页中的视频元素的状态,对该play pause消息进行分析,再对视频元素做出对应的播控操作。如果当前网页中的视频元素处于正在播放状态,Player Controller模块根据该play pause消息控制当前网页中的视频元素暂停播放。如果当前网页中的视频元素处于暂停播放状态,则Player Controller模块根据play pause消息控制当前网页中的视频元素播放。Here, the control device sets the play pause function on the same button, and what the Player Controller module obtains is a play pause message. It is necessary to analyze the play pause message according to the state of the video element in the current webpage, and then perform the corresponding broadcast control operation on the video element. If the video element in the current webpage is in the playing state, the Player Controller module controls the video element in the current webpage to pause playing according to the play pause message. If the video element in the current webpage is in the paused playback state, the Player Controller module controls the playback of the video element in the current webpage according to the play pause message.
在一些实施例中,如果在识别所述按键输入为指示执行快进操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的为播放状态,则可以根据快进指令控制网页视频快进。如果在识别所述按键输入为指示执行后退操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的为播放状态,则可以根据快进指令控制网页视频后退。In some embodiments, if the key input is recognized as an instruction to perform a fast forward operation, if it is determined that the web page contains a web page video, and if it is determined that the web page video is in a playing state, the control can be controlled according to the fast forward instruction Fast forward web video. If it is recognized that the key input is an instruction to perform a rewind operation, if it is determined that the web page contains a web video, and it is determined that the web video is in a playing state, the web video can be controlled to rewind according to the fast forward instruction.
在显示设备中,会预置一些内置应用,内置应用不依赖于网络,在设备未连接网络的情况下,用户也能打开应用并查看应用内的相关信息和资源。在一些应用场景中,智能电视一般内置有电子说明书(E-manual)应用,即操作指南,会在E-manual应用中预置有一些提示和引导用户操作的图形用户界面,通过浏览器加载HTML页面数据或PDF格式文件等形式进行操作指南内容的显示。本申请主要针对显示设备显示操作指南时存在的问题,给出相应的解决方案。In the display device, some built-in applications are preset, and the built-in applications do not depend on the network. When the device is not connected to the network, the user can open the application and view related information and resources in the application. In some application scenarios, smart TVs generally have built-in electronic manual (E-manual) applications, that is, operation guides, and some graphical user interfaces that prompt and guide users to operate are preset in the E-manual application, and HTML is loaded through the browser The contents of the operation guide are displayed in the form of page data or PDF format files. This application mainly aims at the problems existing when the display device displays the operation guide, and provides corresponding solutions.
点击E-manual的应用图标,或者通过设置(Settings)入口,打开E-manual应用,图5中示例性示出打开操作指南时显示的主页面,主页面可包括“实时电视”(LiveTV)、“连接”(Connection)、“多屏”(Multi_screen)、“智慧功能”(Smart Functions)、“影像和音效”(Picture and Sound)、“系统和支援”(Accessibility and System)、“解决疑难”(Troubleshooting)和“使用电子说明书”(Using the E-manual)等子页面的选项,在显示设备未连接网络时,E-manual应用的各个页面(包括主页面和各子页面)不显示二维码,即未连网时用户仅看到操作指南预置的信息资源,是预先存储在显示设备中操作指南固有的信息资源,这些信息资源是不可改变和更新的。Click on the E-manual application icon, or open the E-manual application through the Settings portal. Figure 5 exemplarily shows the main page displayed when the operation guide is opened. The main page may include "LiveTV" (LiveTV), "Connection", "Multi_screen", "Smart Functions", "Picture and Sound", "Accessibility and System", "Solving Problems" (Troubleshooting) and "Using the E-manual" (Using the E-manual) and other sub-page options, when the display device is not connected to the network, each page of the E-manual application (including the main page and each sub-page) does not display two-dimensional Code, that is, when the user is not connected to the Internet, the user only sees the information resources preset in the operation guide, which are inherent information resources of the operation guide pre-stored in the display device, and these information resources cannot be changed and updated.
打开操作指南时,检测显示设备的连网状态,如果检测到连网状态为网络已连接,则向服务器发送与操作指南对应的URL请求,服务器根据URL请求,获取该显示设备的操作指南的最新内容,并下发对应的二维码的URL;显示设备接收URL后生成二维码,如 图6所示,操作指南需要在有网络下刷新E-manual应用的页面。When the operation guide is opened, the connection status of the display device is detected. If the connection status is detected as the network is connected, the URL request corresponding to the operation guide is sent to the server, and the server obtains the latest operation guide of the display device according to the URL request Content, and send the corresponding QR code URL; the display device generates the QR code after receiving the URL, as shown in Figure 6, the operation guide needs to refresh the page of the E-manual application under the network.
刷新后的页面会显示生成的二维码,为了避免因二维码遮挡页面而影响用户浏览,可以在页面的指定位置处显示二维码的缩略图,参照图7显示的页面,指定位置是在页面的右上角,在页面右上角显示了二维码缩小一定倍数后的缩略图,该二维码的缩略图可以看成是二维码标识以及向终端设备推送操作指南的入口,用户看到二维码标识即可获知可以通过终端设备扫描该二维码,在终端设备中查看最新的操作指南内容,这时终端设备显示的操作指南是包括主页面和子页面的全内容。本申请中所述的终端设备可以是智能手机、平板以及其他具有二维码扫描功能的电子设备,终端设备可以支持IOS和安卓等类型系统。The refreshed page will display the generated QR code. In order to avoid affecting the user’s browsing due to the QR code occluding the page, a thumbnail of the QR code can be displayed at the specified location of the page. Refer to the page shown in Figure 7, the specified location is In the upper right corner of the page, the thumbnail of the QR code reduced by a certain multiple is displayed in the upper right corner of the page. The thumbnail of the QR code can be regarded as the QR code identification and the entrance to push the operation guide to the terminal device. Go to the two-dimensional code identification to know that the two-dimensional code can be scanned by the terminal device to view the latest operation guide content in the terminal device. At this time, the operation guide displayed by the terminal device includes the full content of the main page and sub-pages. The terminal device described in this application may be a smart phone, a tablet, or other electronic devices with a QR code scanning function, and the terminal device may support systems such as IOS and Android.
二维码缩略图不仅可以在操作指南的主页面进行显示,在用户点击进入每个子页面后,子页面也同样要在指定位置处显示该二维码的缩略图,这样用户在打开操作指南的任意一个页面都能随时扫描二维码。如图8所示,以其中“实时电视”为例,在主页面点击“实时电视”选项,进入“实时电视”子页面,实时电视”子页面的左侧显示有频道搜索、频道编辑、频道列表等选项,在子页面的左侧点击任一选项后,子页面左侧都会显示相应的信息资源,这些信息资源可以文字、图像、表格、列表等形式展示给用户,子页面中右上角显示二维码的缩略图。需要说明的是,本实施例中二维码标识是以缩略图的形式比较形式直观地呈现,当然在实际应用中二维码标识可以是其他形式,比如文字显示的“扫描二维码”,本申请实施例不作限定。The thumbnail of the QR code can not only be displayed on the main page of the operation guide. After the user clicks to enter each sub-page, the sub-page must also display the thumbnail of the QR code at the specified location, so that the user opens the operation guide Any page can scan the QR code at any time. As shown in Figure 8, taking "Real-time TV" as an example, click the "Real-time TV" option on the main page to enter the "Real-time TV" sub-page. The left side of the "Real-time TV" sub-page displays channel search, channel editing, and channel List and other options. After clicking any option on the left side of the sub-page, the corresponding information resources will be displayed on the left side of the sub-page. These information resources can be displayed to users in the form of text, images, tables, lists, etc., displayed in the upper right corner of the sub-page The thumbnail of the QR code. It should be noted that the QR code logo in this embodiment is visually presented in the form of a thumbnail. Of course, in actual applications, the QR code logo can be in other forms, such as text display. "Scan the QR code" is not limited in the embodiment of this application.
用户在看到二维码的缩略图/标识后,可以通过遥控器或触控等方式点击二维码的缩略图/标识,如图9所示,二维码的缩略图被点击后,会在当前页面的上层显示二维码的放大图,二维码的放大图下方可以配置有引导用户操作的提示信息,比如图9中提示信息为“请使用您的终端扫描该二维码,即可在终端显示操作指南”,该提示信息可以根据实际应用适应性设置。用户使用终端设备中的二维码扫描功能,比如利用微信等应用程序的“扫一扫”来扫描二维码,参照图10,将扫描区域对准二维码,则终端设备即可自动扫描并识别该二维码,然后在终端设备的内容区域中显示被推送的操作指南的最新内容(即online操作指南);如果拍摄环境光线较暗,则可点击“轻触照亮”,即可开启闪光灯,提高光照以保证二维码能够被识别。如图11所示。需要说明的是,操作指南在终端中的显示形式不做限定,操作指南的页面设置、布局和资源显示等内容应以实际应用为准。After seeing the thumbnail/logo of the QR code, the user can click the thumbnail/logo of the QR code by remote control or touch control, as shown in Figure 9, after the thumbnail of the QR code is clicked, it will An enlarged view of the QR code is displayed on the upper level of the current page. Below the enlarged view of the QR code can be configured prompt information to guide the user to operate. For example, the prompt message in Figure 9 is "Please use your terminal to scan the QR code, that is The operation guide can be displayed on the terminal, and the prompt information can be adaptively set according to the actual application. The user uses the QR code scanning function in the terminal device, such as using the "scan" of the WeChat and other applications to scan the QR code. Refer to Figure 10, and the scanning area is aligned with the QR code, and the terminal device can automatically scan And recognize the QR code, and then display the latest content of the pushed operation guide (that is, the online operation guide) in the content area of the terminal device; if the shooting environment is dark, you can click "Tap to illuminate". Turn on the flash and increase the illumination to ensure that the QR code can be recognized. As shown in Figure 11. It should be noted that the display form of the operation guide in the terminal is not limited, and the page settings, layout, and resource display of the operation guide should be subject to the actual application.
当用户成功扫描二维码后,为了使二维码的放大图不再遮盖应用页面,就需要将二维码的放大图隐藏,使二维码重新以缩略图的形式显示,这时用户可以点击二维码的放大图,使二维码的放大图隐藏,这种方式主要是基于用户手动操作;或者,终端设备在响应于二维码成功扫描后,自动生成已扫描指示信息,并将已扫描指示信息发送给显示设备端,显示设备接收到已扫描指示信息后即可控制隐藏二维码的放大图,则重新恢复操作指南正常的页面显示,这种形式就无需用户手动隐藏二维码的放大图。需要说明的是,隐藏二维码放大图的方式不限于本实施例所述,在实际应用中还可采用其他形式,比如手势控制、其他指定操作形式等。After the user successfully scans the QR code, in order to make the enlarged image of the QR code no longer cover the application page, it is necessary to hide the enlarged image of the QR code so that the QR code is displayed as a thumbnail again. At this time, the user can Click the enlarged image of the QR code to hide the enlarged image of the QR code. This method is mainly based on the user’s manual operation; or the terminal device automatically generates the scanned instruction information in response to the successful scanning of the QR code, and The scanned instruction information is sent to the display device. After the display device receives the scanned instruction information, it can control to hide the enlarged view of the QR code, and then resume the normal page display of the operation guide. This form eliminates the need for the user to manually hide the QR code. Enlarged view of the code. It should be noted that the manner of hiding the enlarged view of the two-dimensional code is not limited to that described in this embodiment, and other forms, such as gesture control, other designated operation forms, etc., may also be adopted in practical applications.
图12示出一种操作指南显示方法的实施例,关键在于通过显示设备在操作指南对应的图形用户界面显示二维码,终端扫描二维码的形式,将最新的操作指南的信息资源推送给终端,该方法是显示设备的控制器250被配置执行的,即控制器250为方法的执行主体,该方法包括如下程序步骤:Figure 12 shows an embodiment of an operation guide display method. The key is to display a two-dimensional code on a graphical user interface corresponding to the operation guide through a display device, and the terminal scans the two-dimensional code to push the information resources of the latest operation guide to Terminal, the method is configured to be executed by the controller 250 of the display device, that is, the controller 250 is the execution subject of the method, and the method includes the following program steps:
步骤S101,响应于第一输入指令,显示用于引导用户使用显示设备功能的操作指南对 应的图形用户界面。Step S101: In response to the first input instruction, display a graphical user interface corresponding to the operation guide for guiding the user to use the function of the display device.
步骤S102,检测显示设备的连网状态。Step S102: Detect the network connection status of the display device.
所述第一输入指令为用户启动操作指南功能时输入的操作指令,比如当用户通过遥控器等控制装置100点击操作指南的应用图标时,显示设备的用户接口265即可接收到所述第一输入指令;或者,对于支持屏幕触控的显示设备,用户对触控操作指南的应用图标时生成所述第一输入指令。操作指南预置的页面和信息资源等内容预先存储在显示设备的存储器中,以方便随时调用和显示,以及实现在显示设备未连网时加载显示操作指南。The first input instruction is an operation instruction input when the user starts the operation guide function. For example, when the user clicks the application icon of the operation guide through the control device 100 such as a remote control, the user interface 265 of the display device can receive the first operation instruction. Input instruction; or, for a display device that supports screen touch, the user generates the first input instruction when touching the application icon of the operation guide. The preset pages and information resources of the operation guide are pre-stored in the memory of the display device for easy recall and display at any time, and the operation guide can be loaded and displayed when the display device is not connected to the network.
每次用户操作指南应用时,需要在显示器上先显示操作指南对应的用户图形界面,所述图形用户界面可以是操作指南的主页面或者根据用户操作进入的子页面,显示设备接收到第一输入指令时,同时还需要检测显示设备的连网状态,连网状态包括网络已连接和网络未连接,步骤S101和步骤S102可同时执行。可以通过常规方式直接检测设备整机的网络状态;或者使用HTTP(Hyper Text Transfer Protocol,超文本传输协议)请求轻量级页面的方式检测连网状态。其中,使用HTTP请求轻量级页面的方式检测连网状态,具体为:控制浏览器访问轻量级页面;当所述轻量级页面访问正常,即能够正常显示轻量级页面的资源和信息,则检测到连网状态为网络已连接;当所述轻量级页面显示访问出错或无网络连接的提示信息,即轻量级页面异常显示,则检测到连网状态为网络未连接,轻量级页面访问速度快,因而可以提高连网状态的检测效率,轻量级页面比如是百度页面等。Every time a user operates the guide application, the user graphical interface corresponding to the operation guide needs to be first displayed on the display. The graphical user interface may be the main page of the operation guide or a sub-page entered according to the user operation. The display device receives the first input When instructing, it is also necessary to detect the network connection status of the display device. The network connection status includes the network connected and the network disconnected, and step S101 and step S102 can be executed at the same time. You can directly detect the network status of the entire device in a conventional way; or use HTTP (Hyper Text Transfer Protocol) to request a lightweight page to detect the network status. Among them, the method of using HTTP to request a lightweight page to detect the connection status is specifically: controlling the browser to access the lightweight page; when the lightweight page is accessed normally, the resources and information of the lightweight page can be displayed normally , It is detected that the network status is network connected; when the lightweight page displays an access error or no network connection prompt, that is, the lightweight page displays abnormally, the network status is detected as network disconnected, light The access speed of the weight page is fast, which can improve the detection efficiency of the connection status, such as the Baidu page.
步骤S103,判断连网状态是否为网络已连接。如果是,即检测到所述连网状态为网络已连接时,执行步骤S104;反之,如果检测到所述连网状态为网络未连接,则执行步骤S107。In step S103, it is judged whether the network connection status is that the network is connected. If it is, that is, when it is detected that the network connection state is that the network is connected, step S104 is executed; otherwise, if it is detected that the network connection state is that the network is not connected, step S107 is executed.
步骤S104,向服务器发送所述服务器中的操作指南对应的URL请求。Step S104: Send a URL request corresponding to the operation guide in the server to the server.
当检测到显示设备已连接网络时,操作指南会根据国家、语言、设备品牌等信息先加载显示操作指南在本机的信息资源,即在操作指南启动后并且二维码未获取前,显示器显示操作指南预置的页面。同时,通过Https网络向服务器发送二维码与操作指南对应的URL请求,URL请求会携带有显示设备的品牌、机型和设备自身的属性信息,以及携带国家、语言等信息;服务器响应URL请求,会获取适配显示设备并且最新的操作指南内容,并根据获取到的最新的操作指南内容,为显示设备下发对应的二维码的URL(Uniform Resource Locator,统一资源定位符)。When it is detected that the display device is connected to the network, the operation guide will first load the information resources of the display operation guide on the machine according to the country, language, device brand and other information, that is, after the operation guide is started and the QR code is not obtained, the display will display Preset page of operation guide. At the same time, the URL request corresponding to the QR code and the operation guide is sent to the server through the Https network. The URL request will carry the brand, model of the display device and the attribute information of the device itself, as well as the country, language and other information; the server responds to the URL request , The latest operation guide content adapted to the display device will be obtained, and the URL (Uniform Resource Locator, uniform resource locator) corresponding to the QR code will be issued to the display device according to the obtained latest operation guide content.
步骤S105,接收所述服务器下发的URL,并根据所述URL生成二维码。Step S105: Receive the URL issued by the server, and generate a QR code according to the URL.
当接收到二维码的URL时,根据URL生成操作指南对应的二维码,在获取到二维码图像后,即可刷新操作指南的页面。When the URL of the two-dimensional code is received, the two-dimensional code corresponding to the operation guide is generated according to the URL. After the image of the two-dimensional code is obtained, the page of the operation guide can be refreshed.
步骤S106,控制显示器在所述操作指南对应的图形用户界面上显示所述二维码,以供用户使用终端设备扫描所述二维码而查看所述操作指南。Step S106: Control the display to display the two-dimensional code on a graphical user interface corresponding to the operation guide, so that the user can scan the two-dimensional code with a terminal device to view the operation guide.
在页面刷新之后,其指定位置处会显示二维码的缩略图,并且操作指南的其他页面也需要在指定位置同步添加二维码的缩略图,比如,操作指南的当前页面为主页面,那么就需要在主页面的右上角添加显示二维码的缩略图,同时在主页面下的各个子页面的右上角同步添加二维码的缩略图,这样当用户点击进入任一个子页面时都会在右上角看到显示的二维码缩略图,使用户在操作指南的任一页面都能扫描二维码,扫描完成后,终端设备中即刻显示被推送的操作指南的信息资源。After the page is refreshed, a thumbnail of the QR code will be displayed at its designated location, and other pages of the operation guide need to be synchronized to add the thumbnail of the QR code at the designated location. For example, if the current page of the operation guide is the main page, then You need to add a thumbnail of the QR code in the upper right corner of the main page, and simultaneously add the thumbnail of the QR code in the upper right corner of each sub-page under the main page, so that when the user clicks to enter any sub-page, it will be You can see the QR code thumbnail displayed in the upper right corner, so that the user can scan the QR code on any page of the operation guide. After scanning, the terminal device will immediately display the information resources of the pushed operation guide.
本实施例中,当用户启动操作指南时,检测显示设备的连网状态,如果检测到网络已 连接,向服务器发送URL请求,然后根据服务器下发的二维码的URL显示生成的二维码,终端设备扫描二维码后,即可在终端设备上显示被推送的操作指南中包括的信息资源。服务器端可以根据操作指南最新的内容,下发对应的二维码的URL,只要显示设备连接网络,即可通过二维码将操作指南内容同步更新并推送至终端设备,这样即可在终端设备扫描二维码后显示最新的操作指南内容。显示设备端显示操作指南预置时的原始内容,通过网络自适应向操作指南增显二维码,用户可以参照终端设备显示的操作指南的引导,同时对显示设备进行操作和设置,实现显示设备向终端的资源推送,提升了操作指南的体验功能,以及提升了显示设备与终端的交互,用户实际应用体验更好。In this embodiment, when the user starts the operation guide, the connection status of the display device is detected. If it is detected that the network is connected, a URL request is sent to the server, and then the generated QR code is displayed according to the URL of the QR code issued by the server , After the terminal device scans the QR code, the information resources included in the pushed operation guide can be displayed on the terminal device. The server can issue the URL of the corresponding QR code according to the latest content of the operation guide. As long as the display device is connected to the network, the content of the operation guide can be updated synchronously through the QR code and pushed to the terminal device. After scanning the QR code, the latest operation guide content will be displayed. The display device side displays the original content of the operation guide when it is preset, and the two-dimensional code is added to the operation guide adaptively through the network. The user can refer to the guidance of the operation guide displayed on the terminal device, and operate and set the display device at the same time to realize the display device Pushing to the resources of the terminal improves the experience function of the operation guide, and improves the interaction between the display device and the terminal, and the actual application experience of the user is better.
用户浏览操作指南的页面时,可以看到页面指定位置处显示的二维码的缩略图,这时用户可以输入第二输入指令,所述第二输入指令为用户放大二维码时输入的操作指令,比如用户可以通过遥控器或触控等方式点击二维码的缩略图,二维码的缩略图被点击后,会在当前页面的上层显示二维码的放大图,二维码的放大图下方可以配置有引导用户操作的提示信息。二维码的放大图是相对缩略图而言的,放大图可以是生成二维码URL后获取的原始二维码图像,或者是对缩略图适当放大一定的倍数,但既要保证图像的清晰度,以保证二维码识别的准确性,也要保证放大图的尺寸适中,不至于过大或过小。When the user browses the page of the operation guide, he can see the thumbnail of the QR code displayed at the specified location of the page. At this time, the user can input the second input instruction, which is the operation input when the user enlarges the QR code Instructions, for example, the user can click the thumbnail of the QR code by remote control or touch control, etc. After the thumbnail of the QR code is clicked, the enlarged view of the QR code will be displayed on the upper layer of the current page, and the enlargement of the QR code will be displayed. Below the figure can be configured with prompt information to guide the user's operation. The enlarged image of the QR code is relative to the thumbnail. The enlarged image can be the original QR code image obtained after the QR code URL is generated, or the thumbnail is appropriately enlarged by a certain multiple, but the image must be clear In order to ensure the accuracy of QR code recognition, it is also necessary to ensure that the size of the enlarged image is moderate and not too large or too small.
当用户成功扫描二维码后,为了使二维码的放大图不再遮盖页面,就需要将二维码的放大图隐藏,即令二维码重新恢复以缩略图的形式显示,方便用户查看页面的主体内容,这时用户可以输入第三输入指令,所述第三输入指令为用户隐藏二维码放大图时输入的操作指令,比如用户可以通过遥控器或触控等方式点击二维码的放大图,使二维码的放大图隐藏,这种方式主要是基于用户手动操作;或者,终端设备在响应于二维码成功扫描后,自动生成已扫描指示信息,并将已扫描指示信息发送给显示设备端,显示设备接收到已扫描指示信息后即可控制隐藏二维码的放大图,则重新恢复操作指南正常的页面显示,这种形式就无需用户手动隐藏二维码的放大图。需要说明的是,隐藏二维码放大图的方式不限于本实施例所述,在实际应用中还可采用其他形式,比如手势控制、其他指定操作形式等。其中,二维码的放大图的显示和隐藏效果不限定,比如采用弹出、滑出或者逐渐放大的形式显示二维码的放大图,采用逐渐缩小、溶解、虚化等效果隐藏二维码的放大图。After the user successfully scans the QR code, in order to make the enlarged image of the QR code no longer cover the page, the enlarged image of the QR code needs to be hidden, that is, the QR code is restored to be displayed as a thumbnail, which is convenient for the user to view the page At this time, the user can input the third input instruction, which is the operation instruction input when the user hides the enlarged view of the QR code. For example, the user can click on the QR code by remote control or touch control. Enlarge the image to hide the enlarged image of the QR code. This method is mainly based on the user's manual operation; or the terminal device automatically generates the scanned instruction information in response to the successful scanning of the QR code, and sends the scanned instruction information For the display device side, after the display device receives the scanned instruction information, it can control to hide the enlarged view of the QR code, and then resume the normal page display of the operation guide. This form eliminates the need for the user to manually hide the enlarged view of the QR code. It should be noted that the manner of hiding the enlarged view of the two-dimensional code is not limited to that described in this embodiment, and other forms, such as gesture control, other designated operation forms, etc., may also be adopted in practical applications. Among them, the display and hiding effects of the enlarged image of the QR code are not limited. For example, the enlarged image of the QR code is displayed in the form of pop-up, slide-out or gradually enlarged, and the effect of gradually shrinking, dissolving, blurring, etc. is used to hide the QR code. Zoom in.
步骤S107,所述操作指南对应的图形用户界面上不显示二维码。Step S107, the two-dimensional code is not displayed on the graphical user interface corresponding to the operation guide.
当显示设备未连接网络时,操作指南应用会继续显示根据国家、语言、设备品牌等信息加载的预置在本机的信息资源,即显示的是操作指南预置的页面操作指南预置的主页面和各子页面不显示二维码。当网络处于已连接状态时,按照上述步骤S104~步骤S106,在操作指南预置的页面的基础上,在指定位置添加显示二维码的缩略图。When the display device is not connected to the network, the operation guide application will continue to display the information resources preset on the machine loaded according to the country, language, device brand and other information, that is, it will display the page preset in the operation guide. The home page preset in the operation guide The QR code is not displayed on the face and each sub-page. When the network is in a connected state, in accordance with the above steps S104 to S106, on the basis of the page preset in the operation guide, a thumbnail showing the QR code is added at the specified location.
在实际应用中,显示设备的连网状态可能发生改变,比如用户启动操作指南时,显示设备处于未连接网络,但在浏览操作指南的过程中设备连网,即连网状态由网络未连接切换为网络已连接,那么就需要按照上述步骤在刷新后的页面中显示二维码的缩略图;如果连网状态由网络已连接变为网络未连接,由于二维码扫描是取决于终端设备的网络(比如4G、5G或WIFI等)而不是显示设备的网络,因此显示设备端可以维持显示断网前一时刻显示的二维码缩略图。因此本申请中的网络状态不使用一次性获取的方式,而是根据网络状态的变化自适应调节二维码的显示。In practical applications, the connection status of the display device may change. For example, when the user starts the operation guide, the display device is not connected to the network, but the device is connected to the network during the operation guide, that is, the connection status is switched from the network disconnected. If the network is connected, then you need to follow the above steps to display the thumbnail of the QR code on the refreshed page; if the network status changes from network connected to network disconnected, because the QR code scanning depends on the terminal device The network (such as 4G, 5G or WIFI, etc.) is not the network of the display device, so the display device can maintain the display of the QR code thumbnail displayed at the moment before the network is disconnected. Therefore, the network status in this application does not use a one-time acquisition method, but adaptively adjusts the display of the QR code according to changes in the network status.
对此,本实施例中可以采用实时监听网络状态变化的方式,一旦监听到网络状态变化的广播信息,则需要根据新获取的连网状态对显示器显示的页面进行更新;或者,采用定 时监听网络状态的方式,每间隔预设时间获取一次显示设备的连网状态,预设时间可以根据实际网络环境和应用需求等因素适应性设置,比如是60秒。In this regard, in this embodiment, the method of real-time monitoring of network status changes can be adopted. Once the broadcast information of network status changes is monitored, the page displayed on the display needs to be updated according to the newly acquired network status; or, the network monitoring network periodically is used. In the state method, the network connection state of the display device is obtained every preset time. The preset time can be adaptively set according to factors such as the actual network environment and application requirements, for example, 60 seconds.
在其他可能的实现方式中,在显示设备在运行操作指南应用的过程中,并且这期间显示设备一直处于网络已连接状态,可以及时在线更新二维码,比如服务器端检测到某显示设备的操作指南存在内容更新,则可以根据更新后的内容,生成适配该显示设备的操作指南的新的二维码的URL,并将新的二维码的URL下发给显示设备,显示设备根据新的二维码的URL,刷新页面,从而对显示的二维码缩略图进行更新,二维码更新后可以对用户进行提示,如图13所示,比如在页面上滚动或弹出提示信息,该提示信息是“二维码已更新,您可扫描新的二维码查看最新的操作指南”,该提示信息可以根据实际应用适应性设置。需要说明的是,二维码的显示和更新方式可以根据实际应用灵活设置,不局限于本实施例所述。In other possible implementations, when the display device is running the operation guide application, and the display device is always connected to the network during this period, the QR code can be updated online in time, for example, the server detects the operation of a display device If the content of the guide is updated, the URL of a new QR code adapted to the operation guide of the display device can be generated based on the updated content, and the URL of the new QR code can be issued to the display device. The URL of the QR code is refreshed to refresh the page to update the displayed QR code thumbnail. After the QR code is updated, the user can be prompted, as shown in Figure 13, such as scrolling on the page or popping up a prompt message. The prompt message is "The QR code has been updated, you can scan the new QR code to view the latest operation guide", the prompt message can be adapted according to the actual application. It should be noted that the display and update mode of the two-dimensional code can be flexibly set according to actual applications, and is not limited to that described in this embodiment.
本领域的技术人员可以清楚地了解到本申请实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。具体实现中,本申请还提供一种计算机存储介质,其中,该计算机存储介质可存储有引导用户使用显示设备功能的操作指南,以及还可存储有程序,当计算机存储介质位于显示设备中时,该程序执行时可包括控制器250被配置执行的操作指南显示方法的程序步骤。其中,计算机存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be implemented by means of software plus a necessary general hardware platform. In specific implementation, this application also provides a computer storage medium, where the computer storage medium can store an operation guide that guides users to use the functions of the display device, and can also store a program. When the computer storage medium is located in the display device, The program execution may include the program steps of the operation guide display method that the controller 250 is configured to execute. Among them, the computer storage medium may be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM), etc.
尽管已描述了本申请的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。Although the preferred embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.
显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包括这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application is also intended to include these modifications and variations.

Claims (12)

  1. 一种显示方法,其特征在于,所述方法包括:A display method, characterized in that the method includes:
    在显示器上显示网页页面,所述网页页面中包含多个网页控件;Displaying a web page on the display, the web page including a plurality of web controls;
    接收用户通过按压控制装置上的按键输入;Receive user input by pressing a button on the control device;
    在识别所述按键输入为指示选择器选择多个网页控件中第一播控控件的指令时,执行与所述第一播控控件对应的第一操作;所述第一播控控件用于指示控制网页视频播控;When it is recognized that the key input is an instruction for the selector to select the first broadcast control control among a plurality of web page controls, a first operation corresponding to the first broadcast control control is performed; the first broadcast control control is used for instructing Control web video broadcast control;
    在识别所述按键输入为指示执行第一操作时,若确定所述网页页面中包含网页视频,则执行用于控制网页视频播控的第一操作。When it is recognized that the key input is an instruction to perform the first operation, if it is determined that the web page contains a web page video, the first operation for controlling the web page video playback is performed.
  2. 根据权利要求1所述的方法,其特征在于,所述控制装置上的按键包括:播放暂停按键、停止按键、后退按键以及快进按键中的至少一个;所述第一操作包括:播放操作、暂停操作、停止操作、后退操作以及快进操作中的至少一种。The method according to claim 1, wherein the buttons on the control device include at least one of a play pause button, a stop button, a rewind button, and a fast forward button; the first operation includes: a play operation, At least one of a pause operation, a stop operation, a rewind operation, and a fast forward operation.
  3. 根据权利要求1所述的方法,其特征在于,若确定所述网页页面中包含网页视频,具体包括:若确定所述网页页面中包含非隐藏状态的网页视频。The method according to claim 1, wherein if it is determined that the web page contains a web video, it specifically comprises: if it is determined that the web page contains a web video in a non-hidden state.
  4. 一种显示方法,其特征在于,所述方法包括:A display method, characterized in that the method includes:
    在显示器上显示网页页面,所述网页页面中包含多个网页控件;Displaying a web page on the display, the web page including a plurality of web controls;
    接收用户通过按压控制装置上的按键输入;Receive user input by pressing a button on the control device;
    识别所述按键输入对应的指令;Identifying the instruction corresponding to the key input;
    在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作。When it is recognized that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video and the current state of the web page video is determined, then a control for controlling the web page video broadcast and the current state is executed. Different target operations.
  5. 根据权利要求4所述的方法,其特征在于,在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作,具体包括:在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及所述网页视频未处于播放状态,则执行播放网页视频的操作。The method according to claim 4, wherein when the key input is recognized as an instruction to perform an operation, if it is determined that the web page contains a web video, and the current state of the web video is determined, the execution A target operation that is different from the current state for controlling webpage video playback includes: when recognizing that the key input is an instruction to perform an operation, if it is determined that the webpage page contains a webpage video, and the webpage video If it is not in the playing state, perform the operation of playing the webpage video.
  6. 根据权利要求4所述的方法,其特征在于,在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作,具体包括:在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及所述网页视频处于播放状态,则执行暂停播放网页视频的操作或者执行后退网页视频的操作中或者执行快进网页视频的操作。The method according to claim 4, wherein when the key input is recognized as an instruction to perform an operation, if it is determined that the web page contains a web video, and the current state of the web video is determined, the execution A target operation that is different from the current state for controlling webpage video playback includes: when recognizing that the key input is an instruction to perform an operation, if it is determined that the webpage page contains a webpage video, and the webpage video In the playing state, the operation of pausing the playing of the webpage video or the operation of rewinding the webpage video or the operation of fast-forwarding the webpage video is executed.
  7. 一种显示设备,其特征在于,包括:A display device, characterized in that it comprises:
    显示器,用户显示网页页面;所述网页页面中包含多个网页控件;A display, the user displays a web page; the web page includes a plurality of web controls;
    控制器,用于执行:Controller, used to execute:
    接收用户通过按压控制装置上的按键输入;在识别所述按键输入为指示选择器选择多个网页控件中第一播控控件的指令时,执行与所述第一播控控件对应的第一操作;所述第一播控控件用于指示控制网页视频播控;Receive user input by pressing a button on the control device; when recognizing that the button input is an instruction to instruct the selector to select the first broadcast control control among a plurality of web controls, perform a first operation corresponding to the first broadcast control control ; The first broadcast control control is used to instruct to control the web video broadcast control;
    在识别所述按键输入为指示执行第一操作时,若确定所述网页页面中包含网页视频,则执行用于控制网页视频播控的第一操作。When it is recognized that the key input is an instruction to perform the first operation, if it is determined that the web page contains a web page video, the first operation for controlling the web page video playback is performed.
  8. 根据权利要求7所述的显示设备,其特征在于,所述控制装置上的按键包括:播 放暂停按键、停止按键、后退按键以及快进按键中的至少一个;所述第一操作包括:播放操作、暂停操作、停止操作、后退操作以及快进操作中的至少一种。7. The display device according to claim 7, wherein the buttons on the control device include at least one of a play pause button, a stop button, a rewind button, and a fast forward button; the first operation includes: a play operation , At least one of pause operation, stop operation, rewind operation, and fast forward operation.
  9. 根据权利要求7所述的显示设备,其特征在于,若确定所述网页页面中包含网页视频,具体包括:若确定所述网页页面中包含非隐藏状态的网页视频。8. The display device according to claim 7, wherein if it is determined that the web page contains a web video, it specifically comprises: if it is determined that the web page contains a web video in a non-hidden state.
  10. 一种显示设备,其特征在于,包括:A display device, characterized in that it comprises:
    显示器,用于显示网页页面;所述网页页面中包含多个网页控件;A display for displaying a web page; the web page includes a plurality of web controls;
    按键接收模块,用于接收用户通过按压控制装置上的按键输入;The key receiving module is used to receive user input by pressing the keys on the control device;
    指令解析模块,用于识别所述按键输入对应的指令;An instruction parsing module, used to identify the instruction corresponding to the key input;
    播放控制模块,用于执行:The playback control module is used to execute:
    在指令解析模块识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作。When the instruction parsing module recognizes that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video and the current state of the web page video is determined, it executes the control for controlling the web page video broadcast and the Describe target operations with different current states.
  11. 根据权利要求10所述的显示设备,其特征在于,所述播放控制模块,用于执行:The display device according to claim 10, wherein the playback control module is configured to execute:
    在指令解析模块识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作,具体包括:在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及所述网页视频未处于播放状态,则执行播放网页视频的操作。When the instruction analysis module recognizes that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video and the current state of the web page video is determined, it executes the control for controlling the web page video broadcast and the The target operations with different current states specifically include: when the key input is recognized as an instruction to perform an operation, if it is determined that the web page contains a web page video, and the web page video is not in the playing state, then executing the web page video playback Operation.
  12. 根据权利要求10所述的显示设备,其特征在于,所述播放控制模块,用于执行:The display device according to claim 10, wherein the playback control module is configured to execute:
    在指令解析模块识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及确定所述网页视频的当前状态,则执行用于控制网页视频播控、且与所述当前状态不同的目标操作,具体包括:在识别所述按键输入为指示执行一操作时,若确定所述网页页面中包含网页视频,以及所述网页视频处于播放状态,则执行暂停播放网页视频的操作或者执行后退网页视频的操作中或者执行快进网页视频的操作。When the instruction analysis module recognizes that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video and the current state of the web page video is determined, it executes the control for controlling the web page video broadcast and the The target operations with different current states specifically include: when recognizing that the key input is an instruction to perform an operation, if it is determined that the web page contains a web page video, and the web page video is in a playing state, then executing a pause in playing the web page video The operation of either performing the operation of rewinding the webpage video or performing the operation of fast-forwarding the webpage video.
PCT/CN2021/081641 2020-04-30 2021-03-18 Display method and display device WO2021218477A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202010364189.8A CN111526401B (en) 2020-04-30 2020-04-30 Video playing control method and display equipment
CN202010364189.8 2020-04-30
CN202010490514.5A CN111601149B (en) 2020-06-02 2020-06-02 Operation guide display method and display equipment
CN202010490514.5 2020-06-02

Publications (1)

Publication Number Publication Date
WO2021218477A1 true WO2021218477A1 (en) 2021-11-04

Family

ID=78373291

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/081641 WO2021218477A1 (en) 2020-04-30 2021-03-18 Display method and display device

Country Status (1)

Country Link
WO (1) WO2021218477A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102271150A (en) * 2010-06-02 2011-12-07 索尼公司 Content output system, content output method, program, terminal device, and output device
KR20150071976A (en) * 2013-12-19 2015-06-29 주식회사 케이티스카이라이프 Apparatus and method for providing web virtual channels on tv devices
CN106200998A (en) * 2016-07-06 2016-12-07 北京小米移动软件有限公司 Control method for playing back and device
CN108632659A (en) * 2018-04-23 2018-10-09 聚好看科技股份有限公司 Control method for playing back and device
CN111526401A (en) * 2020-04-30 2020-08-11 青岛海信传媒网络技术有限公司 Video playing control method and display equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102271150A (en) * 2010-06-02 2011-12-07 索尼公司 Content output system, content output method, program, terminal device, and output device
KR20150071976A (en) * 2013-12-19 2015-06-29 주식회사 케이티스카이라이프 Apparatus and method for providing web virtual channels on tv devices
CN106200998A (en) * 2016-07-06 2016-12-07 北京小米移动软件有限公司 Control method for playing back and device
CN108632659A (en) * 2018-04-23 2018-10-09 聚好看科技股份有限公司 Control method for playing back and device
CN111526401A (en) * 2020-04-30 2020-08-11 青岛海信传媒网络技术有限公司 Video playing control method and display equipment

Similar Documents

Publication Publication Date Title
WO2021212668A1 (en) Screen projection display method and display device
WO2021203569A1 (en) Display device and user interface display method
CN111601149B (en) Operation guide display method and display equipment
CN111726673B (en) Channel switching method and display device
WO2021189712A1 (en) Method for switching webpage video from full-screen playing to small-window playing, and display device
CN111601142B (en) Subtitle display method and display equipment
CN111291238A (en) Display device and search display method
CN111639281A (en) Page resource display method and display equipment
WO2021232914A1 (en) Display method and display device
CN111526401B (en) Video playing control method and display equipment
CN111654729B (en) Account login state updating method and display device
WO2021169168A1 (en) Video file preview method and display device
WO2021139045A1 (en) Method for playing back media project and display device
WO2021212667A1 (en) Multiple media resource data display method and display device
CN113115088B (en) Control method of user interface of display equipment and display equipment
CN113115092B (en) Display device and detail page display method
CN111857363A (en) Input method interaction method and display equipment
CN111324215A (en) Display device and search display method
CN112040285B (en) Interface display method and display equipment
CN111343498B (en) Mute control method and device and smart television
CN113115093B (en) Display device and detail page display method
WO2021253592A1 (en) Method for starting sports mode and display device
WO2021218477A1 (en) Display method and display device
CN113010074A (en) Webpage Video control bar display method and display equipment
WO2020147507A1 (en) Display device and display method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21797424

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21797424

Country of ref document: EP

Kind code of ref document: A1