CN113689856B - Voice control method for video playing progress of browser page and display equipment - Google Patents

Voice control method for video playing progress of browser page and display equipment Download PDF

Info

Publication number
CN113689856B
CN113689856B CN202110958874.8A CN202110958874A CN113689856B CN 113689856 B CN113689856 B CN 113689856B CN 202110958874 A CN202110958874 A CN 202110958874A CN 113689856 B CN113689856 B CN 113689856B
Authority
CN
China
Prior art keywords
video
page
playing progress
area
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110958874.8A
Other languages
Chinese (zh)
Other versions
CN113689856A (en
Inventor
刘剑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vidaa Netherlands International Holdings BV
Original Assignee
Vidaa Netherlands International Holdings BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vidaa Netherlands International Holdings BV filed Critical Vidaa Netherlands International Holdings BV
Priority to CN202110958874.8A priority Critical patent/CN113689856B/en
Publication of CN113689856A publication Critical patent/CN113689856A/en
Application granted granted Critical
Publication of CN113689856B publication Critical patent/CN113689856B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a voice control method and display equipment for video playing progress of a browser page. The method comprises the following steps: receiving a voice instruction; if the voice command comprises a video playing progress control command, acquiring a page active video, wherein the page active video is a video with the largest display area on a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.

Description

Voice control method for video playing progress of browser page and display equipment
Technical Field
The application relates to the technical field of video playing progress, in particular to a voice control method and display equipment for video playing progress of a browser page.
Background
In the display device, when a user wants to perform operations such as fast forward, fast backward or designated playing time on a video to be watched in the process of browsing a webpage with the video through a browser, the user often needs to control a mouse pointer to perform two-step operations, firstly, the user needs to slide the mouse at the position of a video window to display a control column of the video, and then, the user needs to click at the position needing to be played on a progress bar by controlling the mouse pointer to realize control of video playing progress. The method can be seen that in the process, the steps of adjusting the video playing progress are complex, the efficiency is low, and the user experience is poor.
Disclosure of Invention
Some embodiments of the present application provide a voice control method and a display device for a video playing progress of a browser page, so that a user can adjust the video playing progress in the browser page by using a voice command, and the use experience of the user is improved.
In a first aspect, there is provided a display device including:
the display is used for displaying a browser webpage, and the browser webpage at least comprises one video;
a user interface for receiving an input signal;
a controller coupled to the display and the user interface, respectively, for performing:
receiving a voice instruction; if the voice command comprises a video playing progress control command, acquiring a page active video, wherein the page active video is a video with the largest display area on a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
In some embodiments, the controller is configured to adjust the playing progress of the active video of the page according to the video playing progress control instruction according to the following steps:
judging whether the video playing progress control instruction is a fast forward instruction or not;
if the fast forward instruction is the fast forward instruction, acquiring the playing progress and the video duration of the active video of the page, and adding the playing progress and the adjustment parameters in the fast forward instruction to obtain a first target playing progress; and adjusting the playing progress of the video according to the first target playing progress.
In some embodiments, the controller is configured to adjust the playing progress of the video according to the first target playing progress according to the following steps:
judging whether the first target playing progress is longer than the video time length of playing the video or not;
if the video playing time is longer than the video playing time, the playing progress is adjusted to the video time;
and if the video playing time is not longer than the video playing time, adjusting the playing progress to a first target playing progress.
In some embodiments, the controller is further configured to perform:
if the video playing progress control instruction is not a fast forward instruction, judging whether the video playing progress control instruction is a fast backward instruction or not;
if the instruction is a fast-rewinding instruction, acquiring the playing progress of the active video of the page, and making a difference between the playing progress and the adjustment parameters in the fast-rewinding instruction to obtain a second target playing progress;
and adjusting the playing progress of the video according to the second target playing progress.
In some embodiments, the controller is configured to adjust the playing progress of the video according to the second target playing progress according to the following steps:
judging whether the second target playing progress is smaller than 0;
if the video playing progress is smaller than 0, the video playing progress is adjusted to 0;
And if the playing progress is not smaller than 0, adjusting the playing progress to a second target playing progress.
In some embodiments, the controller is further configured to perform:
if the video playing progress control instruction is not a fast-rewinding instruction, acquiring video duration of the active video of the page, and judging whether an adjustment parameter in the video playing progress control instruction is larger than the video duration or not;
if the play progress is longer than the video duration, the play progress is adjusted to the video duration;
and if the playing progress is not greater than the video duration, adjusting the playing progress to the video parameters.
In some embodiments, the controller is configured to perform determining page active video as follows:
acquiring a first size parameter and a visible area parameter of a first video corresponding to a video tag in a browser webpage;
determining the display area of the first video on the page visual area according to the first size parameter and the visual area parameter;
acquiring a second size parameter of a second video corresponding to a video tag in a sub-webpage corresponding to an inline frame tag in a browser webpage, and a third size parameter of the sub-webpage;
determining the display area of the second video on the page visual area according to the second size parameter, the third size parameter and the visual area parameter;
And comparing the display area of the first video with the display area of the second video, and screening out the video with the largest display area as the page active video.
In some embodiments, the controller is configured to determine a display area of the first video on the viewable area of the page according to the first size parameter and the viewable area parameter according to:
the first size parameter includes a distance top from the top of the first video to the top of the page view area, a distance bottom from the bottom of the first video to the top of the page view area, a distance Left from the Left side of the first video to the Left side of the page view area, a distance Right from the Right side of the first video to the Left side of the page view area, a Height of the page view area, and a Width of the page view area; the visual area parameters comprise visual area Height and visual area Width;
the display area S1 of the first video displayed on the page visual area is calculated according to the following formula:
S1＝(B-T)＊(R-L)；
where T is the maximum value selected from both distances top and 0, B is the minimum value selected from both distances bottom and height, L is the maximum value selected from both distances left and 0, and R is the minimum value selected from both distances right and width.
In some embodiments, the controller is configured to determine a display area of the second video on the page viewable area according to the second size parameter, the third size parameter, and the viewable area parameter according to:
the second size parameter includes a distance vtop from the top of the second video to the top of the sub-web page, a distance vbottom from the bottom of the second video to the top of the sub-web page, a distance vleft from the left side of the second video to the left side of the sub-web page, and a distance vright from the right side of the second video to the left side of the sub-web page;
the third dimension parameter comprises a distance itop between the top of the sub-webpage and the top of the visible area of the webpage, a distance iLeft between the left side of the sub-webpage and the left side of the visible area of the webpage, a height ihight of the sub-webpage and a width ihidth of the sub-webpage; the visual area parameters comprise visual area height and visual area width;
the display area S2 of the second video displayed on the page visual area is calculated according to the following formula:
S2＝mwidth＊mheight；
wherein mwidth is the maximum of the difference of mright minus mleft and 0; mhight is the maximum value of the difference value of mbottom minus mtop and 0; mright is the sum of the distance itop and the distance vtop, and the maximum of 0; mleft is the sum of the distance iLeft and the distance vleft, and the maximum of 0; the mbottom is the minimum value of the sum of the distance itop and the distance vbottom and the height of the visible area of the page; mright is the minimum of the sum of the distance itop and the distance vright, and the width of the visible area of the page; if the distance vtop is less than 0, vtop is 0; if the distance vtop is greater than the height ihight, then the distance vtop is equal to the distance ihight; if the distance vloft is less than 0, vloft is 0; if the distance vloft is greater than the width iwidth, the distance vloft is equal to the width iwidth.
In a second aspect, a voice control method for video playing progress of a browser page is provided, including:
receiving a voice instruction; if the voice command comprises a video playing progress control command, acquiring a page active video, wherein the page active video is a video with the largest display area on a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
In the embodiment, the user can adjust the video playing progress in the browser webpage by utilizing the voice command, so that the use experience of the user is improved. The method comprises the following steps: receiving a voice instruction; if the voice command comprises a video playing progress control command, acquiring a page active video, wherein the page active video is a video with the largest display area on a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
Drawings
FIG. 1 illustrates a usage scenario of a display device according to some embodiments;
fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;
A flowchart of a method of playing data according to some embodiments is shown schematically in fig. 3;
a user interface schematic diagram according to some embodiments is schematically shown in fig. 4;
a flowchart of a method of voice control of browser page video playback progress is shown schematically in fig. 5, according to some embodiments;
a flowchart of another voice control method for browser page video playback progress is shown schematically in fig. 6, in accordance with some embodiments;
a schematic diagram of a user interface according to some embodiments is shown schematically in fig. 7;
a schematic diagram of a user interface of another terminal according to some embodiments is schematically shown in fig. 8.
Detailed Description
For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.
It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.
The terms "first," second, "" third and the like in the description and in the claims and in the above drawings are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.
In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.
In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.
Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.
In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.
In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.
In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving image signals from the controller output, for displaying video content, image content, and a menu manipulation interface, and for manipulating a UI interface by a user.
In some embodiments, the display 260 may be a liquid crystal display, an OLED display, a projection device, and a projection screen.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.
In some embodiments, the user interface may be configured to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).
In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.
In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.
In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.
A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.
In some embodiments, a graphics processor is used to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments, the video processor is configured to receive an external video signal, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, etc., according to a standard codec protocol of an input signal, and may obtain a signal that is displayed or played on the directly displayable device 200.
In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.
In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.
In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.
Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (simply "application layer"), an application framework layer (Application Framework) layer (simply "framework layer"), a An Zhuoyun row (Android run) and a system library layer (simply "system runtime layer"), and a kernel layer, respectively.
In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.
As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.
In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.
In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.
In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.
At present, users often use a display device browser to watch videos, because page contents are complex, text, pictures, videos and other contents can exist at the same time, and even a plurality of videos exist on the same page, the webpage video playing progress control method often surrounds a control device, when the users need to control the video playing progress, the users need to control the control device to control a mouse pointer and move into a corresponding video area, a progress bar is triggered, and a time node of clicking the progress bar is used for completing the control of the video playing progress.
In order to solve the technical problems, the embodiment of the application provides a voice control method for a video playing progress of a browser page, which is used for adjusting the video playing progress watched by a user through voice, improving adjustment efficiency and improving use experience of the user.
The method, as shown in fig. 5, includes: s100, receiving a voice instruction. In the embodiment of the application, the module for acquiring the voice command is configured in the display device to directly receive the voice command of the user, and the voice command of the user can also be received through the voice control device arranged outside the display device. The user may speak "fast forward video for 15 s", and the display device receives the speech and converts it into Json data, parses the Json data, and determines the voice command.
And S200, judging whether the voice command comprises a video playing progress control command. In the embodiment of the application, the browser webpage at least comprises one video, and after receiving the video playing progress control instruction, the operation of adjusting the video playing progress correspondingly is executed according to the instruction. The video playing progress control instruction comprises a fast forward instruction, a fast backward instruction, an appointed playing time instruction and the like.
And S300, if the voice command does not comprise a video playing progress control command, executing a corresponding operation. The user can control the display device to perform operations other than video playback progress adjustment through voice instructions.
S400, if the voice command comprises a video playing progress control command, acquiring a page active video, wherein the page active video is a video with the largest display area on a page visual area. In order to accurately locate a video being watched by a user, the video playing progress is adjusted for the video, and in the embodiment of the application, a page active video is selected, wherein the page active video is a video with the largest display area on a page visual area. In the embodiment of the application, the visual area of the page refers to an area which can be watched by a user on the display.
In some embodiments, the step of determining the page active video includes: and acquiring all videos in a browser page, determining the display area of the videos displayed on a page visual area, and screening out the video with the largest display area as the page active video. In the embodiment of the application, the browser page may include a plurality of videos, and at this time, the display areas of all videos on the visual area of the page are acquired for comparison, and the video with the largest display area is taken as the video being watched by the user. In the embodiment of the application, the display device comprises a page active video positioning module, and the step of determining the page active video is completed by the page active video positioning module.
In some embodiments, the step of determining the page active video includes S401-S405, as shown in fig. 6. In the embodiment of the application, the video seen by the user through the visual area of the page can be the video loaded in the page of the browser or the video embedded in the page of the browser, the seen video is the video in the sub page, and in order to ensure that the video with the largest display area in the visual area of the page can be accurately distinguished, the display areas of the video under the two conditions are respectively determined, so that the video with the largest display area is screened to be the active video of the page after the display areas of all the videos in the visual area of the page are compared.
S401, acquiring a first size parameter and a visible area parameter of a first video corresponding to a video tag in a browser webpage. In the embodiment of the application, all video tags (video tags) are searched from a DOM (Document Object Model) tree of a browser webpage, and a first video corresponding to the video tags is acquired, wherein the first video can be actually represented by a first video object (video object). The first size parameter of the first video may be obtained by obtaining a size parameter corresponding to the first video object. The visual area parameter is a parameter related to the visual area of the page.
S402, according to the first size parameter and the visual area parameter, determining the display area of the first video on the visual area of the page.
In some embodiments, the step of determining the display area of the first video on the visible area of the page according to the first size parameter and the visible area parameter includes:
as shown in fig. 7, the first size parameter includes a distance top between the top of the first video 701 and the top of the page visual area 702, a distance bottom between the bottom of the first video 701 and the top of the page visual area 702, a distance Left between the Left side of the first video 701 and the Left side of the page visual area 702, a distance Right between the Right side of the first video 701 and the Left side of the page visual area 702, a Height of the page visual area, and a Width of the page visual area, and the visual area parameter includes a Height of the visual area and a Width of the visual area.
The display area S1 of the first video displayed on the page visual area is calculated according to the following formula:
S1＝(B-T)＊(R-L)；
where T is the maximum value selected from both distances top and 0, B is the minimum value selected from both distances bottom and Height, L is the maximum value selected from both distances Left and 0, and R is the minimum value selected from both distances Right and Width. Illustratively, the distance top is 2, at which point T is 2, since 2 is greater than 0. Distance button is 2, height is 5, and B is 2.
S403, acquiring a second size parameter of a second video corresponding to a video tag in a sub-webpage corresponding to an inline frame tag in the browser webpage, and a third size parameter of the sub-webpage. In the embodiment of the application, all the inline frame tags (iframe tags) are searched from the DOM number of the browser webpage, the video tags are searched from the inline frame tags, the second video corresponding to the video tags in the inline frame tags is obtained, the second video can be represented by a second video object, and the second size parameter of the second video can be obtained by obtaining the size parameter corresponding to the second video object. In the embodiment of the application, the sub-page is embedded into the browser webpage, the second video is a video in the sub-webpage, and the second size parameter of the second video is set by referring to the sub-webpage.
S404, determining the display area of the second video on the page visual area according to the second size parameter, the third size parameter and the visual area parameter.
In some embodiments, the step of determining the display area of the second video on the page visible area according to the second size parameter, the third size parameter and the visible area parameter includes:
As shown in fig. 8, the second size parameter includes a distance vtop from the top of the second video 801 to the top of the sub-web page 802, a distance vbottom from the bottom of the second video 801 to the top of the sub-web page 802, a distance vLeft from the left side of the second video 801 to the left side of the sub-web page 802, and a distance vRight from the right side of the second video 801 to the left side of the sub-web page 802;
the third size parameter includes a distance itop between the top of the sub-web page 802 and the top of the page visible area 803, a distance iLeft between the left side of the sub-web page 802 and the left side of the page visible area 803, a height ihight of the sub-web page 802, and a width ikidth of the sub-web page 802; the visual area parameters comprise visual area Height and visual area Width;
the display area S2 of the second video displayed on the page visual area is calculated according to the following formula:
S2＝mwidth＊mheight；
wherein mwidth is the maximum of the difference of mright minus mleft and 0; mhight is the maximum value of the difference value of mbottom minus mtop and 0; mright is the sum of the distance itop and the distance vtop, and the maximum of 0; mleft is the sum of the distance iLeft and the distance vLeft, and the maximum of 0; the mbottom is the minimum value of the sum of the distance itop and the distance vbottom and the height of the visible area of the page; mright is the minimum of the sum of the distance itop and the distance vRight, and the width of the visible area of the page; if the distance vtop is less than 0, vtop is 0; if the distance vtop is greater than the height ihight, then the distance vtop is equal to the distance ihight; if the distance vloft is less than 0, vloft is 0; if the distance vloft is greater than the width iwidth, the distance vloft is equal to the width iwidth.
S405, comparing the display area of the first video with the display area of the second video, and screening out the video with the largest display area as the page active video.
In the embodiment of the present application, the order of determining the display area of the first video and the display area of the second video is not required, and may be performed simultaneously, or any one of the steps is performed first, and the other steps are performed in this step.
S500, according to the video playing progress control instruction, the playing progress of the active video of the page is adjusted. In the embodiment of the application, the display device comprises a video playing progress control module, and the steps S100-S500 are executed by utilizing the video playing progress control module.
In some embodiments, the step of adjusting the playing progress of the active video on the page according to the video playing progress control instruction includes:
and judging whether the video playing progress control instruction is a fast forward instruction or not.
If the fast forward instruction is the fast forward instruction, acquiring the playing progress and the video duration of the active video of the page, and adding the playing progress and the adjustment parameters in the fast forward instruction to obtain a first target playing progress; and adjusting the playing progress of the video according to the first target playing progress. In some embodiments, the video playing progress control module invokes the page active video positioning module to obtain a page active video, invokes the page active video object to obtain a playing progress and a video duration of the page active video, where, by way of example, the page active video object is a episode of a television, a total duration of the television, that is, a video duration is 45min, a current playing time, that is, a playing progress is 29min, and an adjustment parameter in a fast forward instruction is 5min, and then the first target playing progress is 34min.
In some embodiments, the step of adjusting the playing progress of the video according to the first target playing progress includes: judging whether the first target playing progress is longer than the video time length of playing the video or not; if the video playing time is longer than the video playing time, the playing progress is adjusted to the video time; and if the video playing time is not longer than the video playing time, adjusting the playing progress to a first target playing progress.
For example, the first target playing progress is 34min, the video duration is 45min, at this time, the first target playing progress is not greater than the video duration, and the playing progress is adjusted to 34min, at this time, the video starts to play the content for 34 min. In another example, the first target playing progress is 34min, the video duration is 33min, and at this time, the first target playing progress is greater than the video duration, and the playing progress is directly adjusted to 33 min.
In some embodiments, the method further comprises: if the video playing progress control instruction is not a fast forward instruction, judging whether the video playing progress control instruction is a fast backward instruction or not; if the instruction is a fast-rewinding instruction, acquiring the playing progress of the active video of the page, and making a difference between the playing progress and the adjustment parameters in the fast-rewinding instruction to obtain a second target playing progress; and adjusting the playing progress of the video according to the second target playing progress. For example, the playing progress is 29min, the adjustment parameter is 5min, and at this time, the second target playing progress is 24min.
In some embodiments, the step of adjusting the playing progress of the video according to the second target playing progress includes: judging whether the second target playing progress is smaller than 0; if the video playing progress is smaller than 0, the video playing progress is adjusted to 0; and if the playing progress is not smaller than 0, adjusting the playing progress to a second target playing progress. For example, if the second playing progress is-5 and the second playing progress is less than 0, the video playing progress is adjusted to 0. In another example, the second playing progress is 5min, and if the second playing progress is greater than 0, the video playing progress is adjusted to 5min.
In some embodiments, the method further comprises: if the video playing progress control instruction is not a fast-rewinding instruction, acquiring video duration of the active video of the page, and judging whether an adjustment parameter in the video playing progress control instruction is larger than the video duration or not; if the play progress is longer than the video duration, the play progress is adjusted to the video duration; and if the playing progress is not greater than the video duration, adjusting the playing progress to the video parameters. In the embodiment of the application, if the video playing progress instruction is not a fast forward instruction or a fast backward instruction, the video playing progress instruction may be an appointed playing time instruction, and the appointed playing time instruction can be used for directly indicating the video to be played from the appointed time.
In some embodiments, the method further comprises: and controlling a display to display the playing progress of the active video of the page. In the embodiment of the application, when the playing progress of the page active video is adjusted, the progress bar of the page active video is adjusted at the same time, so that a user can clearly see the adjusted playing progress, and the use experience of the user is improved.
In some embodiments, the step of controlling the display to display the playing progress of the active video of the page includes obtaining a size parameter of the active video of the page, determining a position of a user interface where the video is located, triggering a simulated mouse event according to the position, and displaying a progress bar. In some embodiments, the display device includes a progress bar display module that controls the display to display the progress of playing the active video of the page.
In the above embodiment, according to the voice control method and the display device for the video playing progress of the browser page, the user can adjust the video playing progress in the browser webpage by using the voice command, so that the use experience of the user is improved. The method comprises the following steps: receiving a voice instruction; if the voice command comprises a video playing progress control command, acquiring a page active video, wherein the page active video is a video with the largest display area on a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (9)

1. A display device, characterized by comprising:
the display is used for displaying a browser webpage, and the browser webpage at least comprises one video;
A user interface for receiving an input signal;
a controller coupled to the display and the user interface, respectively, for performing:
receiving a voice instruction; if the voice command comprises a video playing progress control command, acquiring a first size parameter and a visible area parameter of a first video corresponding to a video tag in a browser webpage; determining the display area of the first video on the page visual area according to the first size parameter and the visual area parameter; acquiring a second size parameter of a second video corresponding to a video tag in a sub-webpage corresponding to an inline frame tag in a browser webpage, and a third size parameter of the sub-webpage; determining the display area of the second video on the page visual area according to the second size parameter, the third size parameter and the visual area parameter; comparing the display area of the first video with the display area of the second video, and screening out the video with the largest display area as a page active video, wherein the page active video refers to the video with the largest display area on a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
2. The display device of claim 1, wherein the controller is configured to adjust the progress of playing the active video of the page according to the video progress control instructions according to the following steps:
judging whether the video playing progress control instruction is a fast forward instruction or not;
if the fast forward instruction is the fast forward instruction, acquiring the playing progress and the video duration of the active video of the page, and adding the playing progress and the adjustment parameters in the fast forward instruction to obtain a first target playing progress; and adjusting the playing progress of the video according to the first target playing progress.
3. The display device of claim 2, wherein the controller is configured to adjust the playback progress of the video according to the first target playback progress in accordance with:
judging whether the first target playing progress is longer than the video time length of playing the video or not;
if the video playing time is longer than the video playing time, the playing progress is adjusted to the video time;
and if the video playing time is not longer than the video playing time, adjusting the playing progress to a first target playing progress.
4. The display device of claim 2, wherein the controller is further configured to perform:
If the video playing progress control instruction is not a fast forward instruction, judging whether the video playing progress control instruction is a fast backward instruction or not;
if the instruction is a fast-rewinding instruction, acquiring the playing progress of the active video of the page, and making a difference between the playing progress and the adjustment parameters in the fast-rewinding instruction to obtain a second target playing progress;
and adjusting the playing progress of the video according to the second target playing progress.
5. The display device of claim 4, wherein the controller is configured to adjust the playback progress of the video according to the second target playback progress in accordance with:
judging whether the second target playing progress is smaller than 0;
if the play progress is smaller than 0, the play progress is adjusted to 0;
and if the playing progress is not smaller than 0, adjusting the playing progress to a second target playing progress.
6. The display device of claim 4, wherein the controller is further configured to perform:
if the video playing progress control instruction is not a fast-rewinding instruction, acquiring video duration of the active video of the page, and judging whether an adjustment parameter in the video playing progress control instruction is larger than the video duration or not;
if the play progress is longer than the video duration, the play progress is adjusted to the video duration;
And if the playing progress is not greater than the video duration, adjusting the playing progress to the video parameters.
7. The display device of claim 1, wherein the controller is configured to determine the display area of the first video on the viewable area of the page based on the first size parameter and the viewable area parameter by:
the first size parameter includes a distance top from the top of the first video to the top of the page view area, a distance bottom from the bottom of the first video to the top of the page view area, a distance Left from the Left side of the first video to the Left side of the page view area, a distance Right from the Right side of the first video to the Left side of the page view area, a Height of the page view area, and a Width of the page view area; the visual area parameters comprise visual area Height and visual area Width;
the display area S1 of the first video displayed on the page visual area is calculated according to the following formula:
S1＝(B-T)＊(R-L)；
where T is the maximum value selected from both distances top and 0, B is the minimum value selected from both distances bottom and height, L is the maximum value selected from both distances left and 0, and R is the minimum value selected from both distances right and width.
8. The display device of claim 1, wherein the controller is configured to determine the display area of the second video on the viewable area of the page based on the second size parameter, the third size parameter, and the viewable area parameter by:
the second size parameter includes a distance vtop from the top of the second video to the top of the sub-web page, a distance vbottom from the bottom of the second video to the top of the sub-web page, a distance vleft from the left side of the second video to the left side of the sub-web page, and a distance vright from the right side of the second video to the left side of the sub-web page;
the third dimension parameter comprises a distance itop between the top of the sub-webpage and the top of the visible area of the webpage, a distance iLeft between the left side of the sub-webpage and the left side of the visible area of the webpage, a height ihight of the sub-webpage and a width ihidth of the sub-webpage; the visual area parameters comprise visual area height and visual area width;
the display area S2 of the second video displayed on the page visual area is calculated according to the following formula:
S2＝mwidth＊mheight；
wherein mwidth is the maximum of the difference of mright minus mleft and 0; mhight is the maximum value of the difference value of mbottom minus mtop and 0; mright is the sum of the distance itop and the distance vtop, and the maximum of 0; mleft is the sum of the distance iLeft and the distance vleft, and the maximum of 0; the mbottom is the minimum value of the sum of the distance itop and the distance vbottom and the height of the visible area of the page; mright is the minimum of the sum of the distance itop and the distance vright, and the width of the visible area of the page; if the distance vtop is less than 0, vtop is 0; if the distance vtop is greater than the height ihight, then the distance vtop is equal to the distance ihight; if the distance vloft is less than 0, vloft is 0; if the distance vloft is greater than the width iwidth, the distance vloft is equal to the width iwidth.
9. A voice control method for the video playing progress of a browser page is characterized by comprising the following steps:
receiving a voice instruction; if the voice command comprises a video playing progress control command, acquiring a first size parameter and a visible area parameter of a first video corresponding to a video tag in a browser webpage; determining the display area of the first video on the page visual area according to the first size parameter and the visual area parameter; acquiring a second size parameter of a second video corresponding to a video tag in a sub-webpage corresponding to an inline frame tag in a browser webpage, and a third size parameter of the sub-webpage; determining the display area of the second video on the page visual area according to the second size parameter, the third size parameter and the visual area parameter; comparing the display area of the first video with the display area of the second video, and screening out the video with the largest display area as a page active video, wherein the page active video refers to the video with the largest display area on a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
CN202110958874.8A 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment Active CN113689856B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110958874.8A CN113689856B (en) 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110958874.8A CN113689856B (en) 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment

Publications (2)

Publication Number Publication Date
CN113689856A CN113689856A (en) 2021-11-23
CN113689856B true CN113689856B (en) 2023-11-03

Family

ID=78580920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110958874.8A Active CN113689856B (en) 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment

Country Status (1)

Country Link
CN (1) CN113689856B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012010189A (en) * 2010-06-25 2012-01-12 Toshiba Corp Voice control device and voice control method
CN106201157A (en) * 2015-05-05 2016-12-07 阿里巴巴集团控股有限公司 The application control method of window, device
CN109688475A (en) * 2018-12-29 2019-04-26 深圳Tcl新技术有限公司 Video playing jump method, system and computer readable storage medium
CN112437326A (en) * 2020-11-23 2021-03-02 广州虎牙科技有限公司 Video display method and device, electronic equipment and computer readable storage medium
CN112839261A (en) * 2021-01-14 2021-05-25 海信电子科技（深圳）有限公司 Method for improving voice instruction matching degree and display equipment
US11051067B1 (en) * 2020-08-14 2021-06-29 Global Sports & Entertainment Marketing, LLC Interactive video overlay

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012010189A (en) * 2010-06-25 2012-01-12 Toshiba Corp Voice control device and voice control method
CN106201157A (en) * 2015-05-05 2016-12-07 阿里巴巴集团控股有限公司 The application control method of window, device
CN109688475A (en) * 2018-12-29 2019-04-26 深圳Tcl新技术有限公司 Video playing jump method, system and computer readable storage medium
WO2020135161A1 (en) * 2018-12-29 2020-07-02 深圳Tcl新技术有限公司 Video playback jump method and system, and computer readable storage medium
US11051067B1 (en) * 2020-08-14 2021-06-29 Global Sports & Entertainment Marketing, LLC Interactive video overlay
CN112437326A (en) * 2020-11-23 2021-03-02 广州虎牙科技有限公司 Video display method and device, electronic equipment and computer readable storage medium
CN112839261A (en) * 2021-01-14 2021-05-25 海信电子科技（深圳）有限公司 Method for improving voice instruction matching degree and display equipment

Also Published As

Publication number Publication date
CN113689856A (en) 2021-11-23

Similar Documents

Publication Publication Date Title
CN112672195A (en) Remote controller key setting method and display equipment
CN113535019B (en) Display device and display method of application icon
CN113395556A (en) Display device and method for displaying detail page
CN113766164B (en) Display equipment and signal source interface display method
CN113821184B (en) Pairing method of control device and display device and display device
CN112272331B (en) Method for rapidly displaying program channel list and display equipment
CN111836115A (en) A screen saver display method, a screen saver jumping method and a display device
CN113593488A (en) Backlight adjusting method and display device
WO2021121051A1 (en) Display method and display device
CN112764627A (en) Upgrade package installation progress display method and display device
CN113703706B (en) A multi-channel screen projection display method, display device and terminal
CN114302021B (en) Display device and audio-visual synchronization method
CN113556609B (en) Display device and startup picture display method
CN113064691B (en) Display method and display equipment for starting user interface
CN112752156A (en) Subtitle adjusting method and display device
CN112637683A (en) Display equipment system optimization method and display equipment
CN114302070B (en) Display device and audio output method
CN114302131B (en) Display device and black screen detection method
CN113286185A (en) Display device and homepage display method
CN113689856B (en) Voice control method for video playing progress of browser page and display equipment
CN111831377A (en) A display method, display device and server
CN113992960B (en) Subtitle preview method on display device and display device
CN114296842B (en) Display device and scroll text detection method
CN113132809A (en) Channel switching method, channel program playing method and display equipment
CN113672192B (en) A method and display device for text prompt message on browser page

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20221025

Address after: 83 Intekte Street, Devon, Netherlands

Applicant after: VIDAA (Netherlands) International Holdings Ltd.

Address before: 9 / F, Hisense south building, 1777 Chuangye Road, Nanshan District, Shenzhen, Guangdong 518000

Applicant before: HISENSE ELECTRONIC TECHNOLOGY (SHENZHEN) Co.,Ltd.

GR01 Patent grant
GR01 Patent grant