CN113689856A - Voice control method for video playing progress of browser page and display device - Google Patents

Voice control method for video playing progress of browser page and display device Download PDF

Info

Publication number
CN113689856A
CN113689856A CN202110958874.8A CN202110958874A CN113689856A CN 113689856 A CN113689856 A CN 113689856A CN 202110958874 A CN202110958874 A CN 202110958874A CN 113689856 A CN113689856 A CN 113689856A
Authority
CN
China
Prior art keywords
video
playing progress
page
distance
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110958874.8A
Other languages
Chinese (zh)
Other versions
CN113689856B (en
Inventor
刘剑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vidaa Netherlands International Holdings BV
Original Assignee
Hisense Electronic Technology Shenzhen Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Electronic Technology Shenzhen Co ltd filed Critical Hisense Electronic Technology Shenzhen Co ltd
Priority to CN202110958874.8A priority Critical patent/CN113689856B/en
Publication of CN113689856A publication Critical patent/CN113689856A/en
Application granted granted Critical
Publication of CN113689856B publication Critical patent/CN113689856B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a voice control method and display equipment for video playing progress of a browser page. The method comprises the following steps: receiving a voice instruction; if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.

Description

Voice control method for video playing progress of browser page and display device
Technical Field
The application relates to the technical field of video playing progress, in particular to a voice control method and display equipment for video playing progress of a browser page.
Background
In a display device, in the process of browsing a webpage with a video through a browser, when a user wants to perform operations such as fast forward, fast backward or specifying playing time on the watched video, a mouse pointer is often controlled by a control device to perform two-step operations. In the process, the steps of adjusting the video playing progress are complex, the efficiency is low, and the user experience is poor.
Disclosure of Invention
Some embodiments of the present application provide a voice control method and a display device for a video playing progress of a browser page, so that a user can adjust the video playing progress in the browser page by using a voice instruction, and the user experience is improved.
In a first aspect, there is provided a display device comprising:
the display is used for displaying a browser webpage, and the browser webpage at least comprises a video;
a user interface for receiving an input signal;
a controller respectively coupled to the display and the user interface for performing:
receiving a voice instruction; if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
In some embodiments, the controller is configured to perform the following steps of adjusting the playing progress of the active video on the page according to the video playing progress control instruction:
judging whether the video playing progress control instruction is a fast forward instruction or not;
if the video is the fast forward instruction, acquiring the playing progress and the video duration of the active video of the page, and summing the playing progress and the adjustment parameters in the fast forward instruction to obtain a first target playing progress; and adjusting the playing progress of the video according to the playing progress of the first target.
In some embodiments, the controller is configured to perform the following steps of adjusting the playing progress of the video according to the first target playing progress:
judging whether the first target playing progress is larger than the video playing time length of the video;
if the video duration is longer than the video duration of the playing video, the playing progress is adjusted to the video duration;
and if the video time length of the video is not more than the video playing time length, adjusting the playing progress to a first target playing progress.
In some embodiments, the controller is further configured to perform:
if the video playing progress control instruction is not a fast forward instruction, judging whether the video playing progress control instruction is a fast backward instruction or not;
if the video is the fast-backward instruction, acquiring the playing progress of the active video of the page, and making a difference value between the playing progress and an adjusting parameter in the fast-backward instruction to obtain a second target playing progress;
and adjusting the playing progress of the video according to the playing progress of the second target.
In some embodiments, the controller is configured to perform the following steps of adjusting the playing progress of the video according to the second target playing progress:
judging whether the second target playing progress is smaller than 0;
if the video playing speed is less than 0, adjusting the video playing speed to 0;
and if the playing progress is not less than 0, adjusting the playing progress to a second target playing progress.
In some embodiments, the controller is further configured to perform:
if the video is not the fast-backward instruction, acquiring the video duration of the active video of the page, and judging whether the adjustment parameter in the video playing progress control instruction is greater than the video duration or not;
if the time length is larger than the video time length, the playing progress is adjusted to the video time length;
and if the time length of the video is not more than the video time length, adjusting the playing progress to the video parameters.
In some embodiments, the controller is configured to perform determining a page active video according to the following steps:
acquiring a first size parameter and a visible area parameter of a first video corresponding to a video tag in a browser webpage;
determining the display area of the first video on the visible area of the page according to the first size parameter and the visible area parameter;
acquiring a second size parameter of a second video corresponding to a video tag in a sub-webpage corresponding to an inline frame tag in a browser webpage, and a third size parameter of the sub-webpage;
determining the display area of the second video on the visible area of the page according to the second size parameter, the third size parameter and the visible area parameter;
and comparing the display area of the first video with the display area of the second video, and screening out the video with the largest display area as the active page video.
In some embodiments, the controller is configured to determine a display area of the first video on the visible area of the page according to the first size parameter and the visible area parameter according to the following steps:
the first size parameter comprises a distance top of the first video from the top of the page visual area, a distance bottom of the first video from the top of the page visual area, a distance Left of the first video from the Left of the page visual area, a distance Right of the first video from the Right of the page visual area, a page visual area Height and a page visual area Width; the visible area parameters comprise a visible area Height and a visible area Width;
the display area S1 of the first video displayed on the page visible region is calculated according to the following formula:
S1＝(B-T)＊(R-L)；
where T is the maximum selected in both distance top and 0, B is the minimum selected in both distance bottom and height, L is the maximum selected in both distance left and 0, and R is the minimum selected in both distance right and width.
In some embodiments, the controller is configured to determine a display area of the second video on the visible area of the page according to the second size parameter, the third size parameter and the visible area parameter according to the following steps:
the second size parameter comprises a distance vtop from the top of the second video to the top of the sub-webpage, a distance vbottom from the bottom of the second video to the top of the sub-webpage, a distance vlleft from the left of the sub-webpage on the left of the second video, and a distance vright from the right of the second video to the left of the sub-webpage;
the third size parameter comprises a distance itop from the top of the sub-webpage to the top of a page visual area, a distance iLeft from the left side of the page visual area to the left side of the sub-webpage, a height ihight of the sub-webpage and a width iWidth of the sub-webpage; the visible region parameters comprise a visible region height and a visible region width;
the display area S2 of the second video displayed on the page visible region is calculated according to the following formula:
S2＝mwidth＊mheight；
wherein mwidth is the maximum value of the difference value of mright minus mleft and 0; mhehight is the maximum value of the difference value of mtotm minus mtop and 0; mright is the maximum of the sum of the distance itop and the distance vtop, and 0; mleft is the maximum of the sum of the distance iLeft and the distance vleft and 0; mbottom is the minimum value of the sum of the distance itop and the distance vbottom and the height of the page visible region; mright is the minimum value of the sum of the distance itop and the distance vright and the width of the visible area of the page; if the distance vtop is less than 0, vtop is 0; if distance vtop is greater than height ihight, distance vtop is equal to distance ihight; if the distance vleft is less than 0, then vleft is 0; if the distance vleft is greater than the width iWidth, the distance vleft is equal to the width iWidth.
In a second aspect, a method for controlling video playing progress of a browser page by voice is provided, which includes:
receiving a voice instruction; if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
In the embodiment, a user can adjust the video playing progress in the browser webpage by using a voice instruction, so that the use experience of the user is improved. The method comprises the following steps: receiving a voice instruction; if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
Drawings
FIG. 1 illustrates a usage scenario of a display device according to some embodiments;
fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;
FIG. 3 is a flow diagram illustrating a method of playing data according to some embodiments;
a user interface diagram according to some embodiments is illustrated in fig. 4;
FIG. 5 is a flow diagram illustrating a method for voice control of video playback progress of a browser page according to some embodiments;
FIG. 6 illustrates a flow chart of another method for voice control of video playback progress of a browser page, in accordance with some embodiments;
FIG. 7 is a schematic diagram illustrating a user interface according to some embodiments;
a schematic diagram of a user interface of another terminal according to some embodiments is illustrated in fig. 8.
Detailed Description
To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the functionality associated with that element.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the smart device 300 or the control device 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200.
In some embodiments, the smart device 300 (e.g., mobile terminal, tablet, computer, laptop, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.
In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received by a module configured inside the display device 200 to obtain a voice command, or may be received by a voice control device provided outside the display device 200.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.
Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.
In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.
In some embodiments the controller comprises a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, performing display of video content, image content, and a menu manipulation interface, and a user manipulation UI interface.
In some embodiments, the display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the external control apparatus 100 or the server 400 through the communicator 220.
In some embodiments, the user interface may be configured to receive control signals for controlling the apparatus 100 (e.g., an infrared remote control, etc.).
In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.
In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.
A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.
In some embodiments, a graphics processor for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments, the video processor is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.
In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.
In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.
Referring to fig. 4, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) layer and a system library layer (referred to as a "system runtime library layer"), and a kernel layer.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.
As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.
In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.
In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.
In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..
At present, a user often aims at watching videos when using a display device browser, because the content of a page is complex, the content of characters, pictures, videos and the like may exist at the same time, even a plurality of videos exist on the same page, the webpage video playing progress control method often surrounds a control device, the user needs to control the control device to control a mouse pointer when needing to control the video playing progress, the user moves to a corresponding video area, a progress bar is triggered, and a time node of the progress bar is clicked to complete the control of the video playing progress, so that the steps are very complicated, the efficiency is low, and the accurate control of the video playing progress cannot be realized.
In order to solve the above technical problem, an embodiment of the present application provides a voice control method for a video playing progress of a browser page, which is used for adjusting the video playing progress watched by a user through voice, so as to improve adjustment efficiency and improve user experience.
The method, as shown in fig. 5, includes: and S100, receiving a voice command. In the embodiment of the application, a module for acquiring the voice instruction is configured inside the display device to directly receive the voice instruction of the user, and the voice instruction of the user can also be received through a voice control device arranged outside the display device. The user may say "fast forward the video by 15 s", the display device receives the speech and converts it to Json data, parses the Json data, and determines the voice command.
S200, judging whether the voice command comprises a video playing progress control command. In the embodiment of the application, the browser webpage at least comprises one video, and after the video playing progress control instruction is received, the operation of correspondingly adjusting the video playing progress is executed according to the instruction. The video playing progress control instruction comprises a fast forward instruction, a fast backward instruction or an instruction of appointed playing time and the like.
And S300, if the voice instruction does not comprise a video playing progress control instruction, executing corresponding operation. The user can control the display device to perform operations other than video play progress adjustment through voice instructions.
S400, if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visible area. Since a browser page may include a plurality of videos, in order to accurately locate a video being watched by a user and adjust the video playing progress for the video, in the embodiment of the present application, a page active video is selected, where the page active video is a video with a largest display area on a visible area of a page, and it is understood that when the user watches a certain video on a display device, the user may adjust the content of the video to be displayed in the visible area of the page entirely or adjust the content of the video to be displayed in the visible area of the page to the maximum, so in the embodiment of the present application, the page active video is used as a video that the user is most likely to watch, and the video playing progress is adjusted for the video. In the embodiment of the present application, the page visible area refers to an area that can be viewed by a user on a display.
In some embodiments, the step of determining a page active video comprises: all videos in a browser page are obtained, the display area of the videos displayed on the visible area of the page is determined, and the video with the largest display area is screened out to be the active video of the page. In the embodiment of the application, a browser page may include a plurality of videos, and at this time, display areas of all videos on a page visible area are acquired for comparison, and the video with the largest display area is used as the video being watched by a user. In the embodiment of the application, the display device comprises a page active video positioning module, and the step of determining the page active video is completed by the page active video positioning module.
In some embodiments, the step of determining the page active video includes S401-S405, as shown in FIG. 6. In the embodiment of the application, the video seen by the user through the page visual area may be a video loaded in the browser page, or a sub-page may be embedded in the browser page, the seen video is a video in the sub-page, and in order to ensure that the video with the largest display area in the page visual area can be accurately distinguished, the display areas of the videos under the two conditions are respectively determined, so that the video with the largest display area is screened out as a page active video after the display areas of all videos in the page visual area are compared.
S401, acquiring a first size parameter and a visible area parameter of a first video corresponding to a video tag in a browser webpage. In the embodiment of the present application, all video tags (video tags) are searched from a dom (document Object) tree of a browser webpage, and a first video corresponding to the video tags is obtained, where the first video may be actually represented by a first video Object (video Object). The first size parameter of the first video may be obtained by obtaining a size parameter corresponding to the first video object. The visible area parameter is a parameter related to the visible area of the page.
S402, determining the display area of the first video on the page visual area according to the first size parameter and the visual area parameter.
In some embodiments, the step of determining the display area of the first video on the visible area of the page according to the first size parameter and the visible area parameter includes:
as shown in fig. 7, the first size parameter includes a distance top of the first video 701 from the top of the page visible area 702, a distance bottom of the first video 701 from the top of the page visible area 702, a distance Left of the Left side of the first video 701 from the Left of the page visible area 702, a distance Right of the Right side of the first video 701 from the Left of the page visible area 702, a page visible area Height and a page visible area Width, the visible area parameters include a visible area Height and a visible area Width, and the distances may be negative in this embodiment of the present application.
The display area S1 of the first video displayed on the page visible region is calculated according to the following formula:
S1＝(B-T)＊(R-L)；
where T is the maximum selected in both distance top and 0, B is the minimum selected in both distance bottom and Height, L is the maximum selected in both distance Left and 0, and R is the minimum selected in both distance Right and Width. Illustratively, the distance top is 2, and since 2 is greater than 0, T is 2 at this time. Distance botton is 2 and height is 5, where B is 2.
S403, acquiring a second size parameter of a second video corresponding to a video tag in a sub-webpage corresponding to an inline frame tag in the browser webpage, and acquiring a third size parameter of the sub-webpage. In the embodiment of the application, all inline frame tags (iframe tags) are searched from the DOM number of the browser webpage, video tags are searched from the inline frame tags, a second video corresponding to the video tags in the inline frame tags is obtained, the second video can be represented by a second video object, and a second size parameter of the second video can be obtained by obtaining a size parameter corresponding to the second video object. In the embodiment of the application, the sub-page is embedded in the browser webpage, the second video is a video in the sub-page, and the second size parameter of the second video is set by referring to the sub-web.
S404, determining the display area of the second video on the visible area of the page according to the second size parameter, the third size parameter and the visible area parameter.
In some embodiments, the step of determining the display area of the second video on the page visible area according to the second size parameter, the third size parameter and the visible area parameter comprises:
as shown in fig. 8, the second size parameter includes a distance vtop from the top of the second video 801 to the top of the sub-web page 802, a distance vbottom from the bottom of the second video 801 to the top of the sub-web page 802, a distance vLeft from the left side of the second video 801 to the left side of the ion web page 802, and a distance vRight from the right side of the second video 801 to the left side of the ion web page 802;
the third size parameter includes a distance itop from the top of the sub-web page 802 to the top of the page visible area 803, a distance iLeft from the left side of the page visible area 803 to the left side of the sub-web page 802, a height ihehight of the sub-web page 802, and a width iWidth of the sub-web page 802; the visible area parameters comprise a visible area Height and a visible area Width;
the display area S2 of the second video displayed on the page visible region is calculated according to the following formula:
S2＝mwidth＊mheight；
wherein mwidth is the maximum value of the difference value of mright minus mleft and 0; mhehight is the maximum value of the difference value of mtotm minus mtop and 0; mright is the maximum of the sum of the distance itop and the distance vtop, and 0; mleft is the maximum value of the sum of the distance iLeft and the distance vLeft and 0; mbottom is the minimum value of the sum of the distance itop and the distance vbottom and the height of the page visible region; mright is the minimum value of the sum of the distance itop and the distance vRight and the width of the visible area of the page; if the distance vtop is less than 0, vtop is 0; if distance vtop is greater than height ihight, distance vtop is equal to distance ihight; if the distance vleft is less than 0, then vleft is 0; if the distance vleft is greater than the width iWidth, the distance vleft is equal to the width iWidth.
S405, comparing the display area of the first video with the display area of the second video, and screening out the video with the largest display area as a page active video.
It should be noted that, in the embodiment of the present application, the order of determining the display area of the first video and the display area of the second video is not required, and both may be performed simultaneously, or any one of the steps may be performed first, and the other steps may be performed in the step.
And S500, adjusting the playing progress of the active video on the page according to the video playing progress control instruction. In the embodiment of the present application, the display device includes a video playing progress control module, and the video playing progress control module is used to execute steps S100 to S500.
In some embodiments, the step of adjusting the playing progress of the active video on the page according to the video playing progress control instruction includes:
and judging whether the video playing progress control instruction is a fast forward instruction or not.
If the video is the fast forward instruction, acquiring the playing progress and the video duration of the active video of the page, and summing the playing progress and the adjustment parameters in the fast forward instruction to obtain a first target playing progress; and adjusting the playing progress of the video according to the playing progress of the first target. In some embodiments, the video playing progress control module calls the page active video positioning module to obtain a page active video, and calls the page active video object to obtain the playing progress and the video duration of the page active video, where, for example, the page active video object is a tv series, the total duration of the tv series, i.e., the video duration, is 45min, the current playing time, i.e., the playing progress, is 29min, and the adjustment parameter in the fast forward instruction is 5min, then the first target playing progress is 34 min.
In some embodiments, the step of adjusting the playing progress of the video according to the first target playing progress includes: judging whether the first target playing progress is larger than the video playing time length of the video; if the video duration is longer than the video duration of the playing video, the playing progress is adjusted to the video duration; and if the video time length of the video is not more than the video playing time length, adjusting the playing progress to a first target playing progress.
Illustratively, the first target playing progress is 34min, the video duration is 45min, and at this time, the first target playing progress is not greater than the video duration, the playing progress is adjusted to 34min, and at this time, the video starts to play the content of 34 min. In another example, the first target playing progress is 34min, the video duration is 33min, and at this time, if the first target playing progress is greater than the video duration, the playing progress is directly adjusted to 33 min.
In some embodiments, the method further comprises: if the video playing progress control instruction is not a fast forward instruction, judging whether the video playing progress control instruction is a fast backward instruction or not; if the video is the fast-backward instruction, acquiring the playing progress of the active video of the page, and making a difference value between the playing progress and an adjusting parameter in the fast-backward instruction to obtain a second target playing progress; and adjusting the playing progress of the video according to the playing progress of the second target. Illustratively, the playing progress is 29min, the adjustment parameter is 5min, and the playing progress of the second target is 24 min.
In some embodiments, the step of adjusting the playing progress of the video according to the second target playing progress includes: judging whether the second target playing progress is smaller than 0; if the video playing speed is less than 0, adjusting the video playing speed to 0; and if the playing progress is not less than 0, adjusting the playing progress to a second target playing progress. Illustratively, the second playing progress is-5, and the second playing progress is less than 0, the progress of playing the video is adjusted to 0. In another example, the second playing progress is 5min, and if the second playing progress is greater than 0, the progress of playing the video is adjusted to 5 min.
In some embodiments, the method further comprises: if the video is not the fast-backward instruction, acquiring the video duration of the active video of the page, and judging whether the adjustment parameter in the video playing progress control instruction is greater than the video duration or not; if the time length is larger than the video time length, the playing progress is adjusted to the video time length; and if the time length of the video is not more than the video time length, adjusting the playing progress to the video parameters. In the embodiment of the application, the video playing progress instruction may be a play time designation instruction if the video playing progress instruction is not a fast forward instruction or a fast backward instruction, and the video can be directly instructed to be played from a designated time by using the play time designation instruction.
In some embodiments, the method further comprises: and controlling the display to display the playing progress of the active video of the page. In the embodiment of the application, when the playing progress of the active video of the page is adjusted, the progress bar of the active video of the page is adjusted at the same time, so that a user can clearly see the adjusted playing progress, and the use experience of the user is improved.
In some embodiments, the step of controlling the display to display the playing progress of the active page video includes obtaining a size parameter of the active page video, determining a position of a user interface where the video is located, and triggering a simulated mouse event according to the position, so as to display the progress bar. In some embodiments, the display device includes a progress bar display module that controls the display to display the progress of the active video of the page.
In the embodiment, a user can adjust the video playing progress in a browser webpage by using a voice instruction, so that the use experience of the user is improved. The method comprises the following steps: receiving a voice instruction; if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, comprising:
the display is used for displaying a browser webpage, and the browser webpage at least comprises a video;
a user interface for receiving an input signal;
a controller respectively coupled to the display and the user interface for performing:
receiving a voice instruction; if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
2. The display device according to claim 1, wherein the controller is configured to perform the following steps of adjusting the playing progress of the active-page video according to the video playing progress control instruction:
judging whether the video playing progress control instruction is a fast forward instruction or not;
if the video is the fast forward instruction, acquiring the playing progress and the video duration of the active video of the page, and summing the playing progress and the adjustment parameters in the fast forward instruction to obtain a first target playing progress; and adjusting the playing progress of the video according to the playing progress of the first target.
3. The display device according to claim 1, wherein the controller is configured to perform the step of adjusting the playing progress of the video according to the first target playing progress:
judging whether the first target playing progress is larger than the video playing time length of the video;
if the video duration is longer than the video duration of the playing video, the playing progress is adjusted to the video duration;
and if the video time length of the video is not more than the video playing time length, adjusting the playing progress to a first target playing progress.
4. The display device according to claim 2, wherein the controller is further configured to perform:
if the video playing progress control instruction is not a fast forward instruction, judging whether the video playing progress control instruction is a fast backward instruction or not;
if the video is the fast-backward instruction, acquiring the playing progress of the active video of the page, and making a difference value between the playing progress and an adjusting parameter in the fast-backward instruction to obtain a second target playing progress;
and adjusting the playing progress of the video according to the playing progress of the second target.
5. The display device according to claim 4, wherein the controller is configured to perform the step of adjusting the playing progress of the video according to the second target playing progress:
judging whether the second target playing progress is smaller than 0;
if the video playing speed is less than 0, adjusting the video playing speed to 0;
and if the playing progress is not less than 0, adjusting the playing progress to a second target playing progress.
6. The display device according to claim 4, wherein the controller is further configured to perform:
if the video is not the fast-backward instruction, acquiring the video duration of the active video of the page, and judging whether the adjustment parameter in the video playing progress control instruction is greater than the video duration or not;
if the time length is larger than the video time length, the playing progress is adjusted to the video time length;
and if the time length of the video is not more than the video time length, adjusting the playing progress to the video parameters.
7. The display device of claim 1, wherein the controller is configured to perform determining a page active video according to the following steps:
acquiring a first size parameter and a visible area parameter of a first video corresponding to a video tag in a browser webpage;
determining the display area of the first video on the visible area of the page according to the first size parameter and the visible area parameter;
acquiring a second size parameter of a second video corresponding to a video tag in a sub-webpage corresponding to an inline frame tag in a browser webpage, and a third size parameter of the sub-webpage;
determining the display area of the second video on the visible area of the page according to the second size parameter, the third size parameter and the visible area parameter;
and comparing the display area of the first video with the display area of the second video, and screening out the video with the largest display area as the active page video.
8. The display device of claim 7, wherein the controller is configured to determine the display area of the first video on the visible area of the page according to the first size parameter and the visible area parameter by:
the first size parameter comprises a distance top of the first video from the top of the page visual area, a distance bottom of the first video from the top of the page visual area, a distance Left of the first video from the Left of the page visual area, a distance Right of the first video from the Right of the page visual area, a page visual area Height and a page visual area Width; the visible area parameters comprise a visible area Height and a visible area Width;
the display area S1 of the first video displayed on the page visible region is calculated according to the following formula:
S1＝(B-T)＊(R-L)；
where T is the maximum selected in both distance top and 0, B is the minimum selected in both distance bottom and height, L is the maximum selected in both distance left and 0, and R is the minimum selected in both distance right and width.
9. The display device according to claim 7, wherein the controller is configured to determine the display area of the second video on the visible area of the page according to the second size parameter, the third size parameter and the visible area parameter according to the following steps:
the second size parameter comprises a distance vtop from the top of the second video to the top of the sub-webpage, a distance vbottom from the bottom of the second video to the top of the sub-webpage, a distance vlleft from the left of the sub-webpage on the left of the second video, and a distance vright from the right of the second video to the left of the sub-webpage;
the third size parameter comprises a distance itop from the top of the sub-webpage to the top of a page visual area, a distance iLeft from the left side of the page visual area to the left side of the sub-webpage, a height ihight of the sub-webpage and a width iWidth of the sub-webpage; the visible region parameters comprise a visible region height and a visible region width;
the display area S2 of the second video displayed on the page visible region is calculated according to the following formula:
S2＝mwidth＊mheight；
wherein mwidth is the maximum value of the difference value of mright minus mleft and 0; mhehight is the maximum value of the difference value of mtotm minus mtop and 0; mright is the maximum of the sum of the distance itop and the distance vtop, and 0; mleft is the maximum of the sum of the distance iLeft and the distance vleft and 0; mbottom is the minimum value of the sum of the distance itop and the distance vbottom and the height of the page visible region; mright is the minimum value of the sum of the distance itop and the distance vright and the width of the visible area of the page; if the distance vtop is less than 0, vtop is 0; if distance vtop is greater than height ihight, distance vtop is equal to distance ihight; if the distance vleft is less than 0, then vleft is 0; if the distance vleft is greater than the width iWidth, the distance vleft is equal to the width iWidth.
10. A voice control method for video playing progress of a browser page is characterized by comprising the following steps:
receiving a voice instruction; if the voice instruction comprises a video playing progress control instruction, acquiring a page active video, wherein the page active video refers to a video with the largest display area in a page visual area; and adjusting the playing progress of the active video of the page according to the video playing progress control instruction.
CN202110958874.8A 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment Active CN113689856B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110958874.8A CN113689856B (en) 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110958874.8A CN113689856B (en) 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment

Publications (2)

Publication Number Publication Date
CN113689856A true CN113689856A (en) 2021-11-23
CN113689856B CN113689856B (en) 2023-11-03

Family

ID=78580920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110958874.8A Active CN113689856B (en) 2021-08-20 2021-08-20 Voice control method for video playing progress of browser page and display equipment

Country Status (1)

Country Link
CN (1) CN113689856B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012010189A (en) * 2010-06-25 2012-01-12 Toshiba Corp Voice control device and voice control method
CN106201157A (en) * 2015-05-05 2016-12-07 阿里巴巴集团控股有限公司 The application control method of window, device
CN109688475A (en) * 2018-12-29 2019-04-26 深圳Tcl新技术有限公司 Video playing jump method, system and computer readable storage medium
CN112437326A (en) * 2020-11-23 2021-03-02 广州虎牙科技有限公司 Video display method and device, electronic equipment and computer readable storage medium
CN112839261A (en) * 2021-01-14 2021-05-25 海信电子科技（深圳）有限公司 Method for improving voice instruction matching degree and display equipment
US11051067B1 (en) * 2020-08-14 2021-06-29 Global Sports & Entertainment Marketing, LLC Interactive video overlay

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012010189A (en) * 2010-06-25 2012-01-12 Toshiba Corp Voice control device and voice control method
CN106201157A (en) * 2015-05-05 2016-12-07 阿里巴巴集团控股有限公司 The application control method of window, device
CN109688475A (en) * 2018-12-29 2019-04-26 深圳Tcl新技术有限公司 Video playing jump method, system and computer readable storage medium
WO2020135161A1 (en) * 2018-12-29 2020-07-02 深圳Tcl新技术有限公司 Video playback jump method and system, and computer readable storage medium
US11051067B1 (en) * 2020-08-14 2021-06-29 Global Sports & Entertainment Marketing, LLC Interactive video overlay
CN112437326A (en) * 2020-11-23 2021-03-02 广州虎牙科技有限公司 Video display method and device, electronic equipment and computer readable storage medium
CN112839261A (en) * 2021-01-14 2021-05-25 海信电子科技（深圳）有限公司 Method for improving voice instruction matching degree and display equipment

Also Published As

Publication number Publication date
CN113689856B (en) 2023-11-03

Similar Documents

Publication Publication Date Title
CN112672195A (en) Remote controller key setting method and display equipment
WO2021121051A1 (en) Display method and display device
CN113014939A (en) Display device and playing method
CN113395556A (en) Display device and method for displaying detail page
CN112752156A (en) Subtitle adjusting method and display device
CN113821184A (en) Pairing method of control device and display equipment
CN113490042A (en) Display device and channel searching method
CN113593488A (en) Backlight adjusting method and display device
CN113473241A (en) Display equipment and display control method of image-text style menu
CN113132809B (en) Channel switching method, channel program playing method and display equipment
CN113064691B (en) Display method and display equipment for starting user interface
CN112911371B (en) Dual-channel video resource playing method and display equipment
CN113286185A (en) Display device and homepage display method
CN113689856B (en) Voice control method for video playing progress of browser page and display equipment
CN112668546A (en) Video thumbnail display method and display equipment
CN113992960A (en) Subtitle previewing method on display device and display device
CN113064534A (en) Display method and display equipment of user interface
CN112637683A (en) Display equipment system optimization method and display equipment
CN114302070A (en) Display device and audio output method
CN114296664A (en) Auxiliary screen brightness adjusting method and display device
CN113596563B (en) Background color display method and display device
CN112835633B (en) Display device and control method of display language
CN113766164B (en) Display equipment and signal source interface display method
CN113672192A (en) Method for prompting message by browser page characters and display equipment
CN116225275A (en) Display equipment and interface jump method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20221025

Address after: 83 Intekte Street, Devon, Netherlands

Applicant after: VIDAA (Netherlands) International Holdings Ltd.

Address before: 9 / F, Hisense south building, 1777 Chuangye Road, Nanshan District, Shenzhen, Guangdong 518000

Applicant before: HISENSE ELECTRONIC TECHNOLOGY (SHENZHEN) Co.,Ltd.

GR01 Patent grant
GR01 Patent grant