WO2022151688A1 - 视频预览播放方法及装置 - Google Patents
视频预览播放方法及装置 Download PDFInfo
- Publication number
- WO2022151688A1 WO2022151688A1 PCT/CN2021/106949 CN2021106949W WO2022151688A1 WO 2022151688 A1 WO2022151688 A1 WO 2022151688A1 CN 2021106949 W CN2021106949 W CN 2021106949W WO 2022151688 A1 WO2022151688 A1 WO 2022151688A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- browser
- effect processing
- time
- playback
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000012545 processing Methods 0.000 claims abstract description 128
- 230000000694 effects Effects 0.000 claims abstract description 84
- 238000009877 rendering Methods 0.000 claims abstract description 13
- 230000006870 function Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000001133 acceleration Effects 0.000 abstract description 13
- 238000013507 mapping Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 7
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
- H04N21/2355—Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
Definitions
- the present invention relates to the technical field of video processing, and in particular, to a video preview playback method, a computer-readable storage medium, a computer device, and a video preview playback device.
- an object of the present invention is to propose a video preview playback method, which carries the element to be played through the Texture of the browser WebGL, and uses the browser capability to decode to enjoy hardware acceleration, which can support high-resolution video preview playback, Thereby greatly improving the user experience.
- a second object of the present invention is to provide a computer-readable storage medium.
- the third object of the present invention is to propose a computer device.
- the fourth object of the present invention is to provide a video preview playback device.
- an embodiment of the first aspect of the present invention provides a video preview playback method, which includes the following steps: obtaining corresponding elements to be played through different element data types of a browser; Each frame of image is rendered into the video processing element supported by the browser; each frame of image in the video processing element is added to the effect processing space of the browser through the mapping function in the browser , so that the effect processing space performs effect processing on each added frame of image and then draws it into the video processing element for video preview playback.
- the corresponding elements to be played are obtained through different element data types of the browser; then, each frame of images in the corresponding elements to be played is sequentially rendered to the video processing elements supported by the browser. Then add each frame of image in the video processing element to the effect processing space of the browser through the map function in the browser, so that the effect processing space will draw each frame of image added to the video processing element after effect processing.
- the elements to be played are carried through the Texture of the browser WebGL, and the browser capabilities are used for decoding to enjoy hardware acceleration, which can support high-resolution video preview playback, thus greatly improving the user experience.
- the video preview playback method proposed according to the above embodiments of the present invention may also have the following additional technical features.
- the corresponding element to be played is bound to the texture data source in the effect processing space, so that the texture data source in the browser can be Each frame of image in the video processing element is added to the effect processing space of the browser.
- the effect processing space is WebGL.
- the player when the player starts to perform video preview playback, the following steps are included: S1, the player calls HTMLVideoElement in the different element data types of the browser to perform synchronous playback of video elements; S2, according to the time interval specified by the video refresh frequency, The effect processing space performs effect processing on the stored current frame image through the Webassembly effect processor; S3, according to the specified hierarchical order, the effect processing space draws the effect processed current frame image into the video processing element ; S4, obtain the time of each video element in the HTMLVideoElement, and obtain the playback time of the corresponding video element according to the time corresponding to the current frame played by the player, if the playback time of the corresponding video element and the time of the corresponding video element in the HTMLVideoElement are between If the error between them is greater than the first threshold, HTMLVideoElemnt.seek is called to make the time of the corresponding video element in the HTMLVideoElement jump to the playback time of the corresponding video element; S4, steps S2-S4 are repeatedly executed until the playback
- the second aspect of the present invention provides a computer-readable storage medium on which a video preview playback program is stored.
- the video preview playback program is executed by a processor, the above video preview playback method is implemented.
- the processor by storing a video preview playback program, the processor implements the above-mentioned video preview playback method when executing the video preview playback program. It carries the element to be played, and uses the browser's ability to decode it to enjoy hardware acceleration. It can support high-resolution video preview playback, thus greatly improving the user experience.
- a third aspect of the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and running on the processor.
- the processor executes the program, Implement the above video preview playback method.
- the video preview playback program is stored in the memory, so that the processor implements the above-mentioned video preview playback method when executing the video preview playback program. It carries the element to be played, and uses the browser's ability to decode it to enjoy hardware acceleration. It can support high-resolution video preview playback, thus greatly improving the user experience.
- an embodiment of the fourth aspect of the present invention provides a video preview playback device, including: an acquisition module, where the acquisition module is used to acquire corresponding elements to be played through different element data types of a browser; a rendering module, The rendering module is configured to sequentially render each frame of image in the corresponding element to be played to the video processing element supported by the browser; The texture function in the video processing element adds each frame of image in the video processing element to the effect processing space of the browser, so that the effect processing space performs effect processing on each added frame of image and draws it to the video Process element for video preview playback.
- the acquisition module is configured to acquire corresponding elements to be played through different element data types of the browser; the rendering module is used to sequentially render each frame of images in the corresponding elements to be played.
- the effect processing module is used to add each frame of image in the video processing element to the effect processing space of the browser through the texture function in the browser, so that the effect processing space can affect each added image.
- a frame of image is drawn into the video processing element for video preview playback; thus, the element to be played is carried by the Texture of the browser WebGL, and the browser capability is used for decoding to enjoy hardware acceleration, which can support high resolution
- the video preview is played, which greatly improves the user experience.
- the video preview playback device proposed according to the above embodiments of the present invention may also have the following additional technical features.
- the corresponding element to be played is bound to the texture data source in the effect processing space, so that the texture data source in the browser can be Each frame of image in the video processing element is added to the effect processing space of the browser.
- the effect processing space is WebGL.
- a time conversion module is also included, and the time conversion module is used to obtain the time of each video element in the HTMLVideoElement when the player starts to play the video preview, and obtain the corresponding video according to the moment corresponding to the current frame played by the player.
- the playback time of the element If the error between the playback time of the corresponding video element and the time of the corresponding video element in HTMLVideoElement is greater than the first threshold, HTMLVideoElemnt.seek is called to make the time of the corresponding video element in HTMLVideoElement jump to the corresponding video element. The playback time of the video element.
- FIG. 1 is a schematic flowchart of a video preview playback method according to an embodiment of the present invention.
- FIG. 2 is a schematic flowchart of a video preview playing method according to a specific embodiment of the present invention.
- FIG. 3 is a schematic block diagram of a video preview playing apparatus according to an embodiment of the present invention.
- non-editing editing can improve the editing effect by accessing the video and other media at any time frame, which is mainly divided into three parts: decoding and fetching frames, special effects editing, and rendering and rendering;
- the existing web non-editing editing technology is generally Based on webassembly technology, the non-edited editing applications of other platforms are fully compiled and transplanted to the web, and the applications transplanted by complete compilation often include thread synchronization compiled by webaseembly, which has poor compatibility on the web platform. In addition, webassembly cannot be used on the web platform.
- the present invention proposes a video preview playback method, which splits and refines the granularity of the transplant, and accesses the Use callbacks and other widely supported methods between modules to replace thread synchronization; decoding uses WebGL's Texture bearer, uses the browser's native ability to decode to obtain layer material data, processes and draws it to Canvas to achieve final preview playback, and uses in the process The ability of the browser to perform hardware acceleration and avoid the transfer of layer data back and forth between the CPU and GPU; thus greatly improving the user experience.
- FIG. 1 is a schematic flowchart of a video preview playback method according to an embodiment of the present invention. As shown in FIG. 1 , the video preview playback method includes the following steps.
- Step 101 Acquire corresponding elements to be played through different element data types of the browser.
- the above-mentioned different element data types include: ImageBitmap, HTMLCanvasElement, HTMLVideoElement and HTMLImageElement, where the video element is loaded through the browser HTMLVideoElement, the image element is loaded through the browser HTMLImageElement, or the external decoded element is directly obtained through the browser ImageBitmap.
- Step 102 sequentially render each frame of image in the corresponding element to be played into a video processing element supported by the browser.
- the video processing element is a Canvas.
- HTMLVideoElement HTMLImageElement
- ImageBitmap rendered into Canvas by frame.
- Step 103 Add each frame of image in the video processing element to the effect processing space of the browser through the texture function in the browser, so that the effect processing space performs effect processing on each frame of the added image and draws it to the video processing element. for video preview playback.
- the above-mentioned effect processing space is WebGL.
- elements in the form of HTMLVideoElement, HTMLImageElement, and ImageBitmap are added to WebGL from Canvas through Texture, so that WebGL can process the added elements in the form of HTMLVideoElement, HTMLImageElement, and ImageBitmap and draw them into Canvas for video preview playback.
- the corresponding to-be-played element and the texture data source in the effect processing space are bound, so that each frame in the video processing element can be processed by the texture function in the browser.
- the image is added to the browser's effects processing space.
- WebGL's Texlmage2D interface to bind elements in the form of HTMLVideoElement, HTMLImageElement, ImageBitmap to the data source of WebGL's Texture.
- the player invokes HTMLVideoElement in different element data types of the browser to play video elements synchronously.
- the effect processing space performs effect processing on the stored current frame image through the Webassembly effect processor.
- the effect processing space draws the current frame image after effect processing into the video processing element.
- the video clips can be tuned during the video preview playback process. Since the processing process before the video preview playback takes a certain amount of time, each video element has a delay problem, so it is necessary to adjust the delay time. Synchronous processing is performed, that is, if the error between the playback time of the corresponding video element and the time of the corresponding video element in HTMLVideoElement is greater than the first threshold, HTMLVideoElemnt.seek is called to make the time of the corresponding video element in HTMLVideoElement jump to the corresponding video element. The playback time of the video element.
- the video preview playback method includes the following steps.
- Step 201 start the effect processing module, and initialize the WebGL therein as a place for effect processing.
- Step 202 start the rendering module, initialize the Canvas, and set it as the output target of WebGL as the place for rendering output.
- Step 203 use the browser HTMLVideoElement to load the video element, HTMLImageElement to load the picture element, or to obtain the decoded ImageBitmap input from the outside.
- Step 204 the HTMLVideoElement
- the material in the form of HTMLImageElement, ImageBitmap is added to WebGL through Texture.
- Step 205 the player starts playing and calls HTMLVideoElement.play Start the video clip to start playing in sync.
- Step 206 WebGL applies the effect processing in Webassembly to Texture according to the time interval specified by the video refresh frequency.
- Step 207 webGL draws the Texture after effect processing on the Canvas.
- Step 208 for all the video elements being played, convert the player time to the respective video time, if the error is greater than 100ms, call HTMLVideoElemnt.seek to jump to the specified time.
- step 209 steps 206-208 are repeated until the preview playback ends.
- the corresponding elements to be played are obtained through different element data types of the browser; then each frame of images in the corresponding elements to be played is sequentially rendered to the browser.
- Supported video processing elements then add each frame of image in the video processing element to the effect processing space of the browser through the map function in the browser, so that the effect processing space can perform effect processing on each added frame of image. It is drawn into the video processing element for video preview playback; thus, the element to be played is carried through the Texture of the browser WebGL, and the browser capability is used for decoding to enjoy hardware acceleration, which can support high-resolution video preview playback, thereby greatly Improved user experience.
- the embodiments of the present invention provide a computer-readable storage medium on which a video preview playing program is stored.
- the video preview playing program is executed by a processor, the above-mentioned video preview playing method is implemented.
- the processor by storing a video preview playback program, the processor implements the above-mentioned video preview playback method when executing the video preview playback program. It carries the element to be played, and uses the browser's ability to decode it to enjoy hardware acceleration. It can support high-resolution video preview playback, thus greatly improving the user experience.
- the embodiments of the present invention provide a computer device, including a memory, a processor, and a computer program stored in the memory and running on the processor.
- the processor executes the program, the processor implements the following The above-mentioned video preview playback method.
- the video preview playback program is stored in the memory, so that the processor implements the above-mentioned video preview playback method when executing the video preview playback program. It carries the element to be played, and uses the browser's ability to decode it to enjoy hardware acceleration. It can support high-resolution video preview playback, thus greatly improving the user experience.
- the embodiment of the present invention proposes a video preview playback device.
- the video preview playback device includes an acquisition module 10 , a rendering module 20 and an effect processing module 30 .
- the obtaining module 10 is used to obtain the original video file and corresponding expected data information.
- the acquisition module 10 is used to acquire corresponding elements to be played through different element data types of the browser; the rendering module 20 is used to sequentially render each frame of images in the corresponding elements to be played into the video processing elements supported by the browser; effect The processing module 30 is configured to add each frame of image in the video processing element to the effect processing space of the browser through the texture function in the browser, so that the effect processing space performs effect processing on each added frame of image and draws it to the video. Process element for video preview playback.
- the corresponding to-be-played element and the texture data source in the effect processing space are bound, so that each of the video processing elements can be converted by the texture function in the browser.
- the frame image is added to the browser's effects processing space.
- the effects processing space is WebGL.
- a time conversion module (not shown in the figure) is also included; the time conversion module is used to obtain the time of each video element in the HTMLVideoElement when the player starts to play the video preview, and according to the current frame played by the player Obtain the playback time of the corresponding video element at the corresponding moment. If the error between the playback time of the corresponding video element and the time of the corresponding video element in HTMLVideoElement is greater than the first threshold, call HTMLVideoElemnt.seek to make the corresponding video element in HTMLVideoElement The time jumps to the playback time of the corresponding video element.
- the acquisition module is configured to acquire corresponding elements to be played through different element data types of the browser; the rendering module is used to sequentially convert the corresponding elements to be played.
- Each frame of image is rendered into the video processing element supported by the browser;
- the effect processing module is used to add each frame of image in the video processing element to the effect processing space of the browser through the texture function in the browser, so as to facilitate the effect processing
- the space performs effect processing on each frame of image added and draws it into the video processing element for video preview playback; thus, the element to be played is carried through the Texture of the browser WebGL, and the browser capability is used to decode it to enjoy hardware acceleration, It can support high-resolution video preview playback, which greatly improves the user experience.
- embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
- computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.
- These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions
- An apparatus implements the functions specified in a flow or flows of the flowcharts and/or a block or blocks of the block diagrams.
- These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in one or more of the flowcharts and/or one or more blocks of the block diagrams.
- any reference signs placed between parentheses shall not be construed as limiting the claim.
- the word “comprising” does not exclude the presence of elements or steps not listed in a claim.
- the word “a” or “an” preceding an element does not preclude the presence of a plurality of such elements.
- the invention can be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware.
- the use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.
- first and second are only used for description purposes, and cannot be interpreted as indicating or implying relative importance or the number of indicated technical features. Thus, a feature defined as “first” or “second” may expressly or implicitly include one or more of that feature.
- “plurality” means two or more, unless otherwise expressly and specifically defined.
- the terms “installed”, “connected”, “connected”, “fixed” and other terms should be understood in a broad sense, for example, it may be a fixed connection or a detachable connection , or integrated; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal connection of the two elements or the interaction relationship between the two elements.
- installed may be a fixed connection or a detachable connection , or integrated; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal connection of the two elements or the interaction relationship between the two elements.
- a first feature "on” or “under” a second feature may be in direct contact between the first and second features, or the first and second features indirectly through an intermediary touch.
- the first feature being “above”, “over” and “above” the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is level higher than the second feature.
- the first feature being “below”, “below” and “below” the second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature has a lower level than the second feature.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
Description
Claims (10)
- 一种视频预览播放方法,其特征在于,包括以下步骤:通过浏览器的不同元素数据类型获取对应的待播放元素;依次将所述对应的待播放元素中的每一帧图像渲染到所述浏览器支持的视频处理元素中;通过所述浏览器中的贴图功能将所述视频处理元素中的每一帧图像添加到所述浏览器的效果处理空间中,以便所述效果处理空间对添加的每一帧图像进行效果处理后绘制到所述视频处理元素中以进行视频预览播放。
- 如权利要求1所述的视频预览播放方法,其特征在于,通过调用所述效果处理空间中的Texlmage2D接口将所述对应的待播放元素和所述效果处理空间中的贴图数据源进行绑定,以便通过所述浏览器中的贴图功能将所述视频处理元素中的每一帧图像添加到所述浏览器的效果处理空间中。
- 如权利要求1所述的视频预览播放方法,其特征在于,所述效果处理空间为WebGL。
- 如权利要求1所述的视频预览播放方法,其特征在于,播放器开始进行视频预览播放时包括以下步骤:S1,播放器调用所述浏览器的不同元素数据类型中的HTMLVideoElement进行视频元素同步播放;S2,根据视频刷新频率指定的时间间隔,所述效果处理空间通过Webassembly效果处理器对存储的当前帧图像进行效果处理;S3,根据指定的层级顺序,所述效果处理空间将经过效果处理后的当前帧图像绘制到所述视频处理元素中;S4,获取HTMLVideoElement中各个视频元素的时间,并根据播放器播放的当前帧对应的时刻获取对应的视频元素的播放时间,如果对应的视频元素的播放时间与HTMLVideoElement中的对应视频元素的时间之间的误差大于第一阈值,则调用HTMLVideoElemnt.seek使HTMLVideoElement中的对应视频元素的时间跳转到对应的视频元素的播放时间;S4,重复执行步骤S2-S4,直至播放结束。
- 一种计算机可读存储介质,其特征在于,其上存储有视频预览播放程序,该视频预览播放程序被处理器执行时实现如权利要求1-4中任一项所述的视频预览播放方法。
- 一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时,实现如权利要求1-4中任一项所述的视频预览播放方法。
- 一种视频预览播放装置,其特征在于,包括:获取模块,所述获取模块用于通过浏览器的不同元素数据类型获取对应的待播放元素;渲染模块,所述渲染模块用于依次将所述对应的待播放元素中的每一帧图像渲染到所述浏览器支持的视频处理元素中;效果处理模块,所述效果处理模块用于通过所述浏览器中的贴图功能将所述视频处理元素中的每一帧图像添加到所述浏览器的效果处理空间中,以便所述效果处理空间对添加的每一帧图像进行效果处理后绘制到所述视频处理元素中以进行视频预览播放。
- 如权利要求7所述的视频预览播放装置,其特征在于,通过调用所述效果处理空间中的Texlmage2D接口将所述对应的待播放元素和所述效果处理空间中的贴图数据源进行绑定,以便通过所述浏览器中的贴图功能将所述视频处理元素中的每一帧图像添加到所述浏览器的效果处理空间中。
- 如权利要求7所述的视频预览播放装置,其特征在于,所述效果处理空间为WebGL。
- 如权利要求7所述的视频预览播放装置,其特征在于,还包括时间换算模块,所述时间换算模块用于在播放器开始进行视频预览播放时获取HTMLVideoElement中各个视频元素的时间,并根据播放器播放的当前帧对应的时刻获取对应的视频元素的播放时间,如果对应的视频元素的播放时间与HTMLVideoElement中的对应视频元素的时间之间的误差大于第一阈值,则调用HTMLVideoElemnt.seek使HTMLVideoElement中的对应视频元素的时间跳转到对应的视频元素的播放时间。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110063617.8 | 2021-01-18 | ||
CN202110063617.8A CN112929733B (zh) | 2021-01-18 | 2021-01-18 | 视频预览播放方法及装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022151688A1 true WO2022151688A1 (zh) | 2022-07-21 |
Family
ID=76163016
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/106949 WO2022151688A1 (zh) | 2021-01-18 | 2021-07-16 | 视频预览播放方法及装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112929733B (zh) |
WO (1) | WO2022151688A1 (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112929733B (zh) * | 2021-01-18 | 2022-06-28 | 稿定(厦门)科技有限公司 | 视频预览播放方法及装置 |
CN114071229B (zh) * | 2021-12-08 | 2023-06-09 | 四川启睿克科技有限公司 | 一种解决SurfaceView渲染器重载视频解码时回收延迟的方法 |
CN114666514B (zh) * | 2022-03-18 | 2024-02-02 | 稿定(厦门)科技有限公司 | 数据处理方法、装置、电子设备和存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160248833A1 (en) * | 2015-02-25 | 2016-08-25 | StreamRail Ltd. | System and method for playing a video on mobile web environments |
CN110225404A (zh) * | 2019-06-17 | 2019-09-10 | 深圳市正易龙科技有限公司 | 视频播放方法、终端及计算机可读存储介质 |
CN110322532A (zh) * | 2018-03-27 | 2019-10-11 | 优酷网络技术(北京)有限公司 | 动态图像的生成方法及装置 |
CN111901616A (zh) * | 2020-07-15 | 2020-11-06 | 天翼视讯传媒有限公司 | 一种基于H5/WebGL的改进多视角直播渲染的方法 |
CN112929733A (zh) * | 2021-01-18 | 2021-06-08 | 稿定(厦门)科技有限公司 | 视频预览播放方法及装置 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103491452B (zh) * | 2013-09-25 | 2017-01-25 | 北京奇虎科技有限公司 | 播放网页中视频的方法及装置 |
US20170026721A1 (en) * | 2015-06-17 | 2017-01-26 | Ani-View Ltd. | System and Methods Thereof for Auto-Playing Video Content on Mobile Devices |
WO2017130035A1 (en) * | 2016-01-27 | 2017-08-03 | Aniview Ltd. | A system and methods thereof for auto-playing video content on mobile devices |
CN106506525B (zh) * | 2016-11-29 | 2019-10-25 | 北京旷视科技有限公司 | 用于在浏览器上播放视频流的方法及装置 |
CN110198479B (zh) * | 2019-05-24 | 2021-10-22 | 浪潮软件股份有限公司 | 一种基于webassembly的浏览器音视频解码播放方法 |
CN110557670B (zh) * | 2019-09-17 | 2021-12-21 | 广州方硅信息技术有限公司 | 在网页页面中播放视频的方法、装置、终端和存储介质 |
CN111641838A (zh) * | 2020-05-13 | 2020-09-08 | 深圳市商汤科技有限公司 | 一种浏览器视频播放方法、装置以及计算机存储介质 |
-
2021
- 2021-01-18 CN CN202110063617.8A patent/CN112929733B/zh active Active
- 2021-07-16 WO PCT/CN2021/106949 patent/WO2022151688A1/zh active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160248833A1 (en) * | 2015-02-25 | 2016-08-25 | StreamRail Ltd. | System and method for playing a video on mobile web environments |
CN110322532A (zh) * | 2018-03-27 | 2019-10-11 | 优酷网络技术(北京)有限公司 | 动态图像的生成方法及装置 |
CN110225404A (zh) * | 2019-06-17 | 2019-09-10 | 深圳市正易龙科技有限公司 | 视频播放方法、终端及计算机可读存储介质 |
CN111901616A (zh) * | 2020-07-15 | 2020-11-06 | 天翼视讯传媒有限公司 | 一种基于H5/WebGL的改进多视角直播渲染的方法 |
CN112929733A (zh) * | 2021-01-18 | 2021-06-08 | 稿定(厦门)科技有限公司 | 视频预览播放方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN112929733A (zh) | 2021-06-08 |
CN112929733B (zh) | 2022-06-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022151688A1 (zh) | 视频预览播放方法及装置 | |
US10930318B2 (en) | Gapless video looping | |
KR101365829B1 (ko) | 대화형 멀티미디어 프리젠테이션을 재생하는 방법을 수행하는 컴퓨터 실행가능 명령어들이 인코딩된 컴퓨터 판독가능 매체, 및 대화형 멀티미디어 프리젠테이션을 재생하는 프리젠테이션 시스템 및 장치 | |
CN111899322B (zh) | 视频处理方法、动画渲染sdk和设备及计算机存储介质 | |
KR20140145584A (ko) | 재생속도 변경이 가능한 실시간 온라인 비디오 재생 방법 및 시스템 | |
JP5474417B2 (ja) | 動画データ生成装置、動画データ生成システム、動画データ生成方法およびコンピュータープログラム | |
CN105491396A (zh) | 一种多媒体信息处理方法及服务器 | |
US7941739B1 (en) | Timeline source | |
CN102044058A (zh) | 一种在电子设备中处理图片的方法、系统及电子设备 | |
JP2007140941A (ja) | 動画生成装置、動画生成方法、及びプログラム | |
US7934159B1 (en) | Media timeline | |
JP2000106677A (ja) | 圧縮ストリーム復号装置および圧縮ストリーム復号方法 | |
CN1110810C (zh) | Dvd播放机中解码视频数据的方法 | |
US11960444B2 (en) | Methods and systems for providing file data for a media file | |
TW200425079A (en) | Information storage medium storing moving picture data and additional data, reproducing apparatus and method therefor | |
JP2004266742A (ja) | ディスク装置、ディスク記録方法、ディスク再生方法、記録媒体、並びにプログラム | |
US20060088285A1 (en) | Reproduction apparatus, data processing system, reproduction method, program, and storage medium | |
CN114339289B (zh) | 视频播放处理的方法 | |
WO2022156165A1 (zh) | 基于Sox的音频处理方法及装置 | |
CN113938619A (zh) | 一种基于浏览器的视频合成方法、系统、储存装置 | |
JP2008108296A (ja) | 情報再生装置及び情報再生方法 | |
US7231138B1 (en) | Method and system for DVD single frame stepping backwards | |
JP2009003370A (ja) | 情報再生装置 | |
CN111813994B (zh) | 一种基于互动白板的数据处理、文件回放方法及装置 | |
CN115134658B (zh) | 视频处理方法、装置、设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21918883 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21918883 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 08.09.2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21918883 Country of ref document: EP Kind code of ref document: A1 |