WO2022068639A1 - 一种基于视频的交互方法、装置、设备及存储介质 - Google Patents
一种基于视频的交互方法、装置、设备及存储介质 Download PDFInfo
- Publication number
- WO2022068639A1 WO2022068639A1 PCT/CN2021/119541 CN2021119541W WO2022068639A1 WO 2022068639 A1 WO2022068639 A1 WO 2022068639A1 CN 2021119541 W CN2021119541 W CN 2021119541W WO 2022068639 A1 WO2022068639 A1 WO 2022068639A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- target
- interactive
- video
- display
- page
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000003993 interaction Effects 0.000 title claims abstract description 38
- 230000002452 interceptive effect Effects 0.000 claims abstract description 151
- 230000001960 triggered effect Effects 0.000 claims abstract description 6
- 230000004044 response Effects 0.000 claims description 22
- 230000009191 jumping Effects 0.000 claims description 15
- 230000007704 transition Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000000873 masking effect Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
Definitions
- the embodiments of the present disclosure relate to the technical field of data processing, and in particular, to a video-based interaction method, apparatus, device, and storage medium.
- the present disclosure provides a video-based interaction method, device, device and storage medium, which can realize switching from a video playback interface to a video playback interface on the premise of ensuring user experience. target page to display.
- the present disclosure provides a video-based interaction method, the method comprising:
- the resource corresponding to the mask layer in the target video is loaded successfully; wherein, the resource includes the target display element on the current image frame corresponding to the target time point having a corresponding Interactive display images of relationships;
- the interactive display image is used as the display image of the interactive control, and the masked layer containing the interactive control is displayed on the current playback interface corresponding to the current image frame;
- the current playback interface In response to the triggering operation for the interactive control, the current playback interface jumps to a target page; wherein the content displayed on the target page has a corresponding relationship with the content displayed on the current image frame.
- the method further includes:
- the resource further includes an interaction guidance animation
- the interaction guidance animation includes at least two image frames, and the interaction guidance animation is played on the mask layer;
- the method further includes:
- the interaction guide animation is continued to be played on the mask layer based on the target playback frame.
- the current playback interface in response to the triggering operation for the interactive control, jumps to the target page, including:
- the current playing interface jumps to the target page in the form of a transition animation.
- the method before the transition animation is used to jump from the current playback interface to the target page, the method further includes:
- the control module sends a sound playing mark and a page display mark to the control module of the target page; wherein, the sound playing mark is used to indicate whether to play the audio resource corresponding to the target page, and the page display mark is used to indicate whether to display the A pre-rendered page, the control module is configured to play the audio resource based on the sound playing identifier, and display the pre-rendered page based on the page display identifier.
- the method further includes:
- the target video is continued to be played based on the target time point.
- the interactive display image is used as the display image of the interactive control, and the mask layer containing the interactive control is displayed on the current playback interface corresponding to the current image frame, including:
- a mask layer is displayed on the current playback interface corresponding to the current image frame, and based on the target display position information, an interactive control using the interactive display image as a display image is displayed on the mask layer.
- the present disclosure provides a video-based interaction device, the device comprising:
- the determining module is used to determine whether the resource corresponding to the masked layer in the target video is loaded successfully when the target video is played to the target time point; wherein, the resource includes the current image frame corresponding to the target time point.
- the target display element has an interactive display image with a corresponding relationship;
- a display module configured to use the interactive display image as the display image of the interactive control when it is determined that the resource corresponding to the masked layer is successfully loaded, and display the interactive control that contains the interactive control on the current playback interface corresponding to the current image frame the covering;
- a jumping module configured to jump from the current playback interface to a target page in response to a trigger operation for the interactive control; wherein the content displayed on the target page has the same content as the content displayed on the current image frame Correspondence.
- the present disclosure provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a terminal device, the terminal device is made to implement the above method.
- the present disclosure provides a device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, when the processor executes the computer program, Implement the above method.
- the embodiment of the present disclosure provides a video-based interaction method, when the target video is played to the target time point, it is determined whether the resource corresponding to the mask layer in the target video is loaded successfully.
- the resource corresponding to the mask layer includes an interactive display image that has a corresponding relationship with the target display element on the current image frame corresponding to the target time point. If it is determined that the resource corresponding to the mask layer is loaded successfully, the interactive display image is used as the display image of the interactive control, and the mask containing the interactive control is displayed on the current playback interface corresponding to the current image frame.
- the current playing interface jumps to the target page, so as to realize the display of the target page.
- the embodiment of the present disclosure displays a mask with interactive controls on the video playback interface, and jumps to the target page through the interactive controls, so as to realize the display of the target page.
- the settings of the interactive controls are related to the display elements in the video image frame. Therefore, the embodiment of the present disclosure can immerse the user from the video playback interface to the browsing of the target page, which ensures the user's experience.
- FIG. 1 is a flowchart of a video-based interaction method provided by an embodiment of the present disclosure
- FIG. 2 is a schematic diagram of a current image frame corresponding to a target time point according to an embodiment of the present disclosure
- FIG. 3 is an effect diagram of a mask layer including interactive controls provided by an embodiment of the present disclosure
- FIG. 4 is a flowchart of another video-based interaction method provided by an embodiment of the present disclosure.
- FIG. 5 is a schematic structural diagram of a video-based interaction device according to an embodiment of the present disclosure.
- FIG. 6 is a schematic structural diagram of a video-based interaction device according to an embodiment of the present disclosure.
- the video-based interaction method is one of the important factors to ensure the user experience of short video software. Therefore, the video-based interaction method has also attracted much attention.
- the present disclosure provides a video-based interaction method.
- the target video is played to the target time point, it is determined whether the resource corresponding to the masked layer in the target video is loaded successfully.
- the interactive display image corresponding to the target display element on the current image frame corresponding to the point is used as the display image of the interactive control, and the mask layer containing the interactive control is displayed on the current playback interface.
- the current playback interface jumps to a target page that has a corresponding relationship with the content displayed on the current image frame, so as to realize the display of the target page.
- the embodiment of the present disclosure when the target video is played to the target time point, a mask with an interactive control is displayed on the video playback interface, and when a trigger operation for the interactive control is received, the current playing page jumps to the target page , to achieve the display of the target page. Therefore, the embodiment of the present disclosure can realize the function of switching from the video playing interface to the target page for presentation.
- the embodiment of the present disclosure can immerse the user from the video playback interface to the browsing of the target page, ensuring that user experience.
- an embodiment of the present disclosure provides a video-based interaction method.
- a flowchart of a video-based interaction method provided by an embodiment of the present disclosure includes:
- the resource includes an interactive display image that has a corresponding relationship with the target display element on the current image frame corresponding to the target time point.
- the target video refers to a video segment with a certain playback duration, such as an interactive advertisement video.
- the next frame or frames of images adjacent to the image frame corresponding to the target time point of the target video are used to display the mask layer.
- the target time point refers to the playback time point set based on the mask display requirements. For example, in the target video, the playback time point is the 5th to 7th second image frame to display the mask, then the target time point is the 5th second.
- the resources corresponding to the mask layer may include interactive display images, audio resources, etc., and the interactive display images have a corresponding relationship with the target display elements on the current image frame corresponding to the target time point in the target video.
- FIG. 2 the present disclosure is implemented A schematic diagram of a current image frame corresponding to a target time point is provided in the example, wherein the image corresponding to "compositing" is the target display image, and the interactive display image may be the same or similar image as the target display image.
- the audio resource can be the background music when the mask is displayed.
- the target video when the target video starts to play, it can be determined whether the target video includes a mask layer, and if it is determined that the target video includes a mask layer, the resources corresponding to the mask layer are preloaded to ensure that The mask can be displayed successfully. Specifically, the resource corresponding to the mask layer can be downloaded from the server based on the resource link.
- the mask layer may be displayed based on the current image frame corresponding to the target time point. If it is determined that the resource corresponding to the mask layer fails to be loaded, the target video does not need to be paused, but the target video can be played normally.
- the successful loading of the resources corresponding to the masked layer means that all the resources corresponding to the masked layer have been loaded, and the failure to load the resources corresponding to the masked layer means that at least one resource corresponding to the masked layer has not been loaded.
- the loaded interactive display image will be used as the display image of the interactive control and displayed on the current playback interface corresponding to the current image frame.
- the mask with the interactive control based on the display of the mask, presents an interactive interface to the user.
- the display position information of the interactive controls displayed on the mask layer is determined based on the display position information of the target display element corresponding to the interactive display image on the current image frame.
- the display position information of the interactive display image in the target video is preloaded. Specifically, in order to ensure the successful display of the masked layer, before the masked layer is displayed, the interactive display image is first downloaded from the server at the The display position information in the target video, specifically, the display position information is the position information and size information of the interactive display image relative to the target video, and the like.
- the loaded interactive display image In order to enable the loaded interactive display image to be accurately displayed on the screen of the current device, before displaying the mask, first obtain the screen size of the current device and the display position information of the interactive display image in the target video, and then based on the screen of the current device The size and the display position information of the interactive display image in the target video are used to determine the target display position information of the interactive display image on the screen of the current device. Finally, based on the target display position information, interactive controls are displayed on the mask layer on the current playback interface. Specifically, the display image on the interactive control is the loaded interactive display image.
- FIG. 3 a masking effect diagram including interactive controls provided by an embodiment of the present disclosure, wherein the displayed image of the interactive controls is the same as the image corresponding to “compositing” in FIG. 2 .
- the content displayed on the target page has a corresponding relationship with the content displayed on the current image frame.
- the current playback interface based on the triggering operation of the interactive control displayed on the mask layer, the current playback interface jumps to the target page, so as to realize the display of the target page.
- the content displayed on the target page may be related to the content displayed on the current image frame corresponding to the target time point, for example, it may be an advertisement page corresponding to the content on the current image frame.
- the target video when the target video is played to the target time point, it is determined whether the resource corresponding to the mask layer in the target video is loaded successfully, and if the loading is successful, the resource corresponding to the target time point is set in the resource.
- the target display element on the current image frame of the corresponding interactive display image is used as the display image of the interactive control, and the mask layer containing the interactive control is displayed on the current playback interface.
- the current playback interface jumps to a target page that has a corresponding relationship with the content displayed on the current image frame, so as to realize the display of the target page.
- the embodiment of the present disclosure when the target video is played to the target time point, a mask layer with an interactive control is displayed on the video playback interface, and when a trigger operation for the interactive control is received, the current playback interface jumps to the target page , to achieve the display of the target page. Therefore, the embodiment of the present disclosure can realize the function of switching from the video playing interface to the target page for presentation.
- the embodiment of the present disclosure can immerse the user from the video playback interface to the browsing of the target page, ensuring that user experience.
- the embodiments of the present disclosure further provide another video-based interaction method.
- FIG. 4 the flow of another video-based interaction method provided by the embodiments of the present disclosure is shown. Figure, wherein the method includes:
- the resource includes an interactive display image that has a corresponding relationship with the target display element on the current image frame corresponding to the target time point.
- an interactive guide animation may also be displayed to guide the user to trigger the interactive controls through corresponding operations.
- the interaction guide animation is used to guide the user to click on the "synthesized" interactive control to realize the triggering operation of the interactive control.
- the mask layer that is playing the interactive guidance animation is displayed on the current playback interface
- the user switches the application corresponding to the target video to the background running, and then switches from the background to the foreground running again, the interaction played on the mask layer will be displayed.
- the guidance animation will not continue to play based on the state before the switch, which reduces the user experience.
- the present disclosure when receiving a trigger operation for switching the application corresponding to the target video to running in the background, if an interactive guidance animation is played on the mask layer, the present disclosure first saves the current playback frame of the interactive guidance animation played on the mask layer. , as the target playback frame, and then switch the application corresponding to the target video to run in the background.
- the target playback frame When receiving a trigger operation of switching the application from the background to the foreground running, the target playback frame is acquired, and then the interaction guidance animation is continuously played on the mask layer based on the target playback frame. For example, if the target playback frame is the second frame, when the application switches back to the foreground, the interactive guide animation will continue to be played from the third frame of the interactive guide animation, so that the user can Continue to realize interaction based on the mask layer, which improves the user experience.
- a transition animation can be used to jump from the current playback interface to the target page. Since the transition animation can bring the user to the target page in a native and dynamic way of the video, the user's experience can also be guaranteed in the process of page jumping.
- the resource is pre-rendered. Specifically, before jumping to the target page, the target page is pre-rendered to obtain the pre-render page. At this time, the pre-render page is not displayed on the target page.
- the pre-rendered page is displayed on the target page in the form of a transition animation, so as to realize the effect of jumping from the current playing interface to the target page.
- the target page may have audio resources such as background music.
- the target page may not be displayed but the background music has been played in advance.
- the embodiments of the present disclosure control the playback timing of audio resources such as background music on the target page, and control the display timing of the content on the target page by sending the sound playback identifier and the page realization identifier to the control module of the target page.
- the sound playback identifier is used to indicate whether to play the audio resource corresponding to the target page
- the page display identifier is used to indicate whether to display the pre-rendered page
- the control module is used to play the audio resource based on the sound playback identifier, and based on the page display identifier Pre-rendered pages for display.
- sending the sound playback identifier and the page display identifier to the control module of the target page in the form of a notification message can effectively control the playback timing of audio resources such as background music on the target page, and control the display of content on the target page. timing, so as to avoid the situation that the target page is not displayed but the background music has been played in advance, and the user experience is improved.
- the preset time point is a playback time point in the target video that is later than the target time point.
- the target page during the display process of the target page, if the user triggers the return operation on the target page, the target page will jump to the video playback interface, and the target video will continue to be played on the video playback interface based on a preset time point .
- the preset time point may be the configuration data loaded from the server, specifically, the playback time point in the target video that is later than the target time point.
- the preset time point may be the next time point adjacent to the target time point in the target video.
- the target video may also continue to play the target video based on the preset time point.
- the target video is continuously played based on a preset time point.
- the embodiment of the present disclosure when the target video is played to the target time point, it is determined whether the resource corresponding to the mask layer in the target video is loaded successfully, and if the loading is successful, the resource corresponding to the target time point is set in the resource.
- the target display element on the current image frame of the corresponding interactive display image is used as the display image of the interactive control, and the mask layer containing the interactive control is displayed on the current playback interface.
- a transition animation is used to jump from the current playback interface to a target page corresponding to the content displayed on the current image frame, so as to display the target page. Therefore, on the basis of ensuring user experience, the embodiments of the present disclosure can realize the function of switching from the video playback interface to the target page for display.
- the embodiment of the present disclosure brings the user to the browsing of the target page in a native video dynamic way, and can also ensure the user's experience in the process of page jumping.
- the present disclosure further provides a video-based interaction device.
- a schematic structural diagram of the video-based interaction device provided by the embodiment of the present disclosure, the device includes: :
- the determining module 501 is configured to determine whether the resource corresponding to the mask layer in the target video is loaded successfully when the target video is played to the target time point; wherein, the resource includes the current image frame corresponding to the target time point.
- the target display element has an interactive display image with a corresponding relationship;
- the display module 502 is configured to use the interactive display image as a display image of an interactive control when it is determined that the resource corresponding to the masked layer is successfully loaded, and display the interactive display on the current playback interface corresponding to the current image frame that includes the interactive display The mask of the control;
- Jumping module 503 configured to jump from the current playback interface to a target page in response to a trigger operation for the interactive control; wherein the content displayed on the target page and the content displayed on the current image frame have a corresponding relationship.
- the device further includes:
- the return module is configured to jump from the target page to the video playing interface in response to the return operation triggered on the target page after the jumping from the current playing interface to the target page, and in the On the video playback interface, the target video is continued to be played based on a preset time point; wherein, the preset time point is a playback time point in the target video that is later than the target time point.
- the resource further includes an interactive guide animation
- the interactive guide animation includes at least two image frames, and the interactive guide animation is played on the mask layer
- the device further includes:
- a saving module configured to save the current playback frame of the interactive guidance animation played on the mask layer as a target playback frame in response to a trigger operation that the application program corresponding to the target video is switched to running in the background;
- a continue playing module configured to continue playing the interaction guide animation on the mask layer based on the target playing frame in response to a trigger operation of switching the application to foreground running.
- the jumping module is specifically used for:
- the current playing interface jumps to the target page in the form of a transition animation.
- the device further includes:
- a pre-rendering module configured to pre-render the target page before the transition animation is used to jump to the target page from the current playback interface to obtain a pre-rendered page
- a sending module configured to send a sound playing mark and a page display mark to the control module of the target page; wherein, the sound playing mark is used to indicate whether to play the audio resource corresponding to the target page, and the page display mark is used for Indicates whether to display the pre-rendered page, and the control module is configured to play the audio resource based on the sound playing identifier, and display the pre-rendered page based on the page display identifier.
- the device further includes:
- a video playback module configured to continue to play the target based on the target time point if it is determined that the resource corresponding to the masked layer fails to be loaded after the determination of whether the resource corresponding to the masked layer in the target video is successfully loaded video.
- the display module includes:
- a determination submodule configured to determine the target display position information of the interactive display image on the screen of the current device based on the screen size of the current device and the display position information of the interactive display image in the target video;
- a display sub-module configured to display a mask layer on the current playback interface corresponding to the current image frame, and based on the target display position information, display on the mask layer an interactive control that uses the interactive display image as a display image .
- the target video when the target video is played to the target time point, it is determined whether the resource corresponding to the mask layer in the target video is loaded successfully, and if the loading is successful, the resource corresponding to the target time point in the resource is loaded.
- the target display element on the current image frame has a corresponding interactive display image as the display image of the interactive control, and the mask layer containing the interactive control is displayed on the current playback interface.
- the current playback interface jumps to a target page that has a corresponding relationship with the content displayed on the current image frame, so as to realize the display of the target page.
- the embodiment of the present disclosure when the target video is played to the target time point, a mask layer with an interactive control is displayed on the video playback interface, and when a trigger operation for the interactive control is received, the current playback interface jumps to the target page , to achieve the display of the target page. Therefore, the embodiment of the present disclosure can realize the function of switching from the video playing interface to the display of the target page.
- the embodiment of the present disclosure can immerse the user from the video playback interface to the browsing of the target page, ensuring that user experience.
- embodiments of the present disclosure also provide a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed on a terminal device, the terminal device is made to implement the present invention.
- the video-based interaction method described in the disclosed embodiments is disclosed.
- an embodiment of the present disclosure also provides a video-based interaction device, as shown in FIG. 6 , which may include:
- Processor 601 , memory 602 , input device 603 and output device 604 The number of processors 601 in the video-based interactive device may be one or more, and one processor is taken as an example in FIG. 6 .
- the processor 601 , the memory 602 , the input device 603 and the output device 604 may be connected by a bus or in other ways, wherein the connection by a bus is taken as an example in FIG. 6 .
- the memory 602 can be used to store software programs and modules, and the processor 601 executes various functional applications and data processing of the video-based interactive device by running the software programs and modules stored in the memory 602 .
- the memory 602 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function, and the like. Additionally, memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
- the input device 603 may be used to receive input numerical or character information, and to generate signal input related to user settings and functional control of the video-based interactive device.
- the processor 601 loads the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 executes the executable files stored in the memory 602 application, so as to realize various functions of the above-mentioned video-based interactive device.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本公开提供了一种基于视频的交互方法、装置、设备及存储介质，所述方法包括：当目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功。资源包括与目标显示元素具有对应关系的交互显示图像。如果资源加载成功，将交互显示图像作为交互控件的显示图像，在当前播放界面上显示包含该交互控件的蒙层。在接收到针对该交互控件的触发操作时，由当前播放界面跳转至目标页面，实现对目标页面的展示。本公开在视频播放界面上显示有交互控件的蒙层，并通过触发交互控件跳转至对目标页面进行展示。另外，由于交互控件与视频图像帧中的显示元素有关，因此能够将用户从视频播放界面沉浸式的带入至目标页面的浏览，保证了用户的体验。
Description
本公开要求于2020年9月30日提交中国专利局、申请号为202011065398.9、发明名称为“一种基于视频的交互方法、装置、设备及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本公开中。
本公开实施例涉及数据处理技术领域，尤其涉及一种基于视频的交互方法、装置、设备及存储介质。
随着短视频软件的用户量不断增加，基于视频的交互方式，越来越受到人们的关注。
其中，在保证用户体验的前提下，如何实现从视频的播放界面切换至目标页面进行展示，是目前亟需解决的技术问题。
发明内容
为了解决上述技术问题或者至少部分地解决上述技术问题，本公开提供了一种基于视频的交互方法、装置、设备及存储介质，能够在保证用户体验的前提下，实现从视频的播放界面切换至目标页面进行展示。
第一方面，本公开提供了一种基于视频的交互方法，所述方法包括：
当目标视频播放至目标时间点时，确定所述目标视频中的蒙层对应的资源是否加载成功；其中，所述资源包括与所述目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像；
如果确定所述蒙层对应的资源加载成功，则将所述交互显示图像作为交互控件的显示图像，在所述当前图像帧对应的当前播放界面上显示包含有所述交互控件的蒙层；
响应于针对所述交互控件的触发操作，由所述当前播放界面跳转至目标页面；其中，所述目标页面上展示的内容与所述当前图像帧上展示的内容具有对应关系。
一种可选的实施方式中，在所述由所述当前播放界面跳转至目标页面之后，所述方法还包括：
响应于在所述目标页面上触发的返回操作，由所述目标页面跳转至视频播放界面，并在所述视频播放界面上基于预设时间点继续播放所述目标视频；其中，所述预设时间点为所述目标视频中晚于所述目标时间点的播放时间点。
一种可选的实施方式中，所述资源还包括交互指引动画，所述交互指引动画包括至少两个图像帧，所述蒙层上播放有所述交互指引动画；所述方法还包括：
响应于所述目标视频对应的应用程序切换至后台运行的触发操作，保存在所述蒙层上播放的所述交互指引动画的当前播放帧，作为目标播放帧；
响应于所述应用程序切换至前台运行的触发操作，基于所述目标播放帧继续在所述蒙层上播放所述交互指引动画。
一种可选的实施方式中，所述响应于针对所述交互控件的触发操作，由所述当前播放界面跳转至目标页面，包括：
响应于针对所述交互控件的触发操作，以转场动画的方式由所述当前播放界面跳转至目标页面。
一种可选的实施方式中，在所述以转场动画的方式由所述当前播放界面跳转至目标页面之前，所述方法还包括：
对目标页面进行预渲染，得到预渲染页面；
向所述目标页面的控制模块发送声音播放标识和页面显示标识；其中，所述声音播放标识用于表示是否播放所述目标页面对应的音频资源，所述页面显示标识用于表示是否显示所述预渲染页面，所述控制模块用于基于所述声音播放标识对所述音频资源进行播放，以及基于所述页面显示标识对所述预渲染页面进行显示。
一种可选的实施方式中，在所述确定所述目标视频中的蒙层对应的资源是否加载成功之后，所述方法还包括：
如果确定所述蒙层对应的资源加载失败，则基于所述目标时间点继续播放所述目标视频。
一种可选的实施方式中，所述将所述交互显示图像作为交互控件的显示图像，在所述当前图像帧对应的当前播放界面上显示包含有所述交互控件的蒙层，包括：
基于当前设备的屏幕尺寸和所述交互显示图像在所述目标视频中的显示位置信息，确定所述交互显示图像在所述当前设备的屏幕上的目标显示位置信息；
在所述当前图像帧对应的当前播放界面上显示蒙层，并基于所述目标显示位置信息，在所述蒙层上显示以所述交互显示图像作为显示图像的交互控件。
第二方面，本公开提供了一种基于视频的交互装置，所述装置包括：
确定模块，用于当目标视频播放至目标时间点时，确定所述目标视频中的蒙层对应的资源是否加载成功；其中，所述资源包括与所述目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像；
显示模块，用于在确定所述蒙层对应的资源加载成功时，将所述交互显示图像作为交互控件的显示图像，在所述当前图像帧对应的当前播放界面上显示包含有所述交互控件的蒙层；
跳转模块，用于响应于针对所述交互控件的触发操作，由所述当前播放界面跳转至目标页面；其中，所述目标页面上展示的内容与所述当前图像帧上展示的内容具有对应关系。
第三方面，本公开提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当所述指令在终端设备上运行时，使得所述终端设备实现上述的方法。
第四方面，本公开提供了一种设备，包括：存储器，处理器，及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述处理器执行所述计算机程序时，实现上述的方法。
本公开实施例提供的技术方案与现有技术相比具有如下优点：
本公开实施例提供了一种基于视频的交互方法，当目标视频播放至目标时间点时，确 定目标视频中的蒙层对应的资源是否加载成功。其中，蒙层对应的资源包括与目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像。如果确定蒙层对应的资源加载成功，则将交互显示图像作为交互控件的显示图像，在当前图像帧对应的当前播放界面上显示包含有该交互控件的蒙层。在接收到针对该交互控件的触发操作时，由当前播放界面跳转至目标页面，实现对目标页面的展示。
可见，本公开实施例在视频播放界面上显示带有交互控件的蒙层，并通过交互控件跳转至目标页面，实现对目标页面的展示。另外，交互控件的设置与视频图像帧中的显示元素有关，因此，本公开实施例能够将用户从视频播放界面沉浸式的带入至目标页面的浏览，保证了用户的体验。
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例，并与说明书一起用于解释本公开的原理。
为了更清楚地说明本公开实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，对于本领域普通技术人员而言，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本公开实施例提供的一种基于视频的交互方法的流程图；
图2为本公开实施例提供的一种目标时间点对应的当前图像帧的示意图；
图3为本公开实施例提供的一种包含交互控件的蒙层效果图；
图4为本公开实施例提供的另一种基于视频的交互方法的流程图；
图5为本公开实施例提供的一种基于视频的交互装置的结构示意图；
图6为本公开实施例提供的一种基于视频的交互设备的结构示意图。
为了能够更清楚地理解本公开的上述目的、特征和优点，下面将对本公开的方案进行进一步描述。需要说明的是，在不冲突的情况下，本公开的实施例及实施例中的特征可以相互组合。
在下面的描述中阐述了很多具体细节以便于充分理解本公开，但本公开还可以采用其他不同于在此描述的方式来实施；显然，说明书中的实施例只是本公开的一部分实施例，而不是全部的实施例。
随着短视频软件的用户量的迅速增长，如何保证短视频软件中用户的使用体验，越来越受到开发人员的关注。而基于视频的交互方式是保证短视频软件用户的使用体验的重要因素之一，因此，基于视频的交互方式也备受关注。
为此，本公开提供了一种基于视频的交互方法，在目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功，如果加载成功，则将资源中与目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像作为交互控件的显示图像，在当前播放界面上显示包含有该交互控件的蒙层。当接收到针对该交互控件的触发操 作时，由当前播放界面跳转至与当前图像帧上展示的内容具有对应关系的目标页面，实现对目标页面的展示。
本公开实施例在目标视频播放至目标时间点时，在视频播放界面上显示带有交互控件的蒙层，并在接收到针对该交互控件的触发操作时，由当前播放页面跳转至目标页面，实现对目标页面的展示。因此，本公开实施例可以实现从视频的播放界面切换至目标页面进行展示的功能。
另外，由于本公开实施例对交互控件的显示与目标视频的图像帧上的原生显示内容相关，因此，本公开实施例能够将用户从视频播放界面沉浸式的带入至目标页面的浏览，保证了用户的体验。
基于此，本公开实施例提供了一种基于视频的交互方法，参考图1，为本公开实施例提供的一种基于视频的交互方法的流程图，该方法包括：
S101：当目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功。
其中，资源包括与目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像,。
本公开实施例中，目标视频是指具有一定播放时长的视频片段，例如为互动广告视频等。具体的，在目标视频的目标时间点对应的图像帧的相邻下一帧或多帧图像，用于显示蒙层。其中，目标时间点是指基于蒙层显示需求设置的播放时间点。例如，目标视频中播放时间点为第5至7秒的图像帧，用于显示蒙层，则目标时间点为第5秒。
由于目标视频中的蒙层对应的资源是否加载成功，决定了蒙层是否能够显示成功，因此，本公开实施例为了保证对蒙层的成功显示，在显示蒙层之前，首先确定目标视频中的蒙层对应的资源是否加载成功，如果加载成功，则对蒙层进行显示，否则不显示蒙层，继续对目标视频进行播放。
实际应用中，在目标视频播放的过程中，当目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功。其中，蒙层对应的资源可以包括交互显示图像、音频资源等，交互显示图像与目标视频中的目标时间点对应的当前图像帧上的目标显示元素具有对应关系，参考图2，为本公开实施例提供的一种目标时间点对应的当前图像帧的示意图，其中，“合成”对应的图像即为目标显示图像，交互显示图像可以是与该目标显示图像相同或相似的图像。而音频资源可以为展示蒙层时的背景音乐。
一种可选的实施方式中，可以在目标视频开始播放时，确定该目标视频中是否包括蒙层，如果确定该目标视频中包括蒙层，则对蒙层对应的资源进行预加载，以保证蒙层能够成功显示。具体的，可以基于资源链接从服务端下载蒙层对应的资源。
S102：如果确定蒙层对应的资源加载成功，则将交互显示图像作为交互控件的显示图像，在当前图像帧对应的当前播放界面上显示包含有该交互控件的蒙层。
本公开实施例中，如果确定蒙层对应的资源加载成功，则可以基于目标时间点对应的当前图像帧显示蒙层。如果确定蒙层对应的资源加载失败，则不需要暂停目标视频，而是对目标视频正常播放即可。
其中，蒙层对应的资源加载成功，是指蒙层对应的资源均加载完成，而蒙层对应的资源加载失败，是指蒙层对应的至少一个资源未加载完成。
实际应用中，当目标视频播放至目标时间点时，如果确定蒙层对应的资源加载成功，则将加载成功的交互显示图像作为交互控件的显示图像，在当前图像帧对应的当前播放界面上显示带有该交互控件的蒙层，基于蒙层的显示，为用户展示一个能够互动的界面。
本公开实施例中，在蒙层上显示的交互控件的显示位置信息，是基于交互显示图像对应的目标显示元素在当前图像帧上的显示位置信息确定的。
一种可选的实施方式中，预先加载交互显示图像在目标视频中的显示位置信息，具体的，为了保证对蒙层的成功显示，在显示蒙层之前，首先从服务端下载交互显示图像在目标视频中的显示位置信息，具体的，显示位置信息是交互显示图像相对于目标视频的位置信息和尺寸信息等。
为了使得加载到的交互显示图像能够准确的显示于当前设备屏幕上，在显示蒙层之前，首先获取当前设备的屏幕尺寸和交互显示图像在目标视频中的显示位置信息，然后基于当前设备的屏幕尺寸和交互显示图像在目标视频中的显示位置信息，确定该交互显示图像在当前设备的屏幕上的目标显示位置信息。最终，基于该目标显示位置信息，在当前播放界面上的蒙层上显示交互控件。具体的，该交互控件上的显示图像为加载到的交互显示图像。
如图3所示，为本公开实施例提供的一种包含交互控件的蒙层效果图，其中，交互控件的显示图像与图2中的“合成”对应的图像相同。
S103：响应于针对交互控件的触发操作，由当前播放界面跳转至目标页面。
其中，目标页面上展示的内容与当前图像帧上展示的内容具有对应关系。
本公开实施例中，基于对蒙层上显示的交互控件的触发操作，由当前播放界面跳转至目标页面，实现对目标页面的展示。具体的，目标页面上展示内容可以与目标时间点对应的当前图像帧上展示的内容相关，例如可以为当前图像帧上的内容对应的广告页面等。
本公开实施例提供的基于视频的交互方法中，在目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功，如果加载成功，则将资源中与目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像作为交互控件的显示图像，在当前播放界面上显示包含有该交互控件的蒙层。当接收到针对该交互控件的触发操作时，由当前播放界面跳转至与当前图像帧上展示的内容具有对应关系的目标页面，实现对目标页面的展示。
本公开实施例在目标视频播放至目标时间点时，在视频播放界面上显示带有交互控件的蒙层，并在接收到针对该交互控件的触发操作时，由当前播放界面跳转至目标页面，实现对目标页面的展示。因此，本公开实施例可以实现从视频的播放界面切换至目标页面进行展示的功能。
另外，由于本公开实施例对交互控件的显示与目标视频的图像帧上的原生显示内容相关，因此，本公开实施例能够将用户从视频播放界面沉浸式的带入至目标页面的浏览，保证了用户的体验。
为了提高用户体验，在上述实施例的基础上，本公开实施例还提供了另一种基于视频 的交互方法，参考图4，为本公开实施例提供的另一种基于视频的交互方法的流程图，其中，该方法包括：
S401：当目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功。
其中，资源包括与目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像。
S402：如果确定蒙层对应的资源加载成功，则将交互显示图像作为交互控件的显示图像，在当前图像帧对应的当前播放界面上显示包含有该交互控件的蒙层。
本公开实施例中的S401和S402可参考上述实施例中的S101和S102的描述进行理解，在此不再赘述。
另外，在当前播放界面上显示包含有交互控件的蒙层时，还可以显示交互指引动画，用于指引用户通过相应的操作触发交互控件。如图3所示，交互指引动画用于指引用户点击“合成”交互控件，以实现对交互控件的触发操作。
实际应用中，在当前播放界面上显示正在播放交互指引动画的蒙层时，如果用户将目标视频对应的应用程序切换至后台运行后，再次由后台切换至前台运行，则蒙层上播放的交互指引动画不会基于切换前的状态继续播放，降低了用户体验。
为此，本公开实施例在接收到目标视频对应的应用程序切换至后台运行的触发操作时，如果蒙层上播放有交互指引动画，则首先保存蒙层上播放的交互指引动画的当前播放帧，作为目标播放帧，然后将目标视频对应的应用程序切换至后台运行。
当接收到该应用程序由后台切换至前台运行的触发操作时，获取目标播放帧，然后基于该目标播放帧继续在蒙层上播放该交互指引动画。例如，目标播放帧为第2帧，则在应用程序切换回前台运行时，从交互指引动画的第3帧开始继续播放该交互指引动画，以便用户能够基于切换到后台之前蒙层的显示状态，继续基于蒙层实现交互，提升了用户体验。
S403：响应于针对交互控件的触发操作，以转场动画的方式由当前播放界面跳转至目标页面。
本公开实施例中，在接收到针对交互控件的触发操作时，可以以转场动画的方式由当前播放界面跳转至目标页面。由于转场动画的方式能够以视频原生动态方式将用户带入至目标页面，因此，在页面跳转的过程中也能够保证用户的体验。
一种可选的实施方式中，在以转场动画的方式跳转至目标页面时，为了避免目标页面以转场动画的方式跳转时出现白屏或加载中的情况，需要对目标页面的资源进行预渲染，具体的，在跳转至目标页面之前，首先对目标页面进行预渲染，得到预渲染页面，此时，预渲染页面未展示在目标页面上。当检测到针对交互控件的触发操作时，以转场动画的方式，将预渲染页面展示于目标页面上，实现由当前播放界面跳转至目标页面的效果。
实际应用中，目标页面可能具有背景音乐等音频资源，在对目标页面进行预渲染后，以转场动画的方式跳转至目标页面时，可能出现目标页面未展示但背景音乐已经提前播放的情况。为此，本公开实施例通过向目标页面的控制模块发送声音播放标识和页面实现标识，控制目标页面上背景音乐等音频资源的播放时机，以及控制目标页面上内容的显示时 机。具体的，声音播放标识用于表示是否播放目标页面对应的音频资源，页面显示标识用于表示是否显示预渲染页面，控制模块用于基于声音播放标识对音频资源进行播放，以及基于页面显示标识对预渲染页面进行显示。
本公开实施例中，以通知消息的方式向目标页面的控制模块发送声音播放标识和页面显示标识，能够有效的控制目标页面上背景音乐等音频资源的播放时机，以及控制目标页面上内容的显示时机，从而避免出现目标页面未展示但背景音乐已经提前播放的情况，提升了用户体验。
S404：响应于在目标页面上触发的返回操作，由目标页面跳转至视频播放界面，并在视频播放界面上基于预设时间点继续播放目标视频。
其中，预设时间点为目标视频中晚于所述目标时间点的播放时间点。
本公开实施例中，在目标页面的展示过程中，如果用户触发目标页面上的返回操作，则由目标页面跳转至视频播放界面，并在视频播放界面上基于预设时间点继续播放目标视频。
具体的，预设时间点可以为从服务器加载到的配置数据，具体为目标视频中晚于目标时间点的播放时间点。例如，预设时间点可以为目标视频中与目标时间点相邻的下一个时间点。
一种可选的实施方式中，如果在蒙层的显示过程中，用户在预设时间内未点击交互控件，则目标视频也可以基于预设时间点继续播放目标视频。
另一种可选的实施方式中，如果在蒙层的显示过程中，用户主动触发目标视频的继续播放。具体的，当接收到用户在当前播放界面上的蒙层上触发的继续播放操作时，基于预设时间点继续播放目标视频。
本公开实施例提供的基于视频的交互方法中，在目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功，如果加载成功，则将资源中与目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像作为交互控件的显示图像，在当前播放界面上显示包含有该交互控件的蒙层。当接收到针对该交互控件的触发操作时，以转场动画的方式由当前播放界面跳转至与当前图像帧上展示的内容具有对应关系的目标页面，实现对目标页面的展示。因此，本公开实施例在保证用户体验的基础上，能够实现从视频的播放界面切换至目标页面进行展示的功能。
另外，本公开实施例通过以转场动画的方式跳转至目标页面，实现以视频原生动态方式将用户带入至对目标页面的浏览，在页面跳转的过程中也能够保证用户的体验。
与上述方法实施例基于同一个发明构思，本公开还提供了一种基于视频的交互装置，参考图5，为本公开实施例提供的一种基于视频的交互装置的结构示意图，所述装置包括：
确定模块501，用于当目标视频播放至目标时间点时，确定所述目标视频中的蒙层对应的资源是否加载成功；其中，所述资源包括与所述目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像；
显示模块502，用于在确定所述蒙层对应的资源加载成功时，将所述交互显示图像作为交互控件的显示图像，在所述当前图像帧对应的当前播放界面上显示包含有所述交互控 件的蒙层；
跳转模块503，用于响应于针对所述交互控件的触发操作，由所述当前播放界面跳转至目标页面；其中，所述目标页面上展示的内容与所述当前图像帧上展示的内容具有对应关系。
一种可选的实施方式中，所述装置还包括：
返回模块，用于在所述由所述当前播放界面跳转至目标页面之后，响应于在所述目标页面上触发的返回操作，由所述目标页面跳转至视频播放界面，并在所述视频播放界面上基于预设时间点继续播放所述目标视频；其中，所述预设时间点为所述目标视频中晚于所述目标时间点的播放时间点。
一种可选的实施方式中，所述资源还包括交互指引动画，所述交互指引动画包括至少两个图像帧，所述蒙层上播放有所述交互指引动画；所述装置还包括：
保存模块，用于响应于所述目标视频对应的应用程序切换至后台运行的触发操作，保存在所述蒙层上播放的所述交互指引动画的当前播放帧，作为目标播放帧；
继续播放模块，用于响应于所述应用程序切换至前台运行的触发操作，基于所述目标播放帧继续在所述蒙层上播放所述交互指引动画。
一种可选的实施方式中，所述跳转模块具体用于：
响应于针对所述交互控件的触发操作，以转场动画的方式由所述当前播放界面跳转至目标页面。
一种可选的实施方式中，所述装置还包括：
预渲染模块，用于在所述以转场动画的方式由所述当前播放界面跳转至目标页面之前，对目标页面进行预渲染，得到预渲染页面；
发送模块，用于向所述目标页面的控制模块发送声音播放标识和页面显示标识；其中，所述声音播放标识用于表示是否播放所述目标页面对应的音频资源，所述页面显示标识用于表示是否显示所述预渲染页面，所述控制模块用于基于所述声音播放标识对所述音频资源进行播放，以及基于所述页面显示标识对所述预渲染页面进行显示。
一种可选的实施方式中，所述装置还包括：
视频播放模块，用于在所述确定所述目标视频中的蒙层对应的资源是否加载成功之后，如果确定所述蒙层对应的资源加载失败，则基于所述目标时间点继续播放所述目标视频。
一种可选的实施方式中，所述显示模块包括：
确定子模块，用于基于当前设备的屏幕尺寸和所述交互显示图像在所述目标视频中的显示位置信息，确定所述交互显示图像在所述当前设备的屏幕上的目标显示位置信息；
显示子模块，用于在所述当前图像帧对应的当前播放界面上显示蒙层，并基于所述目标显示位置信息，在所述蒙层上显示以所述交互显示图像作为显示图像的交互控件。
本公开实施例提供的基于视频的交互装置，在目标视频播放至目标时间点时，确定目标视频中的蒙层对应的资源是否加载成功，如果加载成功，则将资源中与目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像作为交互控件的显示图像，在当前播放界面上显示包含有该交互控件的蒙层。当接收到针对该交互控件的触发操作时， 由当前播放界面跳转至与当前图像帧上展示的内容具有对应关系的目标页面，实现对目标页面的展示。
本公开实施例在目标视频播放至目标时间点时，在视频播放界面上显示带有交互控件的蒙层，并在接收到针对该交互控件的触发操作时，由当前播放界面跳转至目标页面，实现对目标页面的展示。因此，本公开实施例可以实现从视频的播放界面切换至目标页面的展示的功能。
另外，由于本公开实施例对交互控件的显示与目标视频的图像帧上的原生显示内容相关，因此，本公开实施例能够将用户从视频播放界面沉浸式的带入至目标页面的浏览，保证了用户的体验。
除了上述方法和装置以外，本公开实施例还提供了一种计算机可读存储介质，计算机可读存储介质中存储有指令，当所述指令在终端设备上运行时，使得所述终端设备实现本公开实施例所述的基于视频的交互方法。
另外，本公开实施例还提供了一种基于视频的交互设备，参见图6所示，可以包括：
处理器601、存储器602、输入装置603和输出装置604。基于视频的交互设备中的处理器601的数量可以一个或多个，图6中以一个处理器为例。在本公开的一些实施例中，处理器601、存储器602、输入装置603和输出装置604可通过总线或其它方式连接，其中，图6中以通过总线连接为例。
存储器602可用于存储软件程序以及模块，处理器601通过运行存储在存储器602的软件程序以及模块，从而执行基于视频的交互设备的各种功能应用以及数据处理。存储器602可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序等。此外，存储器602可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。输入装置603可用于接收输入的数字或字符信息，以及产生与基于视频的交互设备的用户设置以及功能控制有关的信号输入。
具体在本实施例中，处理器601会按照如下的指令，将一个或一个以上的应用程序的进程对应的可执行文件加载到存储器602中，并由处理器601来运行存储在存储器602中的应用程序，从而实现上述基于视频的交互设备的各种功能。
需要说明的是，在本文中，诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
以上所述仅是本公开的具体实施方式，使本领域技术人员能够理解或实现本公开。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的，本文中所定义的一般原理可以在不脱离本公开的精神或范围的情况下，在其它实施例中实现。因此，本公开将不 会被限制于本文所述的这些实施例，而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。
Claims (10)
- 一种基于视频的交互方法，其特征在于，所述方法包括：当目标视频播放至目标时间点时，确定所述目标视频中的蒙层对应的资源是否加载成功；其中，所述资源包括与所述目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像；如果确定所述蒙层对应的资源加载成功，则将所述交互显示图像作为交互控件的显示图像，在所述当前图像帧对应的当前播放界面上显示包含有所述交互控件的蒙层；响应于针对所述交互控件的触发操作，由所述当前播放界面跳转至目标页面；其中，所述目标页面上展示的内容与所述当前图像帧上展示的内容具有对应关系。
- 根据权利要求1所述的方法，其特征在于，在所述由所述当前播放界面跳转至目标页面之后，所述方法还包括：响应于在所述目标页面上触发的返回操作，由所述目标页面跳转至视频播放界面，并在所述视频播放界面上基于预设时间点继续播放所述目标视频；其中，所述预设时间点为所述目标视频中晚于所述目标时间点的播放时间点。
- 根据权利要求1所述的方法，其特征在于，所述资源还包括交互指引动画，所述交互指引动画包括至少两个图像帧，所述蒙层上播放有所述交互指引动画；所述方法还包括：响应于所述目标视频对应的应用程序切换至后台运行的触发操作，保存在所述蒙层上播放的所述交互指引动画的当前播放帧，作为目标播放帧；响应于所述应用程序切换至前台运行的触发操作，基于所述目标播放帧继续在所述蒙层上播放所述交互指引动画。
- 根据权利要求1所述的方法，其特征在于，所述响应于针对所述交互控件的触发操作，由所述当前播放界面跳转至目标页面，包括：响应于针对所述交互控件的触发操作，以转场动画的方式由所述当前播放界面跳转至目标页面。
- 根据权利要求4所述的方法，其特征在于，在所述以转场动画的方式由所述当前播放界面跳转至目标页面之前，所述方法还包括：对目标页面进行预渲染，得到预渲染页面；向所述目标页面的控制模块发送声音播放标识和页面显示标识；其中，所述声音播放标识用于表示是否播放所述目标页面对应的音频资源，所述页面显示标识用于表示是否显示所述预渲染页面，所述控制模块用于基于所述声音播放标识对所述音频资源进行播放，以及基于所述页面显示标识对所述预渲染页面进行显示。
- 根据权利要求1所述的方法，其特征在于，在所述确定所述目标视频中的蒙层对应的资源是否加载成功之后，所述方法还包括：如果确定所述蒙层对应的资源加载失败，则基于所述目标时间点继续播放所述目标视频。
- 根据权利要求1所述的方法，其特征在于，所述将所述交互显示图像作为交互控件的显示图像，在所述当前图像帧对应的当前播放界面上显示包含有所述交互控件的蒙层， 包括：基于当前设备的屏幕尺寸和所述交互显示图像在所述目标视频中的显示位置信息，确定所述交互显示图像在所述当前设备的屏幕上的目标显示位置信息；在所述当前图像帧对应的当前播放界面上显示蒙层，并基于所述目标显示位置信息，在所述蒙层上显示以所述交互显示图像作为显示图像的交互控件。
- 一种基于视频的交互装置，其特征在于，所述装置包括：确定模块，用于当目标视频播放至目标时间点时，确定所述目标视频中的蒙层对应的资源是否加载成功；其中，所述资源包括与所述目标时间点对应的当前图像帧上的目标显示元素具有对应关系的交互显示图像；显示模块，用于在确定所述蒙层对应的资源加载成功时，将所述交互显示图像作为交互控件的显示图像，在所述当前图像帧对应的当前播放界面上显示包含有所述交互控件的蒙层；跳转模块，用于响应于针对所述交互控件的触发操作，由所述当前播放界面跳转至目标页面；其中，所述目标页面上展示的内容与所述当前图像帧上展示的内容具有对应关系。
- 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质中存储有指令，当所述指令在终端设备上运行时，使得所述终端设备实现如权利要求1-7任一项所述的方法。
- 一种设备，其特征在于，包括：存储器，处理器，及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述处理器执行所述计算机程序时，实现如权利要求1-7任一项所述的方法。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2023506176A JP2023535639A (ja) | 2020-09-30 | 2021-09-22 | ビデオによるインタラクション方法、装置、デバイス及び記憶媒体 |
| EP21874300.3A EP4170475A4 (en) | 2020-09-30 | 2021-09-22 | METHOD, APPARATUS AND DEVICE FOR VIDEO-BASED INTERACTION, AND RECORDING MEDIUM |
| US18/090,302 US20230144966A1 (en) | 2020-09-30 | 2022-12-28 | Method, apparatus, and device for video-based interaction, and storage medium |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011065398.9 | 2020-09-30 | ||
| CN202011065398.9A CN114356155A (zh) | 2020-09-30 | 2020-09-30 | 一种基于视频的交互方法、装置、设备及存储介质 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/090,302 Continuation US20230144966A1 (en) | 2020-09-30 | 2022-12-28 | Method, apparatus, and device for video-based interaction, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022068639A1 true WO2022068639A1 (zh) | 2022-04-07 |
Family
ID=80949543
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/119541 WO2022068639A1 (zh) | 2020-09-30 | 2021-09-22 | 一种基于视频的交互方法、装置、设备及存储介质 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20230144966A1 (zh) |
| EP (1) | EP4170475A4 (zh) |
| JP (1) | JP2023535639A (zh) |
| CN (1) | CN114356155A (zh) |
| WO (1) | WO2022068639A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115695923A (zh) * | 2023-01-03 | 2023-02-03 | 北京搜狐新动力信息技术有限公司 | 弹幕人物遮罩显示方法、装置、电子设备及存储介质 |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115278329B (zh) * | 2022-06-22 | 2023-09-12 | 阿里巴巴（中国）有限公司 | 视频播放方法、系统和存储介质 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090037947A1 (en) * | 2007-07-30 | 2009-02-05 | Yahoo! Inc. | Textual and visual interactive advertisements in videos |
| CN105635788A (zh) * | 2015-12-29 | 2016-06-01 | 深圳Tcl数字技术有限公司 | 视频播放过程中插播广告的方法及装置 |
| CN107870920A (zh) * | 2016-09-23 | 2018-04-03 | 腾讯科技（深圳）有限公司 | 浏览器资源预拉取方法及装置 |
| CN108769814A (zh) * | 2018-06-01 | 2018-11-06 | 腾讯科技（深圳）有限公司 | 视频互动方法、装置及可读介质 |
| CN109660873A (zh) * | 2018-11-02 | 2019-04-19 | 北京达佳互联信息技术有限公司 | 基于视频的交互方法、交互装置和计算机可读存储介质 |
| CN110062270A (zh) * | 2019-04-24 | 2019-07-26 | 北京豆萌信息技术有限公司 | 广告展示方法和装置 |
| CN111669639A (zh) * | 2020-06-15 | 2020-09-15 | 北京字节跳动网络技术有限公司 | 一种活动入口的展示方法、装置、电子设备及存储介质 |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8281332B2 (en) * | 2007-05-02 | 2012-10-02 | Google Inc. | Animated video overlays |
| US20120084810A1 (en) * | 2010-10-04 | 2012-04-05 | Mark Thompson | System and Method for Integrating Interactive Region-Based Advertising Into Real Time Video Content |
| US20140013196A1 (en) * | 2012-07-09 | 2014-01-09 | Mobitude, LLC, a Delaware LLC | On-screen alert during content playback |
| CN103607650B (zh) * | 2013-11-29 | 2018-08-03 | 乐视网信息技术（北京）股份有限公司 | 一种广告插播方法及播放器 |
| US9576070B2 (en) * | 2014-04-23 | 2017-02-21 | Akamai Technologies, Inc. | Creation and delivery of pre-rendered web pages for accelerated browsing |
| CN104469521B (zh) * | 2014-12-24 | 2018-05-29 | 青岛海信网络科技股份有限公司 | 一种多版式视频媒体贯播控制方法 |
| CN107748690A (zh) * | 2017-10-30 | 2018-03-02 | 深圳Tcl新技术有限公司 | 应用跳转方法、装置和计算机存储介质 |
| US10911795B2 (en) * | 2018-10-05 | 2021-02-02 | Charley Michael Parks | System and method for providing an alert using tags on delivering digital content |
| WO2020132682A1 (en) * | 2018-12-21 | 2020-06-25 | Streamlayer Inc. | Method and system for providing interactive content delivery and audience engagement |
| CN111436004B (zh) * | 2019-01-11 | 2023-02-21 | 腾讯科技（深圳）有限公司 | 视频播放方法、装置和设备、计算机可读存储介质 |
| CN111026392B (zh) * | 2019-11-14 | 2023-08-22 | 北京金山安全软件有限公司 | 一种引导页面生成方法、装置及电子设备 |
| CN111263235A (zh) * | 2020-02-10 | 2020-06-09 | 北京奇艺世纪科技有限公司 | 一种视频播放方法、装置、电子设备及存储介质 |
| US11843574B2 (en) * | 2020-05-21 | 2023-12-12 | Snap Inc. | Featured content collection interface |
-
2020
- 2020-09-30 CN CN202011065398.9A patent/CN114356155A/zh active Pending
-
2021
- 2021-09-22 EP EP21874300.3A patent/EP4170475A4/en active Pending
- 2021-09-22 WO PCT/CN2021/119541 patent/WO2022068639A1/zh unknown
- 2021-09-22 JP JP2023506176A patent/JP2023535639A/ja active Pending
-
2022
- 2022-12-28 US US18/090,302 patent/US20230144966A1/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090037947A1 (en) * | 2007-07-30 | 2009-02-05 | Yahoo! Inc. | Textual and visual interactive advertisements in videos |
| CN105635788A (zh) * | 2015-12-29 | 2016-06-01 | 深圳Tcl数字技术有限公司 | 视频播放过程中插播广告的方法及装置 |
| CN107870920A (zh) * | 2016-09-23 | 2018-04-03 | 腾讯科技（深圳）有限公司 | 浏览器资源预拉取方法及装置 |
| CN108769814A (zh) * | 2018-06-01 | 2018-11-06 | 腾讯科技（深圳）有限公司 | 视频互动方法、装置及可读介质 |
| CN109660873A (zh) * | 2018-11-02 | 2019-04-19 | 北京达佳互联信息技术有限公司 | 基于视频的交互方法、交互装置和计算机可读存储介质 |
| CN110062270A (zh) * | 2019-04-24 | 2019-07-26 | 北京豆萌信息技术有限公司 | 广告展示方法和装置 |
| CN111669639A (zh) * | 2020-06-15 | 2020-09-15 | 北京字节跳动网络技术有限公司 | 一种活动入口的展示方法、装置、电子设备及存储介质 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4170475A4 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115695923A (zh) * | 2023-01-03 | 2023-02-03 | 北京搜狐新动力信息技术有限公司 | 弹幕人物遮罩显示方法、装置、电子设备及存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4170475A1 (en) | 2023-04-26 |
| CN114356155A (zh) | 2022-04-15 |
| US20230144966A1 (en) | 2023-05-11 |
| EP4170475A4 (en) | 2023-12-20 |
| JP2023535639A (ja) | 2023-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022068478A1 (zh) | 基于视频的交互、视频处理方法、装置、设备及存储介质 | |
| WO2022068639A1 (zh) | 一种基于视频的交互方法、装置、设备及存储介质 | |
| US11620784B2 (en) | Virtual scene display method and apparatus, and storage medium | |
| KR102590100B1 (ko) | 비디오 처리 방법 및 장치, 디바이스 및 저장 매체 | |
| WO2021135537A1 (zh) | 一种直播内容引入方法、装置、存储介质及设备 | |
| US20180376216A1 (en) | Video playback method and apparatus, and computer readable storage medium | |
| US11941728B2 (en) | Previewing method and apparatus for effect application, and device, and storage medium | |
| US11314391B2 (en) | Navigation bar controlling method and terminal | |
| US20240089543A1 (en) | Video processing method and apparatus, device, and storage medium | |
| WO2023116661A1 (zh) | 一种直播间的资源处理方法、装置、设备以及存储介质 | |
| CN107807934B (zh) | 页面显示方法和装置以及计算设备 | |
| WO2017140226A1 (zh) | 视频处理方法及其设备 | |
| US20240098362A1 (en) | Method, apparatus, device and storage medium for content capturing | |
| WO2024099275A1 (zh) | 媒体内容处理方法、装置、设备、可读存储介质及产品 | |
| CN113556568A (zh) | 一种云应用程序运行方法、系统、装置与存储介质 | |
| WO2023087991A1 (zh) | 一种页面跳转的方法、装置、计算机设备及存储介质 | |
| CN110286873B (zh) | 网页音频播放方法、装置、计算机设备及存储介质 | |
| CN113691865A (zh) | 一种多媒体播放方法及系统 | |
| CN107197387B (zh) | 在网页上分时显示视频信息的方法及装置 | |
| WO2023207549A1 (zh) | 视频处理方法、装置、设备及存储介质 | |
| CN114390214B (zh) | 一种视频生成方法、装置、设备以及存储介质 | |
| WO2024051612A1 (zh) | 视频内容预览交互方法、装置、电子设备及存储介质 | |
| US20230209136A1 (en) | Method and system for displaying video content | |
| CN116320584A (zh) | 一种网页视频播放方法、装置、电子设备及存储介质 | |
| CN108769777A (zh) | 一种多媒体文件的播放方法、装置、存储介质及终端 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21874300 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2021874300 Country of ref document: EP Effective date: 20230123 |
|
| ENP | Entry into the national phase |
Ref document number: 2023506176 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |