CN113784207A - Video picture display method and device, electronic equipment and storage medium - Google Patents
Video picture display method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113784207A CN113784207A CN202110876245.0A CN202110876245A CN113784207A CN 113784207 A CN113784207 A CN 113784207A CN 202110876245 A CN202110876245 A CN 202110876245A CN 113784207 A CN113784207 A CN 113784207A
- Authority
- CN
- China
- Prior art keywords
- picture
- target object
- video
- video picture
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 90
- 238000003860 storage Methods 0.000 title claims abstract description 9
- 238000012545 processing Methods 0.000 claims abstract description 200
- 230000000694 effects Effects 0.000 claims abstract description 50
- 230000002452 interceptive effect Effects 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 10
- 230000011218 segmentation Effects 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000008569 process Effects 0.000 description 25
- 230000003313 weakening effect Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 238000001514 detection method Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 238000013135 deep learning Methods 0.000 description 3
- 238000003709 image segmentation Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000002156 mixing Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000005304 joining Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 238000011176 pooling Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4662—Learning process for intelligent management, e.g. learning user preferences for recommending movies characterized by learning algorithms
Abstract
The present disclosure relates to a method and an apparatus for displaying a video image, an electronic device, and a storage medium, wherein the method comprises: the method comprises the steps of displaying a video picture on a display interface, receiving an operation on the video picture, responding to the operation, identifying a target object from the video picture, dividing the target object from the video picture to obtain a target object picture, obtaining the target object picture and the video picture after the distinguishing processing based on the distinguishing processing of the target object picture and the video picture, combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture, and displaying the processing result picture on the display interface, so that the technical effect of enriching the display mode of the video picture is achieved, and further, the technical problem that the display mode of the video picture is too single in the related technology is solved.
Description
Technical Field
The present disclosure relates to the field of computers, and in particular, to a method and an apparatus for displaying a video frame, an electronic device, and a storage medium.
Background
Currently, in the related art, users are attracted to watch the interactive videos, and the interactive videos can be roughly divided into customizable interactive videos and conversational interactive videos, wherein the customizable interactive videos allow the users to adjust variable elements of some videos when watching the videos, but the videos do not change, and only part of interactive information is displayed, for example, a mouse is moved to a certain virtual object to display object information, so that the videos seen by each user are similar. And the conversational interactive video means that a user can directly participate in changing the sequence of the video or even the result in a conversational-like mode, the video can not be linear any more, and a designer of the video prepares a plurality of endings and paragraphs to allow a viewer to select the video by himself.
However, the above interactive videos all need to be configured by a worker in advance, and cannot be adjusted according to the personalized requirements of the user, which makes it difficult to actually provide a video picture allowing personalized display for the user.
Therefore, in the related art, there is a diversified need for the display mode of the video image, and different users want to watch the personalized video image, which results in the technical problem that the display mode of the video image is too single to satisfy the diversified need of the users.
Disclosure of Invention
The present disclosure provides a method and an apparatus for displaying a video image, an electronic device, and a storage medium, to at least solve the technical problem of a single video image display mode in the related art. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a method for displaying a video picture, including: displaying a video picture on a display interface; receiving an operation on the video picture; identifying a target object from the video picture in response to the operation; dividing the target object from the video picture to obtain a target object picture; obtaining a target object picture and a video picture after difference processing based on the difference processing of the target object picture and the video picture; combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture; and displaying the processing result picture on the display interface, wherein the playing time of the processing result picture is later than that of the video picture.
Optionally, the identifying a target object from the video picture in response to the operation includes: determining coordinates corresponding to the operation; determining a recognition target based on the coordinates, and determining a set of edge coordinates of the recognition target; determining the target object based on the set of edge coordinates.
Optionally, the obtaining the target object picture and the video picture after the difference processing based on the difference processing of the target object picture and the video picture includes: receiving a voice instruction; determining a distinguishing processing mode for performing distinguishing processing on the target object picture and the video picture based on the voice instruction; and performing distinguishing processing on the target object picture and the video picture by adopting the distinguishing processing mode to obtain the target object picture and the video picture after the distinguishing processing.
Optionally, the distinguishing processing manner includes one of: the original display effect of the video picture is reserved, and the display effect of the target object picture is adjusted; and keeping the original display effect of the target object picture, and adjusting the display effect of the video picture.
Optionally, adjusting the display effect of the target object picture includes one of: performing emphasis processing on the target object picture to highlight the display effect of the target object picture in the processing result picture, performing blur processing on the target object picture to weaken the display effect of the target object picture in the processing result picture, and updating the display state of the target object picture, wherein the display state comprises a dynamic display state and a static display state; or, adjusting the display effect of the video picture comprises one of: performing emphasis processing on the video picture to highlight the display effect of the video picture in the processing result picture, performing weakening processing on the video picture to weaken the display effect of the video picture in the processing result picture, and updating the display state of the video picture, wherein the display state comprises a dynamic display state and a static display state.
According to a second aspect of the embodiments of the present disclosure, there is provided a method for displaying a video screen, including: displaying a video picture on a display interface; receiving an operation on the video picture; responding to the operation, and displaying a processing result picture on the display interface, wherein the processing result picture is obtained by combining a target object picture and a video picture which are subjected to distinguishing processing, the target object picture and the video picture which are subjected to distinguishing processing are obtained by carrying out distinguishing processing on the target object picture and the video picture, the target object picture is obtained by dividing a target object from the video picture, and the target object is obtained by identifying from the video picture according to the operation.
According to a third aspect of the embodiments of the present disclosure, there is provided a display apparatus of a video screen, including: the first display module is used for displaying a video picture on a display interface; the first receiving module is used for receiving the operation of the video picture; the identification module is used for responding to the operation and identifying a target object from the video picture; the segmentation module is used for segmenting the target object from the video picture to obtain a target object picture; the processing module is used for obtaining a target object picture and a video picture after difference processing based on the difference processing of the target object picture and the video picture; the combination module is used for combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture; and the second display module is used for displaying the processing result picture on the display interface, wherein the playing time of the processing result picture is later than that of the video picture.
Optionally, the identification module includes:
the first determining unit is used for determining coordinates corresponding to the operation;
a second determination unit configured to determine a recognition target based on the coordinates, and determine an edge coordinate set of the recognition target;
a third determining unit, configured to determine the target object based on the edge coordinate set.
Optionally, the processing module includes: a receiving unit for receiving a voice instruction; a fourth determination unit configured to determine a distinction processing manner of performing distinction processing on the target object picture and the video picture based on the voice instruction; and the processing unit is used for executing the distinguishing processing on the target object picture and the video picture by adopting the distinguishing processing mode to obtain the target object picture and the video picture after the distinguishing processing.
Optionally, the processing unit includes: the first processing subunit is used for reserving the original display effect of the video picture and adjusting the display effect of the target object picture; and the second processing subunit is used for reserving the original display effect of the target object picture and adjusting the display effect of the video picture.
Optionally, the first processing subunit is configured to adjust the display effect of the target object picture by at least one of: performing emphasis processing on the target object picture to highlight the display effect of the target object picture in the processing result picture, performing blur processing on the target object picture to weaken the display effect of the target object picture in the processing result picture, and updating the display state of the target object picture, wherein the display state comprises a dynamic display state and a static display state; or, the second processing subunit is configured to adjust the display effect of the video picture by at least one of: performing emphasis processing on the video picture to highlight the display effect of the video picture in the processing result picture, performing weakening processing on the video picture to weaken the display effect of the video picture in the processing result picture, and updating the display state of the video picture, wherein the display state comprises a dynamic display state and a static display state.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a display apparatus of a video screen, including: the third display module is used for displaying a video picture on a display interface; the second receiving module is used for receiving the operation of the video picture; and the fourth display module is used for responding to the operation and displaying a processing result picture on the display interface, wherein the processing result picture is obtained by combining a target object picture and a video picture which are subjected to distinguishing processing, the target object picture and the video picture which are subjected to distinguishing processing are obtained by carrying out distinguishing processing on the target object picture and the video picture, the target object picture is obtained by dividing a target object from the video picture, and the target object is obtained by identifying from the video picture according to the operation.
According to a fifth aspect of the embodiments of the present disclosure, there is provided an electronic device for displaying a video screen, including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the method of displaying video pictures as described above.
According to still another aspect of the embodiments of the present disclosure, there is also provided a computer-readable storage medium having a computer program stored therein, wherein the computer program is configured to execute the above-mentioned video screen display method when running.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects: by displaying a video picture on a display interface, receiving an operation on the video picture, identifying a target object from the video picture in response to the operation, dividing the target object from the video picture to obtain a target object picture, obtaining the target object picture and the video picture after difference processing based on the difference processing of the target object picture and the video picture, combining the target object picture and the video picture after difference processing to obtain a processing result picture, and displaying the processing result picture on the display interface, according to the received operation to the video picture, the target object is identified, then different processing modes are respectively carried out to the target object and the original picture, so as to achieve the technical effect of enriching the display mode of the video picture, furthermore, the technical problem that the display mode of the video picture is too single in the related art is solved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
FIG. 1 is a schematic diagram of an application environment illustrating a method of displaying a video frame according to an exemplary embodiment;
FIG. 2 is a flow chart illustrating a method of displaying a video picture in accordance with an exemplary embodiment;
FIG. 3 is a schematic diagram illustrating an application scenario of a method for displaying a video frame according to an exemplary embodiment;
FIG. 4 is a diagram illustrating the effects of a method of displaying a video picture according to one exemplary embodiment;
FIG. 5 is a diagram illustrating effects of another method of displaying a video picture according to an exemplary embodiment;
FIG. 6 is a diagram illustrating effects of still another method of displaying a video picture in accordance with an exemplary embodiment;
FIG. 7 is a flow chart illustrating yet another method of displaying a video picture in accordance with an exemplary embodiment;
FIG. 8 is a block diagram of a display device for video frames in accordance with an exemplary embodiment;
FIG. 9 is a block diagram of another video frame display device according to an exemplary embodiment;
FIG. 10 is a block diagram illustrating an electronic device in accordance with an example embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
First, partial nouns or terms appearing in the description of the embodiments of the present application are applicable to the following explanations:
interactive videos can be roughly classified into 3 types:
the first type: customizable system
This type of interactive video (referred to as interactive video, the same applies below) allows the user to adjust the variable elements of some videos while watching, but the videos themselves are still linear, which makes everyone see the same video and not the same video. The Look Around interactive version MV mentioned at the beginning is representative of this class (music video does not change passages as the user clicks, it is playing all the time, only the rooms seen by everyone are different). The most basic experience is that when a video is watched, a mouse is moved to an object to display tag of information of the object, and the most common experience is that the mouse is used as a clothing shopping guide.
The second type: conversational style
The user can directly participate in changing the sequence of the video in a conversation-like mode and even the result, the video can not be linear any more, and a designer of the video prepares a plurality of endings and paragraphs for the viewer to select. For example, assuming that Windows is a piece of video, it is conversational, and our interaction with Windows is through a conversational window.
In the third category: probe type
As the name implies, the exploration-type interactive video generally provides little (even no) prompt, so that the user can feel interactive points and interactive modes in the video. Generally, scenes in real life are adopted for the videos (people can easily generate substitution feeling), and the scenes are played circularly until the users find the interaction points, before the users operate the videos.
The disclosure is illustrated below with reference to examples:
according to an aspect of the embodiments of the present disclosure, a method for displaying a video picture is provided, and optionally, in the present embodiment, the method for displaying a video picture may be applied to a hardware environment formed by a server 101 and a user terminal 103 as shown in fig. 1. As shown in fig. 1, a server 101 is connected to a terminal 103 through a network, and may be configured to provide a service to a user terminal or a client installed on the user terminal, where the client may be a video client, an instant messaging client, a browser client, an education client, a game client, or the like. The database 105 may be provided on or separate from the server for providing data storage services for the server 101, for example, a multimedia data storage server, and the network may include, but is not limited to: a wired network, a wireless network, wherein the wired network comprises: a local area network, a metropolitan area network, and a wide area network, the wireless network comprising: bluetooth, WIFI, and other wireless communication enabled networks, the user terminal 103 may be a terminal configured with an application program, and may include but is not limited to at least one of the following: a Mobile phone (such as an Android Mobile phone, an iOS Mobile phone, etc.), a notebook computer, a tablet computer, a palm computer, an MID (Mobile Internet Devices), a PAD, a desktop computer, an intelligent television, etc., where the server may be a single server, or a server cluster composed of a plurality of servers, or a cloud server, and a video application 107 using the display method of the video frame is displayed through a client installed on the user terminal 103 or the server 101.
As shown in fig. 1, the method for displaying the video image can be implemented in the user terminal 103 by the following steps:
s1, displaying a video picture on the display interface of the video application 107 on the user terminal;
s2, receiving an operation on the video screen on the video application 107 on the user terminal;
s3, responding to the operation on the video application 107 on the user terminal, and identifying a target object from the video picture;
s4, the target object is divided from the video picture on the video application 107 of the user terminal to obtain a target object picture;
s5, obtaining a target object picture and a video picture after difference processing based on the difference processing of the target object picture and the video picture on the video application 107 on the user terminal;
s6, combining the target object picture and the video picture after the distinguishing processing on the video application 107 on the user terminal to obtain a processing result picture;
and S7, displaying the processing result picture on the display interface on the video application 107 on the user terminal, wherein the playing time of the processing result picture is later than that of the video picture.
Optionally, in this embodiment, the display method of the video picture may also be implemented on the server 101 in a similar manner, or may also be implemented asynchronously by the server 101 and the user terminal 103.
The above is merely an example, and the present embodiment is not particularly limited.
Optionally, as an optional implementation manner, as shown in fig. 2, the method for displaying a video picture includes:
s202, displaying a video picture on a display interface;
s204, receiving the operation of the video picture;
s206, responding to the operation, and identifying a target object from the video picture;
s208, segmenting the target object from the video picture to obtain a target object picture;
s210, based on the difference processing of the target object picture and the video picture, obtaining a target object picture and a video picture after the difference processing;
s212, combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture;
s214, displaying the processing result picture on the display interface, wherein the playing time of the processing result picture is later than that of the video picture.
Optionally, in this embodiment, the playing time of the processing result picture is later than the playing time of the video picture, which may include but is not limited to processing the video picture in response to the operation after the video picture is played, and playing the processing result picture obtained after the processing immediately following the video picture, so as to quickly match the user operation, thereby achieving the technical effects of improving the user interaction efficiency and enriching the way in which the user watches the video picture.
Optionally, in this embodiment, the video frames may include, but are not limited to, video frames played in a player, and may also include, but is not limited to, video frames displayed in a web page or an applet.
Optionally, in this embodiment, the operation on the video frame may include, but is not limited to, a touch interactive operation, for example, the operation may be a single-machine interactive operation, a double-click interactive operation, a long-press interactive operation, and the like, and the operation is fed back to the player as a different instruction, that is, the user may touch a certain part of the frame being played (which is usually a target that can be detected by recognition) for subsequent processing.
Alternatively, in this embodiment, the target object may include, but is not limited to, a task, an object, beijing, and the like identified from a video frame.
Optionally, in this embodiment, the application scenarios of the display method of the video frame may include, but are not limited to, display processes of video frames of various application scenarios of medical treatment, finance, credit investigation, banking, government affairs, energy, education, security, building, game, traffic, internet of things, industry, and the like.
For example, the interactive video interaction process related by the present disclosure does not depend on the production mode of the original video resource, and can be widely applied to any type of video, for example, scenes in which viewers may focus on a part of video content, such as art programs, televisions, movie programs, etc., are mainly available in scenes, an interactive scene that can be actively controlled is provided, and the viewing experience is enhanced.
Optionally, in this embodiment, the above-mentioned identifying the target object from the video frame may include, but is not limited to, being implemented by using a target detection and tracking technology. For example, the object detection algorithms that are currently emerging in the academia and industry fall into 3 classes:
1) conventional target detection algorithms: cascade + HOG/DPM + Haar/SVM and a plurality of improvements and optimizations of the method;
2) candidate region/box + deep learning classification: the method comprises the following steps of extracting candidate regions and carrying out deep learning method-based classification on the corresponding regions, wherein the scheme comprises the following steps:
R-CNN(Selective Search+CNN+SVM)
SPP-net(ROI Pooling)
Fast R-CNN(Selective Search+CNN+ROI)
Faster R-CNN(RPN+CNN+ROI)
R-FCN and the like;
3) the regression method based on deep learning comprises the following steps: a method of YOLO/SSD/DenseBox, etc.; and the most recently occurring RRC detection in combination with RNN algorithm; deformable CNN in conjunction with DPM, and the like.
The above is merely an example, the present embodiment is not limited in any particular way, and any method that allows a target object to be identified from a video frame currently or in the future may be applied to the present disclosure to realize the display of the video frame.
Optionally, in this embodiment, the obtaining the target object picture by segmenting the target object from the video picture may include, but is not limited to, using an image segmentation technology. Among them, image segmentation is a technique and process that divides an image into several specific regions with unique properties and proposes an object of interest. It is a key step from image processing to image analysis. The existing image segmentation methods mainly include the following categories: a threshold-based segmentation method, a region-based segmentation method, an edge-based segmentation method, a particular theory-based segmentation method, and the like.
Optionally, in this embodiment, the above-mentioned target object picture and the video picture after the difference processing is obtained based on the difference processing of the target object picture and the video picture may include, but are not limited to, a picture in which a team target object is located and the video picture are subjected to the difference processing by adopting different image processing manners.
For example, when the user intends to emphasize the target object, the generation of the screen on which the target object is emphasized can be realized by performing the blurring process on the video screen and performing the fine emphasizing process or no process on the target object screen, and when the user intends to weaken the target object, the generation of the screen on which the target object is emphasized can be realized by performing the blurring process on the target object screen and performing the fine emphasizing process or no process on the video screen.
Optionally, in this embodiment, the combining the target object picture and the video picture after the distinguishing process to obtain the processing result picture may include, but is not limited to, a conventional image blending operation, for example, binary alpha blending may be simply performed to overlay the segmented subject on the original image, so as to present an effect of emphasizing or weakening.
For example, fig. 3 is a schematic view of an application scenario of a display method of a video picture according to an exemplary embodiment, and as shown in fig. 3, a network architecture applying the display method of the video picture at least includes a player 302, a detection module 304, a segmentation module 306, and a rendering module 308, which includes, but is not limited to, the following steps:
s1, interactive operation is obtained in the video application;
s2, responding to the interactive operation, detecting the target object from the video data;
s3, segmenting the video data to obtain the region of the target object;
s4, based on the difference processing of the target object picture and the video picture, obtaining the target object picture and the video picture after the difference processing;
and S5, combining the target object picture and the video picture after the distinguishing processing, and rendering the combined picture on a player.
The above is merely an example, and the present embodiment is not limited in any way.
By the embodiment, a mode of displaying a video picture on a display interface, receiving an operation on the video picture, identifying a target object from the video picture in response to the operation, segmenting the target object from the video picture to obtain a target object picture, obtaining the target object picture and the video picture after difference processing based on difference processing of the target object picture and the video picture, combining the target object picture and the video picture after difference processing to obtain a processing result picture, and displaying the processing result picture on the display interface is adopted, according to the received operation to the video picture, the target object is identified, then different processing modes are respectively carried out to the target object and the original picture, so as to achieve the technical effect of enriching the display mode of the video picture, furthermore, the technical problem that the display mode of the video picture is too single in the related art is solved.
As an optional solution, the identifying a target object from the video picture in response to the operation includes:
determining coordinates corresponding to the operation;
determining a recognition target based on the coordinates, and determining a set of edge coordinates of the recognition target;
determining the target object based on the set of edge coordinates.
Optionally, in this embodiment, the determining the coordinate corresponding to the operation may include, but is not limited to, decoding the video picture, determining the coordinate corresponding to the interactive operation, determining a target object to be identified according to the coordinate, further determining an edge coordinate set of the target object, and finally determining the target object from the video picture.
Optionally, in this embodiment, the above operations may include, but are not limited to, being implemented by a simple touch interactive system, that is, a user may touch a certain part of a picture being played (which is usually a target that can be identified and detected), and the operations may be fed back to the player in a single machine, double click, long press, and the like, for different instructions to be processed later.
For example, fig. 4 is a schematic diagram illustrating an application scenario of a display method of a video picture according to an exemplary embodiment, and as shown in fig. 4, the display method of the video picture may include, but is not limited to, the following steps:
s1, acquiring the original picture 402 played by the player;
s2, acquiring the interactive operation to determine the coordinate 404 corresponding to the interactive operation;
s3, determining an identification target and an edge coordinate set 406 of the identification target based on the coordinates 404;
s4, the target object 408 is determined based on the edge coordinate set 406.
The above is merely an example, and the present embodiment is not limited in any way.
As an alternative, the obtaining a target object picture and a video picture after difference processing based on difference processing of the target object picture and the video picture includes:
receiving a voice instruction;
determining a distinguishing processing mode for performing distinguishing processing on the target object picture and the video picture based on the voice instruction;
and performing distinguishing processing on the target object picture and the video picture by adopting the distinguishing processing mode to obtain the target object picture and the video picture after the distinguishing processing.
Optionally, in this embodiment, the receiving the voice instruction may include, but is not limited to, being implemented by a touch + sound control system, for example, the user touches a picture that is actually played and immediately speaks a command, for example: the method comprises the steps of translating voices such as annoying and liking voices into a specific supportable command through voice recognition (the existing voice recognition technology can be used, or only voice comparison matching is simply performed, the implementation mode is not limited, the voice recognition technology can be translated into supportable commands), further determining a distinguishing processing mode for performing distinguishing processing on a target object picture and a video picture based on the voice command, and performing distinguishing processing on the target object picture and the video picture by adopting the distinguishing processing mode to obtain the target object picture and the video picture after the distinguishing processing.
As an optional scheme, the distinguishing processing mode includes one of the following:
the original display effect of the video picture is reserved, and the display effect of the target object picture is adjusted;
and keeping the original display effect of the target object picture, and adjusting the display effect of the video picture.
Optionally, in this embodiment, the retaining the original display effect of the video picture, the adjusting the display effect of the target object picture may include, but is not limited to, performing an emphasis process on the target object picture, performing a de-emphasis process on the target object picture, and performing an animation display process on the target object picture, and the retaining the original display effect of the target object picture, and the adjusting the display effect of the video picture may include, but is not limited to, performing an emphasis process on the video picture, performing a de-emphasis process on the video picture, and performing an animation display process on the video picture.
It should be noted that, besides emphasizing and weakening the two basic means, other interactive effects, rich experiences, such as coloring, zooming in, zooming out, increasing resolution, decreasing resolution, and the like, can be included.
As an alternative to this, it is possible to,
adjusting the display effect of the target object picture comprises one of the following steps: performing emphasis processing on the target object picture, performing weakening processing on the target object picture, and performing animation display processing on the target object picture;
alternatively, the first and second electrodes may be,
adjusting the display effect of the video picture comprises one of the following: and performing emphasis processing on the video picture, performing weakening processing on the video picture, and performing animation display processing on the video picture.
Alternatively, in this embodiment, the manner of performing the emphasis process may include, but is not limited to, performing a fine emphasis process, such as exposure, contrast, and the like. The above-mentioned ways of performing the weakening process may include, but are not limited to, blurring the original picture, and several typical ways such as Gaussian Blur (Gaussian Blur), mosaic (Pixellate), etc., which all may adjust the blurring effect through the blurring strength parameter, or may also include, but are not limited to, various convolution with function image (convolution kernel), edge modification on the main picture to achieve a natural looking effect, etc.
For example, fig. 5 is a schematic view of an application scenario of a display method of a video picture according to an exemplary embodiment, and as shown in fig. 5, the display method of a video picture includes, for example, performing an animation display process on a target object picture and performing a weakening process on the video picture in the manner of the above-mentioned separate processes, and the display method of a video picture may include, but is not limited to, the following steps:
s1, displaying a video picture;
s2, acquiring interactive operation and selecting a target object;
s3, executing animation display processing to the target object picture, and executing weakening processing to the video picture;
and S4, synthesizing a processing result picture.
For example, fig. 6 is a schematic view of an application scenario of a display method of a video picture according to an exemplary embodiment, and as shown in fig. 6, the display method of the video picture includes, for example, performing a weakening process on a target object picture and performing an animation display process on the video picture in the manner of the above-mentioned separate processes, and the display method of the video picture may include, but is not limited to, the following steps:
s1, displaying a video picture;
s2, acquiring interactive operation and selecting a target object;
s3, weakening the target object picture and displaying the video picture;
and S4, synthesizing a processing result picture.
According to a second aspect of the embodiments of the present disclosure, there is provided a method for displaying a video screen, as shown in fig. 7, the method for displaying a video screen includes:
s702, displaying a video picture on a display interface;
s704, receiving the operation of the video picture;
s706, responding to the operation, and displaying a processing result picture on the display interface, wherein the processing result picture is obtained by combining a target object picture and a video picture which are subjected to distinguishing processing, the target object picture and the video picture which are subjected to distinguishing processing are obtained by performing distinguishing processing on the target object picture and the video picture, the target object picture is obtained by dividing a target object from the video picture, and the target object is obtained by identifying from the video picture according to the operation.
It should be noted that the user information (including but not limited to user device information, user personal information, etc.) referred to in the present disclosure is information authorized by the user or sufficiently authorized by each party.
Fig. 8 is a block diagram of a display device for video pictures according to an exemplary embodiment. Referring to fig. 8, the apparatus includes a first display module 802, a first receiving module 804, an identifying module 806, a dividing module 808, a processing module 810, a combining module 812, and a second display module 814.
According to a third aspect of the embodiments of the present disclosure, there is provided a display apparatus of a video screen, including:
the first display module 802 is configured to display a video frame on a display interface;
the first receiving module 804 is configured to receive an operation on the video picture;
the identification module 806, configured to respond to the operation, identify a target object from the video picture;
the segmentation module 808 is configured to segment the target object from the video frame to obtain a target object frame;
the processing module 810 is configured to obtain a target object picture and a video picture after difference processing based on difference processing of the target object picture and the video picture;
the combining module 812 is configured to combine the target object picture and the video picture after the distinguishing processing to obtain a processing result picture;
the second display module 814 is configured to display the processing result picture on the display interface, wherein the playing time of the processing result picture is later than the playing time of the video picture.
As an alternative, the identifying module 806 identifies the target object from the video frame in response to the operation by:
determining coordinates corresponding to the operation;
determining a recognition target based on the coordinates, and determining a set of edge coordinates of the recognition target;
determining the target object based on the set of edge coordinates.
As an alternative, the processing module 810 obtains the target object picture and the video picture after the difference processing based on the difference processing of the target object picture and the video picture as follows:
receiving a voice instruction;
determining a distinguishing processing mode for performing distinguishing processing on the target object picture and the video picture based on the voice instruction;
and performing distinguishing processing on the target object picture and the video picture by adopting the distinguishing processing mode to obtain the target object picture and the video picture after the distinguishing processing.
As an optional scheme, the distinguishing processing mode includes one of the following:
the original display effect of the video picture is reserved, and the display effect of the target object picture is adjusted;
and keeping the original display effect of the target object picture, and adjusting the display effect of the video picture.
As an alternative, adjusting the display effect of the target object picture includes one of: performing emphasis processing on the target object picture, performing weakening processing on the target object picture, and performing animation display processing on the target object picture; or, adjusting the display effect of the video picture comprises one of: and performing emphasis processing on the video picture, performing weakening processing on the video picture, and performing animation display processing on the video picture.
Fig. 9 is a block diagram of a display device for video pictures according to an exemplary embodiment. Referring to fig. 9, the apparatus includes a third display module 902, a second receiving module 904, and a fourth display module 906.
The third display module 902 is configured to display a video frame on a display interface;
the second receiving module 904 configured to receive an operation on the video picture;
the fourth display module 906 is configured to display a processing result picture on the display interface in response to the operation, where the processing result picture is obtained by combining a target object picture and a video picture after performing distinguishing processing, the target object picture and the video picture after the distinguishing processing are obtained by performing distinguishing processing on the target object picture and the video picture, the target object picture is obtained by dividing a target object from the video picture, and the target object is obtained by identifying from the video picture according to the operation.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
According to another aspect of the embodiment of the present invention, there is also provided an electronic device for implementing the above-mentioned video screen display method, where the electronic device may be a terminal device or a server shown in fig. 1. The present embodiment takes the electronic device as a server as an example for explanation. As shown in fig. 10, the electronic device comprises a memory 1002 and a processor 1004, the memory 1002 having stored therein a computer program, the processor 1004 being arranged to execute the steps of any of the method embodiments described above by means of the computer program.
Optionally, in this embodiment, the electronic device may be located in at least one network device of a plurality of network devices of a computer network.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, displaying a video picture on the display interface;
s2, receiving the operation of the video picture;
s3, responding to the operation, identifying the target object from the video picture;
s4, dividing the target object from the video picture to obtain a target object picture;
s5, based on the difference processing of the target object picture and the video picture, obtaining the target object picture and the video picture after the difference processing;
s6, combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture;
and S7, displaying a processing result picture on the display interface, wherein the playing time of the processing result picture is later than that of the video picture.
Optionally, in this embodiment, the processor may be further configured to execute, by the computer program, the following steps:
s1, displaying a video picture on the display interface;
s2, receiving the operation of the video picture;
s3, responding to the operation, identifying the target object from the video picture;
s4, dividing the target object from the video picture to obtain a target object picture;
s5, based on the difference processing of the target object picture and the video picture, obtaining the target object picture and the video picture after the difference processing;
s6, combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture;
and S7, displaying a processing result picture on the display interface, wherein the playing time of the processing result picture is later than that of the video picture.
Alternatively, it can be understood by those skilled in the art that the structure shown in fig. 10 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 10 is a diagram illustrating a structure of the electronic device. For example, the electronics may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 10, or have a different configuration than shown in FIG. 10.
The memory 1002 may be used to store software programs and modules, such as program instructions/modules corresponding to the method and apparatus for displaying a video picture in the embodiment of the present invention, and the processor 1004 executes various functional applications and data processing by running the software programs and modules stored in the memory 1002, that is, implements the above-described method for displaying a video picture. The memory 1002 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1002 may further include memory located remotely from the processor 1004, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The memory 1002 may be, but not limited to, specifically configured to store information such as historical user data. As an example, as shown in fig. 10, the memory 1002 may include, but is not limited to, a first display module 802, a first receiving module 804, an identifying module 806, a dividing module 808, a processing module 810, a combining module 812, and a second display module 814 of the display device including the video frame. In addition, the display device may further include, but is not limited to, other module units in the display device of the video frame, which is not described in this example again.
Optionally, the above-mentioned transmission device 1006 is used for receiving or sending data via a network. Examples of the network may include a wired network and a wireless network. In one example, the transmission device 1006 includes a Network adapter (NIC) that can be connected to a router via a Network cable and other Network devices so as to communicate with the internet or a local area Network. In one example, the transmission device 1006 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In addition, the electronic device further includes: a display 1008 for displaying user data of the target service; and a connection bus 1010 for connecting the respective module parts in the above-described electronic apparatus.
In other embodiments, the terminal device or the server may be a node in a distributed system, where the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting a plurality of nodes through a network communication. Nodes can form a Peer-To-Peer (P2P, Peer To Peer) network, and any type of computing device, such as a server, a terminal, and other electronic devices, can become a node in the blockchain system by joining the Peer-To-Peer network.
In an exemplary embodiment, there is also provided a computer program product comprising computer programs/instructions which, when executed by a processor, implement the above-described information transmission method.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for displaying a video frame, comprising:
displaying a video picture on a display interface;
receiving an operation on the video picture;
identifying a target object from the video picture in response to the operation;
dividing the target object from the video picture to obtain a target object picture;
obtaining a target object picture and a video picture after difference processing based on the difference processing of the target object picture and the video picture;
combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture;
and displaying the processing result picture on the display interface, wherein the playing time of the processing result picture is later than that of the video picture.
2. The method of claim 1, wherein identifying a target object from the video frame in response to the operation comprises:
determining coordinates corresponding to the operation;
determining a recognition target based on the coordinates, and determining a set of edge coordinates of the recognition target;
determining the target object based on the set of edge coordinates.
3. The method according to claim 1, wherein the deriving a target object picture and a video picture after difference processing based on difference processing of the target object picture and the video picture comprises:
receiving a voice instruction;
determining a distinguishing processing mode for performing distinguishing processing on the target object picture and the video picture based on the voice instruction;
and performing distinguishing processing on the target object picture and the video picture by adopting the distinguishing processing mode to obtain the target object picture and the video picture after the distinguishing processing.
4. The method of claim 3, wherein the discriminative processing mode comprises one of:
the original display effect of the video picture is reserved, and the display effect of the target object picture is adjusted;
and keeping the original display effect of the target object picture, and adjusting the display effect of the video picture.
5. A method for displaying a video frame, comprising:
displaying a video picture on a display interface;
receiving an interactive operation instruction for the video picture, wherein the interactive operation instruction is used for selecting a target object in the video picture;
and responding to the interactive operation instruction, and displaying a processing result picture obtained by combining a target object picture and a video picture after performing distinguishing processing on the target object picture on the display interface, wherein the target object picture is obtained by dividing the target object from the video picture.
6. A video picture display device, comprising:
the first display module is used for displaying a video picture on a display interface;
the first receiving module is used for receiving the operation of the video picture;
the identification module is used for responding to the operation and identifying a target object from the video picture;
the segmentation module is used for segmenting the target object from the video picture to obtain a target object picture;
the processing module is used for obtaining a target object picture and a video picture after difference processing based on the difference processing of the target object picture and the video picture;
the combination module is used for combining the target object picture and the video picture after the distinguishing processing to obtain a processing result picture;
and the second display module is used for displaying the processing result picture on the display interface, wherein the playing time of the processing result picture is later than that of the video picture.
7. A video picture display device, comprising:
the third display module is used for displaying a video picture on a display interface;
the second receiving module is used for receiving the operation of the video picture;
and the fourth display module is used for responding to the operation and displaying a processing result picture on the display interface, wherein the processing result picture is obtained by combining a target object picture and a video picture which are subjected to distinguishing processing, the target object picture and the video picture which are subjected to distinguishing processing are obtained by carrying out distinguishing processing on the target object picture and the video picture, the target object picture is obtained by dividing a target object from the video picture, and the target object is obtained by identifying from the video picture according to the operation.
8. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of displaying a video picture according to any one of claims 1 to 5.
9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of displaying a video picture according to any one of claims 1 to 5.
10. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the method for displaying video pictures according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110876245.0A CN113784207A (en) | 2021-07-30 | 2021-07-30 | Video picture display method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110876245.0A CN113784207A (en) | 2021-07-30 | 2021-07-30 | Video picture display method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113784207A true CN113784207A (en) | 2021-12-10 |
Family
ID=78836286
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110876245.0A Pending CN113784207A (en) | 2021-07-30 | 2021-07-30 | Video picture display method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113784207A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108230252A (en) * | 2017-01-24 | 2018-06-29 | 深圳市商汤科技有限公司 | Image processing method, device and electronic equipment |
| CN109285178A (en) * | 2018-10-25 | 2019-01-29 | 北京达佳互联信息技术有限公司 | Image partition method, device and storage medium |
| CN110598700A (en) * | 2019-09-16 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Object display method and device, storage medium and electronic device |
| CN110944139A (en) * | 2019-11-29 | 2020-03-31 | 维沃移动通信有限公司 | Display control method and electronic equipment |
| CN112118395A (en) * | 2020-04-23 | 2020-12-22 | 中兴通讯股份有限公司 | Video processing method, terminal and computer readable storage medium |
| CN113038232A (en) * | 2021-03-10 | 2021-06-25 | 深圳创维－Rgb电子有限公司 | Video playing method, device, equipment, server and storage medium |
-
2021
- 2021-07-30 CN CN202110876245.0A patent/CN113784207A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108230252A (en) * | 2017-01-24 | 2018-06-29 | 深圳市商汤科技有限公司 | Image processing method, device and electronic equipment |
| CN109285178A (en) * | 2018-10-25 | 2019-01-29 | 北京达佳互联信息技术有限公司 | Image partition method, device and storage medium |
| CN110598700A (en) * | 2019-09-16 | 2019-12-20 | 腾讯科技（深圳）有限公司 | Object display method and device, storage medium and electronic device |
| CN110944139A (en) * | 2019-11-29 | 2020-03-31 | 维沃移动通信有限公司 | Display control method and electronic equipment |
| CN112118395A (en) * | 2020-04-23 | 2020-12-22 | 中兴通讯股份有限公司 | Video processing method, terminal and computer readable storage medium |
| CN113038232A (en) * | 2021-03-10 | 2021-06-25 | 深圳创维－Rgb电子有限公司 | Video playing method, device, equipment, server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019242222A1 (en) | Method and device for use in generating information | |
| CN111476871B (en) | Method and device for generating video | |
| CN107820132B (en) | Live broadcast interaction method, device and system | |
| CN111935537A (en) | Music video generation method and device, electronic equipment and storage medium | |
| CN109993150B (en) | Method and device for identifying age | |
| CN111241340B (en) | Video tag determining method, device, terminal and storage medium | |
| CN104618803A (en) | Information push method, information push device, terminal and server | |
| CN112527115B (en) | User image generation method, related device and computer program product | |
| CN109274999A (en) | A kind of video playing control method, device, equipment and medium | |
| CN113766299B (en) | Video data playing method, device, equipment and medium | |
| US10638135B1 (en) | Confidence-based encoding | |
| JP2021034003A (en) | Human object recognition method, apparatus, electronic device, storage medium, and program | |
| KR102550305B1 (en) | Video automatic editing method and syste based on machine learning | |
| CN112330533A (en) | Mixed blood face image generation method, model training method, device and equipment | |
| CN106530377B (en) | Method and apparatus for manipulating three-dimensional animated characters | |
| CN113727039B (en) | Video generation method and device, electronic equipment and storage medium | |
| CN112866577B (en) | Image processing method and device, computer readable medium and electronic equipment | |
| CN110147481B (en) | Media content pushing method and device and storage medium | |
| CN113656125A (en) | Virtual assistant generation method and device and electronic equipment | |
| CN110431838B (en) | Method and system for providing dynamic content of face recognition camera | |
| CN113515696A (en) | Recommendation method and device, electronic equipment and storage medium | |
| WO2023115974A1 (en) | Multimedia resource recommendation method and apparatus and object representation network generation method and apparatus | |
| CN113784207A (en) | Video picture display method and device, electronic equipment and storage medium | |
| WO2023045635A1 (en) | Multimedia file subtitle processing method and apparatus, electronic device, computer-readable storage medium, and computer program product | |
| US20220383907A1 (en) | Method for processing video, method for playing video, and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211210 |
|
| RJ01 | Rejection of invention patent application after publication |