CN108156504B - Video display method and device - Google Patents
Video display method and device Download PDFInfo
- Publication number
- CN108156504B CN108156504B CN201711385085.XA CN201711385085A CN108156504B CN 108156504 B CN108156504 B CN 108156504B CN 201711385085 A CN201711385085 A CN 201711385085A CN 108156504 B CN108156504 B CN 108156504B
- Authority
- CN
- China
- Prior art keywords
- attribute information
- video picture
- feature element
- feature
- information corresponding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
Abstract
The embodiment of the invention provides a video display method and a video display device, which are used for solving the technical problem that in the prior art, when attribute information is displayed, a user is difficult to correspond each image element on a video picture with corresponding attribute information. The method comprises the following steps: determining at least one characteristic element from the video picture; determining attribute information corresponding to each characteristic element in the at least one characteristic element; and respectively displaying attribute information corresponding to each characteristic element in the at least one characteristic element in a preset area of the video picture.
Description
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to a video display method and apparatus.
Background
With the continuous development of image recognition technology, the prior art has been able to recognize feature elements on a dynamic video picture, obtain related attribute information of the feature elements, and present the attribute information to a user, for example, a face recognition technology, that is, a face image in a video picture is recognized to obtain related attribute information of a face, such as gender, age, expression, and the like.
However, in the prior art, when displaying the attribute information, it is difficult for a user to associate each feature element on a video screen with the corresponding attribute information.
Disclosure of Invention
The invention provides a video display method and a video display device, which are used for solving the technical problem that in the prior art, when attribute information is displayed, a user is difficult to correspond each feature element on a video picture with corresponding attribute information.
A first aspect of an embodiment of the present invention provides a video display method, including:
determining at least one characteristic element from the video picture;
determining attribute information corresponding to each characteristic element in the at least one characteristic element;
and respectively displaying attribute information corresponding to each characteristic element in the at least one characteristic element in a preset area of the video picture.
In the above scheme, after the feature elements on the video picture are identified, the attribute information corresponding to each feature element in the video picture is displayed in the predetermined area on the video picture, and when the user corresponds the feature elements and the attribute information, the user only needs to check each feature element and each attribute information on the video picture. And when the characteristic elements in the plurality of video pictures are identified simultaneously, the attribute information corresponding to each video picture is independently displayed in the respective preset area, so that the efficiency of associating and corresponding the characteristic elements on each video picture with the corresponding attribute information by a user is improved to a greater extent, and the user experience is improved.
Optionally, the determining at least one feature element from the video picture includes: determining all initial characteristic elements in a video picture, and determining the first time of occurrence of each initial characteristic element on the video picture; respectively calculating the time difference between the first appearance time of each initial characteristic element on the video picture and the current time; sequencing each initial characteristic element according to the sequence of the time difference from small to large; and taking the first N initial feature elements as at least one feature element determined from the video picture, wherein N is a preset number. Through the method, some newly appeared characteristic elements can be screened out from the video picture for identification according to the time when the characteristic elements appear on the video picture for the first time, and the attribute information corresponding to the screened characteristic elements is displayed on the preset area, so that the display is more reasonable, and the user experience is further improved.
Optionally, the display areas of the attribute information corresponding to each feature element in the at least one feature element on the predetermined region of the video picture are equal, and N is equal to a ratio of the total area of the predetermined region to the display area. Through the mode, the preset number N can be determined according to the total area and the display area of the preset area, and then the characteristic elements are screened, so that the display is more reasonable, and the user experience is further improved.
Optionally, the size of the display area and the size of the resolution of the video frame are in a negative correlation relationship. By the method, the size of the display area can be reasonably adjusted according to the resolution of the video picture, and the attribute information corresponding to each characteristic element can be displayed more clearly, so that the display is more reasonable, and the user experience is further improved.
Optionally, the predetermined area is: a right region of the video frame; and/or a left region of the video frame; and/or an upper region of the video picture; and/or a lower region of the video frame. By the method, valuable pictures can be avoided in the preset area with a high probability, the display is more reasonable, and the user experience is further improved.
Optionally, before displaying the attribute information corresponding to each feature element in the at least one feature element in the predetermined area of the video frame, the method further includes: determining position information of each characteristic element in the at least one characteristic element in the video picture; determining the predetermined area in the video picture according to the position information of each feature element in the at least one feature element; and the number of the characteristic elements in the preset area is less than a preset value. By the method, valuable picture display can be avoided for the attribute information, and user experience is further improved.
Optionally, respectively displaying attribute information corresponding to each feature element in the at least one feature element in a predetermined area of the video picture, where the attribute information includes: sorting attribute information corresponding to each characteristic element in the at least one characteristic element according to a preset sorting strategy; and respectively displaying the attribute information corresponding to each sorted characteristic element in the preset area. By the method, the attribute information corresponding to each feature element can be sorted according to the preset sorting strategy, and the attribute information corresponding to each sorted feature element is displayed in the preset area, so that the display is more reasonable, the efficiency of associating and corresponding feature elements and corresponding attribute information on each video picture by a user is further improved, and the user experience is improved.
Optionally, the sorting the attribute information corresponding to each feature element in the at least one feature element according to a preset sorting policy includes: sorting attribute information corresponding to each feature element in the at least one feature element according to the sequence of the first appearance time of each feature element in the at least one feature element from large to small in the video picture; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the position coordinates of each feature element in the at least one feature element from high to low or from low to high in the video picture; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the areas of the feature elements in the at least one feature element from large to small. By the method, the attribute information corresponding to each feature element can be sorted according to the preset sorting strategy, and the attribute information corresponding to each sorted feature element is displayed in the preset area, so that the display is more reasonable, the efficiency of associating and corresponding feature elements and corresponding attribute information on each video picture by a user is further improved, and the user experience is improved.
Optionally, after displaying the attribute information corresponding to each feature element in the at least one feature element in the predetermined area of the video frame, the method further includes: determining that a user performs a first predetermined operation on a first feature element, and/or determining that the user performs a second predetermined operation on attribute information corresponding to the first feature element, where the first feature element is any one of the at least one feature element; and displaying the first characteristic element and the attribute information of the first characteristic element in an associated manner. Through the method, when the user executes the preset operation on a certain characteristic element or the attribute information corresponding to the certain characteristic element, the characteristic element and the attribute information corresponding to the characteristic element can be displayed in an associated mode, so that the user can conveniently check the attribute information, the efficiency of the user in associating and corresponding the characteristic element and the corresponding attribute information on each video picture is further improved, and the user experience is improved.
Optionally, the associating and displaying the first feature element and the attribute information of the first feature element includes: displaying a connecting line between the first characteristic element and the attribute information of the first characteristic element; and/or adding a border with the same color to the first characteristic element and the attribute information of the first characteristic element. By the method, the efficiency of associating and corresponding the characteristic elements and the corresponding attribute information on each video picture by the user can be further improved, and the user experience is improved.
A second aspect of an embodiment of the present invention provides a video display apparatus, including: a processing unit for determining at least one feature element from a video picture; determining attribute information corresponding to each characteristic element in the at least one characteristic element; and the display unit is used for respectively displaying the attribute information corresponding to each characteristic element in the at least one characteristic element in a preset area of the video picture.
Optionally, the processing unit is configured to: determining all initial characteristic elements in a video picture, and determining the first time of occurrence of each initial characteristic element on the video picture; respectively calculating the time difference between the first appearance time of each initial characteristic element on the video picture and the current time; sequencing each initial characteristic element according to the sequence of the time difference from small to large; and taking the first N initial feature elements as at least one feature element determined from the video picture, wherein N is a preset number.
Optionally, the display areas of the attribute information corresponding to each feature element in the at least one feature element on the predetermined region of the video picture are equal, and N is equal to a ratio of the total area of the predetermined region to the display area.
Optionally, the size of the display area and the size of the resolution of the video frame are in a negative correlation relationship.
Optionally, the predetermined area is: a right region of the video frame; and/or a left region of the video frame; and/or an upper region of the video picture; and/or a lower region of the video frame.
Optionally, the processing unit is further configured to: before displaying the attribute information corresponding to each feature element in the at least one feature element in a predetermined area of the video picture, determining the position information of each feature element in the at least one feature element in the video picture; determining the predetermined area in the video picture according to the position information of each feature element in the at least one feature element; and the number of the characteristic elements in the preset area is less than a preset value.
Optionally, the display unit is configured to: sorting attribute information corresponding to each characteristic element in the at least one characteristic element according to a preset sorting strategy; and respectively displaying the attribute information corresponding to each sorted characteristic element in the preset area.
Optionally, the display unit is configured to: sorting attribute information corresponding to each feature element in the at least one feature element according to the sequence of the first appearance time of each feature element in the at least one feature element from large to small in the video picture; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the position coordinates of each feature element in the at least one feature element from high to low or from low to high in the video picture; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the areas of the feature elements in the at least one feature element from large to small.
Optionally, the display unit is further configured to: after displaying the attribute information corresponding to each feature element in the at least one feature element in the predetermined area of the video picture, determining that a user performs a first predetermined operation on a first feature element, and/or determining that the user performs a second predetermined operation on the attribute information corresponding to the first feature element, where the first feature element is any one of the at least one feature element; and displaying the first characteristic element and the attribute information of the first characteristic element in an associated manner.
Optionally, the display unit is configured to: displaying a connecting line between the first characteristic element and the attribute information of the first characteristic element; and/or adding a border with the same color to the first characteristic element and the attribute information of the first characteristic element.
A third aspect of embodiments of the present invention provides a video display apparatus, including: at least one processor, and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the at least one processor performs the method according to the first aspect of the embodiments by executing the instructions stored by the memory.
A fourth aspect of embodiments of the present invention provides a computer-readable storage medium storing computer instructions that, when executed on a computer, cause the computer to perform the method according to the first aspect of embodiments of the present invention.
One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages:
1. after the characteristic elements on the video picture are identified, the attribute information corresponding to each characteristic element in the video picture is displayed in the preset area on the video picture, and when a user corresponds the characteristic elements and the attribute information, the user only needs to check each characteristic element and each attribute information on the video picture, so that the difficulty of the user in corresponding each characteristic element and corresponding attribute information on the video picture is reduced.
2. When the embodiment of the invention identifies the characteristic elements in the plurality of video pictures at the same time, the attribute information corresponding to each video picture is independently displayed in the respective preset area, so that the efficiency of associating and corresponding the characteristic elements and the corresponding attribute information on each video picture by a user can be improved, and the user experience is improved.
3. The determination method of the predetermined area for displaying the attribute information in the embodiment of the present invention has various implementation manners, for example, determining the upper/lower/left/right area of the video picture as the predetermined area, or determining the predetermined area according to the distribution characteristics of the feature elements on the video picture, etc., so that the attribute information can avoid valuable picture display, and further improve user experience.
4. According to the embodiment of the invention, the attribute information corresponding to each feature element can be sorted according to the preset sorting strategy, and the attribute information corresponding to each sorted feature element is respectively displayed in the preset area, so that the display is more reasonable, the efficiency of associating and corresponding feature elements and corresponding attribute information on each video picture by a user is further improved, and the user experience is improved.
5. When the embodiment of the invention detects that the user performs the preset operation on a certain characteristic element or the attribute information corresponding to the certain characteristic element, the characteristic element and the attribute information corresponding to the characteristic element can be displayed in an associated manner, so that the user can conveniently check the attribute information, the efficiency of associating and corresponding the characteristic element and the corresponding attribute information on each video picture by the user is further improved, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a diagram illustrating a prior art video display method;
FIG. 2 is a flowchart illustrating a video display method according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a predetermined area in an embodiment of the present invention;
fig. 4 is a schematic diagram of attribute information sorted according to a preset sorting policy in the embodiment of the present invention;
fig. 5 is a schematic diagram of attribute information sorted according to a preset sorting policy in the embodiment of the present invention;
fig. 6 is a schematic diagram of attribute information sorted according to a preset sorting policy in the embodiment of the present invention;
fig. 7 is a schematic diagram of attribute information sorted according to a preset sorting policy in the embodiment of the present invention;
FIG. 8 is a schematic structural diagram of a video display apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a video display device according to an embodiment of the present invention.
Detailed Description
In the existing video display method, attribute information corresponding to identified feature elements (such as human faces, animations, flowers, and the like) in a video picture is presented in an area outside the video picture. For example, referring to fig. 1, the attribute information display area of the human face in the video picture of channel 2 is separated from the video picture, mainly concentrated on the left and lower sides outside the video picture. When the number of human faces in the video picture is large, a user needs to search for corresponding human face attribute information in a left side or right side area outside the video picture aiming at each human face, the user is very inconvenient to check, and the difficulty of the user in corresponding the human face on the video picture with the corresponding attribute information is very large. Moreover, if the attribute information of the feature elements in the multiple video pictures is simultaneously recognized, for example, the faces in the video pictures of channels 1, 2, 3, and 4 are simultaneously recognized, the attribute information display area will simultaneously contain the face attribute information from the video pictures of channels 1, 2, 3, and 4, and the difficulty for the user to correspond the face on the video picture and the attribute information in the attribute information display area is greater.
The embodiment of the invention provides a video display method and device, aiming at the technical problem that in the prior art, when attribute information corresponding to characteristic elements is displayed, a user is difficult to correspond each characteristic element and corresponding attribute information on a video picture.
The technical solutions of the present invention are described in detail below with reference to the drawings and the specific embodiments, and it should be understood that the specific features in the embodiments and the embodiments of the present invention are not intended to limit the technical solutions of the present invention, but may be combined with each other without conflict.
It is to be understood that the terms first, second, and the like in the description of the embodiments of the invention are used for distinguishing between the descriptions and not necessarily for describing a sequential or chronological order. "plurality" in the description of the embodiments of the present invention means two or more.
The term "and/or" in the embodiment of the present invention is only one kind of association relationship describing an associated object, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
Example one
The embodiment of the invention provides a video display method, which is used for solving the technical problem that in the prior art, when attribute information corresponding to characteristic elements is displayed, a user is difficult to correspond each characteristic element and corresponding attribute information on a video picture. The video display method can be simultaneously and respectively executed in a plurality of video pictures, and a detailed description will be given by taking one of the video pictures as an example. With reference to fig. 2, the method mainly comprises the following steps:
step 101: at least one feature element is determined from the video picture.
The feature elements may be faces, flowers, birds, and the like, and the embodiment of the present invention is not particularly limited.
In a specific implementation, after the at least one feature element is determined, the feature elements may be further displayed in a manner of being distinguished from other image elements on the video frame, for example, a mark may be added to the determined feature element, such as drawing a recognition frame, or enlarging a display scale of the feature element, and the like.
Step 102: and determining attribute information corresponding to each characteristic element in the at least one characteristic element.
When the feature element is a face, the attribute information corresponding to the feature element may include: gender, age, expression, race, hairstyle, whether to wear glasses, etc.; when the feature element is a flower, the attribute information corresponding to the feature element may include: color, variety, planting method, etc.; when the feature element is a bird, the attribute information corresponding to the feature element may include: variety, feeding habits, migration habits, etc.
Step 103: and respectively displaying attribute information corresponding to each characteristic element in the at least one characteristic element in a preset area of the video picture.
In a specific implementation process, the method for determining the predetermined area may have various implementation manners, and embodiments of the present invention are not limited in particular. Two possible implementations are listed below:
1) the predetermined area is a fixed area on the video picture.
For example, the predetermined area may be any one of a left area, a right area, an upper area, a lower area, and the like on the video screen, or any combination of the above fixed areas, such as a combination of an upper area and a right area, a combination of a left area and a right area, and the like. For example, referring to fig. 3, the face recognition function is turned on in the first of the four video frames in fig. 3, and the attribute information corresponding to the face is displayed in the right area on the video frame.
2) And dynamically determining the preset area according to the distribution characteristics of the characteristic elements on the video picture so as to ensure that the preset area does not shield the characteristic elements on the video picture as much as possible.
For example, position information of each feature element in the at least one feature element in the video picture may be determined; then, according to the position information of each characteristic element in the at least one characteristic element, determining the preset area in the video picture; the number of the characteristic elements in the preset area is smaller than a preset value, and the preset value is a positive integer.
In the above scheme, after the feature elements on the video picture are identified, the attribute information corresponding to each feature element in the video picture is displayed in the predetermined area on the video picture, and when the user corresponds the feature elements and the attribute information, the user only needs to check each feature element and each attribute information on the video picture.
Secondly, when the characteristic elements in the plurality of video pictures are identified simultaneously, the attribute information corresponding to each video picture is independently displayed in the respective preset area, so that the efficiency of associating and corresponding the characteristic elements and the corresponding attribute information on each video picture by a user is improved to a greater extent, and the user experience is improved.
Furthermore, the determination method of the predetermined area for displaying the attribute information in the scheme has various implementation manners, for example, determining the upper/lower/left/right area of the video picture as the predetermined area, or dynamically determining the predetermined area according to the distribution characteristics of the feature elements on the video picture, and the like, so that the attribute information can avoid valuable picture display, and further improve user experience.
Optionally, if the number of the feature elements on the video picture is large, a preset number of feature elements may be screened from all the feature elements according to a preset condition, and then only the screened part of feature elements is identified, and the related attribute information is displayed on the predetermined area.
The preset condition may have various implementation manners, such as time when the feature element appears on the video picture for the first time, a size of the feature element, a type of the feature element, a position coordinate of the feature element, and the like, and the embodiment of the present invention is not particularly limited.
For example, the preset condition may be a time when the feature element appears on the video picture for the first time, and the specific implementation method for screening out a preset number of feature elements from all feature elements according to the preset condition may include: determining all initial characteristic elements in a video picture, and determining the first time of occurrence of each initial characteristic element on the video picture; respectively calculating the time difference between the first appearance time of each initial characteristic element on the video picture and the current time; sequencing each initial characteristic element according to the sequence of the time difference from small to large; and taking the first N initial feature elements as at least one feature element determined from the video picture, wherein N is a preset number.
For another example, the preset condition may be a size of the feature element, and the specific implementation method for screening out a preset number of feature elements from all the feature elements according to the preset condition may include: determining all initial characteristic elements in a video picture, and determining the size of each initial characteristic element; sequencing each initial characteristic element according to the sequence of the sizes from large to small; taking the first N initial feature elements as at least one feature element determined from the video picture, wherein N is a preset number
In a specific implementation process, the preset number N may be determined in a plurality of manners, and one possible implementation manner is as follows: and determining N as the number of characteristic elements corresponding to the attribute information which can be displayed at most on the predetermined area. For example, referring to fig. 3, if the predetermined area of the video frame can display attribute information corresponding to at most 3 faces, N is determined to be 3, that is, 3 faces are selected from all faces in the video frame for identification.
In a specific implementation process, the display areas of the attribute information corresponding to each feature element on the predetermined area may be equal or different, and the embodiment of the present invention is not limited in particular. When the display areas of the attribute information corresponding to the feature elements on the predetermined area are equal, the preset number N is equal to the ratio of the total area of the predetermined area to the display area. The display area of the attribute information corresponding to each feature element may be a fixed value, or may be obtained in real time, and the embodiment of the present invention is not limited specifically. For example, the display area may be determined according to a preset function, an argument of the preset function is a resolution of a video picture, and a function value obtained by substituting the resolution of the video picture into the preset function is a display area, where a size of the display area and a size of the resolution of the video picture have a negative correlation.
Through the method, some newly appeared characteristic elements can be screened out from the video picture for identification according to the time when the characteristic elements appear on the video picture for the first time, and the attribute information corresponding to the screened characteristic elements is displayed on the preset area, so that the display is more reasonable, and the user experience is further improved.
Optionally, the displaying, in the step 103, the attribute information corresponding to each feature element in the at least one feature element in the predetermined area of the video picture respectively includes: sorting attribute information corresponding to each characteristic element in the at least one characteristic element according to a preset sorting strategy; and respectively displaying the attribute information corresponding to each sorted characteristic element in the preset area.
The preset ordering policy may be implemented in various ways, including but not limited to the following three ways:
1) and sorting the attribute information corresponding to each characteristic element in the at least one characteristic element according to the sequence of the first appearance time of each characteristic element in the at least one characteristic element from large to small in the video picture.
For example, referring to fig. 4, each face may be assigned an ID as one of attributes corresponding to the face, and the IDs are sequentially incremented according to the time when the face is detected. In the preset area, the attribute information corresponding to the human faces in the video picture is sorted from large to small according to the ID corresponding to each human face, namely, the attribute information enters the video picture from the top, enters the video picture from the bottom, and possibly extrudes out of the preset area to be hidden.
2) And sequencing the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the position coordinates of each feature element in the at least one feature element from high to low (or from low to high), so as to achieve the effect of parallel display of the feature elements and the corresponding attribute information.
For example, a coordinate system is established with the vertex of the lower left corner of the video frame as the origin, the lower boundary of the video frame as the X-axis, and the left boundary of the video frame as the Y-axis. Referring to fig. 5, when the predetermined area is a right area, the attribute information corresponding to each feature element may be sorted and displayed from high to low according to the Y coordinate corresponding to each feature element; referring to fig. 6, when the predetermined area is the lower area, the attribute information corresponding to each feature element may be displayed in order from high to low according to the X coordinate corresponding to each feature element.
3) And sorting the attribute information corresponding to each characteristic element in the at least one characteristic element according to the sequence of the areas of the characteristic elements from large to small.
For example, referring to fig. 7, the predetermined area is the right area of the video screen, and the video screen has three faces in total, where the face image with the ID 002 has the largest area, the face image with the ID 001 has the smallest area, and the face image with the ID 003 has an area between 001 and 002, and the attribute information corresponding to the three faces in the predetermined area is displayed in the order of 002, 003, and 001.
By the method, the attribute information corresponding to each feature element can be sorted according to the preset sorting strategy, and the attribute information corresponding to each sorted feature element is displayed in the preset area, so that the display is more reasonable, the efficiency of associating and corresponding feature elements and corresponding attribute information on each video picture by a user is further improved, and the user experience is improved.
Optionally, after the step 103 is executed, the method may further include: determining that a user performs a first predetermined operation on a first feature element, and/or determining that the user performs a second predetermined operation on attribute information corresponding to the first feature element, where the first feature element is any one of the at least one feature element; and displaying the first characteristic element and the attribute information of the first characteristic element in an associated manner.
The first predetermined operation may be that the user clicks the feature element with a mouse, or double clicks the feature element, or leaves a cursor on the feature element, and the like, which is not limited in this embodiment of the present invention. The operation type of the second predetermined operation and the operation type of the first predetermined operation may be the same or different, and embodiments of the present invention are not limited specifically.
The implementation manner of displaying the first feature element and the attribute information of the first feature element in an associated manner may be multiple, for example: displaying a connecting line between the first feature element and the attribute information of the first feature element, adding a border with the same color to the attribute information of the first feature element and the first feature element, enlarging a display ratio of the attribute information of the first feature element and the first feature element, and the like, which is not limited in the embodiments of the present invention.
Through the method, when the user executes the preset operation on a certain characteristic element or the attribute information corresponding to the certain characteristic element, the characteristic element and the attribute information corresponding to the characteristic element can be displayed in an associated mode, so that the user can conveniently check the attribute information, the efficiency of the user in associating and corresponding the characteristic element and the corresponding attribute information on each video picture is further improved, and the user experience is improved.
Optionally, in a specific implementation process, the attribute information corresponding to each feature element may be displayed in a predetermined area of the video screen in a semi-transparent manner, so that a user can see the video content at the predetermined area.
When detecting that a user performs a third predetermined operation on a first feature element and/or detecting that the user performs a fourth predetermined operation on attribute information corresponding to the first feature element, reducing the transparency of the attribute information corresponding to the first feature element, so that the user can view the attribute information corresponding to the first feature element more clearly; and when detecting that the user performs a fifth predetermined operation on the first feature element and/or detecting that the user performs a sixth predetermined operation on the attribute information corresponding to the first feature element, restoring the attribute information corresponding to the first feature element to be semi-transparent. The operation type of the third predetermined operation and the operation type of the fourth predetermined operation may be the same or different, and the embodiment of the present invention is not particularly limited; the operation type of the fifth predetermined operation and the operation type of the sixth predetermined operation may be the same or different, and embodiments of the present invention are not limited specifically. The fifth predetermined operation may be an ending action of the third predetermined operation, and the sixth predetermined operation may be an ending action of the fourth predetermined operation.
For example, when it is detected that a cursor of a mouse resides on the first feature element (or the attribute information corresponding to the first feature element), the transparency of the attribute information corresponding to the first feature element is reduced; when the mouse cursor is detected to leave the first feature element (or the attribute information corresponding to the first feature element), the attribute information corresponding to the first feature element is restored to be semi-transparent.
By the method, the attribute information corresponding to each feature element can be displayed in the predetermined area of the video picture in a semitransparent mode, so that a user can see the video content at the position of the predetermined area; and when the user performs a predetermined operation on a certain feature element or the attribute information corresponding to the feature element, the transparency of the attribute information corresponding to the feature element can be reduced, so that the user can view the attribute information corresponding to the feature element more clearly. The efficiency that the user associates and corresponds the characteristic elements and the corresponding attribute information on each video picture is further improved, and the user experience is improved.
Example two
An embodiment of the present invention provides a video display apparatus, and referring to fig. 8, the apparatus includes:
a processing unit 201, configured to determine at least one feature element from a video picture; determining attribute information corresponding to each characteristic element in the at least one characteristic element;
a display unit 202, configured to display attribute information corresponding to each feature element in the at least one feature element in a predetermined area of the video picture.
Optionally, the processing unit 201 is configured to: determining all initial characteristic elements in a video picture, and determining the first time of occurrence of each initial characteristic element on the video picture; respectively calculating the time difference between the first appearance time of each initial characteristic element on the video picture and the current time; sequencing each initial characteristic element according to the sequence of the time difference from small to large; and taking the first N initial feature elements as at least one feature element determined from the video picture, wherein N is a preset number.
Optionally, the display areas of the attribute information corresponding to each feature element in the at least one feature element on the predetermined region of the video picture are equal, and N is equal to a ratio of the total area of the predetermined region to the display area.
Optionally, the size of the display area and the size of the resolution of the video frame are in a negative correlation relationship.
Optionally, the predetermined area is: a right region of the video frame; and/or a left region of the video frame; and/or an upper region of the video picture; and/or a lower region of the video frame.
Optionally, the processing unit 201 is further configured to: before displaying the attribute information corresponding to each feature element in the at least one feature element in a predetermined area of the video picture, determining the position information of each feature element in the at least one feature element in the video picture; determining the predetermined area in the video picture according to the position information of each feature element in the at least one feature element; and the number of the characteristic elements in the preset area is less than a preset value.
Optionally, the display unit 202 is configured to: sorting attribute information corresponding to each characteristic element in the at least one characteristic element according to a preset sorting strategy; and respectively displaying the attribute information corresponding to each sorted characteristic element in the preset area.
Optionally, the display unit 202 is configured to: sorting attribute information corresponding to each feature element in the at least one feature element according to the sequence of the first appearance time of each feature element in the at least one feature element from large to small in the video picture; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the position coordinates of each feature element in the at least one feature element from high to low or from low to high in the video picture; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the areas of the feature elements in the at least one feature element from large to small.
Optionally, the display unit 202 is further configured to: after displaying the attribute information corresponding to each feature element in the at least one feature element in the predetermined area of the video picture, determining that a user performs a first predetermined operation on a first feature element, and/or determining that the user performs a second predetermined operation on the attribute information corresponding to the first feature element, where the first feature element is any one of the at least one feature element; and displaying the first characteristic element and the attribute information of the first characteristic element in an associated manner.
Optionally, the display unit 202 is configured to: displaying a connecting line between the first characteristic element and the attribute information of the first characteristic element; and/or adding a border with the same color to the first characteristic element and the attribute information of the first characteristic element.
The specific implementation manner of the operations performed by the above units may be corresponding to the steps in the first embodiment of the present invention, and the embodiment of the present invention is not described in detail again.
EXAMPLE III
An embodiment of the present invention provides a video display apparatus, and referring to fig. 9, the apparatus includes:
at least one processor 301, and
a memory 302 communicatively coupled to the at least one processor;
the memory 302 stores instructions executable by the at least one processor 301, and the at least one processor 301 executes the instructions stored in the memory 302 to perform the method according to the first embodiment of the present invention.
Example fourth
A fourth embodiment of the present invention provides a computer-readable storage medium, which stores computer instructions, and when the computer instructions are executed on a computer, the computer is caused to execute the method according to the first embodiment of the present invention.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (9)
1. A video display method, comprising:
determining at least one characteristic element from the video picture;
determining attribute information corresponding to each characteristic element in the at least one characteristic element;
respectively displaying attribute information corresponding to each characteristic element in the at least one characteristic element in a preset area of the video picture;
before displaying the attribute information corresponding to each feature element in the at least one feature element in the predetermined area of the video picture, the method further includes:
determining position information of each characteristic element in the at least one characteristic element in the video picture;
determining the predetermined area in the video picture according to the position information of each feature element in the at least one feature element; wherein the predetermined area is one or more of the following areas: a right region of the video picture, a left region of the video picture, an upper region of the video picture, and a lower region of the video picture;
after displaying the attribute information corresponding to each of the at least one feature element in the predetermined area of the video picture, the method further includes:
determining that a user performs a first predetermined operation on a first feature element, and/or determining that the user performs a second predetermined operation on attribute information corresponding to the first feature element, where the first feature element is any one of the at least one feature element;
performing associated display on the first characteristic element and attribute information of the first characteristic element;
wherein the displaying the attribute information corresponding to each feature element in the at least one feature element in a predetermined area of the video picture comprises:
sorting attribute information corresponding to each feature element in the at least one feature element according to the sequence of the position coordinates of each feature element in the at least one feature element in the video picture from high to low or from low to high; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the areas of the feature elements in the at least one feature element from large to small;
and respectively displaying the attribute information corresponding to each sorted characteristic element in the preset area.
2. The method of claim 1, wherein said determining at least one feature element from a video picture comprises:
determining all initial characteristic elements in a video picture, and determining the first time of occurrence of each initial characteristic element on the video picture;
respectively calculating the time difference between the first appearance time of each initial characteristic element on the video picture and the current time;
sequencing each initial characteristic element according to the sequence of the time difference from small to large;
and taking the first N initial feature elements as at least one feature element determined from the video picture, wherein N is a preset number.
3. The method according to claim 2, wherein the display area of the attribute information corresponding to each of the at least one feature element on the predetermined area is equal, and N is equal to the ratio of the total area of the predetermined area to the display area.
4. The method of claim 3, wherein the display area size is inversely related to the resolution size of the video picture.
5. The method of claim 1, wherein the number of feature elements in the predetermined area is less than a preset value.
6. The method of claim 1, wherein the associating and displaying the first feature element and the attribute information of the first feature element comprises:
displaying a connecting line between the first characteristic element and the attribute information of the first characteristic element; and/or
Adding a border with the same color to the first feature element and the attribute information of the first feature element.
7. A video display apparatus, comprising:
a processing unit for determining at least one feature element from a video picture; determining attribute information corresponding to each characteristic element in the at least one characteristic element;
the display unit is used for respectively displaying attribute information corresponding to each characteristic element in the at least one characteristic element in a preset area of the video picture;
the processing unit is further to: before the display unit displays the attribute information corresponding to each feature element in the at least one feature element in a preset area of the video picture, determining the position information of each feature element in the at least one feature element in the video picture; determining the predetermined area in the video picture according to the position information of each feature element in the at least one feature element; wherein the predetermined area is one or more of the following areas: a right region of the video picture, a left region of the video picture, an upper region of the video picture, and a lower region of the video picture; after displaying the attribute information corresponding to each feature element in the at least one feature element in the predetermined area of the video picture, determining that a user performs a first predetermined operation on a first feature element, and/or determining that the user performs a second predetermined operation on the attribute information corresponding to the first feature element, where the first feature element is any one of the at least one feature element; performing associated display on the first characteristic element and attribute information of the first characteristic element;
wherein the display unit is specifically configured to:
sorting attribute information corresponding to each feature element in the at least one feature element according to the sequence of the position coordinates of each feature element in the at least one feature element in the video picture from high to low or from low to high; or sorting the attribute information corresponding to each feature element in the at least one feature element according to the sequence of the areas of the feature elements in the at least one feature element from large to small;
and respectively displaying the attribute information corresponding to each sorted characteristic element in the preset area.
8. A video display device, comprising:
at least one processor, and
a memory communicatively coupled to the at least one processor;
wherein the memory stores instructions executable by the at least one processor to perform the method of any one of claims 1-6 by executing the instructions stored by the memory.
9. A computer-readable storage medium having stored thereon computer instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711385085.XA CN108156504B (en) | 2017-12-20 | 2017-12-20 | Video display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711385085.XA CN108156504B (en) | 2017-12-20 | 2017-12-20 | Video display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108156504A CN108156504A (en) | 2018-06-12 |
| CN108156504B true CN108156504B (en) | 2020-08-14 |
Family
ID=62464633
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711385085.XA Active CN108156504B (en) | 2017-12-20 | 2017-12-20 | Video display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108156504B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110390919B (en) * | 2019-06-25 | 2020-12-04 | 中国人民解放军空军特色医学中心 | Display device and color processing method and device |
| CN110392310B (en) * | 2019-07-29 | 2022-06-03 | 北京奇艺世纪科技有限公司 | Display method of video identification information and related equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708606A (en) * | 2012-03-26 | 2012-10-03 | 北京普惠恒丰科技有限公司 | System for monitoring person entering and exiting presence area of prison by recognizing faces of person |
| CN103227959A (en) * | 2012-01-31 | 2013-07-31 | 三星电子株式会社 | Method for providing user interface and video receiving apparatus thereof |
| WO2013127624A1 (en) * | 2012-03-02 | 2013-09-06 | Bundesdruckerei Gmbh | Method for identifying a person |
-
2017
- 2017-12-20 CN CN201711385085.XA patent/CN108156504B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103227959A (en) * | 2012-01-31 | 2013-07-31 | 三星电子株式会社 | Method for providing user interface and video receiving apparatus thereof |
| WO2013127624A1 (en) * | 2012-03-02 | 2013-09-06 | Bundesdruckerei Gmbh | Method for identifying a person |
| CN102708606A (en) * | 2012-03-26 | 2012-10-03 | 北京普惠恒丰科技有限公司 | System for monitoring person entering and exiting presence area of prison by recognizing faces of person |
Non-Patent Citations (1)
| Title |
|---|
| "中国天网"监控放大招：2000万个监控摄像头，准确识别年龄、性别、匹配人脸！;互联网的一些事;《网易贴吧:dy.163.com/v2/article/detail/CVSG3FH60511B1U0.html》;20171004;正文第1页第3行-第4页第12行 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108156504A (en) | 2018-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10049308B1 (en) | Synthesizing training data | |
| Wang et al. | Stereoscopic thumbnail creation via efficient stereo saliency detection | |
| CN107181976B (en) | Bullet screen display method and electronic equipment | |
| WO2021012837A1 (en) | Method and apparatus for determining recommendation information implantation position, device and storage medium | |
| US10019779B2 (en) | Browsing interface for item counterparts having different scales and lengths | |
| CN108124184A (en) | A kind of method and device of living broadcast interactive | |
| WO2018099125A1 (en) | Method and system for processing displayed content in overlapping windows | |
| US20180337880A1 (en) | System and method for presentation of content linked comments | |
| CN106202316A (en) | Merchandise news acquisition methods based on video and device | |
| Schmidt et al. | VAICo: Visual analysis for image comparison | |
| JP4916548B2 (en) | Establish and use dominant lines of images | |
| CN107766349B (en) | Method, device, equipment and client for generating text | |
| US10026176B2 (en) | Browsing interface for item counterparts having different scales and lengths | |
| CN108156504B (en) | Video display method and device | |
| Wang et al. | How real is reality? A perceptually motivated system for quantifying visual realism in digital images | |
| WO2022262404A1 (en) | Picture presentation method, picture presentation apparatus and electronic device | |
| CN116308530A (en) | Advertisement implantation method, advertisement implantation device, advertisement implantation equipment and readable storage medium | |
| US10438085B2 (en) | Image analysis apparatus, image analysis method, and storage medium | |
| KR20190087711A (en) | Method, apparatus and computer program for pre-processing video | |
| CN110880167A (en) | Indoor effect graph description generation method and device and electronic equipment | |
| CN101656037A (en) | Method for displaying large-format picture on small screen equipment and small screen equipment | |
| CN108764232B (en) | Label position obtaining method and device | |
| CN108830820B (en) | Electronic device, image acquisition method, and computer-readable storage medium | |
| CN110636322B (en) | Multimedia data processing method and device, intelligent terminal and storage medium | |
| JP2010245983A (en) | Image structuring device, image structure method, and image structuring program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |