CN109089157B - Video picture cutting method, display device and device - Google Patents
Video picture cutting method, display device and device Download PDFInfo
- Publication number
- CN109089157B CN109089157B CN201810623302.2A CN201810623302A CN109089157B CN 109089157 B CN109089157 B CN 109089157B CN 201810623302 A CN201810623302 A CN 201810623302A CN 109089157 B CN109089157 B CN 109089157B
- Authority
- CN
- China
- Prior art keywords
- display
- picture
- cut
- feature
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
- H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
Abstract
The application provides a video picture cutting method, a display device and a device, wherein the method comprises the following steps: and collecting a picture to be cut. And identifying a first characteristic in the picture to be cut. Determining a cutting frame of the picture to be cut according to the first characteristic, wherein the first characteristic is contained in the cutting frame. And utilizing the cutting frame to cut the picture to be cut to obtain a cut picture, and displaying the cut picture on display equipment. Through the mode, the video watching experience can be effectively improved.
Description
Technical Field
The present application relates to the field of video processing technologies, and in particular, to a method, a display device, and an apparatus for cropping a video frame.
Background
With the development of internet technology and the rapid popularization of intelligent equipment, people can conveniently and rapidly conduct video chat through the intelligent equipment or watch video programs on line, such as watching live broadcast on line.
Through long-term research, the invention of the application discovers that the existing video processing method is fixed and roughly cut from the middle part of the original video without considering the content of the picture. In fact, the focus of the picture in the original video or the key content of the original video is not necessarily centered, which may cause the focus or key part, for example, the upper half of the other party to be cut off, and only the lower half of the other party can be seen, and the cut picture basically loses the viewing meaning, thereby greatly affecting the viewing experience.
Disclosure of Invention
The technical problem mainly solved by the application is to provide a cutting method, a display device and a device of a video picture, and the video watching experience can be effectively improved.
In order to solve the above technical problem, the present application provides a method for clipping a video frame, including:
and collecting a picture to be cut.
And identifying a first characteristic in the picture to be cut.
Determining a cutting frame of the picture to be cut according to the first characteristic, wherein the first characteristic is contained in the cutting frame.
And utilizing the cutting frame to cut the picture to be cut to obtain a cut picture, and displaying the cut picture on display equipment.
In order to solve the technical problem, the application further provides a display device, which comprises an acquisition module, an identification module, a determination module, a cutting module and a display module. The acquisition module is used for acquiring a picture to be cut. The identification module is used for identifying a first characteristic in the picture to be cut. The determining module is used for determining a cutting frame of the picture to be cut according to the first characteristic, wherein the first characteristic is contained in the cutting frame. And the cutting module is used for cutting the picture to be cut by utilizing the cutting frame. The display module is used for displaying the cut picture.
In order to solve the above technical problem, the present application further provides a display device, including a processor and a communication circuit, where the processor is connected to the communication circuit. The processor is used for collecting the picture to be cut through the communication circuit. The processor is configured to identify a first feature in the picture to be cropped. The processor is used for determining a cutting frame of the picture to be cut according to the first characteristic, wherein the first characteristic is contained in the cutting frame. The processor is used for utilizing the cutting frame to cut the picture to be cut so as to obtain the cut picture.
In order to solve the above technical problem, the present application further provides a device having a storage function, which stores program data that can be executed to implement a method for cropping a video frame as provided in the above application.
Compared with the prior art, the beneficial effects of this application are: through treating the first characteristic in the picture of tailorring and discern, and confirm the cutting frame of waiting to tailor the picture according to first characteristic, make first characteristic contain in the cutting frame, utilize the cutting frame to tailor and remain the picture in the cutting frame after waiting to tailor the picture, make the picture that shows on the second display device include first characteristic, guarantee that spectator can clearly see first characteristic completely, so can solve when gathering the video picture under the different angles, can show first characteristic completely when discerning first characteristic equally, avoid first characteristic to show incomplete scheduling problem, effectively promote the video and watch experience.
Drawings
FIG. 1 is a schematic structural diagram of an embodiment of an interactive system of the present application;
FIG. 2 is a schematic flow chart illustrating an embodiment of a cropping method for video frames according to the present application;
FIG. 3 is a schematic diagram of a cropping process of an embodiment of the cropping method of a video frame of the present application;
FIG. 4 is a schematic structural diagram of a first embodiment of a display device of the present application;
FIG. 5 is a schematic structural diagram of a second embodiment of a display device of the present application;
fig. 6 is a schematic structural diagram of an embodiment of the apparatus with a storage function according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, the interactive system of the present application includes a first display device 11 and a plurality of second display devices 12, where the first display device 11 is configured to send a captured video image to the plurality of second display devices 12, respectively, for example, a video image recorded in real time is transmitted to the plurality of second display devices 12 in real time. For example, the first display device 11 captures a video image by its own camera or an external camera. The plurality of second display devices 12 respectively receive the video pictures transmitted by the first display device 11, and for example, may receive the video pictures transmitted by the first display device 11 in real time. In this embodiment, the first display device 11 may be a computer, a mobile phone, a tablet computer, a smart television, or an image capturing device with a display screen, such as a camera, a video camera, etc., and the second display device 12 may be a computer, a television, a mobile phone, a tablet computer, etc. The first display device 11 and the second display device 12 may be the same kind of device or different kinds of devices.
For example, with live online as a specific scene, the first display device 11 is a terminal used by a main broadcaster, and the plurality of second display devices 12 are terminals used by viewers. The anchor and the user interact in an online live broadcast manner through the server, for example, a live broadcast APP (anchor version) installed on the first display device 11, and the same live broadcast APP (audience version) installed on the second display device 12, of course, the anchor version and the audience version may be the same version or different versions, for example, there is a difference in page layout and function. In the live broadcast process, the first display device 11 captures a video picture of the anchor broadcast through a camera (for example, a camera) or an external camera (for example, an external camera) of the first display device and sends the video picture to the audience in real time, and then the second display device 12 of the audience collects or acquires the video picture of the anchor broadcast in real time and displays the video picture on the second display device 12, so that the audience can watch the live broadcast of the anchor broadcast in real time and perform real-time interaction. Of course, in other embodiments, an interactive system may be formed among a plurality of second display devices 12, for example, a real-time video chat scene belonging to a non-live scene, and then a video frame is sent from one second display device 12, and the other second display devices 12 receive and the second display device 12 performs a cropping process. It is also possible that a single second display device 12 takes a video picture by itself while the second display device 12 performs a targeted cropping process for the video picture. For example, the processing described in the following embodiment of the video frame cropping method of the present application is performed.
Referring to fig. 1-3, an embodiment of a method for clipping a video frame of the present application includes:
s11: and collecting a picture to be cut.
In this embodiment, the second display device 12 acquires a picture to be cut, on one hand, a video picture sent by the anchor through the first display device 11 may be acquired, and on the other hand, a video picture acquired by the second display device 12 through a camera device carried by the second display device or an external camera device may also be acquired. In a specific application scene of live broadcasting, the second display device 12 acquires the video pictures sent by the first display device 11 in real time.
In this embodiment, as for the first display device 11, the first display device 11 may also acquire, in real time, a picture to be cropped by using the image pickup device, and perform the following steps S12-S15, so as to be convenient for the user of the first display device 11 to watch, for example, the first display device 11 of the anchor may also display, in real time, the picture cropped by using the cropping method in the embodiment of the cropping method of the video picture in the present application. The video picture sent by the first display device 11 to the second display device 12 is still a picture to be cropped and is not a picture cropped by the first display device 11. Even though the following description mostly illustrates the second display device 12, it should be noted that the cropping method in the embodiment of the cropping method of the video picture in the present application is also applicable to the first display device 11.
S12: a first feature 12a is identified in the picture to be cropped.
The second display device 12 identifies a first feature 12a in the captured video picture to be cropped. In this embodiment, the sample of the first feature 12a may be preset on the second display device 12, and the first feature 12a is identified by matching with the sample, or the second display device 12 performs multiple training on the same type of sample of the first feature 12a, so as to accurately identify the first feature 12 a. For example, the first features 12a comprise human face features. Other features of the person, such as an eye feature, an expression feature, a hand feature, a hair feature, etc., may be further included, as well as features in the scene, such as a vase feature, a certain scene feature, etc. The first feature 12a may be a single feature or a collection of features. For example, the first feature 12a may be selected from an APP in the second display device 12, and only one feature, such as a face feature, may be selected, as well as multiple features, such as a face feature and a hand feature, may be selected simultaneously.
In the present application, the second display device 12 recognizes the first feature 12a may be a real-time tracking type recognition; alternatively, the first feature 12a may be recognized by performing the recognition operation at regular time intervals.
S13: a crop box 12b of the picture to be cropped is determined from the first feature 12a, wherein the first feature 12a is included within the crop box 12 b.
After recognizing the first feature 12a, the second display device 12 needs to determine the cropping frame 12b according to the first feature 12a in order to ensure that the first feature 12a is not cropped, so that the first feature 12a can appear in the cropped picture of the cropping frame 12b, and the viewer can completely see the first feature 12a of the video picture. Optionally, the geometric center point of the first feature 12a coincides with the geometric center point of the crop box 12b, further such that the first feature 12a is located in the visual center of the crop box 12 b.
In this embodiment, if the first feature 12a is identified in a real-time tracking manner, the cropping frame 12b is also adjusted in real time. If intermittent recognition is used, the crop box 12b determined after one recognition is continuously used for an interval period.
Optionally, S131: a cropping frame 12b of the picture to be cropped is further determined jointly from the first feature 12a and the display conditions of the display device, wherein the first feature 12a is contained within the cropping frame 12 b.
In this implementation, according to the first feature 12a and by combining the display condition of the second display device 12, the cut picture can be displayed on the second display device 12 with a good display effect, so that the viewing requirement and aesthetic requirement of the user are met, and the viewing experience is improved. Taking the second display device 12 as an example, the display condition of the second display device 12 is, for example, one or a combination of a plurality of display resolutions, display scales of screens, color gamuts, screen refresh frequencies, display modes, and the like. The display mode is, for example, a horizontal screen display, a vertical screen display, a slant screen display, a split screen display, or the like.
For example, the shape, size, length-width ratio, etc. of the cropping frame 12b are determined according to the resolution and screen display ratio of the first feature 12a and the second display device 12, so that the cropped picture can better fit the display ratio and display resolution of the screen of the second display device 12, for example, the ratio of the picture to be cropped is 18:9 and the resolution is 2160 × 1080P, the display resolution of the second display device 12 is 1280 × 720P, the display ratio is 16:9 and the picture is currently displayed in the horizontal direction, after the cropping frame 12b is determined according to the display conditions of the first feature 12a and the second display device 12, the cropping frame 12b contains the first feature 12a and the ratio of the cropping frame is 16:9 and the picture obtained by using the cropping frame 12b, that is, automatically fit to the second display device 12, the cropped picture is 1280 × 720P, the display scale is 16:9, and the display direction is horizontal display.
In the case of split-screen display, the cropping frame 12b is determined jointly according to the first feature 12a and the size, display ratio, and split-screen display manner (for example, horizontal-screen display or vertical-screen display in the split-screen area) of the split-screen display area, so that the cropped picture can be better displayed in the split-screen display area.
S14: the frame to be cut is cut by the cutting frame 12b to obtain a cut frame, and the cut frame is displayed on the second display device 12.
After the cutting frame 12b is determined, the obtained video picture is cut by using the cutting frame 12b to obtain a cut picture, the cut picture can adapt to the second display device 12, the aesthetic feeling of the cut picture is guaranteed, and the experience of watching the video picture by the audience is improved when the audience can watch the first feature 12 a.
In the specific application scenario of online live broadcasting, multiple viewers may exist simultaneously for viewing and interacting in a live page of a main broadcast. For the anchor, there are situations where the anchor is sitting without facing the camera, without centering, etc. The existing processing method is to fixedly cut from the middle of the video, so that sometimes a viewer can only see half of the face of the anchor or cannot see the anchor himself at all. Therefore, in the embodiment, the first feature 12a in the picture to be cut is identified, and the cutting frame 12b of the picture to be cut is determined according to the first feature 12a, so that the first feature 12a is contained in the cutting frame 12b, the first feature 12a can be displayed on the second display device 12 in real time, the audience can clearly and completely see the first feature 12a, the problem that the first feature 12a is displayed incompletely when the first feature 12a is identified when video pictures at different angles are collected can be solved, and the problem that the first feature 12a is displayed incompletely is avoided, and the picture to be cut is cut by using the cutting frame 12 b.
For the viewers, the second display devices 12 used by different viewers may be different, and there are many differences in the display conditions, for example, the display ratio of the second display device 12 of some viewers is 16:9, the display ratio of the second display device 12 of some viewers is 18:9, some viewers watch the main video picture with landscape screen, and some viewers watch the main video picture with portrait screen, the most common technical means in the prior art are: although the video is cut from the video source to be cut according to the same aspect ratio according to the display scale (aspect ratio) of the second display device 12 and is cut from the middle part of the video picture to be cut, black edges do not need to be supplemented at the upper part, the lower part, the left part and the right part of the video picture to be cut are directly cut off, so that the audience cannot watch the effective live broadcast picture or cannot watch important parts. In this embodiment, the cropping frame 12b of the picture to be cropped is further determined according to the first feature 12a and the display condition of the second display device 12, so that the cropped picture can be automatically adapted to the previous second display device 12, and thus, the second display device 12 under different use conditions can be cropped and displayed in a targeted manner, so that the display effect is better, and the viewing experience is effectively improved.
Referring to fig. 3, in the present embodiment, the first feature 12a includes a human face feature. For the online live broadcast with application scenes, when watching the live broadcast program of the anchor, the audience hopes to face the anchor, the anchor sends the live broadcast video picture (picture to be cut) through the first display device 11, the second display device 12 of each audience receives the live broadcast video picture, recognizes the face feature of the anchor, when recognizing the face feature of the anchor, determines the cutting frame 12b according to the face feature of the anchor, or determines the cutting frame 12b according to the face feature and the display condition of the second display device 12, at this time, the face feature of the anchor is contained in the cutting frame 12b, the second display device 12 cuts the video picture by using the cutting frame 12b, the picture in the cutting frame 12b is reserved as the cut picture and displayed on the second display device 12 of the audience, thus, when recognizing the face feature, the second display device 12 can be guaranteed, the audience can see the characteristics on the second display device 12 of the audience, and the problems that the cut video picture cannot see a face or the watching experience is poor due to the face missing and the like caused by the existing video processing technology are solved. In the embodiment, the problems of important partial picture loss and the like caused by the existing fixed cutting technology can be well solved by applying the face recognition to the cutting of the online live video.
In this embodiment, the facial features are recognized in the picture to be cropped, for example, an opencv recognition algorithm based on module matching may be adopted, and of course, a human face feature point recognition algorithm, an entire human face image recognition algorithm, a neural network recognition algorithm, or a recognition algorithm entering an illumination estimation model may also be adopted. Or a combination of the above recognition algorithms.
Referring to fig. 2 and 3, further, the step of identifying the first feature 12a in the picture to be cropped includes:
s121: the first feature 12a is identified in the picture to be cropped, and a first feature extraction frame 12c is output, wherein the first feature 12a is contained in the first feature extraction frame 12 c.
Specifically, when the second display device 12 recognizes, for example, a face feature in the picture to be cropped, the first feature extraction frame 12c is output, for example, a rectangular frame or an oval frame, and the first feature extraction frame 12c surrounds the face feature, for example, just completely surrounds the face feature, so that the face feature is included in the first feature extraction frame 12c to better locate the range of the face feature.
The step of determining the cropping frame 12b of the picture to be cropped according to the first feature 12a and the display condition of the second display device 12 includes:
s132: the cutting frame 12b of the picture to be cut is determined jointly according to the first feature extraction frame 12c and the display conditions of the second display device 12, wherein the first feature extraction frame 12c is included in the cutting frame 12 b.
Specifically, the first feature 12a is contained in the first feature extraction box 12c, the first feature 12a is contained in the crop box 12b, and the second display device 12 crops a video picture using the crop box 12b, leaving the picture in the crop box 12 b. The first feature extraction box 12c can better ensure that the first feature 12a is contained in the cropping box 12b, and the cropped picture of the second display device 12 can be ensured to completely display the first feature 12 a.
In this embodiment, the display conditions of the second display device 12 may include a display scale and a display manner, and the display manner includes a landscape display and a portrait display. Of course, as before, the display condition may also be other parameters or content, or in combination with other parameters.
Since the viewers use different second display devices 12 to watch the live broadcast in different display manners, the cropping frame 12b needs to be determined jointly with the display conditions of the second display devices 12 and the first characteristics 12a to crop the picture to be cropped, so as to better adapt to the different second display devices 12 and display manners.
For example, when the second display device 12 is displayed in a landscape mode, the longitudinal length of the first feature 12a is short due to the landscape mode, and the first feature 12a easily overflows from the longitudinal direction, so that in order to ensure that the first feature 12a can be displayed on the second display device 12 completely, the second display device 12 cuts the upper and lower frames of the first feature 12a, and at least ensures that the first feature 12a is centered at least up and down in the cutting frame 12b, so as to ensure that the first feature 12a is centered in the case that the longitudinal length is short, and ensures that the first feature 12a is displayed completely in the cut frame. Further, the first feature 12a is also centered side-to-side in the crop box 12 b.
Similarly, when the display mode of the second display device 12 is vertical screen display, the vertical screen display results in a long longitudinal length, and the horizontal screen display results in a short horizontal length, which easily causes the first feature 12a to overflow from the horizontal direction, so that attention needs to be paid to horizontal cropping, and for this reason, in order to ensure that the first feature 12a does not overflow from the horizontal direction when the vertical screen display is performed on the second display device 12, when determining the cropping frame 12b, it needs to ensure that the first feature 12a is at least centered left and right in the cropping frame 12 b. Further, the first feature 12a is also centered above and below in the crop box 12 b.
Referring to fig. 2 and 3, optionally, the method further comprises:
s15: if the first feature 12a cannot be identified in the picture to be cropped, the previous cropping frame 12b is adopted to crop the picture to be cropped.
In a specific application scenario of online live broadcasting, when a main broadcast causes a video picture to be cropped, which is sent by the first display device 11, to the second display device 12 of a viewer due to turning or moving, the second display device 12 cannot recognize the first feature 12a, such as a human face feature, and then the second display device 12 crops the video picture with the previous cropping frame 12 b. In the present embodiment, the previous crop box 12b is the crop box 12b used for the most adjacent one of the crops when the first feature 12a is not recognized. In other embodiments, the second display device 12 may select one of the previous crop boxes 12b to crop the frame when the first feature 12a is not recognized.
In summary, in the present embodiment, the first feature 12a is identified in the to-be-cropped picture, the cropping frame 12b of the to-be-cropped picture is determined according to the first feature 12a and the display condition of the second display device 12 when the first feature 12a is identified, and the first feature 12a is included in the cropping frame 12b, so that the first feature 12a can be displayed on the display picture of the second display device 12 in real time, and thus, when video pictures at different angles are collected or the display condition of the second display device 12 is different, the first feature 12a can be displayed relatively completely when the first feature 12a is identified, the problem that the first feature 12a is displayed incompletely is avoided, and the to-be-cropped picture is cropped by using the cropping frame 12b, the cropped picture can be automatically adapted to the previous second display device 12, and thus, the second display device 12 under different use conditions can be cropped and displayed specifically, so that the display effect is better.
Referring to fig. 3 and 4, the first embodiment of the display device of the present application is an embodiment of the display device in the embodiment of the method for cropping a video frame of the present application, and the first embodiment of the display device of the present application includes an acquisition module 121, a recognition module 122, a determination module 123, a cropping module 124, and a display module 125. The collecting module 121 is used for collecting a picture to be cut. The recognition module 122 is configured to recognize the first feature 12a in the picture to be cropped. The determining module 123 is configured to determine a cropping frame 12b of the picture to be cropped according to the first feature 12a, where the first feature 12a is included in the cropping frame 12 b. The cropping module 124 is used for cropping the picture to be cropped by using the cropping frame 12 b. The display module 125 is configured to display the cropped picture.
Optionally, the determining module 123 is further configured to determine a cropping frame 12b of the picture to be cropped according to the first feature 12a and the display condition of the display device, where the first feature 12a is included in the cropping frame 12 b.
Optionally, the identifying module 122 is further configured to identify the first feature 12a in the picture to be cropped, and output a first feature extraction box 12 c. Wherein the first feature 12a is contained within a first feature extraction box 12 c.
Optionally, the determining module 123 is further configured to determine a cropping frame 12b of the picture to be cropped according to the first feature extraction frame 12c and the display condition of the display device, where the first feature extraction frame 12c is included in the cropping frame 12 b.
Optionally, the display conditions of the display device include a display scale and a display mode, and the display mode includes a landscape screen display and a portrait screen display.
Optionally, when the display mode of the display device is landscape display, the first feature is at least centered up and down in the crop box.
Optionally, when the display mode of the display device is vertical screen display, the first feature is centered at least left and right in the crop box.
Optionally, the first features 12a are human face features.
Optionally, when the recognition module 122 cannot recognize the first feature 12a in the picture to be cropped, the determination module 123 determines the previous crop box as the crop box 12 b.
In this embodiment, the functions and extensions of each functional module may specifically refer to the description of the clipping method embodiment of the video frame in the present application, and are not described herein again.
In addition, each module of the first embodiment of the display device of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules are integrated into one module, and the modules may be implemented in a form of hardware or a form of software functional units.
Referring to fig. 3 and 5, the second embodiment of the display device of the present application is another embodiment of the display device in the embodiment of the video frame cropping method of the present application, and the second embodiment of the display device of the present application includes a processor 131 and a communication circuit 132, and the processor 131 is connected to the communication circuit 132.
The processor 131 is configured to collect a picture to be cropped through the communication circuit 132. The processor 131 is arranged to identify the first feature 12a in the picture to be cropped. The processor 131 is configured to determine a cropping frame 12b of the picture to be cropped according to the first feature 12a, wherein the first feature 12a is included in the cropping frame 12 b. The processor 131 is configured to crop the picture to be cropped by using the cropping frame 12b to obtain a cropped picture.
Optionally, the processor is further configured to determine a cropping frame 12b of the picture to be cropped according to the first feature 12a and the display condition of the display device.
Optionally, the processor 131 is further configured to output a first feature extraction box 12c after identifying the first feature 12a in the picture to be cropped, where the first feature 12a is included in the first feature extraction box 12 c. The processor 131 is further configured to determine a cropping frame 12b of the picture to be cropped according to the first feature extraction frame 12c and the display condition of the display device, wherein the first feature extraction frame 12c is included in the cropping frame 12 b.
Optionally, the first features 12a comprise human face features.
Optionally, the display conditions of the display device include a display scale and a display mode, and the display mode includes a landscape screen display and a portrait screen display.
Optionally, when the display mode of the display device is landscape display, the first feature 12a is at least centered up and down in the crop box 12 b.
Optionally, when the display mode of the display device is vertical screen display, the first feature 12a is at least centered left and right in the crop box 12 b.
Optionally, the processor 131 is configured to crop the picture to be cropped by using the previous cropping frame 12b when the first feature 12a cannot be identified in the picture to be cropped.
In the present embodiment, the processor 131 controls the operation of the resource server, and the processor 131 may also be referred to as a Central Processing Unit (CPU). The processor 131 may be an integrated circuit chip having signal processing capabilities. Processor 131 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor 131 may be any conventional processor or the like.
For the functions of each part in the second embodiment of the display device of the present application, reference may be specifically made to the description in the embodiment of the video frame cropping method of the present application, and details are not described here again.
Referring to fig. 6, the device 14 with storage function in the embodiment of the device with storage function of the present application stores program data that can be executed to implement the method as described in the embodiment of the cropping method of video frames of the present application.
The method involved in the embodiment of the method for cropping a video frame of the present application, when implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in the device 14, for example, a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.
Claims (7)
1. A method for cropping a video frame, comprising:
collecting a picture to be cut;
identifying a first feature in the picture to be cut, and outputting a first feature extraction frame, wherein the first feature is contained in the first feature extraction frame;
determining a cutting frame of the picture to be cut according to the first feature extraction frame and the display condition of the display equipment, wherein the first feature extraction frame is contained in the cutting frame; the display conditions of the display equipment comprise a display scale and a display mode, wherein the display mode comprises horizontal screen display, vertical screen display and split screen display; under the condition of split-screen display, determining the cutting frame according to the size, the display proportion and the split-screen display mode of the first feature extraction frame and the split-screen display area;
and utilizing the cutting frame to cut the picture to be cut to obtain a cut picture, and displaying the cut picture on display equipment.
2. The clipping method according to claim 1, wherein: when the display mode of the display equipment is horizontal screen display, the first feature is at least vertically centered in the cutting frame; and/or the presence of a gas in the gas,
and when the display mode of the display equipment is vertical screen display, the first feature is at least centered left and right in the cutting frame.
3. The clipping method according to claim 1, wherein: the first characteristic is a face characteristic.
4. The clipping method according to claim 1, wherein the method further comprises:
and if the first characteristic cannot be identified in the picture to be cut, cutting the picture to be cut by adopting the last cutting frame.
5. A display device, comprising:
the acquisition module is used for acquiring a picture to be cut;
the recognition module is used for recognizing a first feature in the picture to be cut and generating a first feature extraction frame according to the first feature, wherein the first feature is contained in the first feature extraction frame;
a determining module, configured to determine, according to the first feature extraction frame and a display condition of the display device, a clipping frame of the picture to be clipped, where the first feature extraction frame is included in the clipping frame; the display conditions of the display equipment comprise a display scale and a display mode, wherein the display mode comprises horizontal screen display, vertical screen display and split screen display; under the condition of split-screen display, determining the cutting frame according to the size, the display proportion and the split-screen display mode of the first feature extraction frame and the split-screen display area;
the cutting module is used for cutting the picture to be cut by utilizing the cutting frame to obtain a cut picture;
and the display module is used for displaying the cut picture.
6. A display device comprising a processor and a communication circuit, the processor being connected to the communication circuit;
the processor is used for acquiring a picture to be cut through the communication circuit; the processor is used for identifying a first feature in the picture to be cut; the processor is used for generating a first feature extraction frame according to the first feature, and determining a cutting frame of the picture to be cut according to the first feature extraction frame and display conditions of display equipment, wherein the first feature extraction frame is contained in the cutting frame, the display conditions of the display equipment comprise a display scale and a display mode, and the display mode comprises horizontal screen display, vertical screen display and split screen display; under the condition of split-screen display, determining the cutting frame according to the size, the display proportion and the split-screen display mode of the first feature extraction frame and the split-screen display area; the processor is used for utilizing the cutting frame to cut the picture to be cut so as to obtain the cut picture.
7. An apparatus having a storage function, characterized in that program data are stored, which program data can be executed to implement the method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810623302.2A CN109089157B (en) | 2018-06-15 | 2018-06-15 | Video picture cutting method, display device and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810623302.2A CN109089157B (en) | 2018-06-15 | 2018-06-15 | Video picture cutting method, display device and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109089157A CN109089157A (en) | 2018-12-25 |
| CN109089157B true CN109089157B (en) | 2021-12-07 |
Family
ID=64839696
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810623302.2A Active CN109089157B (en) | 2018-06-15 | 2018-06-15 | Video picture cutting method, display device and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109089157B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109819306B (en) * | 2018-12-29 | 2022-11-04 | 花瓣云科技有限公司 | Media file clipping method, electronic device and server |
| CN111953919B (en) * | 2019-05-17 | 2022-11-04 | 成都鼎桥通信技术有限公司 | Video recording method and device of handheld terminal in video single call |
| CN110189378B (en) * | 2019-05-23 | 2022-03-04 | 北京奇艺世纪科技有限公司 | Video processing method and device and electronic equipment |
| CN110611787B (en) | 2019-06-10 | 2021-05-28 | 海信视像科技股份有限公司 | Display and image processing method |
| CN110839174A (en) * | 2019-12-02 | 2020-02-25 | 广州酷狗计算机科技有限公司 | Image processing method and device, computer equipment and storage medium |
| CN111031178A (en) * | 2019-12-19 | 2020-04-17 | 维沃移动通信有限公司 | Video stream clipping method and electronic equipment |
| CN111614910B (en) * | 2020-04-07 | 2022-05-13 | 北京达佳互联信息技术有限公司 | File generation method and device, electronic equipment and storage medium |
| CN113592874A (en) * | 2020-04-30 | 2021-11-02 | 杭州海康威视数字技术股份有限公司 | Image display method and device and computer equipment |
| CN112165635A (en) * | 2020-10-12 | 2021-01-01 | 北京达佳互联信息技术有限公司 | Video conversion method, device, system and storage medium |
| CN114666649B (en) * | 2022-03-31 | 2024-03-01 | 北京奇艺世纪科技有限公司 | Identification method and device of subtitle cut video, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102625147A (en) * | 2012-02-29 | 2012-08-01 | 中山大学 | Self-adapting display method for mobile video equipment |
| CN104361329A (en) * | 2014-11-25 | 2015-02-18 | 成都品果科技有限公司 | Photo cropping method and system based on face recognition |
| CN105264904A (en) * | 2013-06-19 | 2016-01-20 | Lg电子株式会社 | Signal transmitting and receiving device and method of controlling said device |
| WO2016198846A1 (en) * | 2015-06-08 | 2016-12-15 | Forbidden Technologies Plc | Highlight editor |
| CN106454407A (en) * | 2016-10-25 | 2017-02-22 | 广州华多网络科技有限公司 | Video live broadcast method and device |
| CN106713975A (en) * | 2016-12-08 | 2017-05-24 | 广州华多网络科技有限公司 | Live broadcast processing method and apparatus |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090102973A1 (en) * | 2004-01-09 | 2009-04-23 | Harris Scott C | Video split device |
| US20050179817A1 (en) * | 2004-01-14 | 2005-08-18 | Matsushita Electric Industrial Co., Ltd. | Video signal display unit |
| JP5455594B2 (en) * | 2009-12-10 | 2014-03-26 | 日本電信電話株式会社 | Video division reproduction method, video division reproduction apparatus, and program |
| KR102048041B1 (en) * | 2013-04-18 | 2019-11-22 | 삼성전자주식회사 | Electronic device and method for generating split screen image |
| CN104333695A (en) * | 2014-11-19 | 2015-02-04 | 北京奇虎科技有限公司 | Method and device for processing split-screen shooting, and client |
| CN106296760B (en) * | 2015-05-21 | 2021-05-14 | 腾讯科技（深圳）有限公司 | Picture clipping method and device |
| WO2017219347A1 (en) * | 2016-06-24 | 2017-12-28 | 北京小米移动软件有限公司 | Live broadcast display method, device and system |
| CN106201200A (en) * | 2016-07-06 | 2016-12-07 | 深圳市金立通信设备有限公司 | A kind of multi-screen display method and terminal |
-
2018
- 2018-06-15 CN CN201810623302.2A patent/CN109089157B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102625147A (en) * | 2012-02-29 | 2012-08-01 | 中山大学 | Self-adapting display method for mobile video equipment |
| CN105264904A (en) * | 2013-06-19 | 2016-01-20 | Lg电子株式会社 | Signal transmitting and receiving device and method of controlling said device |
| CN104361329A (en) * | 2014-11-25 | 2015-02-18 | 成都品果科技有限公司 | Photo cropping method and system based on face recognition |
| WO2016198846A1 (en) * | 2015-06-08 | 2016-12-15 | Forbidden Technologies Plc | Highlight editor |
| CN106454407A (en) * | 2016-10-25 | 2017-02-22 | 广州华多网络科技有限公司 | Video live broadcast method and device |
| CN106713975A (en) * | 2016-12-08 | 2017-05-24 | 广州华多网络科技有限公司 | Live broadcast processing method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109089157A (en) | 2018-12-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109089157B (en) | Video picture cutting method, display device and device | |
| CN108737882B (en) | Image display method, image display device, storage medium and electronic device | |
| CN106454407B (en) | Video live broadcasting method and device | |
| US8885875B2 (en) | Imaged image data processing apparatus, viewing information creating apparatus, viewing information creating system, imaged image data processing method and viewing information creating method | |
| CN105898583B (en) | Image recommendation method and electronic equipment | |
| CN111147911A (en) | Video clipping method and device, electronic equipment and storage medium | |
| CN110267093B (en) | Live video pushing method and device, storage medium, terminal and live mirror | |
| CN110876079B (en) | Video processing method, device and equipment | |
| CN110324648B (en) | Live broadcast display method and system | |
| CN108235090B (en) | Method and device for adjusting picture angle | |
| US9706102B1 (en) | Enhanced images associated with display devices | |
| WO2014030405A1 (en) | Display device, display method, television receiver, and display control device | |
| CN110234015A (en) | Live-broadcast control method, device, storage medium, terminal | |
| CN111050204A (en) | Video clipping method and device, electronic equipment and storage medium | |
| CN111741364A (en) | Content accurate pushing method and system based on face recognition | |
| EP2575358B1 (en) | Display apparatus and control method thereof | |
| CN115396705A (en) | Screen projection operation verification method, platform and system | |
| CN111147883A (en) | Live broadcast method and device, head-mounted display equipment and readable storage medium | |
| CN114449303A (en) | Live broadcast picture generation method and device, storage medium and electronic device | |
| CN107105311B (en) | Live broadcasting method and device | |
| CN113518239A (en) | Live broadcast interaction method and system, computer equipment and storage medium thereof | |
| CN113438550B (en) | Video playing method, video conference method, live broadcasting method and related devices | |
| CN109120856B (en) | Camera shooting method and device | |
| CN112672057B (en) | Shooting method and device | |
| CN112422907B (en) | Image processing method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20181225 Assignee: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Assignor: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. Contract record no.: X2021440000030 Denomination of invention: Clipping method, display device and device of video picture License type: Common License Record date: 20210125 |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |