CN109640150B - Method, equipment and device for adjusting reference video picture - Google Patents
Method, equipment and device for adjusting reference video picture Download PDFInfo
- Publication number
- CN109640150B CN109640150B CN201811261615.4A CN201811261615A CN109640150B CN 109640150 B CN109640150 B CN 109640150B CN 201811261615 A CN201811261615 A CN 201811261615A CN 109640150 B CN109640150 B CN 109640150B
- Authority
- CN
- China
- Prior art keywords
- reference video
- video picture
- picture
- anchor point
- display area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application discloses a method, equipment and a device for adjusting a reference video picture, wherein the method comprises the following steps: acquiring a live broadcast picture; displaying a reference video picture in a live picture; determining an anchor point of a reference video picture; and acquiring the position change of the anchor point, and cutting the reference video picture according to the position change of the anchor point. By means of the mode, the reference video picture can be cut conveniently in the live broadcast process, and the live broadcast effect is optimized.
Description
Technical Field
The present application relates to the field of live broadcast technologies, and in particular, to a method, a device, and an apparatus for adjusting a reference video frame.
Background
With the rapid development of the internet technology and the popularization of intelligent equipment, people can perform various transaction processing and entertainment activities through the intelligent equipment at any time and any place, live broadcast is popular with people at present, and the live broadcast market is very active. The current live broadcast technology has large limitation on video processing in live broadcast.
Disclosure of Invention
The technical problem mainly solved by the application is to provide a method, equipment and a device for adjusting a reference video picture, which can facilitate cutting and adjusting the reference video picture in a live broadcast process.
In order to solve the technical problem, the application adopts a technical scheme that: a method for adjusting a reference video picture is provided, which comprises the following steps:
acquiring a live broadcast picture;
displaying a reference video picture in a live picture;
determining an anchor point of a reference video picture;
and acquiring the position change of the anchor point, and cutting the reference video picture according to the position change of the anchor point.
In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided an electronic device comprising an acquisition module, a display module, and a processing module, wherein,
the acquisition module is used for acquiring a live broadcast picture;
the display module is used for displaying the live broadcast picture and displaying the reference video picture in the live broadcast picture;
the processing module is used for determining an anchor point of a reference video picture;
the processing module is further used for obtaining the position change of the anchor point and cutting the reference video picture according to the position change of the anchor point.
In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided an electronic apparatus comprising a display device, an image acquisition circuit, a communication circuit, and a processor connected to the display device, the communication circuit, and the image acquisition circuit, respectively, wherein,
the image acquisition circuit is used for acquiring a live broadcast picture;
the display device is used for displaying the live broadcast picture and displaying the reference video picture in the live broadcast picture;
the processor is used for acquiring the position change of the anchor point through the communication circuit and cutting the reference video picture according to the position change of the anchor point.
In order to solve the above technical problem, another technical solution adopted by the present application is: there is provided a device having a storage function, storing program data that can be executed to implement the steps in the reference video picture adjustment method provided by the present application.
Compared with the prior art, the beneficial effects of this application are: through show the reference video picture in the live broadcast picture, can promote the interest of live broadcast, and confirm the anchor point on the reference video picture in the live broadcast process, the area of cutting out of waiting of calculating the reference video picture through the position change that obtains anchor point removal production, can directly tailor and adjust the reference video picture, so can realize effectively directly tailorring the reference video picture in the live broadcast process, need not to carry out post processing to the reference video picture before the live broadcast, thereby can realize directly, handle the reference video picture fast in the live broadcast process, satisfy anchor broadcast or user's requirement, save user's time and cost, promote the live broadcast and experience.
Drawings
FIG. 1 is a flowchart illustrating a first embodiment of a reference video frame adjustment method according to the present application;
FIG. 2 is a schematic interface diagram of a live view and a reference video view according to a first embodiment of a reference video view adjustment method of the present application;
FIG. 3 is a schematic diagram illustrating a process of cropping a reference video frame according to a first embodiment of the reference video frame adjustment method of the present application;
FIG. 4 is a flowchart illustrating a second embodiment of a reference video frame adjustment method according to the present application;
FIG. 5 is a schematic interface diagram of a live view and a reference video view according to a second embodiment of the reference video view adjustment method of the present application;
FIG. 6 is a schematic diagram of a reference video frame cropping and scaling process according to a second embodiment of the reference video frame adjusting method of the present application;
FIG. 7 is a flowchart illustrating a third embodiment of a reference video frame adjustment method according to the present application;
FIG. 8 is a schematic interface diagram of a live view and a reference video view according to a third embodiment of the reference video view adjustment method of the present application;
FIG. 9 is a schematic block circuit diagram of a first embodiment of the electronic device of the present application;
FIG. 10 is a schematic block circuit diagram of a first embodiment of the electronic device of the present application;
fig. 11 is a block diagram schematically illustrating the structure of an embodiment of the apparatus with storage function according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The inventor of the application finds that the anchor can open other video files in the live broadcast room to watch, for example, the dancing anchor takes related dancing video as a tutorial and puts the video in the live broadcast picture, thereby dancing along with the tutorial in the picture. The current live broadcast technology can only adjust video files by zooming, that is, the aspect ratio is fixed, and two methods which are most commonly used in the field are:
firstly, corresponding materials are directly used according to a desired display mode, for example, a vertical screen display is desired, a video file of the vertical screen can be directly searched, for example, a video file of the vertical screen recorded by a mobile phone is played in a live broadcast room, and after zooming is carried out, the length-width ratio is kept unchanged and the video file is still the vertical screen.
Secondly, using video editing software to perform post-processing, changing the length-width ratio of the video file, and then playing the post-processed video file in a live broadcast room.
However, the existing phenomenon is that a large number of video files are generally horizontal, and if the video files are processed by the two methods, the processing is very troublesome, and the workload and the cost are too large.
In order to improve the above phenomenon or solve the above problem, the present application provides the following embodiments:
referring to fig. 1 to 3, the first embodiment of the video frame adjustment method according to the present application, for example, can be applied to a video live broadcast technology, and includes the following steps:
step S101: a live view 11 is acquired.
The live broadcast picture 11 refers to a picture performed in a live broadcast process of a current live broadcast room, and is, for example, a picture acquired by using a camera or a screen projection or the like on live broadcast equipment such as a computer or a mobile terminal in a live broadcast software or an application program and displayed to audiences in a live broadcast manner, for example, a dancer is performing live broadcast dancing, and the live broadcast picture 11 is an acquired picture of the dancer performing the whole live broadcast process.
Step S102: a reference video picture 12 is displayed in the live picture 11.
The reference video frame 12 is a frame presented by a video file played by a main broadcast, for example, a video frame played by a dance main broadcast as a dance tutor, for example, a video frame played by a singer main broadcast as an MV, and the reference video frame 12 is played by the main broadcast or a user, and the type, size, and the like thereof are not limited herein.
In the present embodiment, the reference video frame 12 occupies a part of the live view 11 when displayed on the live view 11, and the frame covering the corresponding part of the live view 11 is displayed in front of the live view 11, for example, displayed in a floating manner on the live view 11.
In this embodiment, the reference video frame 12 may be displayed only on the live device on the main broadcast side, and the viewer cannot see the reference video frame 12 and can only see the live frame 11. Of course, the reference video frame 12 may also form a live video stream along with the live video frame 11, and the live video stream is sent to the viewer through the server for viewing, and the viewer may view the live video frame 11 and the reference video frame 12.
Step S103: an anchor point 121 of reference video picture 12 is determined.
For example, by determining one or more anchor points 121 on or outside the boundaries of the reference video picture 12, the anchor points 121 being associated with the reference video picture 12 such that the reference video picture 12 is in an editable state for a user or computer or the like to adjust the reference video picture 12. The anchor point 121 may be in the shape of a bar, or a dot.
Step S104: the change in position of the anchor point 121 is acquired and the reference video picture 12 is cropped according to the change in position of the anchor point 121.
Specifically, for example, if the anchor point 121 is dragged to move as the anchor point 12 is adjusted to be cropped, the live device calculates a position change caused by the movement of the anchor point 121, determines a region to be cropped 1213 according to the position change of the anchor point 121, and finally crops the reference video picture 12 according to the region to be cropped 1213, or crops the reference video picture 12 in real time along with the position change of the anchor point 121.
Referring to fig. 3, in the present embodiment, for example: first, the coordinate change of the anchor point 121 in the reference video picture 12 is calculated.
For example, the geometric center of the reference video frame 12 is used as the origin of coordinates, but it is also possible to use the center of the live frame 11 as the origin of coordinates. The change in position of the anchor point 121 before and after being moved can be represented as a change in coordinates.
Next, a width change and/or a height change of the to-be-cropped area 1213 of the reference video picture 12 is calculated from the coordinate change, for example, refer to fig. 3.
The width variation and the height variation refer to the width variation and the height variation of the to-be-cropped area 1213 in the source map of the reference video picture 12.
Further, the reference video picture 12 is cropped according to a height change and/or a width change of the region to be cropped 1213.
Referring to fig. 3, for example, taking a dancing anchor as an example, the dancing anchor utilizes a live broadcast device to perform live broadcast, and at the same time, opens a video file of a dancing tutorial as a reference video frame 12, and displays the video file in a live broadcast frame 11, because the video file is recorded and the aspect ratio is fixed, the live broadcast device may determine an anchor point 121 according to the position, the boundary, and other factors of the reference video frame 12, for example, the position of the anchor point 121 is on the boundary of the reference video frame 12, the anchor point 121 may be dragged by the dancing anchor to a desired position on the reference video frame 12 (of course, the live broadcast device may also automatically move the anchor point 121 to cause the anchor point 121 to generate a position change), the live broadcast device may calculate a position change of the anchor point 121, calculate a region to be clipped 1213 according to the position change of the anchor point 121, for example, the dancing anchor point 121 is dragged toward the middle of the reference video frame 12 to generate multi-segment displacement, the area through which the multiple segments of displacement pass can be determined as an area to be cropped 1213, and then the reference video picture 12 is cropped to obtain the cropped reference video picture 12, so that the actual requirements of the anchor are met.
In the embodiment, the anchor point 121 is determined by calculating the reference video picture 12 displayed in the live broadcast picture 11, the region 1213 to be cropped of the reference video picture 12 is calculated according to the position change of the anchor point 121 when the position change generated by the movement of the anchor point 121 is acquired, the reference video picture 12 can be directly cropped in the live broadcast process, the reference video picture 12 does not need to be subjected to post-processing before live broadcast, so that the reference video picture 12 can be directly and quickly processed in the live broadcast process, the requirements of an anchor broadcast or a user are met, the time and the cost of the user are saved, and the live broadcast experience is improved.
In the present embodiment, steps S101 to S104 are only numbered for convenience of presentation, and do not specifically limit the specific execution order of the steps, and in other embodiments of the present application, the specific order of the steps may be different from that of the present embodiment as long as the corresponding technical effects of the present application can be achieved.
Referring to fig. 4 to 6, a second embodiment of the method for adjusting a reference video picture according to the present application is further described in the first embodiment of the method for adjusting a reference video picture 12 according to the present application, where the anchor point 121 includes a clipping anchor point 1211 and a scaling anchor point 1212, where the same steps as those in the first embodiment may be referred to the contents of the first embodiment, and no further description is given here, and the second embodiment of the method for adjusting a reference video picture according to the present application includes the following steps:
step S201: a live view 11 is acquired.
Step S202: a reference video picture 12 is displayed in the live picture 11.
Step S203: the trim box 120 is determined on the boundary of the reference video picture 12, and the clip anchor 1211 is determined on the side of the trim box 120.
For example, when the reference video frame 12 is to be adjusted, the live device displays the adjustment frame 120, for example, the live device recognizes that the mouse position or the touch position of the anchor stays on the reference video frame 12, or the live device receives a signal that the anchor clicks the reference video frame 12, and then automatically displays the adjustment frame 120, where the adjustment frame 120 is located on the boundary of the reference video frame 12, and frames the reference video frame 12 in the adjustment frame 120, so as to adjust the entire reference video frame 12. In this embodiment, the adjustment frame 120 may be a rectangular frame, and the clipping anchor 1211 is determined in at least one of four sides of the adjustment frame 120, and optionally, four clipping anchor 1211 are determined in the middle of the four sides, and one clipping anchor 1211 is determined in the middle of each side and displayed. Referring to fig. 5, the moving direction of the clipping anchor 1211 may be a vertical direction of the edge of the adjustment frame 120.
Step S204: a zoom anchor point 1212 is determined at the vertex of the adjustment box 120.
The vertex of the adjustment box 120 refers to the intersection of adjacent edges. For example, when the adjustment frame 120 is a rectangular frame, the intersection of four sides is four vertices. In this embodiment, optionally, four scaling anchors 1212 are determined at the 4 vertices of the adjustment box 120, and each vertex determines and displays one scaling anchor 1212. The direction of movement of the zoom anchor point 1212 may be a positive or negative direction of the diagonal direction of the adjustment block 120 to allow zooming in or out of the reference video picture 12.
Step S205: the positional change of the clipping anchor 1211 is acquired, and the reference video picture 12 is clipped in accordance with the positional change of the clipping anchor 1211.
Referring to fig. 6, for example, when the anchor point 1211 on the adjustment frame 120 is dragged by the anchor, the edge of the adjustment frame moves along with the anchor point 1211, for example, to the middle of the reference video frame 12, and the coordinate change before and after the position change in the reference video frame 12 can be calculated, so as to calculate the region to be cropped 1213 of the reference video frame 12 corresponding to the edge of the adjustment frame 120. During the moving process of the clipping anchor 1211, the edge corresponding to the clipping anchor 1211 moves as a whole, that is, the movement of the clipping anchor 1211 drives the entire edge where it is located to translate together, so that the intersection point of the edge and the adjacent edge also moves.
Step S206: the position change of the zoom anchor point 1212 is acquired, and the reference video picture 12 is zoomed keeping the length-width ratio according to the position change of the zoom anchor point 1212.
For example, if the anchor drags the zoom anchor 1212 on the adjustment box 120 along the vertex diagonal direction, the live device will live to the position change of the movement of the zoom anchor 1212, and determine the zoom range according to the position change of the movement of the zoom anchor 1212, so as to perform zooming on the reference video lake surface with the aspect ratio kept. In this embodiment, the zooming may be real-time zooming, i.e. the anchor real-time drag zoom anchor 1212, and the reference video picture 12 may be zoomed in real-time. Of course, in other embodiments, non-real-time zooming is also possible, and zooming is performed after the anchor drag action is completed. In other embodiments, the zooming may also be performed automatically by the live device. Referring to fig. 6, when the zoom anchor point 1212 moves, two edges forming the zoom anchor point 1212 also move, so as to zoom in or out on the reference video frame 12.
In this embodiment, the reference video frame 12 may be cropped first and then zoomed, or zoomed first and then cropped, or only cropped or zoomed, and the actual situation is performed according to specific requirements.
In the embodiment, by setting the clipping anchor 1211 and the scaling anchor 1212, the reference video picture 12 can be freely and continuously clipped and scaled, scaling can be performed according to the length-width ratio, flexible picture clipping is supported, a suitable area can be clipped from the original reference video picture 12, and the reference video picture can be scaled to a proper size, so that the problem that clipping cannot be performed in the prior art can be better solved, and live broadcast experience is better improved.
Referring to fig. 7 and 8, a third embodiment of the reference video picture adjustment method of the present application is further described in the first embodiment of the reference video picture adjustment method of the present application, where the same steps as in the first embodiment may be referred to the contents of the first embodiment, and are not described herein again, and the third embodiment of the reference video picture adjustment method of the present application further includes the following steps:
step S301: a live view 11 is acquired.
Step S302: a reference video picture 12 is displayed in the live picture 11.
Step S303: an anchor point 121 of reference video picture 12 is determined.
Step S304: a first target of the reference video picture 12 is identified.
The first object may be preset by live software, such as a character. Taking the dancing anchor as an example, step S304 is to identify the dancing anchor in the reference video frame 12, so that the cropping range can be better determined without the first object being cropped or partially cropped.
Step S305: and obtaining the moving tracks of a plurality of first preset feature points of the first target.
Referring to fig. 8, the first predetermined feature point may be predetermined according to the type of the first target, and of course, the first feature point is also related to the type of the reference video frame 12. Taking the dancing anchor as an example, the head, palm, elbow, and knee of the teacher in the reference video frame 12 may be preset as the first preset feature points for obtaining the dancing action of the teacher, and certainly, more feature points may be selected to more accurately represent the action of the first target. The live broadcast equipment obtains the moving track that the first preset characteristic point moved and formed when mr's dancing, through obtaining the moving track of first preset characteristic point, can calculate the scope in the main activity space of first target.
Step S306: and determining the position change of the anchor point 121 according to the movement tracks of the plurality of first preset feature points.
Step S307: the reference video picture 12 is cropped according to the position change of the anchor point 121, so that a plurality of first preset feature points of the target are in the cropped reference video picture 12.
Specifically, the live device may calculate a range of an active space of the first target according to the movement trajectories of the plurality of first preset feature points, and calculate and determine a change in the position of the anchor point 121 according to the range of the active space, so that a region to be cropped (see, for example, a region to be cropped 1213 in fig. 6) generated by the change in the position of the anchor point 121 is not cropped to the range of the active space of the first target.
In this embodiment, the live broadcast device may automatically calculate the position change of the anchor point 121 according to the plurality of first preset feature points, and may generate the position change without manually moving the anchor point 121 by the anchor broadcaster, so as to calculate the region to be cropped 1213 and ensure that the portions corresponding to the plurality of first feature points are displayed in the cropped reference video picture 12, that is, the cropped reference video picture 12 must ensure that the track of the first feature points is displayed, so that the action of the first object can be normally displayed in the cropped reference video picture 12, and thus the action of the first object is not lost due to the cropping. Taking the dance anchor as an example, the course motion shown in the reference video frame 12 as the course is important, and if the course motion is not shown, the follow-up of the anchor may be affected.
In this embodiment, the geometric center of the reference video frame 12 may be used as a coordinate origin, the coordinate of the movement trajectory of the first preset feature point in the reference video frame 12 is obtained, the maximum value of the coordinates in the up-down and left-right directions is selected as the minimum value of the first target area (for example, a rectangular area, that is, the range of the first target activity space), so as to ensure that the first target area covers a plurality of first preset feature points of the first target, the coordinate to which the anchor point 121 needs to be moved is determined according to the coordinates of each boundary of the first target area, and the coordinate to which the anchor point is moved cannot be located in the first target area, so as to ensure that the area to be cut cannot be cut into the activity space of the first target. The coordinates to which the anchor point 121 needs to be moved may be compared with the original coordinates of the anchor point 121, the change in the position of the anchor point 121 may be determined, the adjustment block 120 may be the same as the first target area range, or the adjustment block 120 covers the first target area range.
Step S308: a second target in the live view 11 is identified.
Referring to fig. 8, the first target may be preset in the live broadcast software, but may also be automatically recognized by the live broadcast software, such as automatically recognizing a human face or recognizing a living body. Taking a dance anchor as an example, the first target may be the anchor himself.
Step S309: and obtaining the moving tracks of a plurality of second preset feature points of the second target.
The second preset feature point may be preset according to the type of the second target, or may be automatically determined by live broadcast software, for example, performing living body motion tracking. Taking a dance anchor as an example, the dance motion of the anchor when dancing can be represented by presetting a head, a palm, an elbow and a knee as second preset feature points, and certainly, more feature points can be selected to more accurately represent the motion of the second target. The live broadcast equipment acquires a moving track formed by the movement of a second preset characteristic point of the anchor when dancing, and the range of the activity space of the second target can be calculated by acquiring the moving track of the second preset characteristic point.
Step S310: the first display area 111 is determined in the live view 11 according to the movement trajectories of the second preset feature points, so that the second preset feature points for the second target are displayed in the first display area 111.
Specifically, the range of the first display area 111 may be calculated by using the change of the coordinates as in step S307, that is, the live device may automatically determine the range of the first display area 111 according to the movement track of the second preset feature point, so that the display of a plurality of preset second feature points in the first display area 111 can be ensured, that is, the first display area 111 is the range of the activity space where the second target is located. Of course, in other embodiments, the extent of the first display area 111 may be determined manually by the anchor or by the user.
Step S311: a second display area 112 is determined within the live view 11 in accordance with the first display area 111, the second display area 112 being used for placing the reference video view 12, wherein the first display area 111 and the second display area 112 do not overlap.
That is, the live video picture may be divided to include the first display region 111 and the second display region 112, and the first display region 111 and the second display region 112 are displayed without overlapping, that is, the second display region 112 is outside the first display region 111. After the first display region 111 is determined in step S310, the second display region 112 may be determined. The second display area 112 is determined in the present embodiment, so that the second display area 112 can be used as an area for displaying the reference video picture 12, and thus the reference video picture 12 does not overlap with the range of the main activity space of the anchor, and the live activity of the anchor is prevented from being blocked.
Step S312: an instruction to move the reference video picture 12 is obtained, and the reference video picture 12 is moved according to the instruction.
For example, the anchor moves the reference video picture 12 through a mouse pointer or a touch action to generate a moving instruction, and the live broadcasting equipment moves the reference video picture 12 to a proper position according to the moving instruction so as to ensure better live broadcasting activity.
Step S313: it is determined whether the position to which the reference video picture 12 has been moved is within the second display area 112.
When the live broadcasting equipment moves the reference video picture 12 to the position desired by the main broadcasting according to the instruction, whether the current position of the reference video picture 12 is in the second display area 112 is judged.
Step S314: if so, the reference video picture 12 is displayed in the second display area 112.
When the position to which the reference video picture 12 is moved is located within the second display area 112 for placing the reference video picture 12, the reference video picture 12 is smoothly displayed within the second display area 112. For example, a prompt may be displayed that the move was successful.
Step S315: if not, displaying prompt information in the live broadcast picture 11 for prompting the user to perform corresponding operations.
When the position to which the reference video picture 12 is moved is not located within the second display area 112 for placing the reference video picture 12, i.e., within the first display area 111 or overlapping the first display area 111, the live device may display a prompt message, such as a pop-up prompt, of a prompt type such as "occlusion prompt", "movement failure prompt", or "prompt to suggest movement to a specific area". In the present embodiment, when the reference video picture 12 is moved, the boundary between the first display area 111 and the second display area 112 is displayed in the live view 11, so that the anchor can move the reference video picture 12 conveniently.
In this embodiment, by recognizing the first target and the second target, the first display area 111 and the second display area 112 are respectively determined according to the trajectories of the first preset feature point and the second preset feature point, so that the display between the reference video picture 12 and the live broadcast picture 11 can be more conveniently adjusted, the reference video picture 12 does not block an important part of the live broadcast picture 11, the audience can better watch the live broadcast of the main broadcast, and the live broadcast experience is improved.
This embodiment can be combined with the second embodiment of the method for adjusting a reference video picture of the present application.
Referring to fig. 9, a first embodiment of the electronic device of the present application is a functional implementation of the live broadcast device of the first to third embodiments of the clipping method for reference video frames of the present application, and the present embodiment includes an obtaining module 21, a display module 22, and a processing module 23.
The obtaining module 21 is configured to obtain a live view. The display module 22 is configured to display a live view and a reference video view in the live view. The processing module 23 is used to determine anchor points for reference video pictures. The processing module 23 is further configured to obtain a position change of the anchor point, and crop the reference video picture according to the position change of the anchor point.
Modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional module in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The electronic device of this embodiment may be a terminal such as a PC, a tablet computer, a mobile phone, a notebook computer, an intelligent device, and so on, and for more functions of the functional module in this embodiment, reference may be made to the first to third embodiments of the adjustment method for a reference video frame in this application, which is not described herein again.
Referring to fig. 10, a second embodiment of the electronic device according to the present application is a hardware implementation of the live broadcast device according to the first to third embodiments of the adjustment method for a reference video picture according to the present application, and the present embodiment includes a processor 31, a communication circuit 32, an image acquisition circuit 33, a display device 34, and the processor 31 respectively connected to the communication circuit 32, the display device 34, and the image acquisition circuit 33 through buses.
In the present embodiment, the display device has a display function, such as an LCD display, or an OLED display, or the like. The communication circuit 32 is an interface for the processor 31 to communicate with external devices. The image acquisition circuit 33 is a circuit for capturing an image or video, or a circuit for acquiring a screen shot. The image capturing circuit 33 is, for example, a camera, and can capture or record images and videos, and for example, an interface including a USB may be connected to an external device to project video pictures onto the electronic device.
The image acquisition circuit 33 is configured to acquire a live view. The display device 34 is used to display a live view and a reference video view in the live view. The processor 31 is configured to obtain the position change of the anchor point through the communication circuit 32, and crop the reference video picture according to the position change of the anchor point.
In the present embodiment, the processor 31 may also be referred to as a CPU (Central Processing Unit). The processor 31 may be an integrated circuit chip having signal processing capabilities. The processor 31 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The electronic device of this embodiment may be a terminal such as a PC, a tablet computer, a mobile phone, a notebook computer, and the like, and as for the processor in this embodiment to realize more functions, reference may be made to the first to third embodiments of the adjustment method for reference video frames in this application, which are not described herein again.
Referring to fig. 11, the device 40 provided in the embodiment of the device with storage function of the present application stores program data, and the program data can be executed to implement the steps in the first to third embodiments of the reference video frame adjusting method of the present application.
The methods according to the first to third embodiments of the present application reference video picture adjustment method provided by the present application may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as independent products. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage device 40 and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. The aforementioned device 40 includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, or other devices, such as a computer, including a storage medium.
The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.
Claims (8)
1. A method for adjusting a reference video frame, the method comprising:
acquiring a live broadcast picture;
displaying the reference video picture in the live picture;
determining an anchor point for the reference video picture;
identifying a first target of the reference video picture;
obtaining the moving tracks of a plurality of first preset feature points of the first target;
determining the position change of the anchor point according to the movement tracks of the first preset feature points, so that the first preset feature points of the first target are displayed in the cut reference video picture;
identifying a second target in the live picture;
obtaining the moving tracks of a plurality of second preset feature points of the second target;
determining a first display area in the live broadcast picture according to the moving tracks of the second preset feature points, so that parts corresponding to the second preset feature points for the second target are displayed in the first display area;
and determining a second display area according to the first display area, wherein the second display area is used for placing the reference video picture, and the first display area and the second display area are not overlapped.
2. The method of claim 1, wherein: the anchor point comprises a cropping anchor point, and the step of determining the anchor point for the reference video picture comprises:
determining an adjustment frame on a boundary of the reference video picture;
and determining the clipping anchor point on the edge of the adjusting frame.
3. The method of claim 2, wherein: the anchor point comprises a zoom anchor point, the step of determining the anchor point for the reference video picture further comprising:
determining the scaling anchor point at the vertex of the adjustment box;
after the step of obtaining the position change of the anchor point and cutting the video picture according to the position change of the anchor point, the method comprises the following steps:
and acquiring the position change of the zooming anchor point, and zooming the reference video picture in real time by keeping the length-width ratio according to the position change of the zooming anchor point.
4. The method of claim 1, further comprising:
acquiring an instruction for moving the reference video picture, and moving the reference video picture according to the instruction;
judging whether the position to which the reference video picture is moved is in the second display area;
if so, displaying the reference video picture in the second display area;
if not, displaying prompt information in the live broadcast picture for prompting the user to perform corresponding operation.
5. The method of claim 1, wherein the step of obtaining the change in the position of the anchor point and cropping the reference video picture according to the change in the position of the anchor point comprises:
calculating the coordinate change of the position change of the anchor point in the reference video picture;
calculating the width change and/or height change of a cutting area of the reference video picture according to the coordinate change;
and real-time clipping is carried out on the reference video picture according to the height change and/or the width change of the clipping area.
6. An electronic device, comprising an acquisition module, a display module, and a processing module, wherein,
the acquisition module is used for acquiring a live broadcast picture;
the display module is used for displaying a reference video picture and the live broadcast picture, wherein the reference video picture is displayed in the live broadcast picture;
the processing module is to determine an anchor point of the reference video picture;
the processing module is to identify a first target of the reference video picture; obtaining the moving tracks of a plurality of first preset feature points of the first target; determining the position change of the anchor point according to the movement tracks of the first preset feature points, so that the first preset feature points of the first target are displayed in the cut reference video picture; identifying a second target in the live picture; obtaining the moving tracks of a plurality of second preset feature points of the second target; determining a first display area in the live broadcast picture according to the moving tracks of the second preset feature points, so that parts corresponding to the second preset feature points for the second target are displayed in the first display area; and determining a second display area according to the first display area, wherein the second display area is used for placing the reference video picture, and the first display area and the second display area are not overlapped.
7. An electronic apparatus comprising a display device, an image acquisition circuit, a communication circuit, and a processor connected to the display device, the communication circuit, and the image acquisition circuit via buses, respectively,
the image acquisition circuit is used for acquiring a live broadcast picture;
the display device is used for displaying a reference video picture and the live broadcast picture, wherein the reference video picture is displayed in the live broadcast picture;
the processor is configured to identify a first target of the reference video picture; obtaining the moving tracks of a plurality of first preset feature points of the first target; determining the position change of an anchor point according to the movement tracks of the first preset feature points, so that the first preset feature points of the first target are displayed in the cut reference video picture; identifying a second target in the live picture; obtaining the moving tracks of a plurality of second preset feature points of the second target; determining a first display area in the live broadcast picture according to the moving tracks of the second preset feature points, so that parts corresponding to the second preset feature points for the second target are displayed in the first display area; and determining a second display area according to the first display area, wherein the second display area is used for placing the reference video picture, and the first display area and the second display area are not overlapped.
8. An apparatus having a storage function, wherein program data is stored, the program data being executable to implement the steps in the reference video picture adjustment method according to any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811261615.4A CN109640150B (en) | 2018-10-26 | 2018-10-26 | Method, equipment and device for adjusting reference video picture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811261615.4A CN109640150B (en) | 2018-10-26 | 2018-10-26 | Method, equipment and device for adjusting reference video picture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109640150A CN109640150A (en) | 2019-04-16 |
| CN109640150B true CN109640150B (en) | 2021-10-15 |
Family
ID=66066804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811261615.4A Active CN109640150B (en) | 2018-10-26 | 2018-10-26 | Method, equipment and device for adjusting reference video picture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109640150B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110515686B (en) * | 2019-08-28 | 2021-05-18 | 联想(北京)有限公司 | Image display method and device |
| CN111683263B (en) * | 2020-06-08 | 2022-06-03 | 腾讯科技（深圳）有限公司 | Live broadcast guiding method, device, equipment and computer readable storage medium |
| CN115767113B (en) * | 2022-09-22 | 2023-09-01 | 北京国际云转播科技有限公司 | Cloud rebroadcasting method, device, medium and system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8869198B2 (en) * | 2011-09-28 | 2014-10-21 | Vilynx, Inc. | Producing video bits for space time video summary |
| CN105263049B (en) * | 2015-10-28 | 2019-10-29 | 努比亚技术有限公司 | A kind of video Scissoring device, method and mobile terminal based on frame coordinate |
| CN106303586A (en) * | 2016-08-18 | 2017-01-04 | 北京奇虎科技有限公司 | A kind of method of network direct broadcasting, main broadcaster's end equipment, viewer end equipment |
| CN108566519B (en) * | 2018-04-28 | 2022-04-12 | 腾讯科技（深圳）有限公司 | Video production method, device, terminal and storage medium |
-
2018
- 2018-10-26 CN CN201811261615.4A patent/CN109640150B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109640150A (en) | 2019-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109640150B (en) | Method, equipment and device for adjusting reference video picture | |
| US8330793B2 (en) | Video conference | |
| CN110072087B (en) | Camera linkage method, device, equipment and storage medium based on 3D map | |
| CN106878786B (en) | Method and device for displaying barrage in VR video | |
| CN110944727A (en) | System and method for controlling virtual camera | |
| US11533438B2 (en) | Method to configure a virtual camera path | |
| US9129657B2 (en) | Video image display apparatus, video image display method, non-transitory computer readable medium, and video image processing/display system for video images of an object shot from multiple angles | |
| CN108319362B (en) | Panoramic information display method, electronic equipment and computer storage medium | |
| US20240078703A1 (en) | Personalized scene image processing method, apparatus and storage medium | |
| WO2018014517A1 (en) | Information processing method, device and storage medium | |
| CN112954193B (en) | Shooting method, shooting device, electronic equipment and medium | |
| CN112221128B (en) | Map adjusting method and related device | |
| US20200329227A1 (en) | Information processing apparatus, information processing method and storage medium | |
| CN111970532A (en) | Video playing method, device and equipment | |
| CN114520877A (en) | Video recording method and device and electronic equipment | |
| CN111954045A (en) | Augmented reality device and method | |
| CN113709544B (en) | Video playing method, device, equipment and computer readable storage medium | |
| KR102128955B1 (en) | Method for generating a spin image and apparatus thereof | |
| CN112509005B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| JP5103682B2 (en) | Interactive signage system | |
| US12062137B2 (en) | Information processing apparatus, information processing method, and storage medium | |
| CN113286138A (en) | Panoramic video display method and display equipment | |
| CN110958463A (en) | Method, device and equipment for detecting and synthesizing virtual gift display position | |
| CN105261041A (en) | Information processing method and electronic device | |
| JP2009246917A (en) | Video display device, and video processing apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210120 Address after: 511442 3108, 79 Wanbo 2nd Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Applicant after: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Address before: 511449 28th floor, block B1, Wanda Plaza, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Applicant before: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |