CN113014814A - Video acquisition method, video acquisition terminal and video live broadcast system - Google Patents
Video acquisition method, video acquisition terminal and video live broadcast system Download PDFInfo
- Publication number
- CN113014814A CN113014814A CN202110233090.9A CN202110233090A CN113014814A CN 113014814 A CN113014814 A CN 113014814A CN 202110233090 A CN202110233090 A CN 202110233090A CN 113014814 A CN113014814 A CN 113014814A
- Authority
- CN
- China
- Prior art keywords
- video
- target
- acquisition
- module
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000000007 visual effect Effects 0.000 claims abstract description 16
- 238000004806 packaging method and process Methods 0.000 claims abstract description 12
- 238000005538 encapsulation Methods 0.000 claims description 2
- 230000009286 beneficial effect Effects 0.000 abstract 1
- 208000031509 superficial epidermolytic ichthyosis Diseases 0.000 description 19
- 238000010586 diagram Methods 0.000 description 9
- 230000005540 biological transmission Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002860 competitive effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000000547 structure data Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a video acquisition method, a video acquisition terminal and a video live broadcast system, which comprise the following steps: s1: acquiring a target to be acquired; s2: acquiring the visual angle information of the acquisition target when a preset condition is met, and storing the visual angle information of the acquisition target; s3: packaging the view angle parameters of the collected target into video data; s4: and transmitting the video data. The invention also discloses a video acquisition terminal, and by utilizing the method and the terminal, the multi-view information is added in the video acquisition and coding stage, the watching requirement of multi-view playing at the playing end is realized by matching with a multi-view player, the watching experience of a user is obviously improved, and the deployment cost of the acquisition end is also reduced, so the method and the terminal have obvious technical advantages and beneficial effects.
Description
Technical Field
The invention relates to a video playing technology, in particular to a video acquisition method, a video acquisition terminal and a video live broadcast system.
Background
At present, various competitive events at home and abroad, particularly sports events and other events with large information content, are usually presented to audiences by multiple machine positions and manual camera view angle switching. Although the cameraman can usually successfully capture and switch to the wonderful moment of the game, the passive watching practice of the audience causes the audience to lose the autonomy and has certain influence on the watching experience.
Disclosure of Invention
In order to solve the above problems in the prior art, the present invention provides a solution for video capture.
In order to solve the above problems, the present invention provides a video capture method, which includes the following steps: s1: acquiring a target to be acquired; s2: acquiring the visual angle information of the acquisition target when a preset condition is met, and storing the visual angle information of the acquisition target; s3: packaging the view angle parameters of the collected target into video data; s4: and transmitting the video data.
Further, the acquisition target comprises a global target, a focus target, a hot spot target and a multi-focus mixed target.
Further, the viewing angle information includes collected viewing angle coordinates and focus information.
Further, the preset condition includes waiting for a predetermined time interval.
Further, in step S3, the stored view angle parameters of the acquisition target are specifically encapsulated as SEI data of a video data packet.
Further, before the step S4, the method further includes waiting for the nalu data frame to be sent out.
Further, after the step S1, the method further includes sending SEI data, which encapsulates the collection target into a video data packet, to the playing end.
The invention also provides a video acquisition terminal, and the system comprises: a target identification module: the system is used for acquiring a target to be acquired; the target information acquisition module: the system comprises a camera, a camera module, a display module and a display module, wherein the camera is used for acquiring the view angle information of the acquisition target when a preset condition is met and storing the view angle information of the acquisition target; a video packaging module: the system comprises a video acquisition module, a video acquisition module and a display module, wherein the video acquisition module is used for acquiring a video data; the video sending module: and the audio/video data packet is sent.
Further, the system also comprises a target information encapsulation module, which is used for encapsulating the acquired target into SEI data of the video data packet and sending the SEI data to a playing end.
The invention also discloses a live video broadcast system, a live broadcast cdn distribution system, a video acquisition terminal, a video processing system, a video transcoding system and a video playing terminal, wherein the live broadcast cdn distribution system is used for receiving and distributing live broadcast video streams, the video acquisition terminal is used for acquiring data of live broadcast video sources, the video transcoding system is used for transcoding video frames, the video playing terminal is used for playing and displaying videos, and the video acquisition terminal is the video acquisition terminal.
The invention also provides an electronic device, which comprises a processor and a memory, wherein the memory is used for storing the executable program; the processor is configured to perform any one of the video capture methods disclosed in the first aspect of the present invention.
By utilizing the method and the system, the viewing angle coordinate information of the target object is acquired at the acquisition end, and the method for playing the live video by adopting the special customized player at the playing end realizes a special video live broadcasting system supporting multi-viewing-angle viewing experience.
Compared with the prior art, the method and the system have the following advantages:
(1) multi-view information is added in the audio and video acquisition and encoding stage, and the multi-view player at the playing end is matched, so that the multi-view playing which can be controlled randomly and the watching effect of players which can be switched randomly can be realized, and the watching experience of users can be greatly improved;
(2) by using the acquisition system disclosed by the invention, on an acquisition site, only the minimum number of machine positions capable of covering the whole field are needed to be adopted for video acquisition, and meanwhile, the video playback processing by the director is not needed any more, so that a large amount of manpower and material resources can be saved, and the deployment cost of an acquisition end is greatly reduced.
In summary, the method and system of the present invention have significant technical advantages over the prior art.
In order that the invention may be more clearly and fully understood, specific embodiments thereof are described in detail below with reference to the accompanying drawings.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly introduced below. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
FIG. 1 is a flow diagram illustrating a video capture method in one embodiment
Fig. 2 shows a schematic structural diagram of a video capture terminal in one embodiment.
Fig. 3 shows a schematic structural diagram of a video capture terminal in another embodiment.
Fig. 4 shows a schematic structural diagram of a video live system in one embodiment.
Fig. 5 shows a schematic structural diagram of a video live system in another embodiment.
Detailed Description
Referring to fig. 1, fig. 1 shows a flowchart of a video capturing method in an embodiment, which specifically includes steps S11 to S14:
step S11: acquiring a target to be acquired;
in one embodiment, the targets to be collected in the game need to be identified, and the targets to be collected may be identified through images, and include a global target, a focus target, a hot target, and a multi-focus mixed target.
Step S12: acquiring the visual angle information of the acquisition target when a preset condition is met, and storing the visual angle information of the acquisition target;
in this embodiment, the preset condition includes waiting for a predetermined time interval, or every certain number of video frames. When the video acquisition terminal monitors that the match starts, the video acquisition terminal will start to acquire the visual angle parameters of each player at a certain number of video frames,
step S13: packaging the view angle parameters of the collected target into video data;
in one embodiment, step S13 is to encapsulate the view angle parameters of the saved collection objects as SEI data of a video data packet, and if the view angle parameters of the saved collection objects of the objects contain view angle information of players, the view angle information of the players is encapsulated in the SEI data.
Step S14: and transmitting the video data.
And pushing the video data packet encapsulated with the view angle parameters of the acquisition object to a receiving end.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a video capture terminal in an embodiment, where the video capture terminal 10 includes: the system comprises a target identification module 101, a target information acquisition module 102, a video packaging module 103 and a video sending module 104, wherein:
the target recognition module 101: the system is used for acquiring a target to be acquired;
the target information acquisition module 102: the system comprises a camera, a camera module, a display module and a display module, wherein the camera is used for acquiring the view angle information of the acquisition target when a preset condition is met and storing the view angle information of the acquisition target;
the video packaging module 103: the visual angle parameter is used for packaging the stored visual angle parameter of the target acquisition object into an audio/video data packet;
the video transmission module 104: and the audio/video data packet is sent.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a video capture terminal in another embodiment, in which the video capture terminal 10 includes: the system comprises a target identification module 101, a target information acquisition module 102, a video packaging module 103, a video sending module 104, a target information packaging module 105, an audio and video acquisition module 106, an image processing module 107 and a video processing main module 108, wherein the four modules of the target identification module 101, the target information acquisition module 102, the video packaging module 103 and the video sending module 104 have the same functions as those of the previous embodiment, and other modules have the following functions:
the target information acquisition module 105: and the SEI data used for encapsulating the acquisition target to the video data packet is sent to the playing end. In one embodiment, the module is primarily used to send SEI data encapsulating player information into video data packets to the player.
And audio and video acquisition 106: the method is used for acquiring audio and video signals.
The image processing module 107: for image processing.
The video processing main module 108: the main module for video processing is used for completing the control of the main processing flow in the video acquisition stage, and a cache is also arranged in the main video processing module for storing the multi-view information of the acquired object.
In one embodiment, the video processing main module 108 receives the capture instruction, obtains the target object information to be captured from the instruction, calls the target information capture module 102 to obtain the view angle parameter of the target object according to the condition, and returns the view angle parameter to the video processing main module 108 for processing. As an example, the main video processing module 108 may be triggered by a system user actively, or a signal for starting a game may be monitored by the main video processing module 108, and the main video processing module 108 actively calls the target information collecting module 102 according to a certain number of video frame intervals to obtain multi-view parameters of each player, and store the multi-view parameters in the "view cache".
In one embodiment, when the video processing master module 108 detects that there is data in the "view buffer", it waits for the current nalu to be sent out, and then encapsulates the data in the "view buffer" as SEI and outputs the SEI.
Based on the foregoing embodiment, the present application further discloses a live video system, please refer to fig. 4, where fig. 4 is a schematic structural diagram of a live video system of this embodiment for implementing live broadcast, and in this embodiment, the live video system includes: live cdn distribution system, video acquisition terminal, video processing system, video transcoding system and video playback terminal, wherein, live cdn distribution system is used for receiving live video stream and distributes, video acquisition terminal is used for being used for gathering the data of live video source, video transcoding system is used for carrying out transcoding processing to the video frame, video playback terminal is used for broadcast and show video, video acquisition terminal is the video acquisition terminal in above-mentioned embodiment.
As shown in the figure, the video capture terminal completes the capture of the live video content, at the cdn distribution stage of the live service, the video processing system receives the live stream or the video stream, extracts the view angle information of the view angle object and the view angle object in the page by processing the frame image data of the video stream, packages the view angle information into the structure data to be filled or supplemented in the page data of the video frame, assembles the new video stream data to be redistributed to the live cdn distribution system for distribution, transcodes the video by using the video transcoding system before cdn network distribution, then distributes the video stream or the video data to the player terminal by using the cdn network, after the player terminal receives the video stream, firstly uses the video transcoding system to process the video, then extracts and renders the transcoded view angle information according to the playing setting, and realizing the playing and displaying of the video.
Referring to fig. 5, fig. 5 shows a schematic structural diagram of a video live broadcasting system in an embodiment, as shown in the figure, the embodiment is a ball game live broadcasting system mainly including a collecting end and a playing end, and the following describes an operation flow of the system from the collecting end and the playing end respectively:
1. collection end
In this embodiment, the acquisition end mainly comprises a video processing module and a player identification module.
Before sending video data, the video processing module outputs a video frame with a custom SEI field, wherein the custom SEI field contains information of players participating in the game;
the acquisition end user actively informs the video processing module, or after the video processing module monitors that the match starts, the video processing module calls the player identification module to acquire the visual angle parameters of each player at intervals of a certain number of video frames, and returns the visual angle parameters to the video processing module, and the visual angle parameters are stored in a player visual angle parameter cache area by the video processing module;
when the video processing module detects that data exists in the player view angle parameter buffer area, the video processing module waits for the completion of the current nalu transmission, and then encapsulates the parameter information in the buffer area into SEI and outputs the SEI.
2. Player terminal
In this embodiment, the playing end is specifically implemented by a customized player.
When the customized player receives the first video frame with the custom SEI field, the customized player analyzes the first video frame to obtain the information of participating players and displays the information of participating players to audiences;
when the customized player receives more SEIs, the SEIs are analyzed and stored in a local cache;
when the audience requests the customized player to switch to a specific viewing angle of a specific player, the customized player judges whether the viewing angle is legal or not according to the information of the first SEI and the last SEI (namely the current viewing angle parameter information). If yes, processing the video picture according to the current visual angle parameter information and the request of the audience and outputting the video picture.
In practical application, the modules in the method and the system disclosed by the invention can be deployed on one server, or each module can be independently deployed on different servers, and particularly, the modules can be deployed on cluster servers according to needs in order to provide stronger video animation processing capacity.
It should be noted that, all or part of the steps in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, which may include, but is not limited to: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (11)
1. A video capture method, comprising the steps of:
s1: acquiring a target to be acquired;
s2: acquiring the visual angle information of the acquisition target when a preset condition is met, and storing the visual angle information of the acquisition target;
s3: packaging the view angle parameters of the collected target into video data;
s4: and transmitting the video data.
2. The video capture method of claim 1, wherein the capture objects comprise global objects, focus objects, hotspot objects, and multifocal hybrid objects.
3. The video capture method of claim 1, wherein the view angle information comprises captured view angle coordinates, focus information.
4. The video capture method of claim 1, wherein the predetermined condition comprises waiting a predetermined time interval.
5. The video capturing method as claimed in claim 1, wherein in step S3, the stored view angle parameters of the capturing target are encapsulated as SEI data of a video data packet.
6. The video capturing method of claim 1, wherein before step S4, the method further comprises waiting for nalu data frames to be sent.
7. The video capturing method as claimed in claim 1, wherein after the step S1, the method further comprises sending SEI data encapsulating the capturing object as a video data packet to a playing end.
8. A video capture terminal, comprising:
a target identification module: the system is used for acquiring a target to be acquired;
the target information acquisition module: the system comprises a camera, a camera module, a display module and a display module, wherein the camera is used for acquiring the view angle information of the acquisition target when a preset condition is met and storing the view angle information of the acquisition target;
a video packaging module: the system comprises a video acquisition module, a video acquisition module and a display module, wherein the video acquisition module is used for acquiring a video data;
the video sending module: and the audio/video data packet is sent.
9. The video capture terminal of claim 7, further comprising a target information encapsulation module, configured to send SEI data that encapsulates the capture target into a video data packet to the playback end.
10. A live video system comprises a live broadcast cdn distribution system, a video acquisition terminal, a video processing system, a video transcoding system and a video playing terminal, wherein the live broadcast cdn distribution system is used for receiving live broadcast video streams and distributing the live broadcast video streams, the video processing system is used for processing the content of video frames, the video transcoding system is used for transcoding the video frames, the video playing terminal is used for playing and displaying videos, and the video acquisition terminal is the video acquisition terminal disclosed by any one of claims 7-9.
11. An electronic device, further comprising a processor and a memory,
the memory is used for storing an executable program;
the processor is configured to execute the executable program to implement the video capture method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110233090.9A CN113014814A (en) | 2021-03-03 | 2021-03-03 | Video acquisition method, video acquisition terminal and video live broadcast system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110233090.9A CN113014814A (en) | 2021-03-03 | 2021-03-03 | Video acquisition method, video acquisition terminal and video live broadcast system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113014814A true CN113014814A (en) | 2021-06-22 |
Family
ID=76403168
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110233090.9A Pending CN113014814A (en) | 2021-03-03 | 2021-03-03 | Video acquisition method, video acquisition terminal and video live broadcast system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113014814A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891044A (en) * | 2021-09-29 | 2022-01-04 | 天翼物联科技有限公司 | Video live broadcast method and device, computer equipment and computer readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102396236A (en) * | 2009-01-28 | 2012-03-28 | Lg电子株式会社 | Broadcast receiver and video data processing method thereof |
| CN105007415A (en) * | 2015-06-30 | 2015-10-28 | 广东欧珀移动通信有限公司 | Method and device for previewing image |
| CN105656910A (en) * | 2016-01-27 | 2016-06-08 | 腾讯科技（深圳）有限公司 | Media transmission server, media transmission system, user terminal and media transmission method |
| CN106303230A (en) * | 2016-08-05 | 2017-01-04 | 浙江大华技术股份有限公司 | A kind of method for processing video frequency and device |
| CN110225401A (en) * | 2019-07-12 | 2019-09-10 | 青岛一舍科技有限公司 | A kind of video broadcasting method and device of adjustable viewing angle |
| US20200322587A1 (en) * | 2018-04-05 | 2020-10-08 | Lg Electronics Inc. | Method for transmitting 360-degree video, method for receiving 360-degree video, apparatus for transmitting 360-degree video, and apparatus for receiving 360-degree video |
| CN111901623A (en) * | 2020-08-03 | 2020-11-06 | 杭州当虹科技股份有限公司 | Auxiliary information superposition method based on full-link IP ultra-high-definition multicast system |
-
2021
- 2021-03-03 CN CN202110233090.9A patent/CN113014814A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102396236A (en) * | 2009-01-28 | 2012-03-28 | Lg电子株式会社 | Broadcast receiver and video data processing method thereof |
| CN105007415A (en) * | 2015-06-30 | 2015-10-28 | 广东欧珀移动通信有限公司 | Method and device for previewing image |
| CN105656910A (en) * | 2016-01-27 | 2016-06-08 | 腾讯科技（深圳）有限公司 | Media transmission server, media transmission system, user terminal and media transmission method |
| CN106303230A (en) * | 2016-08-05 | 2017-01-04 | 浙江大华技术股份有限公司 | A kind of method for processing video frequency and device |
| US20200322587A1 (en) * | 2018-04-05 | 2020-10-08 | Lg Electronics Inc. | Method for transmitting 360-degree video, method for receiving 360-degree video, apparatus for transmitting 360-degree video, and apparatus for receiving 360-degree video |
| CN110225401A (en) * | 2019-07-12 | 2019-09-10 | 青岛一舍科技有限公司 | A kind of video broadcasting method and device of adjustable viewing angle |
| CN111901623A (en) * | 2020-08-03 | 2020-11-06 | 杭州当虹科技股份有限公司 | Auxiliary information superposition method based on full-link IP ultra-high-definition multicast system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113891044A (en) * | 2021-09-29 | 2022-01-04 | 天翼物联科技有限公司 | Video live broadcast method and device, computer equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106233745B (en) | Providing tile video streams to clients | |
| CA2809312C (en) | Content transmission apparatus, content transmission method, content reproduction apparatus, content reproduction method, program, and content distribution system | |
| KR101208427B1 (en) | Multiple Camera control and image storing apparatus and method for synchronized multiple image acquisition | |
| KR20190045934A (en) | Method and apparatus for controlled viewing point and orientation selective audiovisual content | |
| WO2012043358A1 (en) | Content supplying device, content supplying method, content reproduction device, content reproduction method, program, and content viewing system | |
| CN107040794A (en) | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system | |
| US20090113505A1 (en) | Systems, methods and computer products for multi-user access for integrated video | |
| CN110035316B (en) | Method and apparatus for processing media data | |
| WO2015151095A1 (en) | Method and system for automatic television production | |
| CN111355966A (en) | Surrounding free visual angle live broadcast method and system | |
| US11282169B2 (en) | Method and apparatus for processing and distributing live virtual reality content | |
| CN113014943A (en) | Video playing method, video player and video live broadcasting system | |
| US9438937B1 (en) | Video server that provides a user tailored video stream consistent with user input using content of a primary stream and an enhanced stream | |
| CN111225228B (en) | Video live broadcast method, device, equipment and medium | |
| CN105163152A (en) | Interactive access method for television interaction system | |
| CN113572975B (en) | Video playing method, device and system and computer storage medium | |
| CN112584189A (en) | Live broadcast data processing method, device and system and computer readable storage medium | |
| CN113014814A (en) | Video acquisition method, video acquisition terminal and video live broadcast system | |
| CN113014944A (en) | Video processing method and system and video live broadcast system | |
| US20200213631A1 (en) | Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus | |
| CN114040184A (en) | Image display method, system, storage medium and computer program product | |
| CN112738609A (en) | Multi-channel video stream transmission method and device and multi-channel video stream playing system | |
| CN113014942A (en) | Video transcoding method, video transcoding system and video live broadcasting system | |
| KR102124194B1 (en) | Multi channel transmitting system for image analysis and controlling method | |
| WO2022222533A1 (en) | Video playing method, apparatus and system, and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210622 |