CN107835433A - A kind of race wide viewing angle live broadcast system, associated equipment and live broadcasting method - Google Patents
A kind of race wide viewing angle live broadcast system, associated equipment and live broadcasting method Download PDFInfo
- Publication number
- CN107835433A CN107835433A CN201710432123.6A CN201710432123A CN107835433A CN 107835433 A CN107835433 A CN 107835433A CN 201710432123 A CN201710432123 A CN 201710432123A CN 107835433 A CN107835433 A CN 107835433A
- Authority
- CN
- China
- Prior art keywords
- wide viewing
- viewing angle
- video flowing
- streaming media
- media server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention relates to a kind of race wide viewing angle live broadcast system, it includes the live equipment of wide viewing angle, streaming media server and playback equipment, and the live equipment of wide viewing angle obtains multiple wide viewing angle picture frames；Obtain the Intrinsic Matrix and distortion factor matrix of wide viewing angle image unit；The Intrinsic Matrix and distortion factor matrix are sent to streaming media server；Generation video flowing is encoded into the multiple wide viewing angle picture frame；With by the video stream to streaming media server；The streaming media server is scheduled and cached to the video flowing, and the playback equipment decoded to the video flowing, deploy and textures play.
Description
Technical field
The application is related to live apparatus and method, in particular to live game coverage equipment, system and method.
Background technology
Live game coverage be often referred in real time by race scene image, sound by cable TV network, radio network or
Person internet etc. is transferred to for example, TV, radio, computer, the process of mobile terminal.With the development of Internet technology, base
Direct seeding technique in internet has obtained tremendous development, for example, the appearance of stream media technology, its sectional can by media data
Data are sent by network after compression, instantaneous transmission is audio-visual on network sees so that audience is played using specific playout software
Reward, audience can appreciate the live picture of the shooting angle of a certain video capture device essentially in real time using playout software
Face.
Wider visual angle is usually required to embody grand scene when relaying the sports class racing car race such as rally,
And the video council for playing wide viewing angle for a long time makes audience produce weary mood, so as to lose to live interest.Traditional
The mode of the chronological picture switching of direct seeding technique generally use realizes the live of different angle, such as is broadcast in the very first time
Put the feature fragment of First partial and play panorama fragment etc. in second time period.Although also there is picture-in-picture techniques, the technology
Extra resource can be taken in digital transmission mode, therefore is seldom applied in digital television system.
Therefore, it is necessary to a kind of device that can realize that race wide viewing angle is live, system and correlation technique.
The content of the invention
Some embodiments of the present application are related to a kind of race wide viewing angle live broadcast system, including the live equipment of wide viewing angle, the width
The live equipment in visual angle can include wide viewing angle image unit, for obtaining multiple wide viewing angle picture frames；Memory, for storing the
One sequence of computer instructions；Processor, for perform first sequence of computer instructions with：It is single to obtain the wide viewing angle shooting
The Intrinsic Matrix and distortion factor matrix of member；The Intrinsic Matrix and distortion factor matrix are sent to streaming media service
Device；Generation video flowing will be encoded into the multiple wide viewing angle picture frame, by the video stream to streaming media server；Institute
State streaming media server the Intrinsic Matrix and distortion factor matrix, and the wide viewing angle picture frame are cached and adjusted
Degree；Playback equipment, the playback equipment includes memory, for storing second computer command sequence；Processor, for performing
The second computer command sequence with：From the streaming media server received from least one wide viewing angle image unit
Intrinsic Matrix and the distortion factor matrix and the wide viewing angle video flowing；The wide viewing angle video flowing decode also
It is former into the multiple wide viewing angle picture frame；The wide viewing angle picture frame is entered based on the Intrinsic Matrix and distortion factor matrix
The wide viewing angle picture frame that row correction is deployed；The wide viewing angle of the expansion is played by the generation sequential of the wide viewing angle picture frame
Picture frame.
According to some embodiments of the present application, the wide viewing angle video flowing is based on RTMP by the live equipment of wide viewing angle
Or RTSP protocol propellings are to the streaming media server, or the live equipment of the wide viewing angle is based on the streaming media server
The wide viewing angle video flowing is sent to the streaming media server by request based on RTMP/RTSP/HTTP.
According to some embodiments of the present application, the race wide viewing angle live broadcast system also includes sound collection unit, is used for
Obtain the acoustic field signal of the sports live equipment of class racing car.
According to some embodiments of the present application, the first memory is also stored with the 3rd sequence of computer instructions, described
Sequence of computer instructions described in computing device by the acoustic field signal to be digitized into voice data；By the voice data with
The wide viewing angle Image Coding is to be packaged into wide viewing angle audio/video flow；And the wide viewing angle audio/video flow is sent to the stream
Media server.
According to some embodiments of the present application, the race includes vehicle sports race, and the race wide viewing angle is live to be set
It is standby to be arranged on vehicle.According to some embodiments of the present application, the race includes vehicle sports race, the race wide viewing angle
Live equipment is arranged on race place.
According to some embodiments of the present application, it is straight that race wide viewing angle live broadcast system can also include at least one common view angle
Broadcast equipment, the live equipment of common view angle produces common view angle video flowing, and by the common view angle video stream to institute
State streaming media server.
According to some embodiments of the present application, the stream media system will be from the institute of the live equipment reception of the common view angle
The wide viewing angle video flowing for stating common view angle video flowing and the expansion received from the live equipment of the wide viewing angle is passed in parallel to
Direct broadcast server.
Other embodiments of the application provide a kind of playback equipment for race wide viewing angle live broadcast system, and it includes
Memory, for storing sequence of computer instructions；Processor, for perform the sequence of computer instructions with：Taken from Streaming Media
Business Intrinsic Matrix and distortion factor matrix of the device received from least one wide viewing angle image unit；Received from streaming media server
From the wide viewing angle video flowing of the wide viewing angle image unit；Decoded back is carried out to the wide viewing angle video flowing into multiple wide viewing angles
Picture frame；The width deployed is corrected to the wide viewing angle picture frame based on the Intrinsic Matrix and distortion factor matrix
Multi-view image frame；And the wide viewing angle picture frame of the expansion is played by the generation sequential of the wide viewing angle picture frame.
According to the playback equipment of the race wide viewing angle live broadcast system of some embodiments, the streaming media server can be based on
RTMP/RTSP/HTTP agreements are by wide viewing angle video stream to the playback equipment.
Some embodiments of the present application are related to live game coverage method, and this method can include：By the intrinsic parameter measured and abnormal
Variable coefficient is sent to streaming media server；By the live equipment generation wide viewing angle video flowing of at least one race wide viewing angle or audio frequency and video
Stream；The wide viewing angle video flowing or audio/video flow are sent to the streaming media server；By at least one common live equipment
Generate common view angle video flowing or audio/video flow；The common view angle video flowing or audio/video flow are sent to the Streaming Media clothes
Business device；The streaming media server regards the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound
Frequency stream is passed in parallel to direct broadcast server；And the direct broadcast server is by the wide viewing angle video flowing or audio/video flow and institute
Common view angle video flowing or audio/video flow is stated either synchronously or asynchronously to provide to playback equipment.
In certain embodiments, the intrinsic parameter and distortion factor measured, which is sent to streaming media server, to be included being based on RTMP
Metadata packets by the intrinsic parameter measured and distortion factor by being sent to streaming media server
Some embodiments of the present application are related to live game coverage method, and this method can be included the intrinsic parameter measured and distortion
Coefficient is sent to streaming media server；By the wide viewing angle video flowing or sound of the live equipment generation expansion of at least one race wide viewing angle
Video flowing；The wide viewing angle video flowing or audio/video flow of the expansion are sent to the streaming media server；By at least one general
Logical live equipment generation common view angle video flowing or audio/video flow；The common view angle video flowing or audio/video flow are sent to institute
State streaming media server；The streaming media server regards the wide viewing angle video flowing or audio/video flow and the common view angle
Frequency stream or audio/video flow are passed in parallel to direct broadcast server；And the direct broadcast server regards the wide viewing angle video flowing or sound
Frequency stream and the common view angle video flowing or audio/video flow are provided to playback equipment according to the selected operation of the playback equipment.
According to some embodiments of the present application, the intrinsic parameter measured and distortion factor are sent into streaming media server includes
Metadata packets based on RTMP are by the intrinsic parameter measured and distortion factor by being sent to streaming media server.
Many the wide viewing angle live broadcast system and live broadcasting method that the application provides especially suitable for scenes such as live game coverages,
To provide suitable solution such as cross-country event is live, in particular, providing the live equipment of race wide viewing angle can realize
The application of the live platform of streaming media.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, of the invention is other
Feature, objects and advantages will become more apparent upon：
Fig. 1 is the schematic diagram of a scenario according to embodiments of the invention；
Fig. 2 is a kind of principle schematic diagram of live equipment according to embodiments of the invention；
Fig. 3 is the image processing flow figure of the live equipment according to embodiments of the invention；
Fig. 4 is the schematic diagram of the live broadcast system according to embodiments of the invention；
Fig. 5 is the schematic diagram according to a kind of broadcast interface of the playback equipment of embodiment of the present invention；And
Fig. 6 is the flow chart according to a kind of expansion function of the playback equipment of embodiment of the present invention.
Embodiment
It should be mentioned that some exemplary embodiments are described as before exemplary embodiment is discussed in greater detail
The processing described as flow chart or method.Although operations are described as the processing of order by flow chart, therein to be permitted
Multioperation can be implemented concurrently, concomitantly or simultaneously.In addition, the order of operations can be rearranged.When it
The processing can be terminated when operation is completed, it is also possible to the additional step being not included in accompanying drawing.The processing
It can correspond to method, function, code, subroutine, subprogram etc..
Alleged within a context " server " refer to can by run preset program or instruction come perform numerical computations and/
Or the intelligent electronic device of the predetermined process process such as logical calculated, it can include processor and memory, by computing device
The programmed instruction to prestore in memory makes a reservation for perform predetermined process process, or by the execution of the hardware such as ASIC, FPGA, DSP
Processing procedure, or realized by said two devices combination.
Wherein, the user equipment includes but is not limited to smart mobile phone, PDA, PC, notebook computer etc.；The network is set
For including but not limited to single network server, the server group of multiple webservers composition or based on cloud computing (Cloud
Computing the cloud being made up of a large amount of computers or the webserver), wherein, cloud computing is one kind of Distributed Calculation, by
One super virtual computer of the computer collection composition of a group loose couplings.Wherein, the computer equipment can isolated operation
To realize the present invention, it also can access network and this hair realized by the interactive operation with other computer equipments in network
It is bright.Wherein, the network residing for the computer equipment includes but is not limited to internet, wide area network, Metropolitan Area Network (MAN), LAN, VPN nets
Network etc..
It should be noted that the user equipment, the network equipment and network etc. are only for example, other are existing or from now on may be used
The computer equipment or network that can occur such as are applicable to the present invention, should also be included within the scope of the present invention, and to draw
It is incorporated herein with mode.
The method (some of them illustrated by flow) discussed herein below can by hardware, software, firmware, in
Between part, microcode, hardware description language or its any combination implement.When with software, firmware, middleware or microcode come real
Shi Shi, to implement the program code of necessary task or code segment can be stored in machine or computer-readable medium (such as
Storage medium) in.(one or more) processor can implement necessary task.
Concrete structure and function detail disclosed herein are only representational, and are for describing showing for the present invention
The purpose of example property embodiment.But the present invention can be implemented by many alternative forms, and it is not interpreted as
It is limited only by the embodiments set forth herein.
Although it should be appreciated that may have been used term " first ", " second " etc. herein to describe unit,
But these units should not be limited by these terms.It is used for the purpose of using these terms by a unit and another unit
Make a distinction.For example, in the case of the scope without departing substantially from exemplary embodiment, it is single that first module can be referred to as second
Member, and similarly second unit can be referred to as first module.Term "and/or" used herein above include one of them or
Any and all combination of more listed associated items.
Term used herein above is not intended to limit exemplary embodiment just for the sake of description specific embodiment.Unless
Context clearly refers else, otherwise singulative used herein above "one", " one " also attempt to include plural number.Should also
When understanding, term " comprising " and/or "comprising" used herein above provide stated feature, integer, step, operation,
The presence of unit and/or component, and do not preclude the presence or addition of other one or more features, integer, step, operation, unit,
Component and/or its combination.
It should further be mentioned that in some replaces realization modes, the function/action being previously mentioned can be according to different from attached
The order indicated in figure occurs.For example, depending on involved function/action, the two width figures shown in succession actually may be used
Substantially simultaneously to perform or can perform in a reverse order sometimes.
Live game coverage system in a kind of embodiment of the present invention goes for such as vehicle sports class race
It is live, vehicle sports can for example include track cycle and race, such as equation motorcycle race and offroad racing sports, example
Such as rally.Fig. 1 shows a kind of live broadcast system schematic diagram of a scenario of vehicle sports race.As shown in figure 1, common vehicle is competing
Skill race includes at least two cars, and live equipment is housed wherein at least on a car.Can have to be provided with the place of race and be oriented to
The live equipment of different shooting angles, these live equipment 10 can generate video flowing, audio stream or audio/video flow, video flowing, sound
Frequency stream or audio/video flow can be transferred into streaming media server, and streaming media server 20 can be by live platform by video flowing, sound
Frequency stream or audio/video flow are sent to the playback equipment of user equipment, such as smart mobile phone plays out.Live platform 30 can be
Direct broadcast server, it can have the video flowing or audio/video flow that director system control is sent to user equipment, and to live platform
30 video flowings received, audio stream or audio/video flow are selected.Live platform 30 can be by the video flowing received, sound
Frequency stream or audio/video flow are stored in different storage locations, and the address that user equipment 40 can be specified by accessing live platform is viewed and admired
Video flowing or audio/video flow.
In the live equipment shown in Fig. 1, some live equipment can be the live equipment for having wide viewing angle image unit
10.Wide viewing angle is the harvester with the visual angle more than 170 degree.The wide viewing angle image unit may, for example, be with flake
The image of camera lens, video acquisition module, such as fish-eye camera.There is the device of wide viewing angle camera lens can for example be deployed in for these
The inside of vehicle, such as instrument desk or roof, or the optional position in racing car place.
In the legend shown in Fig. 1, Some vehicles are provided with the live equipment 10 of wide viewing angle with fish-eye camera, this
The live equipment of kind can be described as the live equipment of flake again, and flake live equipment 10A, 10B, 10C and 10D can for example be arranged on vehicle
On, it can also be installed in competition field, as shown in live equipment 10E and 10F.
Fig. 2 shows a kind of schematic diagram of the live equipment 10 with fish-eye camera in embodiment.Reference picture 2, institute
Stating live equipment includes fish-eye camera 11, memory 12, wired or wireless output unit 13 and processor 14.Processor can be with
Pass through bus 16 and fish-eye camera, memory, wired or wireless output unit communication.The image that fish-eye camera 11 collects
For essentially more than the image at 180 degree visual angle, can be in the storage program of memory 12, when processor runs the program, will
The image S101 and camera internal reference number and distortion parameter S102 collected by fish-eye camera is obtained or receives first, then
Preposition processing S200 is carried out to the view data for obtaining or receiving.
The preposition processing, it can include carrying out image the one or more in dark angle processing, picture position correction.
After preposition processing, the live equipment of wide viewing angle will carry out coding to multiple images frame and form wide viewing angle video flowing.Again will
The wide viewing angle video stream is to user equipment, i.e. playback equipment.
Multiple wide viewing angle picture frames can be generated at the live end of equipment 10 of wide viewing angle by procedure above, by these wide viewing angles
Picture frame compresses generation wide viewing angle video flowing by the collection sequential of image by encoding, and it is based on such as RTMP (real-time messages
Host-host protocol) or RTSP (real time streaming transport protocol) agreement be sent to streaming media server 20.
The streaming media server 20 can be located geographically in the position away from live platform 30.For example, Streaming Media takes
Business device 20 can be arranged at the place center of closing racing track, or on any one vehicle.
The storage location 31 that streaming media server 20 can deposit in the video flowing received segmentation on live platform 30 supplies
User equipment is transferred, and either also directly can be based on RTMP, RTSP, HLS protocol or HTTP FLV agreements by live platform passes
Deliver to user equipment.
Can be that live equipment 10 provides sound collection unit 15, sound collection unit 15 gathers acoustic field signal, Ke Yiyou
Acoustic field signal is digitized as voice data by processor operation program, and voice data carries out preposition processing in live equipment, such as
Denoising.Voice data through preposition processing is synchronized with image, sealed after coding compression and based on RTMP or RTSP agreements
Audio/video flow is dressed up, is resent to streaming media server 20.
The request of transmission video flowing or audio/video flow can also be sent from the timing of streaming media server 20 to live equipment 10,
Live equipment 10 can respond the request will encode compression generation video flowing or audio/video flow send streaming media server 20 to.
The stream of acquisition store simultaneously the live use to audience simultaneously by streaming media server 20 by live platform 30
Family equipment 40.
Live broadcast system 30 can also obtain video flowing or audio/video flow from the live equipment 50 of common view angle.Common view angle is live
Equipment 50 can arrange one or more.Any position on vehicle or competition field can be arranged in.The live equipment of common view angle
There can be similar structure with the live equipment of wide viewing angle.Such as it can equally include image acquisition units, processor, storage
Device, bus, wired or wireless output unit etc..The live equipment 50 of common view angle is only needed after being corrected to the image collected
Video flowing is generated, and by pushing video streaming to streaming media server.
Similar, the live equipment 50 of common view angle can also include sound collection unit, for obtaining acoustic field signal, and number
Word metaplasia is into voice data.Voice data codified forms audio stream and pushes to streaming media server or together encapsulated with video flowing
Into audio/video flow and push to streaming media server.
The wide viewing angle video flowing or audio/video flow and common of expansion can be controlled via the director system 32 of live platform
Deploy the transmission of video flowing or audio/video flow in visual angle.
Video flowing, audio stream or the audio/video flow that the live equipment 50 of common view angle generates can equipment lifes live with wide viewing angle
Into expansion wide viewing angle video flowing or audio/video flow push to streaming media server 20 parallel.Streaming media server 20 can incite somebody to action
Live platform is sent to after the wide viewing angle video flowing or audio/video flow of expansion are synchronous with common view angle video flowing or audio/video flow to enter
Row storage, or by live platform synchronous driving give such as smart mobile phone playback equipment.
Can also be asynchronously by the wide viewing angle video flowing or audio/video flow of expansion and common view angle video flowing or audio/video flow
Send playback equipment to.
User equipment, i.e. playback equipment can be asked from streaming media server the specific live equipment of wide viewing angle intrinsic parameter and
Distortion factor matrix；User equipment can also be asked to streaming media server the live equipment of the wide viewing angle wide viewing angle video flowing or
Wide viewing angle audio/video flow.Conversely, streaming media server can also push the specific live equipment of wide viewing angle by user equipment depending on
The wide viewing angle video flowing or wide viewing angle audio/video flow of intrinsic parameter and distortion factor matrix and the live equipment of the wide viewing angle.
The user equipment can have wide viewing angle video flowing or wide viewing angle audio/video flow expansion playing function.Such as Fig. 6 institutes
Show, the function, which can be included in, receives S601 after wide viewing angle video flowing or wide viewing angle audio/video flow, and it decode
To multiple wide viewing angle picture frame S602.To intrinsic parameter of the wide viewing angle picture frame based on the live equipment of the wide viewing angle received and abnormal
Variable coefficient matrix carries out expansion and handles the wide viewing angle picture frame S603 deployed.Finally to the wide viewing angle picture frame of multiple expansion
The mapping operations of the wide viewing angle picture frame to the expansion of each frame, such as rectangle mapping operations are carried out according to sequential, to be set in broadcasting
Standby broadcast interface forms video pictures S604.
Image expansion processing such as can use cylinder model arc length mapping techniques, that is, establish with it is fish-eye
The cylinder model of the radiuses such as Sphere Measurement Model, wherein fish-eye Sphere Measurement Model is based on CCS (camera coordinates system), and cylinder
Model is based on WCS (world coordinate system).Need to carry out the coordinate system of cylinder model with the coordinate system of Sphere Measurement Model it is corresponding,
The corresponding relation of the point for the Sphere Measurement Model established under point and CCS on the cylinder model under WCS coordinate systems.Such as can be first
The height and width of cylinder are obtained by the maximum magnitude of the horizontal view angle of cylinder model；Then by certain point of image plane according to etc.
Corresponded to away from imaging model on the point for the sphere that radius is R, and be mapped to cylinder with waiting arc length, resettle inclination angle and level
The relation of the height and width position of azimuth and expanded view.It is possible thereby to establish the mapping one by one of image plane point and post planar point
Relation, so as to complete the corresponding relation of fish eye images and cylindrical picture, then the color-values of each point of fish eye images are pressed into two-wire
Property interpolation method obtains the point that a more accurate gray value is assigned on cylinder.
The wide viewing angle video flowing of the expansion can be played in the broadcast interface of the offer multi-angle of playback equipment 40, for example,
Broadcast interface as shown in Figure 5 can be provided, it includes broadcasting for the length-width ratio of the wide viewing angle image for meeting expansion positioned at middle part
Screen is put, for example, the wide viewing angle screen 3 of the wide viewing angle screen 1 of expansion, the wide viewing angle screen 2 of expansion and expansion.And it is located at
The common view angle screen 1 with common view angle the ratio of width to height of the wide viewing angle screen sides of expansion is to common view angle screen 4.Commonly regard
The source video sequence that angle screen plays can be the live equipment of the foregoing common view angle being arranged on competition field or be arranged in racing car
The video flowing of the live equipment push of common view angle.
For example, it is also possible to the wide viewing angle screen in expansion plays video flowing or audio frequency and video with one in common view angle screen
Stream, and the fragment in other screens repeat playing one time circulation of video flowing, and in user for example, by clicking on or touching
When operation selects the fragment of the loop play, the stored video flowing of corresponding live equipment is pulled from the memory of live platform
Or audio/video flow or pull streaming media server in real time from streaming media server and just regarded from what live equipment had just obtained
Frequency stream or audio/video flow.
The broadcast interface can also judge to shield when receiving user to the operation of screen corresponding to a certain live equipment
Whether curtain needs the wide viewing angle screens switch from expansion to common view angle screen, or inverse operation, if it is determined that need to switch,
Then replace broadcast interface.
The implementation example of the application includes：
1. a kind of race wide viewing angle live broadcast system, including
The live equipment of wide viewing angle, including
Wide viewing angle image unit, for obtaining multiple wide viewing angle picture frames；
Memory, for storing the first sequence of computer instructions；
Processor, for perform first sequence of computer instructions with：
Obtain the Intrinsic Matrix and distortion factor matrix of the wide viewing angle image unit；
The Intrinsic Matrix and distortion factor matrix are sent to streaming media server；
Generation video flowing will be encoded into the multiple wide viewing angle picture frame,
By the video stream to streaming media server；
The streaming media server enters to the Intrinsic Matrix and distortion factor matrix, and the wide viewing angle picture frame
Row caching and scheduling；
Playback equipment, including
Memory, for storing second computer command sequence；
Processor, for perform the second computer command sequence with：
From the Intrinsic Matrix of the streaming media server received from least one wide viewing angle image unit and
Distortion factor matrix and the wide viewing angle video flowing；
Decoded back is carried out to the wide viewing angle video flowing into the multiple wide viewing angle picture frame；
That is deployed is corrected to the wide viewing angle picture frame based on the Intrinsic Matrix and distortion factor matrix
Wide viewing angle picture frame；
The wide viewing angle picture frame of the expansion is played by the generation sequential of the wide viewing angle picture frame.
2. according to the race wide viewing angle live broadcast system of example 1, it is characterised in that：The live equipment of wide viewing angle is by the width
View video stream is based on based on RTMP or RTSP protocol propellings to the streaming media server, or the live equipment of the wide viewing angle
The wide viewing angle video flowing is sent to the Streaming Media based on RTMP/RTSP/HTTP and taken by the request of the streaming media server
Business device.
3. according to the race wide viewing angle live broadcast system of example 1, it is characterised in that：Also include sound collection unit, for obtaining
Take the acoustic field signal of the sports live equipment of class racing car.
4. according to the race wide viewing angle live broadcast system of example 3, it is characterised in that：The memory is also stored with the 3rd calculating
Machine command sequence, sequence of computer instructions described in the computing device with
The acoustic field signal is digitized into voice data；
By the voice data and the wide viewing angle Image Coding to be packaged into wide viewing angle audio/video flow；And
The wide viewing angle audio/video flow is sent to the streaming media server.
5. according to the race wide viewing angle live broadcast system of example 1, it is characterised in that：The race includes vehicle sports race,
The live equipment of race wide viewing angle is arranged on vehicle.
6. according to the race wide viewing angle live broadcast system of example 1, it is characterised in that：The race includes vehicle sports race,
The live equipment of race wide viewing angle is arranged on race place.
7. according to the race wide viewing angle live broadcast system of example 1, it is characterised in that：It is live also to include at least one common view angle
Equipment, the live equipment of the common view angle produce common view angle video flowing, and by the common view angle video stream to described
Streaming media server.
8. according to the race wide viewing angle live broadcast system of example 7, it is characterised in that：The stream media system will be from described common
The common view angle video flowing and the width of the expansion received from the live equipment of the wide viewing angle that the live equipment in visual angle receives
View video stream is passed in parallel to direct broadcast server.
9. a kind of playback equipment for race wide viewing angle live broadcast system, including
Memory, for storing sequence of computer instructions；
Processor, for perform the sequence of computer instructions with：
From Intrinsic Matrix and distortion factor matrix of the streaming media server received from least one wide viewing angle image unit；
From wide viewing angle video flowing of the streaming media server received from the wide viewing angle image unit；
Decoded back is carried out to the wide viewing angle video flowing into multiple wide viewing angle picture frames；
That is deployed is corrected to the wide viewing angle picture frame based on the Intrinsic Matrix and distortion factor matrix
Wide viewing angle picture frame；
The wide viewing angle picture frame of the expansion is played by the generation sequential of the wide viewing angle picture frame.
10. according to the playback equipment for race wide viewing angle live broadcast system of example 9, it is characterised in that：The Streaming Media
Server is based on RTMP/RTSP/HTTP agreements by wide viewing angle video stream to the playback equipment.
A kind of 11. live game coverage method, it is characterised in that：
The intrinsic parameter measured and distortion factor are sent to streaming media server；
By the live equipment generation wide viewing angle video flowing of at least one race wide viewing angle or audio/video flow；
The wide viewing angle video flowing or audio/video flow are sent to the streaming media server；
By at least one common live equipment generation common view angle video flowing or audio/video flow；
The common view angle video flowing or audio/video flow are sent to the streaming media server；
The streaming media server by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or
Audio/video flow is passed in parallel to direct broadcast server；And
The direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound
Video stream synchronization or asynchronously provide to playback equipment.
12. according to the live game coverage method of example 11, it is characterised in that：The intrinsic parameter and distortion factor measured is sent to stream
Media server includes the metadata packets based on RTMP by the intrinsic parameter measured and distortion factor by being sent to stream matchmaker
Body server
A kind of 13. live game coverage method, it is characterised in that：
The intrinsic parameter measured and distortion factor are sent to streaming media server；
By the wide viewing angle video flowing or audio/video flow of the live equipment generation expansion of at least one race wide viewing angle；
The wide viewing angle video flowing or audio/video flow of the expansion are sent to the streaming media server；
By at least one common live equipment generation common view angle video flowing or audio/video flow；
The common view angle video flowing or audio/video flow are sent to the streaming media server；
The streaming media server by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or
Audio/video flow is passed in parallel to direct broadcast server；And
The direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound
Video flowing is provided to playback equipment according to the selected operation of the playback equipment.
14. according to the live game coverage method of example 13, it is characterised in that：The intrinsic parameter measured and distortion factor are sent to
Streaming media server includes the metadata packets based on RTMP by the intrinsic parameter measured and distortion factor by being sent to stream
Media server.
15. a kind of computer-readable recording medium, it is stored with command sequence, can as described in computing device command sequence
To implement the method that right will go any one in 11 to 14.
Those skilled in the art will be understood that above-mentioned each function choosing-item and its corresponding live game coverage using merely illustrative,
For illustrating the purpose of the present invention, and any limitation of the invention is understood not to, other are existing or future
Function choosing-item and its it is corresponding it is live application such as can be applied to the present invention, all should be comprised in the present invention scope of patent protection it
It is interior.
It should be noted that the process part of the present invention can be carried out in the assembly of software and/or software and hardware,
For example, can using application specific integrated circuit (ASIC), general purpose computer or any other realized similar to hardware device.One
In individual embodiment, software program of the invention can realize steps described above or function by computing device.Similarly,
The software program (including related data structure) of the present invention can be stored in computer readable recording medium storing program for performing, for example, RAM
Memory, magnetically or optically driver or floppy disc and similar devices.In addition, some steps or function of the present invention can employ hardware to
Realize, for example, coordinating as with processor so as to perform the circuit of each step or function.
In addition, the part of the present invention can be applied to computer program product, such as computer program instructions, when its quilt
When computer performs, by the operation of the computer, the method according to the invention and/or technical scheme can be called or provided.
And the programmed instruction of the method for the present invention is called, it is possibly stored in fixed or moveable recording medium, and/or pass through
Broadcast or the data flow in other signal bearing medias and be transmitted, and/or be stored according to described program instruction operation
In the working storage of computer equipment.Here, including a device according to one embodiment of present invention, the device includes using
Memory in storage computer program instructions and processor for execute program instructions, wherein, when the computer program refers to
When order is by the computing device, method and/or skill of the plant running based on foregoing multiple embodiments according to the present invention are triggered
Art scheme.
Claims (4)
1. a kind of race wide viewing angle live broadcast system, including
The live equipment of wide viewing angle, including
Wide viewing angle image unit, for obtaining multiple wide viewing angle picture frames；
First memory, for storing the first sequence of computer instructions；
First processor, for perform first sequence of computer instructions with：
Obtain the Intrinsic Matrix and distortion factor matrix of the wide viewing angle image unit；
The Intrinsic Matrix and distortion factor matrix are sent to streaming media server；
The multiple wide viewing angle picture frame is encoded into generation video flowing；With
By the video stream to streaming media server；
The streaming media server is delayed to the Intrinsic Matrix and distortion factor matrix, and the wide viewing angle picture frame
Deposit and dispatch；
Playback equipment, including
Second memory, for storing second computer command sequence；
Second processor, for perform the second computer command sequence with：
From the Intrinsic Matrix of the streaming media server received from least one wide viewing angle image unit and distortion
Coefficient matrix and the wide viewing angle video flowing；
Decoded back is carried out to the wide viewing angle video flowing into the multiple wide viewing angle picture frame；
The width deployed is corrected based on the Intrinsic Matrix and distortion factor matrix to the wide viewing angle picture frame to regard
Angle picture frame；With
The wide viewing angle picture frame of the expansion is played by the generation sequential of the wide viewing angle picture frame.
2. a kind of playback equipment for race wide viewing angle live broadcast system, including
Memory, for storing sequence of computer instructions；
Processor, for perform the sequence of computer instructions with：
From Intrinsic Matrix and distortion factor matrix of the streaming media server received from least one wide viewing angle image unit；
From wide viewing angle video flowing of the streaming media server received from the wide viewing angle image unit；
Decoded back is carried out to the wide viewing angle video flowing into multiple wide viewing angle picture frames；
The width deployed is corrected based on the Intrinsic Matrix and distortion factor matrix to the wide viewing angle picture frame to regard
Angle picture frame；And
The wide viewing angle picture frame of the expansion is played by the generation sequential of the wide viewing angle picture frame.
A kind of 3. live game coverage method, it is characterised in that：
The intrinsic parameter measured and distortion factor are sent to streaming media server；
By the live equipment generation wide viewing angle video flowing of at least one race wide viewing angle or audio/video flow；
The wide viewing angle video flowing or audio/video flow are sent to the streaming media server；
By at least one common live equipment generation common view angle video flowing or audio/video flow；
The common view angle video flowing or audio/video flow are sent to the streaming media server；
The streaming media server regards the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound
Frequency stream is passed in parallel to direct broadcast server；And
The direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or audio frequency and video
Stream is either synchronously or asynchronously provided to playback equipment.
A kind of 4. live game coverage method, it is characterised in that：
The intrinsic parameter measured and distortion factor are sent to streaming media server；
By the wide viewing angle video flowing or audio/video flow of the live equipment generation expansion of at least one race wide viewing angle；
The wide viewing angle video flowing or audio/video flow of the expansion are sent to the streaming media server；
By at least one common live equipment generation common view angle video flowing or audio/video flow；
The common view angle video flowing or audio/video flow are sent to the streaming media server；
The streaming media server regards the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound
Frequency stream is passed in parallel to direct broadcast server；And
The direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or audio frequency and video
Stream is provided to playback equipment according to the selected operation of the playback equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710432123.6A CN107835433B (en) | 2017-06-09 | 2017-06-09 | Event wide-view live broadcasting system, associated equipment and live broadcasting method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710432123.6A CN107835433B (en) | 2017-06-09 | 2017-06-09 | Event wide-view live broadcasting system, associated equipment and live broadcasting method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107835433A true CN107835433A (en) | 2018-03-23 |
| CN107835433B CN107835433B (en) | 2020-11-20 |
Family
ID=61642987
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710432123.6A Active CN107835433B (en) | 2017-06-09 | 2017-06-09 | Event wide-view live broadcasting system, associated equipment and live broadcasting method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107835433B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113766266A (en) * | 2021-09-10 | 2021-12-07 | 阿波罗智联(北京)科技有限公司 | Audio and video processing method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1278384A (en) * | 1997-09-04 | 2000-12-27 | 发现通信公司 | Apparatus for video access and control over computer network, including image correction |
| JP2004153750A (en) * | 2002-11-01 | 2004-05-27 | Matsushita Electric Ind Co Ltd | Image distribution system |
| US9185391B1 (en) * | 2014-06-17 | 2015-11-10 | Actality, Inc. | Adjustable parallax distance, wide field of view, stereoscopic imaging system |
| CN105847851A (en) * | 2016-04-19 | 2016-08-10 | 北京金山安全软件有限公司 | Panoramic video live broadcast method, device and system and video source control equipment |
| CN106101503A (en) * | 2016-07-18 | 2016-11-09 | 优势拓展（北京）科技有限公司 | Real time panoramic Living Network video camera and system and method |
| CN106327478A (en) * | 2016-08-31 | 2017-01-11 | 北京的卢深视科技有限公司 | Fisheye panoramic image synthesis processing method and device |
| US9547883B1 (en) * | 2016-08-19 | 2017-01-17 | Intelligent Security Systems Corporation | Systems and methods for dewarping images |
| CN106604042A (en) * | 2016-12-22 | 2017-04-26 | Tcl集团股份有限公司 | Panorama webcasting system and panorama webcasting method based on cloud server |
-
2017
- 2017-06-09 CN CN201710432123.6A patent/CN107835433B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1278384A (en) * | 1997-09-04 | 2000-12-27 | 发现通信公司 | Apparatus for video access and control over computer network, including image correction |
| JP2004153750A (en) * | 2002-11-01 | 2004-05-27 | Matsushita Electric Ind Co Ltd | Image distribution system |
| US9185391B1 (en) * | 2014-06-17 | 2015-11-10 | Actality, Inc. | Adjustable parallax distance, wide field of view, stereoscopic imaging system |
| CN105847851A (en) * | 2016-04-19 | 2016-08-10 | 北京金山安全软件有限公司 | Panoramic video live broadcast method, device and system and video source control equipment |
| CN106101503A (en) * | 2016-07-18 | 2016-11-09 | 优势拓展（北京）科技有限公司 | Real time panoramic Living Network video camera and system and method |
| US9547883B1 (en) * | 2016-08-19 | 2017-01-17 | Intelligent Security Systems Corporation | Systems and methods for dewarping images |
| CN106327478A (en) * | 2016-08-31 | 2017-01-11 | 北京的卢深视科技有限公司 | Fisheye panoramic image synthesis processing method and device |
| CN106604042A (en) * | 2016-12-22 | 2017-04-26 | Tcl集团股份有限公司 | Panorama webcasting system and panorama webcasting method based on cloud server |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113766266A (en) * | 2021-09-10 | 2021-12-07 | 阿波罗智联(北京)科技有限公司 | Audio and video processing method, device, equipment and storage medium |
| CN113766266B (en) * | 2021-09-10 | 2024-02-13 | 阿波罗智联(北京)科技有限公司 | Audio and video processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107835433B (en) | 2020-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11653065B2 (en) | Content based stream splitting of video data | |
| KR102246002B1 (en) | Method, device, and computer program to improve streaming of virtual reality media content | |
| WO2021083176A1 (en) | Data interaction method and system, interaction terminal and readable storage medium | |
| JP7045856B2 (en) | Video transmission based on independent coded background update | |
| CN112738534B (en) | Data processing method and system, server and storage medium | |
| KR20150006771A (en) | Method and device for rendering selected portions of video in high resolution | |
| KR102214085B1 (en) | Method and apparatus for transmitting and receiving metadata for a plurality of viewpoints | |
| CN112738495B (en) | Virtual viewpoint image generation method, system, electronic device and storage medium | |
| Ahmad | Multi-view video: get ready for next-generation television | |
| US11282169B2 (en) | Method and apparatus for processing and distributing live virtual reality content | |
| JP2015521322A (en) | Panorama picture processing | |
| CN107835435A (en) | A kind of live equipment of race wide viewing angle and associated live broadcast system and method | |
| US11120615B2 (en) | Dynamic rendering of low frequency objects in a virtual reality system | |
| CN107835433A (en) | A kind of race wide viewing angle live broadcast system, associated equipment and live broadcasting method | |
| CN107835434A (en) | The live equipment of race wide viewing angle and associated live broadcast system and method | |
| CN112738009A (en) | Data synchronization method, device, synchronization system, medium and server | |
| WO2021083177A1 (en) | Method for generating depth map, computing nodes, computing node cluster, and storage medium | |
| CN112203101B (en) | Remote video live broadcast method and device and electronic equipment | |
| GB2563275A (en) | Image processing device and system | |
| TW202339495A (en) | Presentation of multi-view video data | |
| JP2023085912A (en) | Moving image distribution system, moving image distribution device, terminal, method, data structure, and program | |
| JP2023085913A (en) | Moving image distribution system, moving image distribution device, method, and program | |
| WO2023220535A1 (en) | Streaming scene prioritizer for immersive media | |
| Zoric et al. | Requirements for the Network Interfaces and Interactive Systems Usability | |
| JP2017041707A (en) | Reproduction device, information processing method, and communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211202 Address after: Room 501, gate 9, 9 / F, zhixueyuan, No. 29, Xierqi Road West, Haidian District, Beijing 100085 Patentee after: Zhi Xiaomu Address before: Room 1513, building 3, No. 3, Xijing Road, Badachu high tech park, Shijingshan District, Beijing 100041 Patentee before: FBLIFE (BEIJING) MEDIA TECHNOLOGY CO.,LTD. |
|
| TR01 | Transfer of patent right |