CN107835434A - The live equipment of race wide viewing angle and associated live broadcast system and method - Google Patents
The live equipment of race wide viewing angle and associated live broadcast system and method Download PDFInfo
- Publication number
- CN107835434A CN107835434A CN201710431777.7A CN201710431777A CN107835434A CN 107835434 A CN107835434 A CN 107835434A CN 201710431777 A CN201710431777 A CN 201710431777A CN 107835434 A CN107835434 A CN 107835434A
- Authority
- CN
- China
- Prior art keywords
- viewing angle
- wide viewing
- audio
- expansion
- live
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
- H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
Abstract
The application is related to the live equipment of race wide viewing angle, and it includes wide viewing angle image unit, for obtaining wide viewing angle image；The executable sequence of computer instructions of storage in memory；To realize：Obtain the Intrinsic Matrix and distortion factor matrix of the image unit；Preposition processing is carried out to the wide viewing angle image；The wide viewing angle image of expansion processing generation expansion is carried out to the image through preposition processing based on the Intrinsic Matrix and distortion factor matrix；The wide viewing angle video flowing of wide viewing angle image generation expansion based on the expansion；And by the wide viewing angle video stream of the expansion to streaming media server.The application further relates to the live broadcast system and method for correlation.
Description
Technical field
The application is related to live apparatus and method, in particular to live game coverage equipment, system and method.
Background technology
Live game coverage be often referred in real time by race scene image, sound by cable TV network, radio network,
Or internet etc. is transferred to for example, TV, radio, computer, the process of mobile terminal.With the development of Internet technology,
Direct seeding technique based on internet has obtained tremendous development, for example, the appearance of stream media technology, its sectional by media number
Data are sent by network according to after compressible, instantaneous transmission is audio-visual so that audience uses specific playout software on network
Broadcasting is viewed and admired, and audience can appreciate the shooting angle of a certain video capture device essentially in real time using playout software
Live picture.
Wider visual angle is usually required to embody grand field when relaying the sports class racing car race such as rally
Face, and the video council for playing wide viewing angle for a long time makes audience produce weary mood, so as to lose to live interest.Pass
The mode of the chronological picture switching of direct seeding technique generally use of system realizes the live of different angle, such as first
Time plays the feature fragment of First partial and plays panorama fragment etc. in second time period.Although also there is picture-in-picture techniques,
But the technology can take extra resource in digital transmission mode, therefore seldom be applied in digital television system.
Therefore, it is necessary to a kind of device that can realize that race wide viewing angle is live, system and correlation technique.
The content of the invention
Some embodiments of the present application are related to a kind of live equipment of race wide viewing angle, and it includes wide viewing angle image unit, use
In acquisition wide viewing angle image；Memory, for storing sequence of computer instructions；Processor, perform the sequence of computer instructions
To realize：Obtain the Intrinsic Matrix and distortion factor matrix of the image unit；Preposition place is carried out to the wide viewing angle image
Reason；Expansion processing generation expansion is carried out to the image through preposition processing based on the Intrinsic Matrix and distortion factor matrix
Wide viewing angle image；The wide viewing angle video flowing of wide viewing angle image generation expansion based on the expansion；By the wide viewing angle of the expansion
Video stream is to streaming media server.
Other embodiments of the application are related to a kind of live game coverage system, and it includes, and at least one wide viewing angle is live to be set
It is standby, for producing video flowing and/or audio/video flow；Streaming media server, for receiving the live equipment transmission of the wide viewing angle
Video flowing or audio/video flow；And direct broadcast server, for the video flowing that is received streaming media server by Living Network or
Audio/video flow is distributed to playback equipment；Wherein, the live equipment of the wide viewing angle includes wide viewing angle image unit, for obtaining width
Multi-view image；Memory, for storing sequence of computer instructions；
Processor, the sequence of computer instructions is performed to realize：Obtain the Intrinsic Matrix of the image unit and abnormal
Variable coefficient matrix；To the preposition processing of wide viewing angle image；Based on the Intrinsic Matrix and distortion factor matrix to through preposition processing
Image carry out expansion processing generation expansion wide viewing angle image；Wide viewing angle image based on the expansion forms the width of expansion
View video stream；By video stream to streaming media server.
Other embodiments of the application provide a kind of live game coverage method, and it includes：Regarded by least one race is wide
The wide viewing angle video flowing or audio/video flow of the live equipment generation expansion in angle；By the wide viewing angle video flowing or audio frequency and video of the expansion
It is streamed to the streaming media server；By at least one common live equipment generation common view angle video flowing or audio/video flow；
The common view angle video flowing or audio/video flow are sent to the streaming media server；The streaming media server is by described in
Wide viewing angle video flowing or audio/video flow and the common view angle video flowing or audio/video flow are passed in parallel to direct broadcast server；
And the direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or audio frequency and video
The step of stream is either synchronously or asynchronously provided to playback equipment.
Other embodiments of the application provide a kind of live game coverage method, it is characterised in that including by least one
The wide viewing angle video flowing or audio/video flow of the live equipment generation expansion of race wide viewing angle；By the wide viewing angle video flowing of the expansion
Or audio/video flow is sent to the streaming media server；By at least one common live equipment generation common view angle video flowing or
Audio/video flow；The common view angle video flowing or audio/video flow are sent to the streaming media server；The streaming media service
The wide viewing angle video flowing or audio/video flow and the common view angle video flowing or audio/video flow are passed in parallel to live by device
Server；And the direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing
Or audio/video flow the step of being provided according to the selected operation of the playback equipment to playback equipment.
Many the wide viewing angle live broadcast system and live broadcasting method that the application provides are especially suitable for fields such as live game coverages
Scape, to provide suitable solution such as cross-country event is live, in particular, providing the live equipment of race wide viewing angle can
Realize the application of the live platform of streaming media.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, the application its
Its feature, objects and advantages will become more apparent upon：
Fig. 1 is the schematic diagram of a scenario according to embodiments herein；
Fig. 2 is a kind of principle schematic diagram of live equipment according to embodiments herein；
Fig. 3 is the image processing flow figure of the live equipment according to embodiments herein；
Fig. 4 is the schematic diagram of the live broadcast system according to embodiments herein；And
Fig. 5 is a kind of schematic diagram of the broadcast interface of the playback equipment of embodiment according to the application.
Embodiment
It should be mentioned that some exemplary embodiments are described before exemplary embodiment is discussed in greater detail
Into the processing or method described as flow chart.Although operations are described as the processing of order by flow chart, therein
Many operations can be implemented concurrently, concomitantly or simultaneously.In addition, the order of operations can be rearranged.When
It operates processing when completing and can be terminated, it is also possible to the additional step being not included in accompanying drawing.The place
Reason can correspond to method, function, code, subroutine, subprogram etc..
Alleged within a context " server " refers to that numerical computations can be performed by running preset program or instruction
And/or the intelligent electronic device of the predetermined process process such as logical calculated, it can include processor and memory, by processor
The programmed instruction to prestore in memory is performed to perform to perform predetermined process process, or by hardware such as ASIC, FPGA, DSP
Predetermined process process, or realized by said two devices combination.
Wherein, the user equipment includes but is not limited to smart mobile phone, PDA, PC, notebook computer etc.；The network is set
For including but not limited to single network server, the server group of multiple webservers composition or based on cloud computing (Cloud
Computing the cloud being made up of a large amount of computers or the webserver), wherein, cloud computing is one kind of Distributed Calculation,
A super virtual computer being made up of the computer collection of a group loose couplings.Wherein, the computer equipment can be transported individually
Go to realize the application, also can access network and this is realized by the interactive operation with other computer equipments in network
Application.Wherein, the network residing for the computer equipment include but is not limited to internet, wide area network, Metropolitan Area Network (MAN), LAN,
VPN etc..
It should be noted that the user equipment, the network equipment and network etc. are only for example, other are existing or from now on
The computer equipment or network being likely to occur such as are applicable to the application, should also be included within the application protection domain, and with
Way of reference is incorporated herein.
The method (some of them illustrated by flow) discussed herein below can by hardware, software, firmware,
Middleware, microcode, hardware description language or its any combination are implemented.When with software, firmware, middleware or microcode
During implementing, machine or computer-readable medium can be stored in implement the program code of necessary task or code segment
In (such as storage medium).(one or more) processor can implement necessary task.
Concrete structure and function detail disclosed herein are only representational, and are for describing the application
The purpose of exemplary embodiment.But the application can be implemented by many alternative forms, and should not be explained
Into being limited only by the embodiments set forth herein.
It should be appreciated that although term " first ", " second " etc. are may have been used herein to describe each list
Member, but these units should not be limited by these terms.It is used for the purpose of using these terms by a unit and another
Unit makes a distinction.For example, in the case of the scope without departing substantially from exemplary embodiment, first module can be referred to as
Second unit, and similarly second unit can be referred to as first module.Term "and/or" used herein above includes it
In one or more listed associated items any and all combination.
Term used herein above is not intended to limit exemplary embodiment just for the sake of description specific embodiment.Remove
Non- context clearly refers else, otherwise singulative used herein above "one", " one " also attempt to include plural number.
It is to be further understood that term " comprising " used herein above and/or "comprising" provide stated feature, integer, step,
The presence of operation, unit and/or component, and do not preclude the presence or addition of other one or more features, integer, step, behaviour
Work, unit, component and/or its combination.
It should further be mentioned that in some replaces realization modes, function/action for being previously mentioned can according to different from
The order indicated in accompanying drawing occurs.For example, depending on involved function/action, the two width figures shown in succession are actually
It can substantially simultaneously perform or can perform in a reverse order sometimes.
Live game coverage system in a kind of embodiment of the application goes for such as vehicle sports class race
It is live, vehicle sports can for example include track cycle and race, such as equation motorcycle race and offroad racing sports,
Such as rally.Fig. 1 shows a kind of live broadcast system schematic diagram of a scenario of vehicle sports race.As shown in figure 1, common car
Sports race includes at least two cars, and live equipment is housed wherein at least on a car.Can have on the place of race provided with fixed
Video flowing, audio stream or audio/video flow, video can be generated in the live equipment of different shooting angles, these live equipment 10
Stream, audio stream or audio/video flow can be transferred into streaming media server, and streaming media server 20 can be by live platform by video
Stream, audio stream or audio/video flow are sent to the playback equipment of user equipment, such as smart mobile phone plays out.Live platform 30
Can be direct broadcast server, it can have the video flowing, audio stream or audio frequency and video that director system control is sent to user equipment
Stream, and the video flowing, audio stream or the audio/video flow that are received to live platform 30 select.Live platform 30 will can connect
Video flowing, audio stream or the audio/video flow received is stored in different storage locations, and user equipment 40 can be live flat by accessing
Video flowing, audio stream or audio/video flow are viewed and admired in the address that platform is specified.
In the live equipment shown in Fig. 1, some live equipment can be the live equipment for having wide viewing angle image unit
10.Wide viewing angle is the harvester with the visual angle more than 170 degree.The wide viewing angle image unit may, for example, be with fish
The image of glasses head, video acquisition module, such as fish-eye camera.These have the device of wide viewing angle camera lens for example can portion
Administration is in the inside of vehicle, such as instrument desk or roof, or the optional position in racing car place.
In the legend shown in Fig. 1, Some vehicles are provided with the live equipment 10 with fish-eye camera, this live
Equipment can be described as the live equipment of flake again, and flake live equipment 10A, 10B, 10C and 10D can for example be arranged on vehicle, may be used also
To be installed in competition field, as shown in live equipment 10E and 10F.
Fig. 2 shows a kind of schematic diagram of the live equipment 10 with fish-eye camera in embodiment.Reference picture 2, institute
Stating live equipment includes fish-eye camera 11, memory 12, wired or wireless output unit 13 and processor 14.Processor can
To pass through bus 16 and fish-eye camera, memory, wired or wireless output unit communication.What fish-eye camera 11 collected
Image for essentially more than the image at 180 degree visual angle, can be in the storage program of memory 12, when processor runs the program
When, the image S101 and camera internal reference number and distortion parameter that will obtain first or reception is collected by fish-eye camera
S102, preposition processing S200 then is carried out to the view data for obtaining or receiving.
The preposition processing, it can include carrying out image the one or more in dark angle processing, picture position correction.
After preposition processing, intrinsic parameter of the processor operation program based on the camera lens measured and distortion parameter are by wide viewing angle figure
As carrying out expansion processing S 300.
The expansion processing of image arc length mapping techniques, i.e. foundation and fish eye lens such as can use cylinder model
The radius such as Sphere Measurement Model cylinder model, wherein fish-eye Sphere Measurement Model is based on CCS (camera coordinates system), and
Cylinder model is based on WCS (world coordinate system).Need to carry out the coordinate system of the coordinate system of cylinder model and Sphere Measurement Model
It is corresponding, the corresponding relation of the point for the Sphere Measurement Model established under point and CCS on the cylinder model under WCS coordinate systems.Such as can be with
The height and width of cylinder are obtained by the maximum magnitude of the horizontal view angle of cylinder model first；Then by certain point of image plane
Corresponded to according to equidistant imaging model on the point for the sphere that radius is R, and be mapped to cylinder with waiting arc length, resettle inclination angle
And the relation of the height and width position of horizontal azimuth and expanded view.It is possible thereby to establish image plane point and post planar point
Mapping relations one by one, so as to complete the corresponding relation of fish eye images and cylindrical picture, then the color by each point of fish eye images
Color value obtains the point that a more accurate gray value is assigned on cylinder by bilinear interpolation.
The wide viewing angle image of expansion can be generated at the live end of equipment 10 by procedure above, by the wide viewing angle of this expansion
Image is by the wide viewing angle video flowing of the sequential generation expansion of the collection of expansion map generalization sequential or original image, video flowing
Compressed by encoding after generation, and assisted based on such as RTMP (real-time messages host-host protocol) or RTSP (real time streaming transport protocol)
View is sent to streaming media server 20.
The streaming media server 20 can be located geographically in the position away from live platform 30.For example, Streaming Media takes
Business device 20 can be arranged at the place center of closing racing track, or on any one vehicle.
The storage location 31 that streaming media server 20 can deposit in the video flowing received segmentation on live platform 30 supplies
User equipment is transferred, and either also directly can be based on RTMP, RTSP, HLS protocol or HTTP FLV agreements by live platform passes
Deliver to user equipment.
Can be that live equipment 10 provides sound collection unit 15, sound collection unit 15 gathers acoustic field signal, Ke Yiyou
Acoustic field signal is digitized as voice data by processor operation program, and voice data carries out preposition processing in live equipment, such as
Denoising.Voice data through preposition processing is synchronized with image, sealed after coding compression and based on RTMP or RTSP agreements
Audio/video flow is dressed up, is resent to streaming media server 20.
Can also from the timing of streaming media server 20 to live equipment 10 send transmission video flowing or audio/video flow please
Ask, live equipment 10 can respond the request and compress the video flowing of generation or audio/video flow coding and send streaming media service to
Device 20.
The stream of acquisition store simultaneously the live use to audience simultaneously by streaming media server 20 by live platform 30
Family equipment 40.
Live broadcast system 30 can also obtain video flowing or audio/video flow from the live equipment 50 of common view angle.Common view angle is straight
One or more can be arranged by broadcasting equipment 50.Any position on vehicle or competition field can be arranged in.Common view angle is live to be set
It is standby to have similar structure with the live equipment of wide viewing angle.Such as can equally include image acquisition units, processor, deposit
Reservoir, bus, wired or wireless output unit etc..The live equipment 50 of common view angle is only needed after being corrected to the image collected
It can generate video flowing, and by pushing video streaming to streaming media server.
Similar, the live equipment 50 of common view angle can also include sound collection unit, for obtaining acoustic field signal, and
Digital is into voice data.Voice data codified formed audio stream push to streaming media server or with video flowing together
It is packaged into audio/video flow and pushes to streaming media server.
The wide viewing angle video flowing or audio/video flow and common of expansion can be controlled via the director system 32 of live platform
Deploy the transmission of video flowing or audio/video flow in visual angle.
Video flowing, audio stream or the audio/video flow that the live equipment 50 of common view angle generates can be with the live equipment of wide viewing angle
The wide viewing angle video flowing or audio/video flow of the expansion of generation push to streaming media server 20 parallel.Streaming media server 20 can
With by the wide viewing angle video flowing of expansion or audio/video flow it is synchronous with common view angle video flowing or audio/video flow after be sent to it is live flat
Platform is stored, or by live platform synchronous driving give such as smart mobile phone playback equipment.
Can also be asynchronously by the wide viewing angle video flowing or audio/video flow of expansion and common view angle video flowing or audio/video flow
Send playback equipment to.
The broadcast interface of multi-angle can be provided in playback equipment, for example, broadcast interface as shown in Figure 5 can be provided,
It includes the view screen of the length-width ratio of the wide viewing angle image for meeting expansion positioned at middle part, for example, the wide viewing angle screen of expansion
1st, the wide viewing angle screen 2 of expansion and the wide viewing angle screen 3 of expansion.And have positioned at the wide viewing angle screen sides of expansion
The common view angle screen 1 of common view angle the ratio of width to height is to common view angle screen 4.The source video sequence that common view angle screen plays can be with
It is regarding for the live equipment of the foregoing common view angle being arranged on competition field or the push of the common view angle being arranged in racing car live equipment
Frequency flows.
For example, it is also possible to the wide viewing angle screen in expansion plays video flowing with one in common view angle screen or sound regards
Frequency flows, and the fragment in other screens repeat playing one time circulation of video flowing, and in user for example, by clicking on or touching
When touching operation and selecting the fragment of the loop play, pull that corresponding live equipment is stored to be regarded from the memory of live platform
Frequency stream or audio/video flow pull streaming media server from streaming media server and just just obtained from live equipment in real time
Video flowing or audio/video flow.
The broadcast interface can also judge when receiving user to the operation of screen corresponding to a certain live equipment
Whether screen is needed from the wide viewing angle screens switch of expansion to common view angle screen, or inverse operation, if it is determined that needing to cut
Change, then replace broadcast interface.
Those skilled in the art will be understood that above-mentioned each function choosing-item and its corresponding live game coverage using merely illustrative,
For illustrating the purpose of the application, and any restrictions to the application are understood not to, other are existing or future
Function choosing-item and its corresponding live application such as can be applied to the application, all should be comprised in the scope of patent protection of the application
Within.
It should be noted that the process part of the application can be in the assembly of software and/or software and hardware by reality
Apply, for example, can using application specific integrated circuit (ASIC), general purpose computer or any other realized similar to hardware device.
In one embodiment, the software program of the application can realize steps described above or function by computing device.Together
Sample, the software program (including related data structure) of the application can be stored in computer readable recording medium storing program for performing, example
Such as, RAM memory, magnetically or optically driver or floppy disc and similar devices.In addition, some steps or function of the application can adopt
Realized with hardware, for example, coordinating as with processor so as to perform the circuit of each step or function.
In addition, the part of the application can be applied to computer program product, such as computer program instructions, when it
When being computer-executed, by the operation of the computer, it can call or provide according to the present processes and/or technical side
Case.And the programmed instruction of the present processes is called, it is possibly stored in fixed or moveable recording medium, and/or
It is transmitted by the data flow in broadcast or other signal bearing medias, and/or is stored in be instructed according to described program and transports
In the working storage of capable computer equipment.Here, a device, the device are included according to one embodiment of the application
Including for storing the memory of computer program instructions and processor for execute program instructions, wherein, when the computer
When programmed instruction is by the computing device, method of the plant running based on foregoing multiple embodiments according to the application is triggered
And/or technical scheme.
Some specific examples of the application are listed below：
1. a kind of live equipment of race wide viewing angle, it includes
Wide viewing angle image unit, for obtaining wide viewing angle image；
Memory, for storing sequence of computer instructions；
Processor, the sequence of computer instructions is performed to realize：
Obtain the Intrinsic Matrix and distortion factor matrix of the image unit；
Preposition processing is carried out to the wide viewing angle image；
Expansion processing generation exhibition is carried out to the image through preposition processing based on the Intrinsic Matrix and distortion factor matrix
The wide viewing angle image opened；
The wide viewing angle video flowing of wide viewing angle image generation expansion based on the expansion；
By the wide viewing angle video stream of the expansion to streaming media server.
2. according to the live equipment of race wide viewing angle of example 1, it is characterised in that：The live equipment of wide viewing angle is by described in
It is straight to the streaming media server, or the wide viewing angle that the wide viewing angle video flowing of expansion is based on RTMP or RTSP protocol propellings
Request of the equipment based on the streaming media server is broadcast to pass the wide viewing angle video flowing of the expansion based on RTMP/RTSP/HTTP
Deliver to the streaming media server.
3. according to the live equipment of race wide viewing angle of example 1, it is characterised in that：Also include sound collection unit, for obtaining
Take the acoustic field signal of the sports live equipment of class racing car.
4. according to the live equipment of race wide viewing angle of example 3, it is characterised in that：The memory is also stored with computer
Command sequence, sequence of computer instructions described in the computing device is to realize
The acoustic field signal is digitized into voice data；
By the wide viewing angle Image Coding of the voice data and the expansion to be packaged into the wide viewing angle audio frequency and video of expansion
Stream；And
The wide viewing angle audio/video flow of the expansion is sent to the streaming media server.
5. according to the live equipment of race wide viewing angle of example 1, it is characterised in that：The race includes vehicle sports race,
The live equipment of race wide viewing angle is arranged on vehicle.
6. according to the live equipment of race wide viewing angle of example 1, it is characterised in that：The race includes vehicle sports race,
The live equipment of race wide viewing angle is arranged on race place.
A kind of 7. live game coverage system, it is characterised in that：Including
At least one live equipment of wide viewing angle, for producing video flowing and/or audio/video flow；
Streaming media server, for receiving the video flowing or audio/video flow of the live equipment transmission of the wide viewing angle；And
Direct broadcast server, for video flowing or the audio/video flow distribution for being received streaming media server by Living Network
To playback equipment；
Wherein, the live equipment of the wide viewing angle includes
Wide viewing angle image unit, for obtaining wide viewing angle image；
Memory, for storing sequence of computer instructions；
Processor, the sequence of computer instructions is performed to realize：
Obtain the Intrinsic Matrix and distortion factor matrix of the image unit；
To the preposition processing of wide viewing angle image；
Expansion processing generation exhibition is carried out to the image through preposition processing based on the Intrinsic Matrix and distortion factor matrix
The wide viewing angle image opened；
Wide viewing angle image based on the expansion forms the wide viewing angle video flowing of expansion；
By video stream to streaming media server.
8. according to the live game coverage system of example 5, it is characterised in that：The live equipment of wide viewing angle is by the expansion
Wide viewing angle video flowing is based on RTMP or RTSP protocol propellings to the streaming media server, or the live equipment of the wide viewing angle
The wide viewing angle video flowing of the expansion is sent to institute by the request based on the streaming media server based on RTMP/RTSP/HTTP
State streaming media server.
9. according to the live game coverage system of example 5, it is characterised in that：Also include sound collection unit, it is described for obtaining
The acoustic field signal for the live equipment of class racing car of racing.
10. according to the live game coverage system of example 7, it is characterised in that：The memory is also stored with computer instruction sequence
Row, sequence of computer instructions described in the computing device is to realize
The acoustic field signal is digitized into voice data；
By the wide viewing angle Image Coding of the voice data and the expansion to be packaged into the wide viewing angle audio frequency and video of expansion
Stream；And
The wide viewing angle audio/video flow of the expansion is sent to the streaming media server.
11. according to the live game coverage system of example 7, it is characterised in that：Also include that at least one common view angle is live sets
Standby, the live equipment of the common view angle produces common view angle video flowing, and by the common view angle video stream to the stream
Media server.
12. according to the live game coverage system of example 11, it is characterised in that：The stream media system will commonly regard from described
The common view angle video flowing and the width of the expansion received from the live equipment of the wide viewing angle that the live equipment in angle receives regard
Angle video flowing is passed in parallel to direct broadcast server.
A kind of 13. live game coverage method, it is characterised in that including：
By the wide viewing angle video flowing or audio/video flow of the live equipment generation expansion of at least one race wide viewing angle；
The wide viewing angle video flowing or audio/video flow of the expansion are sent to the streaming media server；
By at least one common live equipment generation common view angle video flowing or audio/video flow；
The common view angle video flowing or audio/video flow are sent to the streaming media server；
The streaming media server by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or
Audio/video flow is passed in parallel to direct broadcast server；And
The direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound
Video stream synchronization or the step of asynchronously provide to playback equipment.
A kind of 14. live game coverage method, it is characterised in that including：
By the wide viewing angle video flowing or audio/video flow of the live equipment generation expansion of at least one race wide viewing angle；
The wide viewing angle video flowing or audio/video flow of the expansion are sent to the streaming media server；
By at least one common live equipment generation common view angle video flowing or audio/video flow；
The common view angle video flowing or audio/video flow are sent to the streaming media server；
The streaming media server by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or
Audio/video flow is passed in parallel to direct broadcast server；And
The direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound
The step of video flowing is provided to playback equipment according to the selected operation of the playback equipment.
Claims (9)
- A kind of 1. live equipment of race wide viewing angle, it is characterised in that：IncludingWide viewing angle image unit, for obtaining wide viewing angle image；Memory, for storing sequence of computer instructions；Processor, the sequence of computer instructions is performed to realize：Obtain the Intrinsic Matrix and distortion factor matrix of the image unit；Preposition processing is carried out to the wide viewing angle image；Expansion processing generation expansion is carried out to the image through preposition processing based on the Intrinsic Matrix and distortion factor matrix Wide viewing angle image；The wide viewing angle video flowing of wide viewing angle image generation expansion based on the expansion；By the wide viewing angle video stream of the expansion to streaming media server.
- 2. the live equipment of race wide viewing angle according to claim 1, it is characterised in that：The live equipment of wide viewing angle is by the exhibition The wide viewing angle video flowing opened is based on RTMP or RTSP protocol propellings to the streaming media server, or the wide viewing angle is live sets The wide viewing angle video flowing of the expansion is sent to by the standby request based on the streaming media server based on RTMP/RTSP/HTTP The streaming media server.
- 3. the live equipment of race wide viewing angle according to claim 1, it is characterised in that：Also include sound collection unit, for obtaining Take the acoustic field signal of the sports live equipment of class racing car.
- 4. the live equipment of race wide viewing angle according to claim 3, it is characterised in that：The memory is also stored with computer and referred to Sequence is made, sequence of computer instructions described in the computing device is to realizeThe acoustic field signal is digitized into voice data；By the wide viewing angle Image Coding of the voice data and the expansion to be packaged into the wide viewing angle audio/video flow of expansion；AndThe wide viewing angle audio/video flow of the expansion is sent to the streaming media server.
- 5. the live equipment of race wide viewing angle according to claim 1, it is characterised in that：The race includes vehicle sports race, The live equipment of race wide viewing angle is arranged on vehicle.
- 6. the live equipment of race wide viewing angle according to claim 1, it is characterised in that：The race includes vehicle sports race, The live equipment of race wide viewing angle is arranged on race place.
- A kind of 7. live game coverage system, it is characterised in that：IncludingAt least one live equipment of wide viewing angle, for producing video flowing and/or audio/video flow；Streaming media server, for receiving the video flowing or audio/video flow of the live equipment transmission of the wide viewing angle；AndDirect broadcast server, video flowing or audio/video flow for being received streaming media server by Living Network are distributed to broadcasting Equipment；Wherein, the live equipment of the wide viewing angle includesWide viewing angle image unit, for obtaining wide viewing angle image；Memory, for storing sequence of computer instructions；Processor, the sequence of computer instructions is performed to realize：Obtain the Intrinsic Matrix and distortion factor matrix of the image unit；To the preposition processing of wide viewing angle image；Expansion processing generation expansion is carried out to the image through preposition processing based on the Intrinsic Matrix and distortion factor matrix Wide viewing angle image；Wide viewing angle image based on the expansion forms the wide viewing angle video flowing of expansion；By video stream to streaming media server.
- A kind of 8. live game coverage method, it is characterised in that including：By the wide viewing angle video flowing or audio/video flow of the live equipment generation expansion of at least one race wide viewing angle；The wide viewing angle video flowing or audio/video flow of the expansion are sent to the streaming media server；By at least one common live equipment generation common view angle video flowing or audio/video flow；The common view angle video flowing or audio/video flow are sent to the streaming media server；The streaming media server regards the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound Frequency stream is passed in parallel to direct broadcast server；AndThe direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or audio frequency and video The step of stream is either synchronously or asynchronously provided to playback equipment.
- A kind of 9. live game coverage method, it is characterised in that including：By the wide viewing angle video flowing or audio/video flow of the live equipment generation expansion of at least one race wide viewing angle；The wide viewing angle video flowing or audio/video flow of the expansion are sent to the streaming media server；By at least one common live equipment generation common view angle video flowing or audio/video flow；The common view angle video flowing or audio/video flow are sent to the streaming media server；The streaming media server regards the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or sound Frequency stream is passed in parallel to direct broadcast server；AndThe direct broadcast server is by the wide viewing angle video flowing or audio/video flow and the common view angle video flowing or audio frequency and video The step of stream is provided to playback equipment according to the selected operation of the playback equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710431777.7A CN107835434B (en) | 2017-06-09 | 2017-06-09 | Event wide-view live broadcasting equipment and associated live broadcasting system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710431777.7A CN107835434B (en) | 2017-06-09 | 2017-06-09 | Event wide-view live broadcasting equipment and associated live broadcasting system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107835434A true CN107835434A (en) | 2018-03-23 |
| CN107835434B CN107835434B (en) | 2021-09-14 |
Family
ID=61642980
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710431777.7A Active CN107835434B (en) | 2017-06-09 | 2017-06-09 | Event wide-view live broadcasting equipment and associated live broadcasting system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107835434B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008151416A1 (en) * | 2007-06-12 | 2008-12-18 | In Extenso Holdings Inc. | Distributed synchronized video viewing and editing |
| CN103369192A (en) * | 2012-03-31 | 2013-10-23 | 深圳市振华微电子有限公司 | Method and device for Full-hardware splicing of multichannel video images |
| CN104539896A (en) * | 2014-12-25 | 2015-04-22 | 桂林远望智能通信科技有限公司 | Intelligent panoramic monitoring and hotspot close-up monitoring system and method |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| CN105052154A (en) * | 2013-03-15 | 2015-11-11 | 谷歌公司 | Generating videos with multiple viewpoints |
| CN105376530A (en) * | 2015-10-27 | 2016-03-02 | 南京泓众电子科技有限公司 | Panorama video image generation device based on fixed position |
| CN105744137A (en) * | 2016-04-22 | 2016-07-06 | 王俊懿 | System for real-time correction and splicing of image formed by fish-eye lens through using hardware circuit |
| CN105765959A (en) * | 2013-08-29 | 2016-07-13 | 米迪亚普罗杜申有限公司 | A Method and System for Producing a Video Production |
| CN105872570A (en) * | 2015-12-11 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Method and apparatus for implementing multi-camera video synchronous playing |
| CN106101503A (en) * | 2016-07-18 | 2016-11-09 | 优势拓展（北京）科技有限公司 | Real time panoramic Living Network video camera and system and method |
| CN106341711A (en) * | 2016-09-27 | 2017-01-18 | 成都西可科技有限公司 | Multi-position video live broadcast playback method and system |
| CN106570938A (en) * | 2016-10-21 | 2017-04-19 | 哈尔滨工业大学深圳研究生院 | OPENGL based panoramic monitoring method and system |
-
2017
- 2017-06-09 CN CN201710431777.7A patent/CN107835434B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008151416A1 (en) * | 2007-06-12 | 2008-12-18 | In Extenso Holdings Inc. | Distributed synchronized video viewing and editing |
| CN103369192A (en) * | 2012-03-31 | 2013-10-23 | 深圳市振华微电子有限公司 | Method and device for Full-hardware splicing of multichannel video images |
| CN105052154A (en) * | 2013-03-15 | 2015-11-11 | 谷歌公司 | Generating videos with multiple viewpoints |
| CN105765959A (en) * | 2013-08-29 | 2016-07-13 | 米迪亚普罗杜申有限公司 | A Method and System for Producing a Video Production |
| CN104539896A (en) * | 2014-12-25 | 2015-04-22 | 桂林远望智能通信科技有限公司 | Intelligent panoramic monitoring and hotspot close-up monitoring system and method |
| CN104602129A (en) * | 2015-01-27 | 2015-05-06 | 三星电子（中国）研发中心 | Playing method and system of interactive multi-view video |
| CN105376530A (en) * | 2015-10-27 | 2016-03-02 | 南京泓众电子科技有限公司 | Panorama video image generation device based on fixed position |
| CN105872570A (en) * | 2015-12-11 | 2016-08-17 | 乐视网信息技术（北京）股份有限公司 | Method and apparatus for implementing multi-camera video synchronous playing |
| CN105744137A (en) * | 2016-04-22 | 2016-07-06 | 王俊懿 | System for real-time correction and splicing of image formed by fish-eye lens through using hardware circuit |
| CN106101503A (en) * | 2016-07-18 | 2016-11-09 | 优势拓展（北京）科技有限公司 | Real time panoramic Living Network video camera and system and method |
| CN106341711A (en) * | 2016-09-27 | 2017-01-18 | 成都西可科技有限公司 | Multi-position video live broadcast playback method and system |
| CN106570938A (en) * | 2016-10-21 | 2017-04-19 | 哈尔滨工业大学深圳研究生院 | OPENGL based panoramic monitoring method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107835434B (en) | 2021-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11653065B2 (en) | Content based stream splitting of video data | |
| KR102246002B1 (en) | Method, device, and computer program to improve streaming of virtual reality media content | |
| US9781356B1 (en) | Panoramic video viewer | |
| EP3804349B1 (en) | Adaptive panoramic video streaming using composite pictures | |
| WO2019202207A1 (en) | Processing video patches for three-dimensional content | |
| CN110149542B (en) | Transmission control method | |
| KR20150006771A (en) | Method and device for rendering selected portions of video in high resolution | |
| KR102214085B1 (en) | Method and apparatus for transmitting and receiving metadata for a plurality of viewpoints | |
| CN112235585B (en) | Live broadcasting method, device and system for virtual scene | |
| US20210076081A1 (en) | Video transmission method, client, and server | |
| CN112738495B (en) | Virtual viewpoint image generation method, system, electronic device and storage medium | |
| US11282169B2 (en) | Method and apparatus for processing and distributing live virtual reality content | |
| US11259050B2 (en) | Six degrees of freedom spatial layout signaling | |
| CN107835435B (en) | Event wide-view live broadcasting equipment and associated live broadcasting system and method | |
| CN113873264A (en) | Method and device for displaying image, electronic equipment and storage medium | |
| Gül et al. | Cloud rendering-based volumetric video streaming system for mixed reality services | |
| WO2009078909A1 (en) | Virtual object rendering system and method | |
| CN107835433A (en) | A kind of race wide viewing angle live broadcast system, associated equipment and live broadcasting method | |
| US20220116677A1 (en) | Method, system, and computer readable recording medium for implementing seamless switching mode between channels in multi-stream live transmission environment | |
| US20150289032A1 (en) | Main and immersive video coordination system and method | |
| CN107835434A (en) | The live equipment of race wide viewing angle and associated live broadcast system and method | |
| CN206117889U (en) | 720 degrees panorama collection system in two meshes | |
| KR101979432B1 (en) | Apparatus and method for predicting user viewpoint using lication information of sound source in 360 vr contents | |
| CN112738009A (en) | Data synchronization method, device, synchronization system, medium and server | |
| US20240104803A1 (en) | Scene graph translation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211130 Address after: Room 501, gate 9, 9 / F, zhixueyuan, No. 29, Xierqi Road West, Haidian District, Beijing 100085 Patentee after: Zhi Xiaomu Address before: Room 1513, building 3, No. 3, Xijing Road, Badachu high tech park, Shijingshan District, Beijing 100041 Patentee before: FBLIFE (BEIJING) MEDIA TECHNOLOGY CO.,LTD. |