CN105763848B - Fish eye camera rear end cut-in method and system - Google Patents
Fish eye camera rear end cut-in method and system Download PDFInfo
- Publication number
- CN105763848B CN105763848B CN201610121406.4A CN201610121406A CN105763848B CN 105763848 B CN105763848 B CN 105763848B CN 201610121406 A CN201610121406 A CN 201610121406A CN 105763848 B CN105763848 B CN 105763848B
- Authority
- CN
- China
- Prior art keywords
- media
- information
- rear end
- media data
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23602—Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4342—Demultiplexing isochronously with video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4347—Demultiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of fish eye camera rear end cut-in method and systems, this method includes after being linked into rear end equipment in the form of single channel positioned at the fish eye camera of front end, receive the medium stream request message that rear end equipment is sent, further include: the multiclass synchronized media data cached respectively is packaged after forming blended data packet according to medium stream request message and is sent to rear end equipment by fish eye camera；Fish eye camera, which is sent, restores information to rear end equipment about the media data of blended data packet；Blended data packet is reverted to all kinds of media datas before encapsulation according to media data recovery information and cached respectively by rear end equipment；Rear end equipment according to user instructions, restores corresponding media data in information selection caching using media data and is stored and shown.Method and system of the invention ensure that while saving bandwidth, user can select to play back and store in conjunction with the multiclass video of viewing according to the needs of oneself.
Description
Technical field
The present invention relates to field of video processing more particularly to a kind of fish eye camera rear end cut-in method and systems.
Background technique
Fish eye camera in global monitoring, advantage easy to maintain, in terms of control cost in monitoring trade due to applying increasingly
Extensively, wherein belong to the fish eye camera of front end correction since the comparison for the factors application such as adaptation ability is strong is more, and this kind is realized
Mode makes the characteristic of fish eye camera different but mutual and related video flowing and identical audio stream with multiple contents,
After fish eye camera is linked into rear end, need solve how to allow user see correction before, correction after, several correction rear videos
Local video (PTZ video) this multiple video information, and each video should be kept in audio synchronize.
In the prior art, fish eye camera is linked into rear end equipment by multichannel form, and each channel respectively sends media
Stream, every Media Stream all carry audio, video data.
This disadvantage in the way of the access of common multichannel (road N) video camera is: since multiple video flowings are from same
A fish eye camera, thus audio data be it is the same, audio data is sent by multiple if each channel sends Media Stream respectively
N-1 times, occupy network bandwidth；Due to not being associated between each channel, then storage is also separately to deposit, and audio data also can be more
Storage N-1 times wastes memory capacity；In addition, since each interchannel is not associated with, it is live to need user voluntarily one with when playing back
One Path Setup preview and playback simultaneously adjust interface display, also more take time and effort.
Therefore, the problem of front end fish eye camera access rear end of the prior art, is, it is ensured that each video is in rear end energy
Enough presentation and storage respectively need to expend the resources such as a large amount of bandwidth and storage.
Summary of the invention
It is of the existing technology in order to solve the problems, such as, the present invention provides a kind of fish eye camera rear end cut-in method, with
Guarantee to carry out saving the resources such as bandwidth and storage while video is flexibly presented in rear end.
A kind of fish eye camera rear end cut-in method, the fish eye camera including being located at front end are linked into the form of single channel
After rear end equipment, the medium stream request message that rear end equipment is sent is received, further includes:
The multiclass synchronized media data cached respectively is packaged by fish eye camera according to the medium stream request message
Blended data packet is formed, and using the blended data packet as media stream to rear end equipment；
Fish eye camera, which is sent, restores information to rear end equipment about the media data of blended data packet；
Rear end equipment restores information according to media data and the blended data packet received is reverted to all kinds of matchmakers before encapsulation
Volume data is simultaneously cached respectively；
Rear end equipment restores corresponding media number in information selection caching according to instruction from the user, using media data
According to being stored and shown.
One audio data and each video data are mixed and are packaged as a blended data by fish eye camera of the invention
Packet is sent, and audio data, only need to be with all types of video data (flake video data, aphorama no need to send more parts
Frequency is according to, each PTZ video data) it is synchronous send, i.e., as one media stream to rear end equipment, and voice data
It only needs to send portion, to save bandwidth, also guarantees that voice data also only needs to store one in subsequent storing process
Part, save memory space.Meanwhile other than sending blended data packet, fish eye camera also has sent media data recovery
Information, blended data packet is reverted to audio data and all kinds of video datas in rear end, this ensure that saving bandwidth
While, user can select to play back and store in conjunction with the multiclass video of viewing according to the needs of oneself.
Furthermore, the blended data packet that fish eye camera is sent includes audio data and various video data, right
Ying Di, it includes: media data type quantity, media data type information and media data encoding letter that media data, which restores information,
Breath.
Buffer area is determined when wherein media data type quantity caches media data for rear end equipment respectively
Number, media data type information include media number corresponding to all types of media datas included in blended data packet
According to type, for the type information of display and storage needed for providing when being decoded display and storage in the later period, media data is compiled
Code information may include coded format, code rate and frame per second of media data etc. for decoding and determining each buffer area distributed
Size.
The sending method that media data restores information can be it is a variety of, both can be main before rear end equipment initiates drainage request
It, can also be by customized in the transport protocol of Streaming Media with capability set information reporting when trend fish eye camera acquisition capability collection
Field portions carry out customized and send, and all carry out a media data before blended data packet is sent every time and restore information
Transmission.
Furthermore, fish eye camera upon receipt end equipment send medium stream request message after, and to
Before rear end equipment sends Media Stream, the transmission that media data restores information is carried out.
In order to avoid fish eye camera send blended data packet when being sent to rear end rear end be not yet ready for caching lead
Cause blended data coating to lose, every blended data packet for sending a period of time or it is every send several data packets before, all into
Media data of row restores the transmission of information.Wherein specific every blended data packet for sending a period of time carries out media data
The transmission or every transmission for sending several data packets and carrying out media data recovery information for restoring information, carry out as needed
It presets.
Furthermore, the fish eye camera sends blended data packet using Real-time Transport Protocol and media data restores information,
And the PAYLOAD TYPE field that the media data all kinds of media datas that restore to include in information and blended data packet are included
For different preset values.
The PAYLOAD TYPE field that all kinds of media datas for including in blended data packet are included is set as different pre-
If value, to distinguish all kinds of media datas.Before blended data packet is reverted to encapsulation by media data recovery information by rear end equipment
All kinds of media datas.
Furthermore, rear end equipment includes: according to the recovery process that media data restores information progress blended data packet
Restore the media data type quantity in information according to media data and distribute respective numbers buffer area, and according to matchmaker
Volume data restores the media data encoding information in information, determines the size of each buffer area, establishes the caching of all kinds of media datas
Area；
Restore the media data type information in information according to media data, by all kinds of media datas in blended data packet
It is decoded and is stored in corresponding buffer area.
Restore a audio data of information, the available multiclass video data in rear end and synchronization by media data,
By the instruction of user, can choose it is one such or it is a variety of stored or shown, and can according to user instructions more
Change and flexibly change, meets the needs of different.With biggish flexibility.
The present invention also provides the systems of corresponding method, to implement the method for the present invention, save bandwidth and storage to reach
The purpose of space resources.
A kind of fish eye camera rear end access system, fish eye camera and rear end equipment including being located at front end, the fish
Eye camera includes AM access module, is set for after fish eye camera is linked into rear end equipment in the form of single channel, receiving rear end
The medium stream request message that preparation is sent, the fish eye camera further include that blended data packet sending module and recovery information send mould
Block, the rear end equipment include media data recovery module and user instruction processing module,
The blended data packet sending module is according to the medium stream request message, the multiclass synchronized multimedia that will be cached respectively
Data are packaged to form blended data packet, and using the blended data packet as media stream to rear end equipment；
The recovery information sending module, which is sent, restores information to rear end equipment about the media data of blended data packet；
The media data recovery module restores information according to media data and the blended data packet received is reverted to envelope
All kinds of media datas before dress are simultaneously cached respectively；
The user instruction processing module is restored in information selection caching according to instruction from the user using media data
Corresponding media data is stored and is shown.
Furthermore, the blended data packet that blended data packet sending module is sent includes audio data and various video
Data, accordingly, it includes: media data type quantity, media data type information and media number that media data, which restores information,
According to encoded information.
Furthermore, after restoring the information sending module medium stream request message that end equipment is sent upon receipt,
And before end equipment backward sends Media Stream, the transmission that media data restores information is carried out.
Furthermore, the blended data packet and restore information sending module transmission that blended data packet sending module is sent
Media data restore information using Real-time Transport Protocol send, and media data recovery information and blended data packet in include it is each
The PAYLOAD TYPE field that class media data is included is different preset value.
Furthermore, media data recovery module restores the recovery that information carries out blended data packet according to media data
Journey includes:
Restore the media data type quantity in information according to media data and distribute respective numbers buffer area, and according to matchmaker
Volume data restores the media data encoding information in information, determines the size of each buffer area, establishes the caching of all kinds of media datas
Area；
Restore the media data type information in information according to media data, by all kinds of media datas in blended data packet
It is decoded and is stored in corresponding buffer area.
The present invention has the advantages that being used after the fish eye camera of front end receives the medium stream request that rear end equipment is sent
Audio-video mixer will be corrected video data mixing forward and backward, that several are local and be packaged, and sends in Media Stream all the way
To rear end equipment, guarantee that multichannel data is synchronous while bandwidth can be saved；Rear end equipment, which receives, carries multi-channel video single channel
After the Media Stream of audio, information is restored according to media data, multi-channel video and audio stream are split, decoded and are stored to different delay
Rush in area, notice storage and decoder module takes according to actual needs, guarantee while saving memory space rear end according to
User needs flexible collocation processing.
Detailed description of the invention
Fig. 1 is that the headend media stream mixing of various embodiments of the present invention sends the flow chart of processing；
Fig. 2 is that the rear end equipment of various embodiments of the present invention carries out Media Stream fractionation storage and decoding flow for displaying figure.
Specific embodiment
To be illustrated that the present invention in further detail, detailed explanation is subject to the present invention now in conjunction with drawings and examples.
In the first embodiment of the present invention and second embodiment, fish eye camera is all made of RTP transport protocol transmission video
Stream, and each embodiment all uses in the system of the present invention, the access of fish eye camera rear end used by the embodiment of the present invention
System includes: AM access module, blended data packet sending module, restores information sending module, media data recovery module and use
Family command process module.Wherein AM access module, blended data packet sending module and recovery information sending module are located at front end
In fish eye camera, media data recovery module and user instruction processing module are located in rear end equipment.
Wherein the method for first embodiment of the invention refers to Fig. 1 and Fig. 2, includes the following steps:
Step 1, positioned at front end fish eye camera AM access module after being linked into rear end equipment in the form of single channel, connect
Receive the medium stream request message that rear end equipment is sent.
Step 2, blended data packet sending module Media Stream according to received by AM access module in fish eye camera is asked
Seek message, the multiclass synchronized media data cached respectively be packaged to form blended data packet, and using blended data packet as
Media stream is to rear end equipment.
As shown in Figure 1, analog video acquisition module collects the video counts of YUV type in the fish eye camera of front end
According to and be stored in yuv data buffer area, the video in yuv data buffer area is divided into two-way by fish eye camera, wherein all the way for not
It is corrected direct coding and is stored in the flake video data of buffer area, in addition re-encoding respectively obtains panorama after a-road-through overcorrection
Video data and several PTZ video datas are simultaneously cached respectively.Then, blended data packet sending module is by each buffer area
The video data and audio data of middle synchronization mix, and obtain blended data packet and are sent.Specific mixed number
According to packet size depending on bandwidth and the condition of buffer area, in present example, when synchrodata and audio data respectively take 1 frame
Between the data of length mixed.
Step 3, the recovery information sending module in fish eye camera is sent restores about the media data of blended data packet
Information is to rear end equipment.
In the present example, the blended data packet and restore information sending module that blended data packet sending module is sent
The media data of transmission restores information and is all made of Real-time Transport Protocol transmission, and media data restores to wrap in information and blended data packet
The PAYLOAD TYPE field that all kinds of media datas included are included is different preset value.
The PAYLOAD TYPE field that all kinds of media datas for including in blended data packet are included is set as different pre-
If value, to distinguish all kinds of media datas.In the PAYLOAD TYPE field of RTP transport protocol, 96-127 sections are not have at present
Definition, can select among this progress it is customized, such as: 110 represent flake video, 111 represent panoramic video data,
112 represent PTZ video 1 (PTZ1), 113 represent PTZ video 2 (PTZ2), 114 represent PTZ video 3 (PTZ3), 115 represent PTZ
Video 4 (PTZ4) etc..In the present embodiment, it is 109 that media data, which restores the PAYLOAD TYPE value that information includes,.Certainly, it removes
Outside Real-time Transport Protocol, it can also can choose corresponding self-defining character section using other transport protocol such as TS agreements and be determined
Justice and differentiation.
After restoring the information sending module medium stream request message that end equipment is sent upon receipt, and set to the back-end
Before preparation send Media Stream, the transmission that media data restores information is carried out.Caching when to avoid rear end equipment from receiving media data
Area is not yet ready for, and the blended data received coating is caused to abandon, and restoring information sending module can also be at interval of transmission one
A media data recovery information is sent after determining the blended data packet of preset duration.In present example, end is set upon receipt
After the medium stream request message that preparation is sent, and before end equipment backward sends Media Stream, end equipment sends a matchmaker backward
Volume data restores information, and then every 1 second, end equipment sent a media data recovery information backward.
It includes: that media data type quantity, media data type information and media data are compiled that media data, which restores information,
Code information.Wherein, media data encoding information includes: the code rate of video data, the frame per second of video data and audio, video data
Coded format.In blended data packet, the PAYLOAD TYPE for all kinds of media datas for including is different preset value, right
Ying Di, media data restore the included media data type information of information and contain all media included in blended data packet
It include flake video and panoramic video data, then media data type information in the type information of data, such as blended data packet
In include 110,111 two type informations.
Step 4, the media data recovery module in rear end equipment restores the mixing that information will receive according to media data
Data packet recovery is that all kinds of media datas before encapsulation are cached respectively.
With reference to Fig. 2, media data recovery module will be received from same chain road comprising different PAYLOAD TYPE matchmakers
After the Media Stream of volume data splits and decapsulates, media data is sorted out, is respectively put into corresponding buffer area, and notify
Decoding display sub-module and sub-module stored in user instruction processing module take stream to show and store respectively.
Media data recovery module restores the matchmaker that information record fish eye camera is sent to rear end equipment according to media data
Volume data type, including flake, panorama, PTZ1, PTZ2, PTZ3 and PTZ4 etc..Media data recovery module is according to media
Data restore the media data type quantity in information and distribute respective numbers buffer area, and are restored in information according to media data
Media data encoding information, determine the size of each buffer area, establish the buffer area of all kinds of media datas, and according to media data
Restore the media data type information in information, all kinds of media datas in blended data packet are decoded and are stored in corresponding
In buffer area.
Step 5, the user instruction processing module in rear end equipment is restored according to instruction from the user using media data
Corresponding media data is stored and is shown in information selection caching.
Sub-module stored in user instruction processing module can allow user's selection to store which class media data,
Such as flake, panorama, PTZ video 1, PTZ video 2, PTZ video 3 and PTZ video 4, audio, can multiselect.According to user's
Storage configuration determines to store which class media data and whether stores audio (sub-module stored takes media from different buffer areas
Data, and the incidence relation of fish eye camera and corresponding media data type is recorded, it is carried out convenient for video recording of the user to storage
Playback operation).
Display interface is divided into different split screen and row according to preview mode set by user by decoding display mould root tuber
Version, respective media data are decoded and are shown on a corresponding position.
Fish eye camera can also in rear end equipment actively to fish eye camera acquisition capability collection when in capability set information
The media data type for reporting itself to support.It is illustrated with second embodiment of the invention.Second embodiment of the invention includes as follows
Step:
Step 1, positioned at front end fish eye camera AM access module after being linked into rear end equipment in the form of single channel, after
End equipment requests capability set information to fish eye camera.Recovery information sending module in fish eye camera will be about blended data
The media data of packet restores information and is sent to rear end equipment with capability set information.
Rear end equipment receives the capability set information that fish eye camera is sent, and it is extensive from capability set information to obtain media data
Complex information.The content that media data restores information includes: media data type quantity, media data type information and media data
Encoded information.Wherein, the PAYLOAD TYPE value setting of all kinds of media datas is identical with the first embodiment in the present example.
If using other transport protocol such as TS agreement, the type of each video and the media number that correspondence includes in capability set
It is customized according to the progress of corresponding custom field according to type information.
After rear end equipment obtains the capability set information for restoring information comprising media data, Media Stream is sent to fish eye camera
Request.
Step 2, the medium stream request message that rear end equipment is sent is received positioned at the AM access module of fish eye camera.
Step 3, the blended data packet sending module in fish eye camera disappears according to the received medium stream request of AM access module
Breath, the multiclass synchronized media data cached respectively is packaged to form blended data packet, and using blended data packet as media
Stream is sent to rear end equipment.Wherein, step 3 is identical as the process mixed in first embodiment with reference to the step in Fig. 1.
Step 4, the media data recovery module in rear end equipment restores the mixing that information will receive according to media data
Data packet recovery is that all kinds of media datas before encapsulation are cached respectively.
The data of media data recovery module are restored, storage and the process shown refer to Fig. 2, the step with first embodiment
This process is identical in rapid 4.
Step 5, the user instruction processing module in rear end equipment is restored according to instruction from the user using media data
Corresponding media data is stored and is shown in information selection caching.
Wherein, in the present example, the user instruction processing module of rear end equipment is in addition to corresponding in first embodiment
Processing is outer, further includes flake preview mode management submodule and flake playback submodule, wherein flake preview mode manages submodule
Block is that different video typesettings is presented in user, such as flake+4PTZ, panorama+4PTZ, self-defined template, user can be by setting
It sets flake preview mode management module and neatly selects different typesettings, to meet the observation demand of different scenes.And flake plays back
Submodule carries out retrieval and the synchronized playback of multichannel subchannel according to the storage configuration combination current preview mode of user.
The present invention has the advantages that being used after the fish eye camera of front end receives the medium stream request that rear end equipment is sent
Audio-video mixer, will correct forward and backward, several local video datas and audio data mixing is packaged, and with all the way
It is sent to rear end equipment in Media Stream, guarantees that multichannel data is synchronous while bandwidth can be saved；Rear end equipment, which receives, to be carried
After the Media Stream of multi-channel video SCVF single channel voice frequency, multi-channel video and audio stream are split according to media data recovery information, decoded simultaneously
It is stored in different buffer areas, notice storage and decoder module are taken according to actual needs, are protected while saving memory space
Card needs flexible collocation to handle in rear end according to user.
Claims (10)
1. a kind of fish eye camera rear end cut-in method, after the fish eye camera including being located at front end is linked into the form of single channel
After end equipment, the medium stream request message that rear end equipment is sent is received, which is characterized in that further include:
The multiclass synchronized media data cached respectively is packaged to be formed by fish eye camera according to the medium stream request message
Blended data packet, and using the blended data packet as media stream to rear end equipment；Wherein, the multiclass synchronized multimedia number
According to different and be mutually related video data and unique audio data including multiclass content；
Fish eye camera, which is sent, restores information to rear end equipment about the media data of blended data packet；
Rear end equipment restores information according to media data and the blended data packet received is reverted to all kinds of media numbers before encapsulation
According to and cached respectively；
Rear end equipment according to instruction from the user, using media data restore in information selection caching corresponding media data into
Row storage and display.
2. fish eye camera rear end as described in claim 1 cut-in method, which is characterized in that the mixing that fish eye camera is sent
Data include audio data and various video data, and accordingly, it includes: media data type number that media data, which restores information,
Amount, media data type information and media data encoding information.
3. fish eye camera rear end as described in claim 1 cut-in method, which is characterized in that fish eye camera is upon receipt
After the medium stream request message that end equipment is sent, and before end equipment backward sends Media Stream, media data recovery is carried out
The transmission of information.
4. fish eye camera rear end as described in claim 1 cut-in method, which is characterized in that the fish eye camera uses
Real-time Transport Protocol sends blended data packet and media data restores information, and media data restores to wrap in information and blended data packet
The PAYLOAD TYPE field that all kinds of media datas included are included is different preset value.
5. fish eye camera rear end as claimed in claim 2 cut-in method, which is characterized in that rear end equipment is according to media data
Restore information carry out blended data packet recovery process include:
Restore the media data type quantity in information according to media data and distribute respective numbers buffer area, and according to media number
According to the media data encoding information restored in information, determines the size of each buffer area, establish the buffer area of all kinds of media datas；
Restore the media data type information in information according to media data, all kinds of media datas in blended data packet are carried out
It decodes and is stored in corresponding buffer area.
6. a kind of fish eye camera rear end access system, fish eye camera and rear end equipment including being located at front end, the flake
Video camera includes AM access module, for receiving rear end equipment after fish eye camera is linked into rear end equipment in the form of single channel
The medium stream request message of transmission, which is characterized in that the fish eye camera further includes blended data packet sending module and recovery
Information sending module, the rear end equipment include media data recovery module and user instruction processing module,
The blended data packet sending module is according to the medium stream request message, the multiclass synchronized media data that will be cached respectively
It is packaged to form blended data packet, and using the blended data packet as media stream to rear end equipment；Wherein, described more
Homochronousness media data includes multiclass content difference and be mutually related video data and unique audio data；
The recovery information sending module, which is sent, restores information to rear end equipment about the media data of blended data packet；
Before the blended data packet received is reverted to encapsulation according to media data recovery information by the media data recovery module
All kinds of media datas and cached respectively；
The user instruction processing module restores corresponding in information selection caching according to instruction from the user, using media data
Media data stored and shown.
7. fish eye camera rear end as claimed in claim 6 access system, which is characterized in that blended data packet sending module hair
The blended data sent includes that audio data and various video data accordingly restore the media number that information sending module is sent
It include: media data type quantity, media data type information and media data encoding information according to information is restored.
8. fish eye camera rear end as claimed in claim 6 access system, which is characterized in that restore information sending module and connecing
After the medium stream request message for receiving rear end equipment transmission, and before end equipment backward sends Media Stream, media number is carried out
According to the transmission for restoring information.
9. fish eye camera rear end as claimed in claim 6 access system, which is characterized in that blended data packet sending module hair
The media data that the blended data packet and recovery information sending module sent is sent is restored information and is sent using Real-time Transport Protocol, and matchmaker
The PAYLOAD TYPE field that all kinds of media datas that volume data is restored to include in information and blended data packet are included is not
Same preset value.
10. fish eye camera rear end as claimed in claim 7 access system, which is characterized in that media data recovery module root
Include: according to the recovery process that media data restores information progress blended data packet
Restore the media data type quantity in information according to media data and distribute respective numbers buffer area, and according to media number
According to the media data encoding information restored in information, determines the size of each buffer area, establish the buffer area of all kinds of media datas；
Restore the media data type information in information according to media data, all kinds of media datas in blended data packet are carried out
It decodes and is stored in corresponding buffer area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610121406.4A CN105763848B (en) | 2016-03-03 | 2016-03-03 | Fish eye camera rear end cut-in method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610121406.4A CN105763848B (en) | 2016-03-03 | 2016-03-03 | Fish eye camera rear end cut-in method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105763848A CN105763848A (en) | 2016-07-13 |
| CN105763848B true CN105763848B (en) | 2019-06-11 |
Family
ID=56331653
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610121406.4A Active CN105763848B (en) | 2016-03-03 | 2016-03-03 | Fish eye camera rear end cut-in method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105763848B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106572289B (en) * | 2016-10-21 | 2019-08-20 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal of camera module |
| CN106572290B (en) * | 2016-10-21 | 2019-08-20 | 维沃移动通信有限公司 | A kind of processing method and mobile terminal of image data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370140A (en) * | 2008-09-25 | 2009-02-18 | 浙江大华技术股份有限公司 | Multi-code stream generation method |
| CN101453662A (en) * | 2007-12-03 | 2009-06-10 | 华为技术有限公司 | Stereo video communication terminal, system and method |
| WO2011001851A1 (en) * | 2009-06-29 | 2011-01-06 | ソニー株式会社 | Three-dimensional image data transmission device, three-dimensional image data transmission method, three-dimensional image data reception device, three-dimensional image data reception method, image data transmission device, and image data reception device |
| CN104349100A (en) * | 2013-07-25 | 2015-02-11 | 杭州海康威视数字技术股份有限公司 | DVR monitoring system supporting single-channel dual-stream video recording and method thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8638354B2 (en) * | 2010-10-01 | 2014-01-28 | Creative Technology Ltd | Immersive video conference system |
-
2016
- 2016-03-03 CN CN201610121406.4A patent/CN105763848B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101453662A (en) * | 2007-12-03 | 2009-06-10 | 华为技术有限公司 | Stereo video communication terminal, system and method |
| CN101370140A (en) * | 2008-09-25 | 2009-02-18 | 浙江大华技术股份有限公司 | Multi-code stream generation method |
| WO2011001851A1 (en) * | 2009-06-29 | 2011-01-06 | ソニー株式会社 | Three-dimensional image data transmission device, three-dimensional image data transmission method, three-dimensional image data reception device, three-dimensional image data reception method, image data transmission device, and image data reception device |
| CN104349100A (en) * | 2013-07-25 | 2015-02-11 | 杭州海康威视数字技术股份有限公司 | DVR monitoring system supporting single-channel dual-stream video recording and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105763848A (en) | 2016-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2652099C2 (en) | Transmission device, transmission method, reception device and reception method | |
| EP3096526B1 (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| US7613381B2 (en) | Video data processing method and video data processing apparatus | |
| EP1708506B1 (en) | Rapid media channel changing mechanism and access network node comprising same | |
| CN101292532B (en) | Apparatus and method for receiving multiple streams in a mobile broadcast system | |
| CN102752669B (en) | The transfer processing method of multichannel real time flow medium file and system, receiving system | |
| CN103856806A (en) | Video stream switching method, device and system | |
| US11284135B2 (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| KR20020001828A (en) | Method for generating and processing transition streams | |
| JP2003114845A (en) | Media conversion method and media conversion device | |
| KR102247976B1 (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| US11750882B2 (en) | Trick play and trick rate support for HLS | |
| CN105763848B (en) | Fish eye camera rear end cut-in method and system | |
| CA2934905C (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| US20140348492A1 (en) | Recording apparatus, delivery apparatus, recording method, program, and recording medium | |
| CN101179695A (en) | Method for implementing recorded broadcast of session, session television system and terminal | |
| JP2003512788A (en) | Method and apparatus for inserting digital media advertisements into statistical multiplex streams | |
| JP2004159057A (en) | System and method for distributing play-back information | |
| CA3084900A1 (en) | Method and system for selective content processing based on a panoramic camera and a virtual-reality headset | |
| JP2015526007A (en) | Apparatus and method for recording data relating to time shift function on recording medium | |
| JPH11341357A (en) | Generation method for video and audio stream and storage and recall method for marking | |
| CA3213617A1 (en) | System and method for selective video-content dissemination | |
| CN113766277A (en) | Multi-channel live stream switching device, method and system | |
| US20170230612A1 (en) | Adaptive resolution encoding for streaming data | |
| WO2021144247A1 (en) | Opt-out method for a stream in a variable bit-rate multiplex, the stream consisting of a plurality of chunks, associated broadcast site and devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |