CN105763848A - Fish-eye camera rear end access method and system - Google Patents
Fish-eye camera rear end access method and system Download PDFInfo
- Publication number
- CN105763848A CN105763848A CN201610121406.4A CN201610121406A CN105763848A CN 105763848 A CN105763848 A CN 105763848A CN 201610121406 A CN201610121406 A CN 201610121406A CN 105763848 A CN105763848 A CN 105763848A
- Authority
- CN
- China
- Prior art keywords
- media data
- information
- media
- rear end
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23602—Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4342—Demultiplexing isochronously with video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4347—Demultiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a fish-eye camera rear end access method and system, and the method comprises the steps: enabling a fish-eye camera located at a front end to be connected to rear-end equipment in a mode of single channel, and receiving a media stream request message transmitted by the rear-end equipment; enabling the fish-eye camera to package a plurality of types of cached synchronous media data according to the media stream request message, forming a mixed data package, and sending the mixed data package to the rear-end equipment; enabling the fish-eye camera to transmit media data restoration information related with the mixed data package to the rear-end equipment; enabling the rear-end equipment to revert the mixed data package into various types of media data before package according to the media data restoration information, and carrying out the caching of the media data; enabling the rear-end equipment to select the corresponding cached media data for storage and display according to a user instruction through the media data restoration information. The method and system guarantees that a user can select various types of videos to be combined for watching for playback and storage according to the needs while saving the bandwidth.
Description
Technical field
The present invention relates to field of video processing, particularly relate to a kind of flake video camera rear end cut-in method and system.
Background technology
Flake video camera is due at global monitoring, easy care, the advantage controlling into present aspect is more and more extensive in monitoring trade application, and it is many wherein to belong to the comparison applied due to factors such as adaptation ability are strong of flake video camera corrected front end, and this kind of implementation flake video camera is had multiple content is different but characteristic of related video flowing and identical audio stream mutually, after flake video camera is linked into rear end, before needing solution how to allow user see rectification, after rectification, local video (PTZ video) these multiple video informations of several correction rear videos, and each video should keep synchronizing on audio frequency.
In prior art, flake video camera is linked into rear end equipment by multichannel form, and each passage each sends Media Stream, and every Media Stream all carries audio, video data.
This mode accessed by common multichannel (N road) video camera has drawbacks in that owing to multiple video flowings are from same flake video camera, therefore voice data is the same, if each passage sends Media Stream respectively, voice data be have sent N-1 time more, takies the network bandwidth；Due to not association between each passage, then storing also is separately deposit, and voice data also can be stored N-1 time more, wastes memory capacity；Further, since each interchannel does not associate, need user's Path Setup preview and playback adjust interface display one by one voluntarily during live and playback, also comparatively take time and effort.
Therefore, the flake video camera access rear end, front end of prior art has a problem in that, it is ensured that each video can present respectively in rear end and storage needs to expend the resources such as substantial amounts of bandwidth and storage.
Summary of the invention
In order to solve prior art Problems existing, the invention provides a kind of flake video camera rear end cut-in method, to ensure to carry out the saving resource such as bandwidth and storage while video presents flexibly in rear end.
A kind of flake video camera rear end cut-in method, after being linked into rear end equipment including the flake video camera being positioned at front end with single channel form, receives the medium stream request message that rear end equipment sends, also includes:
The multiclass synchronized media data of buffer memory respectively, according to described medium stream request message, is packaged being formed blended data bag by flake video camera, and using described blended data bag as media stream to rear end equipment；
Flake video camera sends the media data about blended data bag and recovers information to rear end equipment；
Rear end equipment is recovered all kinds of media datas before the blended data bag received is reverted to encapsulation by information according to media data and carries out buffer memory respectively；
Rear end equipment, according to the instruction from user, utilizes media data to recover information and selects corresponding media data in buffer memory to carry out storing and showing.
One voice data and the mixing of each video data are packaged as a blended data bag and are transmitted by the flake video camera of the present invention, voice data need not send many parts, only need and all types of video data (flake video data, panoramic video data, each PTZ video data) synchronized transmissions, namely as one media stream to rear end equipment, and speech data has only to send portion, thus having saved bandwidth, also ensure that speech data also has only to storage portion in follow-up storing process, has saved memory space.Simultaneously, except sending blended data bag, flake video camera also have sent media data and recovers information, in order to blended data bag to be reverted in rear end voice data and all kinds of video data, this ensure that while saving bandwidth, user can carry out playing back and storing in conjunction with the multiclass video of viewing according to the selection that needs of oneself.
Furthermore, the blended data bag that flake video camera sends includes voice data and various video data, and accordingly, media data recovers information and includes: media data type quantity, media data type information and media data encoding information.
Wherein media data type quantity determines the number of buffer area when media data carrying out buffer memory respectively for rear end equipment, media data type information includes the media data type corresponding to all types of media datas comprised in blended data bag, thering is provided the type information of required display and storage during for being decoded display and storage in the later stage, media data encoding information can include the size for decoding and determine each buffer area distributed such as the coded format of media data, code check and frame per second.
It can be multiple that media data recovers the transmission mode of information, both can rear end equipment initiate drain request before active to flake video camera acquisition capability collection time with capability set information reporting, can also be undertaken self-defined by field portions self-defining in the host-host protocol of Streaming Media and send, and blended data bag all carries out the transmission that media data recovers information one time before sending every time.
Furthermore, after the medium stream request message that equipment sends held upon receipt by flake video camera, and before equipment to the back-end sends Media Stream, carry out media data and recover the transmission of information.
The blended data sent in order to avoid flake video camera wraps in rear end when being sent to rear end and is not yet ready for buffer memory and causes that blended data is coated and lose, before often sending the blended data bag of a period of time or often sending some packets, all carry out the transmission that media data recovers information one time.The blended data Bao Jun wherein specifically often sending a period of time carries out the transmission of media data recovery information, still often sends some packets and all carries out the transmission of media data recovery information, presets as required.
Furthermore, described flake video camera adopts Real-time Transport Protocol to send blended data bag and media data to recover information, and the PAYLOADTYPE field that comprises of all kinds of media datas that media data recovers information and blended data bag includes is different preset value.
The PAYLOADTYPE field that all kinds of media datas that blended data bag includes comprise is set to different preset values, to distinguish all kinds of media data.Rear end equipment recovers all kinds of media datas before blended data bag is reverted to encapsulation by information by media data.
Furthermore, the recovery process that rear end equipment carries out blended data bag according to media data recovery information includes:
Respective numbers buffer area is distributed according to the media data type quantity in media data recovery information, and according to the media data encoding information in media data recovery information, it is determined that the size of each buffer area, set up the buffer area of all kinds of media data；
According to the media data type information in media data recovery information, all kinds of media datas in blended data bag are decoded and are stored in the buffer area of correspondence.
Information is recovered by media data, rear end can obtain a voice data of multiclass video data and synchronization, by the instruction of user, it is possible to selects therein one or more to carry out storing or showing, and can change flexibly according to the change of user instruction, meet different demands.There is bigger motility.
Present invention also offers the system of corresponding method, in order to implement the inventive method, to reach to save the purpose of bandwidth and memory space resource.
System is accessed in a kind of flake video camera rear end, including the flake video camera and the rear end equipment that are positioned at front end, described flake video camera includes AM access module, for after flake video camera is linked into rear end equipment with single channel form, receive the medium stream request message that rear end equipment sends, described flake video camera also includes blended data bag sending module and recovers information sending module, and described rear end equipment includes media data and recovers module and user instruction processing module
The multiclass synchronized media data of buffer memory respectively, according to described medium stream request message, is packaged being formed blended data bag by described blended data bag sending module, and using described blended data bag as media stream to rear end equipment；
Described recovery information sending module sends the media data about blended data bag and recovers information to rear end equipment；
Described media data recovers module and recovers all kinds of media datas before the blended data bag received is reverted to encapsulation by information according to media data and carry out buffer memory respectively；
Described user instruction processing module, according to the instruction from user, utilizes media data to recover information and selects corresponding media data in buffer memory to carry out storing and showing.
Furthermore, the blended data bag that blended data bag sending module sends includes voice data and various video data, and accordingly, media data recovers information and includes: media data type quantity, media data type information and media data encoding information.
Furthermore, after recovery information sending module holds the medium stream request message that equipment sends upon receipt, and before equipment to the back-end sends Media Stream, carry out media data and recover the transmission of information.
Furthermore, blended data bag that blended data bag sending module sends and recover the media data that information sending module sends and recover information and adopt Real-time Transport Protocol to send, and media data to recover the PAYLOADTYPE field that all kinds of media datas that information and blended data bag include comprise be different preset value.
Furthermore, the recovery process that media data recovery module carries out blended data bag according to media data recovery information includes:
Respective numbers buffer area is distributed according to the media data type quantity in media data recovery information, and according to the media data encoding information in media data recovery information, it is determined that the size of each buffer area, set up the buffer area of all kinds of media data；
According to the media data type information in media data recovery information, all kinds of media datas in blended data bag are decoded and are stored in the buffer area of correspondence.
It is an advantage of the current invention that: after the flake video camera of front end receives the medium stream request that rear end equipment is sent, adopt audio frequency and video blender, video data mixing packing forward and backward, several local will be corrected, and it is sent to rear end equipment in the Media Stream of same road, it is possible to ensure that multichannel data synchronizes while saving bandwidth；After rear end equipment receives the Media Stream carrying multi-channel video SCVF single channel voice frequency, recover information according to media data multi-channel video and audio stream to be split, decode and be stored in different relief areas, notice storage and decoder module are taken according to actual needs, ensure to need flexible collocation to process in rear end according to user while saving memory space.
Accompanying drawing explanation
Fig. 1 is the flow chart of the headend media stream mixing transmission process of various embodiments of the present invention；
The rear end equipment that Fig. 2 is various embodiments of the present invention carries out Media Stream fractionation storage and decoding flow for displaying figure.
Detailed description of the invention
For making the present invention understand in further detail, in conjunction with the explanation that drawings and Examples are in addition detailed to the present invention.
In the first embodiment of the present invention and the second embodiment, flake video camera all adopts RTP host-host protocol transmitting video-frequency flow, and each embodiment all uses in the system of the present invention, the flake video camera rear end that embodiments of the invention adopt is accessed system and is included: AM access module, blended data bag sending module, recover information sending module, media data recovers module and user instruction processing module.Wherein AM access module, blended data bag sending module and recovery information sending module are arranged in the flake video camera of front end, and media data recovers module and user instruction processing module is arranged in rear end equipment.
Wherein the method for first embodiment of the invention is with reference to Fig. 1 and Fig. 2, comprises the steps:
Step 1, is positioned at the AM access module of flake video camera of front end after being linked into rear end equipment with single channel form, receives the medium stream request message that rear end equipment sends.
Step 2, the blended data bag sending module in flake video camera medium stream request message received by AM access module, the multiclass synchronized media data of buffer memory respectively is packaged being formed blended data bag, and using blended data bag as media stream to rear end equipment.
As shown in Figure 1, in the flake video camera of front end, analog video acquisition module collects the video data of YUV type and is stored in yuv data buffer area, video in yuv data buffer area is divided into two-way by flake video camera, wherein a road is that re-encoding after correcting of additionally leading up to respectively obtains panoramic video data and several PTZ video datas and carries out buffer memory respectively without correcting direct coding and being stored in the flake video data of buffer area.Then, the video data synchronized in each buffer area and voice data are mixed by blended data bag sending module, obtain blended data bag and are transmitted.Concrete blended data bag size is determined according to the condition of bandwidth and buffer area, and in present example, synchrodata and voice data respectively take the data of 1 frame time length and mix.
Step 3, recovery information sending module in flake video camera sends the media data about blended data bag and recovers information to rear end equipment.
In the present example, blended data bag that blended data bag sending module sends and recover the media data that information sending module sends and recover information and all adopt Real-time Transport Protocol to send, and the PAYLOADTYPE field that comprises of media data recovery information and all kinds of media datas that include of blended data bag is different preset values.
The PAYLOADTYPE field that all kinds of media datas that blended data bag includes comprise is set to different preset values, to distinguish all kinds of media data.In the PAYLOADTYPE field of RTP host-host protocol, current 96-127 section is undefined, can select in the middle of this to carry out self-defined, for instance: 110 represent flake video, 111 represent panoramic video data, 112 represent PTZ video 1 (PTZ1), 113 represent PTZ video 2 (PTZ2), 114 represent PTZ video 3 (PTZ3), 115 represent PTZ video 4 (PTZ4) etc..In the present embodiment, the PAYLOADTYPE value that media data recovery information comprises is 109.Certainly, except Real-time Transport Protocol, it would however also be possible to employ other host-host protocol such as TS agreement, it is possible to select corresponding self-defining character section be defined and distinguish.
After recovery information sending module holds the medium stream request message that equipment sends upon receipt, and before equipment to the back-end sends Media Stream, carry out media data and recover the transmission of information.During for avoiding rear end equipment to receive media data, buffer area is not yet ready for, and causes that the blended data received is coated and abandons, and recovers information sending module and can also recover information at interval of sending after the blended data bag of transmission certain predetermined duration a media data.In present example, after the medium stream request message that end equipment sends upon receipt, and before equipment to the back-end sends Media Stream, equipment sends a media data recovery information to the back-end, then every 1 second, equipment sent a media data recovery information to the back-end.
Media data recovers information and includes: media data type quantity, media data type information and media data encoding information.Wherein, media data encoding information includes: the coded format of the code check of video data, the frame per second of video data and audio, video data.In blended data bag, the PAYLOADTYPE of all kinds of media datas comprised is different preset values, accordingly, media data recovers information comprised media data type information and contains the type information of all media datas comprised in blended data bag, such as blended data bag comprises flake video and panoramic video data, then media data type information comprises 110,111 two type informations.
Step 4, the media data in rear end equipment recovers all kinds of media datas before the blended data bag received is reverted to encapsulation according to media data recovery information by module and carries out buffer memory respectively.
With reference to Fig. 2, after the Media Stream comprising different PAYLOADTYPE media data received from same link is split and decapsulates by media data recovery module, media data is sorted out, it is respectively put in the buffer area of correspondence, and notifies that the decoding display sub-module in user instruction processing module and sub module stored take stream display and storage respectively.
Media data recovers module and is sent to the media data type of rear end equipment according to media data recovery information record flake video camera, including flake, panorama, PTZ1, PTZ2, PTZ3 and PTZ4 etc..Media data recovers module and distributes respective numbers buffer area according to the media data type quantity in media data recovery information, and according to the media data encoding information in media data recovery information, determine the size of each buffer area, set up the buffer area of all kinds of media data, and according to the media data type information in media data recovery information, all kinds of media datas in blended data bag are decoded and are stored in the buffer area of correspondence.
Step 5, the user instruction processing module in rear end equipment, according to the instruction from user, utilizes media data to recover information and selects corresponding media data in buffer memory to carry out storing and showing.
Sub module stored in user instruction processing module can allow user select which class media data is stored, such as flake, panorama, PTZ video 1, PTZ video 2, PTZ video 3 and PTZ video 4, audio frequency etc., and can multiselect.Storage according to user configures, which determine store class media data and whether store audio frequency (sub module stored takes media data from different buffer areas, and record the incidence relation of the media data type of flake video camera and correspondence, it is simple to the video recording of storage is carried out playback operation by user).
Display interface, according to the preview mode set by user, is divided into different split screens and typesetting, respective media data is decoded and show on a corresponding position by decoding display mould tuber.
The media data type that flake video camera can also be supported with capability set information reporting self when rear end equipment is actively to flake video camera acquisition capability collection.Illustrate with second embodiment of the invention.Second embodiment of the invention comprises the steps:
Step 1, is positioned at the AM access module of flake video camera of front end after being linked into rear end equipment with single channel form, and rear end equipment asks capability set information to flake video camera.Media data about blended data bag is recovered information and sends to rear end equipment with capability set information by the recovery information sending module in flake video camera.
Rear end equipment receives the capability set information that flake video camera sends, and obtains media data recovery information from capability set information.Media data recovers the content of information and includes: media data type quantity, media data type information and media data encoding information.Wherein, the PAYLOADTYPE value of all kinds of media datas sets identical with first embodiment in the present example.If adopting other host-host protocol such as TS agreement, then each video type and in capability set the corresponding media data type information comprised carry out self-defined according to corresponding custom field.
Rear end equipment obtains after comprising the capability set information that media data recovers information, sends medium stream request to flake video camera.
Step 2, the AM access module being positioned at flake video camera receives the medium stream request message that rear end equipment sends.
Step 3, the medium stream request message that blended data bag sending module in flake video camera receives according to AM access module, the multiclass synchronized media data of buffer memory respectively is packaged being formed blended data bag, and using blended data bag as media stream to rear end equipment.Wherein, step 3 is with reference to the step in Fig. 1, identical with the process of mixing in first embodiment.
Step 4, the media data in rear end equipment recovers all kinds of media datas before the blended data bag received is reverted to encapsulation according to media data recovery information by module and carries out buffer memory respectively.
Media data recovers process reference Fig. 2 that the data of module are recovered, store and shown, identical with this process in the step 4 of first embodiment.
Step 5, the user instruction processing module in rear end equipment, according to the instruction from user, utilizes media data to recover information and selects corresponding media data in buffer memory to carry out storing and showing.
Wherein, in the present example, the user instruction processing module of rear end equipment is except the respective handling in first embodiment, also include flake preview mode management submodule and flake playback submodule, wherein flake preview mode management submodule is that user presents different video typesettings, such as flake+4PTZ, panorama+4PTZ, self-defined template etc., user can pass through to arrange flake preview mode management module and select different typesetting neatly, with the observation demand of satisfied different scenes.And flake playback submodule configures in conjunction with current preview pattern according to the storage of user, carry out retrieval and the synchronized playback of multichannel subchannel.
It is an advantage of the current invention that: after the flake video camera of front end receives the medium stream request that rear end equipment is sent, adopt audio frequency and video blender, by correct forward and backward, several local video data and voice data mixing packing, and it is sent to rear end equipment in the Media Stream of same road, it is possible to ensure that multichannel data synchronizes while saving bandwidth；After rear end equipment receives the Media Stream carrying multi-channel video SCVF single channel voice frequency, recover information according to media data multi-channel video and audio stream to be split, decode and be stored in different relief areas, notice storage and decoder module are taken according to actual needs, ensure to need flexible collocation to process in rear end according to user while saving memory space.
Claims (10)
1. a flake video camera rear end cut-in method, after being linked into rear end equipment including the flake video camera being positioned at front end with single channel form, receives the medium stream request message that rear end equipment sends, it is characterised in that also include:
The multiclass synchronized media data of buffer memory respectively, according to described medium stream request message, is packaged being formed blended data bag by flake video camera, and using described blended data bag as media stream to rear end equipment；
Flake video camera sends the media data about blended data bag and recovers information to rear end equipment；
Rear end equipment is recovered all kinds of media datas before the blended data bag received is reverted to encapsulation by information according to media data and carries out buffer memory respectively；
Rear end equipment, according to the instruction from user, utilizes media data to recover information and selects corresponding media data in buffer memory to carry out storing and showing.
2. flake video camera rear end as claimed in claim 1 cut-in method, it is characterized in that, the blended data that flake video camera sends includes voice data and various video data, accordingly, media data recovery information includes: media data type quantity, media data type information and media data encoding information.
3. flake video camera rear end as claimed in claim 1 cut-in method, it is characterised in that after the medium stream request message that equipment sends held upon receipt by flake video camera, and before equipment to the back-end sends Media Stream, carry out media data and recover the transmission of information.
4. flake video camera rear end as claimed in claim 1 cut-in method, it is characterized in that, described flake video camera adopts Real-time Transport Protocol to send blended data bag and media data to recover information, and the PAYLOADTYPE field that comprises of all kinds of media datas that media data recovers information and blended data bag includes is different preset value.
5. flake video camera rear end as claimed in claim 2 cut-in method, it is characterised in that the recovery process that rear end equipment carries out blended data bag according to media data recovery information includes:
Respective numbers buffer area is distributed according to the media data type quantity in media data recovery information, and according to the media data encoding information in media data recovery information, it is determined that the size of each buffer area, set up the buffer area of all kinds of media data；
According to the media data type information in media data recovery information, all kinds of media datas in blended data bag are decoded and are stored in the buffer area of correspondence.
6. system is accessed in a flake video camera rear end, including the flake video camera and the rear end equipment that are positioned at front end, described flake video camera includes AM access module, for after flake video camera is linked into rear end equipment with single channel form, receive the medium stream request message that rear end equipment sends, it is characterised in that described flake video camera also includes blended data bag sending module and recovers information sending module, described rear end equipment includes media data and recovers module and user instruction processing module
The multiclass synchronized media data of buffer memory respectively, according to described medium stream request message, is packaged being formed blended data bag by described blended data bag sending module, and using described blended data bag as media stream to rear end equipment；
Described recovery information sending module sends the media data about blended data bag and recovers information to rear end equipment；
Described media data recovers module and recovers all kinds of media datas before the blended data bag received is reverted to encapsulation by information according to media data and carry out buffer memory respectively；
Described user instruction processing module, according to the instruction from user, utilizes media data to recover information and selects corresponding media data in buffer memory to carry out storing and showing.
7. system is accessed in flake video camera rear end as claimed in claim 6, it is characterized in that, the blended data that blended data bag sending module sends includes voice data and various video data, accordingly, the media data recovery information recovering information sending module transmission includes: media data type quantity, media data type information and media data encoding information.
8. system is accessed in flake video camera rear end as claimed in claim 6, it is characterized in that, after recovery information sending module holds the medium stream request message that equipment sends upon receipt, and before equipment to the back-end sends Media Stream, carry out media data and recover the transmission of information.
9. system is accessed in flake video camera rear end as claimed in claim 6, it is characterized in that, blended data bag that blended data bag sending module sends and recover the media data that information sending module sends and recover information and adopt Real-time Transport Protocol to send, and media data to recover the PAYLOADTYPE field that all kinds of media datas that information and blended data bag include comprise be different preset value.
10. system is accessed in flake video camera rear end as claimed in claim 7, it is characterised in that the recovery process that media data recovery module carries out blended data bag according to media data recovery information includes:
Respective numbers buffer area is distributed according to the media data type quantity in media data recovery information, and according to the media data encoding information in media data recovery information, it is determined that the size of each buffer area, set up the buffer area of all kinds of media data；
According to the media data type information in media data recovery information, all kinds of media datas in blended data bag are decoded and are stored in the buffer area of correspondence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610121406.4A CN105763848B (en) | 2016-03-03 | 2016-03-03 | Fish eye camera rear end cut-in method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610121406.4A CN105763848B (en) | 2016-03-03 | 2016-03-03 | Fish eye camera rear end cut-in method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105763848A true CN105763848A (en) | 2016-07-13 |
| CN105763848B CN105763848B (en) | 2019-06-11 |
Family
ID=56331653
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610121406.4A Active CN105763848B (en) | 2016-03-03 | 2016-03-03 | Fish eye camera rear end cut-in method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105763848B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106572290A (en) * | 2016-10-21 | 2017-04-19 | 维沃移动通信有限公司 | Image data processing method and mobile terminal |
| CN106572289A (en) * | 2016-10-21 | 2017-04-19 | 维沃移动通信有限公司 | Image processing module of camera module, and mobile terminal |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370140A (en) * | 2008-09-25 | 2009-02-18 | 浙江大华技术股份有限公司 | Multi-code stream generation method |
| CN101453662A (en) * | 2007-12-03 | 2009-06-10 | 华为技术有限公司 | Stereo video communication terminal, system and method |
| WO2011001851A1 (en) * | 2009-06-29 | 2011-01-06 | ソニー株式会社 | Three-dimensional image data transmission device, three-dimensional image data transmission method, three-dimensional image data reception device, three-dimensional image data reception method, image data transmission device, and image data reception device |
| US20120081503A1 (en) * | 2010-10-01 | 2012-04-05 | Creative Technology Ltd | Immersive video conference system |
| CN104349100A (en) * | 2013-07-25 | 2015-02-11 | 杭州海康威视数字技术股份有限公司 | DVR monitoring system supporting single-channel dual-stream video recording and method thereof |
-
2016
- 2016-03-03 CN CN201610121406.4A patent/CN105763848B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101453662A (en) * | 2007-12-03 | 2009-06-10 | 华为技术有限公司 | Stereo video communication terminal, system and method |
| CN101370140A (en) * | 2008-09-25 | 2009-02-18 | 浙江大华技术股份有限公司 | Multi-code stream generation method |
| WO2011001851A1 (en) * | 2009-06-29 | 2011-01-06 | ソニー株式会社 | Three-dimensional image data transmission device, three-dimensional image data transmission method, three-dimensional image data reception device, three-dimensional image data reception method, image data transmission device, and image data reception device |
| US20120081503A1 (en) * | 2010-10-01 | 2012-04-05 | Creative Technology Ltd | Immersive video conference system |
| CN104349100A (en) * | 2013-07-25 | 2015-02-11 | 杭州海康威视数字技术股份有限公司 | DVR monitoring system supporting single-channel dual-stream video recording and method thereof |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106572290A (en) * | 2016-10-21 | 2017-04-19 | 维沃移动通信有限公司 | Image data processing method and mobile terminal |
| CN106572289A (en) * | 2016-10-21 | 2017-04-19 | 维沃移动通信有限公司 | Image processing module of camera module, and mobile terminal |
| CN106572290B (en) * | 2016-10-21 | 2019-08-20 | 维沃移动通信有限公司 | A kind of processing method and mobile terminal of image data |
| CN106572289B (en) * | 2016-10-21 | 2019-08-20 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal of camera module |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105763848B (en) | 2019-06-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11178436B2 (en) | Broadcast signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method | |
| CN101917389B (en) | Network television direct broadcasting system | |
| CN101710965A (en) | Full network storage and scheduling method and system for network television | |
| CN104737514A (en) | A method and apparatus for distributing a media content service | |
| US20210409796A1 (en) | Systems and methods for localized adaptive content distribution | |
| KR20050049428A (en) | Broadcast recording system, recording apparatus, broadcasting apparatus, and recording program for saving storage space of recording medium used for recording contents | |
| CN111629283B (en) | Multi-stream media gateway service system and method | |
| CN104038844A (en) | Mobile live broadcast system based on MPEG-2 standard | |
| US10349095B2 (en) | Transmission device for processing video data related to HDR/SDR and method for controlling the same | |
| US20050094562A1 (en) | Methods and devices for reducing total bandwidth when streaming multiple media streams | |
| US10666549B2 (en) | Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method and broadcast signal reception method | |
| US10412422B2 (en) | Apparatus for transmitting broadcasting signal, apparatus for receiving broadcasting signal, method for transmitting broadcasting signal, and method for receiving broadcasting signal | |
| CN101505298B (en) | Storing and obtaining method for media time shift code stream and multimedia service system | |
| US10362342B2 (en) | Broadcast signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method | |
| CN105430510A (en) | Video on demand method, gateway, smart terminal and video on demand system | |
| US20110088069A1 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| CN105763848A (en) | Fish-eye camera rear end access method and system | |
| US10298975B2 (en) | Communication apparatus, communication data generation method, and communication data processing method | |
| US8184660B2 (en) | Transparent methods for altering the video decoder frame-rate in a fixed-frame-rate audio-video multiplex structure | |
| JPWO2006027857A1 (en) | Zapping stream generation apparatus and method | |
| KR20020022147A (en) | A Digital Television for Playing Multimedia Audio and Method for Playing Multimedia Audio using Digital Television |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |