CN107124575A - A kind of media processing method, device and media server - Google Patents
A kind of media processing method, device and media server Download PDFInfo
- Publication number
- CN107124575A CN107124575A CN201710243848.0A CN201710243848A CN107124575A CN 107124575 A CN107124575 A CN 107124575A CN 201710243848 A CN201710243848 A CN 201710243848A CN 107124575 A CN107124575 A CN 107124575A
- Authority
- CN
- China
- Prior art keywords
- media
- chip
- main control
- handling
- chosen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The invention discloses a kind of media processing method, device and media server, wherein methods described includes：Main control chip is obtained after media handling instruction, and one or more media chips for performing media handling instruction are chosen from default media resource pond；Media handling flow is set up between the media chip chosen further according to media handling instruction；Main control chip sends it to the media chip chosen after obtaining pending media data, and pending media data is handled successively according to media handling flow by the media chip chosen.By the present invention, a variety of media chips (i.e. heterogeneous chip) with different media handling functions can cluster be arranged in media server so that media server can support a variety of different media handling demands；When the amount of pending media data is larger, media server can flexibly select multiple media chip parallel processing media datas with same media handling function as needed, so as to improve the speed of media handling.
Description
Technical field
The present invention relates to media processing techniques field, and in particular to a kind of media processing method, device and media server.
Background technology
In medium processing system (such as audio/video communication system, video monitoring system), first terminal (i.e. adopt by media data
Collect terminal, the mobile client such as smart mobile phone, tablet personal computer, special audio/video conference system terminal, camera and wheat
Gram wind etc.) need the audio, video data collected being compressed coding, and sent by network to media server, the matchmaker
Body server is performed to the audio-video code stream received to be retransmited after media handling function to second terminal (media data presentation end
End, the mobile client such as smart mobile phone, tablet personal computer, special audio/video conference system terminal, display and loudspeaker
Deng), the media handling function includes coding, decoding, code stream conversion, object identification, image mosaic, audio mixing etc., so that second is whole
End can receive the audio-video code stream suitable for its broadcasting, and show desired visual/audio effects.
Existing media server generally performs above-mentioned media handling function using universal media chip.The universal media chip
Any one in above-mentioned media handling function can be performed, when pending processing media data, by this universal media
Chip is handled.
However as existing audio-visual system, the popularization and application of video monitoring system, increasing audio-visual system, regard
Frequency monitoring system produces increasing pending media data；On the other hand, the processing due to client to audio, video data
Ability varies, and thus the media handling demand such as code stream conversion is more diversified；In addition, the meeting of existing audio/video conference system
Field scale is increasing, the requirement more and more higher to media handlings such as image mosaic, audio mixings.Existing mode uses universal media core
The method that piece carries out media handling, the disposal ability of general processor has been difficult to be competent at above-mentioned media handling demand.
The content of the invention
In view of this, the embodiments of the invention provide a kind of media processing method, device and media server, to solve to lead to
The problem of more diversified and amount is increasing media data can not being met with media chip.
According in a first aspect, the embodiments of the invention provide a kind of media processing method, for media server, the matchmaker
Body server includes a main control chip and multiple media chips；Methods described includes：The main control chip obtains media handling
Instruction, the media handling is instructed for indicating that the media server is handled pending media data；The master control
Chip chooses one or more media chips for performing the media handling instruction from default media resource pond；The matchmaker
Body resource pool is the set of media chip in the media server, wherein at least one media data of each media chip correspondence
The function of processing；The main control chip instructs according to the media handling and sets up media handling between the media chip chosen
Flow；The media handling flow is the sequential combination between the main control chip and the media chip chosen；The master control core
Piece obtains pending media data；The main control chip sends the pending media data to the media chip chosen,
The pending media data is handled successively according to the media handling flow by the media chip chosen.
Alternatively, the main control chip instructs according to the media handling and sets up media between the media chip chosen
The step of handling process, including：The main control chip determines that the media chip chosen is used to perform the media handling instruction
Order；The main control chip is set up with first media chip in the order and communicated to connect；The main control chip is to
Each media chip chosen sends the mark of next media chip of each media chip in the order；Each media
Communication connection is set up between chip and its next media chip.
Alternatively, the pending matchmaker is handled successively according to the media handling flow by the media chip chosen
The step of volume data, including：Current media chip receives the pending media data；The current media chip is according to itself
Pending media data described in media handling function treatment；The current media chip be processed to after media data send to
Next media chip in media handling flow.
Alternatively, the media chip includes the second media chip being detachably connected with the main control chip；The side
Method also includes：When the second media chip is connected to the main control chip, second media chip is sent out to the main control chip
Send log-on message；The log-on message includes the media handling function of second media chip；The main control chip receives institute
The log-on message of the second media chip is stated, and the media handling function of second media chip is stored to the media resource
Pond.
Alternatively, the media chip includes the 3rd media chip being detachably connected with the main control chip；The side
Method also includes：When the 3rd media chip has sent notice or the 3rd media that it will be removed to the main control chip
When chip operation is broken down, the main control chip deletes the 3rd media chip from the media resource pond；Main control chip from
Fourth media chip is chosen in the media resource pond；The processing type of the fourth media chip and the 3rd media chip
Media handling function phase it is same；The fourth media chip and a upper core of the 3rd media chip in media handling flow
Piece and next chip set up communication connection respectively.
According to second aspect, the embodiments of the invention provide a kind of media processor, for media server, the matchmaker
Body server includes a main control chip and multiple media chips；Described device includes：First acquisition unit, for obtaining media
Process instruction, the media handling is instructed for indicating that the media server is handled pending media data；First
Unit is chosen, for choosing one or more media cores for performing the media handling instruction from default media resource pond
Piece；The media resource pond is the set of media chip in the media server, wherein each media chip correspondence at least one
Plant the function of media data processing；First sets up unit, for being instructed according to the media handling in the media chip chosen
Between set up media handling flow；The media handling flow is the order between the main control chip and the media chip chosen
Combination；Second acquisition unit, for obtaining pending media data；First transmitting element, for by the pending media number
According to sending to the media chip chosen, described treat is handled successively according to the media handling flow by the media chip chosen
Handle media data.
Alternatively, described first set up unit and include：Determination subelement, the media chip for determining to have chosen is used to hold
The order of the row media handling instruction；First sets up subelement, for being set up with first media chip in the order
Communication connection；Transmission sub-unit, for sending each media chip in the order to each media chip chosen
Next media chip；Second sets up subelement, is communicated for being set up between each media chip and its next media chip
Connection.
Alternatively, described device also includes：First receiving unit, for receiving the pending media data；Processing is single
Member, for the pending media data according to itself media handling function treatment；Second transmitting element, for by after processing
Media data sends next media chip into media handling flow.
Alternatively, the media chip includes the second media chip being detachably connected with the main control chip；The dress
Putting also includes：3rd transmitting element, for when the second media chip is connected to the main control chip, being sent out to the main control chip
Send log-on message；The log-on message includes the media handling function of second media chip；Second receiving unit, for connecing
Receive the log-on message of second media chip, memory cell, for the media handling function of second media chip to be deposited
Store up to the media resource pond.
Alternatively, the media chip includes the 3rd media chip being detachably connected with the main control chip；The dress
Putting also includes：Delete unit, for when the 3rd media chip to the main control chip send notice that it will be removed or
When the operation of the 3rd media chip is broken down described in person, the 3rd media chip is deleted from the media resource pond；Second chooses
Unit, for choosing fourth media chip from the media resource pond；The processing type of the fourth media chip with it is described
The media handling function phase of 3rd media chip is same；Second sets up unit, for by the 3rd media chip in media handling
A upper chip and next chip in flow are set up with the fourth media chip respectively to be communicated to connect.
According to the third aspect, the embodiments of the invention provide a kind of media server, including a main control chip and multiple
Media chip；Wherein, the main control chip is used to obtain media handling instruction；It is used for according to being chosen from default media resource pond
One or more media chips of the media handling instruction are performed, and media handling is set up between the media chip chosen
Flow；The media resource pond be the media server in media chip set, wherein each media chip correspondence extremely
A kind of function of few media data processing；The media chip chosen handles pending matchmaker successively according to media handling flow
Volume data.
Media processing method, device and media server that the embodiment of the present invention is provided, by media server
Main control chip obtains media handling instruction, and is chosen from default media resource pond for performing one that the media handling is instructed
Or multiple media chips, media handling flow is set up between the media chip chosen, main control chip obtains pending media
The media chip chosen is sent it to after data, is handled and treated successively according to media handling flow by the media chip chosen
Handle media data.With it, a variety of media chips (i.e. heterogeneous chip) with different media handling functions can collect
Group is arranged in media server so that media server can support a variety of different media handling demands；As pending matchmaker
When the amount of volume data is larger, media server can flexibly select multiple media with same media handling function as needed
Chip parallel processing media data, so as to improve the speed of media handling.
Brief description of the drawings
The features and advantages of the present invention can be more clearly understood from by reference to accompanying drawing, accompanying drawing is schematical without that should manage
Solve to carry out any limitation to the present invention, in the accompanying drawings：
Fig. 1 shows the application scenarios schematic diagram of the embodiment of the present invention；
Fig. 2 shows a kind of flow chart of media processing method according to embodiments of the present invention；
Fig. 3 shows the schematic diagram of media handling flow according to embodiments of the present invention；
Fig. 4 shows the schematic diagram of another media handling flow according to embodiments of the present invention；
Fig. 5 shows the schematic diagram of another media handling flow according to embodiments of the present invention；
Fig. 6 shows the flow chart of another media processing method according to embodiments of the present invention；
Fig. 7 shows a kind of theory diagram of media processor according to embodiments of the present invention；
Fig. 8 shows the theory diagram of another media processor according to embodiments of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those skilled in the art are not having
There is the every other embodiment made and obtained under the premise of creative work, belong to the scope of protection of the invention.
Fig. 1 shows the application scenarios schematic diagram of the embodiment of the present invention.Fig. 1 includes first terminal (medium data acquisition
Terminal, the mobile client such as smart mobile phone, tablet personal computer, special audio/video conference system terminal, camera and Mike
Wind etc.), (terminal, the mobile client such as smart mobile phone, tablet personal computer is presented in media data for media server and second terminal
End, special audio/video conference system terminal, display and loudspeaker etc.).The quantity of first terminal is one or more, and second
The quantity of terminal can also be one or more.
Under normal circumstances, first terminal and data format handled by second terminal are different, it is therefore desirable to data
Form is changed (i.e. code stream is changed)；Or, it is necessary to data that first terminal is gathered are further after processing, then pass through the
Two terminals are presented.These media handling functions are performed by the media server in the embodiment of the present invention.Require supplementation with explanation
, in addition to code stream is changed, media handling function also includes coding, decoding, object identification (such as in identification monitoring image
Object), image mosaic (such as by the image mosaic in multiple meeting-place into piece image, or the multiple images in same meeting-place spelled
Be connected into piece image), audio mixing etc..
Media server is connected respectively with first terminal, second terminal, for handling the pending media data collected,
So that it is applied to present by second terminal.As shown in figure 1, the media server includes a main control chip M and multiple
Media chip C1, C2, C3 ... media chip can be H265 coding/decodings chip, H264 coding/decodings chip, MPEG volumes/solution
Code chip, image scaling process chip, continuous presence chip, image denoising chip, object identification chip, audio mixing chip etc..
It should be added that, media chip described herein can also be the module for performing media handling function.
Alternatively, the media server can also include a standby control chip S, the disaster tolerance energy for strengthening media server
Power, to ensure that media server can normally perform media handling function.
Specifically, the first terminal and second terminal in the application scenarios of the embodiment of the present invention can be whole for audio/video conference
End, i.e., the terminal that can have not only gathered media data in audio/video conference system but also media data can be presented；Media take
Business device can be audio/video conference system server, more specifically can be the multipoint control unit (English of audio/video conference system
Text：Multi-point Control Unit, referred to as：MCU).
Embodiment one
Fig. 2 shows a kind of flow chart of media processing method according to embodiments of the present invention.The media processing method is fitted
For the media server shown in Fig. 1.According to Fig. 2, this method comprises the following steps：
S101：Main control chip obtains media handling instruction.
Media handling is instructed for indicating that media server is handled pending media data.
Before handling pending media data, main control chip first obtains media handling instruction.The media handling
Instruction can be disposed in pending media data, then main control chip receives and first therefrom obtains media after pending media data
Process instruction；Or, media handling instruction can also be that first terminal is sent in advance before pending media data is sent
's.
For example, the media handling instruction acquired in main control chip is the number that the H265 data encoded are converted to H264 codings
According to, that is, realize code stream change.
S102：Main control chip chooses one or more matchmakers for performing media handling instruction from default media resource pond
Body chip.The process that the media chip chosen performs media handling instruction is the process that it handles media data.
Media resource pond is the set of media chip in media server, wherein at least one matchmaker of each media chip correspondence
The function of volume data processing.
Use the example above, it is assumed that record has H265 coding chip C, H265 decoding chip, H264 coding cores in media resource pond
Piece, H264 decoding chips, H263 coding chips, H263 decoding chips, mpeg encoded chip, MPEG decoding chips etc..To realize
Above-mentioned code stream conversion, main control chip need to choose H265 decoding chip C1 and H264 coding chips C2 from media resource pond.
S103：Main control chip sets up media handling flow according to media handling instruction between the media chip chosen.
Wherein media handling flow is the sequential combination between main control chip and the media chip chosen.Use the example above, according to by H265
The data of coding are converted to the media set up between this media handling instruction of the data of H264 codings, the media chip chosen
Handling process is " H265 decodings-H264 codings ", and not " H264 codings-H265 decodings ", as shown in Figure 3.Require supplementation with
Illustrate, before step S103 main control chips set up processing media handling flow, the H265 decoding chips C1 and H264 are compiled
Code chip C2 media processing capacity is in idle condition, that is, is not in any handling process, herein signified " media handling energy
Power " is different from media processing chip itself, such as when media processing chip C1 total medium disposal ability has only used half
When, its second half media processing capacity is just in idle condition.Now main control chip resettles a media handling stream in addition
Cheng Shi, it is also an option that media processing chip C1, i.e. media processing chip C1 total medium disposal ability can belong to
Two different media handling flows.
S104：Main control chip obtains pending media data.
S105：Main control chip sends pending media data to the media chip chosen, by the media core chosen
Piece handles pending media data successively according to media handling flow.
Use the example above, pending media data is first sent to H265 decoding chips C1 and decoded by main control chip, decode
After the completion of send next media chip into media handling flow --- H264 chips C2 is encoded.
After the completion of last media chip processing in media handling flow, the data after processing can be back to
Main control chip；Or, main control chip can be with sets target interface or chip so that last matchmaker in media handling flow
After the completion of the processing of body chip, the data after processing are sent to the target interface or chip.
The above-mentioned complete process for setting up media handling flow, can be that main control chip is got after pending media data,
Whole media handling flow is sent into next media chip into media handling flow in company with pending media data, for example, sent out
Deliver to H265 decoding chips C1；Each media chip, will also according to the media handling flow after pending media data is handled
Data after processing send next media chip into media handling flow, and such as H265 decoding chips C1 completes to decode
Afterwards, reading media handling process, decoded data are sent to the next media chip read --- H264 chips C2.
First made according to media handling flow as the above-mentioned embodiment arranged side by side for setting up media handling flow or main control chip
The media of selection set up communication connection successively, are that each media chip sets its next media chip, main control chip will be pending
Media data sends the media chip in media handling flow, after the completion of each media chip is to data processing, is sent directly to
Next media chip set in advance, for further details, please refer to step S205, S206, S207 and S208 of embodiment two.
As another specific embodiment of the present embodiment, as shown in figure 4, media handling flow can also be " media core
Piece C1-media chip C4-media chip C2 ".When media chip C1 is that decoding chip, media chip C2 are coding chip,
Media chip C4 can be any one in object identification chip, image mosaic, audio mixing chip." chip " described herein
It can be the module for performing corresponding function.
As a kind of optional embodiment of the present embodiment, main control chip is chosen multiple with same from media resource pond
The media data that a media chip is sent out in the media chip of media handling function, these media chip parallel processings, such as Fig. 5 institutes
Show (communication interface of media chip is not drawn into figure), media chip C2 is coding chip, media chip C4 can know for object
Any one in other chip, image mosaic, audio mixing chip, media chip C11, C12, C13 are decoding chip.It is multiple that there is phase
Media chip with media handling function is jointly processed by media data and can improve the processing speed of pending media data.
It is pointed out that the media chip that being used for selected by main control chip performs media handling instruction can also be one
It is individual, for example only need the instruction to pending execution image scaling.
Above-mentioned media processing method, obtains media handling by main control chip in media server and instructs, and from default
One or more media chips for performing media handling instruction are chosen in media resource pond, in the media chip chosen
Between set up media handling flow, main control chip sends it to the media chip chosen after obtaining pending media data,
Pending media data is handled successively according to media handling flow by the media chip chosen.With it, a variety of have
The media chip (i.e. heterogeneous chip) of different media handling functions can cluster be arranged in media server so that media services
Device can support a variety of different media handling demands；When the amount of pending media data is larger, media server can root
According to needing flexibly to select multiple media chip parallel processing media datas with same media handling function, so as to improve media
The speed of processing.
Embodiment two
Fig. 6 shows the flow chart of another media processing method according to embodiments of the present invention.The media processing method
Suitable for the media server shown in Fig. 1, wherein, the media chip in media server includes detachably connecting with main control chip
The second media chip or the 3rd media chip connect.According to Fig. 6, this method comprises the following steps：
S201：When the second media chip is connected to main control chip, the second media chip sends registration letter to main control chip
Breath.
The log-on message includes the media handling function of the second media chip, for example, encode, decode, code stream is changed, object
Identification, image mosaic, audio mixing etc..
As shown in Figure 3, it is assumed that media chip C1 is that the second media chip, i.e. media chip C1 detachably connect with main control chip
Connect, be easy to only change the decoding chip when media chip C1 is damaged, to reduce maintenance cost；Or choose whether according to demand
Installation media chip C1, to improve the flexibility of media server installation, reduces installation cost in the media server.
When media chip C1 is connected to main control chip, log-on message can be sent to main control chip, inform its institute of main control chip
The media handling function being able to carry out decodes for H265.
S202：Main control chip receives the log-on message of the second media chip.
S203：Main control chip stores the media handling function of the second media chip to media resource pond.
Use the example above, main control chip is received after media chip C1 log-on message, media chip C1 and its institute is right
The H265 answered decodes this media data processing function and stored to media resource pond.
Media chip C2 can be fixedly connected with main control chip；Or can also be detachably connected with main control chip
, media chip C2 sends log-on message to main control chip, and it is encoded this media by main control chip with the H264 corresponding to it
Data processing function is stored to media resource pond.
S204：Main control chip obtains media handling instruction, and media handling is instructed for indicating media server to pending
Media data is handled.The step refers to the step S101 in embodiment one, will not be repeated here.
S205：Main control chip chooses one or more matchmakers for performing media handling instruction from default media resource pond
Body chip.Media resource pond is the set of media chip in media server.The step refers to the step in embodiment one
S102, will not be repeated here.
S206：Main control chip determines that the media chip chosen is used for the order for performing media handling instruction.
S207：Main control chip is set up with first media chip in order and communicated to connect.
S208：Main control chip sends next media core of each media chip in order to each media chip chosen
Piece.
S209：Communication connection is set up between each media chip and its next media chip.
Use the example above, above-mentioned steps S206, S207, S208 and S209 are：Main control chip determination order be：H265 is decoded
Pre-processing data of the chip C1 in H264 coding chips C2.Main control chip is set up with H265 decoding chips C1 communicate to connect first,
And send its next media chip to H265 decoding chips C1 for H264 coding chip C2, then H265 decoding chips C1 with
H264 coding chips C2 sets up communication connection.Alternatively, last media chip H264 of the main control chip also into the order
Coding chip C2 sends its next media chip for main control chip.Thus set for each media chip chosen next
Media chip, namely form between the media chip chosen a kind of described media handling flow of embodiment.
As a kind of optional embodiment of the present embodiment, each media chip includes at least two PCIe communication interfaces,
A upper media chip, the next media chip being respectively used to the media chip, which are set up, to be communicated to connect.The number of PCIe communication bus
It is high according to transmission rate, it is possible to increase processing speed of the media server for media data.
S210：Main control chip obtains pending media data.
S211：Main control chip sends pending media data to the media chip chosen.Circulation execution step S212,
S213 and S214, until pending media data is disposed by last media chip in media handling flow.
S212：Current media chip receives pending media data.
S213：Current media chip is according to itself pending media data of media handling function treatment.
S214：Media data after current media chip is processed to sends next media core into media handling flow
Piece.
In above-mentioned steps S212, S213 and S214, the media core of media data is presently processing in media handling flow
Piece is the current media chip of the media handling flow.A upper media chip is sent to the media number of current media process chip
According to the pending media data of as current media process chip.Use the example above, current media chip is H265 decoding chips C1
When, main control chip send to H265 decoding chips C1 media data be H265 decoding chips C1 pending media data,
After H265 decoding chips C1 is decoded to pending media data, next media chip set in advance is sent data to ---
H264 coding chips C2；Then, current media chip is that H264 coding chips C2, H265 decoding chip C1 is sent to H264 codings
Chip C2 media data is H264 coding chips C2 pending media data, and H264 coding chips C2 is to pending media
After data encoding, next media chip set in advance is sent data to --- main control chip is (assuming that it presets next media
Chip is main control chip).So far, the media chip chosen completes according to media handling flow and handles pending media successively
The step of data.
S215：When the 3rd media chip has sent notice or the 3rd media chip that it will be removed to main control chip
When operation is broken down, main control chip deletes the 3rd media chip from media resource pond.
3rd media chip and above-mentioned second media chip can be same media chip.Use the example above, if media core
When piece C1 breaks down, it is sent after failure notification to main control chip, or main control chip implements each in monitoring media resource pond
Whether individual media chip is normally connected with main control chip, and when monitoring that media chip C1 breaks down, main control chip is from matchmaker
Media chip C1 is deleted in body resource pool.Or, before manual demolition media chip C1, first pass through on media chip C1
Set button etc. sends its notice that will be removed to main control chip, and main control chip is received after the notice, master control core
Piece deletes media chip C1 from media resource pond.
S216：Main control chip chooses fourth media chip from media resource pond.The processing type of fourth media chip with
The media handling function phase of 3rd media chip is same.Decoded for example, fourth media chip and the 3rd media chip are all used for H265,
Or all it is used for H264 codings, so that fourth media chip can take over the work of the 3rd media chip.
Use the example above, if before media chip C1 (i.e. the 3rd media chip) is deleted from media resource pond, being in certain
One media handling flow, then after deletion, also disconnect media chip C1 and thereon between a media chip, next media chip
Communication connection.In addition, main control chip chooses the media handling function identical with media chip C1 also from media resource pond
Media chip C3 (i.e. fourth media chip), to undertake the step performed by media chip C1.
S217：Fourth media chip and the 3rd the media chip upper chip and next chip in media handling flow point
It Jian Li not communicate to connect.Namely fourth media chip substitutes the 3rd original media chip, starts against media handling flow,
To ensure that media server can also normally perform media handling function in the case where the 3rd media chip is removed.
Embodiment three
Fig. 7 shows a kind of theory diagram of media processor according to embodiments of the present invention.The media processor
Suitable for media server, the media server includes a main control chip and multiple media chips.The device is obtained including first
The selection of unit 10, first unit 20, first is taken to set up unit 30, the transmitting element 50 of second acquisition unit 40 and first.
First acquisition unit 10, for obtaining media handling instruction, media handling is instructed for indicating media server pair
Pending media data is handled.
First choose unit 20, for chosen from default media resource pond for perform media handling instruction one or
Multiple media chips.Media resource pond is the set of media chip in media server, wherein each media chip correspondence is at least
A kind of function of media data processing.
First sets up unit 30, for setting up media handling between the media chip chosen according to media handling instruction
Flow.Media handling flow is the sequential combination between main control chip and the media chip chosen.
Second acquisition unit 40, for obtaining pending media data.
First transmitting element 50, for pending media data to be sent to the media chip chosen, by what is chosen
Media chip handles pending media data successively according to media handling flow.
Step performed by above-mentioned unit specifically refers to embodiment one or embodiment two.
Above-mentioned media processor, obtains media handling by main control chip in media server and instructs, and from default
One or more media chips for performing media handling instruction are chosen in media resource pond, in the media chip chosen
Between set up media handling flow, main control chip sends it to the media chip chosen after obtaining pending media data,
Pending media data is handled successively according to media handling flow by the media chip chosen.With it, a variety of have
The media chip (i.e. heterogeneous chip) of different media handling functions can cluster be arranged in media server so that media services
Device can support a variety of different media handling demands；When the amount of pending media data is larger, media server can root
According to needing flexibly to select multiple media chip parallel processing media datas with same media handling function, so as to improve media
The speed of processing.
Example IV
Fig. 8 shows the theory diagram of another media processor according to embodiments of the present invention.Alternatively, first obtain
The selection of unit 10, first unit 20, first set up unit 30, the transmitting element 50 of second acquisition unit 40 and first and are arranged at master control
Chip.The media processor and the difference of embodiment three are also resided in, and first, which sets up unit 30, includes determination subelement 31, first
Set up subelement 32, transmission sub-unit 33 and second and set up subelement 34.
Determination subelement 31, the media chip for determining to have chosen is used for the order for performing media handling instruction.
First sets up subelement 32, is communicated to connect for being set up with first media chip in order.
Transmission sub-unit 33, for sending next media of each media chip in order to each media chip chosen
Chip.
Second sets up subelement 34, for setting up communication connection between media chip and its next media chip.
Alternatively, above-mentioned determination subelement 31, first set up subelement 32 and transmission sub-unit 33 is arranged at main control chip.
Second, which sets up subelement 34, is arranged at each media chip chosen.
As a kind of optional embodiment of the present embodiment, each working as in the media handling flow described in embodiment two
Preceding media chip include receiving unit, processing unit and transmitting element, be respectively used to perform embodiment two in step S212,
S213 and S214.Specifically, the device includes the first receiving unit 60, the transmitting element 80 of processing unit 70 and second.
First receiving unit 60, for receiving pending media data.
Processing unit 70, for according to itself pending media data of media handling function treatment.
Second transmitting element 80, for the media data after processing to be sent to next media core into media handling flow
Piece.
Alternatively, above-mentioned first receiving unit 60, the transmitting element 80 of processing unit 70 and second are arranged at current media core
The media chip that media data is presently processing in piece, media handling flow is the current media core of the media handling flow
Piece.
As a kind of optional embodiment of the present embodiment, media chip includes second be detachably connected with main control chip
Media chip.The device also includes the 3rd transmitting element 90, the second receiving unit 100 and memory cell 110.
3rd transmitting element 90, for when the second media chip is connected to main control chip, sending and registering to main control chip
Information.Log-on message includes the media handling function of the second media chip.Second receiving unit 100, for receiving the second media
The log-on message of chip,
Memory cell 110, for the media handling function of the second media chip to be stored to media resource pond.
Alternatively, above-mentioned 3rd transmitting element 90 is arranged at the second media chip, the second receiving unit 100 and memory cell
110 are arranged at main control chip.
As a kind of optional embodiment of the present embodiment, media chip includes the 3rd be detachably connected with main control chip
Media chip.The device also includes the deletion selection unit 130 and second of unit 120, second and sets up unit 140.
Delete unit 120, for when the 3rd media chip to main control chip send notice that it will be removed or
When the operation of 3rd media chip is broken down, the 3rd media chip is deleted from media resource pond.
Second chooses unit 130, for choosing fourth media chip from media resource pond.The processing of fourth media chip
Type and the media handling function phase of the 3rd media chip are same.
Second sets up unit 140, for the upper chip and next core by the 3rd media chip in media handling flow
Piece is set up with fourth media chip communicate to connect respectively.
Alternatively, above-mentioned deletion unit 120 and second chooses unit 130 and is arranged at main control chip.Second sets up unit 140
Refer to first and set up unit 30.
Step performed by above-mentioned unit specifically refers to embodiment one or embodiment two.
Embodiment five
The embodiments of the invention provide a kind of media server, as shown in figure 1, including a main control chip M and multiple matchmakers
Body chip C1, C2, C3 ....Wherein, main control chip is used to obtain media handling instruction.Selected according to from default media resource pond
Take in one or more media chips of execution media handling instruction, and set up between the media chip chosen at media
Manage flow.Media resource pond is the set of the media chip in media server, wherein each media chip correspondence is at least one
The function of media data processing.The media chip chosen handles pending media data successively according to media handling flow.Tool
Body please participate in embodiment one or embodiment two.
Also include standby control chip S as a kind of optional embodiment of the present embodiment, in media server, the controlled chip
Implement media processing capacity service condition and the record of media handling flow on each media chip in backup main control chip.
When main control chip breaks down, the step of controlled chip takes over execution main control chip, so as to ensure in main control chip event occur
During barrier, media server still can normally perform media handling function.
It should be noted that for foregoing each method embodiment, in order to be briefly described, therefore it is all expressed as a series of
Combination of actions, but those skilled in the art should know, the present invention is not limited by described sequence of movement because
According to the present invention, some steps can be carried out sequentially or simultaneously using other.Secondly, those skilled in the art should also know
Know, embodiment described in this description belongs to preferred embodiment, involved action and module is not necessarily of the invention
It is necessary.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not have the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiment.
, can be by another way in several embodiments provided herein, it should be understood that disclosed device
Realize.For example, device embodiment described above is only schematical, such as the division of described unit is only one kind
Division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or can
To be integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or discussed each other
Coupling direct-coupling or communication connection can be by some interfaces, the INDIRECT COUPLING or communication connection of device or unit,
Can be electrical or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If the integrated unit is realized using in the form of SFU software functional unit and as independent production marketing or used
When, it can be stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially
The part contributed in other words to prior art or all or part of the technical scheme can be in the form of software products
Embody, the computer software product is stored in a storage medium, including some instructions are to cause a computer
Equipment (can be personal computer, mobile terminal, server or network equipment etc.) performs side described in each embodiment of the invention
The all or part of step of method.And foregoing storage medium includes：USB flash disk, read-only storage (ROM, Read-Only Memory),
Random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disc or CD etc. are various to be stored
The medium of program code.
Although being described in conjunction with the accompanying embodiments of the invention, those skilled in the art can not depart from the present invention
Spirit and scope in the case of various modification can be adapted and modification, such modifications and variations are each fallen within by appended claims institute
Within the scope of restriction.
Claims (10)
1. a kind of media processing method, it is characterised in that for media server, the media server includes a master control core
Piece and multiple media chips；Methods described includes：
The main control chip obtains media handling instruction, and the media handling is instructed for indicating that the media server treats place
Reason media data is handled；
The main control chip chooses one or more matchmakers for performing the media handling instruction from default media resource pond
Body chip；The media resource pond is the set of media chip in the media server, wherein each media chip correspondence is extremely
A kind of function of few media data processing；
The main control chip sets up media handling flow according to media handling instruction between the media chip chosen；Institute
It is the sequential combination between the main control chip and the media chip chosen to state media handling flow；
The main control chip obtains pending media data；
The main control chip sends the pending media data to the media chip chosen, by the media chip chosen
The pending media data is handled successively according to the media handling flow.
2. media processing method according to claim 1, it is characterised in that the main control chip is according to the media handling
The step of media handling flow is set up in instruction between the media chip chosen, including：
The main control chip determines that the media chip chosen is used for the order for performing the media handling instruction；
The main control chip is set up with first media chip in the order and communicated to connect；
The main control chip sends next media of each media chip in the order to each media chip chosen
The mark of chip；
Communication connection is set up between each media chip and its next media chip.
3. described in media processing method according to claim 1, it is characterised in that pressed by the media chip chosen
The step of pending media data being handled according to the media handling flow successively, including：
Current media chip receives the pending media data；
The current media chip pending media data according to itself media handling function treatment；
Media data after the current media chip is processed to sends next media chip into media handling flow.
4. media processing method according to claim 1, it is characterised in that the media chip includes and the master control core
The second media chip that piece is detachably connected；Methods described also includes：
When the second media chip is connected to the main control chip, second media chip sends to the main control chip and registered
Information；The log-on message includes the media handling function of second media chip；
The main control chip receives the log-on message of second media chip, and by the media handling of second media chip
Function is stored to the media resource pond.
5. media processing method according to claim 1, it is characterised in that the media chip includes and the master control core
The 3rd media chip that piece is detachably connected；Methods described also includes：
When the 3rd media chip has sent notice or the 3rd media chip that it will be removed to the main control chip
When operation is broken down, the main control chip deletes the 3rd media chip from the media resource pond；
Main control chip chooses fourth media chip from the media resource pond；The processing type of the fourth media chip and institute
The media handling function phase for stating the 3rd media chip is same；
A upper chip and next chip of 3rd media chip in media handling flow respectively with the fourth media core
Piece sets up communication connection.
6. a kind of media processor, it is characterised in that for media server, the media server includes a master control core
Piece and multiple media chips；Described device includes：
First acquisition unit, for obtaining media handling instruction, the media handling is instructed for indicating the media server
Pending media data is handled；
First chooses unit, for being chosen from default media resource pond for performing one or many that the media handling is instructed
Individual media chip；The media resource pond is the set of media chip in the media server, wherein each media chip pair
Answer the function of at least one media data processing；
First sets up unit, for setting up media handling stream between the media chip chosen according to media handling instruction
Journey；The media handling flow is the sequential combination between the main control chip and the media chip chosen；
Second acquisition unit, for obtaining pending media data；
First transmitting element, for the pending media data to be sent to the media chip chosen, by the matchmaker chosen
Body chip handles the pending media data successively according to the media handling flow.
7. media processor according to claim 6, it is characterised in that described first, which sets up unit, includes：
Determination subelement, the media chip for determining to have chosen is used for the order for performing the media handling instruction；
First sets up subelement, is communicated to connect for being set up with first media chip in the order；
Transmission sub-unit, for sending next matchmaker of each media chip in the order to each media chip chosen
Body chip；
Second sets up subelement, for setting up communication connection between each media chip and its next media chip.
8. described in media processor according to claim 6, it is characterised in that described device also includes：
First receiving unit, for receiving the pending media data；
Processing unit, for the pending media data according to itself media handling function treatment；
Second transmitting element, for the media data after processing to be sent to next media chip into media handling flow.
9. media processor according to claim 6, it is characterised in that the media chip includes and the master control core
The second media chip that piece is detachably connected；Described device also includes：
3rd transmitting element, for when the second media chip is connected to the main control chip, sending and noting to the main control chip
Volume information；The log-on message includes the media handling function of second media chip；
Second receiving unit, the log-on message for receiving second media chip,
Memory cell, for the media handling function of second media chip to be stored to the media resource pond.
10. a kind of media server, it is characterised in that including a main control chip and multiple media chips；Wherein,
The main control chip is used to obtain media handling instruction；It is used to perform the matchmaker according to choosing from default media resource pond
One or more media chips of body process instruction, and set up between the media chip chosen media handling flow；It is described
Media resource pond is the set of the media chip in the media server, wherein at least one media of each media chip correspondence
The function of data processing；
The media chip chosen handles pending media data successively according to media handling flow.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710243848.0A CN107124575A (en) | 2017-04-14 | 2017-04-14 | A kind of media processing method, device and media server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710243848.0A CN107124575A (en) | 2017-04-14 | 2017-04-14 | A kind of media processing method, device and media server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107124575A true CN107124575A (en) | 2017-09-01 |
Family
ID=59724720
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710243848.0A Pending CN107124575A (en) | 2017-04-14 | 2017-04-14 | A kind of media processing method, device and media server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107124575A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153411A (en) * | 2020-08-18 | 2020-12-29 | 南斗六星系统集成有限公司 | Method and system for improving performance of chat room streaming media server |
| WO2023274094A1 (en) * | 2021-06-30 | 2023-01-05 | 华为技术有限公司 | Method for processing media stream in video conference and related product |
| WO2023051153A1 (en) * | 2021-09-30 | 2023-04-06 | 中兴通讯股份有限公司 | Video conferencing mcu inspection method, electronic device, and storage medium |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1913621A (en) * | 2005-08-10 | 2007-02-14 | 中兴通讯股份有限公司 | Source scheduling method for implementing image processing in conference telephone system |
| CN101316352A (en) * | 2008-07-01 | 2008-12-03 | 中兴通讯股份有限公司 | Method and device for implementing multiple pictures of conference television system, video gateway and implementing method thereof |
| CN201312356Y (en) * | 2008-12-22 | 2009-09-16 | 沈逸林 | Digital television network media phone set terminal |
| CN101815370A (en) * | 2010-04-09 | 2010-08-25 | 中兴通讯股份有限公司 | Multi-chip mobile terminal and equipment management realization method thereof |
| CN101969552A (en) * | 2010-11-17 | 2011-02-09 | 广东威创视讯科技股份有限公司 | System and method for parallel processing of video data |
| CN102123268A (en) * | 2011-03-15 | 2011-07-13 | 深圳市捷视飞通科技有限公司 | Video conference terminal and system |
| CN102360309A (en) * | 2011-09-29 | 2012-02-22 | 中国科学技术大学苏州研究院 | Scheduling system and scheduling execution method of multi-core heterogeneous system on chip |
| CN202258375U (en) * | 2011-11-01 | 2012-05-30 | 深圳市融创天下科技股份有限公司 | Double-chip audio/ video player and mobile terminal |
| CN102761736A (en) * | 2011-04-29 | 2012-10-31 | 腾讯科技（深圳）有限公司 | Video decoding method and device |
| CN103179029A (en) * | 2013-03-26 | 2013-06-26 | 深圳市同洲电子股份有限公司 | Wireless home multimedia gateway |
| US20140047170A1 (en) * | 2012-05-04 | 2014-02-13 | Lsi Corporation | Maintaining ordering via a multi-level map of a solid-state media |
| CN104464290A (en) * | 2014-12-08 | 2015-03-25 | 无锡加视诚智能科技有限公司 | Road traffic parameter collecting and rule violation snapshot system based on embedded double-core chip |
| CN104581075A (en) * | 2015-01-13 | 2015-04-29 | 中国电子科技集团公司第三十二研究所 | Panoramic video processing system and method based on heterogeneous platform |
| CN105187760A (en) * | 2015-07-30 | 2015-12-23 | 武汉随锐亿山科技有限公司 | Multipoint control unit clustering system and method |
| CN105404487A (en) * | 2015-11-16 | 2016-03-16 | 浙江宇视科技有限公司 | Splicing controller supporting redisplay function and control method therefor |
-
2017
- 2017-04-14 CN CN201710243848.0A patent/CN107124575A/en active Pending
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1913621A (en) * | 2005-08-10 | 2007-02-14 | 中兴通讯股份有限公司 | Source scheduling method for implementing image processing in conference telephone system |
| CN101316352A (en) * | 2008-07-01 | 2008-12-03 | 中兴通讯股份有限公司 | Method and device for implementing multiple pictures of conference television system, video gateway and implementing method thereof |
| CN201312356Y (en) * | 2008-12-22 | 2009-09-16 | 沈逸林 | Digital television network media phone set terminal |
| CN101815370A (en) * | 2010-04-09 | 2010-08-25 | 中兴通讯股份有限公司 | Multi-chip mobile terminal and equipment management realization method thereof |
| CN101969552A (en) * | 2010-11-17 | 2011-02-09 | 广东威创视讯科技股份有限公司 | System and method for parallel processing of video data |
| CN102123268A (en) * | 2011-03-15 | 2011-07-13 | 深圳市捷视飞通科技有限公司 | Video conference terminal and system |
| CN102761736A (en) * | 2011-04-29 | 2012-10-31 | 腾讯科技（深圳）有限公司 | Video decoding method and device |
| CN102360309A (en) * | 2011-09-29 | 2012-02-22 | 中国科学技术大学苏州研究院 | Scheduling system and scheduling execution method of multi-core heterogeneous system on chip |
| CN202258375U (en) * | 2011-11-01 | 2012-05-30 | 深圳市融创天下科技股份有限公司 | Double-chip audio/ video player and mobile terminal |
| US20140047170A1 (en) * | 2012-05-04 | 2014-02-13 | Lsi Corporation | Maintaining ordering via a multi-level map of a solid-state media |
| CN103179029A (en) * | 2013-03-26 | 2013-06-26 | 深圳市同洲电子股份有限公司 | Wireless home multimedia gateway |
| CN104464290A (en) * | 2014-12-08 | 2015-03-25 | 无锡加视诚智能科技有限公司 | Road traffic parameter collecting and rule violation snapshot system based on embedded double-core chip |
| CN104581075A (en) * | 2015-01-13 | 2015-04-29 | 中国电子科技集团公司第三十二研究所 | Panoramic video processing system and method based on heterogeneous platform |
| CN105187760A (en) * | 2015-07-30 | 2015-12-23 | 武汉随锐亿山科技有限公司 | Multipoint control unit clustering system and method |
| CN105404487A (en) * | 2015-11-16 | 2016-03-16 | 浙江宇视科技有限公司 | Splicing controller supporting redisplay function and control method therefor |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153411A (en) * | 2020-08-18 | 2020-12-29 | 南斗六星系统集成有限公司 | Method and system for improving performance of chat room streaming media server |
| WO2023274094A1 (en) * | 2021-06-30 | 2023-01-05 | 华为技术有限公司 | Method for processing media stream in video conference and related product |
| WO2023051153A1 (en) * | 2021-09-30 | 2023-04-06 | 中兴通讯股份有限公司 | Video conferencing mcu inspection method, electronic device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107292808B (en) | Image processing method and device and image coprocessor | |
| CN107124575A (en) | A kind of media processing method, device and media server | |
| CN203057193U (en) | Data processing apparatus | |
| CN101068345B (en) | Video frequency monitoring method and system and network transmission equipment | |
| CN105430534B (en) | method and system for reporting data by intelligent equipment | |
| CN102404543B (en) | Processing method and device of cascade conference place in cascade conference and cascade conference system | |
| WO2020083019A1 (en) | Decoding method based on multi-core processor, terminal device and storage medium | |
| CN106658110A (en) | Screen projection method and system | |
| CN105554430A (en) | Video call method, system and device | |
| CN101316352B (en) | Method and device for implementing multiple pictures of conference television system, video gateway and implementing method thereof | |
| CN105893735A (en) | Medical information remote one-screen assisting method and terminal | |
| CN107396034A (en) | Image transfer method and system | |
| CN101489052B (en) | Subtitle data processing method and apparatus | |
| CN106098071A (en) | Intelligent Mobile Robot audio frequency processing system and method | |
| CN104253807A (en) | Media resource control method and device | |
| CN102790766A (en) | Object query method, object query system, object query device and object query acquisition device | |
| CN102685415A (en) | Method, system, device and terminal for processing video picture | |
| CN113988104B (en) | Method and device for decoding bar code, scanning equipment and storage medium | |
| CN105872673A (en) | Multimedia data display method and device | |
| CN109669838A (en) | Realize application resident method, apparatus, computer equipment and storage medium | |
| CN209460787U (en) | A kind of artificial intelligence identification equipment | |
| CN105828131A (en) | Video sharing method and communication terminal | |
| CN107480437B (en) | Data transmission method and device | |
| CN2410710Y (en) | Picture/voice front-end processor | |
| CN103702136A (en) | Storage method and device of multimedia data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170901 |