CN106685895A - Multi-input parameter cooperative media processing device supporting user intervention - Google Patents
Multi-input parameter cooperative media processing device supporting user intervention Download PDFInfo
- Publication number
- CN106685895A CN106685895A CN201510756353.9A CN201510756353A CN106685895A CN 106685895 A CN106685895 A CN 106685895A CN 201510756353 A CN201510756353 A CN 201510756353A CN 106685895 A CN106685895 A CN 106685895A
- Authority
- CN
- China
- Prior art keywords
- parameter
- media
- user intervention
- processing module
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004891 communication Methods 0.000 claims abstract description 11
- 230000007246 mechanism Effects 0.000 claims abstract description 4
- 238000000034 method Methods 0.000 claims description 19
- 230000008569 process Effects 0.000 claims description 16
- 230000001960 triggered effect Effects 0.000 claims description 12
- 238000005111 flow chemistry technique Methods 0.000 claims description 4
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/10—Multimedia information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a multi-input parameter cooperative media processing device supporting user intervention, which comprises an instant communication module, a cooperative processing module and a media real-time processing module, wherein the instant communication module is used for realizing communication connection between the device and multiple clients; by adopting long connection or a client active PUSH communication mechanism, user intervention parameters or scene triggering parameters inputted by multiple clients at the same time are received, and the parameters are transmitted to the cooperative processing module; the cooperative processing module is used for adopting semaphores to carry out synchronization and cooperative processing on the multiple input parameters, and only one user intervention parameter or one scene triggering parameter is inputted to the media real-time processing module at any one time; and the media real-time processing module comprises multiple different types of media stream processing units for receiving the original multimedia data stream, selecting a media stream processing unit according to the user intervention parameters or the scene triggering parameters and outputting multimedia data stream after processing.
Description
Technical field
The present invention relates to multi-media processing field, more particularly to a kind of to support that the multi input parameter of user intervention cooperates with matchmaker
Body processing meanss.
Background technology
The fast development of HTML5 technologies and the final shaping of HTML5 specifications, allow users to realize intervention immediately
The process of real-time media stream.
At present, two kinds are roughly divided into the device that Media Stream carries out real-time processing：The first is that do not possess user input
The real-time device of intervention functions, when input for pending stream media code stream when, output code flow typically can not according to
The real-time intervention control parameter at family carries out real-time code stream output；Another kind is that the input medium for supporting user intervention is processed
Device, typically based on offline application, or output code flow carries larger output time delay；And multi-user's multi input
Parameter is difficult to collaboration process.
The content of the invention
It is an object of the invention to overcome the drawbacks described above that current media current processing device is present, there is provided one kind is supported to use
The multi input parameter collaboration media real-time processing device that family is intervened, the output code flow of the device can be according to the intervention of user
Information real-time change, and can be simultaneously input into multiple users and collaboration process.
To achieve these goals, the present invention is proposed at a kind of multi input parameter collaboration media for supporting user intervention
Reason device, it is a kind of to support that the multi input parameter of user intervention cooperates with media processor；Described device includes：Immediately
Communication module, collaboration processing module and media real-time processing module；
The instant messaging module, for realizing the communication connection between described device and multiple client；Using length
Connection or the communication mechanism of client active PUSH, receive user intervention parameter that multiple client is input into simultaneously or
Scenario triggered parameter；And the parameter of all receptions is sent to into the collaboration processing module；
The collaboration processing module, for being synchronized to multi input parameter using semaphore and cooperateing with process, it is ensured that
At any one moment, only a user intervention parameter or scenario triggered parameter are input into into the media real-time processing mould
Block；
The media real-time processing module, comprising several different types of media flow processing units, for receiving original
The multimedia data stream of beginning, according to the user intervention parameter or scenario triggered parameter that receive corresponding Media Stream is selected
Processing unit, the multimedia data stream after output process.
In above-mentioned technical proposal, the client is computer, mobile phone or PAD.
In above-mentioned technical proposal, the synchronization of the collaboration processing module is with processing procedure is cooperateed with：When the media reality
When processing module it is available when, the value of semaphore variable sv is TRUE, and when there is user intervention parameter the media are input into
During real-time processing module, it is subtracted 1 by P (sv) operations, makes it be changed into FALSE, represents the media real-time processing
During module is currently in use；At the end of the user intervention parameter processing, semaphore variable is added 1 using V (sv) operations,
Release resource, makes the media real-time processing module be changed into addressable critical region again, and with this other are ensured
The input of user intervention parameter, so as to realize multiple client and described device process is cooperateed with.
In above-mentioned technical proposal, when the media flow processing unit is Audio Processing Unit, the speech processes list
The type of unit is speech enhancement unit, audio enhancement unit, low stress unit or 3-D audio unit.
It is an advantage of the current invention that：
1st, the present invention provides a kind of media real-time processing device for supporting user intervention |input paramete, and the code stream of output can
Real-time change is carried out according to user input parameter；
2nd, the method for the present invention supports that the multiparameter of multiple users is input into simultaneously, can cooperate with the multiple |input parametes of process；
Multiple |input parametes include user intervention parameter and scenario triggered parameter；The former can directly affect the code stream of output；Afterwards
Person can be triggered in media application according to certain scene, and specific vision content is presented or relevant treatment is carried out.
Description of the drawings
Fig. 1 is the structure chart that the multi input parameter of the support user intervention of the present invention cooperates with media processor；
Fig. 2 is the schematic diagram of the position coordinateses (X, Y, Z) of 3-D audio.
Specific embodiment
Below in conjunction with the accompanying drawings the present invention will be further described in detail with specific embodiment.
As shown in figure 1, the invention provides a kind of support that the multi input parameter of user intervention cooperates with media processor；
Described device includes：Instant messaging module, collaboration processing module and media real-time processing module；
The instant messaging module, for realizing the communication connection between described device and multiple client；Using length
Connection or the communication mechanism of client active PUSH, receive user intervention parameter that multiple client is input into simultaneously or
Scenario triggered parameter；And the parameter of all receptions is sent to into the collaboration processing module；
The client is computer, mobile phone or PAD；So that multimedia data stream is as voice data as an example, it is output as
The audio frequency containing 3-D audio after process；The user intervention parameter includes the position coordinateses (X, Y, Z) of 3-D audio；
The scenario triggered parameter includes the presentation processing parameter of vision content；For example it is set in voice data stream broadcasting mistake
Cheng Zhong, ejects specific advertisement webpage in specific time, position.
The collaboration processing module, for being synchronized to multi input parameter using semaphore and cooperateing with process, it is ensured that
At any one moment, only a user intervention parameter or scenario triggered parameter are input into into the media real-time processing mould
Block；
When the media real-time processing module is available, the value of semaphore variable sv is TRUE, when there is user intervention
When parameter is input into the media real-time processing module, it is subtracted 1 by P (sv) operations, makes it be changed into FALSE, is represented
During the media real-time processing module is currently in use；At the end of the user intervention parameter processing, operated using V (sv)
Semaphore variable is added 1, resource is discharged, makes the media real-time processing module be changed into addressable critical region again,
Ensure the input of other user intervention parameters with this, so as to realize multiple client and described device process is cooperateed with；
The media real-time processing module, comprising several Audio Processing Units, receives original multimedia data stream,
After user intervention parameter or scenario triggered parameter according to receiving selects corresponding Audio Processing Unit, output to process
Multimedia data stream.
The type of the Audio Processing Unit is speech enhancement unit, audio enhancement unit, low stress unit or three-dimensional
Audio unit；
The Speech processing unit is by creating audio object, it is intended that audio input source；According to the user for receiving
Intervene parameter, special sound signal processing is carried out to voice data stream, and export corresponding sound effect.
As shown in Fig. 2 so that client is as PAD as an example, obtaining source of sound (or hearer) coordinate in three dimensions
Position (x, y, z), is input in real time the related position coordinateses (x, y, z) of 3-D audio, then instant messaging mould by PAD
Block passes to server end, and the media real-time processing module of server end carries out real-time processing according to |input paramete, processes
The 3-D audio that audio frequency afterwards is produced by the earphone output of PAD, while the ad-hoc location that can be played in audio frequency is ejected
Particular webpage (i.e. special scenes triggering is for example presented advertisement etc.).
The specific embodiment of the present invention is the foregoing is only, protection scope of the present invention, ability is not intended to limit
Domain it will be appreciated by the skilled person that on the premise of without departing from inventive principle, repairing to technical scheme
Change or equivalent, without departure from the spirit and scope of technical solution of the present invention, it all should cover the present invention's
In protection domain.
Claims (4)
1. it is a kind of to support that the multi input parameter of user intervention cooperates with media processor；Described device includes：IMU
Letter module, collaboration processing module and media real-time processing module；Characterized in that,
The instant messaging module, for realizing the communication connection between described device and multiple client；Using length
Connection or the communication mechanism of client active PUSH, receive user intervention parameter that multiple client is input into simultaneously or
Scenario triggered parameter；And the parameter of all receptions is sent to into the collaboration processing module；
The collaboration processing module, for being synchronized to multi input parameter using semaphore and cooperateing with process, it is ensured that
At any one moment, only a user intervention parameter or scenario triggered parameter are input into into the media real-time processing mould
Block；
The media real-time processing module, comprising several different types of media flow processing units, for receiving original
The multimedia data stream of beginning, according to the user intervention parameter or scenario triggered parameter that receive corresponding Media Stream is selected
Processing unit, the multimedia data stream after output process.
2. according to claim 1 to support that the multi input parameter of user intervention cooperates with media processor, it is special
Levy and be, the client is computer, mobile phone or PAD.
3. according to claim 1 to support that the multi input parameter of user intervention cooperates with media processor, it is special
Levy and be, the synchronization of the collaboration processing module is with processing procedure is cooperateed with：
When the media real-time processing module is available, the value of semaphore variable sv is TRUE, when there is user intervention
When parameter is input into the media real-time processing module, it is subtracted 1 by P (sv) operations, makes it be changed into FALSE, is represented
During the media real-time processing module is currently in use；At the end of the user intervention parameter processing, operated using V (sv)
Semaphore variable is added 1, resource is discharged, makes the media real-time processing module be changed into addressable critical region again,
Ensure the input of other user intervention parameters with this, so as to realize multiple client and described device process is cooperateed with.
4. according to claim 1 to support that the multi input parameter of user intervention cooperates with media processor, it is special
Levy and be, when the media flow processing unit is Audio Processing Unit, the type of the Audio Processing Unit is language
Sound enhancement unit, audio enhancement unit, low stress unit or 3-D audio unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510756353.9A CN106685895B (en) | 2015-11-09 | 2015-11-09 | A kind of multi input parameter collaboration media processor for supporting user intervention |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510756353.9A CN106685895B (en) | 2015-11-09 | 2015-11-09 | A kind of multi input parameter collaboration media processor for supporting user intervention |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106685895A true CN106685895A (en) | 2017-05-17 |
| CN106685895B CN106685895B (en) | 2019-08-20 |
Family
ID=58864247
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510756353.9A Expired - Fee Related CN106685895B (en) | 2015-11-09 | 2015-11-09 | A kind of multi input parameter collaboration media processor for supporting user intervention |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106685895B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8026945B2 (en) * | 2005-07-22 | 2011-09-27 | Cernium Corporation | Directed attention digital video recordation |
| CN102842337A (en) * | 2012-06-05 | 2012-12-26 | 国光电器股份有限公司 | High-fidelity audio transmission method based on WIFI (Wireless Fidelity) |
| CN103237255A (en) * | 2013-04-24 | 2013-08-07 | 南京龙渊微电子科技有限公司 | Multi-thread audio and video synchronization control method and system |
| WO2014018867A1 (en) * | 2012-07-27 | 2014-01-30 | The Neat Company, Inc. | Portable document scanner having user interface and integrated communications means |
| CN104036789A (en) * | 2014-01-03 | 2014-09-10 | 北京智谷睿拓技术服务有限公司 | Multimedia processing method and multimedia device |
-
2015
- 2015-11-09 CN CN201510756353.9A patent/CN106685895B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8026945B2 (en) * | 2005-07-22 | 2011-09-27 | Cernium Corporation | Directed attention digital video recordation |
| CN102842337A (en) * | 2012-06-05 | 2012-12-26 | 国光电器股份有限公司 | High-fidelity audio transmission method based on WIFI (Wireless Fidelity) |
| WO2014018867A1 (en) * | 2012-07-27 | 2014-01-30 | The Neat Company, Inc. | Portable document scanner having user interface and integrated communications means |
| CN103237255A (en) * | 2013-04-24 | 2013-08-07 | 南京龙渊微电子科技有限公司 | Multi-thread audio and video synchronization control method and system |
| CN104036789A (en) * | 2014-01-03 | 2014-09-10 | 北京智谷睿拓技术服务有限公司 | Multimedia processing method and multimedia device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106685895B (en) | 2019-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9479728B2 (en) | Video SMS message sending and receiving methods and apparatuses thereof, and handheld electronic device | |
| CN108683937A (en) | Interactive voice feedback method, system and the computer-readable medium of smart television | |
| CN109951743A (en) | Barrage information processing method, system and computer equipment | |
| EP4007947A1 (en) | Computing device and extended reality integration | |
| JP2020524420A (en) | Method, apparatus and system for optimizing communication between transmitters and receivers in computer-mediated real-world applications | |
| CN106464953A (en) | Binaural audio systems and methods | |
| EP3284249A2 (en) | Communication system and method | |
| CN113890932A (en) | Audio control method and system and electronic equipment | |
| EP4171066A1 (en) | Audio processing method, apparatus, and system, and storage medium | |
| CN104735153B (en) | A kind of resource supplying and the method and device obtained | |
| CN109560913B (en) | Method and device for data time synchronization between Bluetooth audio devices | |
| CN106101845A (en) | The creation method of a kind of net cast and device | |
| CN109963628A (en) | Game server and the method for generating context aware game information | |
| JP2014167517A (en) | Conversation providing system, game providing system, conversation providing method, game providing method, and program | |
| CN103581603B (en) | The transmission method and electronic equipment of a kind of multi-medium data | |
| CN106162231A (en) | The method and device that a kind of net cast turning point is broadcast | |
| CN104536645A (en) | Information presentation method based on cloud technology | |
| CN108055594A (en) | Implementation method, device, computer equipment and the storage medium of edge section | |
| CN106685895A (en) | Multi-input parameter cooperative media processing device supporting user intervention | |
| CN114374880B (en) | Joint live broadcast method, joint live broadcast device, electronic equipment and computer readable storage medium | |
| US20230141096A1 (en) | Transcription presentation | |
| CN105430153A (en) | Voice reminding information generation method and device, and voice reminding method and device | |
| CN104079703B (en) | A kind of information processing method and electronic equipment | |
| US20190333517A1 (en) | Transcription of communications | |
| EP3716038A1 (en) | An apparatus, method, computer program or system for indicating audibility of audio content rendered in a virtual space |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190820 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |