CN110392292A - A kind of synchronous synergetic method of multi-section intelligent electronic device and multimedia play system - Google Patents

Abstract

The disclosure is a kind of synchronous synergetic method of multi-section intelligent electronic device and multimedia play system, this method and system are for more accurately making multi-section intelligent terminal, intelligent electronic device cooperate, multimedia, synchronous shooting etc. is played simultaneously, the System and method for can be deployed in smart phone, PAD, smartwatch, smart television, intelligent sound box, digital camera etc. and have the field that smart electronics feature needs multi-machine collaborative again, can be the system function that APP mode is also possible to certain intelligent electronic device according to the deployment way of usage scenario its system.The technology has used wireless network, synchronous triggering technique, and dual trigger mechanism, condition triggering technique, sensor control technology, NFC technique and such as speech recognition of part artificial intelligence technology etc. are for synchronous synergetic.

Description

A kind of synchronous synergetic method of multi-section intelligent electronic device and multimedia play system

Technical field

The disclosure is a kind of synchronous synergetic method of multi-section intelligent electronic device and multimedia play system, this method and system For more accurately making multi-section intelligent terminal, intelligent electronic device cooperate, multimedia, synchronous shooting etc. is played simultaneously, is somebody's turn to do System and method for can be deployed in smart phone, PAD, smartwatch, smart television, intelligent sound box, digital camera etc. and have intelligence Can electronic characteristic need the field of multi-machine collaborative again, can be APP mode according to the deployment way of usage scenario its system can also To be the system function of certain intelligent electronic device.The technology has used wireless network, synchronous triggering technique, dual trigger mechanism, item Part triggering technique, sensor control technology, NFC technique and such as speech recognition of part artificial intelligence technology etc..

Background technique

Intelligent electronic device is often referred to containing CPU, the electronic equipment containing itself operating system, such as smart phone, intelligence are eventually End is exactly typical intelligent electronic device.Intelligent terminal or smart phone generally use monaural speaker, and loudspeaker function Rate is small, in relatively spacious or large volume place such as meeting-place or larger room, the volume of single portion's smart phone multimedia It exports small, and when multi-section is played simultaneously, audio can be increased by the way that the superposition of volume is played simultaneously, can also be played not with multi-section With sound channel promote audio, audio contains volume, surround, more D, Doby, the multimedia of 5.1 sound channels or even more multichannel, and lead to Technology, the method and system for crossing the disclosure then can use multi-section intelligent terminal, the smart electronics for having media playback capability are set It is standby, provisional louder volume can be constructed at any time, stereo or even circular, 3D, the experience effect of 5.1 even more sound channels.

And use method used by the disclosure, then intelligent electronic device can be allowed to cooperate, clapped as polyphaser is synchronous It takes the photograph, according to different shooting skills such as aperture time, synchronous synergetic shooting, image superposition is handled later, ultimately forms very body Test the photo or video of sense.

For intelligent sound box, when that can be played simultaneously, audio brings the experience sense more shaken than individual equipment, such as Around 2D or more D music, D or 2 D(is equivalent to using each speaker after the technology that is played simultaneously and is tieed up), then the solid of sound Feel it is stronger (existing market intelligent sound box usually one or two loudspeaker, it is poorer than acoustics, but be easy can obtain at any time, so can To form more preferably audio environment with intelligent sound with this system).For multimedia, it is most difficult to the audio realized, because of people Video is much higher than to the identification of audio.So solving the problems, such as audio sync, audio video synchronization playback problem is then easier to solve.

Synchronous music is played, synchronous effect is that have technology limiting range, in field of acoustics, there is Haas effect, right For ordinary people, Haas effect value is about at 30 milliseconds, that is to say, that non-professional the general public, when two or more intelligence The sound step-out that terminal or electronic equipment play out is more than 30 milliseconds, and the general public can recognize step-out, and for music speciality side The personnel in face, about step-out are more than 10 milliseconds, so that it may recognize step-out.So for two-channel or multichannel layout in difference When terminal or electronic equipment play, the requirement to the time is with regard to especially sensitive, even and if it is understood that intelligent terminal is wireless in Wifi Under LAN environment, UDP server sends out data in a manner of broadcast/group broadcast, and UDP client receives data and identifies data Time plus the multi-level processing such as network, network interface card, system after, identify the time of contents of packet usually at 10-20 milliseconds Nearby (condition is network state ideal, when clog-free), and with TCP then due to agreement, causes delay bigger, later with The sensitivity of the performance boost of intelligent electronic device, radio broadcasting and sensor all can be promoted significantly, and being delayed and shake can be into One step is reduced.

So patent of invention ZL201510197467.4 " a kind of method that multi-section smart phone synchronized multimedia plays ", is used The synchronous triggering technique of sensor, after every cell phone system for participating in playing postpones by dynamic monitoring, using sensitive, stable The synchronous triggering of sensor is realized and is played simultaneously every terminal is adjusted according to the delay of other participation terminals dynamic again after.The party Method jumps out this professional domain personnel completely and passes through formula and prejudice with the synchronous technology of clock, to realize synchronization.And use clock same Logic is walked no matter from 3,4G or even ng network or the mode of NTP, the intelligent terminal that Multi-Machine Synchronous plays is participated in and is unable to reach The other clock synchronization of Millisecond, and from Haas effect, realization, which synchronizes total step-out deviation, must not be higher than 30ms, distribute to difference in multichannel When participation terminal, step-out deviation requirement is harsher, so once there is certain overseas major company's patent application based on network clock synchronization to solve Certainly cellphone multimedia is played simultaneously, but may be because that the not realizability of technology causes patent applicant oneself to abandon the patent Application.

It becomes a reality although ZL201510197467.4 makes multi-section intelligent terminal that multimedia be played simultaneously, its requirement has net Such as Wifi, 3G/4G/nG network communication needs server providing services Internet-based for network connection, allows each participation terminal Homologous music is carried above and below, is understood each terminal system to play instruction to broadcasting and is executed practical duration (terminal dynamic delay), and In the case of working as, the delay of this terminal is adjusted, is played simultaneously to be realized in synchronous sensor triggering.But for Network (when can not connecting Internet such as in mountain area climb the mountain, team rest play music) of the countryside without operator, the patent is just It cannot achieve the network that the data of each end equipment system delay are understood needed for synchronous triggering, so the disclosure combines ZL201510197467.4 further improves multi-section intelligent terminal and multimedia technology is played simultaneously according to different scenes, make its When without internet, remain to be played simultaneously.

In addition, the patent has no description for multichannel application, and the disclosure also needs to solve multiple sound channels and plays application, To promote more preferably effect, as either automatically or manually selected sound channel such as left and right sound channels or 5.1 sound channels to terminal according to terminal number Selection.

In addition, the disclosure combines the referenced patents, wireless network or network hotspot such as WIFI, WIFI heat are utilized in triggering Point is made up the defect of the possible insensitive or unstable sensor of intelligent terminal with dual trigger mechanism, makes up non-sensor triggering If speech recognition triggers, NFC is close to triggering, so that realization is more excellent, more extensively, more multifarious triggering mode and synchronous effect.Institute The technology of some sensors or artificial intelligence can be allowed to intervene, the participant that the multimedia synchronous that lets on plays has more bodies It tests, it is more to trigger mode and richer trigger condition.

Furthermore the system of the disclosure is also also possible to a kind of method that more smart machines are synchronous synergetic in itself, such as more Equipment shooting itself is not necessarily to source file, but needs synchronous triggering, dual trigger mechanism, condition triggering, wireless network broadcast touching The series techniques such as hair realize that intelligent electronic device is synchronous synergetic.

In the disclosure, intelligent electronic device, which should have, supports wireless network or hotspot function, is otherwise not easy to constitute this Disclosed technology realizes main points, unless intelligent electronic device all connects and composes Web broadcast element with wired cable.

Summary of the invention

In order to overcome the drawbacks of the prior art with the disclosure uses multiple technologies, to realize more intelligent electronic devices Synchronous synergetic to be such as played simultaneously, specific embodiment described in this specification, embodiment do not represent consistent with the disclosure All System and method fors, it is opposite its be only the method and system consistent with this disclosure as described in attachment letter of authorization.

Detailed description of the invention

With reference to the accompanying drawing, the disclosure is further illustrated.

Fig. 1 is the system framework and functions figure of scheme 1.

Fig. 2 is 2 terminal side system function module figure of scheme.

Fig. 3 is the system framework figure of scheme 2.

Fig. 4 is the system framework figure of integrated scheme 1 Yu scheme 2.

Fig. 5 is the synchronous synergetic method figure of multi-section intelligent electronic device.

In order to overcome Related Technical Issues, and allow intelligent terminal, smart phone user under more scenes even without mutual Under the scene of networking, realizes that multi-section terminal is synchronous synergetic and be such as played simultaneously multimedia, multiple terminals multichannel and more insensitive The condition that the synchronous triggering of sensor expands to more scenes is touched in the condition triggering that sensor and some artificial intelligence technologys participate in Hair mode.

Firstly, solving the problems, such as that multimedia synchronous broadcasting first has to solve multimedia file homology, that is, broadcast The multimedia file put is the file slice of the same mark of same file or same file, and for broadcasting in each terminal The part put is from same file.This is because: even if same song, causes this song bent due to recording, editing With other versions can not be the same, so when being played simultaneously, it should use source file.

It, can be with the segment played in caching without all arriving local, In until entire file when media play when playing It can be when local and be also possible in caching in memory or external memory.

So being directed to source file, it can be any body and exist, it can be by the media file of each terminal plays.It should File can be document form, can also be Streaming Media form can also be strange land document form be also possible to file slice again be with Upper various forms combination occurs.The disclosure is emphasized using source file, but is used as using which kind of mode, is all such as the disclosure A kind of specific embodiment or embodiment described in claims.

The homologous solution of multimedia file: the multimedia file of same head content is due to performance, singer, producer And the difference of each link such as recording, there are larger differences for the multimedia file for the same content different editions for causing different user to use It is different.The method for solving the problems, such as this is the multimedia file that determination will play, and makes the intelligent terminal to be played simultaneously or electricity Sub- equipment obtains the multimedia file.Due to existing Bluetooth technology, when to more intelligent terminals and more multimedia file transmissions, transmission Efficiency speed is too low, thus will using external network and server (the non-physical server of the server of the disclosure but filled clothes Be engaged in functional software service module its can be also possible to the service on empty machine on the physical server).

There are two types of operating modes for external server.

The first mode: by the multimedia text of the promoter being played simultaneously and participant's selection in oneself smart phone Part uploads to the server, if containing multiple files, need to set playing sequence (or according to default sequence such as load sequence or Person sorts according to sequence logic automatically), the participation end being played simultaneously is participated in the server downloading multimedia file and is broadcast Sequence is put forward, other any agreements that the mode of upper transmitting file can be used for uploading, tool.

Second of mode: providing multimedia file by external server, and the promoter being played simultaneously selects multimedia file, And playing sequence (default can sort according to selecting sequence or sort automatically according to sequence logic) is set, all participants are at this Server downloading/buffer multimedia file and playing sequence, the mode of downloading can be any agreement for downloading, tool, The mode of caching can use the agreement of any Streaming Media, the agreement of file stream.

But in no external network and server, the processing of multimedia source file just needs new means, this public affairs In opening, for source file service, the APP or intelligent terminal system for having synchronous playing function on intelligent terminal of use In included service, increase file-sharing service function.

Below with two specific examples come supporting paper shared service function:

FTP is a very common Internet protocol, is used for transmission file.Assuming that participating in synchronizing now with 3 intelligent terminals It plays (can of course be more multi-section), and there is no mobile phone wireless (3G, 4G or even NG) signal in mountain.So needing wherein one Portion intelligent terminal A opens hot spot function, and other two intelligent terminals B, C access the hot spot.

Wherein, the function that the support of band is played simultaneously on the APP or intelligent terminal system of the synchronous playing function in terminal System needs:

1, have ftp server function, secondly also have ftp client function；

2, by connecting the hot spot of A mobile phone, B and C has actually been associated in the online of a Wi-Fi hotspot, and in a broadcast domain In；

3, any terminal user of A, B, C selects shared multimedia file, such as certain song, after selection, this document be replicated or Other two sides are given by Wi-Fi hotspot Web broadcast in the path for moving on to ftp server default, if the user of C terminal selects " as boundless as the sea and the sky "；The then APP or intelligent terminal of A and the support synchronous playing function in B terminal included synchronous playing function System just will receive the data of C terminal broadcast, contain IP address, the parameter when FTP such as FTP service and file work；

4, A, B terminal system are supported according to the broadcasting packet received with the APP or intelligent terminal that support playing function are included The system of synchronous playing function downloads file according to message with ftp client automatically.Source file is realized when completing downloading After synchronizing, APP or system inform that user and system can enter next-step operation.

Certainly it can also be with the mode of Web server for file-sharing and transmission:

1, it supports to have Web server function on the APP or intelligent terminal system of synchronous playing function；

2, by connecting the hot spot of A mobile phone, B and C has actually been associated in the online of a Wi-Fi hotspot, and in a broadcast domain In；

3, any terminal user of A, B, C selects shared multimedia file, and such as certain song, after selection, this document can be used Web protocol is accessed；

4, after select file, by the hot spot, other sides are broadcast to, other roots are according to the message received, from the Web service Automatic downloading file.

It can be seen that the service that APP or intelligent terminal carry from above-mentioned two simplest example, in no internet When, it can use the networking of hotspot mode, and the service function that the end APP or intelligent terminal are included, require existing file clothes Business device end function, also has client functionality, according to message, downloads source file automatically.

Other than realizing that file synchronization is shared with FTP, this file service of WEB server, stream caching can also be used Mode, as the common technological means of internet VOD, piecemeal caching is played, and when realizing that source file is shared, in fact skill Art means are not unique, have many general or non-universal means, are substantially in the disclosure such as in APP with database mode Or the included module for supporting synchronous playing function of intelligent terminal has selected the multimedia file that will be played simultaneously, other terminal roots According to the broadcast of the terminal, according to rendezvous protocol and service, the multimedia file is synchronized to each terminal local.And it is synchronized to each terminal Local file can be complete file, is also possible to file slice and is also possible to stream caching, it is achieved that shared or file The technology of synchronous service can be varied, does not limit in the disclosure but the disclosure needs a form of file synchronization clothes Business, is synchronized to the machine for the media file of each terminals share with some form.

Certainly it can select in 3 terminal users of A, B, C by the file of shared or synchronous homologous media, these texts Part is obtained by each terminal rendezvous protocol and is used to be played simultaneously.And substantially in the disclosure for above-mentioned file service Belong to source file synchronous service, either FTP or Web service or other types service, essence is all to complete homologous matchmaker Body file synchronization services.

Different from referenced patents above, which needs external network, server, carries out file loading or downloading, is used for The features such as group are established, and when there is no Internet service, under this feature of hot spot, the participant in broadcast domain can be group Group membership, naturally it is also possible to member is arranged by message again, about grouping, but usually when one hot spot broadcast domain in default one Group sets multigroup group in fixed-site except multigroup is non-specifically set such as in Wifi equipment.

In hot spot, other than broadcast, be referred to as multicast multicast there are also a kind of special agreement, in hot spot or Person WiFi perhaps in similar packet switch wireless network the disclosure can with broadcast or multicast or broadcast plus multicast mode come Realize the various information transmitting such as triggering information to participant, each terminal delayed data, file location information etc..

And relative to broadcast, multicast has its feature, please be detailed in related RFC technical standard file.

But for being broadcast if there is two groups of people or more group people synchronizes in a hot spot or WIFi or wireless packet network It puts, then just has certain limitation using broadcast, use multicast at this time, then it is natural to divide group according to multicast " channel ", this It is created in system from referenced patents group different, but group is divided according to multicast address or " channel ".

Above content is mainly taught how in the case where no internet, carries out file-sharing or file synchronization clothes Business, tells about the calculating of the system delay of each terminal below.

It is understood that the operating system of intelligent terminal or intelligent electronic device is divided into macro kernel and micro-kernel system, no matter It is macro or micro-, result in the efficiency and the resource (CPU, interior external memory, the resource etc. that front and back program is eaten up) of machine at that time of system Correlation, so just playing a multimedia file such as music, being played to broadcasting since being played to instruction terminates, the same intelligence For energy terminal such as mobile phone in different periods, the duration occupied to system is dynamic change, for example instruction is played to actual play, short When have 30ms, 60ms when normal, and 100 even 200ms can be can exceed that by encountering certain situations, that is, user gives After playing program play instruction, there is the delay of dozens to hundreds of millisecond just to execute broadcasting in fact.And if we with touch screen When click, clicks system identification and click execution and start to play this system delay to be dynamic；Secondly, when true broadcasting Long, we can obtain the actual length (millisecond counting) of music by reading the attribute of multimedia file, this can be in APP Or media file properties are read with program in mobile phone function can accomplish, but be actually played from start to broadcasting and terminate Afterwards, media file physical length and true playing duration also have deviation, but fortunately no as that after sign on is a wide range of The duration of drift.So, in some period, not needing especially largely to consume for an intelligent terminal or intelligent electronic device It is very close with the true duration of media after usually broadcasting media really start when computing resource, it can tolerate, meet Kazakhstan Within the scope of this effect value.

So the broadcasting by monitoring to media file, is performed to instruction since user instruction and finishes, it is whole The time supervision in period can generate historical data, and the deviation of the historical data and little, but the spy for caused by particular time Other error amount has good rejecting to act on, so supporting the APP of synchronous playing function or terminal system to carry function, to matchmaker After the data tracking of relative populations is done in body broadcasting, by the way of going interference, delay variation tune in most cases can be allowed It is whole in tolerable range.For example long history value is to be delayed near 60ms, and occur the delay of 156ms at this time, it is necessary to Value after rejecting the value and further looking at, rather than history advises data near 60ms, occurs a 156ms suddenly and just recognizes It is current value for the value.So in intelligent terminal multimedia synchronous, there are the small probability step loss condition of a Statistics category, this The reason is that when as with micro-kernel, any starting time twice has larger as caused by intelligent terminal software and hardware system itself The time difference and macro kernel is relatively quite a lot of, but intelligent terminal is usually using the CPU of micro- power consumption, even if so macro kernel, deviation also compare It is larger.And dynamic grasps its instruction at that time and is played to true broadcasting, instruction, which is played to broadcasting, to be terminated, to calculating each terminal dynamic Adjustment delay is extremely important.

It assume that at the first time be play instruction time T1；Second time was that true play time T2(is exactly media text Part starts to be played the time started), the third time is to play end time T3, and the media file time is Tm.So passing through this 4 Time, so that it may obtain after each play instruction provides to really playing each stage duration, it will also be appreciated that inclined when each Timely inclined range, so as to adjust delay for the feature and other terminals that play to realize that reaching substantial synchronization plays.

Intelligent terminal such as APP are mounted in the system of the disclosure or when in function system, pass through clock sources and instruction In conjunction with the temporal characteristics for each broadcasting media that can be obtained by the terminal, just obtained more actually by a certain number of accumulation Delayed scope.

In addition, sensor-triggered duration is also an important link, as in referenced patents, acceleration transducer is from outer Boundary is triggered to response triggering variation, usually only several several or more than 20 in a millisecond to 10, but in fact in different vendor Sensor and different intelligent terminal processing on, cause response also variant, but relative to other sensors, susceptibility with The accuracy of time feedbacking is very good, can reach the delay jitter requirement of synchronous triggering in most cases.

For example close to range sensor, belong to insensitive also unstable sensor (on the special smart phone of intelligent terminal Usually this feature), after covering leaves, need a few tens of milliseconds to 200 milliseconds reaction time and also each time with than Relatively large deviation.

The Mike of intelligent terminal is rich for another example, when triggering when to external voice such as decibel being more than 60 audio response, is Response time deviation of uniting is bigger, even if the same equipment.

It is understood that intelligent terminal has many sensors, if these sensors are all stable, sensitive, it is ok certainly For the synchronization triggering technique trigger sensor of such as referenced patents, so that multimedia be played simultaneously, for example have 10 on a desk Portion's mobile phone, present someone, which cries out, " to be started to broadcast " (such as sound decibel is more than 60 decibels), each terminal " dynamic delay and " after processing, works as synchronization It plays.

When the photosensitive sensors for such as using intelligent terminal, after turning on light suddenly in room, plurality of mobile phones can be synchronized It plays (after certain dynamic delay processing)；

Plurality of mobile phones is said using such as speech recognition, someone after artificial intelligence process for another example " broadcasting " as boundless as the sea and the sky " ", then more Homologous " as boundless as the sea and the sky " for being synchronized to this terminal can be played simultaneously in portion's mobile phone.Synchronizing for more intelligent terminals is broadcast in fact It puts differently trigger under many scenes and be triggered containing sensor-triggered and condition, and should not be limited to referenced patents 1 two features 1 need network and network server；2, sensor and the sensor of stabilization, sensitivity.

It in the disclosure, in order to solve this problem, is exactly to utilize wireless network or wireless using a new means The hot spot of net such as WiFi or Wi-Fi hotspot not only can realize that media file is homologous when no net is without Service Source and (pass through same source document Part synchronous service), but also utilize it as trigger means.

Such as not sensitive enough, the intelligent mobile phone sensor being not sufficiently stable such as Mike is rich, it is assumed that when setting trigger value as 50 points Bei Shi, that is, multiple mobile phones, when listening to external sound greater than 50 decibels, triggering plays music (certainly at dynamic delay Played after reason), due to the rich dependence operation system function of Mike, so reaction reference time delay is possible to be more than what Haas effect required Duration sets up wireless local area in Wifi or hot spot so being generally difficult to the sensor as synchronous triggering, but in the disclosure When net, multi-section terminal listens to 50 decibels because reaction speed is inconsistent greater than 50 decibels of sound listening at first The terminal of the sound issues radio broadcasting (broadcast or multicast) and starts simultaneously at broadcasting (needing dynamic delay to adjust certainly), accuses simultaneously Know other all terminals, then (described previously, at Wifi, system notifies network interface card to issue broadcast packet extremely under Wireless Network delay Other terminals receive broadcast packet, and parse the content time about 10-20ms in packet), other terminals are notified, if other participations Terminal there are no by the external sounds trigger more than 50 decibels, then is completed to trigger by wireless network broadcast packet at this time, and if Through being triggered by decibel (sound), then the terminal is not further processed the broadcast packet.That is any participation is played simultaneously Terminal, if not monitoring that volume triggering (is some given threshold for listening to external volume and being greater than sensor in fact also Such as 50 decibels) but be equally used for triggering if being connected to the trigger packet of network.So in this case, Web broadcast triggering pair Insensitive, unstable sensor has done good supplement, but in fact, sensor is usually all very sensitive, problem went out at intelligent end End or electronic device system handle its monitoring and triggering.So using this touching to make up such case Hair mechanism.

In fact above-mentioned is exactly dual trigger mechanism, Web broadcast or the triggering of multicast packets combination sensor threshold value, that is first accorded with Trigger condition is closed, is just executed according to the subsequent logic of condition, that is, the APP or terminal operating system function mould that are played simultaneously The synchronization triggering part of block is had ready conditions triggering and one of any triggering of Web broadcast triggering, and one is to receive triggering broadcast packet touching Hair, the other is sensor threshold values triggers, using dual trigger mechanism be allow that triggering faster start to execute lower step play from And to realize more accurate synchronous (also dynamic delay being needed to handle before playing certainly).

On intelligent terminal, can have with the sensor that this technology is realized many such as magnetic sensor, gyroscope etc..I.e. It is acceleration transducer, dual trigger mechanism can also be used, the acceleration transducer of such different vendor's different quality is touching When hair, can also make up that sensor and system ultimately cause with the form of broadcast packet or multicast packets when it is inclined.

Under dual trigger mechanism, having several may be exactly that end sensor has reached trigger value work, then just receive Broadcast or multicast trigger packet walk work such as dynamic delay in this case, under sensor-triggered and handle；A kind of situation is terminal Trigger value has not been reached yet in sensor, just receives broadcast or multicast trigger packet, and in this case, broadcast or multicast triggering is lower to walk work Make；It is to receive simultaneously there are also a kind of situation, both sides can trigger or one triggering, tangible program are all very convenient when handling.

Under this dual trigger mechanism, with regard to this occur for the synchronous triggering mode of novel two intelligent terminals of one kind such as two ends End crashes, and when using sensor such as acceleration transducer, as long as having wherein, any end trigger value is more than threshold value, issues wide Broadcast or multicast packets, and if other end sensor is more than threshold values not yet, triggered playing by Web broadcast, so in Fancy Match Its precision of this link is more than that only (acceleration transducer can use tri- sides X, Y, Z in this example to sensor-triggered mode To acceleration value square be added again respectively and open radical sign after summation and seek its vector value, this is that vector is sought in the variation of acceleration transducer value Formula, that is, the big Mr. Yu's value of vector value is for example 30).

Under dual trigger mechanism, NFC can be used for condition triggering, start NFC function in APP or system function, Two intelligent terminal Close approachs have the information of NFC device to inform that is, by radio broadcasting close to rear any terminal discovery The other end being played simultaneously is participated in, without waiting until that NFC completion is shaken hands or the other end is it has also been found that opposite equip..It is understood that NFC establishes the time of communication far more than Haas effect range, so being triggered using NFC and being substantially that radio broadcasting/multicast is real The broadcasting of existing media player.This dual trigger mechanism is no longer limited to sensor, but certain of terminal or electronic equipment Function reaches certain condition (can be the triggering of sound, light, electricity, magnetic, displacement, position, distance etc. condition), reaches condition and plays (to add dynamic delay certainly), condition issue broadcast or multicast trigger packet after meeting, and the least way that is delayed or touch at first The mode of hair triggers lower step work, in this way better than only sensor or condition triggering, triggers also superior to only broadcast or multicast, after all Many sensors or condition triggering are less than 10ms or 20ms, if acceleration transducer is usually with regard to several millisecond delays, gyroscope 1/1000th milliseconds are accurate to, GPS location triggering can be 10 meters of ranges, but speed is slower, such as start to synchronize to certain position range Playing song, (such as arrangement for bicycle rider advertisement begins to that a head is played simultaneously to be the position to a predetermined location (condition) The song of setting rides to reach certain demonstration effect such as 50 drivers and be lined up, rides and play national anthem to Tian An-men, and rides Row to Jianguomen starts to play Beijing ... Beijing, can also be played simultaneously according to position in a word, this belongs to condition triggering and broadcasts Put), furthermore under speech identifying function such as several terminals, as someone says " being played simultaneously " (assuming that being played simultaneously is that triggering plays The keyword of device), APP is played simultaneously in terminal or the synchronous playing system identification of function of terminal is inputted and identified to the voice It is " be played simultaneously ", but it is understood that speech recognition is time to change very big function with system capability, it is difficult to synchronize Play, but after combining wireless network broadcast and speech recognition, identify keyword at first " be played simultaneously " terminal to it Its terminal sends out broadcast or multicast, and other unidentified terminals out are triggered broadcasting (to add dynamic delay certainly) naturally.To allow Speech recognition can also be used as triggering mode, meets the condition and triggers；It is exactly that trigger condition is so being triggered in so-called condition Can monitor, can conditioning means or technology, the signals such as activation threshold value and sound, light, electricity, magnetics containing sensor.

So above-mentioned example has not only used sensor, and communication function such as NFC or AI speech identifying function is used Realize triggering that the synchronized multimedia of multi-section intelligent terminal plays, and previous this kind of condition triggering mode was difficult to synchronize, as upper When stating NFC, several people's smart phones as a result synchronize close to together (condition triggering) and start to play a song but also be 5.1 Sound channel (being substantially that dual trigger mechanism adds dynamic delay to handle), this experience are undoubtedly one kind for the mobile phone user of today Experience free from worldly cares.

So after technically dual trigger mechanism is handled for Web broadcast and referenced patents, sensor is not only allowed, Er Qierang The function of non-sensor may be used to condition triggering, conditional synchronization triggering.

Although sensitive stable triggering mode is realized prior to radio broadcasting packet to be touched when radio broadcasting is as trigger means Hair, but once encountering susceptibility not is very outstanding triggering mode and system, then can make up its defect to a certain extent, and Under the very poor system of obvious susceptibility today, although triggering can be realized by radio broadcasting and that susceptibility is utilized is bad System, but have the novel or innovative synchronization triggering mode such as mobile phone Fancy Match in use and especially (its behind is in fact such as Described above, one is collisions, and acceleration transducer to be caused to be more than threshold triggers, and one is the triggerings of NFC discovery near-field devices simultaneously Dual trigger mechanism is used again), so giving the experience effect of user's bring novelty in conjunction with after.As two mobile phones toward one close to, Play its same song, left side plays L channel music, and right side plays right channel music, no matter volume or music effect it is big The big effect better than singlehanded machine or intelligent terminal.

So when realizing broadcast, the system in APP or intelligent terminal being played simultaneously, after function or APP operation Need to increase in APP UDP service function and UDP client's function, it is also UDP client that each APP or terminal, which are UDP server, End, terminal each in this way can send out broadcast or multicast, and each terminal can also receive the broadcast or multicast of other sides, only take Business end and client, which will be set, does not generate network conflict with other ends.

Through the above, in the disclosure, synchronous triggering technique is no longer limited to dependent on sensor, but any new The condition of grain husk innovation triggers mode.So-called condition triggers mode, and exactly set triggering reaches condition, and condition can be sound Any system such as amount, magnetic field, sentence, sound spectrum, the frequency spectrum of light, position, distance support can condition monitoring mode (sound, light, Electricity, magnetic, physical location, height etc.).

Solving source file and triggering mode and for non-sensitive, stability sensor and non-sensor function using double Trigger mechanism after condition triggering mode, greatly expands the basis of synchronous triggering technique with form.Acoustics, optics, electricity can be used Learn, magnetic field is learned and communication, speech recognition etc. are all monitors, can the means of conditioning can be used as synchronous condition and trigger mode, With dual trigger mechanism, keep the triggering form being played simultaneously varied, so that the user being played simultaneously can experience It is various forms of to be played simultaneously.

For example two be played simultaneously participant with smartwatch, there is APP, two people's intelligence hands on smartwatch Table detects other side close to smartwatch, NFC, wireless to issue broadcast (if speed all exists NFC each other in future probes certainly In 10ms, then self delay is better than radio broadcasting, and natural Web broadcast triggering is exactly a kind of supplement, and today, Web broadcast was better than NFC detection identification, so using dual trigger), then the smart phone with smartwatch interconnection starts that music is played simultaneously, this is obviously It is interactive model under the music line that do not seen today.

In referenced patents, the delay of each terminal is characterized in sending background server by network, each terminal keep with The intercommunication of server and obtain the delay information of participant, each terminal calculates the delay of oneself according to the delay of all participants And when playing plus the specific delay value of the adjustment, because delay is all non-fixed value, the value of dynamic change, so being a dynamic The delay of state adjustment.

And in the case where no network, if multiple terminals does not know that delay is to cannot achieve to be played simultaneously each other, Wu Fadong State adjustment delay, so by hot spot, local wifi etc., each terminal is added hot spot or wifi, and each terminal is by the delay of oneself Information broadcast or multicast message issue, it is ensured that other each terminals receive, so narration terminal is both UDP server above It is UDP client (APP or terminal have UDP server-side function also to have client functionality).Each terminal receives the delay of different terminals After feature, it is delayed according to oneself, adjustment.If A, tri- terminals of B, C participate in, instruction to instruction execution delay assumes that A is 50ms, B are 30ms, and D is 120ms, then A increases 70ms delay and plays, and B increases 90ms delay and plays, and D does not have to then change, touching After hair plus 0 millisecond time-delay plays.After then each terminal is synchronized triggering, respectively increasing corresponding delay to start to play can play It is synchronous.And being actually delayed is to change, and in order to accurate, is delayed so to be adjusted according to the delay data dynamic of each equipment, and This process is inherently named delay process (all herein dynamic delay adjustment, dynamic delay processing, when being used on triggering When defining consistent content and function with delay process, it is substitutable for delay process), that is, each end is according to the delay number of oneself According to the data that participate in end, when calculating this collaboration, data of required delay, and on triggering according to the data delay, when Task such as media play or camera shooting thereafter is executed after the completion of delay process.

When actually calculating the delay of each end, it is in 40- that historical data, which can be used, and go the method such as history of deviation larger data 60ms excursions and probability space accounts for 80% near 50, such as the last results of measuring is 70ms, then this value can be thrown It abandons, but (70ms-50ms) * coefficient can be used, the result+50ms, computation delay may be 58ms, and 70ms deviation is really being broadcast When putting, it may have descended near 60ms, and 58ms is very close to 60ms.It can be big so being handled using necessary new probability formula Big allows offset close to possible true value, so dynamic processing is the good method that synchronous effect is promoted, and only with The method of historical data, relative quiescent, effect are worse than dynamic and handle.And a kind of delay process mode more deteriorated is exactly no history Data, this measuring and calculating value may be because other reasons when testing because rectifying a deviation without historical data, test caused to be delayed Be 160ms, but be 50ms when practical triggering, in this way effect all very step-outs anyway, thus delay calculate it is most handy static or Person's dynamic, the random value that had better not be rectified a deviation with no historical data.So each end that participates in is prolonged according to own system when delay process Shi Tezheng (such as above-mentioned three attribute delay) and other system delay features for participating in end, after delay process, under each end executes Step collaborative work such as multimedia.

At no internet, under the network environment established by intelligent terminal hot spot, various sensors or various synchronizations " such as mobile phone Fancy Match, plurality of mobile phones are close strong using NFC triggering, wave volume driving, magnetic field strength, light for triggering " playing method It spends, close to range sensor or even video camera, such as determines target object and enter monitoring region, utilize intelligent terminal in a word The function of perceiving external trigger, monitor triggering condition or more than setting threshold value (feature phrase of such as speech recognition, NFC discovery has other equipment, and the rich pickup decibel of Mike is more than 50 decibels, close to range sensor sense variation, changes of magnetic field superthreshold Value, light intensity superthreshold, temperature, humidity are more than certain threshold value etc.) dual trigger mechanism is used, each participation terminal is according to different ends End delay each delay process of feature is with triggering terminal multimedia player.

It is homologous that foregoing is directed media files, describes system delay feature later, synchronizes triggering technique, double later Trigger mechanism and the feature of condition triggering, above-mentioned is all the key technology explanation for realizing synchronous triggering.Such as adding in referenced patents Velocity sensor triggering is to trigger two different terminals using synchronous, and the disclosure greatly enriches possible triggering mode.

In addition, being also further illustrated to player function in the disclosure, player has to be selected from media file Play the function of specific sound channel.In general, a multimedia file such as music is made of left and right two sound channels, two tracks, broadcasting It when putting, plays simultaneously, but such as two terminals when more intelligent terminals are played simultaneously, due to generate better experience effect, just Needing one of terminal is L channel music, another terminal is right channel music, in this way when playing 2D around music, effect Fruit just becomes apparent from.This is than referenced patents better effect.

When for 3 terminals, L channel can be selected with one, one is selected right channel, and third selects left and right acoustic channels and stress, this Sample 2D annular adds intermediate volume enhancing, and 3 intelligent terminals form one group of stero set naturally, and volume effect increases Add, such as used to the aunt for jumping street dance, will not at least interfering ambient enviroment, (decibels of the volume of singlehanded machine are 80 decibels of left sides The right side, and the speaker of aunt is at 120 decibels), each aunt carries a mobile phone, and is played simultaneously, and sound is again little, that is, pacify the people and Can take exercise and has also lacked sound pollution, this be also the disclosure a beneficial outcomes (volume is superimposed with its power Superposition Formula, and It is not the calculated relationship of 1+1=2).

The requirement of development and people to experience in practice as technology increases, and the music and sound of 5.1 sound channels occurs Acoustic system, and for multiple terminals is played simultaneously, only media player has multichannel playing function, independent track selecting Playing function, the sound channel that selection is selected the location of when playing participant according to oneself broadcasting being played simultaneously, So the player of the disclosure supports multichannel playing function, and audio effect processing can be done according to multiple sound channels and such as becomes weight Sound is changed voice, Doby audio etc..

Future Media broadcasting must be multidimensional experience, so sound channel is the information of wherein sound, and various other experience function It can develop with technology and terminal function is diversified, it is inevitable also to keep up with, the music about mist is such as listened, intelligent terminal may be at certain The time point ejection " mist " of a broadcasting plays more D, various dimensions, such as 3D shadow casting technique to strengthen this experience to allow, Such as it is holographic.Furthermore some sound effect technologies can be used for playing such as bass, mega bass, Doby audio etc..

So the matchmaker for the system function for only supporting the APP being played simultaneously or terminal to have multimedia file, the disclosure Body player part has the expansible various sound effect functions of track selecting playing function, can choose specific sound channel, can also select Select certain several sound channel and all sound channels.

When being played simultaneously, have it is a kind of deterioration experience sense, deteriorate participant's sense of participation broadcasting means be exactly in multiple terminals Only one terminal, which has, is played simultaneously triggering key, after media file synchronization, clicks the key, the machine by radio broadcasting to its Its terminal sends play instruction.This usage mode can use such as hundreds of people to put certain song together on playground, give people certain sense Feel, usual advertising or certain publicity of team use, and this mode is exactly that dual trigger mechanism has been gone condition triggering in fact Embodiment afterwards has lacked condition triggering, and many scenes are without user's sense of participation and experience sense, and example as above, everybody is in quilt Dynamic waiting main equipment triggering.

Relative to Fancy Match, such as adept machine Fancy Match of two men and women in love, latter two right mobile phone defaults left and right acoustic channels It playing, this is kind of an experience effect, it is also compared by phase difference of the system to two sound after broadcasting or end time difference compares, Can calculate " have mutual affinity " index, and with single machine send out broadcasting instructions, it is clear that lack this experience sense, because other sides are One kind passively participates in and nothing is actively engaged in.

Under 3G, 4G, 5G, NG environment, if the disclosure equally also can be used in the intelligent terminal of same base station covering Middle radio broadcasting perhaps multicast rather than be only capable of using hotspot or local wireless, this is because under a certain base station Terminal, maximum probability belongs to same broadcast domain, then in the broadcast domain, broadcast usually can all be received by other terminals, so adopting With UDP server plus the mode of UDP terminal, base station is utilized but without using the server on internet.

And the intelligent terminal of service is provided for different operators, because belonging to different base stations, then due to cross operator IP shake is unpredictable, so technical controlling can not be done to TCP packet time delay itself, broadcast does not collapse broadcast domain, and multicast collapses domain delay And communication is uncontrollable.

It realizes sensor-triggered, needs to analyze the susceptibility of sensor with feature, as referenced patents add in use When velocity sensor, be using biggish trigger value because the time required to movement and triggering, space verified, And the synchronous triggering that the patent is only suitable for sensitive sensor realizes that synchronized multimedia plays.

Such as the response time of a handset touch panel, it is usually such as measured without external instrument, touch can not be known from click How many millisecond are needed on earth to system response, and if on the basis of acceleration transducer, after finger contact screen, terminal itself There is vibration, the two temporal characteristics are monitored by this, the opposite delay deviation with acceleration transducer of screen triggering can be calculated.

Similarly, with acceleration transducer, the rich delay deviation of Mike can also be measured, if hand claps intelligent terminal, when clapping machine There is vibration to have sound, the initial time comparison of two signals can be calculated into relative time delay.

Similarly, technical staff can measure the sensitivity of other sensors with one of sensitive accurately sensor The relative indicatrix of degree and stability determines which sensor can be used for synchronous triggering in this way, those are needed using dual trigger machine System could preferably synchronize triggering and play, and after using the disclosure, then it can be to the survey of this correlation time performance of sensor Examination calculates, and exact value could be obtained by requiring instrument generally for the other deviation of Millisecond, and pass through the reference of relative accuracy equipment, It then can achieve the time measuring and calculating of certain accuracy of instrument.

In referenced patents, the delay of sensor, in synchronous triggering, plays to Guan Chong multimedia synchronous with stability Such as larger than 50 decibels of sound when wanting, for example being triggered with volume, a terminal 30ms response, a terminal 80ms response, even if Play instruction described previously is grasped to the delay for really playing this section, but sensor delay is directly resulted in and can not be synchronized.So After the delay for grasping sensor, needing for sensor to be delayed also will be added in the whole delay that synchronous triggering plays, so that it is guaranteed that The synchronization of broadcasting, and dual trigger mechanism, but can making up the problem of causing by sensor, and sensitive sensor can make up The latency issue of Web broadcast triggering, so for triggering effect, it can only be more synchronous, and from performance, only program is known It is on earth that condition triggering or network-triggered work in certain terminal.

In an intelligent terminal, it should be noted that with the available reference sensor of some terminals, calculate other sensors or function Delay carry out system delay caused by alternative hardware or even including certain terminal software functions, such as certain cell phone manufacturer Mobile phone does audio processing unexpectedly in order to save hardware cost with software, and process needs hundreds of milliseconds, sound after causing audio to play Pleasure could release sound, compare hardware only several to 10 milliseconds, this terminal is encountered in synchronization process, is needed systematic Calculating is all added in the delay of each terminal each section, so synchronized multimedia broadcasting in multiple terminals is that an accurate system is synchronous, is needed The point considered is the delay of each link, and each intelligent terminal has oneself attribute and virtual condition when with system is changing, So obtain and inform other terminals in real time, dynamic adjustment delay is just extremely important, and obtain total system delay need from Links calculate, calculate, delay caused by being completed such as above-mentioned audio processing as software, after sound plays, need several milliseconds Just play out, it is clear that synchronizing is synchronization looking for music to go out sound, so in delay process, will also plus certain terminal this The time of a " audio software processing ", and usually ignore when hardware.

Since in multimedia synchronous broadcasting, people is higher than vision to the perception degree identification of audio, so in audio sync When, technical difficulty is much higher than visual synchronization, is able to achieve audio sync, and audio video synchronization broadcasting requires lower instead.

In the exploitation of future terminal, in the development of intelligent electronic device, holographic or stereoscopic projections technology necessarily becomes Bright spot, and intelligent terminal is typically due to the problem of volume is with projecting space, area, effect is possible and bad, but if multimachine is same When walking subregion projection, then effect more preferably, when such as playing music can project the image beated with sound wave, when multiple intelligent terminals, The projection subregion (can be by original projection subregion to each terminal processes) being each responsible for is defined in program, multimachine can be spliced into Compared with the project information of single machine greater room, because of following multimedia, it is not only simple as today and project information is inevitable It is multimedia component part or experience form, so multimachine divides projected area, similar single image today is on combination (screen is Spatial Coupling when being 2 dimensions and stereoscopic projections) is shown by multiple screens such as 4 screens.

The disclosure combines cited patent, is further promoted to Multimedia Synchronizing Technology, from can be used for synchronizing The range of the sensor of triggering, to the mode of synchronous triggering, synchronizing function when to no internet is realized, is played simultaneously to allow The people that are more suitable go on a journey today, the feature of activity.And although patent ZL201510197467.4 allows multiple terminals multimedia synchronous It becomes a reality, but excessively provides that group, media file synchronization service, each system is prolonged in group member dependent on internet and backstage When processing server.

So on the basis of ZL201510197467.4, the technical characterstic and feature enhanced in conjunction with the disclosure mentions significantly The effect of multiple terminals synchronized multimedia broadcasting is risen in achievable scene domain.And the range of intelligent terminal is not limited only to intelligent hand Machine, intelligent PAD, smartwatch, smart television are also possible to intelligent sound box or external (the wired or wireless) sound of smart machine Case, that is, containing CPU, the electronic equipment containing operating system be intelligent electronic device.

It is above-mentioned to describe each key technology point one by one, it is operated in the following, each technical point will be described in APP or intelligent terminal The implementation of part in system or included system function.

From system or the realization synchronized multimedia play-back technology angle of APP, it is divided to two big technical solutions, a kind of scheme is base In Internet(scheme 1), this scheme be characterized in by the server on backstage realizes " group ", " source file synchronous service ", " know each participation terminal parameter and inform each terminal ", " the synchronous triggering of dual trigger mechanism play ", and another scheme is (side Case 2) in no Internet, a terminal of participation inherently has broadcast/multicast server and client, passes through wireless network Or hot spot is realized " source file " by wireless network " notice other sides to know the delay parameter of oneself and obtain other by processing The synchronous triggering broadcasting of participant terminal delay parameter ", " dual trigger mechanism ".And in system or the product treatment of APP, usually again It is to combine two schemes, but the judgement of the system of APP or terminal be when cannot obtain Internet and background service, direct enabling APP or terminal " homologous multimedia file " service, such 1 association schemes 2 of scheme, only in Internet non-availability Starting.For intelligent terminal manufacturer, main business is to do terminal production, usually such as without the service offer by the backstage Internet " group The service of group ", " source file " and " delay data of participation terminal " and when, then may selection scheme 2, and Internet is serviced Quotient is the combination of scheme 1 and 2 to adapt to more scenes then.

Illustrate the system of the disclosure with legend below.

Wherein Fig. 1 is that the system framework of scheme 1 and functions figure (are suitble to internet and local wireless network in scheme 1 There is scene).

S100 is server-side, wherein containing three important subfunctions, S101 is group service module, and S102 is source file Synchronous service module and S103 terminal parameter advertisement service module.

S200 is terminal side functional module, it contains S200A and S200N in Fig. 1, and A represents A terminal, and N represents N terminal S200 GC group connector, mean 2 to the portion N terminal.Terminal side module contains S201 to S206 in scheme 1, is S201 system respectively System delay computing module, S202 Web broadcast/group wave server end module, S203 Web broadcast/multicast client end module, S204 Synchronous trigger module, S205 media player module, S206 are source file synchronization module；Each terminal is by S300 The network of Internet or similar Internet network attribute obtains the service of S100 offer (assuming that an Intranet is only to this Network users provide a specific embodiment of synchronous service and the disclosure, and Intranet has all technology categories of Internet Property but only have a service object and dimensional discrepancy), the clothes that wherein terminal passes through the S100 on wireless network acquisition Internet Business, wireless network contain and are not limited only to WiFi, 2G to nG, data relay satellite communication network or substitution Wifi, the new types of data of nG The wireless network of packet switch.

So the service that terminal S200 obtain server-side S100 by the wireless Internet of S300 can be summarized as.

S101 is group service module, which establishes group according to the request of terminal user, can be invited by group, Addition, the operation of management group member such as deletes at refusal, and can carry out the shared of multimedia source file in group and will The operation of playing sequence when synchronous file addition, selection operation and multiple files.Operation object can be group master can also To be the member in group.Addition such as group members select the multimedia file oneself liked such as song, and file can come from end End can be from the song of the listed files such as library of media file service.

S102 is source file synchronous service module, the slave terminal which adds the file selected or participant The file automatic synchronization come is to each participation terminal, and when plurality of source file, can edit playing sequence list can also be with Form playlist and automatic synchronization to each participation terminal according to default sequence (into the terminal in group).

Each terminal that group is added, needs will affect the parameter being played simultaneously, delay when such as terminal itself media play Parameter, the parameter of selected sensor are sent to S103 terminal parameter advertisement service module, which can lead to terminal parameter Know each participation terminal or itself just according to the data of received each terminal, sent at the terminal dynamic delay to specific terminal The occurrence (being computational resource allocation problem as which kind of mode to have no essence difference using) of reason.The module have it is offline, On-line water flushing function, after terminal exits APP or after having closed the synchronous playing function of intelligent terminal system, the data of the terminal It is removed in total parameter list, to prevent influencing to be played simultaneously.

S100 be usually placed in server or server farm or empty machine in, the service of S101 to S103 is provided.

S300 is wireless Internet or certain network such as Intranet(of similar Internet is limited as described above Range limits the service of participant but same alike result)

S200 is terminal, and S200A and S200N respectively refer to A terminal to N terminal, represent the multiple terminals for participating in being played simultaneously, terminal In the computing module of system delay containing S201, which is issued to instruction execution from instruction according to each instruction needed for being played simultaneously The system each stage such as start, complete to multimedia is time-consuming, more accurate method be in local terminal history of forming data, with Historical data is to rely on, and filters out possible noise data (from the biggish data of datum drift) with algorithm and forms benchmark and be at that time The measured data (each time obtained by such as of short duration media play) of system, in conjunction with historical data and optimal algorithm, provides S103 Local terminal delay characteristic.

S202 and S203 is substantially broadcast/group broadcast transceiver module, which is to use dual trigger mechanism in Fig. 1 scheme, Using wireless networks such as WiFi, broadcast or multicast is issued in same broadcast domain.In multiple broadcast domains, although also may be implemented Multicast, but Multicast Routing or relaying duration are difficult to determine, and unless the extremely low 10ms rank of system delay, otherwise unsuitable synchronize is broadcast It puts.Wherein S202 is used to issue the network-triggered packet of broadcast such as dual trigger mechanism, and the information of synchronous documents, which waits, declares everybody Information, and S203 be monitor broadcast or multicast port information, and parse broadcast packet whether be dual trigger mechanism trigger packet or The declaration information that the other ends of person are come.

S204 is synchronous trigger module, which has a variety of triggering modes such as mode sensor, NFC mode, and voice is known Other mode, belongs to condition triggering mode in a word, and the various functions for the monitoring that satisfies the requirements simultaneously trigger item according to selected mode monitoring Part triggers media player module after trigger condition meets with dual trigger mechanism, before triggered multimedia playing function module, In addition the dynamic delay that the machine obtained from S103 should add or the delay parameter for obtaining other ends from S103, itself calculate delay Parameter, with synchronization.It is in Fig. 1, other than treatment conditions triggering (sensor-triggered, function trigger such as NFC, speech recognition) It also receives the triggering information that S203 is received and is triggered according to priority logic, when such as intensity of sound triggering, two terminal of A, B, B terminal is also Do not reach the condition of triggering but have received the trigger packet that S203 comes, then S204 equally adds dynamic delay to trigger S205 media play Device module.

S205 is media player module, which plays multimedia file, and can be selected according to user, and selection is not Same sound channel or different play area (especially in the following stereoscopic projections) module when being played simultaneously, are receiving It is executed after the triggering of S204, and in asynchronous broadcasting, broadcasting can be completed in user interface control.

In Fig. 1, if 200A terminal takes the lead in monitoring the conditioned signal that sensor such as Mike is rich, then overseas broadcast and add dynamic After state delay process trigger media renderer plays source file, S200N terminal have not been reached yet its monitoring conditioned signal or Person has monitored that then terminal S200N is executed in S204 step plus dynamic is prolonged but without broadcast triggering is had received when identifying When after triggering S205 play.

S206 is source file synchronization module, and the file of module synchronization S102, form can be extremely traditional FTP Deng, it is also possible to slice, manifold formula, is sliced buffered forms, source file or blocks of files or inside and outside needed for realizing local play The automatic synchronization of source file is realized in the file or blocks of files deposited, S206 and S102 cooperation.

The S400 of Fig. 2 is the functional block diagram (scheme 2 is suitble to without Internet scene such as Fig. 3) of 2 terminal of scheme, wherein S201 to S205 is identical as scheme 1, but S401 and S402 are the functions that scheme 2 needs to have, the reason is that, in scheme 2, respectively Terminal is the service provided without S100 in no Internet service state, and the terminal such as Fig. 3 participated in is to pass through local wireless Network or hotspot networking, so needing source file synchronous service, the multimedia file for exactly selecting any terminal is accused Know other terminals, and be synchronized to local by other participation terminals, synchronous form, which can be entire file and be also possible to file, cuts Piece, can be in memory or in external memory.So S401 can externally provide the information for the broadcast that service is also required to according to S202, It obtains the file information that other terminals to be synchronized and this terminal is synchronized by technological means, the form of source file is same as above.S401 Not only can to other participation terminal provide file synchronization services can also be synchronized from other terminal other terminals share go out it is homologous File.So S401 part function is the function such as automatic synchronization of S206 to locally relative to scheme 1.

S402 is terminal parameter advertisement service module, and the module is for obtaining the delay data of other termination and according to local terminal Dynamic delay when local terminal plays, while the online situation of module monitors other termination are calculated, online awareness is realized, as other users It is offline then delete terminal data in table.

In scheme 2, whole topological diagram is as shown in figure 3, terminal A to terminal N passes through S310 wireless network or wireless heat Point communication, so that multimedia synchronous playing function equally may be implemented when without Internet service.

As it was noted above, actually when implementing the disclosure, the function that can be superimposed using scheme 2 with scheme 3, i.e., integrally System is as shown in Figure 4: terminal has the function of S400 in Fig. 4, and server provides the service of S100, In on the internet When Internet provides service, use S400's when S300 cannot provide service using S102 the and S103 function of S100 S401, S402 function, when only existing wireless Internet or multi-section terminal belongs to different nG broadcast domains or local nothing When Wifi, wireless network (for example accessing existing WIFI) or hotspot (self-built or addition), touchings double in this way are established in local terminal Hair mechanism is achieved, and a variety of condition triggering modes may be implemented.

When not having S300 service such as in mountain area, no Internet service passes through starting when system identification is to without service S310 is as being added wireless or establishing hotspot and allow participation terminal addition is played simultaneously, the terminal S401 and S402 of S400 at this time Module work, realizes that the synchronization of source file and the delay feature data adver of each participation terminal or calculating or participant are online Perception.

The solution of Fig. 4 is the association schemes of scheme 1 Yu scheme 2, makes synchronized multimedia broadcasting can be in no internet Scene, thus when greatly improving with and without internet can " amusement " feature.When certain music service quotient is as service, When having internet, song library is exactly the media file library that can be synchronized to participation terminal at any time and access, and at no internet, respectively Terminal is all one of song library, sees that terminal user shares that first media file, the file selected enters file-sharing function.

It by S200 or S400 function with the synchronous playing function of intelligent terminal operation system, is deployed on intelligent terminal, just It realizes intelligent terminal and supports synchronized multimedia playing function；

If S200 or S400 are deployed on smart television, it is achieved that smart television supports synchronized multimedia to play；

And S200 or S400 are deployed on intelligent sound box, multiple intelligent sound boxes can support synchronized multimedia to play；

Just because of terminal all uses the calculating of delay performance and dynamic is handled, family has the equipment such as intelligence of intelligent terminal attribute Energy TV, intelligent sound box, so that it may the multimedia play system of local composition multichannel, when such as playing music, two intelligent sounds Case power-up depending on speaker can form multichannel play system.

Be worth one say is no matter S200 or S400 requires GUI HCI(human-computer interaction) it is operated, no matter GUI or key or voice recognition processing need the choosing of certain playing methods because needing to select multimedia file when synchronization process It selects.

That is worth mentioning can support broadcast domain when Bluetooth technology, when supporting the communication of fair speed, can also be used as A kind of implementation wireless mode of S310, only communication needs the data packet of regulation and bluetooth using bluetooth

, but be substantially also bluetooth server, the concept of Bluetooth terminal, that is, S202 and S203 be changed to bluetooth server end with Bluetooth users end.

It's also worth mentioning that after using this technology, if a certain equipment selection being played simultaneously is opened from some position Begin to play or be changed by the user the position, which informs other terminals position (such as music 50 by radio broadcasting Second, i.e., 50000 milliseconds long, it is now switched at 32000 milliseconds) players of all terminals for participating in being played simultaneously all points to At this, at this time by a radio broadcasting, each terminal is triggered, each terminal plays from this after adding respective dynamic delay, thus Synchronism switching play position is realized in being played simultaneously again.Its special case is exactly that other ends are playing, and one end participates in, and is to obtain at this time The broadcast (being usually the information for being played to how many milliseconds) of other end positions, then local terminal is delayed according to oneself processing, at delay It is just other time points (such as xxx milliseconds) for correcting broadcasting, to reach synchronous when playing after reason.

Summarize: by foregoing description, technical staff can implement multiple terminals out on intelligent terminal or intelligent electronic device Synchronized multimedia play system (for simplify summarize, using intelligent electronic device include intelligent terminal), 1, a kind of multi-section intelligence eventually End or intelligent electronic device synchronized multimedia play system, feature includes: multimedia source file is synchronous by source file Service module is synchronized to participation intelligent electronic device；Its system delay parameter is distributed to terminal parameter and led to by each intelligent electronic device Accuse service module；Each equipment that participates in passes through synchronous trigger module, using containing condition triggering mode, radio broadcasting/multicast triggering Dynamic delay after dual trigger mechanism, triggering triggers media player module.

2, a kind of multi-section intelligent electronic device multimedia synchronous play system based on wireless Internet, feature includes: By the server-side on INTERNET, group service is provided；The synchronous service of homologous multimedia file；Terminal parameter notice clothes Business；Multimedia source file is by 2. module of source file synchronous service with 2. steps to participation intelligent electronic device；Each equipment Its system delay parameter is distributed to terminal parameter advertisement service module；Each equipment that participates in passes through synchronous trigger module, using containing Condition triggers dynamic delay after mode, radio broadcasting/multicast triggering dual trigger mechanism, triggering, triggers media player module.

3, a kind of multi-section intelligent electronic device multimedia synchronous play system based on Local wireless network, feature packet Contain: by wireless network or hotspot, homologous multimedia file passes through the source file synchronous service module synchronization in terminal To participation intelligent electronic device；Its system delay parameter is distributed to terminal parameter advertisement service module by each intelligent electronic device； Each equipment that participates in passes through synchronous trigger module, using containing condition triggering mode, radio broadcasting/multicast triggering dual trigger mechanism, Dynamic delay after triggering triggers media player module.

Those skilled in the art, can be in intelligent terminal or intelligent electronic device, in the form of APP by this specification Or system function form realizes that multiple terminals/more intelligent electronic devices multimedia synchronous plays.

The multimedia of multi-section intelligent electronic device belongs to more equipment synchronized cooperative works, is broadcasting from technical spirit Put the music on angle, such as with two intelligent electronic devices when, the L channel of a broadcasting music, the right channel of a broadcasting music, Two intelligent electronic devices are substantially to have synchronously completed the broadcasting of a piece of music, but experience effect is greatly changed It is kind, no matter volume, stereo or 2D surrounding effect.Its " media play " substantially be exactly " execution synergistic function ", although It is seen in single device angle, is only a broadcasting left side or right channel music, but in terms of the entirety that two equipment works, the result is that passing through Dual trigger means/mechanism realizes that collaboration plays a piece of music.

This use pattern can make intelligent electronic device have the function of more cooperateing with and be just able to achieve in future, just as above State the broadcasting of multi-section intelligent electronic device synchronized multimedia.And eventually for middle and high end intelligent electronic device such as smart phone, intelligence End, camera have this work demand.

It such as takes pictures in application in intelligent terminal, it is desirable to which being exposed the time to a dynamic object was 2 seconds, and at 2 seconds The interior and time for exposure with 50ms claps the clear pictures of 3 different time points, then generates image superposition processing, is formed and taken the photograph at certain end Shadow special efficacy, such as sportsman's high jump are padded from starting to falling, and during this, the time for exposure is that 2 milliseconds of image is its fortune Dynamic rail mark, and the time for exposure is clear pictures during 3 of 50ms different time points are, after superposition stunt is handled in this way, with regard to shape There is the special effect cinematography photo clearly felt again at existing dynamic sense.

And for camera, a camera lens cannot accomplish can 2000 milliseconds exposure again can simultaneously 50ms exposure, so 2 cameras/shutter collaboration is needed, in addition, multiple smart phones such as 3 or more are not necessarily to professional equipment and wireless cable release, it can also To form the perspective view of subject.

When 2 cameras cooperate with, such as A01 in Fig. 5, each step of camera is grasped in progress system delay calculating first System time and mobility scale, statistical distribution (calculate when such as music and grasp instruction time of every step and actually occur The instruction of time is delayed), it additionally needs to obtain A02, participates in the delay parameter of system equipment, because as smart machine, in Time division mode equipment it is different be exactly to execute a same instruction, required time has system deviation, may specifically need 20ms, next time may be 50ms, so to realize synergistic function, it is necessary to which the system delay such as A01 for grasping oneself is grasped simultaneously The delay parameter of other cooperative devices such as A02, and communication channel can use network or wireless network.

After the delay for other terminals that the system delay that the machine for participating in shooting grasps oneself is cooperateed with participation, using double Trigger mechanism, wherein there is A031 radio broadcasting/multicast triggering and the triggering of A032 condition, A031 and A032 to describe above, one The condition triggering of a equipment just issues multicast and broadcast, the other participation cooperative devices of notification triggers to outside by A301 after meeting A05(is not certainly receiving triggering information of the A301 from other equipment).Such as in camera operation, speech recognition touching can be Hair, speech recognition triggering setting is such as " shooting ", assisted through A031 to other participations after the voice input that camera recognizes " shooting " Make equipment (A05) and issue broadcast or multicast, is handled through A033 dynamic delay to execute A04 and execute synergistic function simultaneously, but such as Fruit is identified not yet " " namely condition triggering does not trigger also, but receives other equipment hair for participating in collaboration from A031 for shooting Broadcast/group broadcast triggering out, then execute after A033 moreover execute A04.That is condition triggering can recognize that " condition not yet " when, if receiving radio broadcasting or the multicast of cooperative device sending, i.e., synergistic function is executed after trigger processing, such as one A shooting for being triggered 2000ms shutter, and 3 are clapped the other is 50ms shutter, in 2000ms, after the completion of shooting, pass through nothing Gauze network is transferred to initiating equipment or each other, then according to triggering when the mark that is formed form stunt photo to pass through algorithm (such as formation sequence number, service numbers, all labels that can identify synchronous triggering such as timestamp of tape identification), and it is previous necessary Two-shipper, two cable releases, a control one, camera of 2000ms is 50ms, and cable release is also needed to fix time setting, machine Time synchronization is in order to by just can be carried out the processing of the stunts such as image superposition after time-stamp Recognition.It and is hand touching when because shooting Hair, can not chronometer time, and post-processing needs processing software, otherwise needs special accurate control equipment control.And it uses upper Method is stated, then camera can be allowed to have multi-machine collaborative stunt shooting function (for image superposition, identification, the reality of the technologies such as comparison Existing, the community of some open sources has respective algorithms to realize program, and such as OPENCV, those skilled in the art can be in forefathers' open source base It is realized on plinth).Similarly, when three-dimensional stunt photo is clapped in the 120 degree of distributions of minimum 3 cameras, also use above-mentioned Fig. 5 method, i.e., it is logical It crosses synchronous triggering and the photograph taking of synergistic function such as all angles is executed after dynamic delay processing using dual trigger means/mechanism And with the algorithm of stitching algorithm and 3D modeling in system, so that it may which sync pulse jamming simultaneously forms 3D rendering in each machine.

In above-mentioned polyphaser or the collaboration of more intelligent terminal camera sync pulse jammings, each machine needs wireless or hotspot to connect Logical, triggering, communication need speech recognition technology triggering or other conditions triggering.Collaboration camera is participated in, each camera is touched synchronous Under the premise of hair, and the part of collaborative content the machine execution is respectively executed, left and right acoustic channels are not by when playing such as synchronous music With machine broadcasting.

So method shown in fig. 5 is a kind of method that more intelligent electronic devices are synchronous synergetic, practical this method is exactly such as Synchronized multimedia broadcasting, multi-machine collaborative shooting etc. need to trigger using synchronous, dual trigger machine under the scene of work of multi-machine collaborative System (condition triggering is triggered with wireless network broadcast/multicast), calculates and participates in the delay of cooperative device according to own system delay Parameter, executes synergistic function such as multimedia after delay process, video-photographic stunt technology, this method particularly suitable for sound, Shadow is played simultaneously, synchronizes stunt imaging.

For the above method when multimedia synchronous plays, needing a preposition job is exactly that source file and source file are same It walks on the intelligent electronic device for participating in collaboration, and when shooting, then without preposition work, but after executing synergistic function, have One is sent to photo files the process of image machine processing to be processed (such as superposition, splicing, 3D forming).Namely synchronous touching Hair is delayed according to own system and counts on triggering using containing condition triggering and radio broadcasting/multicast triggering dual trigger mechanism Calculate with the delay parameter of cooperative device, after delay process, shot according to the acquisition parameters of setting, the file of shooting is through wireless network It is transferred to processing terminal calculation processing.For example aperture time above is all that we commonly photograph acquisition parameters, certainly also Several parameters, these parameters such as exposure are all that cameraman sets according to demand, then when synchronous triggering shooting, according to these ginsengs Number, camera cooperate, then handle on handling machine according to serial algorithm again, complete stunt special efficacy.It is assisted in multimachine image Meanwhile condition triggering mode is also very much, if sensor threshold value trigger, speech recognition triggering etc. it is various meet preset condition after carry out Triggering.

In multimedia synchronous broadcast, dynamic delay processing is according to the delay parameter for participating in playback equipment and itself delay Parameter calculates the delay data of this collaboration, and according to the data delay, executes lower step association according to collaborative logic$$$$ after the completion of delay With work, as played, (processing of certain dynamic delay or dynamic delay adjustment are referred to as delay process, using being dynamically to embody When collaboration, which is all according to each end situation dynamic change), simplest example is with regard to 3 electronics of A, B, C as mentioned before Equipment, every equipment adjust oneself parameter according to maximum delay, and in photography, and shutter key, which is triggered to shutter and starts movement, to be arrived Shutter close is finished to image procossing, and the time of each process requires to grasp, to form stunt accurate, that effect is beautiful Effect, otherwise the motion profile fluctuation of 2000ms is that upwards, and the position of the accurate photo of 50ms and 2000ms shutter is not to On, then effect is just made a discount, and people is 33ms (or 30 frames/second) to the identification of video or image, so in order in this effect Under fruit requires, using Synergistic method described in Fig. 5, many existing equipments can be allowed to obtain the effect of super equipment level itself no matter Photography or media play.This multimachine superimposing technique can also be used in also can be more interesting when shooting the video, and is formed and is respectively required Special effects such as 3D dynamic video, the special efficacy that can be just done by professional system and peripheral hardware directly can be by conventional equipment or hand Machine is realized, consequently facilitating amusement and the life requirement of general population.

For the intelligent electronic device of today, carrying wireless network and popularize very much, wireless network is commonly used in online, And it is universal due to it, allow multi-machine collaborative, dual trigger mechanism is achieved, and because " condition triggering " can be using a variety of shapes The synchronous triggering of formula " ", so that experience sense can be surmounted in the past.

As previously mentioned, condition triggering contains sensor-triggered, triggers containing signals such as NFC, also this AI containing speech recognition Triggering, is also summarized, the triggering using certain conditional mechanism as triggering mode is all condition, such as satellite positioning as discussed above.

Method shown in above-mentioned Fig. 5 is very suitable to need the scene of high-precision more intelligent electronic devices collaboration, as sound, Shadow etc., and the technology and method of this paper enables normal domestic equipment to cooperate with and meets people's cognition and satisfied desired multimachine association Together.

In synchronous synergetic or multimedia, wireless network broadcast is also used as the publication of some synchronizing informations, than As equipment timing or not timing issue oneself collaboration progress such as media play current time, other each cooperative devices according to The time goes the time of adjustment the machine, so that each end more cooperates with, this way belongs to well known to those of ordinary skill in this field The group that music is just being played in plurality of mobile phones is added in technology, such as mobile phone, everybody synchronizes equal its that be not necessarily to stop Triggering, at this point, the new addition terminal is exactly to know that the play position of other machines (is generally basede on a machine pair by Web broadcast It is quasi-) because processing, which plays, needs the time, the broadcasting of the machine is the play position based on current other machines, in addition oneself System time feature, play some following position, it is just synchronous with other machines after broadcasting.

By the description to above system and method, those skilled in the art can realize more according to system and method Intelligent terminal is played simultaneously, and polyphaser collaboration or other functions of needing more smart electronics collaborations are realized, and because are used A variety of trigger mechanisms that AI is triggered are triggered to from synchronous sensor, the scene of triggering is caused to combine experience more preferably.Due to different machines The triggering of device condition executes when better than radio broadcasting triggering, synergy more preferably, and with intelligent electronic device, operating system Development, sensibility, the stability of condition triggering can be more preferable, and experience sense can be more preferably.It is noted that (dynamic in delay process State delay adjustment or dynamic delay processing), if it is the triggering that wireless network comes, can by its process time such as 10ms, as One of parameter participates in.It has been received as sensor triggers not yet but broadcasts triggering, then local terminal originally needs to add 40ms millisecond time-delay Adjustment subtracts meter network-triggered 10ms because receiving radio broadcasting about consumes 10 seconds, and such synchronous effect more preferably, subtracts as far as possible Small step-out value.So in delay process, calculating can be added, without being only limitted in the delay of any inclined step when causing The machine delay, cooperates with machine delay parameter, if the communication delay between collaboration machine is related to influencing to synchronize, can be included in.

Above system description in, using several functional modules be for the clearer realization for illustrating this system, but In actual implementation, several modules can integrate, and it is inessential according in figure or description in one by one program module or Person system module is realized；Although multiple modules may be integrally incorporated to together, when realization of function is to be by disclosure description System or method are realized, then are all a specific embodiments of the disclosure.

Claims (10)

1. a kind of multi-section intelligent terminal or intelligent electronic device synchronized multimedia play system, feature includes: multimedia is homologous File passes through source file synchronous service module synchronization to intelligent electronic device；Each intelligent electronic device is by its system delay parameter It is distributed to terminal parameter advertisement service module；Each equipment that participates in passes through synchronous trigger module, triggers using containing condition, radio broadcasting Or the dual trigger mechanism of multicast triggering, after triggering, delay process triggers media player module.

2. a kind of multi-section intelligent electronic device multimedia synchronous play system based on wireless Internet, feature includes: passing through Server-side on INTERNET, provides group service；The synchronous service of homologous multimedia file；Terminal parameter advertisement service；It is more Media source file is synchronized to participation intelligent electronic device by source file synchronous service；Each equipment is by its system delay parameter It is distributed to terminal parameter advertisement service module；Each equipment that participates in passes through synchronous trigger module, triggers using containing condition, radio broadcasting Or the dual trigger mechanism of multicast triggering, after triggering, delay process triggers media player module.

3. a kind of multi-section intelligent electronic device multimedia synchronous play system based on Local wireless network, feature includes: logical Wireless network or hotspot are crossed, homologous multimedia file passes through the source file synchronous service module synchronization in terminal to participation Intelligent electronic device；Its system delay parameter is distributed to terminal parameter advertisement service module by each intelligent electronic device；It is each to participate in Equipment passes through synchronous trigger module, triggers using containing condition, and the dual trigger mechanism of radio broadcasting or multicast triggering after triggering, is prolonged When handle, trigger media player module.

4. the system as described in claim 1-3, which contains: dual trigger mechanism contains: radio broadcasting or multicast triggering；Item Part triggering；The shortest triggering that is wherein delayed carries out the triggering of lower step function.

5. the condition as described in claim 1-4 triggers, it is characterized in that: the trigger condition that monitoring is set, meets the condition and touches Hair；Trigger condition be can monitor, can conditioning means or technology, activation threshold value, sound, light, electricity containing sensor, magnetics letter Number.

6. the system as described in claim 1-3, system is characterized in the media player module in the system, and user is optional Different sound channels are selected, or different play area play multimedia file.

7. the system as described in claim 1-3, system is characterized in the parameter advertisement service module function of online awareness containing terminal Can, after terminal is offline, remove the terminal parameter.

8. the system as described in claim 1-3, system are characterized in: source file, which is synchronized to, locally can be file, text File or blocks of files in part block, memory, external memory；Form can be slice, slice caching, stream.

9. a kind of method that multi-section intelligent electronic device is synchronous synergetic, the feature of this method contain: synchronous triggering is touched using containing condition Hair and radio broadcasting/multicast triggering dual trigger mechanism, are delayed according to own system calculate and participate in cooperative device on triggering Delay parameter, after delay process, execute synergistic function.

10. a kind of method of the synchronous synergetic shooting of multi-section camera, the feature of this method contain: synchronous triggering is triggered using containing condition The delay with cooperative device is calculated according to own system delay on triggering with radio broadcasting/multicast triggering dual trigger mechanism Parameter after delay process, is shot according to the acquisition parameters of setting, and the file of shooting gives processing terminal to calculate through wireless network transmissions Processing.