CN105472296B

CN105472296B - Real-time method of calibration and device

Info

Publication number: CN105472296B
Application number: CN201410455243.4A
Authority: CN
Inventors: 宁晓魁; 尹华菊
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2014-09-09
Filing date: 2014-09-09
Publication date: 2019-02-05
Anticipated expiration: 2034-09-09
Also published as: CN105472296A

Abstract

Embodiments herein discloses a kind of real-time method of calibration and device.This method is applied to the first end equipment of multimedia communication, and includes: acquisition transformation parameter；Data conversion requests are sent to second end equipment, the data conversion requests are for requesting second end equipment according to the transformation parameter to convert to the multi-medium data obtained in real time；Feedback data is received from second end equipment；Reference data is obtained according to the feedback data, which is data of the similarity between the feedback data not less than first threshold；And judge whether the feedback data matches with the reference data according to the transformation parameter, if the feedback data is matched with the reference data, it is determined that second end equipment obtains in real time to multi-medium data transmitted by first end equipment.Therefore, in embodiments herein, a kind of real-time verification mode is provided, improves safety of user when using multimedia communication.

Description

Real-time method of calibration and device

Technical field

This application involves field of computer technology, more specifically, this application involves a kind of real-time method of calibration and devices.

Background technique

With the development of internet technology, multimedia communication mode is more universal.For example, multimedia communication mainly includes language Sound call and video calling etc..By taking video calling as an example, it can be obtained in real time by the camera for being connected to electronic equipment The image and surrounding enviroment of user increases ditch so that be spatially separated by far-out both sides sees other side each other Logical effect.

User is caused to cannot achieve video call function in order to avoid not equipping camera due to electronic equipment, existing Have and have developed a kind of Softcam software in technology, itself simulation can be become into " true " in the electronic device and taken the photograph As head, and the picture, animation of broadcasting user setting, music, video etc. in video window.

However, since existing electronic equipment can not identify that the video data received from opposite equip. is taken the photograph by physics The real time video data obtained as head device or the recorded broadcast video data played by Softcam software, this is just illegal There are opportunities for molecule.

For example, in recent years, criminal steals video using the communication software account usurped or installation trojan horse program intercepts Video, and the event swindled using the account and video stolen frequently are occurred.It is studied abroad in particular, criminal usurps Raw video is even more appeared in the newspapers chapter repeatly with swindling the case of kith and kin's money and goods.

Summary of the invention

As described above, in the prior art, electronic equipment is due to that can not identify the multimedia number received from opposite equip. According to real-time, to generate potential security breaches.

In order to solve the above-mentioned technical problem, according to the one aspect of the application, a kind of real-time method of calibration, institute are provided The first end equipment that method is applied to multimedia communication is stated, for determining the second end equipment of the multimedia communication to described the Whether multi-medium data transmitted by one end equipment obtains in real time, which comprises obtains transformation parameter；To described Two end equipments send data conversion requests, and the data conversion requests are for requesting second end equipment to be joined according to the transformation Number is to convert the multi-medium data obtained in real time；Feedback data is received from second end equipment；According to the feedback Data obtain reference data, and the reference data is the number that similarity between the feedback data is not less than first threshold According to；And judge whether the feedback data matches with the reference data according to the transformation parameter, if the feedback Data are matched with the reference data, it is determined that second end equipment is to multi-medium data transmitted by first end equipment It obtains in real time.

In addition, providing a kind of real-time method of calibration according to the another aspect of the application, the method is applied to more matchmakers Second end equipment of body communication, for determining transmitted by the first end equipment of second end equipment to the multimedia communication Whether multi-medium data obtains in real time, which comprises data conversion requests are received from first end equipment, it is described Data conversion requests are for requesting second end equipment according to transformation parameter to become to the multi-medium data obtained in real time It changes；In the case that the multi-medium data acquired in second end equipment is real-time obtains, according to the transformation parameter come pair The multi-medium data obtained in real time is converted；And described is sent to using the multi-medium data converted as feedback data One end equipment, enables first end equipment to obtain reference data according to the feedback data, and the reference data is Similarity between the feedback data is not less than the data of first threshold；And judged according to the transformation parameter described Whether feedback data matches with the reference data, if the feedback data is matched with the reference data, it is determined that described Second end equipment obtains in real time to multi-medium data transmitted by first end equipment.

According to the another aspect of the application, a kind of real-time calibration equipment is provided, described device is logical applied to multimedia First end equipment of letter, for determining the second end equipment of the multimedia communication to more matchmakers transmitted by first end equipment Whether volume data obtains in real time, and described device includes: parameter acquiring unit, for obtaining transformation parameter；First sends list Member, for sending data conversion requests to second end equipment, the data conversion requests are for requesting the second end to set It is standby that the multi-medium data obtained in real time is converted according to the transformation parameter；First receiving unit, for from described the Two end equipments receive feedback data；Benchmark acquiring unit, for obtaining reference data, the benchmark according to the feedback data Data are data of the similarity between the feedback data not less than first threshold；And real-time judging unit, it is used for Judge whether the feedback data matches with the reference data according to the transformation parameter, if the feedback data and institute State reference data matching, it is determined that second end equipment to multi-medium data transmitted by first end equipment be to obtain in real time It takes.

According to the another aspect of the application, a kind of real-time calibration equipment is provided, described device is logical applied to multimedia Second end equipment of letter, for determining more matchmakers transmitted by the first end equipment of second end equipment to the multimedia communication Whether volume data obtains in real time, and described device includes: the second receiving unit, for receiving data from first end equipment Conversion requests, the data conversion requests are for requesting second end equipment according to transformation parameter come to the more matchmakers obtained in real time Volume data is converted；Data conversion unit is to obtain in real time for the multi-medium data acquired in second end equipment In the case where, the multi-medium data obtained in real time is converted according to the transformation parameter；And second transmission unit, it uses In being sent to first end equipment for the multi-medium data converted as feedback data, enable first end equipment Reference data is obtained according to the feedback data, the reference data is that the similarity between the feedback data is not less than The data of first threshold；And judge whether the feedback data matches with the reference data according to the transformation parameter, If the feedback data is matched with the reference data, it is determined that second end equipment is to transmitted by first end equipment Multi-medium data obtain in real time.

Compared with prior art, using the real-time method of calibration and device according to the application first embodiment, in safety Initiator's (that is, first end equipment) of verification operation, can determine transformation parameter by various modes, transformation parameter is sent The responder's (that is, second end equipment) operated to safety check；It, can be according to obtaining after receiving feedback data from responder The reference data got, the transformation parameter generated before and the transformed or non-transformed feedback data received carry out phase It is compared like degree, so that it is determined that whether the multi-medium data gone out received by oneself obtains in real time.

Using the real-time method of calibration and device according to the application second embodiment, in the responder of safety check operation (that is, second end equipment) can receive the transformation parameter that initiator's (that is, first end equipment) of safety check operation sends, take Certainly whether obtained in real time in the second end equipment to multi-medium data transmitted by first end equipment, to safety check The initiator of operation transmits different feedback data, and the initiator that safety check is operated is according to the base value got According to, the transformation parameter that generates and the transformed or non-transformed feedback data received carry out similarity comparison before, thus Determine whether the multi-medium data received by oneself obtains in real time.

Therefore, in embodiments herein, a kind of real-time verification mode is provided, user is improved and is using more matchmakers Safety when body communication.

Other features and advantage will illustrate in the following description, also, partly become from specification It obtains it is clear that being understood and implementing the application.The purpose of the application and other advantages can be by specifications, right Specifically noted structure is achieved and obtained in claim and attached drawing.

Detailed description of the invention

Attached drawing is used to provide further understanding of the present application, and constitutes part of specification, the reality with the application It applies example to be used to explain the application together, does not constitute the limitation to the application.In the accompanying drawings:

Fig. 1 illustrates the application architectures according to the embodiment of the present application.

Fig. 2 illustrates the real-time method of calibration according to the application first embodiment.

Fig. 3 illustrates the real-time method of calibration according to the application second embodiment.

Fig. 4 illustrates the real-time calibration equipment according to the application first embodiment.

Fig. 5 illustrates the first end equipment according to the application first embodiment.

Fig. 6 illustrates the real-time calibration equipment according to the application second embodiment.

Fig. 7 illustrates the second end equipment according to the application second embodiment.

Specific embodiment

It will be described in detail with reference to the accompanying drawings each embodiment according to the application.Here it is to be noted that it in the accompanying drawings, It assigns identical appended drawing reference to component part substantially with same or like structure and function, and will omit about it Repeated description.

As shown in Figure 1, the real-time method of calibration and device according to the embodiment of the present application can be applied to multimedia communication System 40.The multimedia communications system 40 includes at least the first end equipment 10 and the second end equipment 20.First end equipment 10 can To come to carry out multimedia communication with the second end equipment 20 in any manner.

For example, first end equipment 10 can be point-to-point by wireless network or cable network with second end equipment 20 Ground is directly linked together, and transmits multimedia communication data according to the data format of agreement.This example includes mobile electricity Talk about the communication scenes such as communication, interphone communication, Bluetooth communication.

Alternatively, which can also include the communication server 30, and first end equipment 10 can To establish multimedia communication via the communication server 30 with second end equipment 20 and connect.This example includes instant messaging (IM) communication scenes such as.

In either case, by the two-way communication between two electronic equipments 10 and 20, the first end equipment 10 User can carry out multimedia communication, voice communication, video calling etc. with the user of the second end equipment 20.

For example, the first end equipment 10 can acquire the sound of the user of 10 side of the first end equipment in real time by physical unit Frequently, the information such as video, and send the second end equipment 20 to, alternatively, the first end equipment 10 can also be obtained by virtual software The information such as audio set by the user, video, and send the second end equipment 20 to.

Similarly, the second end equipment 20 can also be by the real-time audio of the user of collected second end equipment, 20 side, view Frequency etc. or sends the information such as non real-time audio, video set by the user to first end equipment 10 at information.

Specifically, in the first end equipment 10 or the second end equipment 20, it can use voice collection device (for example, Mike Wind) carry out collected sound signal in real time, picture signal etc. is acquired in real time using image collecting device (for example, camera)； Or it can use virtual bench software also to simulate the voice collection device and image collecting device.

Obviously, in multimedia communications system, any one of the first end equipment and the second end equipment can be more matchmakers The initiator of body communication connection, for issuing for establishing communication request relevant to the multimedia communication；And first end is set Another standby in the second end equipment can be the responder that multimedia communication connects to be made for responding the communication request Obtain the communication connection established be used for the multimedia communication therebetween.

In addition, the initiation and response that connect with multimedia communication are independently, appointing in the first end equipment and the second end equipment What one can be the initiator of real-time verification operation, for issuing the data conversion requests of real-time verification operation, with right The real-time of multi-medium data transmitted by opposite equip. is verified.

In the following, for convenience, it will be assumed that initiator of first end equipment as real-time verification operation, and second end Responder of the equipment as real-time verification operation.

Real-time method of calibration shown in Fig. 2 can be applied to the first end equipment of multimedia communication.It is set when in first end It is standby the communication connection for multimedia communication is set up between the second end equipment after, the user of the first end equipment (or it For the first user) multimedia communication can be carried out with the user (or being referred to as, second user) of the second end equipment.At this point, In one end equipment, real-time verification operation can be initiated to the second end equipment by executing real-time method of calibration below, With determine the multimedia communication the second end equipment to multi-medium data transmitted by first end equipment whether be to obtain in real time 's.

As illustrated in Figure 2, which includes:

In step s 110, transformation parameter is obtained.

In order to enable the first end equipment can determine that the second end equipment of the multimedia communication is sent out to first end equipment Whether the multi-medium data sent obtains in real time, can obtain transformation parameter first in the first end equipment.

For example, the transformation parameter can be what user was manually entered, it is also possible to what electronic equipment automatically generated.

It is in the first example, available in the first end equipment to be somebody's turn to do in the case where user's manual Input transformation parameter The user of first end equipment transformation parameter based on determined by local multi-medium data.

Specifically, which may include: to obtain multi-medium data in the first end equipment side；Display is obtained The multi-medium data taken；The user for receiving first end equipment is referred to based on the parameter input that shown multi-medium data executes It enables；And instruction is inputted to determine the transformation parameter according to the parameter, which includes at least for characterizing domain transformation Parameter.

For example, by taking video communication as an example, it, can be first with the image collector being located locally in first end equipment (for example, camera) is set to acquire the picture signal about the first user in real time.It is then possible to using display device (for example, Display, touch screen etc.) to show the picture signal about its own to the first user.Next, can use order input Device (for example, mouse, keyboard, touch screen, writing pencil etc.) obtains first user in the picture signal about its own The parameter input instruction (for example, click, towing, numerical value input etc.) of execution.Finally, it can analyze parameter input instruction, and And determine that the first user is used as first to transformation parameter used in the picture signal about its own, and by the transformation parameter User wishes to transformation parameter used in the picture signal about second user.For example, the transformation parameter may include being used for It characterizes domain transformation (for example, position coordinates), mapping mode (for example, stretch, shrink, recess, protrusion, distortion, squeezing) and becomes Change the parameter of degree (for example, range value) etc..

In this way, initiator can be by detecting oneself face, and for some unessential position (example Such as, hair) deformation by a small margin of random angles is carried out, to determine to use the transformation parameter on responder's same section.

Although providing a kind of acquisition modes of transformation parameter in the first example, in practical applications, due to The characteristic area (for example, face) of one user position and ratio spy identical as second user shared in local image signal It levies region (for example, face) position shared in remote image signal and ratio may be different, so the acquisition modes may Cause not realizing the specific change for second user characteristic area according to the real intention of the first user in subsequent operation Operation is changed, is deformed so as to cause key position (for example, the features muzzle ear etc.) display in second user face, influences to use The normal video at family is conversed.

For this purpose, in the second example, in the first end equipment, the user of available first end equipment is based on long-range more Transformation parameter determined by media data.

Specifically, which may include: that display is received via the multimedia communication from second end equipment The multi-medium data arrived；The user for receiving first end equipment is referred to based on the parameter input that shown multi-medium data executes It enables；And instruction is inputted to determine the transformation parameter according to the parameter, which includes at least for characterizing domain transformation Parameter.

It still, can be first with communication device (for example, cable modem in first end equipment by taking video communication as an example T unit or wireless communication device) to receive the picture signal about second user from the second end equipment.It is then possible to using aobvious Showing device to show the picture signal about second user to the first user.Next, can use command input device to obtain The parameter input instruction for taking first user to execute in the picture signal about second user.Finally, it can analyze the parameter Input instruction, and directly determine that the first user wishes to transformation parameter used in the picture signal about second user.

In this way, providing a kind of acquisition modes of transformation parameter in the second example, may insure in subsequent operation The particular transform operation for second user specific region is realized according to the real intention of the first user, to reduce in real time The unnecessary influence that property verification operation generates video calling.

Although being illustrated so that the user of the first end equipment determines transformation parameter based on multi-medium data as an example above, But the application is without being limited thereto.For example, it includes that multiple candidate transformations are joined that the first end equipment, which can also be provided directly to the first user, Several candidate parameter lists, and receive the transformation parameter that user manually selects from the candidate parameter list.

In addition, in third example, in the first end equipment, remote multi-media number can be based in order to realize automation Characteristic point in is distributed to automatically generate the transformation parameter.

Specifically, which may include: to receive to via the multimedia communication from second end equipment Multi-medium data carry out feature point extraction, and determine the feature distribution of received multi-medium data；And according to this Feature distribution automatically determines the transformation parameter, which includes at least the parameter for characterizing domain transformation.

Still it by taking video communication as an example, in first end equipment, can be set first with communication device from second end The standby picture signal received about second user.It is then possible to the picture signal about second user be analyzed, to use feature Point extractive technique is (for example, active shape model (ASM), scale invariant feature conversion (SIFT) algorithm, acceleration robust features (SURF) etc.) feature distributions of the key feature points in second user characteristic area is determined.Finally, it can analyze key spy The feature distribution of point is levied, and determines that the first user wishes to transformation parameter used in the picture signal about second user. For example, the transformation parameter may include the parameter for characterizing domain transformation, mapping mode and transformation degree etc..

For example, normally watching pass in order to ensure map function performed by real-time verification operation will not influence the first user In the picture signal of second user, human face detection tech can be used herein, and select to have in second user face area There is the region of less characteristic point as the domain transformation, and keeps that there is the region compared with multi-characteristic points (for example, the eyebrow of second user Mesh muzzle ear) it is constant.For this purpose, the domain transformation can be the region with predefined size, and in the characteristic point for wherein including Number be less than or equal to second threshold.

In this way, providing a kind of acquisition modes of transformation parameter in third example, can automatically generate real-time Required transformation parameter in property verification operation, to save the manual operation of user.Obviously

Although generating the transformation parameter based on the characteristic point distribution in remote multi-media data with the first end equipment above For be illustrated, but the application is without being limited thereto.For example, the first end equipment can also be based in local multi-medium data Characteristic point be distributed to automatically generate the transformation parameter, or even be not based on characteristic point distribution but completely random generate this Transformation parameter.

In the step s 120, data conversion requests are sent to second end equipment.

By various feasible modes (for example, it is random generate, user selects from candidate list, user is in video counts According to middle determination) get transformation parameter after, can be generated based on the transformation parameter in the first end equipment data transformation ask It asks, which carries accessed transformation parameter, and for requesting second end equipment according to the transformation Parameter converts the multi-medium data obtained in real time.

Next, can use communication device in the first end equipment to the second end equipment and send data generated Conversion requests.Obviously, the data communication between the first end equipment and the second end equipment can directly point-to-point realization, can also be through It is realized by Relay Server or the communication server (for example, instant communication server).

Correspondingly, it can use communication device in the second end equipment to ask to receive data transformation from the first end equipment It asks, and depends on whether the second end equipment obtains in real time to multi-medium data transmitted by first end equipment, to do Different response out.

Specifically, it in the case that the multi-medium data acquired in second end equipment is real-time obtains, is set in second end In standby, the multi-medium data obtained in real time can be converted according to the transformation parameter, and utilize communication device by institute The multi-medium data of transformation is sent to first end equipment as feedback data.

On the contrary, in the case that the multi-medium data acquired in second end equipment is non real-time acquisition, in second end In equipment, first end equipment, i.e. second end can be sent to using the multi-medium data of non real-time acquisition as the feedback data Equipment does not carry out any conversion process to the multi-medium data of non real-time acquisition.

For example, in above process, if the second end equipment using be located locally image collecting device (for example, Camera) picture signal about second user is acquired in real time, it may be considered that more matchmakers acquired in second end equipment Volume data obtains in real time；And if the second end equipment is not using the image collecting device being located locally but utilizes empty Quasi- camera software plays the picture signal (for example, picture, animation, music, video etc.) of second user setting, then can be with Think that multi-medium data acquired in second end equipment does not obtain in real time.

In step s 130, feedback data is received from second end equipment.

In second end equipment utilization communication device come after sending the feedback data to the first end equipment, correspondingly, Communication device be can use in one end equipment to receive the feedback data from the second end equipment, for subsequent processing.

In step S140, reference data is obtained according to the feedback data.

After getting feedback data, in first end equipment, base value can be obtained according to the feedback data According to.For example, the reference data can store in the local storage of the first end equipment, also can store in remote server It is obtained in (for example, cloud) and by communication device.

For example, the reference data can be the multiple template of the face area about second user.For this purpose, can be in advance Acquire the characteristic point of second user face area, the template library as the second user.

In order to guarantee the accuracy of real-time verification operation, which can be similar between the feedback data Degree is not less than the data of first threshold.

In the first example, it may include: to carry out to the feedback data that this, which obtains reference data according to the feedback data, Feature point extraction, and determine the feature distribution of the feedback data；Obtain the feature distribution of multiple template data；And it is it is special Similarity between sign distribution and the feature distribution of the feedback data is determined as the base not less than the template data of the first threshold Quasi- data.

By taking video communication as an example, in first end equipment, the feedback image as the feedback data can be analyzed first Signal, thus using feature point extraction technology (for example, active shape model (ASM), scale invariant feature conversion (SIFT) are calculated Method accelerates robust features (SURF) etc.) come determine the feedback image signal key feature points feature distribution.It is then possible to The feature distribution of the multiple template picture signal as template data is obtained in the local storage or remote server.Here, In order to save process resource, this feature distribution can be pre-generated.Next, can be from multiple template picture signal A template image signal is selected, and compares the phase of the feature distribution of the template image signal and the feature distribution of feedback data Like degree.It, can be using the template image signal behavior as time if the comparison result of similarity is greater than or equal to first threshold The person of choosing.Finally, if it find that there are multiple candidates, then the maximum candidate of similarity can be determined as the reference data.

Although providing a kind of acquisition modes of reference data in the first example, found based on whole image region Immediate matching image signal, but since in practical applications, the picture signal as feedback data is likely to By conversion process, so if extracted to all characteristic points in picture signal, it is possible to lead to not find with Correct matched reference data.

For this purpose, in the second example, in the first end equipment, can only compare non-shifting region in feedback data with The similarity in the non-shifting region in template data.

Specifically, it may include: to the non-shifting in the feedback data that this, which obtains reference data according to the feedback data, Region carries out feature point extraction, which is the region other than the domain transformation, and determines the feedback data In non-shifting region feature distribution；Obtain the feature distribution in the non-shifting region in multiple template data；And it will wherein Non-shifting region feature distribution and the feedback data in non-shifting region feature distribution between similarity be not less than The template data of the first threshold is determined as the reference data.

For example, the parameter for characterizing domain transformation may include in transformation parameter acquired in step s 110.

In step S150, judge whether the feedback data matches with the reference data according to the transformation parameter, if The feedback data is matched with the reference data, it is determined that second end equipment is to multi-medium data transmitted by first end equipment It obtains in real time.

On the contrary, if the feedback data and the reference data mismatch, it is determined that second end equipment is to the first end Multi-medium data transmitted by equipment does not obtain in real time.

After obtaining reference data, feedback data, reference data and transformation parameter can use, by using following A kind of what mode finally judges to state real-time of second end equipment to multi-medium data transmitted by first end equipment.

In one example, this judge whether the feedback data and the reference data match according to the transformation parameter can be with It include: the reference data to be transformed to transformation data using the transformation parameter, and determine the transformation data and the feedback coefficient Whether the similarity between is not less than third threshold value, if the similarity between the transformation data and the feedback data is not less than Third threshold value, it is determined that second end equipment obtains in real time to multi-medium data transmitted by first end equipment.

In another example, this judge whether the feedback data and the reference data match according to the transformation parameter can be with It include: the feedback data to be inversely transformed into initial data using the transformation parameter, and determine the initial data and the benchmark Whether the similarity between data is not less than third threshold value, if the similarity between the initial data and the reference data is not small In third threshold value, it is determined that second end equipment obtains in real time to multi-medium data transmitted by first end equipment.

In another example, this judge whether the feedback data and the reference data match according to the transformation parameter can be with It include: checking parameter to be calculated using the feedback data and the reference data, and determine the checking parameter and the transformation parameter Between similarity whether be not less than third threshold value, if the similarity between the checking parameter and the transformation parameter is not less than the Three threshold values, it is determined that second end equipment obtains in real time to multi-medium data transmitted by first end equipment.

Obviously, in the first two example, the comparison of similarity is same between this multi-medium data (for example, picture signal) It can be realized based on Feature Points Matching algorithm.However, the application is without being limited thereto.The processing of above-mentioned mentioned similarity-rough set It can also the combination based on the other modes such as pixel value, pixel histogram, angle point distribution, edge detection or above-mentioned several ways To realize.

Also, in all three examples, it can not be and compare whole image signal, but be based only in feedback data Domain transformation and reference data in domain transformation and the transformation parameter realize the comparison of similarity, calculated with reducing Amount saves process resource.

In addition, when determining second end equipment to multi-medium data transmitted by first end equipment in step S150 It is after obtaining in real time, if directly used to be shown to the first user about second using display device in the first end equipment The picture signal at family is then crossed since the picture signal has already passed through conversion process, it seem likely that will lead to second user Characteristic area (for example, face) deform.If this deformation is appeared in compared with multi-characteristic points region (for example, second user Features muzzle ear) in, then certainly will influence the viewing experience of the first user.

For this purpose, being real judging second end equipment to multi-medium data transmitted by first end equipment optionally When obtain after, the transformation parameter can be used by the feedback data and be inversely transformed into initial data；And show that this is original Data.

In this way it is ensured that map function performed by real-time verification operation, which will not influence the first user, normally watches pass In the picture signal of second user.

In addition, when determining second end equipment to multi-medium data transmitted by first end equipment in step S150 It is not that, in order to cause giving one's full attention to for the first user, prompt information can be sent to the first user after obtaining in real time.

For this purpose, optionally, if the feedback data and the reference data mismatch, prompt information can be generated, this is mentioned Show that information indicates that second end equipment does not obtain in real time to multi-medium data transmitted by first end equipment.Then, Display device be can use to show the prompt information to the first user.

It can be seen that using the real-time method of calibration according to the application first embodiment, in the hair of safety check operation Side's (that is, first end equipment) is played, can determine transformation parameter by various modes, sends safety check behaviour for transformation parameter Responder's (that is, second end equipment) of work；It, can be according to the base value got after receiving feedback data from responder According to, the transformation parameter that generates and the transformed or non-transformed feedback data received carry out similarity comparison before, thus Determine whether the multi-medium data received by oneself obtains in real time.Therefore, it in embodiments herein, provides A kind of real-time verification mode improves safety of user when using multimedia communication.

Specifically, it in the case where video calling, is identified by using Facial metamorphosis, criminal can be taken precautions against well Pirate recordings and post-processing are carried out to the user video stolen.Even if criminal takes the video record of user, but due to It is unfamiliar with the face characteristic of the user, and can not also judges the transformation parameter that random or customization generates, so will be unable to point Used identifying schemes are discerned, so that this identifying schemes are hidden and effective.Further, since this identifying schemes compare Intuitively, more quickly and efficiently than watermark calculation process.

Real-time method of calibration shown in Fig. 3 can be applied to the second end equipment of multimedia communication.It is set when in first end It is standby the communication connection for multimedia communication is set up between the second end equipment after, the user of the first end equipment (or it For the first user) multimedia communication can be carried out with the user (or being referred to as, second user) of the second end equipment.At this point, In two end equipments, the real-time verification initiated by the first end equipment can be responded by executing real-time method of calibration below Operation, with determine the multimedia communication the second end equipment to multi-medium data transmitted by first end equipment whether be real-time It obtains.

As illustrated in fig. 3, which includes:

In step S210, data conversion requests are received from first end equipment.

In first end equipment utilization communication device come after sending the data conversion requests to the second end equipment, correspondingly, It can use communication device (for example, wire communication device or wireless communication device) in the second end equipment to come from the first end equipment The data conversion requests are received, for subsequent processing.

Obviously, the data communication between the second end equipment and the first end equipment can directly point-to-point realization, can also be through It is realized by Relay Server or the communication server (for example, instant communication server).

In step S220, in the case that the multi-medium data acquired in second end equipment is real-time obtains, according to The transformation parameter converts the multi-medium data obtained in real time.

After receiving data conversion requests, in second end equipment, it can analyze the data conversion requests, and The first user is extracted to wish to transformation parameter used in the picture signal about second user.For example, the transformation parameter can be with Including for characterize domain transformation (for example, position coordinates), mapping mode (for example, stretch, shrink, recess, protrusion, distortion, squeeze Pressure) and transformation degree (for example, range value) etc. parameter.

It, can in the second end equipment in the case that the multi-medium data acquired in second end equipment is real-time obtains To be converted according to extracted transformation parameter to the multi-medium data obtained in real time.

For example, simply, this data transformation can by be located at the second end equipment local image collecting device (for example, Camera) it is directly realized by.

By taking video communication as an example, if second user is not that Softcam is used is soft in the second end equipment Part, but physics cam device is used and normally carries out video calling, then it can send transformation parameter to image letter Number acquisition source, i.e. physics cam device, by physics cam device according to transformation parameter to captured in real-time to video Data are converted.For example, the mapping mode that the first user specifies can be used for physics cam device and transformation degree is come Image transformation is carried out to the domain transformation that the first user specifies about in the picture signal of second user.

Although being illustrated for realizing data transformation directly in image collecting device above, the application It is without being limited thereto.For example, the source of multi-medium data acquired in the second end equipment can also be monitored in the second end equipment, and And in the case where the source is image collecting device, before being sent to the first end equipment, using transformation parameter come more to this Media data is converted.

In step S230, first end equipment is sent to using the multi-medium data converted as feedback data.

After converting to the multi-medium data obtained in real time, in the second end equipment, communication device can use First end equipment is sent to using the multi-medium data converted as feedback data.

It, will in the case that the multi-medium data acquired in second end equipment is non real-time acquisition in step S240 The multi-medium data of non real-time acquisition is sent to first end equipment as the feedback data.

With in step S220 on the contrary, the case where multi-medium data acquired in second end equipment is non real-time acquisition Under, in the second end equipment, it can use communication device the multi-medium data of non real-time acquisition is direct as the feedback data It is sent to first end equipment, i.e. the second end equipment does not carry out any conversion process to the multi-medium data of non real-time acquisition.

Still by taking video communication as an example, if Softcam software is used in second user in the second end equipment Video calling is carried out (for example, criminal is carrying out video fraud, certainly it is also possible that legitimate user normally makes With the software), then transformation parameter can be equally sent to the acquisition source of picture signal, i.e. Softcam software, due to Softcam software is to provide corresponding application interface, so it not will use the transformation parameter to the video of non real-time recorded broadcast Data carry out any conversion process, thus in the second end equipment, will be continued using communication device will be without any transformation Multi-medium data is sent to first end equipment as feedback data.

Correspondingly, it can use communication device in the first end equipment to receive the feedback data from the second end equipment.So Afterwards, similar reference data can be obtained according to the feedback data.Finally, this can be judged according to the transformation parameter Whether feedback data matches with the reference data, if the feedback data is matched with the reference data, it is determined that the second end is set It is standby to be obtained in real time to multi-medium data transmitted by first end equipment.Otherwise, it determines second end equipment to this first Multi-medium data transmitted by end equipment does not obtain in real time.

It can be seen that using the real-time method of calibration according to the application second embodiment, in the sound of safety check operation Side's (that is, second end equipment) is answered, can receive the transformation ginseng that initiator's (that is, first end equipment) of safety check operation sends Whether number, obtain depending on the second end equipment to multi-medium data transmitted by first end equipment, in real time to safety The initiator of verification operation transmits different feedback data, and the initiator that safety check is operated is according to the base got Quasi- data, the transformation parameter generated before and the transformed or non-transformed feedback data received carry out similarity comparison, So that it is determined that whether the multi-medium data gone out received by oneself obtains in real time.Therefore, it in embodiments herein, mentions A kind of real-time verification mode has been supplied, safety of user when using multimedia communication is improved.

Fig. 4 illustrates the real-time calibration equipment according to the application first embodiment, and Fig. 5 is illustrated according to the application First end equipment of first embodiment.

The illustrated real-time method of calibration according to the application first embodiment of Fig. 2 can pass through the illustrated reality of Fig. 4 When property calibration equipment 100 is realized, and the real-time calibration equipment 100 can be applied to illustrated first end equipment of Fig. 5 10。

For example, first end equipment 10 can by means of intermediate equipments such as base station, access point, the communication servers and with Other peer devices carry out wireless communication, alternatively, first end equipment 10 can also directly with other peer devices into Row wireless communication, to carry out multimedia communication between both devices.For example, the first end equipment 10 can be it is shown in FIG. 1 The first end equipment 10 in communication system.

As illustrated in fig. 5, which may include: real-time calibration equipment 100, image collecting device 300, voice collection device 400, communication device 500, command input device 600 and display device 700.

The real-time calibration equipment 100 can determine transformation parameter, send the second end equipment 20 for transformation parameter；From After second end equipment 20 receives feedback data, the transformation parameter that can generate according to the reference data got, before and The transformed or non-transformed feedback data received carries out similarity comparison, so that it is determined that the first end equipment 10 from second out Whether multi-medium data received by end equipment 20 obtains in real time.

The image collecting device 300 can be used for acquiring picture signal.

The voice collection device 400 can be used for collected sound signal.

The command input device 600 can be used for receiving input signal from the user, for example, parameter input instruction etc..

The communication device 500 can be used for being communicated with other electronic equipments or server, with to other electronic equipments Image sequence is sent, and/or receives image sequence etc. from other electronic equipments.For example, the communication device 500 can be for leading to It crosses WLAN (WLAN) communication standard and is connected to the wireless communication module of internet, or for passing through mobile communication standard And it is connected to the mobile communication module of internet or bluetooth for being connected to other equipment by short-range communication standard is logical Believe module or near-field communication module etc..

The multi-medium data of acquisition that the display device 700 is displayed for locally obtaining and/or long-range.

In addition, the real-time calibration equipment 100 can be communicated with the first end equipment 10 in any manner.

In one example, which can be used as a software module and/or hardware module and collects At into first end equipment 10, in other words, which may include the real-time calibration equipment 100.For example, working as When first end equipment 10 is mobile phone, which can be one in the operating system of the mobile phone A software module, or can be and be directed to the application program that the mobile phone is developed；Certainly, real-time verification dress Setting 100 equally can be one of numerous hardware modules of the mobile phone.

Alternatively, in another example, the real-time calibration equipment 100 and first end equipment 10 are also possible to separate Equipment, and the real-time calibration equipment 100 can be connected to first end equipment 10 by wired and or wireless network, and And interactive information is transmitted according to the data format of agreement.

Real-time calibration equipment shown in Fig. 4 is determined for the second end equipment of the multimedia communication to the first end Whether multi-medium data transmitted by equipment obtains in real time.

It as illustrated in figure 4, may include: that parameter obtains list according to the real-time calibration equipment 100 of the embodiment of the present application First 110, first transmission unit 120, the first receiving unit 130, benchmark acquiring unit 140 and real-time judging unit 150.

The parameter acquiring unit 110 can be used for obtaining transformation parameter.

First transmission unit 120 can be used for sending data conversion requests to second end equipment, and data transformation is asked It asks for requesting second end equipment according to the transformation parameter and the multi-medium data obtained in real time is converted.

First receiving unit 130 can be used for receiving feedback data from second end equipment.

The benchmark acquiring unit 140 can be used for obtaining reference data according to the feedback data, the reference data be with Similarity between the feedback data is not less than the data of first threshold.

The real-time judging unit 150 can be used for judging the feedback data and the reference data according to the transformation parameter Whether match, if the feedback data is matched with the reference data, it is determined that second end equipment is sent out to first end equipment The multi-medium data sent obtains in real time.

In the first example, which can obtain transformation parameter by following operation: in the first end Equipment side obtains multi-medium data；The acquired multi-medium data of display；The user of first end equipment is received based on shown Multi-medium data execute parameter input instruction；And it is inputted according to the parameter and instructs the transformation to determine the transformation parameter Parameter includes at least the parameter for characterizing domain transformation.

In the second example, which can obtain transformation parameter by following operation: display is via this The multi-medium data that multimedia communication is received from second end equipment；The user of first end equipment is received based on shown The parameter that multi-medium data executes inputs instruction；And instruction is inputted to determine the transformation parameter according to the parameter, which joins Number includes at least the parameter for characterizing domain transformation.

In third example, which can obtain transformation parameter by following operation: to more via this The multi-medium data that media communication is received from second end equipment carries out feature point extraction, and determines received more matchmakers The feature distribution of volume data；And the transformation parameter is automatically determined according to this feature distribution, which includes at least For characterizing the parameter of domain transformation.

Specifically, which can be the region with predefined size, and in for the characteristic point for wherein including Number is less than or equal to second threshold.

In one example, which can obtain base according to the feedback data by following operation Quasi- data: feature point extraction is carried out to the feedback data, and determines the feature distribution of the feedback data；Obtain multiple template number According to feature distribution；And the similarity between its feature distribution and the feature distribution of the feedback data is not less than first threshold The template data of value is determined as the reference data.

In another example, which can obtain base according to the feedback data by following operation Quasi- data: feature point extraction is carried out to the non-shifting region in the feedback data, which is in addition to the domain transformation Except region, and determine the feedback data in non-shifting region feature distribution；It obtains non-in multiple template data The feature distribution of domain transformation；And by the non-shifting region in the feature distribution in non-shifting region therein and the feedback data Feature distribution between similarity be determined as the reference data not less than the template data of the first threshold.

In one example, which can be judged by following operation according to the transformation parameter Whether the feedback data matches with the reference data: the reference data is transformed to transformation data using the transformation parameter, and And determine whether the similarity between the transformation data and the feedback data is not less than third threshold value, if the transformation data with should Similarity between feedback data is not less than third threshold value, it is determined that second end equipment is to more transmitted by first end equipment Media data obtains in real time；Or the feedback data is inversely transformed into initial data using the transformation parameter, and really Whether the similarity between the fixed initial data and the reference data is not less than third threshold value, if the initial data and the benchmark Similarity between data is not less than third threshold value, it is determined that second end equipment is to multimedia transmitted by first end equipment Data obtain in real time；Or checking parameter is calculated using the feedback data and the reference data, and determine the verification Whether the similarity between parameter and the transformation parameter is not less than third threshold value, if between the checking parameter and the transformation parameter Similarity be not less than third threshold value, it is determined that second end equipment is real to multi-medium data transmitted by first end equipment When obtain.

In addition, in order to realize one or more optional functions, also according to the real-time calibration equipment 100 of the embodiment of the present application It may include: data inverse transformation block 160, data display unit 170 and information generating unit 180.

The data inverse transformation block 160 can be used for judging second end equipment to transmitted by first end equipment Multi-medium data is that the feedback data is inversely transformed into initial data using the transformation parameter after obtaining in real time.

The data display unit 170 is displayed for the initial data.

If the information generating unit 180 can be used for the feedback data and the reference data mismatches, prompt is generated Information, the prompt information indicate second end equipment to multi-medium data transmitted by first end equipment be not to obtain in real time 's.

According to each unit in the real-time calibration equipment 100 of the embodiment of the present application and each in electronic equipment 10 The concrete configuration of device and operation have been described above in the real-time method of calibration described with reference to Fig. 2 and are discussed in detail, and therefore, will Omit its repeated description.

It can be seen that using the real-time calibration equipment according to the application first embodiment, in the hair of safety check operation Side's (that is, first end equipment) is played, can determine transformation parameter by various modes, sends safety check behaviour for transformation parameter Responder's (that is, second end equipment) of work；It, can be according to the base value got after receiving feedback data from responder According to, the transformation parameter that generates and the transformed or non-transformed feedback data received carry out similarity comparison before, thus Determine whether the multi-medium data received by oneself obtains in real time.Therefore, it in embodiments herein, provides A kind of real-time verification mode improves safety of user when using multimedia communication.

Fig. 6 illustrates the real-time calibration equipment according to the application second embodiment, and Fig. 7 is illustrated according to the application Second end equipment of second embodiment.

The illustrated real-time method of calibration according to the application second embodiment of Fig. 3 can pass through the illustrated reality of Fig. 6 When property calibration equipment 200 is realized, and the real-time calibration equipment 200 can be applied to illustrated second end equipment of Fig. 7 20。

For example, second end equipment 20 can by means of intermediate equipments such as base station, access point, the communication servers and with Other peer devices carry out wireless communication, alternatively, second end equipment 20 can also directly with other peer devices into Row wireless communication, to carry out multimedia communication between both devices.For example, the second end equipment 20 can be it is shown in FIG. 1 The second end equipment 20 in communication system.

As illustrated in figure 7, which may include: real-time calibration equipment 200, image collecting device 300, voice collection device 400 and communication device 500.

The real-time calibration equipment 200 can receive the transformation parameter of the first end equipment 10 transmission, set depending on second end Whether standby 20 obtain in real time to multi-medium data transmitted by first end equipment 10, not to the transmission of the first end equipment 10 With feedback data, the transformation parameter that the first end equipment 10 is generated according to the reference data got, before and connect The transformed or non-transformed feedback data received carries out similarity comparison, so that it is determined that going out the multimedia received by oneself Whether data obtain in real time.

The image collecting device 300 can be used for acquiring picture signal.

The voice collection device 400 can be used for collected sound signal.

In addition, the real-time calibration equipment 200 can be communicated with the second end equipment 20 in any manner.

In one example, which can be used as a software module and/or hardware module and collects At into second end equipment 20, in other words, which may include the real-time calibration equipment 200.For example, working as When second end equipment 20 is mobile phone, which can be one in the operating system of the mobile phone A software module, or can be and be directed to the application program that the mobile phone is developed；Certainly, real-time verification dress Setting 200 equally can be one of numerous hardware modules of the mobile phone.

Alternatively, in another example, the real-time calibration equipment 200 and second end equipment 20 are also possible to separate Equipment, and the real-time calibration equipment 200 can be connected to second end equipment 20 by wired and or wireless network, and And interactive information is transmitted according to the data format of agreement.

Real-time calibration equipment shown in fig. 6 is determined for the second end equipment of the multimedia communication to the first end Whether multi-medium data transmitted by equipment obtains in real time.

It as illustrated in FIG. 6, may include: the second reception list according to the real-time calibration equipment 200 of the embodiment of the present application First 210, data conversion unit 220, the second transmission unit 230.

Second receiving unit 210 can be used for receiving data conversion requests from first end equipment, and data transformation is asked It asks for requesting second end equipment according to transformation parameter and the multi-medium data obtained in real time is converted.

The data conversion unit 220 can be used for the multi-medium data acquired in second end equipment and obtain in real time In the case of, the multi-medium data obtained in real time is converted according to the transformation parameter.

The multi-medium data that second transmission unit 230 can be used for be converted as feedback data be sent to this first End equipment enables first end equipment to obtain reference data according to the feedback data, which is and the feedback Similarity between data is not less than the data of first threshold；And the feedback data and the base are judged according to the transformation parameter Whether quasi- data match, if the feedback data is matched with the reference data, it is determined that second end equipment is set to the first end Standby transmitted multi-medium data obtains in real time.

It is non real-time obtain that second transmission unit 230, which can be also used for the multi-medium data acquired in second end equipment, In the case where taking, first end equipment is sent to using the multi-medium data of non real-time acquisition as the feedback data.

According to each unit in the real-time calibration equipment 200 of the embodiment of the present application and each in electronic equipment 10 The concrete configuration of device and operation have been described above in the real-time method of calibration described with reference to Fig. 2 and are discussed in detail, and therefore, will Omit its repeated description.

It can be seen that using the real-time calibration equipment according to the application second embodiment, in the sound of safety check operation Side's (that is, second end equipment) is answered, can receive the transformation ginseng that initiator's (that is, first end equipment) of safety check operation sends Whether number, obtain depending on the second end equipment to multi-medium data transmitted by first end equipment, in real time to safety The initiator of verification operation transmits different feedback data, and the initiator that safety check is operated is according to the base got Quasi- data, the transformation parameter generated before and the transformed or non-transformed feedback data received carry out similarity comparison, So that it is determined that whether the multi-medium data gone out received by oneself obtains in real time.Therefore, it in embodiments herein, mentions A kind of real-time verification mode has been supplied, safety of user when using multimedia communication is improved.

It should be noted that although hereinbefore embodiments herein is illustrated by taking video communication as an example, It is that the application is without being limited thereto.For example, the application can be equally used for determining the second end equipment of voice communication to voice communication Whether audio data transmitted by the first end equipment is to be obtained in real time by physics microphone apparatus.

In addition, although above-mentioned each unit is illustrated that the application's is each as the executing subject of each step herein Embodiment, still, it will be appreciated to those of skill in the art that the application is without being limited thereto.The executing subject of each step can be with It is served as by other one or more units, unit, even module.

For example, the parameter acquiring unit 110, first being applied in the real-time calibration equipment 100 of the first end equipment 10 is sent out Send unit 120, the first receiving unit 130, benchmark acquiring unit 140, real-time judging unit 150, data inverse transformation block 160, data display unit 170 and information generating unit 180 and the real-time calibration equipment applied to the second end equipment 20 Each step performed by the second receiving unit 210, data conversion unit 220, the second transmission unit 230 in 200 can unite It is realized by the central processing unit (CPU) in electronic equipment on one ground.At this moment, above-mentioned transmission unit and receiving unit can be The software interface of application program.

Through the above description of the embodiments, those skilled in the art can be understood that the application can be by It is realized in the mode of software plus required hardware platform, naturally it is also possible to all be implemented by software or hardware.Based on this The understanding of sample, the technical solution of the application to background technique contribute in whole or in part can be in the form of software products It embodies, which can store in storage medium, such as ROM/RAM, disk, CD, including several Instruction is used so that a computer equipment (can be personal computer, server or the network equipment etc.) executes the application The method that certain parts of each embodiment or embodiment are somebody's turn to do.

Each embodiment of the application has been described in detail above.However, it should be appreciated by those skilled in the art that not taking off In the case where principle and spirit from the application, these embodiments can be carry out various modifications, combination or sub-portfolio, and in this way Modification should fall within the scope of the present application.

Claims

1. a kind of real-time method of calibration, which is characterized in that the method is applied to the first end equipment of multimedia communication, is used for Determine the second end equipment of the multimedia communication to multi-medium data transmitted by first end equipment whether be to obtain in real time It takes, which comprises

Obtain transformation parameter；

Data conversion requests are sent to second end equipment, the data conversion requests are for requesting the second end equipment root The multi-medium data obtained in real time is converted according to the transformation parameter；

Feedback data is received from second end equipment；

Obtain reference data according to the feedback data, the reference data be similarity between the feedback data not Less than the data of first threshold；And

The reference data is transformed to transformation data using the transformation parameter, and determine the transformation data with it is described Whether the similarity between feedback data is not less than third threshold value, if the phase between the transformation data and the feedback data It is not less than third threshold value like degree, it is determined that second end equipment is real to multi-medium data transmitted by first end equipment When obtain；Or

The feedback data is inversely transformed into initial data using the transformation parameter, and determines the initial data and institute State whether the similarity between reference data is not less than third threshold value, if between the initial data and the reference data Similarity is not less than third threshold value, it is determined that second end equipment is to multi-medium data transmitted by first end equipment It obtains in real time；Or

Checking parameter is calculated using the feedback data and the reference data, and determines the checking parameter and the change Whether the similarity changed between parameter is not less than third threshold value, if similar between the checking parameter and the transformation parameter Degree be not less than third threshold value, it is determined that second end equipment to multi-medium data transmitted by first end equipment be real-time It obtains.

2. the method according to claim 1, wherein the acquisition transformation parameter, comprising:

Show the multi-medium data received via the multimedia communication from second end equipment；

Receive the parameter input instruction that the user of first end equipment is executed based on shown multi-medium data；And

Instruction is inputted according to the parameter to determine that the transformation parameter, the transformation parameter are included at least for characterizing shift zone The parameter in domain.

3. the method according to claim 1, wherein the acquisition transformation parameter, comprising:

Feature point extraction is carried out to the multi-medium data received via the multimedia communication from second end equipment, and Determine the feature distribution of received multi-medium data；And

The transformation parameter is automatically determined according to the feature distribution, the transformation parameter is included at least for characterizing transformation The parameter in region.

4. according to the method described in claim 3, it is characterized in that, the domain transformation is the region with predefined size, and And it is less than or equal to second threshold in the number for the characteristic point for wherein including.

5. the method according to claim 1, wherein the acquisition transformation parameter, comprising:

Multi-medium data is obtained in first end equipment side；

The acquired multi-medium data of display；

6. the method according to claim 1, wherein described obtain reference data according to the feedback data, Include:

Feature point extraction is carried out to the feedback data, and determines the feature distribution of the feedback data；

Obtain the feature distribution of multiple template data；And

Similarity between its feature distribution and the feature distribution of the feedback data is not less than to the template of the first threshold Data are determined as the reference data.

7. the method according to any one of claim 2 to 5, which is characterized in that described to be obtained according to the feedback data Take reference data, comprising:

Feature point extraction is carried out to the non-shifting region in the feedback data, the non-shifting region is in addition to the shift zone Region except domain, and determine the feature distribution in the non-shifting region in the feedback data；

Obtain the feature distribution in the non-shifting region in multiple template data；And

It will be between the feature distribution in the non-shifting region in the feature distribution and the feedback data in non-shifting region therein Similarity is determined as the reference data not less than the template data of the first threshold.

8. the method according to claim 1, wherein the method also includes:

After judging that second end equipment is to obtain in real time to multi-medium data transmitted by first end equipment, The feedback data is inversely transformed into initial data using the transformation parameter；And

Show the initial data.

9. the method according to claim 1, wherein the method also includes:

If the feedback data and the reference data mismatch, prompt information is generated, the prompt information indicates institute The second end equipment is stated not obtain in real time to multi-medium data transmitted by first end equipment.

10. a kind of real-time method of calibration, which is characterized in that the method is applied to the second end equipment of multimedia communication, uses In determining whether multi-medium data transmitted by the first end equipment of second end equipment to the multimedia communication is real-time It obtains, which comprises

Data conversion requests are received from first end equipment, the data conversion requests are for requesting the second end equipment root The multi-medium data obtained in real time is converted according to transformation parameter；

In the case that the multi-medium data acquired in second end equipment is real-time obtains, according to the transformation parameter come pair The multi-medium data obtained in real time is converted；And

It is sent to first end equipment using the multi-medium data converted as feedback data, enables first end equipment Enough that reference data is obtained according to the feedback data, the reference data is that the similarity between the feedback data is not small In the data of first threshold；And

11. according to the method described in claim 10, it is characterized in that, the method also includes:

In the case that the multi-medium data acquired in second end equipment is non real-time acquisition, by more matchmakers of non real-time acquisition Volume data is sent to first end equipment as the feedback data.

12. a kind of real-time calibration equipment, which is characterized in that described device is applied to the first end equipment of multimedia communication, uses In determine the second end equipment of the multimedia communication to multi-medium data transmitted by first end equipment whether be real-time It obtains, described device includes:

Parameter acquiring unit, for obtaining transformation parameter；

First transmission unit, for sending data conversion requests to second end equipment, the data conversion requests are for asking Second end equipment is sought according to the transformation parameter to convert to the multi-medium data obtained in real time；

First receiving unit, for receiving feedback data from second end equipment；

Benchmark acquiring unit, for obtaining reference data according to the feedback data, the reference data is and the feedback Similarity between data is not less than the data of first threshold；And

Real-time judging unit, is used for:

The reference data is transformed to transformation data using the transformation parameter, and determine the transformation data with it is described Whether the similarity between feedback data is not less than third threshold value, if the phase between the transformation data and the feedback data It is not less than third threshold value like degree, it is determined that second end equipment is real to multi-medium data transmitted by first end equipment When obtain；Or the feedback data is inversely transformed into initial data using the transformation parameter, and determine the original Whether the similarity between beginning data and the reference data is not less than third threshold value, if the initial data and the benchmark Similarity between data is not less than third threshold value, it is determined that second end equipment is to more transmitted by first end equipment Media data obtains in real time；Or

Person

13. device according to claim 12, which is characterized in that the parameter acquiring unit is obtained by following operation to be become Change parameter:

14. device according to claim 12, which is characterized in that the parameter acquiring unit is obtained by following operation to be become Change parameter:

15. device according to claim 14, which is characterized in that the domain transformation is the region with predefined size, And it is less than or equal to second threshold in the number for the characteristic point for wherein including.

16. device according to claim 12, which is characterized in that the parameter acquiring unit is obtained by following operation to be become Change parameter:

Multi-medium data is obtained in first end equipment side；

The acquired multi-medium data of display；

17. device according to claim 12, which is characterized in that the benchmark acquiring unit is by following operation according to institute Feedback data is stated to obtain reference data:

Obtain the feature distribution of multiple template data；And

18. device described in any one of 3 to 16 according to claim 1, which is characterized in that the benchmark acquiring unit by with Lower operation obtains reference data according to the feedback data:

19. device according to claim 12, which is characterized in that described device further include:

Data inverse transformation block, for judging second end equipment to multimedia number transmitted by first end equipment According to being that the feedback data is inversely transformed into initial data using the transformation parameter after obtaining in real time；And

Data display unit, for showing the initial data.

20. device according to claim 12, which is characterized in that described device further include:

Information generating unit generates prompt information if mismatched for the feedback data and the reference data, described Prompt information indicates that second end equipment does not obtain in real time to multi-medium data transmitted by first end equipment.

21. a kind of real-time calibration equipment, which is characterized in that described device is applied to the second end equipment of multimedia communication, uses In determining whether multi-medium data transmitted by the first end equipment of second end equipment to the multimedia communication is real-time It obtains, described device includes:

Second receiving unit, for receiving data conversion requests from first end equipment, the data conversion requests are for asking Second end equipment is sought according to transformation parameter to convert to the multi-medium data obtained in real time；

Data conversion unit is root in the case where acquisition in real time for the multi-medium data acquired in second end equipment The multi-medium data obtained in real time is converted according to the transformation parameter；And

Second transmission unit makes for being sent to first end equipment for the multi-medium data converted as feedback data Reference data can be obtained according to the feedback data by obtaining first end equipment, and the reference data is and the feedback coefficient Similarity between is not less than the data of first threshold；And

Person

22. device according to claim 21, which is characterized in that second transmission unit is also used in the second end In the case that multi-medium data acquired in equipment is non real-time acquisition, using the multi-medium data of non real-time acquisition as described anti- Feedback data are sent to first end equipment.