CN105472309B

CN105472309B - Data transmission method, device and system

Info

Publication number: CN105472309B
Application number: CN201511027876.6A
Authority: CN
Inventors: 盛波; 汤畅; 孙喆; 李泽文
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2015-12-31
Filing date: 2015-12-31
Publication date: 2020-03-10
Anticipated expiration: 2035-12-31
Also published as: CN105472309A

Abstract

The invention discloses a method, a device and a system for data transmission, and belongs to the technical field of computers. The method comprises the following steps: acquiring first distance information indicating a first distance between the conference terminal and a first participant terminal; generating a data request for requesting picture data corresponding to the first distance according to the first distance information, wherein the data request carries the first distance information; sending the data request for requesting the picture data corresponding to the first distance to a Multipoint Control Unit (MCU); receiving picture data corresponding to the first distance from the MCU; and sending the picture data corresponding to the first distance to the first participant terminal. By adopting the invention, the picture data displayed by the participant terminal can better meet the requirements of users.

Description

Data transmission method, device and system

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, and a system for data transmission.

Background

With the development of terminal technology, the application of the terminal is more and more extensive, and the function is more and more powerful. Among them, video conferencing is one of the functions that people commonly use. When a video conference is carried out, users in different conference places can watch videos, conference files and the like of other conference places in real time through a network.

In the process of performing a video conference, conference terminals in multiple conference sites may send local video data to an MCU (Multipoint Control Unit), the MCU may process a received video to generate a corresponding video, and send the video to the conference terminals in the conference sites, the conference terminals may display the video through a display device, and users in the conference sites may view videos of other conference sites. In order to facilitate each user in the conference place to watch the video, the user can establish communication connection with the conference terminal of the conference place by using a mobile terminal (or called as a conference participant terminal) such as a mobile phone or a tablet computer, and the conference terminal can send the received video to each mobile terminal, so that the user can watch the video by using the mobile phone or the tablet computer of the user.

The user in the meeting place can synchronously watch the video which is the same as the video displayed by the display device through the meeting participant terminal, however, the displayed pictures are repeated sometimes to cause the waste of the device (the meeting participant terminal), so that the requirement of the user is not met.

Disclosure of Invention

In order to solve the problems in the prior art, embodiments of the present invention provide a method, an apparatus, and a system for data transmission. The technical scheme is as follows:

in a first aspect, a method for data transmission is provided, where the method is performed by a conference terminal, and the method includes:

acquiring first distance information indicating a first distance between the conference terminal and a first participant terminal;

generating a data request for requesting picture data corresponding to the first distance according to the first distance information, wherein the data request for requesting the picture data corresponding to the first distance carries the first distance information;

sending the data request for requesting the picture data corresponding to the first distance to an MCU;

receiving picture data corresponding to the first distance from the MCU;

and sending the picture data corresponding to the first distance to the first participant terminal.

The user can carry a mobile terminal (i.e., a participant terminal) such as a mobile phone or a tablet computer during the process of participating in the video conference. The participant terminal can establish wireless connection with the conference terminal, and the connection establishment mode is various, for example, the connection establishment can be performed through a network or through ultrasonic pairing. Taking the example of establishing connection by ultrasonic pairing, a conference terminal may send an ultrasonic signal through connected sound equipment, the ultrasonic signal may be received by a receiver of a participant terminal, and then the participant terminal may detect the conference terminal and join its Wireless local area network Wi-Fi (Wireless Fidelity) network, thereby implementing seamless connection between the conference terminal and a mobile terminal. When a participant terminal (i.e., a first participant terminal) of a certain user establishes a connection with a conference terminal, the conference terminal may detect distance information between the first participant terminal and itself through a distance detection component. The conference terminal may send a data request for requesting the picture data corresponding to the first distance to the MCU, where the data request for requesting the picture data corresponding to the first distance may carry first distance information of the first distance to obtain picture data of a first picture combination type corresponding to the first distance, and then may send the obtained picture data to the first participant terminal, and the first participant terminal may display the picture data after receiving the picture data.

Based on the processing, the conference terminal can send different picture data to the participant terminals at different positions, so that the picture data displayed by the participant terminals can better meet the requirements of users.

With reference to the first aspect, in a first possible implementation manner of the first aspect, the method further includes: acquiring a first content type of content currently displayed by the conference terminal, wherein the first content type comprises a conference place video and a document; accordingly, the number of the first and second electrodes,

the data request for requesting the picture data corresponding to the first distance also carries the first content type;

accordingly, the picture data corresponding to the first distance includes picture data corresponding to the first distance and the first content type.

The content displayed by the conference terminal can be classified to obtain the content type of the content, and the content type can include a conference video and a document. The meeting place video content may be picture data generated by the MCU, and the document content may be document data of the video conference, such as PPT and word. The conference terminal may obtain the currently displayed content, may further determine a content type (i.e., a first content type) corresponding to the content, may then add the first content type to a data request for requesting the picture data corresponding to the first distance, and may send the data request to the MCU.

Therefore, the picture data needing to be pushed to the first participant terminal is determined by combining the currently displayed content of the conference terminal, so that the pushed picture data can better meet the requirements of users.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the obtaining first distance information indicating a first distance between the conference terminal and the first participant terminal includes:

sending an ultrasonic signal to the first meeting person terminal;

receiving an ultrasonic feedback signal corresponding to the ultrasonic signal from the first participant terminal;

and determining the first distance according to a first time difference between the sending time of the ultrasonic signal and the receiving time of the ultrasonic feedback signal.

The distance detection part may be an ultrasonic distance detection part in the related art, and the distance detection signal may be an ultrasonic signal. When the first participant terminal establishes a connection with the conference terminal, the distance detection unit of the conference terminal may transmit an ultrasonic signal to the conference terminal and record the transmission time. After receiving the ultrasonic signal, the first participant terminal can send an ultrasonic feedback signal to the conference terminal, and the conference terminal can receive the ultrasonic signal feedback signal sent by the first participant terminal and record the receiving time, so that the first time difference between the sending time and the receiving time can be calculated, and the first distance is calculated according to the time difference and the propagation speed of the ultrasonic wave.

Therefore, the distance grade of the participant terminal can be determined firstly, and then the corresponding picture combination type can be determined according to the distance grade of the participant terminal, the corresponding relation between each distance and the picture combination type does not need to be stored, the data quantity stored by the MCU can be reduced, and meanwhile, the processing efficiency of the MCU can be improved.

With reference to the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the ultrasonic feedback signal carries a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal;

the determining the first distance information according to a time difference between a transmission time of the ultrasonic signal and a reception time of the ultrasonic feedback signal includes:

and determining the first distance according to the first time difference and a second time difference between the receiving time of the ultrasonic signal received by the first participant terminal and the sending time of the ultrasonic feedback signal sent by the first participant terminal.

Wherein the ultrasonic feedback signal also carries the second time difference.

When the first participant terminal receives the ultrasonic signal, the current time (that is, the receiving time of the ultrasonic signal) may be recorded, and after the first participant terminal receives the ultrasonic signal, the first participant terminal may send the ultrasonic feedback signal to the conference terminal, may record the sending time of the ultrasonic feedback signal to be sent, may determine a time difference (that is, a second time difference) between the two times, and may add the second time difference to the ultrasonic feedback signal for sending. The second time difference may indicate a processing time between the reception of the ultrasonic signal and the transmission of the ultrasonic feedback signal by the primary participant terminal. The conference terminal may receive the ultrasonic signal feedback signal sent by the first participant terminal, may analyze the ultrasonic signal feedback signal to obtain a second time difference therein, may subtract the second time difference from the first time difference to obtain a difference therebetween, that is, after the propagation time of the ultrasonic signal and the propagation time of the ultrasonic signal feedback signal, may calculate the first distance according to the difference and the propagation speed of the ultrasonic wave.

Therefore, the first distance between the conference terminal and the first participant terminal can be calculated more accurately.

With reference to the first aspect to the third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, after the obtaining first distance information indicating a first distance between the conference terminal and a first conferee terminal, the method further includes:

acquiring second distance information indicating a second distance between the conference terminal and a second participant terminal, wherein the second participant terminal establishes communication connection with the conference terminal;

and when the second distance information is the same as the first distance information, sending the picture data corresponding to the first distance to the second participant terminal, so that the second participant terminal displays the picture data corresponding to the first distance.

The conference terminal may establish a communication connection with the second participant terminal, and may detect a second distance from the second participant terminal to the second participant terminal, and the conference terminal may determine whether the second distance information is the same as the first distance information, and may transmit picture data corresponding to the first distance to the second participant terminal if the conference terminal determines that the second distance information is the same as the first distance information, so that the second participant terminal displays the picture data corresponding to the first distance.

Therefore, after the second participant terminal establishes communication connection with the conference terminal, if the first conference terminal determines that the second distance information is the same as the first distance information, the picture data corresponding to the first distance can be directly sent to the second participant terminal, and therefore the processing efficiency can be improved.

With reference to the first aspect to the third possible implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, after the obtaining first distance information indicating a first distance between the conference terminal and a first conferee terminal, the method further includes:

sending a data request for requesting the picture data corresponding to the second distance to the MCU, wherein the data request for requesting the picture data corresponding to the second distance carries the second distance information;

receiving a feedback message from the MCU, the feedback message being used for requesting a data request of the picture data corresponding to the second distance, the feedback message carrying the first distance information, the feedback message being used for indicating that the picture data corresponding to the second distance is the picture data corresponding to the first distance;

and sending the picture data corresponding to the first distance to the second participant terminal so that the second participant terminal displays the picture data corresponding to the first distance.

The conference terminal may establish a communication connection with the second participant terminal, may detect a second distance between the conference terminal and the second participant terminal, and may send a data request for requesting picture data corresponding to the second distance to the MCU, where the data request for requesting the picture data corresponding to the second distance carries second distance information of the second distance. After receiving the data request for requesting the picture data corresponding to the second distance, the MCU may determine whether the second distance information is the same as the first distance information, and if the MCU determines that the second distance information is the same as the first distance information, the MCU may send a feedback message to the conference terminal for requesting the data request for the picture data corresponding to the second distance, where the feedback message may carry the first distance information. The conference terminal may receive a feedback message from the MCU, where the feedback message may carry the first distance information, and the conference terminal may determine that the picture data corresponding to the second distance is the picture data corresponding to the first distance. The conference terminal may transmit the picture data corresponding to the first distance to the second participant terminal, so that the second participant terminal displays the picture data corresponding to the first distance.

Thus, if the second distance information is the same as the first distance information, the feedback message can be sent to the conference terminal without repeatedly sending the picture data, so that the data volume of transmission can be reduced, and the bandwidth can be saved.

With reference to the first aspect to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner of the first aspect, the first distance information includes a distance level corresponding to the first distance.

With reference to the first aspect to the sixth possible implementation manner of the first aspect, in a seventh possible implementation manner of the first aspect, the method further includes:

and sending the first distance information to the first participant terminal so that the first participant terminal displays the first distance information.

After the conference terminal determines the distance grade corresponding to the first participant terminal, a distance prompt message can be sent to the first participant terminal, the distance prompt message carries first distance information corresponding to the first participant terminal, the first distance information can be the distance grade, the first participant terminal can receive the distance prompt message, and then a corresponding push message can be displayed, if the distance grade of your present is the middle distance grade.

With reference to the first aspect to the seventh possible implementation manner of the first aspect, the obtaining first distance information indicating a first distance between the conference terminal and the first participant terminal includes:

and when the preset detection period is reached, detecting first distance information of the conference terminal relative to a first participant terminal which establishes communication connection with the conference terminal.

The conference terminal can preset a detection period, and the conference terminal can acquire first distance information indicating a first distance between the conference terminal and the first participant terminal when the preset detection period is reached.

Therefore, if the position of the first participant terminal is changed, the conference terminal can timely know and can resend the data request, so that the user can see a proper picture video.

In a second aspect, a method for data transmission is provided, where the method is performed by an MCU, and the method includes:

receiving a data request for requesting picture data corresponding to the first distance from a conference terminal, wherein the data request for requesting the picture data corresponding to the first distance carries first distance information indicating the first distance, the first distance is a distance between the conference terminal and a first participant terminal, and the conference terminal and the first participant terminal establish communication connection;

determining a first picture combination type corresponding to the first distance according to the first distance information and a first corresponding relation between the distance information and the picture combination type;

generating picture data corresponding to the first distance according to the first picture combination type;

and sending the picture data corresponding to the first distance to the conference terminal so that the first participant terminal displays the picture data corresponding to the first distance.

The MCU may receive a data request for requesting picture data corresponding to the first distance, which is sent by the conference terminal, and then may acquire first distance information in the data request for requesting picture data corresponding to the first distance. The technician can set the picture combination types corresponding to different distances in the MCU. The MCU can correspondingly store different distance information and picture combination types. The MCU may search for a first picture combination type corresponding to the first distance in the correspondence between the distance information and the picture combination type, and then may send picture data of the first picture combination type to the conference terminal.

With reference to the second aspect, in a first possible implementation manner of the second aspect, the first distance information includes a distance grade corresponding to the first distance.

With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner of the second aspect, the determining, according to the first distance information and the first corresponding relationship between the distance information and the picture combination type, a first picture combination type corresponding to the first distance includes:

if the first distance information is a long-distance grade, determining that the picture combination type corresponding to the first distance is used for indicating that the picture data corresponding to the first distance comprises the picture data displayed by the conference terminal; alternatively, the first and second electrodes may be,

if the first distance information is of a medium distance grade, determining that the picture combination type corresponding to the first distance is used for indicating that the picture data corresponding to the first distance comprises picture data displayed by the conference terminal and picture data collected by at least one conference terminal except the conference terminal; alternatively, the first and second electrodes may be,

and if the first distance information is in a close range grade, determining that the picture combination type corresponding to the first distance is used for indicating that the picture data corresponding to the first distance comprises picture data acquired by at least one conference terminal except the conference terminal.

With reference to the second aspect to the second possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the generating, according to the first picture combination type, picture data corresponding to the first distance includes:

acquiring picture data displayed by at least one conference terminal corresponding to the first picture combination type according to the first picture combination type;

and acquiring the picture data corresponding to the first distance according to the picture data displayed by at least one conference terminal corresponding to the first picture combination type.

The MCU can establish communication connection with a plurality of conference terminals and can receive video data transmitted by each conference terminal which establishes communication connection with the MCU. The MCU may acquire, from the received video data sent by each conference terminal, picture data displayed by at least one conference terminal corresponding to the first picture combination type, and acquire, according to the picture data displayed by the at least one conference terminal corresponding to the first picture combination type, picture data corresponding to the first distance.

With reference to the second aspect to the third possible implementation manner of the second aspect, in a fourth possible implementation manner of the second aspect, the data request for requesting the picture data corresponding to the first distance further carries a first content type of content currently displayed by the conference terminal, where the first content type includes a conference hall video and a document, and the first corresponding relationship includes a second corresponding relationship between a picture combination type and distance information and a content type;

the determining, according to the first distance information, a first picture combination type corresponding to the first distance includes: and determining a first picture combination type corresponding to the first distance and the first content type according to the first distance information, the first content type and the second corresponding relation.

The MCU may pre-store the correspondence between the distance information, the content type of the conference terminal, and the picture combination type. The content types may include meeting place videos and documents. For the case that the content type is the conference place video, the corresponding relationship between the distance information, the content type of the conference terminal and the picture combination type may be the same as the above corresponding relationship, and is not described again; for the case where the content type is a document, the correspondence between the distance information, the content type of the conference terminal, and the picture combination type may be: the picture combination type corresponding to the remote level can be the picture combination type of the document data displayed by the conference terminal and the video data of the document speaker; the picture combination type corresponding to the middle distance level may be a picture combination type of document data plus video data of at least one conference terminal, and the picture combination type corresponding to the short distance level may be a picture combination type including video data of at least one conference terminal. The MCU may acquire a first content type and first distance information carried in a data request for requesting the picture data corresponding to the first distance, and then may query a corresponding picture combination type in a correspondence relationship between the distance information and the content type and picture combination type of the conference terminal, so as to perform subsequent processing.

Therefore, the picture data needing to be pushed to the first participant terminal is determined by combining the data content currently displayed by the conference terminal, so that the pushed picture data can better meet the requirements of users.

With reference to the second aspect to the fourth possible implementation manner of the second aspect, in a fifth possible implementation manner of the second aspect, the method further includes:

receiving a data request for requesting picture data corresponding to the second distance from a conference terminal, wherein the data request for requesting the picture data corresponding to the second distance carries second distance information indicating the second distance, the second distance is a distance between the conference terminal and a second participant terminal, and the conference terminal and the second participant terminal establish communication connection;

and if the second distance is the same as the first distance, sending a feedback message of the data request for requesting the picture data corresponding to the second distance to the conference terminal, wherein the feedback message carries the first distance information, and the feedback message is used for indicating that the picture data corresponding to the second distance is the picture data corresponding to the first distance.

In a third aspect, a method for data transmission is provided, where the method is performed by a conference terminal, and the method includes:

receiving a data request for requesting picture data corresponding to a second picture combination type from a first conference terminal, wherein the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

sending a data request for requesting picture data corresponding to the second picture combination type to an MCU, wherein the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

receiving picture data corresponding to the second picture combination type from the MCU;

and sending the picture data corresponding to the second picture combination type to the first participant terminal.

The user may select a picture combination type from the picture combination type list, the first participant terminal may send a data request for requesting picture data corresponding to the second picture combination type to the conference terminal, and the data request for requesting the picture data corresponding to the second picture combination type may carry the second picture combination type selected by the user. After receiving a data request for requesting picture data corresponding to a second picture combination type, the conference terminal may acquire the second picture combination type carried in the data request, then send a data request for requesting the picture data corresponding to the second picture combination type to the MCU, where the data request carries the second picture combination type to acquire the picture data corresponding to the second picture combination type, then may send the picture data of the second picture combination type to the first participant terminal, and stop sending the picture data corresponding to the first picture combination type to the first participant terminal. The primary participant terminal may display the picture data of the second picture combination type.

Thus, the user can select the picture data of the picture combination type which the user wants to watch according to the preference of the user.

In a fourth aspect, a method for data transmission is provided, where the method is performed by an MCU, and the method includes:

receiving a data request for requesting picture data corresponding to the second picture combination type from a conference terminal, wherein the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

generating picture data corresponding to the second picture combination type according to the second picture combination type;

and sending the picture data corresponding to the second picture combination type to the conference terminal.

The user may select a picture combination type from the picture combination type list, and the first participant terminal may send a third data request to the conference terminal, where the third data request may carry the second picture combination type selected by the user. After receiving the third data request, the conference terminal may obtain a second picture combination type carried in the third data request, then send a data request for requesting picture data corresponding to the second picture combination type to the MCU, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type, the MCU may receive a data request for requesting picture data corresponding to the second picture combination type from the conference terminal, then may parse the data request for requesting picture data corresponding to the second picture combination type, obtain a second picture combination type carried in the data request for requesting picture data corresponding to the second picture combination type, and further may generate picture data corresponding to the second picture combination type according to the second picture combination type, and then sending the picture data corresponding to the second picture combination type to the conference terminal.

In a fifth aspect, there is provided a conference terminal comprising a processor, a receiver and a transmitter, wherein:

the processor is used for acquiring first distance information indicating a first distance between the conference terminal and a first participant terminal;

the processor is further configured to generate a data request for requesting picture data corresponding to the first distance according to the first distance information, where the data request for requesting picture data corresponding to the first distance carries the first distance information;

the transmitter is used for transmitting the data request for requesting the picture data corresponding to the first distance to the MCU;

the receiver is used for receiving the picture data corresponding to the first distance from the MCU;

the transmitter is further configured to send, to the first participant terminal, picture data corresponding to the first distance received by the receiver.

With reference to the fifth aspect, in a first possible implementation manner of the fifth aspect, the processor is further configured to

Acquiring a first content type of content currently displayed by the conference terminal, wherein the first content type comprises a conference place video and a document; accordingly, the number of the first and second electrodes,

With reference to the fifth aspect or the first possible implementation manner of the fifth aspect, in a second possible implementation manner of the fifth aspect, the transmitter is configured to transmit an ultrasonic signal to the first and second party terminals;

the receiver is used for receiving an ultrasonic feedback signal corresponding to the ultrasonic signal from the first participant terminal; accordingly, the method can be used for solving the problems that,

the processor is configured to determine the first distance according to a first time difference between a sending time of the ultrasonic signal and a receiving time of the ultrasonic feedback signal.

With reference to the second possible implementation manner of the fifth aspect, in a third possible implementation manner of the fifth aspect, the ultrasonic feedback signal carries a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal;

the processor is configured to:

With reference to the third possible implementation manner of the fifth aspect to the fifth aspect, in a fourth possible implementation manner of the fifth aspect, the processor is further configured to:

acquiring second distance information indicating a second distance between the conference terminal and a second participant terminal;

the transmitter is further configured to send the picture data corresponding to the first distance to the second participant terminal when the processor determines that the second distance information is the same as the first distance information, so that the second participant terminal displays the picture data corresponding to the first distance.

With reference to the third possible implementation manner of the fifth aspect, in a fifth possible implementation manner of the fifth aspect, the processor is further configured to:

the transmitter is further configured to:

sending a data request for requesting the picture data corresponding to the second distance to the MCU, wherein the data request for requesting the picture data corresponding to the second distance carries second distance information acquired by the processor;

the receiver is further configured to:

the transmitter is further configured to:

and sending the picture data corresponding to the first distance to the second participant terminal.

With reference to the fifth possible implementation manner of the fifth aspect to the fifth aspect, in a sixth possible implementation manner of the fifth aspect, the first distance information includes a distance grade corresponding to the first distance.

With reference to the sixth possible implementation manner of the fifth aspect to the fifth aspect, in a seventh possible implementation manner of the fifth aspect, the transceiver is further configured to:

In a sixth aspect, there is provided an MCU comprising a receiver, a transmitter, a processor and a memory, wherein:

the receiver is configured to receive a data request for requesting picture data corresponding to the first distance from a conference terminal, where the data request for requesting the picture data corresponding to the first distance carries first distance information indicating the first distance, and the first distance is a distance between the conference terminal and a first participant terminal;

the processor is configured to determine a first picture combination type corresponding to the first distance according to the first distance information received by the receiver and a first corresponding relationship between the distance information and the picture combination type, where the distance information is stored in the memory;

the processor is further configured to generate picture data corresponding to the first distance according to the first picture combination type;

and the transmitter is used for sending the picture data corresponding to the first distance generated by the processor to the conference terminal.

With reference to the sixth aspect, in a first possible implementation manner of the sixth aspect, the first distance information includes a distance rank corresponding to the first distance.

With reference to the sixth aspect, in a second possible implementation manner of the sixth aspect, the distance ranking includes at least one of a far distance ranking, a medium distance ranking and a near distance ranking, and the processor is configured to:

and if the first distance information is in a close range grade, determining that the picture combination type corresponding to the first distance is used for indicating that the picture data corresponding to the first distance comprises picture data collected by at least one conference terminal except the picture data displayed by the conference terminal.

With reference to the second possible implementation manner of the sixth aspect, in a third possible implementation manner of the sixth aspect, the processor is further configured to:

With reference to the sixth aspect to the third possible implementation manner of the sixth aspect, in a fourth possible implementation manner of the sixth aspect, the data request for requesting the picture data corresponding to the first distance further carries a first content type of a content currently displayed by the conference terminal, where the first content type includes a conference site video and a document;

the processor is configured to: and determining a first picture combination type corresponding to the first distance and the first content type according to the first distance information, the first content type and the second corresponding relation.

With reference to the fourth possible implementation manner of the sixth aspect, in a fifth possible implementation manner of the sixth aspect, the receiver is further configured to:

receiving a data request for requesting picture data corresponding to the second distance from a conference terminal, wherein the data request for requesting the picture data corresponding to the second distance carries second distance information indicating the second distance, and the second distance is the distance between the conference terminal and a second participant terminal;

the transmitter is further configured to: and if the processor determines that the second distance is the same as the first distance, sending a feedback message of the data request for requesting the picture data corresponding to the second distance to the conference terminal, wherein the feedback message carries the first distance information, and the feedback message is used for indicating that the picture data corresponding to the second distance is the picture data corresponding to the first distance.

In a seventh aspect, a conference terminal is provided, the conference terminal comprising a receiver and a transmitter:

the receiver is used for receiving a data request for requesting picture data corresponding to a second picture combination type from a first conference terminal, wherein the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

the transmitter is further configured to send a data request for requesting picture data corresponding to the second picture combination type to an MCU, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

the receiver is further configured to receive picture data corresponding to the second picture combination type from the MCU;

and the transmitter is further configured to send picture data corresponding to the second picture combination type to the first participant terminal.

In an eighth aspect, there is provided an MCU comprising a receiver, a transmitter and a processor:

the receiver is configured to receive a data request for requesting picture data corresponding to the second picture combination type from a conference terminal, where the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

the processor is configured to generate picture data corresponding to the second picture combination type according to the second picture combination type received by the receiver;

and the transmitter is further configured to send the picture data corresponding to the second picture combination type to the conference terminal.

In a ninth aspect, there is provided a conference terminal, comprising:

the distance detection module is used for acquiring first distance information indicating a first distance between the conference terminal and a first participant terminal;

a generating module, configured to generate, according to the first distance information, a data request for requesting picture data corresponding to the first distance, where the data request carries the first distance information;

the sending module is used for sending the data request for requesting the picture data corresponding to the first distance to the MCU;

the receiving module is used for receiving the picture data corresponding to the first distance from the MCU;

the sending module is further configured to send the picture data corresponding to the first distance to the first participant terminal.

With reference to the ninth aspect, in a first possible implementation manner of the ninth aspect, the conference terminal further includes an obtaining module;

the acquisition module is used for acquiring a first content type of the content currently displayed by the conference terminal, wherein the first content type comprises a conference place video and a document; accordingly, the number of the first and second electrodes,

With reference to the ninth aspect or the first possible implementation manner of the ninth aspect, in a second possible implementation manner of the ninth aspect, the distance detection module is further configured to:

sending an ultrasonic signal to the first meeting person terminal;

With reference to the second possible implementation manner of the ninth aspect, in a third possible implementation manner of the ninth aspect, the ultrasonic feedback signal carries a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal;

the distance detection module is further configured to:

With reference to the ninth aspect to the third possible implementation manner of the ninth aspect, in a fourth possible implementation manner of the ninth aspect, the distance detection module is further configured to:

the sending module is further configured to:

and when the second distance information is the same as the first distance information, sending the picture data corresponding to the first distance to the second participant terminal so that the second participant terminal displays the picture data corresponding to the first distance.

With reference to the third possible implementation manner of the ninth aspect, in a fifth possible implementation manner of the ninth aspect, the distance detection module is further configured to:

the sending module is further configured to:

the receiving module is further configured to:

the sending module is further configured to:

With reference to the ninth aspect to the fifth possible implementation manner of the ninth aspect, in a sixth possible implementation manner of the ninth aspect, the first distance information includes a distance grade corresponding to the first distance.

With reference to the ninth aspect to the sixth possible implementation manner of the ninth aspect, in a seventh possible implementation manner of the ninth aspect, the sending module is further configured to:

In a tenth aspect, there is provided an MCU comprising:

a receiving module, configured to receive a data request for requesting picture data corresponding to the first distance from a conference terminal, where the data request for requesting the picture data corresponding to the first distance carries first distance information indicating the first distance, the first distance is a distance between the conference terminal and a first participant terminal, and the conference terminal establishes a communication connection with the first participant terminal;

a determining module, configured to determine, according to the first distance information and a first corresponding relationship between the distance information and a picture combination type, a first picture combination type corresponding to the first distance;

a generating module, configured to generate, according to the first picture combination type, picture data corresponding to the first distance;

and the sending module is used for sending the picture data corresponding to the first distance to the conference terminal so that the first participant terminal displays the picture data corresponding to the first distance.

With reference to the tenth aspect, in a first possible implementation manner of the tenth aspect, the first distance information includes a distance grade corresponding to the first distance.

With reference to the tenth aspect, in a second possible implementation manner of the tenth aspect, the distance level includes at least one of a long distance level, a medium distance level, and a short distance level, and the determining module is further configured to:

With reference to the tenth aspect to the second possible implementation manner of the tenth aspect, in a third possible implementation manner of the tenth aspect, the data request for requesting the picture data corresponding to the first distance further carries a first content type of a content currently displayed by the conference terminal, where the first content type includes a conference site video and a document;

the determining module is further configured to:

and determining a first picture combination type corresponding to the first distance and the first content type according to the first distance information, the first content type and the second corresponding relation.

With reference to the tenth aspect to the third possible implementation manner of the tenth aspect, in a fourth possible implementation manner of the tenth aspect, the receiving module is further configured to:

the sending module is also used for

In an eleventh aspect, there is provided a conference terminal, including:

a receiving module, configured to receive a data request for requesting picture data corresponding to a second picture combination type from a first and a second conference terminal, where the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

a sending module, configured to send, to an MCU, a data request for requesting picture data corresponding to the second picture combination type, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

the receiving module is further configured to receive picture data corresponding to the second picture combination type from the MCU;

the sending module is further configured to send the picture data corresponding to the second picture combination type to the first participant terminal.

In a twelfth aspect, an MCU is provided, wherein the MCU includes:

a receiving module, configured to receive a data request for requesting picture data corresponding to the second picture combination type from a conference terminal, where the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

the generating module is used for generating picture data corresponding to the second picture combination type according to the second picture combination type;

and the sending module is used for sending the picture data corresponding to the second picture combination type to the conference terminal.

In a thirteenth aspect, a system for data transmission is provided, where the system includes a conference terminal and an MCU, and where:

the conference terminal is configured to acquire first distance information indicating a first distance between the conference terminal and a first participant terminal, generate a data request for requesting picture data corresponding to the first distance according to the first distance information, carry the first distance information in the data request for requesting the picture data corresponding to the first distance, and send the data request for requesting the picture data corresponding to the first distance to an MCU;

the MCU is used for receiving a data request for requesting the picture data corresponding to the first distance from the conference terminal, determining a first picture combination type corresponding to the first distance according to the first distance information and a first corresponding relation between the distance information and the picture combination type, generating the picture data corresponding to the first distance according to the first picture combination type, and sending the picture data corresponding to the first distance to the conference terminal;

and the conference terminal is further used for receiving the picture data corresponding to the first distance from the MCU and sending the picture data corresponding to the first distance to the first participant terminal.

Possible implementations of the system may refer to implementations of the conference terminal and the MCU.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a system framework diagram provided by an embodiment of the invention;

fig. 2 is a schematic structural diagram of a conference terminal according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a server according to an embodiment of the present invention;

fig. 4 is a flowchart of a method for data transmission according to an embodiment of the present invention;

FIGS. 5a, 5b, 5c and 5d are schematic diagrams of interface displays provided by embodiments of the present invention;

6a, 6b, 6c and 6d are schematic diagrams of interface displays provided by embodiments of the present invention;

fig. 7 is a flowchart of a method for data transmission according to an embodiment of the present invention;

fig. 8 is a flowchart of a method for data transmission according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of a conference terminal according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of a conference terminal according to an embodiment of the present invention;

fig. 11 is a schematic structural diagram of a server according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The embodiment of the invention provides a data transmission method which can be executed by a conference terminal and a server together. In addition, the functions of the server may also be integrated into the conference terminal and executed by the conference terminal, which is described in this embodiment with the conference terminal and the server being executed together as an example, and other cases are similar and will not be described again. The server may be an MCU (multi control unit). Fig. 1 is a system framework diagram of an embodiment of the present invention, which includes a conference terminal, a participant terminal, and an MCU.

In implementation, each conference place can be provided with a respective conference terminal, and each conference terminal can be connected with the camera device and the display device of the corresponding conference place and can be connected with the MCU. The conference terminal can also establish communication connection with the participant terminal in the conference place. The participant terminal can be a mobile terminal such as a mobile phone or a tablet computer. In the process of carrying out the video conference, for any meeting place, the camera device of the meeting place can shoot the video of the meeting place, and then can send the shot video data to the conference terminal, and the conference terminal can send the received video data to the MCU. The MCU can be connected with the conference terminals of all the conference places and receives video data sent by the conference terminals of all the conference places. Technicians can call a management interface of the MCU through terminals such as a notebook computer and the like, and the picture combination type of picture data required to be displayed by each conference room is set in the management interface, for example, the picture combination type of each conference room can be a video only comprising a main conference room, or a video also comprising the main conference room and a plurality of other conference rooms. The MCU can reduce the video pictures of a plurality of meeting places according to picture combination types set by technicians in a certain proportion to form a large picture, the large picture is used as one path of picture data and is sent to the meeting terminals of all the meeting places, the meeting terminals can decode the received picture data and respectively send the decoded image data and audio data to the display equipment and the audio equipment of the corresponding meeting places, and the display equipment and the audio equipment can output the image data and the audio data of the picture data.

The conference terminal may include a processor 210, a receiver 220, and a transmitter 230, and the receiver 220 and the transmitter 230 may be respectively connected to the processor 210, as shown in fig. 2. The receiver 220 may be used to receive messages, data, or ultrasonic feedback signals, and the receiver 220 may include, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. The receiver 220 may receive an analog signal or a digital signal and then transmit the digital signal to the processor 210 so that the processor 210 may process the received data. The transmitter 230 may be used to transmit messages, data, or ultrasonic signals, and similar to the structure of the receiver 220, the transmitter 230 may include, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a coupler, an LNA (low noise Amplifier), a duplexer, and the like. The processor 210 may be a control center of the conference terminal, and may connect various portions of the entire conference terminal, such as the receiver 220 and the transmitter 230, using various interfaces and lines. Optionally, processor 210 may include one or more processing units; preferably, the processor 210 may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems and the modem processor primarily handles wireless communications. The processor 210 may also be a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, or the like. The conference terminal may further include a memory for storing software programs and modules, and the processor 210 performs various functional applications and data processing of the lecture terminal by reading the software codes and modules stored in the memory.

The server may include a transceiver receiver 310, a transmitter 320, a processor 330, and a memory 340, and the receiver 310, the transmitter 320, and the memory 340 may be connected to the processor 330, respectively, as shown in fig. 3. The transceiver 310 may be used for transceiving messages or data, and the receiver 310 may include, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like, for receiving messages or data. Similar to the structure of the receiver 320, the transmitter 320 may also include, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. for transmitting messages or data. The processor 330 may be a control center of the server, connect various parts of the entire server using various interfaces and lines, perform various functions of the server and process data by running or executing software programs and/or modules stored in the memory 340 and calling data stored in the memory 340, thereby performing overall monitoring of the server. Processor 330 may include one or more processing units; the Processor 330 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, etc. The memory 340 may be used to store programs. In particular, the program may include program code including computer operating instructions. The memory 340 may comprise RAM, and may further comprise non-volatile memory (non-volatile memory), such as at least one disk memory. Processor 330 executes program code stored in memory 340 in order to carry out various functions of the processor in embodiments of the present invention.

As shown in fig. 4, the processing flow of the method may be as follows:

step 401, a conference terminal acquires first distance information indicating a first distance between the conference terminal and a first participant terminal.

In implementation, a user may carry a mobile terminal (i.e., a participant terminal) such as a mobile phone or a tablet computer during a video conference, and the participant terminal may store a code for establishing a connection with the conference terminal and a code for playing picture data of the video conference in advance. The connection between the participant terminal and the conference terminal can be established in various ways, for example, the connection can be established through a network, or the connection can be established through ultrasonic pairing. Taking the example of establishing connection by ultrasonic pairing, the conference terminal can send out an ultrasonic signal through connected sound equipment, the ultrasonic signal can be received and identified by a receiver of the participant terminal, and then the participant terminal can detect the conference terminal and join the Wi-Fi network of the conference terminal, so that seamless connection between the conference terminal and the mobile terminal is realized.

The conference terminal may be provided with a distance detection component, and the distance detection component may be various, such as a laser distance sensor or an ultrasonic distance sensor in the prior art, which is not limited in this embodiment. When a participant terminal (i.e., a first participant terminal) of a certain user establishes a connection with a conference terminal, the conference terminal may detect a distance between the first participant terminal and itself through a distance detection component. The conference terminal can store the corresponding relation between the participant terminal and the distance, and after the first conference terminal and the terminal detect the distance information between the first conference terminal and the first participant terminal, the identifier of the first conference terminal and the distance information can be added into the corresponding relation between the participant terminal and the distance information.

Alternatively, the distance between the participant terminal and the conference terminal may be detected by an ultrasonic distance sensor, and accordingly, the processing procedure of step 401 may be as follows: sending an ultrasonic signal to a first meeting person terminal; receiving an ultrasonic feedback signal corresponding to an ultrasonic signal from a first participant terminal; the first distance is determined based on a first time difference between a transmission time of the ultrasonic signal and a reception time of the ultrasonic feedback signal.

In implementation, the distance detection unit may be an ultrasonic distance detection unit in the prior art, and the distance detection signal may be an ultrasonic signal. When the first participant terminal establishes a connection with the conference terminal, the distance detection unit of the conference terminal may transmit an ultrasonic signal to the conference terminal and record the transmission time. After receiving the ultrasonic signal, the first participant terminal can send an ultrasonic feedback signal to the conference terminal, and the conference terminal can receive the ultrasonic signal feedback signal sent by the first participant terminal and record the receiving time, so that the first time difference between the sending time and the receiving time can be calculated, and the first distance is calculated according to the time difference and the propagation speed of the ultrasonic wave.

Optionally, the ultrasonic feedback signal may carry a second time difference between a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal, and correspondingly, the processing procedure may be as follows: and determining the first distance according to the first time difference and the second time difference.

In an implementation, when the first participant terminal receives the ultrasonic signal, the current time (that is, the receiving time of the ultrasonic signal) may be recorded, and after receiving the ultrasonic signal, the first participant terminal may transmit the ultrasonic feedback signal to the conference terminal, may record the transmission time of the ultrasonic feedback signal to be transmitted, may determine a time difference (that is, a second time difference) between the two times, and may add the second time difference to the ultrasonic feedback signal for transmission. The second time difference may indicate a processing time between the reception of the ultrasonic signal and the transmission of the ultrasonic feedback signal by the primary participant terminal. The conference terminal may receive the ultrasonic signal feedback signal sent by the first participant terminal, may analyze the ultrasonic signal feedback signal to obtain a second time difference therein, may subtract the second time difference from the first time difference to obtain a difference therebetween, that is, after the propagation time of the ultrasonic signal and the propagation time of the ultrasonic signal feedback signal, may calculate the first distance according to the difference and the propagation speed of the ultrasonic wave. In addition, the ultrasonic feedback signal may also carry a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal, and after receiving the ultrasonic feedback signal, the conference terminal may calculate a second time difference between the receiving time at which the first participant terminal receives the ultrasonic signal and the sending time at which the first participant terminal sends the ultrasonic feedback signal, and then calculate the first distance according to the first time difference and the second time difference.

Optionally, the first distance information includes a distance grade corresponding to the first distance.

In an implementation, the conference terminal may classify the connected conferee terminals according to distance, and the first distance information may include a distance class. The corresponding relationship between the distance range and the distance level may be prestored in the conference terminal, and then the distance range to which the calculated first distance belongs may be determined, and then the distance level corresponding to the distance range is determined, the number of the distance levels may be set by a technician at will, which is not limited in this embodiment. For example, if the distance range corresponding to the near distance level is (0,10m), the distance range corresponding to the intermediate distance level is [10m,25m ], the distance range corresponding to the far distance level is (25m, + ∞) and the calculated first distance is 15m, the distance level corresponding to the first participant terminal can be determined to be intermediate. In addition, the conference terminal may also store a time difference range in advance, and determine the distance level corresponding to the first participant terminal according to the determined time difference.

Optionally, the user may be notified of the current distance to the conference terminal, and the corresponding processing procedure may be as follows: and sending the first distance information to the first participant terminal so that the first participant terminal displays the first distance information.

In implementation, after determining the distance class corresponding to the first participant terminal, the conference terminal may send a distance prompt message to the first participant terminal, where the distance prompt message carries first distance information corresponding to the first participant terminal, where the first distance information may be a distance class, and the first participant terminal may receive the distance prompt message and may then display a corresponding push message, where "the current distance class of you is a middle distance class".

Optionally, the conference terminal may detect, in real time, distance information between the first participant terminal and the conference terminal, and correspondingly, the processing procedure in step 401 may be as follows: and when the preset detection period is reached, detecting first distance information of the conference terminal relative to a first participant terminal establishing communication connection with the conference terminal.

In implementation, a detection period can be preset in the conference terminal, and the conference terminal can detect the distance information of the conference terminal relative to the first participant terminal when the preset detection period is reached, so that if the position of the first participant terminal is changed, the conference terminal can timely know, and then can resend the data request, so that a user can see appropriate picture data.

Step 402, the conference terminal generates a data request for requesting picture data corresponding to a first distance according to the first distance information, wherein the data request for requesting the picture data corresponding to the first distance carries the first distance information.

In an implementation, after detecting a first distance between the conference terminal and the first participant terminal, the conference terminal adds first distance information to a data request, which may be a data request for requesting picture data corresponding to the first distance, and for convenience of description, the data request may be referred to as a first data request.

Optionally, the corresponding picture combination type may be determined according to the first distance information and the content type of the data content currently displayed by the conference terminal, and correspondingly, the conference terminal may obtain a first content type of the currently displayed content, where the first content type includes a conference room video and a document; accordingly, the data request for requesting the picture data corresponding to the first distance may carry a first content type.

In implementation, the content displayed by the conference terminal may be classified to obtain the content type of the content, and the content type may include a conference video and a document. The meeting place video content may be picture data generated by the MCU, and the document content may be document data of the video conference, such as PPT and word. The conference terminal may obtain the currently displayed content, may further determine a content type (i.e., a first content type) corresponding to the content, may then add the first content type to the first data request, and may send the first data request to the MCU.

In step 403, the conference terminal sends a first data request to the MCU.

In implementation, after detecting a first distance between the conference terminal and the first participant terminal, the conference terminal may send a first data request to the MCU, where the first data request carries distance information of the first distance. In addition, for the above situation of obtaining the first content type of the data content currently displayed by the conference terminal, correspondingly, the first content type may be added to the first data request, and then the first data request may be sent to the MCU, so that the first data request may carry the first distance information and the first content type.

In step 404, the MCU receives a first data request from the conference terminal, where the first data request carries first distance information indicating a first distance, where the first distance is a distance between the first conference participant terminal and the first conference participant terminal.

In implementation, the MCU may receive a first data request sent by the conference terminal, and then may parse the first data request to obtain first distance information carried in the first data request, so as to perform subsequent processing.

In step 405, the MCU determines a first picture combination type corresponding to the first distance according to the first distance information and the first corresponding relationship between the distance information and the picture combination type.

In implementation, a technician may set picture combination types corresponding to different distances in the MCU. The MCU may correspondingly store the distance information and the picture combination type at different distances, and establish a corresponding relationship (i.e., a first corresponding relationship) between the distance and the picture combination type. Taking the distance information as a long-distance grade, a medium-distance grade and a short-distance grade as examples, the picture combination type corresponding to the long-distance grade is used for indicating that the picture data corresponding to the first distance comprises the picture data displayed by the conference terminal; the picture combination type corresponding to the middle distance grade is used for indicating that the picture data corresponding to the first distance comprises picture data displayed by the conference terminal and picture data collected by at least one conference terminal except the conference terminal; the picture combination type corresponding to the close range grade is used for indicating that the picture data corresponding to the first distance comprises picture data collected by at least one conference terminal except the conference terminal.

After receiving the first data request, the MCU may search for a first picture combination type corresponding to a distance of the first distance in the first data request in the correspondence, so as to perform subsequent processing.

Optionally, for a case that the first data request further carries a first content type of content currently displayed by the conference terminal, correspondingly, the first corresponding relationship may include a second corresponding relationship between a picture combination type and the distance information, and the content type, and the processing procedure of step 405 may be as follows: and determining a first picture combination type corresponding to the first distance and the first content type according to the first distance information, the first content type and the second corresponding relation.

In an implementation, the first corresponding relationship may include a second corresponding relationship between the picture combination type and the distance information and the content type, that is, the MCU may store the corresponding relationship among the distance information, the content type of the conference terminal, and the picture combination type in advance. Wherein the distance information may be a distance rating and the content type may include a meeting place video and a document. For the case that the content type is the conference place video, the corresponding relationship between the distance information, the content type of the conference terminal and the picture combination type may be the same as the above corresponding relationship, and is not described again; for the case where the content type is a document, the correspondence between the distance information, the content type of the conference terminal, and the picture combination type may be: the picture combination type corresponding to the remote level can be the picture combination type of the document data displayed by the conference terminal and the video data of the document speaker; the picture combination type corresponding to the middle distance level may be a picture combination type of document data plus video data of at least one conference terminal, and the picture combination type corresponding to the short distance level may be a picture combination type including video data of at least one conference terminal. The screen combination type corresponding to the close range level may be a screen combination type including video data of a document presenter and the number of videos of at least one conference terminal.

For example, the MCU is connected to conference site a, conference site B, conference site C, conference site D, conference site E and conference site F, the user is at conference site B, the conference terminal of conference site B displays document data, as shown in fig. 6a, the picture combination type corresponding to the long-distance level is the picture combination type of the document data plus the video data of the document speaker, the display interface of the corresponding first participant terminal may be as shown in fig. 6b, the picture combination type corresponding to the medium-distance level is the picture combination type of the document data plus the video data of the meeting place C, the meeting place D and the meeting place E, the display interface of the corresponding first participant terminal may be as shown in fig. 6C, the picture combination type corresponding to the short-distance level is the picture combination type of the video data of the document speaker plus the video data of the meeting place C, the meeting place D and the meeting place E, and the display interface of the corresponding first participant terminal may be as shown in fig. 6D.

The MCU may acquire the first content type and the first distance information carried in the first data request, and then may query a corresponding picture combination type in the correspondence between the distance information and the content type and the picture combination type of the conference terminal, so as to perform subsequent processing.

In step 406, the MCU generates picture data corresponding to the first distance according to the first picture combination type.

In implementation, after the MCU determines the corresponding first picture combination type, picture data corresponding to the first distance may be generated according to the first picture combination type. If the first distance information is the long-distance grade, determining that the picture combination type corresponding to the first distance is used for indicating that the picture data corresponding to the first distance comprises the picture data displayed by the conference terminal; or if the first distance information is of a medium distance grade, determining that the picture combination type corresponding to the first distance is used for indicating that the picture data corresponding to the first distance comprises picture data displayed by the conference terminal and video data of at least one conference terminal except the picture data; or, if the first distance information is the close range grade, determining that the picture combination type corresponding to the first distance is used for indicating that the picture data corresponding to the first distance comprises video data of at least one conference terminal except the picture data displayed by the conference terminal.

For example, the MCU is connected to conference site a, conference site B, conference site C, conference site D, conference site E and conference site F, the user is in conference site B, the conference terminal in conference site B only displays the video data of conference site a, as shown in fig. 5a, the video data displayed by the conference terminal, the picture combination type corresponding to the long-distance level is a picture combination type only including video data of the meeting place a, the display interface of the corresponding first participant terminal may be as shown in fig. 5b, the picture combination type corresponding to the medium-distance level is a picture combination type including video data of the meeting place a, the meeting place C, the meeting place D, and the meeting place E, the display interface of the corresponding first participant terminal may be as shown in fig. 5C, the picture combination type corresponding to the short-distance level is a picture combination type including video data of the meeting place C, the meeting place D, the meeting place E, and the meeting place F, and the display interface of the corresponding first participant terminal may be as shown in fig. 5D.

Optionally, the processing procedure of the MCU generating the picture data corresponding to the first distance may be as follows: acquiring picture data displayed by at least one conference terminal corresponding to the first picture combination type according to the first picture combination type; and acquiring picture data corresponding to the first distance according to the picture data displayed by at least one conference terminal corresponding to the first picture combination type.

In an implementation, the MCU may establish a communication connection with a plurality of conference terminals, and may receive video data transmitted by each conference terminal that establishes a communication connection with the MCU. The MCU may acquire, from the received video data sent by each conference terminal, picture data displayed by at least one conference terminal corresponding to the first picture combination type, and acquire, according to the picture data displayed by the at least one conference terminal corresponding to the first picture combination type, picture data corresponding to the first distance.

Step 407, the MCU sends the picture data corresponding to the first distance to the conference terminal.

In an implementation, the MCU may transmit picture data of the first picture combination type to the conference terminal. The MCU may pre-store the picture data of the first picture combination type, or generate the picture data of the first picture combination type in real time.

In step 408, the conference terminal receives the picture data corresponding to the first distance from the MCU.

In step 409, the conference terminal sends the picture data corresponding to the first distance to the first participant terminal.

In implementation, the conference terminal may receive picture data of a first picture combination type corresponding to the first distance sent by the MCU, and then may send the picture data to the first participant terminal, and after receiving the picture data, the first participant terminal may display the picture data.

In addition, after the conference terminal acquires the first distance information indicating the first distance between the conference terminal and the first participant terminal, the conference terminal may further establish a communication connection with other participant terminals to acquire the distance information of the drinking water, and if a second participant terminal establishes a connection with the conference terminal and second distance information corresponding to the second participant terminal is the same as the first distance information, the processing procedure may be as follows:

the method comprises the steps that firstly, a conference terminal acquires second distance information indicating a second distance between the conference terminal and a second participant terminal, and the second participant terminal establishes communication connection with the conference terminal.

In an implementation, the second participant terminal may establish a communication connection with the conference terminal, and the specific connection manner is the same as the above-mentioned manner of establishing the communication connection. The conference terminal may be provided with a distance detection component, and the distance detection component may adopt a laser distance sensor or an ultrasonic distance sensor in the prior art, which is not limited in this embodiment. After the second participant terminal is connected with the conference terminal, the conference terminal can detect the distance between the second participant terminal and the conference terminal through the distance detection component, and the distance detection mode can be the same as the distance detection mode between the first participant terminal and the conference terminal. The conference terminal may determine second distance information, which may be a distance grade, according to the detected distance (i.e., the second distance).

And step two, the conference terminal sends a data request for requesting the picture data corresponding to the second distance to the MCU, wherein the data request for requesting the picture data corresponding to the second distance carries second distance information. For convenience of the following description, a data request for requesting picture data corresponding to the second distance may be referred to as a second data request.

And step three, the MCU receives a second data request from the conference terminal, wherein the second data request carries second distance information indicating a second distance.

In implementation, the MCU may receive a second data request sent by the conference terminal, and then may parse the second data request to obtain second distance information of a second distance in the second data request, so as to perform subsequent processing.

And step four, if the second distance and the first distance information exist, the MCU sends a feedback message of the second data request to the conference terminal, wherein the feedback message carries the first distance information and is used for indicating that the picture data corresponding to the second distance is the picture data corresponding to the first distance.

In implementation, after acquiring second distance information indicating a second distance, the MCU may determine whether the second distance information is the same as the first distance information, and if the MCU determines that the second distance information is the same as the first distance information, the MCU may send a feedback message of the second data request to the conference terminal, where the feedback message may carry the first distance information.

And step five, the conference terminal receives a feedback message of the second data request from the MCU, the feedback message carries the first distance information, and the feedback message is used for indicating that the picture data corresponding to the second distance is the picture data corresponding to the first distance.

In implementation, the conference terminal may receive a feedback message of the second data request from the MCU, and then may analyze the feedback message to obtain the first distance information carried in the feedback message, so that the conference terminal may determine that the picture data corresponding to the second distance is the picture data corresponding to the first distance.

And step six, the conference terminal sends the picture data corresponding to the first distance to the second participant terminal so that the second participant terminal displays the picture data corresponding to the first distance.

In implementation, after determining that the picture data corresponding to the second distance is the picture data corresponding to the first distance, the conference terminal may send the picture data corresponding to the first distance to the second participant terminal, and the second participant terminal may receive and display the picture data.

Optionally, the conference terminal may also determine whether the second distance information is the same as the first distance information, and correspondingly, after the conference terminal acquires the first distance information indicating the first distance between the conference terminal and the first participant terminal, the conference terminal may perform the following processing:

The specific processing of this step can be seen in step one above.

And step two, when the second distance is the same as the first distance, the conference terminal sends the picture data corresponding to the first distance to the second participant terminal, so that the second participant terminal displays the picture data corresponding to the first distance.

In implementation, the conference terminal may determine whether the second distance information is the same as the first distance information, and if the conference terminal determines that the second distance information is the same as the first distance information, may send the picture data corresponding to the first distance to the second participant terminal, so that the second participant terminal displays the picture data corresponding to the first distance.

In addition, the user may also select a picture combination type that the user wishes to view on the first participant terminal, and the corresponding processing procedure may include the following steps:

in step 701, the conference terminal receives a data request for requesting picture data corresponding to a second picture combination type from the first and second conference terminals, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type.

In an implementation, a frame combination type option may be set in the play interface of the first participant terminal, and the user may click the option, and the first participant terminal may display a selectable frame combination type list. The first participant terminal can acquire the content type of the content currently displayed by the conference terminal and display different picture combination type lists according to different content types. Taking the example that the distance information is divided into a long distance level, a medium distance level and a short distance level, for the case that the currently displayed content type is a meeting place video, the picture combination type list may include picture combination types corresponding to two distance levels other than the first distance level corresponding to the meeting person terminal. For the case that the currently displayed content type is a document, the picture combination type list may include picture combination types corresponding to two distance levels other than the first distance level corresponding to the conference terminal, and three corresponding picture combination types when the content type is a conference video.

For example, the MCU is connected to meeting place a, meeting place B, meeting place C, meeting place D and meeting place E, the user is in meeting place B, the picture combination type corresponding to the conference terminal in meeting place B is to display only the video data in meeting place a, and the first and second party terminals correspond to the middle distance level. If the video data is currently displayed by the conference terminal, the picture combination type list comprises a picture combination type corresponding to the long-distance grade of 1, namely the picture combination type only comprising the video data of the conference site A; 2. the picture combination type corresponding to the close range level is the picture combination type including the video data of the conference site C, the conference site D, and the conference site E. If the conference terminal currently displays the document data, the picture combination type list comprises a picture combination type corresponding to the remote level of 1, namely the document data plus the picture combination type of the video data of the document speaker; 2. the picture combination type corresponding to the close range level is the picture combination type of the video data of the document speaker added with the video data of the meeting places C, D and E; 3. when the conference terminal displays the video data, the picture combination type corresponding to the remote grade, namely the picture combination type only containing the video data of the conference site A; 4. when the conference terminal displays the video data, the picture combination type corresponding to the middle distance grade is the picture combination type of the video data comprising the conference site A, the conference site C and the conference site D; 5. and when the conference terminal displays the video data, the picture combination type corresponding to the close range grade is the picture combination type of the video data comprising the conference places C, D and E.

The user may select a picture combination type (i.e., a second picture combination type) desired to be viewed from the picture combination type list, and the first participant terminal may send a data request for requesting picture data corresponding to the second picture combination type to the conference terminal. And after receiving the third data request, the conference terminal can acquire the second picture combination type carried in the second data request.

In step 702, the conference terminal sends, to the MCU, a data request for requesting picture data corresponding to the second picture combination type, which may be referred to as a fourth data request for convenience of description, where the fourth data request may carry the second picture combination type.

In implementation, after receiving the third data request, the conference terminal may send a fourth data request to the MCU, where the fourth data request carries the second picture combination type selected by the user. The fourth data request may be a third data request, and the conference terminal may forward the received third data request to the MCU; the fourth data request may also be generated by the conference terminal according to the second picture combination type in the third data request.

In step 703, the MCU receives a fourth data request from the conference terminal, where the fourth data request carries the second picture combination type.

In implementation, the MCU may receive a fourth data request sent by the conference terminal, analyze the fourth data request, and obtain a second picture combination type therein.

And 704, generating the picture data corresponding to the second picture combination type by the MCU according to the second picture combination type.

In an implementation, the MCU may determine whether picture data of the second picture combination type has been currently transmitted to the conference terminal. If the MCU does not currently transmit the picture data of the second picture combination type to the conference terminal, the MCU may acquire the picture data displayed by the at least one conference terminal corresponding to the second picture combination type according to the second picture combination type, and then generate the picture data corresponding to the second picture combination type according to the picture data displayed by the at least one conference terminal corresponding to the second picture combination type. If the MCU has currently sent the picture data corresponding to the second picture combination type to the conference terminal, a feedback message may be sent to the conference terminal, where the feedback message may carry the distance information corresponding to the second picture combination type.

Step 705, the MCU sends the picture data corresponding to the second picture combination type to the conference terminal.

In step 706, the conference terminal receives the picture data corresponding to the second picture combination type from the MCU.

In step 707, the conference terminal sends the picture data corresponding to the second picture combination type to the first participant terminal.

In implementation, after receiving the picture data corresponding to the second picture combination type, the conference terminal may send the picture data to the first participant terminal. In addition, the conference terminal may determine whether to currently transmit other types of picture data than the second picture combination type to the first participant terminal before transmitting the picture data corresponding to the second picture combination type, and if so, may stop transmitting the current picture data, and then transmit the picture data corresponding to the second picture combination type to the first and participant terminals. Thus, the user can see the picture data of the picture combination type selected by the user.

The embodiment also provides a data transmission method, as shown in fig. 8, a specific processing procedure may include the following steps:

step 801, a conference terminal acquires first distance information indicating a first distance between the conference terminal and a first participant terminal, wherein the first distance information is a distance grade.

The specific processing procedure of this step can refer to step 401.

Step 802, the conference terminal sends a data request for requesting the picture data corresponding to the first distance to the MCU, where the data request for requesting the picture data corresponding to the first distance carries first distance information and a first content type of content currently displayed by the conference terminal.

The specific processing procedure of this step can refer to step 403.

In step 803, the MCU receives a data request from the conference terminal for requesting the picture data corresponding to the first distance.

The specific processing procedure of this step can refer to step 404.

And step 804, the MCU determines the first distance information and a first picture combination type corresponding to the first content type according to the pre-stored corresponding relationship among the distance grade, the content type of the conference terminal and the picture combination type.

The specific processing procedure of this step can refer to step 405.

In step 805, the MCU determines a first picture combination type corresponding to the first distance and the first content type according to the correspondence between the picture combination type and the distance information and the content type, and the first distance information and the first content type.

The specific processing procedure of this step can refer to step 406.

In step 806, the MCU sends the picture data corresponding to the first distance to the conference terminal.

The specific processing procedure of this step can refer to step 407.

In step 807, the conference terminal receives the picture data corresponding to the first distance from the MCU.

The specific processing of this step can be referred to as step 408.

Step 808, the conference terminal sends the picture data corresponding to the first distance to the first participant terminal, so that the first participant terminal displays the picture data corresponding to the first distance.

The specific processing procedure of this step can refer to step 409.

In the embodiment of the invention, first distance information indicating a first distance between a conference terminal and a first participant terminal is obtained, a first data request is sent to an MCU (microprogrammed control Unit), the first data request carries the first distance information, picture data corresponding to the first distance from the MCU is received, and the picture data corresponding to the first distance is sent to the first participant terminal, so that the first participant terminal displays the number of pictures corresponding to the first distance, therefore, different picture data can be sent to the participant terminals at different positions, and the picture data displayed by the participant terminals can better meet the requirements of users.

Based on the same technical concept, an embodiment of the present invention further provides a conference terminal, as shown in fig. 2, the conference terminal includes a processor 210, a receiver 220, and a transmitter 230, wherein:

the processor 210 is configured to obtain first distance information indicating a first distance between the conference terminal and a first participant terminal;

the processor 210 is further configured to generate a data request for requesting picture data corresponding to the first distance according to the first distance information, where the data request for requesting picture data corresponding to the first distance carries the first distance information;

the transmitter 230 is configured to send the data request for requesting the picture data corresponding to the first distance to the MCU;

the receiver 220 is configured to receive picture data corresponding to the first distance from the MCU;

the transmitter 230 is further configured to send picture data corresponding to the first distance received by the receiver to the first participant terminal.

In implementation, a user may carry a mobile terminal (i.e., a participant terminal) such as a mobile phone or a tablet computer while participating in a video conference. The participant terminal can establish wireless connection with the conference terminal, and the connection establishment mode is various, for example, the connection establishment can be performed through a network or through ultrasonic pairing. Taking the example of establishing connection by ultrasonic pairing, the conference terminal can send out an ultrasonic signal through connected sound equipment, the ultrasonic signal can be received by a receiver of the participant terminal, and then the participant terminal can detect the conference terminal and join the Wi-Fi network of the conference terminal, so that seamless connection between the conference terminal and the mobile terminal is realized. When a participant terminal (i.e., a first participant terminal) of a certain user establishes a connection with a conference terminal, the conference terminal may detect distance information between the first participant terminal and itself through the processor 210. The transmitter 230 may send a data request (may be referred to as a first data request) for requesting picture data corresponding to the first distance to the MCU, where the first data request may carry first distance information of the first distance, the receiver 220 may receive picture data of a first picture combination type corresponding to the first distance information, and then the transmitter 230 may send the acquired picture data to the first participant terminal, and after receiving the picture data, the first participant terminal may display the picture data.

Optionally, the processor 210 is further configured to

In an implementation, the processor 210 may classify the content displayed by the conference terminal, and obtain the content type of the content, where the content type may include a conference video and a document. The meeting place video content may be picture data generated by the MCU, and the document content may be document data of the video conference, such as PPT and word. The processor 210 may obtain the currently displayed content, may determine a content type (i.e., a first content type) corresponding to the content, may then add the first content type to the first data request, and the transmitter 230 may transmit the first data request to the MCU.

Optionally, the transmitter 230 is configured to send an ultrasonic signal to the first and second meeting person terminals;

the receiver 220 is configured to receive an ultrasonic feedback signal corresponding to the ultrasonic signal from the first participant terminal; accordingly, the method can be used for solving the problems that,

the processor 210 is configured to determine the first distance according to a first time difference between a sending time of the ultrasonic signal and a receiving time of the ultrasonic feedback signal.

In an implementation, after the first participant terminal establishes a connection with the conference terminal, the transmitter 230 may transmit an ultrasonic signal to the conference terminal and record the transmission time. After receiving the ultrasonic signal, the first participant terminal may send an ultrasonic feedback signal to the conference terminal, the receiver 220 may receive the ultrasonic feedback signal sent by the first participant terminal, and record a receiving time, and the processor 210 may calculate a first time difference between the sending time and the receiving time, and calculate a first distance according to the time difference and the propagation speed of the ultrasonic wave.

Optionally, the ultrasonic feedback signal carries a second time difference between a receiving time when the first participant terminal receives the ultrasonic signal and a sending time when the first participant terminal sends the ultrasonic feedback signal;

the processor 210 is configured to:

and determining the first distance according to the first time difference and the second time difference.

In an implementation, when the first participant terminal receives the ultrasonic signal, the current time (that is, the receiving time of the ultrasonic signal) may be recorded, and after receiving the ultrasonic signal, the first participant terminal may transmit the ultrasonic feedback signal to the conference terminal, may record the transmission time of the ultrasonic feedback signal to be transmitted, may determine a time difference (that is, a second time difference) between the two times, and may add the second time difference to the ultrasonic feedback signal for transmission. The second time difference may indicate a processing time between the reception of the ultrasonic signal and the transmission of the ultrasonic feedback signal by the primary participant terminal. The receiver 220 may receive the ultrasonic signal feedback signal sent by the first participant terminal, and the processor 210 may analyze the ultrasonic signal feedback signal to obtain a second time difference therein, and then may subtract the second time difference from the first time difference to obtain a difference therebetween, that is, after the propagation time of the ultrasonic signal and the propagation time of the ultrasonic signal feedback signal, the first distance may be calculated according to the difference and the propagation speed of the ultrasonic wave.

Optionally, the processor 210 is further configured to:

the transmitter 230 is further configured to send the picture data corresponding to the first distance to the secondary participant terminal when the processor 210 determines that the second distance information is the same as the first distance information, so that the secondary participant terminal displays the picture data corresponding to the first distance.

In an implementation, the conference terminal may establish a communication connection with a second participant terminal, the processor 210 may detect a second distance from the second participant terminal, the processor 210 may determine whether the second distance information is the same as the first distance information, and if the conference terminal determines that the second distance information is the same as the first distance information, the transmitter 230 may transmit picture data corresponding to the first distance to the second participant terminal, so that the second participant terminal displays the picture data corresponding to the first distance.

Optionally, the processor 210 is further configured to:

the transmitter 230 is further configured to:

sending a data request for requesting the picture data corresponding to the second distance to the MCU, where the data request for requesting the picture data corresponding to the second distance carries the second distance information acquired by the processor 210;

the receiver 220 is further configured to:

the transmitter 230 is further configured to:

In an implementation, the conference terminal may establish a communication connection with the second participant terminal, then the processor 210 may obtain a second distance from the second participant terminal, and then the transmitter 230 may transmit a data request (may be referred to as a second data request) for requesting picture data corresponding to the second distance to the MCU, where the second data request carries second distance information of the second distance. After receiving the second data request, the MCU may determine whether the second distance information is the same as the first distance information, and if the MCU determines that the second distance information is the same as the first distance information, the MCU may send a feedback message of the second data request to the conference terminal, where the feedback message may carry the first distance information. The receiver 220 may receive a feedback message from the MCU, where the feedback message may carry the first distance information, and the processor 210 may determine that the picture data corresponding to the second distance is the picture data corresponding to the first distance. The transmitter 230 may transmit the picture data corresponding to the first distance to the second participant terminal so that the second participant terminal displays the picture data corresponding to the first distance.

Optionally, the transmitter 230 is further configured to:

In an implementation, the transmitter 230 may send a distance prompting message to the first and meeting person terminal, where the distance prompting message carries first distance information corresponding to the first and meeting person terminal, and the first distance information may be a distance class, and the first and meeting person terminal may receive the distance prompting message, and may then display a corresponding push message, for example, "your present distance class is a middle distance class".

Based on the same technical concept, an embodiment of the present invention further provides an MCU, as shown in fig. 3, the MCU includes a receiver 310, a transmitter 320, a processor 330 and a memory 340, wherein:

the receiver 310 is configured to receive a data request for requesting picture data corresponding to the first distance from a conference terminal, where the data request for requesting the picture data corresponding to the first distance carries first distance information indicating the first distance, and the first distance is a distance between the conference terminal and a first participant terminal;

the processor 330 is configured to determine a first picture combination type corresponding to the first distance according to the first distance information received by the receiver and a first corresponding relationship between the distance information and the picture combination type stored in the memory 340;

the processor 330 is further configured to generate picture data corresponding to the first distance according to the first picture combination type;

the transmitter 320 is configured to send, to the conference terminal, the picture data corresponding to the first distance generated by the processor.

In implementation, the receiver 310 receives a first data request sent by the conference terminal, and may then obtain first distance information in the first data request. The technician can set the picture combination types corresponding to different distance information in the MCU. The memory 340 may correspondingly store different distance information and picture combination types. The processor 330 may search for a first picture combination type corresponding to the first distance in the correspondence between the distance information and the picture combination type, and then generate picture data corresponding to the first distance, and the transmitter 330 may transmit the picture data of the first picture combination type to the conference terminal.

Optionally, the distance level includes at least one of a long distance level, a medium distance level and a short distance level, and the processor 330 is configured to:

Optionally, the data request for requesting the picture data corresponding to the first distance further carries a first content type of content currently displayed by the conference terminal, where the first content type includes a conference room video and a document;

the processor 330 is configured to: and determining a first picture combination type corresponding to the first distance and the first content type according to the first distance information, the first content type and the second corresponding relation.

In implementation, the memory 340 may store in advance a correspondence relationship between the distance information, the content type of the conference terminal, and the screen combination type. The content types may include meeting place videos and documents. For the case that the content type is the conference place video, the corresponding relationship between the distance information, the content type of the conference terminal and the picture combination type may be the same as the above corresponding relationship, and is not described again; for the case where the content type is a document, the correspondence between the distance information, the content type of the conference terminal, and the picture combination type may be: the picture combination type corresponding to the remote level can be the picture combination type of the document data displayed by the conference terminal and the video data of the document speaker; the picture combination type corresponding to the middle distance level may be a picture combination type of document data plus video data of at least one conference terminal, and the picture combination type corresponding to the short distance level may be a picture combination type including video data of at least one conference terminal. The processor 330 may obtain the first content type and the first distance information carried in the first data request, and then may query a corresponding picture combination type in the correspondence between the distance information and the content type and the picture combination type of the conference terminal, so as to perform subsequent processing.

Optionally, the receiver 310 is further configured to:

the transmitter 320 is further configured to: and if the processor determines that the second distance is the same as the first distance, sending a feedback message of the data request for requesting the picture data corresponding to the second distance to the conference terminal, wherein the feedback message carries the first distance information, and the feedback message is used for indicating that the picture data corresponding to the second distance is the picture data corresponding to the first distance.

In an implementation, after the receiver 310 receives the second data request, the processor 330 may determine whether the second distance information is the same as the first distance information, and if the processor 330 determines that the second distance information is the same as the first distance information, the transmitter 320 may send a feedback message of the second data request to the conference terminal, where the feedback message may carry the first distance information.

Based on the same technical concept, an embodiment of the present invention further provides a conference terminal, as shown in fig. 2, the conference terminal includes a receiver 220 and a transmitter 230:

the receiver 220 is configured to receive a data request from the first and second conference terminal for requesting picture data corresponding to a second picture combination type, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

the transmitter 230 is configured to send a data request for requesting picture data corresponding to the second picture combination type to an MCU, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

the receiver 220 is further configured to receive picture data corresponding to the second picture combination type from the MCU;

the transmitter 230 is further configured to transmit picture data corresponding to the second picture combination type to the primary participant terminal.

The user may select the picture combination type from the picture combination type list, the first participant terminal may send a data request (may be referred to as a third data request) for requesting picture data corresponding to the second picture combination type to the conference terminal, and the third data request may carry the second picture combination type selected by the user. After receiving the third data request, the receiver 220 may obtain a second picture combination type carried in the third data request, then the transmitter 230 sends a data request (which may be referred to as a fourth data request) for requesting picture data corresponding to the second picture combination type to the MCU, the fourth data request carries the second picture combination type, the receiver 220 may receive the picture data corresponding to the second picture combination type, then the transmitter 230 may send the picture data of the second picture combination type to the first participant terminal, and stop sending the picture data corresponding to the first picture combination type to the first participant terminal. The primary participant terminal may display the picture data of the second picture combination type.

Based on the same technical concept, an embodiment of the present invention further provides an MCU, as shown in fig. 3, the MCU includes a receiver 310, a transmitter 320, and a processor 330:

the receiver 310 is configured to receive a data request for requesting picture data corresponding to the second picture combination type from a conference terminal, where the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

the processor 330 is configured to generate picture data corresponding to the second picture combination type according to the second picture combination type received by the receiver;

the transmitter 320 is further configured to send the picture data corresponding to the second picture combination type to the conference terminal.

The user may select the picture combination type from the picture combination type list, the first participant terminal may send a data request (may be referred to as a third data request) for requesting picture data corresponding to the second picture combination type to the conference terminal, and the third data request may carry the second picture combination type selected by the user. After receiving the third data request, the conference terminal may obtain a second picture combination type carried in the third data request, and then send a data request (which may be referred to as a fourth data request) for requesting picture data corresponding to the second picture combination type to the MCU, where the fourth data request carries the second picture combination type, the receiver 310 may receive the fourth data request from the conference terminal, and then may parse the fourth data request, the processor 330 may obtain the second picture combination type carried in the fourth data request, and then may generate picture data corresponding to the second picture combination type according to the second picture combination type, and then the transmitter 320 may send the picture data corresponding to the second picture combination type to the conference terminal.

Based on the same technical concept, an embodiment of the present invention further provides a conference terminal, as shown in fig. 9, where the conference terminal includes:

a distance detection module 910, configured to obtain first distance information indicating a first distance between the conference terminal and a first participant terminal;

a generating module 920, configured to generate, according to the first distance information, a data request for requesting picture data corresponding to the first distance, where the data request for requesting picture data corresponding to the first distance carries the first distance information;

a sending module 930, configured to send, to the MCU, the data request for requesting the picture data corresponding to the first distance;

a receiving module 940, configured to receive picture data corresponding to the first distance from the MCU;

the sending module 930 is further configured to send the picture data corresponding to the first distance to the first participant terminal.

The user can carry a mobile terminal (i.e., a participant terminal) such as a mobile phone or a tablet computer during the process of participating in the video conference. The participant terminal can establish wireless connection with the conference terminal, and the connection establishment mode is various, for example, the connection establishment can be performed through a network or through ultrasonic pairing. Taking the example of establishing connection by ultrasonic pairing, the conference terminal can send out an ultrasonic signal through connected sound equipment, the ultrasonic signal can be received by a receiver of the participant terminal, and then the participant terminal can detect the conference terminal and join the Wi-Fi network of the conference terminal, so that seamless connection between the conference terminal and the mobile terminal is realized. When a participant terminal (i.e., a first participant terminal) of a certain user establishes a connection with a conference terminal, the distance detection module 910 may detect distance information between the first participant terminal and the first participant terminal, and then the generation module 920 may generate a data request for requesting picture data corresponding to the first distance according to the first distance information. The sending module 930 may send a data request (may be referred to as a first data request) for requesting the picture data corresponding to the first distance to the MCU, where the first data request may carry first distance information of the first distance, the receiving module 940 may receive the picture data of the first picture combination type corresponding to the first distance information, and then the sending module 930 may send the acquired picture data to the first participant terminal, and after receiving the picture data, the first participant terminal may display the picture data.

Optionally, as shown in fig. 10, the conference terminal further includes an obtaining module 950;

the obtaining module 950 is configured to obtain a first content type of content currently displayed by the conference terminal, where the first content type includes a conference site video and a document; accordingly, the number of the first and second electrodes,

The content displayed by the conference terminal can be classified to obtain the content type of the content, and the content type can include a conference video and a document. The meeting place video content may be picture data generated by the MCU, and the document content may be document data of the video conference, such as PPT and word. The obtaining module 950 may obtain the currently displayed content, and further may determine a content type (i.e., a first content type) corresponding to the content, and then the sending module 930 may add the first content type to the first data request, and may send the first data request to the MCU.

Optionally, the distance detecting module 910 is further configured to:

sending an ultrasonic signal to the first meeting person terminal;

In an implementation, after the first participant terminal establishes a connection with the conference terminal, the distance detection module 910 may send an ultrasonic signal to the conference terminal and record the sending time. After receiving the ultrasonic signal, the first participant terminal may send an ultrasonic feedback signal to the conference terminal, the distance detection module 910 may receive the ultrasonic feedback signal sent by the first participant terminal, and record a receiving time, and then the distance detection module 910 may calculate a first time difference between the sending time and the receiving time, and calculate a first distance according to the time difference and the propagation speed of the ultrasonic wave.

the distance detection module 910 is further configured to:

In an implementation, when the first participant terminal receives the ultrasonic signal, the current time (that is, the receiving time of the ultrasonic signal) may be recorded, and after receiving the ultrasonic signal, the first participant terminal may transmit the ultrasonic feedback signal to the conference terminal, may record the transmission time of the ultrasonic feedback signal to be transmitted, may determine a time difference (that is, a second time difference) between the two times, and may add the second time difference to the ultrasonic feedback signal for transmission. The second time difference may indicate a processing time between the reception of the ultrasonic signal and the transmission of the ultrasonic feedback signal by the primary participant terminal. The distance detection module 910 may receive the ultrasonic signal feedback signal sent by the first participant terminal, analyze the ultrasonic signal feedback signal to obtain a second time difference, subtract the second time difference from the first time difference to obtain a difference therebetween, that is, after the propagation time of the ultrasonic signal and the propagation time of the ultrasonic signal feedback signal, calculate the first distance according to the difference and the propagation speed of the ultrasonic wave.

Optionally, after the obtaining first distance information indicating a first distance between the conference terminal and a first participant terminal, the distance detecting module 910 is further configured to:

the sending module 930 is further configured to:

In an implementation, the conference terminal may establish a communication connection with a second participant terminal, the distance detection module 910 may detect a second distance from the second participant terminal, the processor 230 may determine whether the second distance information is the same as the first distance information, and if the conference terminal determines that the second distance information is the same as the first distance information, the sending module 930 may send the picture data corresponding to the first distance to the second participant terminal, so that the second participant terminal displays the picture data corresponding to the first distance.

the sending module 930 is further configured to:

the receiving module 940 is further configured to:

the sending module 930 is further configured to:

In an implementation, the conference terminal may establish a communication connection with a second participant terminal, then the distance detection module 910 may detect a second distance from the second participant terminal, and then the transmission module 930 may transmit a data request (may be referred to as a second data request) for requesting picture data corresponding to the second distance to the MCU, where the second data request carries second distance information of the second distance. After receiving the second data request, the MCU may determine whether the second distance information is the same as the first distance information, and if the MCU determines that the second distance information is the same as the first distance information, the MCU may send a feedback message of the second data request to the conference terminal, where the feedback message may carry the first distance information. The receiving module 940 may receive a feedback message from the MCU, where the feedback message may carry the first distance information, and further may determine that the picture data corresponding to the second distance is the picture data corresponding to the first distance. The sending module 930 may send the picture data corresponding to the first distance to the second participant terminal so that the second participant terminal displays the picture data corresponding to the first distance.

Optionally, the sending module 930 is further configured to:

In an implementation, the sending module 930 may send a distance prompting message to the first participant terminal, where the distance prompting message carries first distance information corresponding to the first participant terminal, where the first distance information may be a distance class, and the first participant terminal may receive the distance prompting message, and may then display a corresponding push message, where "the distance class of your present is a middle distance class".

Based on the same technical concept, an embodiment of the present invention further provides an MCU, as shown in fig. 11, the MCU includes:

a receiving module 1110, configured to receive a data request for requesting picture data corresponding to the first distance from a conference terminal, where the data request for requesting the picture data corresponding to the first distance carries first distance information indicating the first distance, and the first distance is a distance between the conference terminal and a first participant terminal;

a determining module 1120, configured to determine, according to the first distance information and a first corresponding relationship between the distance information and a picture combination type, a first picture combination type corresponding to the first distance;

a generating module 1130, configured to generate, according to the first picture combination type, picture data corresponding to the first distance;

a sending module 1140, configured to send the picture data corresponding to the first distance to the conference terminal, so that the first participant terminal displays the picture data corresponding to the first distance.

In implementation, the receiving module 1110 receives a first data request sent by a conference terminal, and may then obtain first distance information in the first data request. The technician can set the picture combination types corresponding to different distance information in the MCU. The memory can correspondingly store different distance information and picture combination types. The determining module 1120 may search for a first picture combination type corresponding to the first distance in the correspondence between the distance information and the picture combination type, the generating module 1130 may generate picture data corresponding to the first distance according to the first picture combination type, and then the sending module 1140 may send the picture data of the first picture combination type to the conference terminal.

Optionally, the distance level includes at least one of a long distance level, a medium distance level and a short distance level, and the determining module 1120 is further configured to:

the determining module 1120 is further configured to:

In implementation, the memory may store in advance a correspondence relationship between the distance information, the content type of the conference terminal, and the screen combination type. The content types may include meeting place videos and documents. For the case that the content type is the conference place video, the corresponding relationship between the distance information, the content type of the conference terminal and the picture combination type may be the same as the above corresponding relationship, and is not described again; for the case where the content type is a document, the correspondence between the distance information, the content type of the conference terminal, and the picture combination type may be: the picture combination type corresponding to the remote level can be the picture combination type of the document data displayed by the conference terminal and the video data of the document speaker; the picture combination type corresponding to the middle distance level may be a picture combination type of document data plus video data of at least one conference terminal, and the picture combination type corresponding to the short distance level may be a picture combination type including video data of at least one conference terminal. The determining module 1120 may obtain the first content type and the first distance information carried in the first data request, and then may query a corresponding picture combination type in the correspondence between the distance information and the content type and the picture combination type of the conference terminal, so as to perform subsequent processing.

Optionally, the receiving module 1110 is further configured to:

the sending module 1140 is further configured to

In an implementation, after the receiving module 1110 receives the second data request, it may determine whether the second distance information is the same as the first distance information, and if the second distance information is the same as the first distance information, the sending module 1140 may send a feedback message of the second data request to the conference terminal, where the feedback message may carry the first distance information.

a receiving module 940, configured to receive a data request from the first and second conference terminal for requesting picture data corresponding to the second picture combination type, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

a sending module 930, configured to send, to an MCU, a data request for requesting picture data corresponding to the second picture combination type, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

the receiving module 930, further configured to receive picture data corresponding to the second picture combination type from the MCU;

the sending module 940 is further configured to send the picture data corresponding to the second picture combination type to the first participant terminal.

The user may select the picture combination type from the picture combination type list, the first participant terminal may send a data request (may be referred to as a third data request) for requesting picture data corresponding to the second picture combination type to the conference terminal, and the third data request may carry the second picture combination type selected by the user. After receiving the third data request, the receiving module 940 may obtain a second picture combination type carried in the third data request, then the sending module 930 sends a data request (which may be referred to as a fourth data request) for requesting picture data corresponding to the second picture combination type to the MCU, where the fourth data request carries the second picture combination type to obtain picture data corresponding to the second picture combination type, and then the sending module 930 may send the picture data of the second picture combination type to the first participant terminal and stop sending the picture data corresponding to the first picture combination type to the first participant terminal. The primary participant terminal may display the picture data of the second picture combination type.

a receiving module 1110, configured to receive a data request for requesting picture data corresponding to the second picture combination type from a conference terminal, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

a generating module 1130, configured to generate, according to the second picture combination type, picture data corresponding to the second picture combination type;

a sending module 1140, configured to send the picture data corresponding to the second picture combination type to the conference terminal.

The user may select the picture combination type from the picture combination type list, the first participant terminal may send a data request (may be referred to as a third data request) for requesting picture data corresponding to the second picture combination type to the conference terminal, and the third data request may carry the second picture combination type selected by the user. After receiving the third data request, the conference terminal may obtain a second picture combination type carried in the third data request, and then send a data request (which may be referred to as a fourth data request) for requesting picture data corresponding to the second picture combination type to the MCU, where the fourth data request carries the second picture combination type, the receiving module 1110 may receive the fourth data request from the conference terminal, and then may parse the fourth data request to obtain the second picture combination type carried in the fourth data request, and then according to the second picture combination type, the generating module 1130 may generate picture data corresponding to the second picture combination type, and then the sending module 1140 may send the picture data corresponding to the second picture combination type to the conference terminal.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. A method of data transmission, the method being performed by a conference terminal, the method comprising:

sending the data request for requesting the picture data corresponding to the first distance to a Multipoint Control Unit (MCU);

receiving picture data corresponding to a first distance from the MCU;

2. The method of claim 1, further comprising:

3. The method of claim 1,

the acquiring first distance information indicating a first distance between the conference terminal and the first participant terminal includes:

sending an ultrasonic signal to the first meeting person terminal;

4. The method of claim 2,

sending an ultrasonic signal to the first meeting person terminal;

5. The method according to claim 3, wherein the ultrasonic feedback signal carries a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal;

6. The method according to claim 4, wherein the ultrasonic feedback signal carries a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal;

7. The method of any of claims 1 to 6, wherein after the obtaining first distance information indicating a first distance between the conference terminal and a primary participant terminal, the method further comprises:

8. The method of any of claims 1 to 6, wherein after the obtaining first distance information indicating a first distance between the conference terminal and a primary participant terminal, the method further comprises:

9. The method according to any one of claims 1 to 6, wherein the first distance information includes a distance grade corresponding to the first distance.

10. The method according to any one of claims 1 to 6, further comprising:

11. A method of data transmission, the method being performed by a Multipoint Control Unit (MCU), the method comprising:

receiving a data request for requesting picture data corresponding to a first distance from a conference terminal, wherein the data request for requesting the picture data corresponding to the first distance carries first distance information indicating the first distance, and the first distance is the distance between the conference terminal and a first participant terminal;

and sending the picture data corresponding to the first distance to the conference terminal.

12. The method of claim 11, wherein the first distance information comprises a distance rating corresponding to the first distance.

13. The method according to claim 12, wherein the distance level comprises at least one of a long distance level, a medium distance level and a short distance level, and the determining a first picture combination type corresponding to the first distance according to the first distance information and the first correspondence relationship between the distance information and the picture combination type comprises:

14. The method according to any one of claims 11 to 13, wherein the data request for requesting the picture data corresponding to the first distance further carries a first content type of content currently displayed by the conference terminal, the first content type includes a conference video and a document, and the first correspondence includes a second correspondence between a picture combination type and distance information and a content type;

15. The method according to any one of claims 11 to 13, further comprising:

receiving a data request for requesting picture data corresponding to a second distance from a conference terminal, wherein the data request for requesting the picture data corresponding to the second distance carries second distance information indicating the second distance, and the second distance is a distance between the conference terminal and a second participant terminal;

16. The method of claim 14, further comprising:

17. A method of data transmission, the method being performed by a conference terminal, the method comprising:

sending a data request for requesting picture data corresponding to the second picture combination type to a Multipoint Control Unit (MCU), wherein the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

receiving picture data corresponding to a second picture combination type from the MCU;

18. A method of data transmission, the method being performed by a Multipoint Control Unit (MCU), the method comprising:

receiving a data request for requesting picture data corresponding to a second picture combination type from a conference terminal, wherein the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

19. A conference terminal, characterized in that the conference terminal comprises:

a generating module, configured to generate, according to the first distance information, a data request for requesting picture data corresponding to the first distance, where the data request for requesting the picture data corresponding to the first distance carries the first distance information;

the sending module is used for sending the data request for requesting the picture data corresponding to the first distance to a Multipoint Control Unit (MCU);

20. The conference terminal of claim 19, wherein said conference terminal further comprises an acquisition module;

21. The conference terminal of claim 19,

the distance detection module is configured to:

sending an ultrasonic signal to the first meeting person terminal;

22. The conference terminal of claim 20,

the distance detection module is configured to:

sending an ultrasonic signal to the first meeting person terminal;

23. The conference terminal of claim 21, wherein the ultrasonic feedback signal carries a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal;

the distance detection module is configured to:

24. The conference terminal of claim 22, wherein the ultrasonic feedback signal carries a receiving time at which the first participant terminal receives the ultrasonic signal and a sending time at which the first participant terminal sends the ultrasonic feedback signal;

the distance detection module is configured to:

25. The conference terminal of any of claims 19 to 24, wherein after the obtaining of the first distance information indicating the first distance between the conference terminal and the primary participant terminal, the distance detection module is further configured to:

the sending module is further configured to:

26. The conference terminal of any of claims 19 to 24, wherein after the obtaining of the first distance information indicating the first distance between the conference terminal and the primary participant terminal, the distance detection module is further configured to:

the sending module is further configured to:

the receiving module is further configured to:

the sending module is further configured to:

27. The conference terminal of any of claims 19 to 24, wherein the first distance information comprises a distance rating corresponding to the first distance.

28. The conference terminal according to any of the claims 19 to 24, wherein the sending module is further configured to:

29. A multipoint control unit, MCU, characterized in that it comprises:

a receiving module, configured to receive a data request for requesting picture data corresponding to a first distance from a conference terminal, where the data request for requesting the picture data corresponding to the first distance carries first distance information indicating the first distance, and the first distance is a distance between the conference terminal and a first participant terminal;

30. The MCU of claim 29, wherein the first distance information comprises a distance rating corresponding to the first distance.

31. The MCU of claim 30, wherein the distance levels comprise at least one of a long distance level, a medium distance level and a short distance level, the determining module is configured to:

32. The MCU of any one of claims 29 to 31, wherein the data request for requesting the picture data corresponding to the first distance further carries a first content type of a content currently displayed by the conference terminal, and the first content type comprises a conference room video and a document;

the determining module is configured to:

33. The MCU of any one of claims 29 to 31, wherein the receiving module is further configured to:

the sending module is also used for

34. The MCU of claim 32, wherein the receiving module is further configured to:

the sending module is also used for

35. A conference terminal, characterized in that the conference terminal comprises:

a sending module, configured to send a data request for requesting picture data corresponding to the second picture combination type to a multipoint control unit MCU, where the data request for requesting picture data corresponding to the second picture combination type carries the second picture combination type;

the receiving module is further configured to receive picture data corresponding to a second picture combination type from the MCU;

36. A multipoint control unit, MCU, characterized in that it comprises:

a receiving module, configured to receive a data request for requesting picture data corresponding to a second picture combination type from a conference terminal, where the data request for requesting the picture data corresponding to the second picture combination type carries the second picture combination type;

37. A system for data transmission, the system comprising a conference terminal and a multipoint control unit MCU, wherein:

the conference terminal is configured to acquire first distance information indicating a first distance between the conference terminal and a first participant terminal, generate a data request for requesting picture data corresponding to the first distance according to the first distance information, carry the first distance information in the data request for requesting the picture data corresponding to the first distance, and send the data request for requesting the picture data corresponding to the first distance to the MCU;

and the conference terminal is also used for receiving the picture data corresponding to the first distance from the MCU and sending the picture data corresponding to the first distance to the first participant terminal.