WO2018024114A1 - 多媒体会议系统、多媒体会议的语音采集方法及装置 - Google Patents

多媒体会议系统、多媒体会议的语音采集方法及装置 Download PDF

Info

Publication number
WO2018024114A1
WO2018024114A1 PCT/CN2017/093769 CN2017093769W WO2018024114A1 WO 2018024114 A1 WO2018024114 A1 WO 2018024114A1 CN 2017093769 W CN2017093769 W CN 2017093769W WO 2018024114 A1 WO2018024114 A1 WO 2018024114A1
Authority
WO
WIPO (PCT)
Prior art keywords
conference
data transmission
transmission device
voice
sound pickup
Prior art date
Application number
PCT/CN2017/093769
Other languages
English (en)
French (fr)
Inventor
孙健康
朱碧军
杨豪
任卿
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2018024114A1 publication Critical patent/WO2018024114A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]

Definitions

  • the present application relates to the field of communications technologies, and in particular, to a multimedia conference system, a voice collection method and apparatus for a multimedia conference.
  • Multi-site users can hold multimedia conferences to facilitate exchanges in different places.
  • the conference call is usually required for the multimedia conference.
  • the conference phone has a powerful pickup function, it can clearly pick up the sound within a few meters in the hands-free state, which is convenient for communication between many users. .
  • the present application provides a multimedia conference system, a voice collection method and device for a multimedia conference
  • a multimedia conference system comprising:
  • the sound pickup device includes a sound pickup component on a mobile device carried by the local participant, to collect a conference voice of the local participant in the sound pickup range;
  • a data transmission device configured to receive the conference voice sent by the sound pickup device when the near-field connection is established with the sound pickup device, and transmit the received conference voice to the peer end Conference equipment used by participants.
  • a voice collection method for a multimedia conference including:
  • the sound collecting device establishes a near field connection with the data transmission device, and the data transmission device is assembled at the conference location;
  • the sound pickup device includes a sound pickup component on the mobile device carried by the local participant;
  • the pickup device collects a conference voice of the local participant in the pickup range
  • the sound collecting device transmits the conference voice to the data transmission device for further transmission by the data transmission device to a conference device adopted by a peer participant.
  • a voice collection method for a multimedia conference including:
  • the data transmission device establishes a near field connection with the sound pickup device; the data transmission device is assembled at a conference location, and the sound pickup device includes a sound pickup component on the mobile device carried by the local participant;
  • the data transmission device respectively receives the conference voice sent by each of the sound pickup devices, and the conference voice is collected by the sound pickup device to the local participant in the sound pickup range;
  • the data transmission device transmits the received conference voice to the conference device used by the peer participant to play the conference voice to the peer participant.
  • a voice collection device for a multimedia conference including:
  • the sound pickup device comprising a sound pickup component on the mobile device carried by the local participant;
  • a collecting unit configured to collect the conference voice of the local participant in the pickup range
  • a transmitting unit configured to transmit, by the sound collecting device, the conference voice to the data transmission device, to be further transmitted by the data transmission device to a conference device used by a peer participant.
  • a voice collection device for a multimedia conference including:
  • the data transmission device being assembled at a conference location, the sound pickup device comprising a sound pickup component on a mobile device carried by the local participant;
  • the data transmission device respectively receives the conference voice sent by each of the sound pickup devices, and the conference voice is collected by the sound pickup device for the local participant in the sound pickup range;
  • the transmitting unit enables the data transmission device to transmit the received conference voice to the conference device used by the peer participant.
  • a voice collection method for a multimedia conference including:
  • the instant messaging application initiates a conference request related to the selected data transmission device to the server, so that the selected data transmission device is added to the Determining, by the server, a multimedia conference created for the conference request;
  • the selected data transmission device also forms a multimedia with a plurality of pickup devices at the conference location where the conference is located.
  • a sound collecting device comprising: a sound collecting component on a mobile device carried by a local participant of the multimedia conference to collect a conference voice of a local participant in a pickup range; the data transmission The device is configured to receive the conference voice sent by the sound pickup device when establishing a near field connection with the sound pickup device, and transmit the received conference voice to a peer participant of the multimedia conference Conference equipment used.
  • a voice collection device for a multimedia conference including:
  • a display unit according to an enterprise to which the initiator belongs, displaying an organization structure of the enterprise in an instant messaging application, where the organization structure includes a data transmission device bound to the enterprise, where the data transmission device is assembled The pre-set meeting place in the enterprise;
  • the instant messaging application initiates a conference request related to the selected data transmission device to the server, so that the selected data transmission device is Adding to the multimedia conference created by the server for the conference request;
  • the selected data transmission device also forms a multimedia conference system with a plurality of sound pickup devices at the conference location; the sound pickup device includes the mobile device carried by the local conference participant of the multimedia conference. a sound pickup assembly for collecting a conference voice of a local conference participant within a pickup range; the data transmission device configured to receive a near field connection with the pickup device for receiving the transmission by the pickup device The conference voice is transmitted to the conference device used by the peer participant of the multimedia conference.
  • the mobile device carried by the local participant can be used as a sound pickup device to implement function multiplexing of the mobile device, and the mobile device is carried by the local participant and the local device. Participants are close to each other, and better pickup effects can be obtained without using a professional conference phone. Only a random data transmission device and a conference device used by the peer participant can be used for conference voice transmission. It can avoid increasing equipment costs and reduce the configuration complexity and maintenance cost of multimedia conferences.
  • FIG. 1 is a schematic diagram of a scenario of holding a multimedia conference in the related art
  • FIG. 2 is a schematic structural diagram of a multimedia conference system according to an exemplary embodiment of the present application.
  • FIG. 3 is a schematic flowchart diagram of a voice collection method based on a multimedia conference of a sound collecting device side according to an exemplary embodiment of the present application
  • FIG. 4 is a schematic flowchart of a voice collection method of a multimedia conference based on a data transmission device side according to an exemplary embodiment of the present application
  • FIG. 5 is a schematic diagram of a scenario for holding a multimedia conference according to an exemplary embodiment of the present application.
  • FIG. 6 is a schematic flowchart diagram of a voice collection method for a multimedia conference according to an exemplary embodiment of the present application
  • FIG. 7 is a schematic diagram of an interface with a multimedia conference according to an exemplary embodiment of the present application.
  • FIG. 8 is a schematic diagram of another interface with a multimedia conference according to an exemplary embodiment of the present application.
  • FIG. 9 is a schematic diagram of another interface with a multimedia conference according to an exemplary embodiment of the present application.
  • FIG. 10 is a schematic diagram of another interface with a multimedia conference according to an exemplary embodiment of the present application.
  • FIG. 11 is a schematic diagram of another interface with a multimedia conference according to an exemplary embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of still another electronic device based on a sound pickup device according to an exemplary embodiment of the present application.
  • FIG. 13 is a block diagram of a voice collection device based on a multimedia conference of a pickup device side according to an exemplary embodiment of the present application
  • FIG. 14 is a schematic structural diagram of an electronic device based on a data transmission device side according to an exemplary embodiment of the present disclosure
  • FIG. 15 is a block diagram of a voice collection device based on a multimedia conference of a data transmission device side according to an exemplary embodiment of the present application.
  • FIG. 16 is a schematic structural diagram of an electronic device according to an exemplary embodiment of the present disclosure.
  • FIG. 17 is a block diagram of a voice collection apparatus for a multimedia conference according to an exemplary embodiment of the present application.
  • FIG. 1 is a schematic diagram of a scenario in which a multimedia conference is held in the related art. As shown in FIG. 1, it is assumed that users such as A1, A2, ..., A10 are in the office A of a certain place, and users such as B1, B2, ..., B10 are in the office B of another location, and then between the office A and the office B. Establishing a multimedia conference can achieve smooth communication between users in different places.
  • the present application provides a low-complexity, low-cost multimedia conference solution by providing a new multimedia conference system that can ensure the sound pickup effect.
  • the multimedia conference system may include:
  • a plurality of sound pickup devices such as a sound pickup device 1, a sound pickup device 2, a sound pickup device 3, a sound pickup device 4, and the like, to collect a conference voice of a local participant in a pickup range;
  • a data transmission device configured to receive a conference voice transmitted by each of the pickup devices through the near field connection when the data transmission device is configured to establish a near field connection with each of the sound pickup devices, and transmit the received conference voice to the pair
  • the conference device used by the terminal participants to play the conference voice to the peer participants.
  • the sound collecting device may include a sound pickup component such as a microphone on the mobile device carried by the local participant, for example, the mobile device may include at least one of a mobile communication device, a wearable device, and the like, so that the sound pickup component It can be reused in the multimedia conference system of the present application to implement the pickup operation of the local conference participant as the sound pickup device of the multimedia conference system.
  • the sound collecting device may include a communication module on the mobile device to establish a near field connection with the data transmission device through the communication module to realize the transmission of the conference voice; of course, the communication module in the same mobile device may also be considered. There is an electrical connection with the sound pickup assembly such that the sound pickup assembly can utilize the communication module to achieve a near field connection with the data transmission device.
  • the sound collecting device includes a sound pickup component such as a microphone on a mobile device carried by the local participant
  • a sound pickup component such as a microphone on a mobile device carried by the local participant
  • the mobile device is a mobile communication device such as a mobile phone or a tablet, or a wearable device such as a smart watch or a smart pendant
  • these mobile devices are often worn on the local participants or placed next to the local participants, that is, the distance between the mobile device and the local participants is small, so although the pickup components on the mobile device
  • the pickup range is small, even much smaller than the pickup range of the conference phone, but the pickup range of the pickup component on the mobile device can still cover at least the local participant who carries the mobile device, thereby eliminating the need to set a conference call. , you can clearly collect the conference voice of the local participants.
  • the “local participant” and the “peer participant” are relative concepts; when the multimedia conference is held between users of n locations, any one of the multimedia conference systems adopting the present application is used.
  • the data transmission device can be any electronic device having a data transmission function without using a conference phone.
  • the data transfer device can be running Android (Android), iOS or other operating system
  • the intelligent control device can be installed with a communication application, such as an enterprise communication application, to communicate with the conference device used by the peer participant to transmit the conference voice sent by each pickup device.
  • the data transmission device can establish a point-to-point connection with the conference device, so that the data transmission device can directly transmit the conference voice to the conference device; or the data transmission device can first transmit the conference voice to the server, and then the server performs the mixing and the like. Then, it is sent to the conference device; of course, the application does not limit the means for the data transmission device to transmit the conference voice.
  • the data transmission device can establish a near field connection with the sound pickup device through the wireless communication technology to receive the conference voice sent by the sound pickup device.
  • the wireless communication technology may be a Bluetooth protocol, a WIFI protocol, a ZigBee protocol, etc., and the application does not limit this.
  • FIG. 3 is a schematic flowchart diagram of a voice collection method based on a multimedia conference of a pickup device side according to an exemplary embodiment
  • FIG. 4 shows an exemplary embodiment.
  • a flow diagram of a voice collection method based on a multimedia conference on a data transmission device side is provided.
  • the method is applied to a sound pickup device, and may include the following steps:
  • Step 302 The sound collecting device establishes a near field connection with the data transmission device, and the data transmission device is assembled at the conference location; the sound pickup device includes a sound pickup component on the mobile device carried by the local participant.
  • the sound pickup device can establish a near field connection with the data transmission device through a wireless communication technology to transmit the conference voice to the data transmission device.
  • the wireless communication technology can be Bluetooth technology, WIFI technology, ZigBee technology, and the like.
  • the data transmission device pre-associated to the community may be displayed by the sound pickup device according to the group to which the local participant corresponding to the sound pickup device belongs; for example, the sound pickup device may acquire the pre-association to the The assembled location of the data transmission device of the group, and according to the geographic location of the pickup device, the data transmission device pre-associated to the community is displayed by the pickup device in a distance order. Then, when receiving a selection instruction of the corresponding local participant for any data transmission device, the pickup device establishes a near field connection with the selected data transmission device. Then, when a plurality of data transmission devices exist at the same time, especially when a plurality of data transmission devices are in the detection range of the pickup device, the local participant can be conveniently selected to select the required data transmission device.
  • Step 304 The sound collecting device collects the conference voice of the local participant in the pickup range.
  • the sound pickup device is a mobile device carried by the local participant
  • the mobile device is worn on the local participant or in the vicinity of the local participant, and thus the pickup range of the mobile device You can reach the local participants and you can clearly collect the conference voice of the local participants. Then, when each local participant separately uses his mobile device as a sound pickup device, on the one hand, the function multiplexing of the mobile device can be realized, and the device can be avoided. Cost, and no complicated function configuration, on the other hand, the mobile device can clearly collect the conference voice sent by the local participants, so that the multimedia conference can be separated from the conference call.
  • Step 306 the sound collecting device transmits the conference voice to the data transmission device, to be further transmitted by the data transmission device to a conference device used by a peer participant, so that the conference voice is The peer participant plays.
  • the method is applied to a data transmission device, and may include the following steps:
  • Step 402 The data transmission device establishes a near field connection with the sound pickup device; the data transmission device is assembled at a conference location, and the sound pickup device includes a sound pickup component on the mobile device carried by the local participant.
  • Step 404 The data transmission device respectively receives the conference voice sent by each of the pickup devices, and the conference voice is collected by the local device to the local participant in the pickup range.
  • Step 406 The data transmission device transmits the received conference voice to the conference device used by the peer participant.
  • the data transmission device can establish a remote point-to-point connection with the conference device used by the peer participant, so that the data transmission device can directly transmit the conference voice to the conference device; or, the data transmission device and the conference device Connect to the server separately to establish a remote connection based on the server.
  • the data transmission device first sends the conference voice to the server, and then the server forwards the conference voice to the conference device.
  • the multimedia conference system based on the application is used to perform voice transmission with the conference device in the office B.
  • the office B can adopt the multimedia conference system based on the application, and the conference device can be the data transmission based on the application.
  • the device, or the office B can also adopt a conference call-based multimedia conference system, and the conference device can be the conference call. Then, when a multimedia conference is held between Office A and Office B, the following two stages can be included:
  • Phase 1 Create a multimedia conference
  • user A1 of office A acts as the initiator of the multimedia conference, and initiates and creates a corresponding multimedia conference to the server; of course, any other user in office A, or any user of office B, can also be used as the initiator.
  • any other user in office A, or any user of office B can also be used as the initiator.
  • only user A1 will be described as an example.
  • the specific creation process is shown in Figure 6, and can include the following steps:
  • Step 602 Show an organization structure of the enterprise in an instant messaging application according to an enterprise to which the initiator belongs.
  • the instant messaging application can be any application with instant messaging function, for example, I think that enterprise instant messaging (EIM), such as the following example of the enterprise instant messaging application "DING Talk". Then, in the contact page of the nail shown in FIG. 7, it is assumed that the user A1 as the initiator belongs to the company A, then the contact page includes the entrance of the organizational structure of the company A; when the organization structure in FIG. 7 After the portal is triggered, you can go to the organizational structure page shown in Figure 8. As shown in FIG. 8 , in the embodiment of the present application, the organization structure page integrates the personnel information of each department such as the “security department” and the “sales department” in the company A, and integrates the internal information of the company A.
  • EIM enterprise instant messaging
  • smart devices such smart devices such as “nail box”, “printer”, “smart router” and “smart attendance machine” are pre-associated to the company A, so that user A1 or other enterprise employees in the company A can Quickly browse and manage these smart devices through the organizational structure, integrate the device management functions within the enterprise with the enterprise instant messaging functions, and improve the management efficiency of smart devices inside the enterprise.
  • the "nail box" shown in FIG. 8 may be a smart set top box, which may be used as the data transmission device in the present application; in other words, the organization may include a data transmission device bound to the enterprise to which the initiator belongs, and the data.
  • the transmission device is assembled at a preset conference location in the enterprise, such as the data transmission device in FIG. 5 is installed in the office A as the "conference terminal" in the office A.
  • Step 604 The instant messaging application initiates a conference request related to the selected data transmission device to the server according to the data transmission device selected by the initiator from the organizational structure.
  • the user A1 as the initiator can select the data transmission device set in the office A through the organization structure page shown in FIG. 8, and assume that the data transmission device is the "peg box” shown in FIG. By selecting the "nail box" as the participant, it can be added to the multimedia conference of the present application.
  • the "peg box” in FIG. 8 when the "peg box” in FIG. 8 is triggered, it can be transferred to the management page shown in FIG. 9, and the user A1 can add the "peg box” as a parameter of the multimedia conference by clicking "initiate multimedia conference” at the bottom.
  • the party for example, can be transferred to the conference management page shown in FIG. 10, and it can be seen that the "peg box” has been added as the participant shown on the conference management page, and the user A1 clicks through Icon, you can further add other enterprise employees such as user A2, user A3, or other data transmission devices (such as data transmission devices in office B), or you can click The icon to delete the selected enterprise employees or data transmission devices, etc., will not be described here.
  • the user A1 can initiate a conference request to the server by clicking the "initiate conference” button at the bottom of FIG. 10, and the conference request includes the "nail box" selected as the participant, and the user A2.
  • the information is such that the server adds the participants to the multimedia conference created for the conference request.
  • the user A1 as the initiator can still perform the management such as “mute all the mute” for the multimedia conference through the conference management page as shown in FIG. 11 , and separately mute each participant.
  • Manage, invite new participants, and delete management actions such as any participant.
  • the mobile device carried by the user needs to establish a near field connection with the data transmission device in the office A.
  • the near field connection may be a Bluetooth connection.
  • the mobile device used by the user A1 may be the mobile phone D1 or the like, and the mobile phone D1 may search for nearby Bluetooth devices:
  • the user A1 can view the Bluetooth device searched by the mobile phone D1, identify the data transmission device in the office A according to the device name, and establish a connection with the data transmission device.
  • user A1 may belong to a certain group, for example, the group may be in various forms such as a business, a government department, and a school.
  • enterprise communication applications such as Enterprise Instant Messaging (EIM), DING Talk, etc.
  • EIM Enterprise Instant Messaging
  • DING Talk etc.
  • the group corresponding to the group can be established, and all data transmission devices assembled in the group can also be associated.
  • the mobile phone D1 can display all the beings through the nail client.
  • the assembled location of each data transmission device can be recorded by the "nailed" server, so that the mobile phone D1 can obtain the assembled location of each data transmission device by accessing the server.
  • the data transmission device M1 is located in the office A
  • the data transmission device M2 is located in the office C, etc., then according to the geographical location of the mobile phone D1 (since the user A1 carries the mobile phone D1, it is equivalent to the geographical location of the user A1), the above may be in the order of distance
  • the data transmission devices are arranged.
  • the data transmission device M1 It can be displayed at the top of the corresponding display page, which is convenient for user A1 to make a selection.
  • the remaining users A2, A3, ..., A10, etc. can establish a connection with the data transmission device through the carried mobile devices D2, D3, ..., D10, etc., and will not be described again here.
  • the data transmission device can receive the conference voices sent by each mobile device, and the conference voices are collected by each mobile device through a microphone or the like, and then sent by the mobile device to the Bluetooth connection to the Bluetooth device. Data transmission equipment.
  • the data transmission device further transmits the conference voice through remote communication.
  • the conference device sent to the office B, such as the data transmission device, can first send the conference voice to the server and then send it to the conference device by the server.
  • the mobile device is a mobile communication device such as a mobile phone
  • the user A1 can place the mobile phone D1 on the conference table or hold it in the hand, then the distance between the mobile phone D1 and the user A1 is very close, and the user A1 can be clearly collected at the conference.
  • Conference voice when the mobile device is a wearable device such as a smart watch or a smart pendant, for example, the user A10 can wear the smart watch D10 on the wrist, then the smart watch D10 is also close to the user A10 and can be clearly collected.
  • the mobile device does not necessarily have a one-to-one correspondence with the user.
  • the mobile phone D1 when the user A1 places the mobile phone D1 on the conference table, since the user A2 sits next to the user A1, the mobile phone D1 is also close to the user A2. Therefore, even if the user A2 does not carry the mobile device D2, the mobile phone D1 can collect the conference voice of the user A2.
  • each mobile device has a certain range of pickups, and when one or more users are present in the pickup range, the mobile device can pick up the one or more users; for example, when only the pickup range is included
  • the mobile device can simultaneously pick up multiple users.
  • the nail transfer client can be installed in the data transfer device, and the data transfer device can perform data interaction with the staple server by installing the nail client, in addition to sending the conference voice to the nail server for sending by the nail server.
  • the operating status, the geographical location, and the like of the conference device can also be reported to the nail server, so that the corresponding home group can manage the data transmission device.
  • the data transmission device may be any device that can implement data transmission.
  • the data transmission device may be an intelligent control device running a running system such as Android or iOS, such as a smart set top box in the related art, and the like.
  • the data transmission device also receives the conference voice from the office B, as shown in FIG. 5: when the data transmission device has a voice playback component such as a speaker, the conference voice from the office B can be directly played; when the data transmission device does not have the voice When playing the component, you can play the conference voice from Office B through a voice playback device such as an external speaker.
  • a voice playback component such as a speaker
  • the multimedia conference in this application can be a voice conference (such as a conference call) or a video conference (in combination with voice and video), and can be distributed by the participant's mobile device through the multimedia conference system of the present application.
  • Pick-up solution that is, each mobile device separately picks up the participants in the pickup range to achieve Low-cost, high-quality pickup, eliminating the need for costly equipment such as conference phones.
  • the camera A can be equipped in the office A, and after the camera captures the video image of the office A, the corresponding local video data can be sent to the data transmission device, and Transferred to Office B by the data transfer device.
  • the office A can also be equipped with a display device such as a television.
  • the data transmission device receives the peer video data from the office B, the peer video data can be transmitted to the display device, so that the display device can The peer video data is played.
  • FIG. 12 shows a schematic structural diagram of an electronic device based on a pickup device side according to an exemplary embodiment of the present application.
  • the electronic device includes a processor 1202, an internal bus 1204, a network interface 1206, a memory 1208, and a non-volatile memory 1210, and of course may also include hardware required for other services.
  • the processor 1202 reads the corresponding computer program from the non-volatile memory 1210 into the memory 1202 and then operates to form a voice collection device based on the multimedia conference of the pickup device side on the logical level.
  • the present application does not exclude other implementation manners, such as a logic device or a combination of software and hardware, etc., that is, the execution body of the following processing flow is not limited to each logical unit, and may be Hardware or logic device.
  • the voice collection device of the multimedia conference may include an establishing unit 1301 , an acquiring unit 1302 , and a transmitting unit 1303 . among them:
  • the establishing unit 1301 is configured to establish a near field connection between the sound collecting device and the data transmitting device, wherein the data transmitting device is assembled at a meeting place; and the sound collecting device comprises a sound collecting component on the mobile device carried by the local participant;
  • the collecting unit 1302 is configured to enable the sound collecting device to collect the conference voice of the local participant in the pickup range;
  • the transmitting unit 1303 is configured to enable the sound collecting device to transmit the conference voice to the data transmission device, to be further transmitted by the data transmission device to a conference device used by a peer participant, so that the conference voice is directed to The opposite participant plays.
  • the establishing unit 1301 is specifically configured to:
  • the establishing unit 1301 is specifically configured to:
  • the sound collecting device displays a data transmission device pre-associated to the community
  • the sound pickup device establishes a near field connection with the selected data transmission device when receiving a selection instruction of the corresponding local participant for any of the data transmission devices.
  • the establishing unit 1301 causes the sound collecting device to display the data transmission device pre-associated to the community by:
  • the pickup device acquires an assembled location of a data transmission device pre-associated to the community
  • the pickup device displays the data transmission devices pre-associated to the community in a distance order according to the geographic location of the sound pickup device.
  • FIG. 14 shows a schematic structural diagram of an electronic device based on a pickup device side according to an exemplary embodiment of the present application.
  • the electronic device includes a processor 1402, an internal bus 1404, a network interface 1406, a memory 1408, and a non-volatile memory 1410, and may of course include hardware required for other services.
  • the processor 1402 reads the corresponding computer program from the non-volatile memory 1410 into the memory 1402 and then operates to form a voice collection device based on the multimedia conference of the data transmission device side on the logical level.
  • the present application does not exclude other implementation manners, such as a logic device or a combination of software and hardware, etc., that is, the execution body of the following processing flow is not limited to each logical unit, and may be Hardware or logic device.
  • the voice collection device of the multimedia conference may include an establishing unit 1501, a receiving unit 1502, and a transmitting unit 1503. among them:
  • the unit 1501 is configured to establish a near field connection between the data transmission device and the sound pickup device; the data transmission device is assembled at a conference location, and the sound pickup device includes a sound pickup component on the mobile device carried by the local participant;
  • the receiving unit 1502 is configured to receive, by the data transmission device, the conference voice sent by each of the sound pickup devices, and the conference voice is collected by the sound pickup device to the local participant in the sound pickup range;
  • the transmitting unit 1503 causes the data transmission device to transmit the received conference voice to the conference device used by the peer participant to play the conference voice to the peer participant.
  • FIG. 16 shows a schematic structural diagram of an electronic device based on a pickup device side according to an exemplary embodiment of the present application.
  • the electronic device includes a processor 1602, an internal bus 1604, a network interface 1606, a memory 1608, and a non-volatile memory 1610, and of course may also include hardware required for other services.
  • the processor 1602 reads the corresponding computer program from the non-volatile memory 1610 into the memory 1602 and then operates to form a voice collection device based on the multimedia conference of the data transmission device side on the logical level.
  • the present application does not exclude other implementation manners, such as a logic device or a combination of software and hardware, etc., that is, the execution body of the following processing flow is not limited to each logical unit, and may be Hardware or logic device.
  • the voice collection device of the multimedia conference may include a display unit. 1701 and request unit 1702. among them:
  • the display unit 1701 displays an organization structure of the enterprise in an instant messaging application according to an enterprise to which the initiator belongs, where the organization structure includes a data transmission device bound to the enterprise, and the data transmission device is assembled a meeting place preset in the enterprise;
  • the requesting unit 1702 according to the data transmission device selected by the initiator from the organization, the instant messaging application initiates a conference request related to the selected data transmission device to the server, so that the selected data transmission device Adding to the multimedia conference created by the server for the conference request;
  • the selected data transmission device also forms a multimedia conference system with a plurality of sound pickup devices at the conference location; the sound pickup device includes the mobile device carried by the local conference participant of the multimedia conference. a sound pickup assembly for collecting a conference voice of a local conference participant within a pickup range; the data transmission device configured to receive a near field connection with the pickup device for receiving the transmission by the pickup device The conference voice is transmitted to the conference device used by the peer participant of the multimedia conference.
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.
  • first, second, third, etc. may be used to describe various information in this application, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
  • first information may also be referred to as the second information without departing from the scope of the present application.
  • second information may also be referred to as the first information.
  • word "if” as used herein may be interpreted as "when” or “when” or “in response to a determination.”

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Telephonic Communication Services (AREA)

Abstract

本申请提供一种多媒体会议系统、多媒体会议的语音采集方法及装置，该多媒体会议系统可以包括：若干拾音设备，所述拾音设备包括本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；数据传输设备，所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至对端参会者采用的会议设备。通过本申请的技术方案，可以在无需专业的会议电话的情况下，对多媒体会议的参会者进行清晰拾音。

Description

多媒体会议系统、多媒体会议的语音采集方法及装置
本申请要求2016年08月03日递交的申请号为201610629550.9、发明名称为“多媒体会议系统、多媒体会议的语音采集方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通讯技术领域，尤其涉及一种多媒体会议系统、多媒体会议的语音采集方法及装置。
背景技术
多地用户可以通过召开多媒体会议，以便于异地交流。多媒体会议的召开，通常需要使用会议电话(conference phone)，由于会议电话具有强大的拾音功能，在免提状态下可以清晰地拾取数米范围内的声音，便于多地用户之间的良好沟通。
但是，会议电话的配置复杂度和维护成本都很高，并不适用于所有场景下，尤其是对于轻量化、小型化的团体而言，往往难以采用会议电话，从而提升了多地用户之间的沟通成本、降低了沟通效率。
发明内容
有鉴于此，本申请提供一种多媒体会议系统、多媒体会议的语音采集方法及装置
为实现上述目的，本申请提供技术方案如下：
根据本申请的第一方面，提出了一种多媒体会议系统，包括：
若干拾音设备，所述拾音设备包括本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；
数据传输设备，所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至对端参会者采用的会议设备。
根据本申请的第二方面，提出了一种多媒体会议的语音采集方法，包括：
拾音设备与数据传输设备建立近场连接，所述数据传输设备被装配于会议地点处；所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
所述拾音设备采集拾音范围内的本端参会者的会议语音；
所述拾音设备将所述会议语音传输至所述数据传输设备，以由所述数据传输设备进一步传输至对端参会者采用的会议设备。
根据本申请的第三方面，提出了一种多媒体会议的语音采集方法，包括：
数据传输设备与拾音设备建立近场连接；所述数据传输设备被装配于会议地点处，所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
所述数据传输设备分别接收每一拾音设备发送的会议语音，所述会议语音由拾音设备对拾音范围内的本端参会者进行采集得到；
所述数据传输设备将接收到的会议语音传输至对端参会者采用的会议设备，以向所述对端参会者播放所述会议语音。
根据本申请的第四方面，提出了一种多媒体会议的语音采集装置，包括：
建立单元，使拾音设备与数据传输设备建立近场连接，所述数据传输设备被装配于会议地点处；所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
采集单元，使所述拾音设备采集拾音范围内的本端参会者的会议语音；
传输单元，使所述拾音设备将所述会议语音传输至所述数据传输设备，以由所述数据传输设备进一步传输至对端参会者采用的会议设备。
根据本申请的第五方面，提出了一种多媒体会议的语音采集装置，包括：
建立单元，使数据传输设备与拾音设备建立近场连接；所述数据传输设备被装配于会议地点处，所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
接收单元，使所述数据传输设备分别接收每一拾音设备发送的会议语音，所述会议语音由拾音设备对拾音范围内的本端参会者进行采集得到；
传输单元，使所述数据传输设备将接收到的会议语音传输至对端参会者采用的会议设备。
根据本申请的第六方面，提出了一种多媒体会议的语音采集方法，包括：
根据发起方所属的企业，在即时通讯应用中示出所述企业的组织架构，所述组织架构中包含被绑定至所述企业的数据传输设备，所述数据传输设备被装配于所述企业中预设的会议地点处；
根据所述发起方从所述组织架构中选择的数据传输设备，所述即时通讯应用向服务器发起与被选中的数据传输设备相关的会议请求，使所述被选中的数据传输设备被添加至所述服务器针对所述会议请求创建的多媒体会议；
其中，所述被选中的数据传输设备还与所处的会议地点处的若干拾音设备构成多媒 体会议系统；所述拾音设备包括所述多媒体会议的本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至所述多媒体会议的对端参会者采用的会议设备。
根据本申请的第七方面，提出了一种多媒体会议的语音采集装置，包括：
展示单元，根据发起方所属的企业，在即时通讯应用中展示所述企业的组织架构，所述组织架构中包含被绑定至所述企业的数据传输设备，所述数据传输设备被装配于所述企业中预设的会议地点处；
请求单元，根据所述发起方从所述组织架构中选择的数据传输设备，所述即时通讯应用向服务器发起与被选中的数据传输设备相关的会议请求，使所述被选中的数据传输设备被添加至所述服务器针对所述会议请求创建的多媒体会议；
其中，所述被选中的数据传输设备还与所处的会议地点处的若干拾音设备构成多媒体会议系统；所述拾音设备包括所述多媒体会议的本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至所述多媒体会议的对端参会者采用的会议设备。
由以上技术方案可见，本申请通过将本端参会者携带的移动设备作为拾音设备，可以实现对移动设备的功能复用，而且由于该移动设备由本端参会者随身携带、与本端参会者相距较近，可以获得较佳的拾音效果，而无需使用专业的会议电话，只需要使用任意的数据传输设备与对端参会者采用的会议设备进行会议语音传输即可，既可以避免增加设备成本，又可以降低多媒体会议的配置复杂度和维护成本。
附图说明
图1是相关技术中的召开多媒体会议的场景示意图；
图2是本申请一示例性实施例提供的一种多媒体会议系统的架构示意图；
图3是本申请一示例性实施例提供的一种基于拾音设备侧的多媒体会议的语音采集方法的流程示意图；
图4是本申请一示例性实施例提供的一种基于数据传输设备侧的多媒体会议的语音采集方法的流程示意图；
图5是本申请一示例性实施例提供的一种召开多媒体会议的场景示意图；
图6是本申请一示例性实施例提供的一种多媒体会议的语音采集方法的流程示意图；
图7是本申请一示例性实施例提供的一种与多媒体会议的界面示意图；
图8是本申请一示例性实施例提供的另一种与多媒体会议的界面示意图；
图9是本申请一示例性实施例提供的又一种与多媒体会议的界面示意图；
图10是本申请一示例性实施例提供的又一种与多媒体会议的界面示意图；
图11是本申请一示例性实施例提供的又一种与多媒体会议的界面示意图；
图12是本申请一示例性实施例提供的又一种基于拾音设备侧的电子设备的结构示意图；
图13是本申请一示例性实施例提供的一种基于拾音设备侧的多媒体会议的语音采集装置的框图；
图14是本申请一示例性实施例提供的一种基于数据传输设备侧的电子设备的结构示意图；
图15是本申请一示例性实施例提供的一种基于数据传输设备侧的多媒体会议的语音采集装置的框图；
图16是本申请一示例性实施例提供的一种电子设备的结构示意图；
图17是本申请一示例性实施例提供的一种多媒体会议的语音采集装置的框图。
具体实施方式
图1是相关技术中的召开多媒体会议的场景示意图。如图1所示，假定A1、A2……A10等用户处于某一地点的办公室A，而B1、B2……B10等用户处于另一地点的办公室B，那么通过在办公室A与办公室B之间建立多媒体会议，可以实现异地用户之间的顺利沟通。
以办公室A为例。需要预先在办公室A内安装、调试和维护一台会议电话1，该会议电话1可以采集办公室A内的A1、A2等各个用户的声音，以传输至办公室B。由于会议电话1在免提状态下具有强大的拾音功能，因而即便是距离该会议电话1较远的A5、A10等用户，会议电话1仍然能够实现很好的拾音效果。
但是，会议电话1的配置复杂度和成本都很高，对于用户而言具有一定的使用门槛。
因此，本申请通过提出一种新的多媒体会议系统，可以在确保拾音效果的情况下，提供一种低复杂度、低成本的多媒体会议方案。为对本申请进行进一步说明，提供下列 实施例：
图2是本申请一示例性实施例提供的一种多媒体会议系统的架构示意图，如图2所示，该多媒体会议系统可以包括：
若干拾音设备，比如拾音设备1、拾音设备2、拾音设备3、拾音设备4等，以采集拾音范围内的本端参会者的会议语音；
数据传输设备，该数据传输设备被配置为与各个拾音设备分别建立近场连接时，用于通过该近场连接接收各个拾音设备发送的会议语音，并将接收到的会议语音传输至对端参会者采用的会议设备，以向对端参会者播放该会议语音。
在本实施例中，拾音设备可以包括本端参会者携带的移动设备上的麦克风等拾音组件，比如该移动设备可以包括移动通讯设备、可穿戴设备等至少之一，使得拾音组件可以复用于本申请的多媒体会议系统中，以作为该多媒体会议系统的拾音设备，实现对本端参会者的拾音操作。相应地，拾音设备可以包括所属移动设备上的通讯模块，从而通过该通讯模块与数据传输设备建立近场连接，以实现对会议语音的传输；当然，也可以认为同一移动设备内的通讯模块与拾音组件之间存在电连接，使得拾音组件可以利用该通讯模块实现与数据传输设备之间的近场连接。
其中，当拾音设备包括本端参会者携带的移动设备上的麦克风等拾音组件时，比如当移动设备为手机、平板等移动通讯设备，或者智能手表、智能吊坠等可穿戴设备时，这些移动设备往往被佩戴于本端参会者身上，或者放置在本端参会者旁边，即移动设备与本端参会者之间的间距很小，因此虽然移动设备上的拾音组件的拾音范围较小、甚至远小于会议电话的拾音范围，但是该移动设备上的拾音组件的拾音范围仍然能够至少覆盖到携带该移动设备的本端参会者，从而无需设置会议电话，即可清晰地采集到本端参会者的会议语音。
在本实施例中，“本端参会者”与“对端参会者”是相对概念；当多媒体会议在n个地点的用户之间召开时，针对采用本申请的多媒体会议系统的任一地点的参会者而言，若称该任一地点的参会者为“本端参会者”，那剩余的n-1个地点的参会者均可以称为对应于该任一地点的“对端参会者”。其中，n≥2；当n＝2时，表明该多媒体会议在两方之间实现，而当n＞2时，表明该多媒体会议在三方或更多方之间实现，本申请并不限制多媒体会议的参与方的数量。
在本实施例中，数据传输设备可以为具有数据传输功能的任意电子设备，而无需采用会议电话。例如，该数据传输设备可以为运行Android(安卓)、iOS或其他操作系统 的智能控制设备，该智能控制设备可以安装有通讯应用程序，比如企业通讯应用等，从而与对端参会者使用的会议设备进行通讯，以传输各个拾音设备发送的会议语音。其中，数据传输设备可以与该会议设备建立点对点连接，使数据传输设备可以将会议语音直接传输至会议设备；或者，数据传输设备可以首先将会议语音传输至服务器，然后由服务器进行混音等处理后发送至会议设备；当然，本申请并不限制数据传输设备对会议语音的传输手段。
在本实施例中，数据传输设备可以通过无线通讯技术与拾音设备建立近场连接，以接收拾音设备发送的会议语音。例如，该无线通讯技术可以为蓝牙协议、WIFI协议、ZigBee协议等，本申请并不对此进行限制。
针对图2所示的多媒体会议系统，图3示出了一示例性实施例提供的一种基于拾音设备侧的多媒体会议的语音采集方法的流程示意图，图4示出了一示例性实施例提供的一种基于数据传输设备侧的多媒体会议的语音采集方法的流程示意图。
如图3所示，该方法应用于拾音设备上，可以包括以下步骤：
步骤302，拾音设备与数据传输设备建立近场连接，所述数据传输设备被装配于会议地点处；所述拾音设备包括本端参会者携带的移动设备上的拾音组件。
在本实施例中，拾音设备可以通过无线通讯技术与数据传输设备建立近场连接，以向数据传输设备发送会议语音。例如，该无线通讯技术可以为蓝牙技术、WIFI技术、ZigBee技术等。
在本实施例中，可以根据拾音设备对应的本端参会者归属的团体，由拾音设备展示出预关联至该团体的数据传输设备；例如，拾音设备可以获取预关联至所述团体的数据传输设备的被装配地点，并根据所述拾音设备的地理位置，由该拾音设备按照距离顺序排列展示出预关联至所述团体的数据传输设备。然后，当接收到对应的本端参会者针对任一数据传输设备的选择指令时，该拾音设备与被选中的数据传输设备建立近场连接。那么，当同时存在多个数据传输设备时，尤其是当多个数据传输设备均处于拾音设备的检测范围时，可便于本端参会者选取所需的数据传输设备。
步骤304，所述拾音设备采集拾音范围内的本端参会者的会议语音。
在本实施例中，由于拾音设备为本端参会者携带的移动设备，该移动设备被佩戴于本端参会者身上或者位于本端参会者附近，因而该移动设备的拾音范围能够覆盖到本端参会者，可以清晰地采集到本端参会者的会议语音。那么，当每一本端参会者分别将自身的移动设备作为拾音设备时，一方面可以实现对移动设备的功能复用、避免增加设备 成本，也无需复杂的功能配置，另一方面移动设备可以清晰地采集到本端参会者发出的会议语音，使得多媒体会议可以脱离对会议电话的依赖。
步骤306，所述拾音设备将所述会议语音传输至所述数据传输设备，以由所述数据传输设备进一步传输至对端参会者采用的会议设备，使所述会议语音被向所述对端参会者进行播放。
相应地，如图4所示，该方法应用于数据传输设备上，可以包括以下步骤：
步骤402，数据传输设备与拾音设备建立近场连接；所述数据传输设备被装配于会议地点处，所述拾音设备包括本端参会者携带的移动设备上的拾音组件。
步骤404，所述数据传输设备分别接收每一拾音设备发送的会议语音，所述会议语音由拾音设备对拾音范围内的本端参会者进行采集得到。
步骤406，所述数据传输设备将接收到的会议语音传输至对端参会者采用的会议设备。
在本实施例中，数据传输设备可以与对端参会者采用的会议设备之间建立远程的点对点连接，使得数据传输设备可直接将会议语音传输至会议设备；或者，数据传输设备与会议设备分别连接至服务器，建立基于该服务器的远程连接，数据传输设备首先将会议语音发送至服务器，然后由服务器将会议语音转发至会议设备。
下面结合一具体场景，对本申请的技术方案进行详细描述。如图5所示，假定某一地点的办公室A存在用户A1、A2……A10等，需要与另一地点的办公室B的用户之间召开多媒体会议。在办公室A中采用基于本申请的多媒体会议系统，与办公室B中的会议设备进行语音传输；其中，办公室B可以采用基于本申请的多媒体会议系统，那么该会议设备可以为基于本申请的数据传输设备，或者办公室B也可以采用基于会议电话的多媒体会议系统，那么该会议设备可以为该会议电话。那么，在办公室A与办公室B之间召开多媒体会议时，可以包括下述两个阶段：
阶段一：创建多媒体会议
假定由办公室A的用户A1作为多媒体会议的发起方，向服务器发起并创建相应的多媒体会议；当然，实际上办公室A中的其他任一用户，或者办公室B的任意用户，也都可以作为该发起方，此处仅以用户A1为例进行说明。具体的创建流程如图6所示，可以包括以下步骤：
步骤602，根据发起方所属的企业，在即时通讯应用中示出所述企业的组织架构。
在本实施例中，以即时通讯应用可以为任意具有即时通讯功能的应用程序，例如可 以为企业即时通讯应用(Enterprise Instant Messaging，EIM)，比如下面以企业即时通讯应用“钉钉(DING Talk)”为例进行说明。那么在图7所示的钉钉的联系人页面中，假定作为发起方的用户A1属于A公司，那么该联系人页面中包括该A公司的组织架构的入口；当图7中的“组织架构”入口被触发后，可以转入图8所示的组织架构页面。如图8所示，在本申请的实施例中，组织架构页面中除了包括A公司内的“安全部”、“销售部”等各个部门的人员信息之外，还集成了该A公司内部的“智能设备”，这些诸如“钉盒”、“打印机”、“智能路由器”和“智能考勤机”等智能设备被预先关联至该A公司，使得用户A1或该A公司内的其他企业员工可以通过组织架构快速浏览和管理这些智能设备，将企业内部的设备管理功能与企业即时通讯功能相融合，便于提升对企业内部的智能设备的管理效率。
其中，图8所示的“钉盒”可以为一种智能机顶盒，可以作为本申请中的数据传输设备；换言之，组织架构中可以包含被绑定至发起方所属企业的数据传输设备，这些数据传输设备被装配于该企业中预设的会议地点处，比如图5中的数据传输设备被装配于办公室A中，作为该办公室A中的“会议终端”。
步骤604，根据发起方从组织架构中选择的数据传输设备，即时通讯应用向服务器发起与被选中的数据传输设备相关的会议请求。
在本实施例中，作为发起方的用户A1可以通过图8所示的组织架构页面，选择办公室A内设置的数据传输设备，假定该数据传输设备为图8所示的“钉盒”，那么通过将该“钉盒”选取为参会方，即可使其加入本申请的多媒体会议中。
例如当图8中的“钉盒”被触发时，可以转入图9所示的管理页面，用户A1可以通过点击底部的“发起多媒体会议”，将该“钉盒”添加为多媒体会议的参会方，比如可以转入图10所示的会议管理页面，可见该“钉盒”已被添加为该会议管理页面示出的参会方，且用户A1通过点击
Figure PCTCN2017093769-appb-000001
图标，还可以进一步添加用户A2、用户A3等其他企业员工，或者其他数据传输设备(例如办公室B中的数据传输设备等)，或者可以通过点击
Figure PCTCN2017093769-appb-000002
图标来删除已选取的企业员工或数据传输设备等，此处不再赘述。
那么，在添加完参会方后，用户A1可以通过点击图10底部的“发起会议”按钮，向服务器发起会议请求，该会议请求中包括被选为参会方的“钉盒”、用户A2等的信息，使得服务器将参会方均添加至针对该会议请求创建的多媒体会议中。
此外，在多媒体会议的过程中，作为发起方的用户A1仍然可以通过如图11所示的会议管理页面，对多媒体会议进行诸如“全员静音”管理、对每个参会方进行单独的静音管理、邀请新的参会方以及删除任一参会方等管理操作。
阶段二：会议数据传输
1)本端语音传输
一方面，在用户A1、A2等进入办公室A后，需要将自身携带的移动设备与该办公室A中的数据传输设备建立近场连接，比如该近场连接可以为蓝牙连接。以用户A1为例，该用户A1使用的移动设备可以为手机D1等，该手机D1可以搜索到附近的蓝牙设备：
一种情况下，用户A1可以查看到手机D1搜索到的蓝牙设备，根据设备名称识别出办公室A中的数据传输设备，并与该数据传输设备建立连接。
另一种情况下，用户A1可以归属于某一团体，比如该团体可以企业、政府部门、学校等多种形式。通过企业通讯应用，比如企业即时通讯应用(EIM，Enterprise Instant Messaging)“钉钉(DING Talk)”等，可以建立该团体对应的群组，并且还可以将该团体内装配的所有数据传输设备关联至该群组，那么针对归属于该团体及该群组的用户A1，通过预先在手机D1上安装“钉钉”的客户端应用程序，该手机D1可以通过该钉钉客户端展示出所有被关联至该团体的数据传输设备，以供用户A1进行选择。
其中，数据传输设备被关联至该群组时，每一数据传输设备的被装配地点可以被“钉钉”的服务器记录，使得手机D1可以通过访问服务器而获取每一数据传输设备的被装配地点。比如数据传输设备M1位于办公室A、数据传输设备M2位于办公室C等，那么根据手机D1的地理位置(由于用户A1携带该手机D1，则相当于是用户A1的地理位置)，可以按照距离顺序对上述的数据传输设备进行排列。那么，当用户A1进入办公室A后，即便手机D1同时搜索到数据传输设备M1、数据传输设备M2，但是由于手机D1将与该办公室A中装配的数据传输设备M1距离最近，该数据传输设备M1可以被显示在相应的展示页面的最上方，便于用户A1进行选择。
类似地，其余用户A2、A3……A10等，分别可以通过携带的移动设备D2、D3……D10等，与数据传输设备建立连接，此处不再赘述。
另一方面，在多媒体会议过程中，数据传输设备可以接收各台移动设备发送的会议语音，这些会议语音由各台移动设备通过麦克风等拾音组件采集得到，然后由移动设备通过蓝牙连接发送至数据传输设备。而数据传输设备进一步通过远程通讯将会议语音发 送至办公室B的会议设备，比如数据传输设备可以首先将会议语音发送至服务器，然后由服务器发送至会议设备。
当移动设备为手机等移动通讯设备时，例如用户A1可以将手机D1放在会议桌上或者握于手中，那么手机D1与用户A1的距离很近，可以清晰地采集到用户A1在会议上的会议语音；当移动设备为智能手表、智能吊坠等可穿戴设备时，例如用户A10可以将智能手表D10戴在手腕上，那么该智能手表D10同样与该用户A10距离很近，可以清晰地采集到用户A10在会议上的会议语音。当然，移动设备与用户之间并不一定是一一对应，比如当用户A1将手机D1置于会议桌上时，由于用户A2坐在用户A1旁边，那么手机D1同样与用户A2距离很近，因而即便用户A2并未携带移动设备D2，手机D1也可以对该用户A2的会议语音进行采集。
换言之，每个移动设备具有一定的拾音范围，在该拾音范围内存在一个或多个用户时，该移动设备可以对该一个或多个用户进行拾音；比如当拾音范围内仅包含一个用户时，比如携带该移动设备的用户，那么可以仅对该用户进行拾音，而当拾音范围内包含多个用户时，移动设备可以对多个用户同时进行拾音。
数据传输设备中可以安装有钉钉客户端，而通过安装钉钉客户端，使得数据传输设备可以与钉钉服务器进行数据交互，除了可以将会议语音发送至钉钉服务器，以由钉钉服务器发送至会议设备，还可以将自身的运行状态、地理位置等上报至钉钉服务器，以便于相应的归属团体对该数据传输设备进行管理。
数据传输设备可以为任意可实现数据传输的设备，例如该数据传输设备可以为运行Android、iOS等运行系统的智能控制设备，比如相关技术中的智能机顶盒等，本申请并不对此进行限制。
2)对端语音传输
数据传输设备还接收到来自办公室B的会议语音，如图5所示：当数据传输设备具备扬声器等语音播放组件时，可以直接对来自办公室B的会议语音进行播放；当数据传设备不具备语音播放组件时，可以通过外接音箱等语音播放设备，以播放来自办公室B的会议语音。
3)视频传输
本申请中的多媒体会议，可以为语音会议(如电话会议)，也可以为视频会议(结合语音与视频)，均可以通过本申请的多媒体会议系统，实现基于参会者的移动设备的分布式拾音方案，即每个移动设备分别对拾音范围内的参会者进行拾音操作，从而达到 低成本、高质量的拾音效果，无需采用会议电话等高成本设备。
当多媒体会议需要传输视频画面时，如图5所示，在办公室A中可以装配有摄像头，该摄像头采集得到办公室A的视频画面后，可以将相应的本端视频数据发送给数据传输设备，并由数据传输设备传输至办公室B。同时，办公室A还可以装配有电视机等显示设备，当数据传输设备接收到来自办公室B的对端视频数据时，可以将该对端视频数据传输至该显示设备，以由该显示设备对该对端视频数据进行播放。
图12示出了根据本申请的一示例性实施例的一种基于拾音设备侧的电子设备的示意结构图。请参考图12，在硬件层面，该电子设备包括处理器1202、内部总线1204、网络接口1206、内存1208以及非易失性存储器1210，当然还可能包括其他业务所需要的硬件。处理器1202从非易失性存储器1210中读取对应的计算机程序到内存1202中然后运行，在逻辑层面上形成基于拾音设备侧的多媒体会议的语音采集装置。当然，除了软件实现方式之外，本申请并不排除其他实现方式，比如逻辑器件抑或软硬件结合的方式等等，也就是说以下处理流程的执行主体并不限定于各个逻辑单元，也可以是硬件或逻辑器件。
请参考图13，在软件实施方式中，该多媒体会议的语音采集装置可以包括建立单元1301、采集单元1302和传输单元1303。其中：
建立单元1301，使拾音设备与数据传输设备建立近场连接，所述数据传输设备被装配于会议地点处；所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
采集单元1302，使所述拾音设备采集拾音范围内的本端参会者的会议语音；
传输单元1303，使所述拾音设备将所述会议语音传输至所述数据传输设备，以由所述数据传输设备进一步传输至对端参会者采用的会议设备，使所述会议语音被向所述对端参会者进行播放。
可选的，所述建立单元1301具体用于：
使所述拾音设备通过无线通讯技术与所述数据传输设备建立近场连接，以向所述数据传输设备发送会议语音。
可选的，所述建立单元1301具体用于：
根据所述拾音设备对应的本端参会者归属的团体，所述拾音设备展示出预关联至所述团体的数据传输设备；
当接收到对应的本端参会者针对任一数据传输设备的选择指令时，所述拾音设备与被选中的数据传输设备建立近场连接。
可选的，所述建立单元1301通过下述方式使拾音设备展示出预关联至所述团体的数据传输设备：
所述拾音设备获取预关联至所述团体的数据传输设备的被装配地点；
根据所述拾音设备的地理位置，所述拾音设备按照距离顺序排列展示出预关联至所述团体的数据传输设备。
图14示出了根据本申请的一示例性实施例的一种基于拾音设备侧的电子设备的示意结构图。请参考图14，在硬件层面，该电子设备包括处理器1402、内部总线1404、网络接口1406、内存1408以及非易失性存储器1410，当然还可能包括其他业务所需要的硬件。处理器1402从非易失性存储器1410中读取对应的计算机程序到内存1402中然后运行，在逻辑层面上形成基于数据传输设备侧的多媒体会议的语音采集装置。当然，除了软件实现方式之外，本申请并不排除其他实现方式，比如逻辑器件抑或软硬件结合的方式等等，也就是说以下处理流程的执行主体并不限定于各个逻辑单元，也可以是硬件或逻辑器件。
请参考图15，在软件实施方式中，该多媒体会议的语音采集装置可以包括建立单元1501、接收单元1502和传输单元1503。其中：
建立单元1501，使数据传输设备与拾音设备建立近场连接；所述数据传输设备被装配于会议地点处，所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
接收单元1502，使所述数据传输设备分别接收每一拾音设备发送的会议语音，所述会议语音由拾音设备对拾音范围内的本端参会者进行采集得到；
传输单元1503，使所述数据传输设备将接收到的会议语音传输至对端参会者采用的会议设备，以向所述对端参会者播放所述会议语音。
图16示出了根据本申请的一示例性实施例的一种基于拾音设备侧的电子设备的示意结构图。请参考图16，在硬件层面，该电子设备包括处理器1602、内部总线1604、网络接口1606、内存1608以及非易失性存储器1610，当然还可能包括其他业务所需要的硬件。处理器1602从非易失性存储器1610中读取对应的计算机程序到内存1602中然后运行，在逻辑层面上形成基于数据传输设备侧的多媒体会议的语音采集装置。当然，除了软件实现方式之外，本申请并不排除其他实现方式，比如逻辑器件抑或软硬件结合的方式等等，也就是说以下处理流程的执行主体并不限定于各个逻辑单元，也可以是硬件或逻辑器件。
请参考图17，在软件实施方式中，该多媒体会议的语音采集装置可以包括展示单元 1701和请求单元1702。其中：
展示单元1701，根据发起方所属的企业，在即时通讯应用中展示所述企业的组织架构，所述组织架构中包含被绑定至所述企业的数据传输设备，所述数据传输设备被装配于所述企业中预设的会议地点处；
请求单元1702，根据所述发起方从所述组织架构中选择的数据传输设备，所述即时通讯应用向服务器发起与被选中的数据传输设备相关的会议请求，使所述被选中的数据传输设备被添加至所述服务器针对所述会议请求创建的多媒体会议；
其中，所述被选中的数据传输设备还与所处的会议地点处的若干拾音设备构成多媒体会议系统；所述拾音设备包括所述多媒体会议的本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至所述多媒体会议的对端参会者采用的会议设备。
在一个典型的配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带，磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括暂存电脑可读媒体(transitory media)，如调制的数据信号和载波。
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排 除在包括所述要素的过程、方法、商品或者设备中还存在另外的相同要素。
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。
在本申请使用的术语是仅仅出于描述特定实施例的目的，而非旨在限制本申请。在本申请和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义。还应当理解，本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。
应当理解，尽管在本申请可能采用术语第一、第二、第三等来描述各种信息，但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如，在不脱离本申请范围的情况下，第一信息也可以被称为第二信息，类似地，第二信息也可以被称为第一信息。取决于语境，如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。
以上所述仅为本申请的较佳实施例而已，并不用以限制本申请，凡在本申请的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本申请保护的范围之内。

Claims (16)

  1. 一种多媒体会议系统，其特征在于，包括：
    若干拾音设备，所述拾音设备包括本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；
    数据传输设备，所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至对端参会者采用的会议设备。
  2. 根据权利要求1所述的系统，其特征在于，所述移动设备包括以下至少之一：移动通讯设备、可穿戴设备。
  3. 根据权利要求1所述的系统，其特征在于，所述数据传输设备被配置为通过无线通讯技术与所述拾音设备建立近场连接，以接收所述拾音设备发送的会议语音。
  4. 根据权利要求1所述的系统，其特征在于，所述数据传输设备包括：智能机顶盒。
  5. 一种多媒体会议的语音采集方法，其特征在于，包括：
    拾音设备与数据传输设备建立近场连接，所述数据传输设备被装配于会议地点处；所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
    所述拾音设备采集拾音范围内的本端参会者的会议语音；
    所述拾音设备将所述会议语音传输至所述数据传输设备，以由所述数据传输设备进一步传输至对端参会者采用的会议设备。
  6. 根据权利要求5所述的方法，其特征在于，所述拾音设备与数据传输设备建立近场连接，包括：
    所述拾音设备通过无线通讯技术与所述数据传输设备建立近场连接，以向所述数据传输设备发送会议语音。
  7. 根据权利要求5所述的方法，其特征在于，所述拾音设备与数据传输设备建立近场连接，包括：
    根据所述拾音设备对应的本端参会者归属的团体，所述拾音设备展示出预关联至所述团体的数据传输设备；
    当接收到对应的本端参会者针对任一数据传输设备的选择指令时，所述拾音设备与被选中的数据传输设备建立近场连接。
  8. 根据权利要求7所述的方法，其特征在于，所述拾音设备展示出预关联至所述 团体的数据传输设备，包括：
    所述拾音设备获取预关联至所述团体的数据传输设备的被装配地点；
    根据所述拾音设备的地理位置，所述拾音设备按照距离顺序排列展示出预关联至所述团体的数据传输设备。
  9. 一种多媒体会议的语音采集方法，其特征在于，包括：
    数据传输设备与拾音设备建立近场连接；所述数据传输设备被装配于会议地点处，所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
    所述数据传输设备分别接收每一拾音设备发送的会议语音，所述会议语音由拾音设备对拾音范围内的本端参会者进行采集得到；
    所述数据传输设备将接收到的会议语音传输至对端参会者采用的会议设备。
  10. 一种多媒体会议的语音采集装置，其特征在于，包括：
    建立单元，使拾音设备与数据传输设备建立近场连接，所述数据传输设备被装配于会议地点处；所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
    采集单元，使所述拾音设备采集拾音范围内的本端参会者的会议语音；
    传输单元，使所述拾音设备将所述会议语音传输至所述数据传输设备，以由所述数据传输设备进一步传输至对端参会者采用的会议设备。
  11. 根据权利要求10所述的装置，其特征在于，所述建立单元具体用于：
    使所述拾音设备通过无线通讯技术与所述数据传输设备建立近场连接，以向所述数据传输设备发送会议语音。
  12. 根据权利要求10所述的装置，其特征在于，所述建立单元具体用于：
    根据所述拾音设备对应的本端参会者归属的团体，所述拾音设备展示出预关联至所述团体的数据传输设备；
    当接收到对应的本端参会者针对任一数据传输设备的选择指令时，所述拾音设备与被选中的数据传输设备建立近场连接。
  13. 根据权利要求12所述的装置，其特征在于，所述建立单元通过下述方式使拾音设备展示出预关联至所述团体的数据传输设备：
    所述拾音设备获取预关联至所述团体的数据传输设备的被装配地点；
    根据所述拾音设备的地理位置，所述拾音设备按照距离顺序排列展示出预关联至所述团体的数据传输设备。
  14. 一种多媒体会议的语音采集装置，其特征在于，包括：
    建立单元，使数据传输设备与拾音设备建立近场连接；所述数据传输设备被装配于会议地点处，所述拾音设备包括本端参会者携带的移动设备上的拾音组件；
    接收单元，使所述数据传输设备分别接收每一拾音设备发送的会议语音，所述会议语音由拾音设备对拾音范围内的本端参会者进行采集得到；
    传输单元，使所述数据传输设备将接收到的会议语音传输至对端参会者采用的会议设备。
  15. 一种多媒体会议的语音采集方法，其特征在于，包括：
    根据发起方所属的企业，在即时通讯应用中示出所述企业的组织架构，所述组织架构中包含被绑定至所述企业的数据传输设备，所述数据传输设备被装配于所述企业中预设的会议地点处；
    根据所述发起方从所述组织架构中选择的数据传输设备，所述即时通讯应用向服务器发起与被选中的数据传输设备相关的会议请求，使所述被选中的数据传输设备被添加至所述服务器针对所述会议请求创建的多媒体会议；
    其中，所述被选中的数据传输设备还与所处的会议地点处的若干拾音设备构成多媒体会议系统；所述拾音设备包括所述多媒体会议的本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至所述多媒体会议的对端参会者采用的会议设备。
  16. 一种多媒体会议的语音采集装置，其特征在于，包括：
    展示单元，根据发起方所属的企业，在即时通讯应用中展示所述企业的组织架构，所述组织架构中包含被绑定至所述企业的数据传输设备，所述数据传输设备被装配于所述企业中预设的会议地点处；
    请求单元，根据所述发起方从所述组织架构中选择的数据传输设备，所述即时通讯应用向服务器发起与被选中的数据传输设备相关的会议请求，使所述被选中的数据传输设备被添加至所述服务器针对所述会议请求创建的多媒体会议；
    其中，所述被选中的数据传输设备还与所处的会议地点处的若干拾音设备构成多媒体会议系统；所述拾音设备包括所述多媒体会议的本端参会者携带的移动设备上的拾音组件，以采集拾音范围内的本端参会者的会议语音；所述数据传输设备被配置为与所述拾音设备建立近场连接时，用于接收所述拾音设备发送的所述会议语音，并将接收到的会议语音传输至所述多媒体会议的对端参会者采用的会议设备。
PCT/CN2017/093769 2016-08-03 2017-07-21 多媒体会议系统、多媒体会议的语音采集方法及装置 WO2018024114A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610629550.9A CN107689910A (zh) 2016-08-03 2016-08-03 多媒体会议系统、多媒体会议的语音采集方法及装置
CN201610629550.9 2016-08-03

Publications (1)

Publication Number Publication Date
WO2018024114A1 true WO2018024114A1 (zh) 2018-02-08

Family

ID=61073240

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/093769 WO2018024114A1 (zh) 2016-08-03 2017-07-21 多媒体会议系统、多媒体会议的语音采集方法及装置

Country Status (2)

Country Link
CN (1) CN107689910A (zh)
WO (1) WO2018024114A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109936798A (zh) * 2017-12-19 2019-06-25 展讯通信（上海）有限公司 基于分布式mic阵列实现拾音的方法、装置及服务器

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101656689A (zh) * 2009-09-14 2010-02-24 杭州世导科技有限公司 一种基于通讯录组织架构的通信发起方法
US20100149302A1 (en) * 2008-12-15 2010-06-17 At&T Intellectual Property I, L.P. Apparatus and method for video conferencing
WO2010124545A1 (zh) * 2009-04-29 2010-11-04 中兴通讯股份有限公司 一种使用iptv系统的方法及相应的网络系统
CN102075218A (zh) * 2010-12-29 2011-05-25 上海华勤通讯技术有限公司 近距离手机多方通话的方法
CN102547416A (zh) * 2010-12-27 2012-07-04 佛山络威网络技术有限公司 一种手机与电视分载媒体的方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1956424A (zh) * 2005-10-26 2007-05-02 德赛电子(惠州)有限公司 基于分布式网关的通信方法及应用
US8782527B2 (en) * 2007-06-27 2014-07-15 Microsoft Corp. Collaborative phone-based file exchange
CN101754464A (zh) * 2010-01-25 2010-06-23 华为终端有限公司 实现手机共享数据的方法、装置和通信系统
CN103888413B (zh) * 2012-12-20 2018-03-13 中国电信股份有限公司 实现多媒体会议的方法和系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100149302A1 (en) * 2008-12-15 2010-06-17 At&T Intellectual Property I, L.P. Apparatus and method for video conferencing
WO2010124545A1 (zh) * 2009-04-29 2010-11-04 中兴通讯股份有限公司 一种使用iptv系统的方法及相应的网络系统
CN101656689A (zh) * 2009-09-14 2010-02-24 杭州世导科技有限公司 一种基于通讯录组织架构的通信发起方法
CN102547416A (zh) * 2010-12-27 2012-07-04 佛山络威网络技术有限公司 一种手机与电视分载媒体的方法
CN102075218A (zh) * 2010-12-29 2011-05-25 上海华勤通讯技术有限公司 近距离手机多方通话的方法

Also Published As

Publication number Publication date
CN107689910A (zh) 2018-02-13

Similar Documents

Publication Publication Date Title
US9590932B2 (en) Apparatus, method and computer readable recording medium for sharing real time video through chatting window of messenger service
US11836114B2 (en) Device searching system and method for data transmission
US20160261654A1 (en) Proximity session mobility extension
US9648153B2 (en) Method and device for incoming call notification
CN104253814B (zh) 一种流媒体处理方法、服务器及浏览器
US8280014B1 (en) System and method for associating audio clips with objects
WO2010020840A1 (en) System and method for identifying an active participant in a multiple user communication session
JP6229360B2 (ja) 通信サーバ、通信システム、プログラム及び通信方法
CN105208176B (zh) 联系人记录处理方法及装置
CN106254467A (zh) 文件分享方法及装置
CN110536075B (zh) 视频生成方法和装置
JP2007027918A (ja) 実世界コミュニケーション管理装置
CN105100355A (zh) 识别主叫用户的方法及装置
CN105704655A (zh) 终端之间的媒体数据共享方法及装置
EP3291508B1 (en) Message pushing method and device, and terminal equipment
CN106060257A (zh) 查看联系人相关信息的方法及装置
CN110061904A (zh) 获取社交信息的方法、装置、系统、电子设备及存储介质
CN105848287A (zh) 一种终端定位处理方法、装置、路由器及系统
US20190281106A1 (en) System and method of transmitting data by using widget window
JP4372729B2 (ja) 実世界コミュニケーション管理装置
WO2018024114A1 (zh) 多媒体会议系统、多媒体会议的语音采集方法及装置
US20150365133A1 (en) Touch and Talk Auto-Configuring of Video Conferences Using Near Field Communication (NFC)
KR20180068054A (ko) 차량 탑승자 간 자료 공유 방법 및 그 시스템
CN115665101A (zh) 一种法庭远程庭审方法、装置、电子设备及存储介质
CN109150901A (zh) 一种信息来源的提示方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17836296

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17836296

Country of ref document: EP

Kind code of ref document: A1