WO2022142912A1 - Method and device for realizing conference message synchronization - Google Patents

Method and device for realizing conference message synchronization Download PDF

Info

Publication number
WO2022142912A1
WO2022142912A1 PCT/CN2021/133440 CN2021133440W WO2022142912A1 WO 2022142912 A1 WO2022142912 A1 WO 2022142912A1 CN 2021133440 W CN2021133440 W CN 2021133440W WO 2022142912 A1 WO2022142912 A1 WO 2022142912A1
Authority
WO
WIPO (PCT)
Prior art keywords
conference
group
message
social
user
Prior art date
Application number
PCT/CN2021/133440
Other languages
French (fr)
Chinese (zh)
Inventor
程翰
Original Assignee
上海掌门科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海掌门科技有限公司 filed Critical 上海掌门科技有限公司
Publication of WO2022142912A1 publication Critical patent/WO2022142912A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/185Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with management of multicast group membership
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046Interoperability with other network applications or services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Definitions

  • the present application is based on the application with the CN application number of 202011592032.7 and the filing date of 2020.12.29, and claims its priority.
  • the disclosure content of the CN application is hereby incorporated into the present application as a whole.
  • the present application relates to the field of communications, and in particular, to a technology for realizing conference message synchronization.
  • An object of the present application is to provide a method and device for realizing conference message synchronization.
  • a method for realizing conference message synchronization on a first network device side includes:
  • the conference voice message determines the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group
  • the synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
  • a conversation group Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user.
  • a method for synchronizing conference messages on a second network device comprising:
  • the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request.
  • a first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
  • the first group message is posted to the first conversation group as the first social user.
  • a method for realizing conference message synchronization comprising:
  • the first network device receives the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference; and determines the first conference voice message in response to the conference voice message
  • the first social user corresponding to the participant in the social network, and generates a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, the conference a first group message corresponding to the voice message, and a first conversation group corresponding to the first conference in the social network; sending the first group synchronization request to a second network device in the social network;
  • the second network device receives the first group synchronization request sent by the first network device, wherein the first group synchronization request includes the first group message corresponding to the conference voice message, the first social network corresponding to the first conference participant in the social network a user, and a first conversation group corresponding to the first conference in the social network, where the first conference participant generates the conference voice message in the first conference; in response to the first group synchronization request, Posting the first group message to the first conversation group as the first social user.
  • a device for realizing conference message synchronization comprising:
  • memory arranged to store computer-executable instructions which, when executed, cause the processor to:
  • the conference voice message determines the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group
  • the synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
  • a conversation group Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user.
  • a device for realizing conference message synchronization includes:
  • memory arranged to store computer-executable instructions which, when executed, cause the processor to:
  • the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request.
  • a first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
  • the first group message is posted to the first conversation group as the first social user.
  • a computer-readable medium storing instructions that, when executed, cause a system to:
  • the conference voice message determines the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group
  • the synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
  • a conversation group Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user.
  • a computer-readable medium storing instructions that, when executed, cause a system to:
  • the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request.
  • a first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
  • the first group message is posted to the first conversation group as the first social user.
  • a computer program product comprising a computer program, characterized in that, when the computer program is executed by a processor, the steps of the following method are implemented:
  • the conference voice message determines the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group
  • the synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
  • a conversation group Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user.
  • a computer program product comprising a computer program, characterized in that, when the computer program is executed by a processor, the steps of the following method are implemented:
  • the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request.
  • a first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
  • the first group message is posted to the first conversation group as the first social user.
  • a first network device for realizing conference message synchronization includes:
  • a module configured to receive a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
  • Modules 1 and 2 are configured to, in response to the conference voice message, determine a first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein , the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
  • a third module configured to send the first group synchronization request to a second network device in the social network, so that the second network device can send the first group message to the first social user's The identity is published in the first conversation group.
  • a second network device for realizing conference message synchronization includes:
  • the two-one module is configured to receive a first group synchronization request sent by a first network device, where the first group synchronization request includes a first group message corresponding to the conference voice message, and a first group message corresponding to the first conference participant in the social network.
  • the first group synchronization request includes a first group message corresponding to the conference voice message, and a first group message corresponding to the first conference participant in the social network.
  • a second module is configured to, in response to the first group synchronization request, publish the first group message to the first conversation group as the first social user.
  • the present application receives a conference voice message through a first network device, determines a corresponding first social user based on the conference voice message, generates a first group synchronization request, and sends the first group synchronization request to a second user.
  • a network device wherein the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network .
  • the first group message is posted to the first conversation group by the second network device as the first social user.
  • this application Based on the corresponding relationship between conference users and social users, this application synchronizes conference messages in real time through social networks, helping users who are inconvenient to directly participate in conferences or who need to participate in multiple conferences at the same time to obtain conference information in real time through the conversation group, avoiding the need to know conference messages.
  • the delay increases the user's time utilization rate; the meeting content can also be recorded through the conversation group, which is convenient for users to review the meeting content, expand the social service function, and improve the user experience; and the corresponding relationship between the participating users and the social users is determined by the meeting server. , and can also promote mutual understanding among participating users and facilitate communication among participating users.
  • Fig. 1 shows a system topology diagram according to an embodiment of the present application
  • FIG. 2 shows a flowchart of a method for implementing conference message synchronization at a first network device end according to an embodiment of the present application
  • FIG. 3 shows a flowchart of a method for implementing conference message synchronization at a second network device end according to an embodiment of the present application
  • FIG. 4 shows a schematic diagram of a user interface for realizing conference message synchronization according to an embodiment of the present application
  • FIG. 5 shows a flowchart of a method for realizing conference message synchronization according to an embodiment of the present application
  • FIG. 6 shows a structural diagram of a first network device for realizing conference message synchronization according to an embodiment of the present application
  • FIG. 7 shows a structural diagram of a second network device for realizing conference message synchronization according to an embodiment of the present application
  • FIG. 8 illustrates an exemplary system that may be used to implement various embodiments described in this application.
  • the terminal, the device serving the network, and the trusted party all include one or more processors (for example, a central processing unit (CPU)), an input/output interface, a network interface, and Memory.
  • processors for example, a central processing unit (CPU)
  • Memory may include non-persistent memory in computer-readable media, random access memory (RAM) and/or non-volatile memory, such as read only memory (ROM) or flash memory ( Flash Memory).
  • RAM random access memory
  • ROM read only memory
  • Flash Memory Flash Memory
  • Memory is an example of a computer-readable medium.
  • Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology.
  • Information may be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, Phase-Change Memory (PCM), Programmable Random Access Memory (PRAM), Static Random-Access Memory (Static Random-Access Memory, SRAM), Dynamic Random Access Memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically-Erasable Programmable Read -Only Memory, EEPROM), flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD), or other optical storage , magnetic tape cartridges, magnetic tape-disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
  • PCM Phase-Change Memory
  • PRAM Programmable Random Access Memory
  • SRAM Static
  • the equipment referred to in this application includes, but is not limited to, user equipment, network equipment, or equipment formed by integrating user equipment and network equipment through a network.
  • the user equipment includes, but is not limited to, any mobile electronic product that can perform human-computer interaction with the user (for example, human-computer interaction through a touchpad), such as a smart phone, a tablet computer, etc., and the mobile electronic product can use any operation. system, such as Android operating system, iOS operating system, etc.
  • the network device includes an electronic device that can automatically perform numerical calculation and information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (ASICs) ), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Digital Signal Processor (DSP), embedded devices, etc.
  • the network device includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud formed by a plurality of servers; here, the cloud is formed by a large number of computers or network servers based on cloud computing, Among them, cloud computing is a kind of distributed computing, a virtual supercomputer composed of a group of loosely coupled computer sets.
  • the network includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless ad hoc network (Ad Hoc network), and the like.
  • the device may also be a program running on the user equipment, network equipment, or a device formed by user equipment and network equipment, network equipment, touch terminal or network equipment and touch terminal integrated through a network.
  • FIG. 1 shows a topology diagram of a system for realizing conference message synchronization according to an embodiment of the present application.
  • the system topology diagram includes user equipment, a first network device and a second network device.
  • the user equipment acquires a conference voice message of a user participating in the first conference and sends the conference voice message to the first network device.
  • the first network device generates a first group synchronization request according to the conference voice message and sends the first group synchronization request to the second network device, where the first group synchronization request includes the first social user and the first group message corresponding to the conference voice message , and the first conversation group corresponding to the first meeting in the social network.
  • the second network device publishes the first group message to the first conversation group as the first social user according to the first group synchronization request.
  • the user equipment includes a smartphone, a tablet computer, a computer, a microphone, and other devices that can be used to acquire user voice information.
  • the first network device is a conference server.
  • the second network device is a social server, and the first network device and the second network device may be network devices corresponding to different applications or systems (for example, a first network device corresponding to a conference application, a second network device corresponding to a social application A network device), or a network device performing different functions in the same application or system (eg, a first network device for providing conference services and a second network device for providing social services in an application).
  • the first network device and the second network device are relatively independent, and can perform data intercommunication.
  • the first social user is the social identity information corresponding to the conference participant in the social server who generates the conference voice message.
  • the first conversation group may include social users corresponding to all or part of the participants participating in the conference. Group messages from different conferences can be published simultaneously in the first conversation group, that is, synchronization of conference messages of multiple conferences can be performed in the first conversation group.
  • the system synchronizes conference messages in real time through social networks, helping users who are inconvenient to directly participate in the conference or who need to participate in multiple conferences at the same time to obtain conference information in real time through the conversation group, avoiding the delay in obtaining conference messages and improving the user's time utilization;
  • the meeting content can also be recorded through the conversation group, which is convenient for users to review the meeting content, expand the social service function, and improve the user experience; and the corresponding relationship between the participating users and the social users is determined by the meeting server, which can also promote the mutual interaction between the participating users. Understanding, it is helpful for communication among participating users.
  • FIG. 2 shows a flowchart of a method for synchronizing conference messages on a first network device according to an embodiment of the present application.
  • the method includes step S11 , step S12 , and step S13 .
  • the first network device receives the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference; in step S12, in response to the the conference voice message, the first network device determines the first social user corresponding to the first conference participant in the social network, and generates a first group synchronization request to be sent to the social network, wherein the first The group synchronization request includes the first social user, the first group message corresponding to the conference voice message, and the first conversation group corresponding to the first conference in the social network; in step S13, the first network The device sends the first group synchronization request to a second network device in the social network for the second network device to publish the first group message to the first social user as the identity of the first social user The first conversation group.
  • the first network device receives a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference.
  • the participant user "Zhang San” joins the first conference through his mobile phone or computer, and sends a conference voice message to the first network device through his device.
  • the conference voice message of the conference participant user "Zhang San” is obtained through the microphone device allocated to the conference participant and sent to the first network device.
  • the microphone device assigned to "Zhang San" can also be assigned to other conference participants, that is, in the first conference, the same user device may acquire conference voice messages of multiple conference participants.
  • the conference voice message received by the network device may contain single or multiple voices.
  • step S12 in response to the conference voice message, the first network device determines a first social user corresponding to the first conference participant in the social network, and generates a first group synchronization to be sent to the social network request, wherein the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network.
  • the first group synchronization request further includes conference identification information of the first conference.
  • the conference identification information of the first conference is used to help the second network device receiving the first group synchronization request to distinguish conferences corresponding to each group message.
  • the first network device determines the corresponding first social user according to the conference voice message or user equipment identification information corresponding to the user equipment. For example, the first social user matching the voiceprint spectral feature is determined according to the voiceprint spectral feature corresponding to the conference voice message. For another example, if a participating user registers in a social network using information consistent with the identification information of their user equipment (for example, the device's MAC address, mobile phone number, etc., which can uniquely distinguish the device from the identification information of other devices), the user can register according to the user's identification information.
  • the device identification information query determines the corresponding first social user.
  • the first network device may store a mapping relationship between social users and voiceprint spectral features or user equipment identification information obtained from the social server.
  • the first network device Allocate social user identifiers to the conference participants.
  • the first social user includes the social user identifier, and the social user identifier is used to identify the identity of the conference participant in the social network among the first conference participants whose corresponding social user is not determined. For example, if the conference participant "Zhang San" does not use the social network, he may be temporarily assigned a social name (eg, "Meeting User 1") as his identification in the social network to distinguish him from other users.
  • the first network device determines a first conversation group corresponding to the first conference in the social network according to association information corresponding to the conference voice message.
  • the associated information includes, but is not limited to, associated conference voice messages, conference identification information corresponding to the first conference, and user equipment identification information.
  • the first network device determines the first conversation group according to the conversation group corresponding to the associated conference voice message belonging to the same conference as the conference voice message.
  • the first network device determines, according to the conference identification information corresponding to the conference voice message, the first conversation group that matches the conference identification information.
  • the first network device determines a first social user matching the user equipment identification information according to the user equipment identification information, and then determines a corresponding first conversation group according to the first social user.
  • the first group message includes, but is not limited to, a conference voice message, and text information converted according to the conference voice message.
  • the conference voice message includes multiple voices
  • the first group message includes, but is not limited to, multiple pieces of sub-voice information decomposed by the conference voice message based on voiceprint spectral features, and the converted sub-voice information. Subtext information.
  • step S13 the first network device sends the first group synchronization request to a second network device in the social network, so that the second network device can send the first group message to the first The identity of the social user is published in the first conversation group.
  • the first network device sends the first group synchronization request to a second network device in the social network, and if the first social user exists in the social network, the second network device sends The first group message is published in the first conversation group with the identity of the first social user; otherwise, the second network device marks the first group message with the first social identity and publishes it in the first social group.
  • a conversation group if the first social user exists in the social network, the second network device sends The first group message is published in the first conversation group with the identity of the first social user; otherwise, the second network device marks the first group message with the first social identity and publishes it in the first social group.
  • the determining of the first social user corresponding to the first conference participant in the social network includes: step S121 (not shown), the first network device according to the user identifier corresponding to the user equipment information, or by performing voiceprint spectrum analysis on the conference voice message to determine the first conference participant; step S122 (not shown), the first network device determines that the first conference participant corresponds to the social network The first social users of , wherein the social users in the first social users are in one-to-one correspondence with the conference participants in the first conference participants.
  • the first conference participant includes one or more conference participants, and the one or more conference participants jointly generate the conference voice message in the first conference.
  • the conference participant corresponds to the identity information of the user participating in the first conference in the conference server, for example, the name information used in the conference server by the user participating in the first conference.
  • the user equipment is bound with one or more user identification information, the user identification information corresponds to a participant, and the corresponding conference participant can be determined according to one or more user identification information corresponding to the user equipment personnel.
  • the first network device determines spectrum feature information corresponding to the conference voice message by performing voiceprint spectrum analysis on the conference voice message. The first network device then determines, according to the acquired spectrum feature information, a first conference participant that matches the spectrum feature information.
  • the spectral feature information includes multiple voiceprint spectral features, and each voiceprint spectrum corresponds to one of the first conference participants.
  • a mapping relationship between conference participants and social users is stored in the first network device.
  • the first network device determines a first social user corresponding to the first conference participant in the social network according to the mapping relationship between the conference participant and the social user.
  • the first network device may store a mapping relationship between social users and voiceprint spectral features or user equipment identification information obtained from a social server.
  • the user equipment identification information is identification information such as the MAC address and mobile phone number of the device, which can uniquely distinguish the device from other devices.
  • the first network device determines, according to the voiceprint spectral feature corresponding to the conference voice message, a first social user matching the voiceprint spectral feature. Or the first network device may query and determine the corresponding first social user according to the user equipment identification information. For example, if the participating user registers with the conference server and the social server with the same mobile phone number, the conference server can query the corresponding first social user according to the mobile phone number. Social user information in the meeting server.
  • the first network device stores the determined correspondence between the first conference participant and the first social user in a database for use in subsequent query matching.
  • the step S121 includes: the first network device detects whether the conference voice message meets a spectrum analysis trigger condition; if so, determining the first conference participant by performing voiceprint spectrum analysis on the conference voice message person; otherwise, the first conference participant is determined according to the user identification information corresponding to the user equipment. For example, there may be situations where multiple people use the same user equipment (for example, participants use the same microphone in the conference room to speak, or multiple people use the same computer for remote conferences) or the user equipment is not fixed for use (for example, , user equipment in a public conference room), it is difficult to determine the corresponding conference participants only through the user equipment, so the corresponding conference participants are determined by performing voiceprint spectrum analysis on the conference voice messages. Otherwise, the first network device determines the first conference participant according to the user identification information corresponding to the user equipment or the user equipment identification information.
  • the determining the first conference participant by performing voiceprint spectrum analysis on the conference voice message includes: a first network device performs voiceprint spectrum analysis on the conference voice message to determine the first conference participant. Whether the conference voice message only contains single-person voice; if so, determine the first conference participant according to the spectral feature information corresponding to the conference voice message; otherwise, decompose the conference voice message into multiple parts according to the voiceprint spectral features Pieces of sub-voice information, wherein each piece of sub-voice information only contains a single person’s voice, the multiple pieces of sub-voice information respectively correspond to different participants in the first conference, and the plurality of participants corresponding to the multiple pieces of sub-voice information are determined. It is the first conference participant who generates the conference voice message in the first conference.
  • the first network device performs voiceprint spectrum analysis on the conference voice message to determine whether the spectrum feature information corresponding to the conference voice message contains only one voiceprint spectrum feature; The characteristic information determines the corresponding first conference participant. Otherwise, the first network device decomposes the conference voice message based on the time domain or the frequency domain to obtain multiple pieces of sub-voice information corresponding to different participants in the first conference.
  • the decomposing the conference voice message into multiple pieces of sub-voice information according to the voiceprint spectrum includes: the first network device cuts the conference voice message into multiple voice units according to a preset cutting length, and obtains The voiceprint spectral features corresponding to the multiple voice units are stored in the same voice set with the matching value between the voiceprint spectral features in the multiple voice units higher than the preset matching threshold in the same voice set, and the same voice set is stored in the same voice set. All speech units are concatenated as a piece of sub-speech information.
  • the first network device determines a plurality of corresponding conference participants according to the spectrum feature information corresponding to the plurality of sub-voice messages, and determines a corresponding first conference participant according to the plurality of conference participants.
  • the spectrum analysis trigger condition includes at least any one of the following: the first conference is an offline conference; the user equipment corresponds to a plurality of user identification information; the user equipment is a public device or is not Bind user ID information.
  • the first network device determines that the first conference is an offline conference according to the conference type information
  • the voiceprint spectrum analysis is used to determine the first conference.
  • the notebook computer 1 is a conference-specific computer of user A and user B, and the notebook computer 1 is bound with the user identification information of the two in the conference server.
  • the conference server obtains the conference voice message through the notebook computer 1, the conference participants cannot be accurately determined only based on the user identification information, and the voiceprint spectrum analysis is required to determine the conference participants.
  • the user device cannot provide information that can identify the participant, so the first network device needs to be determined through voiceprint spectrum analysis.
  • the first conference participant corresponding to the conference voice message of the conference.
  • the method further includes: step S14 (not shown), the first network device determines a first group message corresponding to the conference voice message.
  • the first network device performs voiceprint spectrum analysis on the conference voice message to determine whether the spectral feature information corresponding to the conference voice message contains only one voiceprint spectrum feature; The conference voice message or the text information obtained by converting the conference voice message is used as the first group message; otherwise, the first network device decomposes the conference voice message according to the voiceprint spectrum feature to obtain multiple pieces of sub-voice information, and uses the multiple pieces of sub-voice information Or the sub-text information obtained by converting the sub-voice information is used as the first group message.
  • the step S14 includes: if the conference voice message includes multiple voices, generating a first group message corresponding to the conference voice message according to multiple pieces of sub-voice information, wherein the first group message Including multiple first subgroup messages, the multiple first subgroup messages correspond to the multiple sub-voice information one-to-one, and the multiple sub-voice information is obtained by decomposing the conference voice message according to the voiceprint spectral characteristics , and each sub-voice message contains only a single voice.
  • the acquisition method of the sub-voice information is the same as or basically the same as the acquisition method of the sub-voice information in the aforementioned step S121, so it is not repeated here, and is included here by reference.
  • the first network device generates one or more first subgroup messages from multiple pieces of sub-voice information according to a screening rule, and then determines a first group corresponding to the conference voice message according to the first sub-group messages information.
  • the screening rules include at least any one of the following: (1) screening sub-voice information whose duration is greater than or equal to a predetermined time threshold; (2) screening the sub-voice information corresponding to the participant and the user identification information corresponding to the user equipment; matching sub-voice information; (3) screening the sub-voice information corresponding to the sub-voice information whose sound intensity is greater than or equal to a predetermined sound intensity threshold.
  • the screening rule (1) is used to eliminate the short, meaningless voice information sent by the participants;
  • the screening rule (2) is used to eliminate the voice information of the non-user equipment voice collection object to avoid repeated collection of voice information;
  • the screening rule (3) is used to eliminate the voice information with smaller decibels to ensure that the voice information can be successfully converted into text information or that the voice information can be recognized by the user.
  • the first subgroup message includes but is not limited to sub-voice information and sub-text information obtained by converting the sub-voice information.
  • the first group synchronization request further includes a mapping relationship between each first subgroup message in the first group message and a social user in the first social user.
  • the first network device determines each first subgroup message in the first group message according to a conference participant corresponding to the first subgroup message and a social user among the first social users corresponding to the conference participant A mapping relationship with social users in the first social users.
  • the first subgroup messages are in one-to-one correspondence with social users among the first social users, so as to ensure that the publishing user identities corresponding to the first subgroup messages in the first group messages published by the second network device are accurate.
  • the first group synchronization request further includes a sequence relationship of the plurality of first subgroup messages, and the sequence relationship is based on the sub-voice information corresponding to the first subgroup message in the The starting sequence in the conference voice information is determined.
  • the first network device sorts according to the starting position of the sub-voice information corresponding to the first sub-group message in the conference voice message; and takes the sequence relationship corresponding to the multiple pieces of sub-voice information as the first sub-voice information The order relationship of group messages.
  • the first group synchronization request contains three first subgroup messages: "Voice 1", “Voice 2", “Voice 3", where "Voice 1” starts from 0'15" in the conference voice message, " Voice 2" starts from 1'27” in the conference voice message, and "Voice 3" starts from 0'58" in the conference voice message, then the sequence relationship of these three first subgroup messages is: (1) “Voice 1” ", (2) “Voice 3", (3) "Voice 2".
  • the (1), (2), (3) sequence numbers are used to indicate the sequence of the first subgroup messages.
  • the method further includes step S15 (not shown): the first network device receives a second group synchronization request sent by the second network device, wherein the second group synchronization request includes the The second conference message corresponding to the second group message, and the conference identification information of the first conference; and the second conference message is presented in the first conference.
  • the second conference message includes but is not limited to text information, picture information, audio information, and video information.
  • the first network device determines a first conference for presenting the second conference message according to the conference identification information, and determines a presentation device for presenting the second conference message in the first conference according to the second conference message.
  • the first network device sends the second conference message to the presentation device to present the second conference message in the first conference.
  • the second conference message is text information, picture information or video information
  • the first network device may determine display A in the first conference as the presentation device for the second conference message, and send the second conference message to the display A to present the second conference message.
  • the second conference message is voice information
  • the first network device may determine the speaker B in the first conference as the presentation device of the second conference message, and send the second conference message to the speaker B to play the first conference message. 2. Meeting news.
  • FIG. 3 shows a flowchart of a method for realizing conference message synchronization at a second network device end according to an embodiment of the present application, and the method includes steps S21 and S22 .
  • the second network device receives a first group synchronization request sent by the first network device, where the first group synchronization request includes the first group message corresponding to the conference voice message, the first conference participant in the social network The corresponding first social user, and the first conversation group corresponding to the first conference in the social network, the first conference participant generates the conference voice message in the first conference; in step S22, In response to the first group synchronization request, the second network device publishes the first group message to the first conversation group as the first social user.
  • the second network device receives a first group synchronization request sent by the first network device, where the first group synchronization request includes the first group message corresponding to the conference voice message, the first conference participant in the social network A corresponding first social user, and a first conversation group corresponding to the first conference in the social network, and the first conference participant generates the conference voice message in the first conference.
  • the first group synchronization request further includes conference identification information of the first conference.
  • the second network device distinguishes conferences corresponding to each group message according to the conference identification information of the first conference.
  • the first social user includes a social user identifier, and the social user identifier is used to identify the identity of the conference participant in the social network among the first conference participants whose corresponding social user is not determined. For example, if the conference participant "Zhang San" does not use the social network, he may be temporarily assigned a social name (eg, "Meeting User 1") as his identification in the social network to distinguish him from other users.
  • the first group message includes, but is not limited to, a conference voice message, and text information converted according to the conference voice message.
  • the first group message includes, but is not limited to, multiple pieces of sub-voice information decomposed by the conference voice message based on voiceprint spectral features, and the converted sub-voice information. Subtext information.
  • step S22 in response to the first group synchronization request, the second network device publishes the first group message to the first conversation group as the identity of the first social user.
  • the publishing the first group message to the first conversation group as the first social user includes at least any one of the following: way 1, publishing the first group message through The social account corresponding to the first social user is published; in the second method, a first social robot is added to the first conversation group, and the first group message is sent through the first social robot, wherein the first group message is based on the Describe the identity tag of the first social user.
  • the second network device only sends a group message of the conference participant corresponding to the social user identifier through the foregoing method 2.
  • the conference participant "Zhang San” does not have a corresponding social account in the social network
  • the first network device allocates the corresponding social user identifier "zhangsan” to the conference participant "Zhang San” and sends the corresponding social user ID "zhangsan” to the second network device.
  • Group synchronization request The second network device adds the first social robot (“robot 1” in the interface diagram as shown in FIG. 4 ) in the corresponding conversation group according to the group synchronization request.
  • the second network device can directly add the social user identifier to the first group message and send the message through the first social robot (as shown in the sending of “first group message 1” in FIG.
  • the first group message sent to the first conversation group can also be marked (as shown in the sending of "first group message 2" in Figure 4, a message source prompt is added to the sent group message).
  • the first social user includes a plurality of social users
  • the first group message includes a plurality of first subgroup messages
  • each first subgroup message corresponds to a a user
  • the step S22 includes: in response to the first group synchronization request, the second network device stores each first subgroup message in the plurality of first subgroup messages as the first subgroup message in the respective first subgroup message.
  • the identity of the corresponding social user among the first social users is sent to the first conversation group.
  • the sending each first subgroup message in the plurality of first subgroup messages to the The first conversation group includes at least any one of the following: sending each first subgroup message in the plurality of first subgroup messages to the social account of the social user corresponding to the first social user through the first subgroup message.
  • the first group synchronization request further includes a sequence relationship of the plurality of first subgroup messages; the step S22 includes: in response to the first group synchronization request, the second network device executes the The sequence relationship sends each first subgroup message in the plurality of first subgroup messages to the first conversation group as the first subgroup message corresponds to the social user in the first social user.
  • the sequence relationship is determined by the first network device according to the sequence of the starting positions of the sub-voice information corresponding to the first sub-group message in the conference voice message.
  • the first group synchronization request contains three first subgroup messages: "Voice 1", “Voice 2", “Voice 3", where "Voice 1” starts from 0'15" in the conference voice message, " Voice 2" starts from 1'27” in the conference voice message, and "Voice 3" starts from 0'58" in the conference voice message, then the sequence relationship of these three first subgroup messages is: (1) “Voice 1" ", (2) “Voice 3", (3) "Voice 2".
  • the second network device can send messages according to the preset message sending time interval (for example, 3 seconds), according to "Voice 1", “Voice 3", “Voice 3", " The order of voice 2", the three first subgroup messages are sent in sequence.
  • the second network device sends each first subgroup message according to the sequence relationship, which can help the group members in the first conversation group who did not participate in the first conference to clarify each message.
  • the message timeline avoids the logical confusion caused by sending multiple messages at the same time.
  • the step S22 includes: in response to the first group synchronization request, if the first social user has participated in the first conversation group, the second network device sends the first group message to The identity of the first social user is published in the first conversation group; otherwise, the first group message is sent to the first conversation group as the identity of the first social robot corresponding to the first meeting.
  • the first social users are "Zhang San” and “Li Si”
  • the first conversation group is "Planning 1 group”
  • “Zhang San” in the first social user is not "Planning 1" group” members.
  • the second network device may send the first subgroup message corresponding to the first social user "Li Si” to the "Planning 1 group” as “Li Si”.
  • the second network device can add the social robot to the "Planning 1 group”, send the first subgroup message corresponding to the first social user "Zhang San” through the social robot, and use "Zhang San” to the first subgroup.
  • Group messages are identified.
  • the sending method of the first subgroup message is the same or basically the same as the sending method of the first subgroup message in the foregoing step S22, so it is not repeated here, and is incorporated herein by reference.
  • the second network device uses a social robot to replace a social user who is not in the first conversation group to send a group message corresponding to the social user, so as to facilitate message transmission and protect the privacy and security of the social user and the conversation group.
  • the method further includes step S23: if the first social user has not joined the first conversation group, adding the first social user to the first conversation group. For example, for the first social user "Zhang San" who has not joined the first conversation group, the second network device may add the first social user "Zhang San” to the group, and then add the first social user "Zhang San” to the group. The corresponding first group message is published in the first conversation group as "Zhang San". In this embodiment, the second network device adds the social user who has not joined the first conversation group to the first conversation group, which can facilitate the social user and the user in the first conversation group who did not participate in the first meeting to end the meeting You can continue to communicate afterwards.
  • the method further includes step S24: the second network device receives a second group message sent to the first conference by a second group user in the first conversation group; according to the second group message A second group synchronization request to be sent to the first network device is generated, wherein the second group synchronization request includes a second conference message corresponding to the second group message, and the determined value based on the first conference. meeting identification information of the first meeting; sending the second group synchronization request to the first network device for presenting the second meeting message in the first meeting.
  • the second group of users includes social users who did not participate in the first meeting.
  • the social user “Zhang San” manages multiple project groups, and there are two project group meeting times conflicting, then "Zhang San” can choose one of them to participate, and follow up the other project group meeting in real time through the conversation group; Or “Zhang San” can handle other project work and follow up these 2 project team meetings in real time through the conversation group.
  • the conversation group also includes social users who did not participate in the meeting. The social user can learn about the meeting content in real time through the conversation group, and respond to the meeting content, which is convenient for users to participate in meeting decision-making in real time and avoids the delay in learning the meeting content. , to improve the user's work efficiency.
  • the second conference message includes but is not limited to: a second group message, text information obtained by converting voice information in the second group message, and voice information obtained by converting text information in the second group message.
  • the presentation manner of the second conference message in the first conference is the same as or substantially the same as the presentation manner of the second conference message in the aforementioned step S15, so it is not repeated here, and is incorporated herein by reference.
  • the receiving a second group message sent by a second group of users in the first conversation group to the first conference includes: the second network device receiving a second group of users in the first conversation group The second group message is sent, and the corresponding first conference is determined according to the message synchronization operation of the second group users.
  • the message synchronization operation includes but is not limited to: (1) Designating a conference for message synchronization when sending a second group message, for example, presenting one or more conferences in the conversation group for conference message synchronization in the message sending interface.
  • Users of the second group can specify one or more conferences to receive their second group messages through a check operation; (2) refer to one or more first group messages or the first social robot corresponding to the first conference, for example, the second group If the group user responds to the speech of "Zhang San" in the first conference, the second group user can quote the first group message corresponding to the conference voice message of "Zhang San” when sending the message. For another example, if the first social robot corresponding to the first meeting in the first conversation group is "robot A", users in the second group can refer to the first social robot in the form of "@robot A" when sending the second group message. to synchronize the second group of messages to the first conference.
  • the determining the corresponding first conference according to the message synchronization operation of the second group of users includes: determining the corresponding first conference according to the conference designated by the second group of users for message synchronization, or determining the corresponding first conference A meeting that matches one or more first group messages or the first social robot cited by the group user is the first meeting.
  • step S11 ′ receiving a conference voice message sent by a user equipment in a first conference, wherein the first conference participant is in the The conference voice message is generated in the first conference; step S12', in response to the conference voice message, determine the first social user corresponding to the first conference participant in the social network, and generate a message to be sent to all The first group synchronization request of the social network, wherein the first group synchronization request includes the first social user, the first group message corresponding to the conference voice message, and the first conference in the social network.
  • step S13' sending the first group synchronization request to the second network device in the social network
  • step S21' receiving the first group synchronization request sent by the first network device
  • the first group synchronization request includes the first group message corresponding to the conference voice message, the first social user corresponding to the first conference participant in the social network, and the first session corresponding to the first conference in the social network group, the first conference participant generates the conference voice message in the first conference
  • step S22' in response to the first group synchronization request, the first group message is sent to the first social media
  • the identity of the user is published in the first conversation group.
  • steps S11', S12', S13', S21', and S22' are respectively the same as or basically the same as steps S11, S12, S13, S21, and S22 in the foregoing embodiment, so they are not repeated here. Incorporated herein by reference.
  • FIG. 6 shows a structural diagram of a first network device for realizing conference message synchronization according to an embodiment of the present application, where the first network device includes a first module 11 , a second module 12 , and a third module 13 .
  • the one-one module 11 receives the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
  • the one-two module 12 determines in response to the conference voice message the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user , the first group message corresponding to the conference voice message, and the first conversation group corresponding to the first conference in the social network;
  • the third module 13 sends the first group synchronization request to the social network
  • the second network device in the , so that the second network device publishes the first group message to the first conversation group as the identity of the first social user.
  • the specific implementations corresponding to the first module 11 , the first two modules 12 , and the one third modules 13 shown in FIG. 6 are the same or similar to the specific embodiments of the aforementioned steps S11 , S12 , and S13 respectively, so they are not Again, it is incorporated herein by reference.
  • the one-two module 12 includes a one-two-one unit 121 (not shown) and a one-two-two unit 122 (not shown).
  • the one-two-one unit 121 determines the first conference participant according to the user identification information corresponding to the user equipment or by performing voiceprint spectrum analysis on the conference voice message; the one-two-two unit 122 determines the first participant.
  • the first social user corresponding to the first conference participant in the social network, wherein the social user in the first social user is in one-to-one correspondence with the conference participant in the first conference participant.
  • the specific implementations of the one-two-one unit 121 and the one-two-two unit 122 are the same as or similar to the aforementioned steps S121 and S122 , so they are not repeated here, and are incorporated herein by reference.
  • the first network device includes a quad module 14 (not shown).
  • the one-four module 14 determines the first group message corresponding to the conference voice message.
  • the specific implementation manner of the four modules 14 is the same as or similar to the aforementioned step S14, so it is not repeated here, and is included here by reference.
  • the first network device includes a five-module 15 (not shown).
  • the one-five module 15 receives a second group synchronization request sent by the second network device, wherein the second group synchronization request includes a second conference message corresponding to the second group message, a Conference identification information; the second conference message is presented in the first conference.
  • the specific implementation of the one-fifth module 15 is the same as or similar to the aforementioned step S15, so it is not repeated here, and is incorporated herein by reference.
  • Fig. 7 shows a structural diagram of a second network device for realizing conference message synchronization according to an embodiment of the present application, where the second network device includes a two-one module 21 and a two-two module 22.
  • the 21 module 21 receives the first group synchronization request sent by the first network device, wherein the first group synchronization request includes the first group message corresponding to the conference voice message and the first social network corresponding to the first conference participant in the social network the user, and the first conversation group corresponding to the first conference in the social network, the first conference participant generates the conference voice message in the first conference; the second module 22 responds to the first conference A group synchronization request, publishing the first group message to the first conversation group as the identity of the first social user.
  • the second network device further includes a second-third module 23 (not shown).
  • the second and third module 23 adds the first social user to the first conversation group if the first social user has not joined the first conversation group.
  • the specific implementation manner of the second and third modules 23 is the same as or similar to the aforementioned step S23 , so it is not repeated here, and is incorporated herein by reference.
  • the second network device further includes a second-fourth module 24 (not shown).
  • the two-four module 24 receives a second group message sent to the first social robot by a second group of users in the first conversation group; generates a message to be sent to the first network device according to the second group message.
  • a second group synchronization request wherein the second group synchronization request includes a second conference message corresponding to the second group message, and the conference identification information of the first conference determined based on the first social robot;
  • the second group synchronization request is sent to the first network device for presenting the second conference message in the first conference.
  • the specific implementation of the two-four module 24 is the same as or similar to the aforementioned step S24, so it is not repeated here, and is included here by reference.
  • FIG. 8 illustrates an exemplary system that may be used to implement various embodiments described in this application
  • system 300 can function as any of the devices in each of the described embodiments.
  • system 300 may include one or more computer-readable media (eg, system memory or NVM/storage device 320 ) having instructions and be coupled to the one or more computer-readable media and configured to execute Instructions to implement a module to perform one or more processors (eg, processor(s) 305 ) to perform the actions described herein.
  • processors eg, processor(s) 305
  • system control module 310 may include any suitable interface controller to provide at least one of the processor(s) 305 and/or any suitable device or component in communication with the system control module 310 any appropriate interface.
  • the system control module 310 may include a memory controller module 330 to provide an interface to the system memory 315 .
  • the memory controller module 330 may be a hardware module, a software module, and/or a firmware module.
  • System memory 315 may be used, for example, to load and store data and/or instructions for system 300 .
  • system memory 315 may include any suitable volatile memory, eg, suitable DRAM.
  • system memory 315 may include double data rate type quad synchronous dynamic random access memory (DDR4 SDRAM).
  • system control module 310 may include one or more input/output (I/O) controllers to provide interfaces to NVM/storage device 320 and communication interface(s) 325 .
  • I/O input/output
  • NVM/storage device 320 may be used to store data and/or instructions.
  • NVM/storage device 320 may include any suitable non-volatile memory (eg, flash memory) and/or may include any suitable non-volatile storage device(s) (eg, one or more hard drives ( HDD), one or more compact disc (CD) drives and/or one or more digital versatile disc (DVD) drives).
  • HDD hard drives
  • CD compact disc
  • DVD digital versatile disc
  • NVM/storage device 320 may include storage resources that are physically part of the device on which system 300 is installed, or it may be accessed by the device without necessarily being part of the device.
  • the NVM/storage device 320 is accessible via the communication interface(s) 325 over a network.
  • Communication interface(s) 325 may provide an interface for system 300 to communicate over one or more networks and/or with any other suitable device.
  • System 300 may wirelessly communicate with one or more components of a wireless network in accordance with any of one or more wireless network standards and/or protocols.
  • At least one of the processor(s) 305 may be packaged with the logic of one or more controllers of the system control module 310 (eg, the memory controller module 330 ). For one embodiment, at least one of the processor(s) 305 may be packaged with logic of one or more controllers of the system control module 310 to form a system-in-package (SiP). For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with the logic of one or more controllers of the system control module 310 . For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with logic of one or more controllers of the system control module 310 to form a system on a chip (SoC).
  • SoC system on a chip
  • system 300 may be, but is not limited to, a server, workstation, desktop computing device, or mobile computing device (eg, laptop computing device, handheld computing device, tablet computer, netbook, etc.). In various embodiments, system 300 may have more or fewer components and/or different architectures. For example, in some embodiments, system 300 includes one or more cameras, keyboards, liquid crystal display (LCD) screens (including touchscreen displays), non-volatile memory ports, multiple antennas, graphics chips, application specific integrated circuits ( ASIC) and speakers.
  • LCD liquid crystal display
  • ASIC application specific integrated circuits
  • the present application also provides a computer-readable storage medium, where the computer-readable storage medium stores computer codes, when the computer codes are executed, as in any of the previous The described method is executed.
  • the present application also provides a computer program product, when the computer program product is executed by a computer device, the method according to any one of the preceding items is executed.
  • the present application also provides a computer device, the computer device comprising:
  • processors one or more processors
  • memory for storing one or more computer programs
  • the one or more computer programs when executed by the one or more processors, cause the one or more processors to implement the method of any preceding item.
  • the present application may be implemented in software and/or a combination of software and hardware, eg, an application specific integrated circuit (ASIC), a general purpose computer, or any other similar hardware device.
  • the software program of the present application may be executed by a processor to implement the steps or functions described above.
  • the software programs of the present application (including associated data structures) may be stored on a computer-readable recording medium, such as RAM memory, magnetic or optical drives or floppy disks, and the like.
  • some steps or functions of the present application may be implemented in hardware, for example, as a circuit that cooperates with a processor to perform various steps or functions.
  • a part of the present application can be applied as a computer program product, such as computer program instructions, which when executed by a computer, through the operation of the computer, can invoke or provide methods and/or technical solutions according to the present application.
  • Those skilled in the art should understand that the existing forms of computer program instructions in computer-readable media include but are not limited to source files, executable files, installation package files, etc.
  • the ways in which computer program instructions are executed by a computer include but are not limited to Limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding post-installation program. program.
  • the computer-readable medium can be any available computer-readable storage medium or communication medium that can be accessed by a computer.
  • Communication media includes media by which communication signals containing, for example, computer readable instructions, data structures, program modules or other data are transmitted from one system to another.
  • Communication media may include conducted transmission media such as cables and wires (eg, fiber optic, coaxial, etc.) and wireless (unconducted transmission) media capable of propagating energy waves, such as acoustic, electromagnetic, RF, microwave, and infrared .
  • Computer readable instructions, data structures, program modules or other data may be embodied, for example, as a modulated data signal in a wireless medium such as a carrier wave or similar mechanism such as embodied as part of spread spectrum technology.
  • modulated data signal refers to a signal whose one or more characteristics are altered or set in a manner that encodes information in the signal. Modulation can be analog, digital or hybrid modulation techniques.
  • computer-readable storage media may include volatile and non-volatile, readable storage media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Removable and non-removable media.
  • computer-readable storage media include, but are not limited to, volatile memory, such as random access memory (RAM, DRAM, SRAM); and non-volatile memory, such as flash memory, various read-only memories (ROM, PROM, EPROM) , EEPROM), magnetic and ferromagnetic/ferroelectric memory (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, tapes, CDs, DVDs); or other media now known or later developed capable of storing data for computer systems Computer readable information/data used.
  • volatile memory such as random access memory (RAM, DRAM, SRAM
  • non-volatile memory such as flash memory, various read-only memories (ROM, PROM, EPROM) , EEPROM), magnetic and ferromagnetic/ferroelectric memory (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, tapes, CDs, DVDs); or other media now known or later developed capable of storing data for computer systems Computer readable information/data used.
  • an embodiment according to the present application includes an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein, when the computer program instructions are executed by the processor, a trigger is
  • the apparatus operates based on the aforementioned methods and/or technical solutions according to various embodiments of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Telephonic Communication Services (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The object of the present application is to provide a method and device for realizing conference message synchronization. The method comprises: receiving a conference voice message sent by a user equipment; determining a corresponding first social user, and generating a first group synchronization request; and sending the first group synchronization request to a second network device, such that the second network device publishes a first group message to a first session group by using the identity of the first social user. The present application synchronizes a conference message in real time by means of a social network, and helps a user, who cannot directly participate in a conference or needs to simultaneously participate in multiple conferences, to obtain conference information in real time by means of the session group, thereby avoiding the delay of obtaining the conference message, and improving the time utilization rate of the user; conference content can also be recorded by means of the session group, such that it is convenient for the user to review the conference content, and a social networking service function is expanded, thereby improving user experience; and a conference server end determines a corresponding relationship between a conference participating user and a social user, thereby being further capable of promoting the mutual understanding between the conference participating users, and facilitating the communication between the conference participating users.

Description

一种实现会议消息同步的方法与设备Method and device for realizing conference message synchronization
本申请是以CN申请号为202011592032.7,申请日为2020.12.29的申请为基础,并主张其优先权,该CN申请的公开内容在此作为整体引入本申请中。The present application is based on the application with the CN application number of 202011592032.7 and the filing date of 2020.12.29, and claims its priority. The disclosure content of the CN application is hereby incorporated into the present application as a whole.
技术领域technical field
本申请涉及通信领域,尤其涉及一种实现会议消息同步的技术。The present application relates to the field of communications, and in particular, to a technology for realizing conference message synchronization.
背景技术Background technique
随着互联网的发展,越来越多的公司或企业通过网络会议进行业务沟通和协调。网络会议中参会者可突破地域的限制,通过互联网实现面对面般的交流效果。With the development of the Internet, more and more companies or enterprises conduct business communication and coordination through web conferences. In the online conference, participants can break through geographical restrictions and achieve face-to-face communication through the Internet.
发明内容SUMMARY OF THE INVENTION
本申请的一个目的是提供一种实现会议消息同步的方法与设备。An object of the present application is to provide a method and device for realizing conference message synchronization.
根据本申请的一个方面,提供了一种在第一网络设备端实现会议消息同步的方法,该方法包括:According to an aspect of the present application, a method for realizing conference message synchronization on a first network device side is provided, and the method includes:
接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;receiving a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;In response to the conference voice message, determine the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group The synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user. A conversation group.
根据本申请的另一个方面,提供了一种在第二网络设备端实现会议消息同步的方法,该方法包括:According to another aspect of the present application, there is provided a method for synchronizing conference messages on a second network device, the method comprising:
接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述 会议语音消息;Receive a first group synchronization request sent by the first network device, wherein the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request. A first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。In response to the first group synchronization request, the first group message is posted to the first conversation group as the first social user.
根据本申请的另一个方面,提供了一种实现会议消息同步的方法,该方法包括:According to another aspect of the present application, a method for realizing conference message synchronization is provided, the method comprising:
第一网络设备接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;将所述第一群同步请求发送至所述社交网络中的第二网络设备;The first network device receives the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference; and determines the first conference voice message in response to the conference voice message The first social user corresponding to the participant in the social network, and generates a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, the conference a first group message corresponding to the voice message, and a first conversation group corresponding to the first conference in the social network; sending the first group synchronization request to a second network device in the social network;
第二网络设备接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。The second network device receives the first group synchronization request sent by the first network device, wherein the first group synchronization request includes the first group message corresponding to the conference voice message, the first social network corresponding to the first conference participant in the social network a user, and a first conversation group corresponding to the first conference in the social network, where the first conference participant generates the conference voice message in the first conference; in response to the first group synchronization request, Posting the first group message to the first conversation group as the first social user.
根据本申请的一个方面,提供了一种实现会议消息同步的设备,该设备包括:According to an aspect of the present application, a device for realizing conference message synchronization is provided, the device comprising:
处理器;以及processor; and
被安排成存储计算机可执行指令的存储器,所述可执行指令在被执行时使所述处理器执行如下操作:memory arranged to store computer-executable instructions which, when executed, cause the processor to:
接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;receiving a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;In response to the conference voice message, determine the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group The synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user. A conversation group.
根据本申请的另一个方面,提供了一种实现会议消息同步的设备,该设备包括:According to another aspect of the present application, a device for realizing conference message synchronization is provided, and the device includes:
处理器;以及processor; and
被安排成存储计算机可执行指令的存储器,所述可执行指令在被执行时使所述处理器执行如下操作:memory arranged to store computer-executable instructions which, when executed, cause the processor to:
接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;Receive a first group synchronization request sent by the first network device, wherein the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request. A first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。In response to the first group synchronization request, the first group message is posted to the first conversation group as the first social user.
根据本申请的一个方面,提供了一种存储指令的计算机可读介质,所述指令在被执行时使得系统进行如下操作:According to one aspect of the present application, there is provided a computer-readable medium storing instructions that, when executed, cause a system to:
接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;receiving a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;In response to the conference voice message, determine the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group The synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user. A conversation group.
根据本申请的另一个方面,提供了一种存储指令的计算机可读介质,所述指令在被执行时使得系统进行如下操作:According to another aspect of the present application, there is provided a computer-readable medium storing instructions that, when executed, cause a system to:
接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;Receive a first group synchronization request sent by the first network device, wherein the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request. A first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。In response to the first group synchronization request, the first group message is posted to the first conversation group as the first social user.
根据本申请的一个方面,提供了一种计算机程序产品,包括计算机程序,其特征在于,该计算机程序被处理器执行时实现如下方法的步骤:According to one aspect of the present application, a computer program product is provided, comprising a computer program, characterized in that, when the computer program is executed by a processor, the steps of the following method are implemented:
接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议 中产生所述会议语音消息;Receive the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;In response to the conference voice message, determine the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group The synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user. A conversation group.
根据本申请的一个方面,提供了一种计算机程序产品,包括计算机程序,其特征在于,该计算机程序被处理器执行时实现如下方法的步骤:According to one aspect of the present application, a computer program product is provided, comprising a computer program, characterized in that, when the computer program is executed by a processor, the steps of the following method are implemented:
接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;Receive a first group synchronization request sent by the first network device, wherein the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request. A first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。In response to the first group synchronization request, the first group message is posted to the first conversation group as the first social user.
根据本申请的一个方面,提供了一种实现会议消息同步的第一网络设备,该第一网络设备包括:According to an aspect of the present application, a first network device for realizing conference message synchronization is provided, and the first network device includes:
一一模块,用于接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;a module, configured to receive a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
一二模块,用于响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;Modules 1 and 2 are configured to, in response to the conference voice message, determine a first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein , the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
一三模块,用于将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。A third module, configured to send the first group synchronization request to a second network device in the social network, so that the second network device can send the first group message to the first social user's The identity is published in the first conversation group.
根据本申请的另一个方面,提供了一种实现会议消息同步的第二网络设备,该第二网络设备包括:According to another aspect of the present application, a second network device for realizing conference message synchronization is provided, and the second network device includes:
二一模块,用于接收第一网络设备发送的第一群同步请求,其中所述第一群同步请 求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;The two-one module is configured to receive a first group synchronization request sent by a first network device, where the first group synchronization request includes a first group message corresponding to the conference voice message, and a first group message corresponding to the first conference participant in the social network. a social user, and a first conversation group corresponding to the first conference in the social network, and the first conference participant generates the conference voice message in the first conference;
二二模块,用于响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。A second module is configured to, in response to the first group synchronization request, publish the first group message to the first conversation group as the first social user.
与现有技术相比,本申请通过第一网络设备接收会议语音消息,基于该会议语音消息确定对应的第一社交用户,生成第一群同步请求并将该第一群同步请求发送至第二网络设备,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群。由第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。本申请基于参会用户与社交用户的对应关系,通过社交网络实时同步会议消息,帮助不方便直接参与会议或同时有多个会议需要参加的用户通过会话群实时获取会议信息,避免了会议消息获知的延迟,提高了用户的时间利用率;还可通过会话群记录会议内容,方便用户回顾会议内容,拓展社交服务功能,提升用户体验;并且由会议服务器端确定参会用户与社交用户的对应关系,还可促进参会用户间的互相了解,有助于参会用户间交流。Compared with the prior art, the present application receives a conference voice message through a first network device, determines a corresponding first social user based on the conference voice message, generates a first group synchronization request, and sends the first group synchronization request to a second user. A network device, wherein the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network . The first group message is posted to the first conversation group by the second network device as the first social user. Based on the corresponding relationship between conference users and social users, this application synchronizes conference messages in real time through social networks, helping users who are inconvenient to directly participate in conferences or who need to participate in multiple conferences at the same time to obtain conference information in real time through the conversation group, avoiding the need to know conference messages. The delay increases the user's time utilization rate; the meeting content can also be recorded through the conversation group, which is convenient for users to review the meeting content, expand the social service function, and improve the user experience; and the corresponding relationship between the participating users and the social users is determined by the meeting server. , and can also promote mutual understanding among participating users and facilitate communication among participating users.
附图说明Description of drawings
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本申请的其它特征、目的和优点将会变得更明显:Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:
图1示出根据本申请一个实施例的一个系统拓扑图;Fig. 1 shows a system topology diagram according to an embodiment of the present application;
图2示出根据本申请一个实施例的一种在第一网络设备端实现会议消息同步的方法流程图;2 shows a flowchart of a method for implementing conference message synchronization at a first network device end according to an embodiment of the present application;
图3示出根据本申请一个实施例的一种在第二网络设备端实现会议消息同步的方法流程图;3 shows a flowchart of a method for implementing conference message synchronization at a second network device end according to an embodiment of the present application;
图4示出根据本申请一个实施例的一种实现会议消息同步的用户界面示意图;FIG. 4 shows a schematic diagram of a user interface for realizing conference message synchronization according to an embodiment of the present application;
图5示出根据本申请一个实施例的一种实现会议消息同步的方法流程图;5 shows a flowchart of a method for realizing conference message synchronization according to an embodiment of the present application;
图6示出根据本申请一个实施例的一种实现会议消息同步的第一网络设备结构图;FIG. 6 shows a structural diagram of a first network device for realizing conference message synchronization according to an embodiment of the present application;
图7示出根据本申请一个实施例的一种实现会议消息同步的第二网络设备结构图;FIG. 7 shows a structural diagram of a second network device for realizing conference message synchronization according to an embodiment of the present application;
图8示出可被用于实施本申请中所述的各个实施例的示例性系统。FIG. 8 illustrates an exemplary system that may be used to implement various embodiments described in this application.
附图中相同或相似的附图标记代表相同或相似的部件。The same or similar reference numbers in the drawings represent the same or similar parts.
具体实施方式Detailed ways
下面结合附图对本申请作进一步详细描述。The present application will be described in further detail below with reference to the accompanying drawings.
在本申请一个典型的配置中,终端、服务网络的设备和可信方均包括一个或多个处理器(例如,中央处理器(Central Processing Unit,CPU))、输入/输出接口、网络接口和内存。In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party all include one or more processors (for example, a central processing unit (CPU)), an input/output interface, a network interface, and Memory.
内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(Random Access Memory,RAM)和/或非易失性内存等形式,如只读存储器(Read Only Memory,ROM)或闪存(Flash Memory)。内存是计算机可读介质的示例。Memory may include non-persistent memory in computer-readable media, random access memory (RAM) and/or non-volatile memory, such as read only memory (ROM) or flash memory ( Flash Memory). Memory is an example of a computer-readable medium.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(Phase-Change Memory,PCM)、可编程随机存取存储器(Programmable Random Access Memory,PRAM)、静态随机存取存储器(Static Random-Access Memory,SRAM)、动态随机存取存储器(Dynamic Random Access Memory,DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(Electrically-Erasable Programmable Read-Only Memory,EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(Compact Disc Read-Only Memory,CD-ROM)、数字多功能光盘(Digital Versatile Disc,DVD)或其他光学存储、磁盒式磁带,磁带磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, Phase-Change Memory (PCM), Programmable Random Access Memory (PRAM), Static Random-Access Memory (Static Random-Access Memory, SRAM), Dynamic Random Access Memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically-Erasable Programmable Read -Only Memory, EEPROM), flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD), or other optical storage , magnetic tape cartridges, magnetic tape-disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
本申请所指设备包括但不限于用户设备、网络设备、或用户设备与网络设备通过网络相集成所构成的设备。所述用户设备包括但不限于任何一种可与用户进行人机交互(例如通过触摸板进行人机交互)的移动电子产品,例如智能手机、平板电脑等,所述移动电子产品可以采用任意操作系统,如Android操作系统、iOS操作系统等。其中,所述网络设备包括一种能够按照事先设定或存储的指令,自动进行数值计算和信息处理的电子设备,其硬件包括但不限于微处理器、专用集成电路(Application Specific Integrated Circuit,ASIC)、可编程逻辑器件(Programmable Logic Device,PLD)、现场可编程门阵列(Field Programmable  Gate Array,FPGA)、数字信号处理器(Digital Signal Processor,DSP)、嵌入式设备等。所述网络设备包括但不限于计算机、网络主机、单个网络服务器、多个网络服务器集或多个服务器构成的云;在此,云由基于云计算(Cloud Computing)的大量计算机或网络服务器构成,其中,云计算是分布式计算的一种,由一群松散耦合的计算机集组成的一个虚拟超级计算机。所述网络包括但不限于互联网、广域网、城域网、局域网、VPN网络、无线自组织网络(Ad Hoc网络)等。优选地,所述设备还可以是运行于所述用户设备、网络设备、或用户设备与网络设备、网络设备、触摸终端或网络设备与触摸终端通过网络相集成所构成的设备上的程序。The equipment referred to in this application includes, but is not limited to, user equipment, network equipment, or equipment formed by integrating user equipment and network equipment through a network. The user equipment includes, but is not limited to, any mobile electronic product that can perform human-computer interaction with the user (for example, human-computer interaction through a touchpad), such as a smart phone, a tablet computer, etc., and the mobile electronic product can use any operation. system, such as Android operating system, iOS operating system, etc. Wherein, the network device includes an electronic device that can automatically perform numerical calculation and information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (ASICs) ), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Digital Signal Processor (DSP), embedded devices, etc. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud formed by a plurality of servers; here, the cloud is formed by a large number of computers or network servers based on cloud computing, Among them, cloud computing is a kind of distributed computing, a virtual supercomputer composed of a group of loosely coupled computer sets. The network includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless ad hoc network (Ad Hoc network), and the like. Preferably, the device may also be a program running on the user equipment, network equipment, or a device formed by user equipment and network equipment, network equipment, touch terminal or network equipment and touch terminal integrated through a network.
当然,本领域技术人员应能理解上述设备仅为举例,其他现有的或今后可能出现的设备如可适用于本申请,也应包含在本申请保护范围以内,并在此以引用方式包含于此。Of course, those skilled in the art should understand that the above-mentioned devices are only examples, and other existing or possible devices that may appear in the future, if applicable to this application, should also be included within the protection scope of this application, and are included in this application by reference. this.
在本申请的描述中,“多个”的含义是两个或者更多,除非另有明确具体的限定。In the description of this application, "plurality" means two or more, unless expressly and specifically defined otherwise.
图1示出了根据本申请一个实施例的一种实现会议消息同步的系统拓扑图。该系统拓扑图包括用户设备、第一网络设备和第二网络设备。用户设备获取第一会议中参会用户的会议语音消息并将所述会议语音消息发送给第一网络设备。第一网络设备根据会议语音消息生成第一群同步请求并将该第一群同步请求发送至第二网络设备,其中第一群同步请求包括会议语音消息对应的第一社交用户、第一群消息,以及第一会议在社交网络中对应的第一会话群。第二网络设备根据第一群同步请求,将第一群消息以第一社交用户的身份发布于第一会话群。此处,用户设备包括智能手机、平板电脑、计算机、麦克风等可用于获取用户语音信息的设备。第一网络设备为会议服务器。第二网络设备为社交服务器,所述第一网络设备与所述第二网络设备可为不同应用或系统分别对应的网络设备(例如,会议应用对应的第一网络设备、社交应用对应的第二网络设备),也可为同一应用或系统中执行不同功能的网络设备(例如,在应用中用于提供会议服务的第一网络设备以及用于提供社交服务的第二网络设备)。在此所述第一网络设备与所述第二网络设备相对独立,又可进行数据互通。第一社交用户为产生该会议语音消息的参会人员在该社交服务器中对应的社交身份信息。所述第一会话群可包括全部或部分参与会议的参会人员对应的社交用户。在所述第一会话群中可同时发布来自不同会议的群消息,即在第一 会话群中可进行多个会议的会议消息的同步。该系统通过社交网络实时同步会议消息,帮助不方便直接参与会议或同时有多个会议需要参加的用户通过会话群实时获取会议信息,避免了会议消息获知的延迟,提高了用户的时间利用率;还可通过会话群记录会议内容,方便用户回顾会议内容,拓展社交服务功能,提升了用户体验;并且由会议服务器端确定参会用户与社交用户的对应关系,还可促进参会用户间的互相了解,有助于参会用户间交流。FIG. 1 shows a topology diagram of a system for realizing conference message synchronization according to an embodiment of the present application. The system topology diagram includes user equipment, a first network device and a second network device. The user equipment acquires a conference voice message of a user participating in the first conference and sends the conference voice message to the first network device. The first network device generates a first group synchronization request according to the conference voice message and sends the first group synchronization request to the second network device, where the first group synchronization request includes the first social user and the first group message corresponding to the conference voice message , and the first conversation group corresponding to the first meeting in the social network. The second network device publishes the first group message to the first conversation group as the first social user according to the first group synchronization request. Here, the user equipment includes a smartphone, a tablet computer, a computer, a microphone, and other devices that can be used to acquire user voice information. The first network device is a conference server. The second network device is a social server, and the first network device and the second network device may be network devices corresponding to different applications or systems (for example, a first network device corresponding to a conference application, a second network device corresponding to a social application A network device), or a network device performing different functions in the same application or system (eg, a first network device for providing conference services and a second network device for providing social services in an application). Here, the first network device and the second network device are relatively independent, and can perform data intercommunication. The first social user is the social identity information corresponding to the conference participant in the social server who generates the conference voice message. The first conversation group may include social users corresponding to all or part of the participants participating in the conference. Group messages from different conferences can be published simultaneously in the first conversation group, that is, synchronization of conference messages of multiple conferences can be performed in the first conversation group. The system synchronizes conference messages in real time through social networks, helping users who are inconvenient to directly participate in the conference or who need to participate in multiple conferences at the same time to obtain conference information in real time through the conversation group, avoiding the delay in obtaining conference messages and improving the user's time utilization; The meeting content can also be recorded through the conversation group, which is convenient for users to review the meeting content, expand the social service function, and improve the user experience; and the corresponding relationship between the participating users and the social users is determined by the meeting server, which can also promote the mutual interaction between the participating users. Understanding, it is helpful for communication among participating users.
参考图1所示的系统,图2示出根据本申请一个实施例的一种在第一网络设备端实现会议消息同步的方法流程图,该方法包括步骤S11、步骤S12、步骤S13。在步骤S11中,第一网络设备接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;在步骤S12中,响应于所述会议语音消息,第一网络设备确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;在步骤S13中,第一网络设备将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。Referring to the system shown in FIG. 1 , FIG. 2 shows a flowchart of a method for synchronizing conference messages on a first network device according to an embodiment of the present application. The method includes step S11 , step S12 , and step S13 . In step S11, the first network device receives the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference; in step S12, in response to the the conference voice message, the first network device determines the first social user corresponding to the first conference participant in the social network, and generates a first group synchronization request to be sent to the social network, wherein the first The group synchronization request includes the first social user, the first group message corresponding to the conference voice message, and the first conversation group corresponding to the first conference in the social network; in step S13, the first network The device sends the first group synchronization request to a second network device in the social network for the second network device to publish the first group message to the first social user as the identity of the first social user The first conversation group.
在步骤S11中,第一网络设备接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息。例如,在线上会议中,参会用户“张三”通过其手机或电脑加入第一会议,并通过其设备发送会议语音消息至第一网络设备。又例如,在线下会议中,通过分配给参会用户“张三”的麦克风设备获取其会议语音消息并发送至第一网络设备。特别地,分配给“张三”的麦克风设备还可以分配给其他参会用户,即在第一会议中存在由同一用户设备获取多个参会用户的会议语音消息的情况,在此,第一网络设备接收的会议语音消息可能包含单人语音,也可能包含多人语音。In step S11, the first network device receives a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference. For example, in an online conference, the participant user "Zhang San" joins the first conference through his mobile phone or computer, and sends a conference voice message to the first network device through his device. For another example, in an offline conference, the conference voice message of the conference participant user "Zhang San" is obtained through the microphone device allocated to the conference participant and sent to the first network device. In particular, the microphone device assigned to "Zhang San" can also be assigned to other conference participants, that is, in the first conference, the same user device may acquire conference voice messages of multiple conference participants. The conference voice message received by the network device may contain single or multiple voices.
在步骤S12中,响应于所述会议语音消息,第一网络设备确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群。In step S12, in response to the conference voice message, the first network device determines a first social user corresponding to the first conference participant in the social network, and generates a first group synchronization to be sent to the social network request, wherein the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network.
在一些实施例中,所述第一群同步请求还包括所述第一会议的会议标识信息。 所述第一会议的会议标识信息用于帮助接收所述第一群同步请求的第二网络设备区分各群消息对应的会议。In some embodiments, the first group synchronization request further includes conference identification information of the first conference. The conference identification information of the first conference is used to help the second network device receiving the first group synchronization request to distinguish conferences corresponding to each group message.
在一些实施例中,第一网络设备根据所述会议语音消息或者用户设备对应的用户设备标识信息确定对应的第一社交用户。例如,根据会议语音消息对应的声纹频谱特征确定与该声纹频谱特征相匹配的第一社交用户。又例如,参会用户在社交网络中使用与其用户设备标识信息(例如,设备的MAC地址、手机号等可唯一区分该设备与其他设备的标识信息)一致的信息进行注册,则可根据该用户设备标识信息查询确定对应的第一社交用户。在此,第一网络设备中可存储有从社交服务器中获取的社交用户与声纹频谱特征或用户设备标识信息的映射关系。In some embodiments, the first network device determines the corresponding first social user according to the conference voice message or user equipment identification information corresponding to the user equipment. For example, the first social user matching the voiceprint spectral feature is determined according to the voiceprint spectral feature corresponding to the conference voice message. For another example, if a participating user registers in a social network using information consistent with the identification information of their user equipment (for example, the device's MAC address, mobile phone number, etc., which can uniquely distinguish the device from the identification information of other devices), the user can register according to the user's identification information. The device identification information query determines the corresponding first social user. Here, the first network device may store a mapping relationship between social users and voiceprint spectral features or user equipment identification information obtained from the social server.
在一些实施例中,若根据所述会议语音消息或者用户设备对应的用户设备标识信息未能成功确定第一参会人员中参会人员在社交网络中对应的社交用户身份,则第一网络设备给所述参会人员分配社交用户标识。所述第一社交用户中包括所述社交用户标识,所述社交用户标识用于标识未确定对应社交用户的第一参会人员中参会人员在社交网络中身份。例如,若该参会人员“张三”不使用所述社交网络,则可临时为其分配一个社交名称(如,“会议用户1”)作为其在社交网络中的标识以与其他用户区分。In some embodiments, if the social user identities corresponding to the conference participants in the social network among the first conference participants are unsuccessfully determined according to the conference voice message or the user equipment identification information corresponding to the user equipment, the first network device Allocate social user identifiers to the conference participants. The first social user includes the social user identifier, and the social user identifier is used to identify the identity of the conference participant in the social network among the first conference participants whose corresponding social user is not determined. For example, if the conference participant "Zhang San" does not use the social network, he may be temporarily assigned a social name (eg, "Meeting User 1") as his identification in the social network to distinguish him from other users.
在一些实施例中,第一网络设备根据会议语音消息对应的关联信息确定第一会议在社交网络中对应的第一会话群。所述关联信息包括但不限于关联会议语音消息、第一会议对应的会议标识信息、用户设备标识信息。例如,第一网络设备根据与会议语音消息属于同一会议的关联会议语音消息对应的会话群确定所述第一会话群。又例如,第一网络设备根据会议语音消息对应的会议标识信息确定与该会议标识信息相匹配的第一会话群。还例如,第一网络设备根据用户设备标识信息确定与所述用户设备标识信息相匹配的第一社交用户,再根据第一社交用户确定对应的第一会话群。In some embodiments, the first network device determines a first conversation group corresponding to the first conference in the social network according to association information corresponding to the conference voice message. The associated information includes, but is not limited to, associated conference voice messages, conference identification information corresponding to the first conference, and user equipment identification information. For example, the first network device determines the first conversation group according to the conversation group corresponding to the associated conference voice message belonging to the same conference as the conference voice message. For another example, the first network device determines, according to the conference identification information corresponding to the conference voice message, the first conversation group that matches the conference identification information. For another example, the first network device determines a first social user matching the user equipment identification information according to the user equipment identification information, and then determines a corresponding first conversation group according to the first social user.
在一些实施例中,所述第一群消息包括但不限于会议语音消息、根据会议语音消息转换的文本信息。在一些实施例中,若所述会议语音消息包含多人语音,则所述第一群消息包括但不限于会议语音消息基于声纹频谱特征分解的多条子语音信息、所述子语音信息转换的子文本信息。In some embodiments, the first group message includes, but is not limited to, a conference voice message, and text information converted according to the conference voice message. In some embodiments, if the conference voice message includes multiple voices, the first group message includes, but is not limited to, multiple pieces of sub-voice information decomposed by the conference voice message based on voiceprint spectral features, and the converted sub-voice information. Subtext information.
在步骤S13中,第一网络设备将所述第一群同步请求发送至所述社交网络中的 第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。In step S13, the first network device sends the first group synchronization request to a second network device in the social network, so that the second network device can send the first group message to the first The identity of the social user is published in the first conversation group.
在一些实施例中,第一网络设备将所述第一群同步请求发送至所述社交网络中的第二网络设备,若在社交网络中存在所述第一社交用户,则第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群;否则第二网络设备将所述第一群消息以所述第一社交标识标记并发布于所述第一会话群。In some embodiments, the first network device sends the first group synchronization request to a second network device in the social network, and if the first social user exists in the social network, the second network device sends The first group message is published in the first conversation group with the identity of the first social user; otherwise, the second network device marks the first group message with the first social identity and publishes it in the first social group. A conversation group.
在一些实施例中,所述确定所述第一参会人员在社交网络中对应的第一社交用户,包括:步骤S121(未示出),第一网络设备根据所述用户设备对应的用户标识信息,或者通过对所述会议语音消息进行声纹频谱分析,确定所述第一参会人员;步骤S122(未示出),第一网络设备确定所述第一参会人员在社交网络中对应的第一社交用户,其中所述第一社交用户中的社交用户与所述第一参会人员中的参会人员一一对应。In some embodiments, the determining of the first social user corresponding to the first conference participant in the social network includes: step S121 (not shown), the first network device according to the user identifier corresponding to the user equipment information, or by performing voiceprint spectrum analysis on the conference voice message to determine the first conference participant; step S122 (not shown), the first network device determines that the first conference participant corresponds to the social network The first social users of , wherein the social users in the first social users are in one-to-one correspondence with the conference participants in the first conference participants.
在一些实施例中,第一参会人员包括一个或多个参会人员,所述一个或多个参会人员在所述第一会议中共同产生所述会议语音消息。所述参会人员对应参与第一会议的用户在所述会议服务器中的身份信息,例如,参与第一会议的用户在所述会议服务器中使用的名称信息。在一些实施例中,所述用户设备绑定有一个或多个用户标识信息,所述用户标识信息与参会人员对应,可根据用户设备对应的一个或多个用户标识信息确定对应的参会人员。在一些实施例中,第一网络设备通过对会议语音消息进行声纹频谱分析确定所述会议语音消息对应的频谱特征信息。第一网络设备再根据获取的频谱特征信息确定与所述频谱特征信息相匹配的第一参会人员。在一些实施例中,所述频谱特征信息包括多个声纹频谱特征,每个声纹频谱对应第一参会人员中一个参会人员。In some embodiments, the first conference participant includes one or more conference participants, and the one or more conference participants jointly generate the conference voice message in the first conference. The conference participant corresponds to the identity information of the user participating in the first conference in the conference server, for example, the name information used in the conference server by the user participating in the first conference. In some embodiments, the user equipment is bound with one or more user identification information, the user identification information corresponds to a participant, and the corresponding conference participant can be determined according to one or more user identification information corresponding to the user equipment personnel. In some embodiments, the first network device determines spectrum feature information corresponding to the conference voice message by performing voiceprint spectrum analysis on the conference voice message. The first network device then determines, according to the acquired spectrum feature information, a first conference participant that matches the spectrum feature information. In some embodiments, the spectral feature information includes multiple voiceprint spectral features, and each voiceprint spectrum corresponds to one of the first conference participants.
在一些实施例中,第一网络设备中存储有参会人员与社交用户的映射关系。第一网络设备根据所述参会人员与社交用户的映射关系确定第一参会人员在社交网络中对应的第一社交用户。In some embodiments, a mapping relationship between conference participants and social users is stored in the first network device. The first network device determines a first social user corresponding to the first conference participant in the social network according to the mapping relationship between the conference participant and the social user.
在一些实施例中,第一网络设备中可存储有从社交服务器中获取的社交用户与声纹频谱特征或用户设备标识信息的映射关系。所述用户设备标识信息为设备的MAC地址、手机号等可唯一区分该设备与其他设备的标识信息。第一网络设备根据会议语音消息对应的声纹频谱特征确定与该声纹频谱特征相匹配的第一社交用户。 或者第一网络设备根据用户设备标识信息查询确定对应的第一社交用户,例如,参会用户用相同的手机号在会议服务器及社交服务器中注册,则会议服务器可根据该手机号查询到其在会议服务器中的社交用户信息。在一些实施例中,第一网络设备将确定的第一参会人员与第一社交用户的对应关系存储在数据库中,以供后续查询匹配使用。In some embodiments, the first network device may store a mapping relationship between social users and voiceprint spectral features or user equipment identification information obtained from a social server. The user equipment identification information is identification information such as the MAC address and mobile phone number of the device, which can uniquely distinguish the device from other devices. The first network device determines, according to the voiceprint spectral feature corresponding to the conference voice message, a first social user matching the voiceprint spectral feature. Or the first network device may query and determine the corresponding first social user according to the user equipment identification information. For example, if the participating user registers with the conference server and the social server with the same mobile phone number, the conference server can query the corresponding first social user according to the mobile phone number. Social user information in the meeting server. In some embodiments, the first network device stores the determined correspondence between the first conference participant and the first social user in a database for use in subsequent query matching.
在一些实施例中,所述步骤S121包括:第一网络设备检测所述会议语音消息是否满足频谱分析触发条件;若是,通过对所述会议语音消息进行声纹频谱分析确定所述第一参会人员;否则,根据所述用户设备对应的用户标识信息确定所述第一参会人员。例如,在会议中可能出现多个人使用同一用户设备的情况(如,参会人员使用会场中同一个麦克风发言,或者多人使用同一台电脑进行远程会议)或者用户设备没有固定的使用对象(如,公共会议室中的用户设备),则仅通过该用户设备很难确定对应的参会人员,故通过对会议语音消息进行声纹频谱分析的方式确定对应的参会人员。否则,第一网络设备根据用户设备对应的用户标识信息或者用户设备标识信息确定所述第一参会人员。In some embodiments, the step S121 includes: the first network device detects whether the conference voice message meets a spectrum analysis trigger condition; if so, determining the first conference participant by performing voiceprint spectrum analysis on the conference voice message person; otherwise, the first conference participant is determined according to the user identification information corresponding to the user equipment. For example, there may be situations where multiple people use the same user equipment (for example, participants use the same microphone in the conference room to speak, or multiple people use the same computer for remote conferences) or the user equipment is not fixed for use (for example, , user equipment in a public conference room), it is difficult to determine the corresponding conference participants only through the user equipment, so the corresponding conference participants are determined by performing voiceprint spectrum analysis on the conference voice messages. Otherwise, the first network device determines the first conference participant according to the user identification information corresponding to the user equipment or the user equipment identification information.
在一些实施例中,所述通过对所述会议语音消息进行声纹频谱分析确定所述第一参会人员,包括:第一网络设备对所述会议语音消息进行声纹频谱分析以确定所述会议语音消息中是否仅包含单人语音;若是,根据所述会议语音消息对应的频谱特征信息,确定所述第一参会人员;否则,将所述会议语音消息按声纹频谱特征分解为多条子语音信息,其中每条子语音信息仅包含单人语音,所述多条子语音信息分别对应于第一会议中的不同参会人员,并将所述多条子语音信息对应的多个参会人员确定为在所述第一会议中产生所述会议语音消息的第一参会人员。In some embodiments, the determining the first conference participant by performing voiceprint spectrum analysis on the conference voice message includes: a first network device performs voiceprint spectrum analysis on the conference voice message to determine the first conference participant. Whether the conference voice message only contains single-person voice; if so, determine the first conference participant according to the spectral feature information corresponding to the conference voice message; otherwise, decompose the conference voice message into multiple parts according to the voiceprint spectral features Pieces of sub-voice information, wherein each piece of sub-voice information only contains a single person’s voice, the multiple pieces of sub-voice information respectively correspond to different participants in the first conference, and the plurality of participants corresponding to the multiple pieces of sub-voice information are determined. It is the first conference participant who generates the conference voice message in the first conference.
在一些实施例中,第一网络设备对会议语音消息进行声纹频谱分析确定该会议语音消息对应的频谱特征信息是否仅包含一个声纹频谱特征,若是,则第一网络设备直接根据所述频谱特征信息确定对应的第一参会人员。否则,第一网络设备基于时域或频域对会议语音消息进行分解获得多条对应于第一会议中不同参会人员的子语音信息。在一些实施例中,所述将所述会议语音消息按声纹频谱分解为多条子语音信息包括:第一网络设备根据预设的切割长度将所述会议语音消息切割成多个语音单元,获取所述多个语音单元对应的声纹频谱特征,将所述多个语音单元中声纹频谱特征之间的匹配值高于预设匹配阈值的语音单元保存至同一语音集合,将同 一语音集合内所有语音单元拼接作为一条子语音信息。第一网络设备再根据所述多条子语音消息对应的频谱特征信息确定对应的多个参会人员,根据所述多个参会人员确定对应的第一参会人员。In some embodiments, the first network device performs voiceprint spectrum analysis on the conference voice message to determine whether the spectrum feature information corresponding to the conference voice message contains only one voiceprint spectrum feature; The characteristic information determines the corresponding first conference participant. Otherwise, the first network device decomposes the conference voice message based on the time domain or the frequency domain to obtain multiple pieces of sub-voice information corresponding to different participants in the first conference. In some embodiments, the decomposing the conference voice message into multiple pieces of sub-voice information according to the voiceprint spectrum includes: the first network device cuts the conference voice message into multiple voice units according to a preset cutting length, and obtains The voiceprint spectral features corresponding to the multiple voice units are stored in the same voice set with the matching value between the voiceprint spectral features in the multiple voice units higher than the preset matching threshold in the same voice set, and the same voice set is stored in the same voice set. All speech units are concatenated as a piece of sub-speech information. The first network device then determines a plurality of corresponding conference participants according to the spectrum feature information corresponding to the plurality of sub-voice messages, and determines a corresponding first conference participant according to the plurality of conference participants.
在此,本领域技术人员应能理解,上述分解包含多人的声纹频谱信息的会议语音消息的方法仅为举例,其他现有的或后续可能出现的可用于分解包含多人的声纹频谱信息的会议语音消息的方法如可适用该实施例,也应包含在该实施例保护范围以内,并在此以引用方式包含于此。Here, those skilled in the art should understand that the above-mentioned method for decomposing the conference voice message including the voiceprint spectrum information of multiple people is only an example, and other existing or possible subsequent methods can be used to decompose the voiceprint spectrum including multiple people. If the method for conferencing voice message of information is applicable to this embodiment, it should also be included within the protection scope of this embodiment, and is incorporated herein by reference.
在一些实施例中,所述频谱分析触发条件包括以下至少任一项:所述第一会议为线下会议;所述用户设备对应于多个用户标识信息;所述用户设备为公用设备或者未绑定用户标识信息。In some embodiments, the spectrum analysis trigger condition includes at least any one of the following: the first conference is an offline conference; the user equipment corresponds to a plurality of user identification information; the user equipment is a public device or is not Bind user ID information.
例如,考虑到线下会议中使用的用户设备可能无法与参会人员一一对应,故若第一网络设备根据会议类型信息确定所述第一会议为线下会议,即通过声纹频谱分析来确定该会议的会议语音消息对应的第一参会人员。又例如,笔记本电脑1为用户甲和用户乙的会议专用电脑,笔记本电脑1绑定有该二人在会议服务器中的用户标识信息。当会议服务器通过该笔记本电脑1获取会议语音消息时,仅根据用户标识信息无法准确确定参会人员,则需通过声纹频谱分析来确定。还例如,参会人员使用的是公共会议室的设备,未绑定用户标识信息,则该用户设备无法提供可供辨识参会人员的信息,故第一网络设备需通过声纹频谱分析来确定该会议的会议语音消息对应的第一参会人员。For example, considering that the user equipment used in the offline conference may not be in a one-to-one correspondence with the participants, if the first network device determines that the first conference is an offline conference according to the conference type information, the voiceprint spectrum analysis is used to determine the first conference. Determine the first conference participant corresponding to the conference voice message of the conference. For another example, the notebook computer 1 is a conference-specific computer of user A and user B, and the notebook computer 1 is bound with the user identification information of the two in the conference server. When the conference server obtains the conference voice message through the notebook computer 1, the conference participants cannot be accurately determined only based on the user identification information, and the voiceprint spectrum analysis is required to determine the conference participants. For another example, if a participant uses a device in a public conference room and the user identification information is not bound, the user device cannot provide information that can identify the participant, so the first network device needs to be determined through voiceprint spectrum analysis. The first conference participant corresponding to the conference voice message of the conference.
在一些实施例中,所述方法还包括:步骤S14(未示出),第一网络设备确定所述会议语音消息对应的第一群消息。在一些实施例中,第一网络设备对所述会议语音消息进行声纹频谱分析确定所述会议语音消息对应的频谱特征信息是否仅包含一个声纹频谱特征,若是,则第一网络设备将所述会议语音消息或所述会议语音消息转换获得的文本信息作为第一群消息;否则,第一网络设备将会议语音消息按声纹频谱特征分解获得多条子语音信息,将所述多条子语音信息或所述子语音信息转换获得的子文本信息作为第一群消息。In some embodiments, the method further includes: step S14 (not shown), the first network device determines a first group message corresponding to the conference voice message. In some embodiments, the first network device performs voiceprint spectrum analysis on the conference voice message to determine whether the spectral feature information corresponding to the conference voice message contains only one voiceprint spectrum feature; The conference voice message or the text information obtained by converting the conference voice message is used as the first group message; otherwise, the first network device decomposes the conference voice message according to the voiceprint spectrum feature to obtain multiple pieces of sub-voice information, and uses the multiple pieces of sub-voice information Or the sub-text information obtained by converting the sub-voice information is used as the first group message.
在一些实施例中,所述步骤S14包括:若所述会议语音消息中包含多人语音,根据多条子语音信息生成所述会议语音消息对应的第一群消息,其中,所述第一群消息包括多条第一子群消息,所述多条第一子群消息一一对应于所述多条子语音信 息,所述多条子语音信息是由所述会议语音消息按声纹频谱特征分解所得的、且每条子语音信息仅包含单人语音。In some embodiments, the step S14 includes: if the conference voice message includes multiple voices, generating a first group message corresponding to the conference voice message according to multiple pieces of sub-voice information, wherein the first group message Including multiple first subgroup messages, the multiple first subgroup messages correspond to the multiple sub-voice information one-to-one, and the multiple sub-voice information is obtained by decomposing the conference voice message according to the voiceprint spectral characteristics , and each sub-voice message contains only a single voice.
在此,所述子语音信息的获取方式与前述步骤S121中子语音信息的获取方式相同或基本相同,故不再赘述,并以引用方式包含于此。Here, the acquisition method of the sub-voice information is the same as or basically the same as the acquisition method of the sub-voice information in the aforementioned step S121, so it is not repeated here, and is included here by reference.
在一些实施例中,第一网络设备根据筛选规则从多条子语音信息中生成一条或多条第一子群消息,再根据所述第一子群消息确定所述会议语音消息对应的第一群消息。所述筛选规则包括以下至少任一项:(1)筛选子语音信息时长大于或等于预定时间阈值的子语音信息;(2)筛选子语音信息对应参会人员与用户设备对应的用户标识信息相匹配的子语音信息;(3)筛选子语音信息对应声音强度大于或等于预定声音强度阈值的子语音信息。在此,筛选规则(1)用于剔除参会人员发出的短促、无实际意义的语音信息;筛选规则(2)用于剔除非用户设备语音采集对象的语音信息,避免语音信息的重复采集;筛选规则(3)用于剔除分贝较小的语音信息以保证该语音信息可成功转换成文本信息或该语音信息可被用户识别。在一些实施例中,所述第一子群消息包括但不限于子语音信息、子语音信息转换获得的子文本信息。In some embodiments, the first network device generates one or more first subgroup messages from multiple pieces of sub-voice information according to a screening rule, and then determines a first group corresponding to the conference voice message according to the first sub-group messages information. The screening rules include at least any one of the following: (1) screening sub-voice information whose duration is greater than or equal to a predetermined time threshold; (2) screening the sub-voice information corresponding to the participant and the user identification information corresponding to the user equipment; matching sub-voice information; (3) screening the sub-voice information corresponding to the sub-voice information whose sound intensity is greater than or equal to a predetermined sound intensity threshold. Here, the screening rule (1) is used to eliminate the short, meaningless voice information sent by the participants; the screening rule (2) is used to eliminate the voice information of the non-user equipment voice collection object to avoid repeated collection of voice information; The screening rule (3) is used to eliminate the voice information with smaller decibels to ensure that the voice information can be successfully converted into text information or that the voice information can be recognized by the user. In some embodiments, the first subgroup message includes but is not limited to sub-voice information and sub-text information obtained by converting the sub-voice information.
在一些实施例中,所述第一群同步请求还包括所述第一群消息中各第一子群消息与所述第一社交用户中社交用户的映射关系。In some embodiments, the first group synchronization request further includes a mapping relationship between each first subgroup message in the first group message and a social user in the first social user.
在一些实施例中,第一网络设备根据第一子群消息对应的参会人员以及所述参会人员对应的第一社交用户中社交用户确定所述第一群消息中各第一子群消息与所述第一社交用户中社交用户的映射关系。在此,所述第一子群消息与所述第一社交用户中社交用户一一对应,以确保第二网络设备发布的第一群消息中各第一子群消息对应的发布用户身份准确。In some embodiments, the first network device determines each first subgroup message in the first group message according to a conference participant corresponding to the first subgroup message and a social user among the first social users corresponding to the conference participant A mapping relationship with social users in the first social users. Here, the first subgroup messages are in one-to-one correspondence with social users among the first social users, so as to ensure that the publishing user identities corresponding to the first subgroup messages in the first group messages published by the second network device are accurate.
在一些实施例中,所述第一群同步请求还包括所述多条第一子群消息的顺序关系,所述顺序关系是基于所述第一子群消息对应的所述子语音信息在所述会议语音信息中起始顺序确定的。In some embodiments, the first group synchronization request further includes a sequence relationship of the plurality of first subgroup messages, and the sequence relationship is based on the sub-voice information corresponding to the first subgroup message in the The starting sequence in the conference voice information is determined.
在一些实施例中,第一网络设备根据第一子群消息对应的子语音信息在会议语音消息中的起始位置进行排序;将所述多条子语音信息对应的顺序关系作为所述第一子群消息的顺序关系。例如,第一群同步请求中包含三条第一子群消息:“语音1”、“语音2”、“语音3”,其中,“语音1”从会议语音消息中0′15″处开 始,“语音2”从会议语音消息中1′27″处开始,“语音3”从会议语音消息中0′58″处开始,则这三条第一子群消息的顺序关系为:(1)“语音1”、(2)“语音3”、(3)“语音2”。该(1)、(2)、(3)序号用于表示第一子群消息的先后顺序。In some embodiments, the first network device sorts according to the starting position of the sub-voice information corresponding to the first sub-group message in the conference voice message; and takes the sequence relationship corresponding to the multiple pieces of sub-voice information as the first sub-voice information The order relationship of group messages. For example, the first group synchronization request contains three first subgroup messages: "Voice 1", "Voice 2", "Voice 3", where "Voice 1" starts from 0'15" in the conference voice message, " Voice 2" starts from 1'27" in the conference voice message, and "Voice 3" starts from 0'58" in the conference voice message, then the sequence relationship of these three first subgroup messages is: (1) "Voice 1" ", (2) "Voice 3", (3) "Voice 2". The (1), (2), (3) sequence numbers are used to indicate the sequence of the first subgroup messages.
在一些实施例中,所述方法还包括步骤S15(未示出):第一网络设备接收所述第二网络设备发送的第二群同步请求,其中,所述第二群同步请求包括所述第二群消息对应的第二会议消息、所述第一会议的会议标识信息;在所述第一会议中呈现所述第二会议消息。In some embodiments, the method further includes step S15 (not shown): the first network device receives a second group synchronization request sent by the second network device, wherein the second group synchronization request includes the The second conference message corresponding to the second group message, and the conference identification information of the first conference; and the second conference message is presented in the first conference.
在一些实施例中,所述第二会议消息包括但不限于文本信息、图片信息、音频信息、视频信息。第一网络设备根据所述会议标识信息确定呈现所述第二会议消息的第一会议,根据所述第二会议消息确定第一会议中用于呈现所述第二会议消息的呈现设备。第一网络设备将所述第二会议消息发送至所述呈现设备以在第一会议中呈现所述第二会议消息。例如,若第二会议消息为文本信息、图片信息或视频信息,第一网络设备可将第一会议中显示器A确定为该第二会议消息的呈现设备,并将第二会议消息发送至该显示器A以呈现该第二会议消息。又例如,若第二会议消息为语音信息,第一网络设备可将第一会议中扬声器B确定为该第二会议消息的呈现设备,并将第二会议消息发送至该扬声器B以播放该第二会议消息。In some embodiments, the second conference message includes but is not limited to text information, picture information, audio information, and video information. The first network device determines a first conference for presenting the second conference message according to the conference identification information, and determines a presentation device for presenting the second conference message in the first conference according to the second conference message. The first network device sends the second conference message to the presentation device to present the second conference message in the first conference. For example, if the second conference message is text information, picture information or video information, the first network device may determine display A in the first conference as the presentation device for the second conference message, and send the second conference message to the display A to present the second conference message. For another example, if the second conference message is voice information, the first network device may determine the speaker B in the first conference as the presentation device of the second conference message, and send the second conference message to the speaker B to play the first conference message. 2. Meeting news.
参考图1所示的系统,图3示出根据本申请一个实施例的一种在第二网络设备端实现会议消息同步的方法流程图,该方法包括步骤S21、步骤S22。在步骤S21中,第二网络设备接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;在步骤S22中,响应于所述第一群同步请求,第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。Referring to the system shown in FIG. 1 , FIG. 3 shows a flowchart of a method for realizing conference message synchronization at a second network device end according to an embodiment of the present application, and the method includes steps S21 and S22 . In step S21, the second network device receives a first group synchronization request sent by the first network device, where the first group synchronization request includes the first group message corresponding to the conference voice message, the first conference participant in the social network The corresponding first social user, and the first conversation group corresponding to the first conference in the social network, the first conference participant generates the conference voice message in the first conference; in step S22, In response to the first group synchronization request, the second network device publishes the first group message to the first conversation group as the first social user.
在步骤S21中,第二网络设备接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息。In step S21, the second network device receives a first group synchronization request sent by the first network device, where the first group synchronization request includes the first group message corresponding to the conference voice message, the first conference participant in the social network A corresponding first social user, and a first conversation group corresponding to the first conference in the social network, and the first conference participant generates the conference voice message in the first conference.
在一些实施例中,所述第一群同步请求还包括所述第一会议的会议标识信息。第二网络设备根据所述第一会议的会议标识信息区分各群消息对应的会议。在一些实施例中,所述第一社交用户包括社交用户标识,所述社交用户标识用于标识未确定对应社交用户的第一参会人员中参会人员在社交网络中身份。例如,若该参会人员“张三”不使用所述社交网络,则可临时为其分配一个社交名称(如,“会议用户1”)作为其在社交网络中的标识以与其他用户区分。在一些实施例中,所述第一群消息包括但不限于会议语音消息、根据会议语音消息转换的文本信息。在一些实施例中,若所述会议语音消息包含多人语音,则所述第一群消息包括但不限于会议语音消息基于声纹频谱特征分解的多条子语音信息、所述子语音信息转换的子文本信息。In some embodiments, the first group synchronization request further includes conference identification information of the first conference. The second network device distinguishes conferences corresponding to each group message according to the conference identification information of the first conference. In some embodiments, the first social user includes a social user identifier, and the social user identifier is used to identify the identity of the conference participant in the social network among the first conference participants whose corresponding social user is not determined. For example, if the conference participant "Zhang San" does not use the social network, he may be temporarily assigned a social name (eg, "Meeting User 1") as his identification in the social network to distinguish him from other users. In some embodiments, the first group message includes, but is not limited to, a conference voice message, and text information converted according to the conference voice message. In some embodiments, if the conference voice message includes multiple voices, the first group message includes, but is not limited to, multiple pieces of sub-voice information decomposed by the conference voice message based on voiceprint spectral features, and the converted sub-voice information. Subtext information.
在步骤S22中,响应于所述第一群同步请求,第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。In step S22, in response to the first group synchronization request, the second network device publishes the first group message to the first conversation group as the identity of the first social user.
在一些实施例中,所述将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群包括以下至少任一项:方式一,将所述第一群消息通过第一社交用户对应的社交账号发布;方式二,在第一会话群中添加第一社交机器人,将所述第一群消息通过所述第一社交机器人发送,其中所述第一群消息根据所述第一社交用户的身份标记。在一些实施例中,若所述第一社交用户包括社交用户标识,则第二网络设备仅通过前述方式二发送该社交用户标识对应参会人员的群消息。例如,参会用户“张三”在社交网络中没有对应的社交账号,第一网络设备为参会用户“张三”分配了对应的社交用户标识“zhangsan”并向第二网络设备发送对应的群同步请求。第二网络设备根据该群同步请求在对应的会话群中添加第一社交机器人(如图4所示界面图中“机器人1”)。第二网络设备可直接在第一群消息中添加社交用户标识后通过第一社交机器人发出该消息(如图4中“第一群消息1”的发送所示,在群消息中添加社交用户标识“zhangsan”),也可对发送至第一会话群中的第一群消息进行标注(如图4中“第一群消息2”的发送所示,对发送的群消息添加消息来源提示)。In some embodiments, the publishing the first group message to the first conversation group as the first social user includes at least any one of the following: way 1, publishing the first group message through The social account corresponding to the first social user is published; in the second method, a first social robot is added to the first conversation group, and the first group message is sent through the first social robot, wherein the first group message is based on the Describe the identity tag of the first social user. In some embodiments, if the first social user includes a social user identifier, the second network device only sends a group message of the conference participant corresponding to the social user identifier through the foregoing method 2. For example, the conference participant "Zhang San" does not have a corresponding social account in the social network, the first network device allocates the corresponding social user identifier "zhangsan" to the conference participant "Zhang San" and sends the corresponding social user ID "zhangsan" to the second network device. Group synchronization request. The second network device adds the first social robot (“robot 1” in the interface diagram as shown in FIG. 4 ) in the corresponding conversation group according to the group synchronization request. The second network device can directly add the social user identifier to the first group message and send the message through the first social robot (as shown in the sending of “first group message 1” in FIG. 4 , adding the social user identifier to the group message "zhangsan"), the first group message sent to the first conversation group can also be marked (as shown in the sending of "first group message 2" in Figure 4, a message source prompt is added to the sent group message).
在一些实施例中,所述第一社交用户包括多个社交用户,所述第一群消息包括多条第一子群消息,每条第一子群消息对应于所述第一社交用户中的一个用户;所述步骤S22包括:响应于所述第一群同步请求,第二网络设备将所述多条第一子群 消息中各第一子群消息分别以该第一子群消息在所述第一社交用户中对应社交用户的身份发送至所述第一会话群。在一些实施例中,所述将所述多条第一子群消息中各第一子群消息分别以该第一子群消息在所述第一社交用户中对应社交用户的身份发送至所述第一会话群包括以下至少任一项:将所述多条第一子群消息中各第一子群消息分别通过该第一子群消息在所述第一社交用户中对应社交用户的社交账号发布;在第一会话群中添加第一社交机器人,将所述多条第一子群消息中各第一子群消息分别通过所述第一社交机器人发送,其中各第一子群消息根据该第一子群消息在所述第一社交用户中对应社交用户的身份标记。In some embodiments, the first social user includes a plurality of social users, the first group message includes a plurality of first subgroup messages, and each first subgroup message corresponds to a a user; the step S22 includes: in response to the first group synchronization request, the second network device stores each first subgroup message in the plurality of first subgroup messages as the first subgroup message in the respective first subgroup message. The identity of the corresponding social user among the first social users is sent to the first conversation group. In some embodiments, the sending each first subgroup message in the plurality of first subgroup messages to the The first conversation group includes at least any one of the following: sending each first subgroup message in the plurality of first subgroup messages to the social account of the social user corresponding to the first social user through the first subgroup message. Publish; add a first social robot to the first conversation group, and send each first subgroup message in the plurality of first subgroup messages through the first social robot, wherein each first subgroup message is based on the The first subgroup message corresponds to the identity tag of the social user in the first social user.
在一些实施例中,所述第一群同步请求还包括所述多条第一子群消息的顺序关系;所述步骤S22包括:响应于所述第一群同步请求,第二网络设备按照所述顺序关系将所述多条第一子群消息中各第一子群消息分别以该第一子群消息在所述第一社交用户中对应社交用户的身份发送至所述第一会话群。在一些实施例中,所述顺序关系由第一网络设备根据第一子群消息对应的子语音信息在会议语音消息中的起始位置的顺序确定。例如,第一群同步请求中包含三条第一子群消息:“语音1”、“语音2”、“语音3”,其中,“语音1”从会议语音消息中0′15″处开始,“语音2”从会议语音消息中1′27″处开始,“语音3”从会议语音消息中0′58″处开始,则这三条第一子群消息的顺序关系为:(1)“语音1”、(2)“语音3”、(3)“语音2”。第二网络设备可根据预设的消息发送时间间隔(例如,3秒),按照“语音1”、“语音3”、“语音2”的顺序,依次发送这三条第一子群消息。第二网络设备根据所述顺序关系发送各第一子群消息,可帮助第一会话群中未参与第一会议的群成员厘清各消息的时间线,避免多条消息同时发送造成的逻辑混乱。In some embodiments, the first group synchronization request further includes a sequence relationship of the plurality of first subgroup messages; the step S22 includes: in response to the first group synchronization request, the second network device executes the The sequence relationship sends each first subgroup message in the plurality of first subgroup messages to the first conversation group as the first subgroup message corresponds to the social user in the first social user. In some embodiments, the sequence relationship is determined by the first network device according to the sequence of the starting positions of the sub-voice information corresponding to the first sub-group message in the conference voice message. For example, the first group synchronization request contains three first subgroup messages: "Voice 1", "Voice 2", "Voice 3", where "Voice 1" starts from 0'15" in the conference voice message, " Voice 2" starts from 1'27" in the conference voice message, and "Voice 3" starts from 0'58" in the conference voice message, then the sequence relationship of these three first subgroup messages is: (1) "Voice 1" ", (2) "Voice 3", (3) "Voice 2". The second network device can send messages according to the preset message sending time interval (for example, 3 seconds), according to "Voice 1", "Voice 3", "Voice 3", " The order of voice 2", the three first subgroup messages are sent in sequence. The second network device sends each first subgroup message according to the sequence relationship, which can help the group members in the first conversation group who did not participate in the first conference to clarify each message. The message timeline avoids the logical confusion caused by sending multiple messages at the same time.
在一些实施例中,所述步骤S22包括:响应于所述第一群同步请求,若所述第一社交用户已参与所述第一会话群,第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群;否则,将所述第一群消息以所述第一会议对应的第一社交机器人的身份发送至所述第一会话群。例如,第一群同步请求中,第一社交用户为“张三”和“李四”,第一会话群为“策划1群”,其中,第一社交用户中“张三”并非“策划1群”的群成员。第二网络设备可将第一社交用户“李四”对应的第一子群消息以“李四”的身份发送至“策划1群”。同时,第二网络 设备可将社交机器人添加至“策划1群”,通过该社交机器人发送第一社交用户“张三”对应的第一子群消息,并且使用“张三”对该第一子群消息进行标识。在此,所述第一子群消息的发送方式与前述步骤S22中第一子群消息的发送方式相同或基本相同,故不再赘述,并以引用方式包含于此。在该实施例中,第二网络设备通过社交机器人替代不在第一会话群中的社交用户发送与该社交用户对应的群消息,在方便消息传递的同时,保障社交用户与会话群的隐私安全。In some embodiments, the step S22 includes: in response to the first group synchronization request, if the first social user has participated in the first conversation group, the second network device sends the first group message to The identity of the first social user is published in the first conversation group; otherwise, the first group message is sent to the first conversation group as the identity of the first social robot corresponding to the first meeting. For example, in the first group synchronization request, the first social users are "Zhang San" and "Li Si", and the first conversation group is "Planning 1 group", wherein "Zhang San" in the first social user is not "Planning 1" group" members. The second network device may send the first subgroup message corresponding to the first social user "Li Si" to the "Planning 1 group" as "Li Si". At the same time, the second network device can add the social robot to the "Planning 1 group", send the first subgroup message corresponding to the first social user "Zhang San" through the social robot, and use "Zhang San" to the first subgroup. Group messages are identified. Here, the sending method of the first subgroup message is the same or basically the same as the sending method of the first subgroup message in the foregoing step S22, so it is not repeated here, and is incorporated herein by reference. In this embodiment, the second network device uses a social robot to replace a social user who is not in the first conversation group to send a group message corresponding to the social user, so as to facilitate message transmission and protect the privacy and security of the social user and the conversation group.
在一些实施例中,所述方法还包括步骤S23:若所述第一社交用户尚未加入所述第一会话群,将所述第一社交用户添加至所述第一会话群。例如,对于未加入第一会话群的第一社交用户“张三”,第二网络设备可将该第一社交用户“张三”添加至该群后,再将第一社交用户“张三”对应的第一群消息以“张三”的身份发布于所述第一会话群。在该实施例中,第二网络设备将未加入第一会话群的社交用户添加至该第一会话群,可方便该社交用户与第一会话群中未参与该第一会议的用户在会议结束后也能继续进行交流。In some embodiments, the method further includes step S23: if the first social user has not joined the first conversation group, adding the first social user to the first conversation group. For example, for the first social user "Zhang San" who has not joined the first conversation group, the second network device may add the first social user "Zhang San" to the group, and then add the first social user "Zhang San" to the group. The corresponding first group message is published in the first conversation group as "Zhang San". In this embodiment, the second network device adds the social user who has not joined the first conversation group to the first conversation group, which can facilitate the social user and the user in the first conversation group who did not participate in the first meeting to end the meeting You can continue to communicate afterwards.
在一些实施例中,所述方法还包括步骤S24:第二网络设备接收所述第一会话群中第二群用户发送给所述第一会议的第二群消息;根据所述第二群消息生成待发送至所述第一网络设备的第二群同步请求,其中,所述第二群同步请求包括所述第二群消息对应的第二会议消息,以及基于所述第一会议确定的所述第一会议的会议标识信息;将所述第二群同步请求发送至所述第一网络设备,以供在所述第一会议中呈现所述第二会议消息。In some embodiments, the method further includes step S24: the second network device receives a second group message sent to the first conference by a second group user in the first conversation group; according to the second group message A second group synchronization request to be sent to the first network device is generated, wherein the second group synchronization request includes a second conference message corresponding to the second group message, and the determined value based on the first conference. meeting identification information of the first meeting; sending the second group synchronization request to the first network device for presenting the second meeting message in the first meeting.
在一些实施例中,所述第二群用户包括未参与所述第一会议的社交用户。例如,社交用户“张三”管理有多个项目组,其中有2个项目组会议时间冲突,则“张三”可以选择其中之一参加,并通过会话群实时跟进另一个项目组会议;或者“张三”可以处理其他项目工作并通过会话群实时跟进这2个项目组会议。在该实施例中,会话群中还包括未参与会议的社交用户,该社交用户可通过会话群实时了解会议内容,并对会议内容进行回应,方便用户实时参与会议决策,避免会议内容获知的延迟,提高用户工作效率。在一些实施例中,所述第二会议消息包括但不限于:第二群消息、第二群消息中语音信息转换获得的文本信息、第二群消息中文本信息转换获得的语音信息。在此,所述第二会议消息在第一会议中的呈现方式与前述步骤S15中第二会议消息的呈现方式相同或基本相同,故不再赘述,并以引用方式包含于此。In some embodiments, the second group of users includes social users who did not participate in the first meeting. For example, the social user "Zhang San" manages multiple project groups, and there are two project group meeting times conflicting, then "Zhang San" can choose one of them to participate, and follow up the other project group meeting in real time through the conversation group; Or "Zhang San" can handle other project work and follow up these 2 project team meetings in real time through the conversation group. In this embodiment, the conversation group also includes social users who did not participate in the meeting. The social user can learn about the meeting content in real time through the conversation group, and respond to the meeting content, which is convenient for users to participate in meeting decision-making in real time and avoids the delay in learning the meeting content. , to improve the user's work efficiency. In some embodiments, the second conference message includes but is not limited to: a second group message, text information obtained by converting voice information in the second group message, and voice information obtained by converting text information in the second group message. Here, the presentation manner of the second conference message in the first conference is the same as or substantially the same as the presentation manner of the second conference message in the aforementioned step S15, so it is not repeated here, and is incorporated herein by reference.
在一些实施例中,所述接收所述第一会话群中第二群用户发送给所述第一会议的第二群消息包括:第二网络设备接收所述第一会话群中第二群用户发送的第二群消息,并根据所述第二群用户的消息同步操作确定对应的第一会议。所述消息同步操作包括但不限于:(1)在发送第二群消息时指定进行消息同步的会议,例如,在消息发送界面中呈现该会话群中进行会议消息同步的一个或多个会议。第二群用户可通过勾选操作指定接收其第二群消息的一个或多个会议;(2)引用第一会议对应的一个或多个第一群消息或者第一社交机器人,例如,第二群用户对“张三”在第一会议中的发言进行回应,则第二群用户可以在发送消息时引用“张三”会议语音消息对应的第一群消息。又例如,第一会话群中第一会议对应的第一社交机器人为“机器人A”,则第二群用户在发送第二群消息时可通过“@机器人A”的形式引用该第一社交机器人以将该第二群消息同步至第一会议。在一些实施例中,所述根据所述第二群用户的消息同步操作确定对应的第一会议包括:根据第二群用户指定进行消息同步的会议确定对应的第一会议,或者确定与第二群用户所引用的一个或多个第一群消息或者第一社交机器人相匹配的会议为第一会议。In some embodiments, the receiving a second group message sent by a second group of users in the first conversation group to the first conference includes: the second network device receiving a second group of users in the first conversation group The second group message is sent, and the corresponding first conference is determined according to the message synchronization operation of the second group users. The message synchronization operation includes but is not limited to: (1) Designating a conference for message synchronization when sending a second group message, for example, presenting one or more conferences in the conversation group for conference message synchronization in the message sending interface. Users of the second group can specify one or more conferences to receive their second group messages through a check operation; (2) refer to one or more first group messages or the first social robot corresponding to the first conference, for example, the second group If the group user responds to the speech of "Zhang San" in the first conference, the second group user can quote the first group message corresponding to the conference voice message of "Zhang San" when sending the message. For another example, if the first social robot corresponding to the first meeting in the first conversation group is "robot A", users in the second group can refer to the first social robot in the form of "@robot A" when sending the second group message. to synchronize the second group of messages to the first conference. In some embodiments, the determining the corresponding first conference according to the message synchronization operation of the second group of users includes: determining the corresponding first conference according to the conference designated by the second group of users for message synchronization, or determining the corresponding first conference A meeting that matches one or more first group messages or the first social robot cited by the group user is the first meeting.
图5示出根据本申请一个实施例的一种实现会议消息同步的方法流程图,该方法包括:步骤S11’,接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;步骤S12’,响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;步骤S13’,将所述第一群同步请求发送至所述社交网络中的第二网络设备;步骤S21’,接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;步骤S22’,响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。5 shows a flowchart of a method for realizing conference message synchronization according to an embodiment of the present application. The method includes: step S11 ′, receiving a conference voice message sent by a user equipment in a first conference, wherein the first conference participant is in the The conference voice message is generated in the first conference; step S12', in response to the conference voice message, determine the first social user corresponding to the first conference participant in the social network, and generate a message to be sent to all The first group synchronization request of the social network, wherein the first group synchronization request includes the first social user, the first group message corresponding to the conference voice message, and the first conference in the social network. The corresponding first conversation group in the social network; step S13', sending the first group synchronization request to the second network device in the social network; step S21', receiving the first group synchronization request sent by the first network device, The first group synchronization request includes the first group message corresponding to the conference voice message, the first social user corresponding to the first conference participant in the social network, and the first session corresponding to the first conference in the social network group, the first conference participant generates the conference voice message in the first conference; step S22', in response to the first group synchronization request, the first group message is sent to the first social media The identity of the user is published in the first conversation group.
在此,步骤S11’、S12’、S13’、S21’、S22’的具体实现方式,分别与前述实施例中步骤S11、S12、S13、S21、S22相同或基本相同,故不再赘述,并以引 用方式包含于此。Here, the specific implementation manners of steps S11', S12', S13', S21', and S22' are respectively the same as or basically the same as steps S11, S12, S13, S21, and S22 in the foregoing embodiment, so they are not repeated here. Incorporated herein by reference.
图6示出根据本申请一个实施例的一种实现会议消息同步的第一网络设备结构图,所述第一网络设备包括一一模块11、一二模块12、一三模块13。一一模块11接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;一二模块12响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;一三模块13将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。在此,所述图6示出的一一模块11、一二模块12、一三模块13对应的具体实施方式分别与前述步骤S11、步骤S12、步骤S13的具体实施例相同或相近,故不再赘述,以引用方式包含于此。FIG. 6 shows a structural diagram of a first network device for realizing conference message synchronization according to an embodiment of the present application, where the first network device includes a first module 11 , a second module 12 , and a third module 13 . The one-one module 11 receives the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference; the one-two module 12 determines in response to the conference voice message the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user , the first group message corresponding to the conference voice message, and the first conversation group corresponding to the first conference in the social network; the third module 13 sends the first group synchronization request to the social network The second network device in the , so that the second network device publishes the first group message to the first conversation group as the identity of the first social user. Here, the specific implementations corresponding to the first module 11 , the first two modules 12 , and the one third modules 13 shown in FIG. 6 are the same or similar to the specific embodiments of the aforementioned steps S11 , S12 , and S13 respectively, so they are not Again, it is incorporated herein by reference.
在一些实施例中,所述一二模块12包括一二一单元121(未示出)、一二二单元122(未示出)。所述一二一单元121根据所述用户设备对应的用户标识信息,或者通过对所述会议语音消息进行声纹频谱分析,确定所述第一参会人员;所述一二二单元122确定所述第一参会人员在社交网络中对应的第一社交用户,其中所述第一社交用户中的社交用户与所述第一参会人员中的参会人员一一对应。在此,该一二一单元121和一二二单元122的具体实现方式与前述步骤S121、步骤S122相同或相近,故不再赘述,并以引用方式包含于此。In some embodiments, the one-two module 12 includes a one-two-one unit 121 (not shown) and a one-two-two unit 122 (not shown). The one-two-one unit 121 determines the first conference participant according to the user identification information corresponding to the user equipment or by performing voiceprint spectrum analysis on the conference voice message; the one-two-two unit 122 determines the first participant. The first social user corresponding to the first conference participant in the social network, wherein the social user in the first social user is in one-to-one correspondence with the conference participant in the first conference participant. Here, the specific implementations of the one-two-one unit 121 and the one-two-two unit 122 are the same as or similar to the aforementioned steps S121 and S122 , so they are not repeated here, and are incorporated herein by reference.
在一些实施例中,所述第一网络设备包括一四模块14(未示出)。所述一四模块14确定所述会议语音消息对应的第一群消息。在此,该一四模块14的具体实现方式与前述步骤S14相同或相近,故不再赘述,并以引用方式包含于此。In some embodiments, the first network device includes a quad module 14 (not shown). The one-four module 14 determines the first group message corresponding to the conference voice message. Here, the specific implementation manner of the four modules 14 is the same as or similar to the aforementioned step S14, so it is not repeated here, and is included here by reference.
在一些实施例中,所述第一网络设备包括一五模块15(未示出)。所述一五模块15接收所述第二网络设备发送的第二群同步请求,其中,所述第二群同步请求包括所述第二群消息对应的第二会议消息、所述第一会议的会议标识信息;在所述第一会议中呈现所述第二会议消息。在此,该一五模块15的具体实现方式与前述步骤S15相同或相近,故不再赘述,并以引用方式包含于此。In some embodiments, the first network device includes a five-module 15 (not shown). The one-five module 15 receives a second group synchronization request sent by the second network device, wherein the second group synchronization request includes a second conference message corresponding to the second group message, a Conference identification information; the second conference message is presented in the first conference. Here, the specific implementation of the one-fifth module 15 is the same as or similar to the aforementioned step S15, so it is not repeated here, and is incorporated herein by reference.
图7示出根据本申请一个实施例的一种实现会议消息同步的第二网络设备结构 图,所述第二网络设备包括二一模块21、二二模块22。二一模块21接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;二二模块22响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。在此,所述图7示出的二一模块21和二二模块22对应的具体实施方式与前述步骤S21、步骤S22的具体实施例相同或相近,故不再赘述,以引用方式包含于此。Fig. 7 shows a structural diagram of a second network device for realizing conference message synchronization according to an embodiment of the present application, where the second network device includes a two-one module 21 and a two-two module 22. The 21 module 21 receives the first group synchronization request sent by the first network device, wherein the first group synchronization request includes the first group message corresponding to the conference voice message and the first social network corresponding to the first conference participant in the social network the user, and the first conversation group corresponding to the first conference in the social network, the first conference participant generates the conference voice message in the first conference; the second module 22 responds to the first conference A group synchronization request, publishing the first group message to the first conversation group as the identity of the first social user. Here, the specific implementations corresponding to the two-one module 21 and the two-two module 22 shown in FIG. 7 are the same as or similar to the specific embodiments of the aforementioned steps S21 and S22, so they will not be repeated here, but are incorporated herein by reference. .
在一些实施例中,所述第二网络设备还包括二三模块23(未示出)。所述二三模块23若所述第一社交用户尚未加入所述第一会话群,将所述第一社交用户添加至所述第一会话群。在此,该二三模块23的具体实现方式与前述步骤S23相同或相近,故不再赘述,并以引用方式包含于此。In some embodiments, the second network device further includes a second-third module 23 (not shown). The second and third module 23 adds the first social user to the first conversation group if the first social user has not joined the first conversation group. Here, the specific implementation manner of the second and third modules 23 is the same as or similar to the aforementioned step S23 , so it is not repeated here, and is incorporated herein by reference.
在一些实施例中,所述第二网络设备还包括二四模块24(未示出)。所述二四模块24接收所述第一会话群中第二群用户发送给所述第一社交机器人的第二群消息;根据所述第二群消息生成待发送至所述第一网络设备的第二群同步请求,其中,所述第二群同步请求包括所述第二群消息对应的第二会议消息,以及基于所述第一社交机器人确定的所述第一会议的会议标识信息;将所述第二群同步请求发送至所述第一网络设备,以供在所述第一会议中呈现所述第二会议消息。在此,该二四模块24的具体实现方式与前述步骤S24相同或相近,故不再赘述,并以引用方式包含于此。In some embodiments, the second network device further includes a second-fourth module 24 (not shown). The two-four module 24 receives a second group message sent to the first social robot by a second group of users in the first conversation group; generates a message to be sent to the first network device according to the second group message. a second group synchronization request, wherein the second group synchronization request includes a second conference message corresponding to the second group message, and the conference identification information of the first conference determined based on the first social robot; The second group synchronization request is sent to the first network device for presenting the second conference message in the first conference. Here, the specific implementation of the two-four module 24 is the same as or similar to the aforementioned step S24, so it is not repeated here, and is included here by reference.
图8示出了可被用于实施本申请中所述的各个实施例的示例性系统;FIG. 8 illustrates an exemplary system that may be used to implement various embodiments described in this application;
如图8所示在一些实施例中,系统300能够作为各所述实施例中的任意一个设备。在一些实施例中,系统300可包括具有指令的一个或多个计算机可读介质(例如,系统存储器或NVM/存储设备320)以及与该一个或多个计算机可读介质耦合并被配置为执行指令以实现模块从而执行本申请中所述的动作的一个或多个处理器(例如,(一个或多个)处理器305)。As shown in FIG. 8, in some embodiments, the system 300 can function as any of the devices in each of the described embodiments. In some embodiments, system 300 may include one or more computer-readable media (eg, system memory or NVM/storage device 320 ) having instructions and be coupled to the one or more computer-readable media and configured to execute Instructions to implement a module to perform one or more processors (eg, processor(s) 305 ) to perform the actions described herein.
对于一个实施例,系统控制模块310可包括任意适当的接口控制器,以向(一个或多个)处理器305中的至少一个和/或与系统控制模块310通信的任意适当的设备或组件提供任意适当的接口。For one embodiment, the system control module 310 may include any suitable interface controller to provide at least one of the processor(s) 305 and/or any suitable device or component in communication with the system control module 310 any appropriate interface.
系统控制模块310可包括存储器控制器模块330,以向系统存储器315提供接口。存储器控制器模块330可以是硬件模块、软件模块和/或固件模块。The system control module 310 may include a memory controller module 330 to provide an interface to the system memory 315 . The memory controller module 330 may be a hardware module, a software module, and/or a firmware module.
系统存储器315可被用于例如为系统300加载和存储数据和/或指令。对于一个实施例,系统存储器315可包括任意适当的易失性存储器,例如,适当的DRAM。在一些实施例中,系统存储器315可包括双倍数据速率类型四同步动态随机存取存储器(DDR4SDRAM)。 System memory 315 may be used, for example, to load and store data and/or instructions for system 300 . For one embodiment, system memory 315 may include any suitable volatile memory, eg, suitable DRAM. In some embodiments, system memory 315 may include double data rate type quad synchronous dynamic random access memory (DDR4 SDRAM).
对于一个实施例,系统控制模块310可包括一个或多个输入/输出(I/O)控制器,以向NVM/存储设备320及(一个或多个)通信接口325提供接口。For one embodiment, system control module 310 may include one or more input/output (I/O) controllers to provide interfaces to NVM/storage device 320 and communication interface(s) 325 .
例如,NVM/存储设备320可被用于存储数据和/或指令。NVM/存储设备320可包括任意适当的非易失性存储器(例如,闪存)和/或可包括任意适当的(一个或多个)非易失性存储设备(例如,一个或多个硬盘驱动器(HDD)、一个或多个光盘(CD)驱动器和/或一个或多个数字通用光盘(DVD)驱动器)。For example, NVM/storage device 320 may be used to store data and/or instructions. NVM/storage device 320 may include any suitable non-volatile memory (eg, flash memory) and/or may include any suitable non-volatile storage device(s) (eg, one or more hard drives ( HDD), one or more compact disc (CD) drives and/or one or more digital versatile disc (DVD) drives).
NVM/存储设备320可包括在物理上作为系统300被安装在其上的设备的一部分的存储资源,或者其可被该设备访问而不必作为该设备的一部分。例如,NVM/存储设备320可通过网络经由(一个或多个)通信接口325进行访问。NVM/storage device 320 may include storage resources that are physically part of the device on which system 300 is installed, or it may be accessed by the device without necessarily being part of the device. For example, the NVM/storage device 320 is accessible via the communication interface(s) 325 over a network.
(一个或多个)通信接口325可为系统300提供接口以通过一个或多个网络和/或与任意其他适当的设备通信。系统300可根据一个或多个无线网络标准和/或协议中的任意标准和/或协议来与无线网络的一个或多个组件进行无线通信。Communication interface(s) 325 may provide an interface for system 300 to communicate over one or more networks and/or with any other suitable device. System 300 may wirelessly communicate with one or more components of a wireless network in accordance with any of one or more wireless network standards and/or protocols.
对于一个实施例,(一个或多个)处理器305中的至少一个可与系统控制模块310的一个或多个控制器(例如,存储器控制器模块330)的逻辑封装在一起。对于一个实施例,(一个或多个)处理器305中的至少一个可与系统控制模块310的一个或多个控制器的逻辑封装在一起以形成系统级封装(SiP)。对于一个实施例,(一个或多个)处理器305中的至少一个可与系统控制模块310的一个或多个控制器的逻辑集成在同一模具上。对于一个实施例,(一个或多个)处理器305中的至少一个可与系统控制模块310的一个或多个控制器的逻辑集成在同一模具上以形成片上系统(SoC)。For one embodiment, at least one of the processor(s) 305 may be packaged with the logic of one or more controllers of the system control module 310 (eg, the memory controller module 330 ). For one embodiment, at least one of the processor(s) 305 may be packaged with logic of one or more controllers of the system control module 310 to form a system-in-package (SiP). For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with the logic of one or more controllers of the system control module 310 . For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with logic of one or more controllers of the system control module 310 to form a system on a chip (SoC).
在各个实施例中,系统300可以但不限于是:服务器、工作站、台式计算设备或移动计算设备(例如,膝上型计算设备、手持计算设备、平板电脑、上网本等)。在各个实施例中,系统300可具有更多或更少的组件和/或不同的架构。例如,在 一些实施例中,系统300包括一个或多个摄像机、键盘、液晶显示器(LCD)屏幕(包括触屏显示器)、非易失性存储器端口、多个天线、图形芯片、专用集成电路(ASIC)和扬声器。In various embodiments, system 300 may be, but is not limited to, a server, workstation, desktop computing device, or mobile computing device (eg, laptop computing device, handheld computing device, tablet computer, netbook, etc.). In various embodiments, system 300 may have more or fewer components and/or different architectures. For example, in some embodiments, system 300 includes one or more cameras, keyboards, liquid crystal display (LCD) screens (including touchscreen displays), non-volatile memory ports, multiple antennas, graphics chips, application specific integrated circuits ( ASIC) and speakers.
除上述各实施例介绍的方法和设备外,本申请还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机代码,当所述计算机代码被执行时,如前任一项所述的方法被执行。In addition to the methods and devices described in the above-mentioned embodiments, the present application also provides a computer-readable storage medium, where the computer-readable storage medium stores computer codes, when the computer codes are executed, as in any of the previous The described method is executed.
本申请还提供了一种计算机程序产品,当所述计算机程序产品被计算机设备执行时,如前任一项所述的方法被执行。The present application also provides a computer program product, when the computer program product is executed by a computer device, the method according to any one of the preceding items is executed.
本申请还提供了一种计算机设备,所述计算机设备包括:The present application also provides a computer device, the computer device comprising:
一个或多个处理器;one or more processors;
存储器,用于存储一个或多个计算机程序;memory for storing one or more computer programs;
当所述一个或多个计算机程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现如前任一项所述的方法。The one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any preceding item.
需要注意的是,本申请可在软件和/或软件与硬件的组合体中被实施,例如,可采用专用集成电路(ASIC)、通用目的计算机或任何其他类似硬件设备来实现。在一个实施例中,本申请的软件程序可以通过处理器执行以实现上文所述步骤或功能。同样地,本申请的软件程序(包括相关的数据结构)可以被存储到计算机可读记录介质中,例如,RAM存储器,磁或光驱动器或软磁盘及类似设备。另外,本申请的一些步骤或功能可采用硬件来实现,例如,作为与处理器配合从而执行各个步骤或功能的电路。It should be noted that the present application may be implemented in software and/or a combination of software and hardware, eg, an application specific integrated circuit (ASIC), a general purpose computer, or any other similar hardware device. In one embodiment, the software program of the present application may be executed by a processor to implement the steps or functions described above. Likewise, the software programs of the present application (including associated data structures) may be stored on a computer-readable recording medium, such as RAM memory, magnetic or optical drives or floppy disks, and the like. In addition, some steps or functions of the present application may be implemented in hardware, for example, as a circuit that cooperates with a processor to perform various steps or functions.
另外,本申请的一部分可被应用为计算机程序产品,例如计算机程序指令,当其被计算机执行时,通过该计算机的操作,可以调用或提供根据本申请的方法和/或技术方案。本领域技术人员应能理解,计算机程序指令在计算机可读介质中的存在形式包括但不限于源文件、可执行文件、安装包文件等,相应地,计算机程序指令被计算机执行的方式包括但不限于:该计算机直接执行该指令,或者该计算机编译该指令后再执行对应的编译后程序,或者该计算机读取并执行该指令,或者该计算机读取并安装该指令后再执行对应的安装后程序。在此,计算机可读介质可以是可供计算机访问的任意可用的计算机可读存储介质或通信介质。In addition, a part of the present application can be applied as a computer program product, such as computer program instructions, which when executed by a computer, through the operation of the computer, can invoke or provide methods and/or technical solutions according to the present application. Those skilled in the art should understand that the existing forms of computer program instructions in computer-readable media include but are not limited to source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include but are not limited to Limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding post-installation program. program. Here, the computer-readable medium can be any available computer-readable storage medium or communication medium that can be accessed by a computer.
通信介质包括藉此包含例如计算机可读指令、数据结构、程序模块或其他数据 的通信信号被从一个系统传送到另一系统的介质。通信介质可包括有导的传输介质(诸如电缆和线(例如,光纤、同轴等))和能传播能量波的无线(未有导的传输)介质,诸如声音、电磁、RF、微波和红外。计算机可读指令、数据结构、程序模块或其他数据可被体现为例如无线介质(诸如载波或诸如被体现为扩展频谱技术的一部分的类似机制)中的已调制数据信号。术语“已调制数据信号”指的是其一个或多个特征以在信号中编码信息的方式被更改或设定的信号。调制可以是模拟的、数字的或混合调制技术。Communication media includes media by which communication signals containing, for example, computer readable instructions, data structures, program modules or other data are transmitted from one system to another. Communication media may include conducted transmission media such as cables and wires (eg, fiber optic, coaxial, etc.) and wireless (unconducted transmission) media capable of propagating energy waves, such as acoustic, electromagnetic, RF, microwave, and infrared . Computer readable instructions, data structures, program modules or other data may be embodied, for example, as a modulated data signal in a wireless medium such as a carrier wave or similar mechanism such as embodied as part of spread spectrum technology. The term "modulated data signal" refers to a signal whose one or more characteristics are altered or set in a manner that encodes information in the signal. Modulation can be analog, digital or hybrid modulation techniques.
作为示例而非限制,计算机可读存储介质可包括以用于存储诸如计算机可读指令、数据结构、程序模块或其它数据的信息的任何方法或技术实现的易失性和非易失性、可移动和不可移动的介质。例如,计算机可读存储介质包括,但不限于,易失性存储器,诸如随机存储器(RAM,DRAM,SRAM);以及非易失性存储器,诸如闪存、各种只读存储器(ROM,PROM,EPROM,EEPROM)、磁性和铁磁/铁电存储器(MRAM,FeRAM);以及磁性和光学存储设备(硬盘、磁带、CD、DVD);或其它现在已知的介质或今后开发的能够存储供计算机系统使用的计算机可读信息/数据。By way of example and not limitation, computer-readable storage media may include volatile and non-volatile, readable storage media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Removable and non-removable media. For example, computer-readable storage media include, but are not limited to, volatile memory, such as random access memory (RAM, DRAM, SRAM); and non-volatile memory, such as flash memory, various read-only memories (ROM, PROM, EPROM) , EEPROM), magnetic and ferromagnetic/ferroelectric memory (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, tapes, CDs, DVDs); or other media now known or later developed capable of storing data for computer systems Computer readable information/data used.
在此,根据本申请的一个实施例包括一个装置,该装置包括用于存储计算机程序指令的存储器和用于执行程序指令的处理器,其中,当该计算机程序指令被该处理器执行时,触发该装置运行基于前述根据本申请的多个实施例的方法和/或技术方案。Here, an embodiment according to the present application includes an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein, when the computer program instructions are executed by the processor, a trigger is The apparatus operates based on the aforementioned methods and/or technical solutions according to various embodiments of the present application.
对于本领域技术人员而言,显然本申请不限于上述示范性实施例的细节,而且在不背离本申请的精神或基本特征的情况下,能够以其他的具体形式实现本申请。因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本申请的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化涵括在本申请内。不应将权利要求中的任何附图标记视为限制所涉及的权利要求。此外,显然“包括”一词不排除其他单元或步骤,单数不排除复数。装置权利要求中陈述的多个单元或装置也可以由一个单元或装置通过软件或者硬件来实现。第一,第二等词语用来表示名称,而并不表示任何特定的顺序。It will be apparent to those skilled in the art that the present application is not limited to the details of the above-described exemplary embodiments, but that the present application can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application. Accordingly, the embodiments are to be regarded in all respects as illustrative and not restrictive, and the scope of the application is to be defined by the appended claims rather than the foregoing description, which is therefore intended to fall within the scope of the claims. All changes within the meaning and scope of the equivalents of , are included in this application. Any reference signs in the claims shall not be construed as limiting the involved claim. Furthermore, it is clear that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. Several units or means recited in the device claims can also be realized by one unit or means by means of software or hardware. The terms first, second, etc. are used to denote names and do not denote any particular order.

Claims (20)

  1. 一种在第一网络设备端实现会议消息同步的方法,其中,所述方法包括:A method for realizing conference message synchronization at a first network device, wherein the method includes:
    接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;receiving a conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference;
    响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;In response to the conference voice message, determine the first social user corresponding to the first conference participant in the social network, and generate a first group synchronization request to be sent to the social network, wherein the first group The synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first conversation group corresponding to the first conference in the social network;
    将所述第一群同步请求发送至所述社交网络中的第二网络设备,以供所述第二网络设备将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。Send the first group synchronization request to a second network device in the social network, so that the second network device can publish the first group message to the first social user as the first social user. A conversation group.
  2. 根据权利要求1所述的方法,其中,所述确定所述第一参会人员在社交网络中对应的第一社交用户,包括:The method according to claim 1, wherein the determining the first social user corresponding to the first conference participant in the social network comprises:
    根据所述用户设备对应的用户标识信息,或者通过对所述会议语音消息进行声纹频谱分析,确定所述第一参会人员;Determine the first conference participant according to the user identification information corresponding to the user equipment or by performing voiceprint spectrum analysis on the conference voice message;
    确定所述第一参会人员在社交网络中对应的第一社交用户,其中所述第一社交用户中的社交用户与所述第一参会人员中的参会人员一一对应。A first social user corresponding to the first conference participant in the social network is determined, wherein the social user in the first social user is in one-to-one correspondence with the conference participant in the first conference participant.
  3. 根据权利要求2所述的方法,其中,所述根据所述用户设备对应的用户标识信息,或者通过对所述会议语音消息进行声纹频谱分析,确定所述第一参会人员包括:The method according to claim 2, wherein the determining the first conference participant according to the user identification information corresponding to the user equipment or by performing voiceprint spectrum analysis on the conference voice message comprises:
    检测所述会议语音消息是否满足频谱分析触发条件;Detecting whether the conference voice message satisfies the spectrum analysis trigger condition;
    若是,通过对所述会议语音消息进行声纹频谱分析确定所述第一参会人员;否则,根据所述用户设备对应的用户标识信息确定所述第一参会人员。If yes, the first conference participant is determined by performing voiceprint spectrum analysis on the conference voice message; otherwise, the first conference participant is determined according to the user identification information corresponding to the user equipment.
  4. 根据权利要求3所述的方法,其中,所述通过对所述会议语音消息进行声纹频谱分析确定所述第一参会人员,包括:The method according to claim 3, wherein the determining the first conference participant by performing voiceprint spectrum analysis on the conference voice message comprises:
    对所述会议语音消息进行声纹频谱分析以确定所述会议语音消息中是否仅包含单人语音;Perform voiceprint spectrum analysis on the conference voice message to determine whether the conference voice message contains only a single voice;
    若是,根据所述会议语音消息对应的频谱特征信息,确定所述第一参会人员;否则,将所述会议语音消息按声纹频谱特征分解为多条子语音信息,其中每条子语音信息仅包含单人语音,所述多条子语音信息分别对应于第一会议中的不同参会人员,并将所述多 条子语音信息对应的多个参会人员确定为在所述第一会议中产生所述会议语音消息的第一参会人员。If so, determine the first conference participant according to the spectral feature information corresponding to the conference voice message; otherwise, decompose the conference voice message into multiple pieces of sub-voice information according to the voiceprint spectral features, wherein each piece of sub-voice information only contains single-person voice, the multiple pieces of sub-voice information correspond to different participants in the first conference respectively, and the multiple participants corresponding to the multiple pieces of sub-voice information are determined to be generated in the first conference The first participant of the conference voice message.
  5. 根据权利要求3或4所述的方法,其中,所述频谱分析触发条件包括以下至少任一项:The method according to claim 3 or 4, wherein the spectrum analysis trigger condition comprises at least any one of the following:
    所述第一会议为线下会议;The first meeting is an offline meeting;
    所述用户设备对应于多个用户标识信息;the user equipment corresponds to a plurality of user identification information;
    所述用户设备为公用设备或者未绑定用户标识信息。The user equipment is public equipment or unbound user identification information.
  6. 根据权利要求1至5中任一项所述的方法,其中,所述方法还包括:The method of any one of claims 1 to 5, wherein the method further comprises:
    确定所述会议语音消息对应的第一群消息。A first group message corresponding to the conference voice message is determined.
  7. 根据权利要求6所述的方法,其中,所述确定所述会议语音消息对应的第一群消息包括:The method according to claim 6, wherein the determining the first group message corresponding to the conference voice message comprises:
    若所述会议语音消息中包含多人语音,根据多条子语音信息生成所述会议语音消息对应的第一群消息,其中,所述第一群消息包括多条第一子群消息,所述多条第一子群消息一一对应于所述多条子语音信息,所述多条子语音信息是由所述会议语音消息按声纹频谱特征分解所得的、且每条子语音信息仅包含单人语音。If the conference voice message includes multiple voices, a first group message corresponding to the conference voice message is generated according to multiple pieces of sub-voice information, where the first group message includes multiple first subgroup messages, and the multiple The first sub-group messages correspond to the multiple pieces of sub-voice information one by one, the multiple pieces of sub-voice information are obtained by decomposing the conference voice message according to the voiceprint spectrum feature, and each piece of sub-voice information only contains a single voice.
  8. 根据权利要求7所述的方法,其中,所述第一群同步请求还包括所述第一群消息中各第一子群消息与所述第一社交用户中社交用户的映射关系。The method according to claim 7, wherein the first group synchronization request further comprises a mapping relationship between each first subgroup message in the first group message and a social user in the first social user.
  9. 根据权利要求8所述的方法,其中,所述第一群同步请求还包括所述多条第一子群消息的顺序关系,所述顺序关系是基于所述第一子群消息对应的所述子语音信息在所述会议语音信息中起始顺序确定的。The method according to claim 8, wherein the first group synchronization request further comprises a sequence relationship of the plurality of first subgroup messages, the sequence relationship being based on the The starting sequence of the sub-voice information in the conference voice information is determined.
  10. 根据权利要求1至9中任一项所述的方法,其中,所述方法还包括:The method of any one of claims 1 to 9, wherein the method further comprises:
    接收所述第二网络设备发送的第二群同步请求,其中,所述第二群同步请求包括所述第二群消息对应的第二会议消息、所述第一会议的会议标识信息;receiving a second group synchronization request sent by the second network device, wherein the second group synchronization request includes a second conference message corresponding to the second group message and conference identification information of the first conference;
    在所述第一会议中呈现所述第二会议消息。The second conference message is presented in the first conference.
  11. 一种在第二网络设备端实现会议消息同步的方法,其中,所述方法包括:A method for realizing conference message synchronization at a second network device, wherein the method includes:
    接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;Receive a first group synchronization request sent by the first network device, wherein the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first conference participant in the social network, and the first group synchronization request. A first conversation group corresponding to a conference in the social network, and the first conference participant generates the conference voice message in the first conference;
    响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。In response to the first group synchronization request, the first group message is posted to the first conversation group as the first social user.
  12. 根据权利要求11所述的方法,其中,所述第一社交用户包括多个社交用户,所述第一群消息包括多条第一子群消息,每条第一子群消息对应于所述第一社交用户中的一个用户;The method of claim 11, wherein the first social user comprises a plurality of social users, the first group message comprises a plurality of first subgroup messages, and each first subgroup message corresponds to the first subgroup message a user of a social user;
    所述响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群包括:The publishing the first group message to the first conversation group as the first social user in response to the first group synchronization request includes:
    响应于所述第一群同步请求,将所述多条第一子群消息中各第一子群消息分别以该第一子群消息在所述第一社交用户中对应社交用户的身份发送至所述第一会话群。In response to the first group synchronization request, each first subgroup message in the plurality of first subgroup messages is respectively sent to the first subgroup message as the identity of the corresponding social user in the first social user. the first conversation group.
  13. 根据权利要求12所述的方法,其中,所述第一群同步请求还包括所述多条第一子群消息的顺序关系;The method according to claim 12, wherein the first group synchronization request further comprises a sequence relationship of the plurality of first subgroup messages;
    所述响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群包括:The publishing the first group message to the first conversation group as the first social user in response to the first group synchronization request includes:
    响应于所述第一群同步请求,按照所述顺序关系将所述多条第一子群消息中各第一子群消息分别以该第一子群消息在所述第一社交用户中对应社交用户的身份发送至所述第一会话群。In response to the first group synchronization request, according to the sequence relationship, each first subgroup message in the plurality of first subgroup messages corresponds to the first subgroup message in the first social user with the first subgroup message. The identity of the user is sent to the first conversation group.
  14. 根据权利要求11至13中任一项所述的方法,其中,所述响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群包括:The method according to any one of claims 11 to 13, wherein, in response to the first group synchronization request, the first group message is published in the first group message as the first social user A conversation group includes:
    响应于所述第一群同步请求,若所述第一社交用户已参与所述第一会话群,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群;否则,将所述第一群消息以所述第一会议对应的第一社交机器人的身份发送至所述第一会话群。In response to the first group synchronization request, if the first social user has participated in the first conversation group, publishing the first group message in the first conversation group as the first social user ; otherwise, send the first group message to the first conversation group in the identity of the first social robot corresponding to the first conference.
  15. 根据权利要求14所述的方法,其中,所述方法还包括:The method of claim 14, wherein the method further comprises:
    若所述第一社交用户尚未加入所述第一会话群,将所述第一社交用户添加至所述第一会话群。If the first social user has not joined the first conversation group, adding the first social user to the first conversation group.
  16. 根据权利要求14或15所述的方法,其中,所述方法还包括:The method of claim 14 or 15, wherein the method further comprises:
    接收所述第一会话群中第二群用户发送给所述第一会议的第二群消息;receiving a second group message sent by a second group user in the first conversation group to the first conference;
    根据所述第二群消息生成待发送至所述第一网络设备的第二群同步请求,其中,所述第二群同步请求包括所述第二群消息对应的第二会议消息,以及基于所述第一会议确定的所述第一会议的会议标识信息;A second group synchronization request to be sent to the first network device is generated according to the second group message, wherein the second group synchronization request includes a second conference message corresponding to the second group message, and is based on the second group synchronization request. meeting identification information of the first meeting determined by the first meeting;
    将所述第二群同步请求发送至所述第一网络设备,以供在所述第一会议中呈现所述第二会议消息。The second group synchronization request is sent to the first network device for presentation of the second conference message in the first conference.
  17. 一种实现会议消息同步的方法,其中,所述方法包括:A method for realizing conference message synchronization, wherein the method comprises:
    第一网络设备接收第一会议中用户设备发送的会议语音消息,其中第一参会人员在所述第一会议中产生所述会议语音消息;响应于所述会议语音消息,确定所述第一参会人员在社交网络中对应的第一社交用户,并生成待发送至所述社交网络的第一群同步请求,其中,所述第一群同步请求包括所述第一社交用户、所述会议语音消息对应的第一群消息,以及所述第一会议在所述社交网络中对应的第一会话群;将所述第一群同步请求发送至所述社交网络中的第二网络设备;The first network device receives the conference voice message sent by the user equipment in the first conference, wherein the first conference participant generates the conference voice message in the first conference; and determines the first conference voice message in response to the conference voice message The first social user corresponding to the participant in the social network, and generates a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, the conference a first group message corresponding to the voice message, and a first conversation group corresponding to the first conference in the social network; sending the first group synchronization request to a second network device in the social network;
    第二网络设备接收第一网络设备发送的第一群同步请求,其中所述第一群同步请求包括会议语音消息对应的第一群消息、第一参会人员在社交网络中对应的第一社交用户,以及第一会议在所述社交网络中对应的第一会话群,所述第一参会人员在所述第一会议中产生所述会议语音消息;响应于所述第一群同步请求,将所述第一群消息以所述第一社交用户的身份发布于所述第一会话群。The second network device receives the first group synchronization request sent by the first network device, wherein the first group synchronization request includes the first group message corresponding to the conference voice message, the first social network corresponding to the first conference participant in the social network a user, and a first conversation group corresponding to the first conference in the social network, where the first conference participant generates the conference voice message in the first conference; in response to the first group synchronization request, Posting the first group message to the first conversation group as the first social user.
  18. 一种实现会议消息同步的设备,其特征在于,所述设备包括:A device for realizing conference message synchronization, characterized in that the device includes:
    处理器,以及processor, and
    被安排成存储计算机可执行指令的存储器,所述可执行指令在被执行时使所述处理器执行如权利要求1至16中任一项所述的方法。a memory arranged to store computer-executable instructions which, when executed, cause the processor to perform a method as claimed in any of claims 1 to 16.
  19. 一种存储指令的计算机可读介质,所述指令在被计算机执行时使得所述计算机进行如权利要求1至16中任一项所述方法的操作。A computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform the operation of the method of any one of claims 1 to 16.
  20. 一种计算机程序产品,包括计算机程序,其特征在于,该计算机程序被处理器执行时实现如权利要求1至16中任一项所述方法的步骤。A computer program product, comprising a computer program, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.
PCT/CN2021/133440 2020-12-29 2021-11-26 Method and device for realizing conference message synchronization WO2022142912A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011592032.7A CN112751683B (en) 2020-12-29 2020-12-29 Method and equipment for realizing conference message synchronization
CN202011592032.7 2020-12-29

Publications (1)

Publication Number Publication Date
WO2022142912A1 true WO2022142912A1 (en) 2022-07-07

Family

ID=75646692

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/133440 WO2022142912A1 (en) 2020-12-29 2021-11-26 Method and device for realizing conference message synchronization

Country Status (2)

Country Link
CN (1) CN112751683B (en)
WO (1) WO2022142912A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112751683B (en) * 2020-12-29 2022-12-30 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization
CN112822161B (en) * 2020-12-29 2022-12-30 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546464A (en) * 2011-12-22 2012-07-04 华为技术有限公司 Conference method and conference system crossing instant messaging (IM) system
CN102572372A (en) * 2011-12-28 2012-07-11 中兴通讯股份有限公司 Extraction method and device for conference summary
US20150067026A1 (en) * 2013-08-30 2015-03-05 Citrix Systems, Inc. Acquiring online meeting data relating to an online meeting
CN107911646A (en) * 2016-09-30 2018-04-13 阿里巴巴集团控股有限公司 The method and device of minutes is shared, is generated in a kind of meeting
CN112751683A (en) * 2020-12-29 2021-05-04 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization
CN112822161A (en) * 2020-12-29 2021-05-18 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080281971A1 (en) * 2007-05-07 2008-11-13 Nokia Corporation Network multimedia communication using multiple devices
CN104469691B (en) * 2013-09-25 2018-04-17 电信科学技术研究院 A kind of group communication method, equipment and system
CN105338287B (en) * 2015-10-30 2019-06-14 华为技术有限公司 A kind of control method and device of video conference
US9413700B1 (en) * 2015-12-09 2016-08-09 International Business Machines Corporation Operating a group chat session
US10157614B1 (en) * 2016-12-28 2018-12-18 Amazon Technologies, Inc. Message playback using a shared device
CN206728037U (en) * 2017-05-22 2017-12-08 广东工业大学 It is a kind of can disaster tolerance conference system
CN109391850B (en) * 2017-08-02 2021-06-18 腾讯科技(深圳)有限公司 Method, device and storage medium for interacting messages in video page
CN110139062B (en) * 2019-05-09 2022-10-18 平安科技(深圳)有限公司 Video conference record creating method and device and terminal equipment
CN110519153A (en) * 2019-08-15 2019-11-29 连尚(新昌)网络科技有限公司 A kind of method and apparatus sending group session message

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546464A (en) * 2011-12-22 2012-07-04 华为技术有限公司 Conference method and conference system crossing instant messaging (IM) system
CN102572372A (en) * 2011-12-28 2012-07-11 中兴通讯股份有限公司 Extraction method and device for conference summary
US20150067026A1 (en) * 2013-08-30 2015-03-05 Citrix Systems, Inc. Acquiring online meeting data relating to an online meeting
CN107911646A (en) * 2016-09-30 2018-04-13 阿里巴巴集团控股有限公司 The method and device of minutes is shared, is generated in a kind of meeting
CN112751683A (en) * 2020-12-29 2021-05-04 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization
CN112822161A (en) * 2020-12-29 2021-05-18 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization

Also Published As

Publication number Publication date
CN112751683B (en) 2022-12-30
CN112751683A (en) 2021-05-04

Similar Documents

Publication Publication Date Title
WO2022142913A1 (en) Method and device for implementing conference message synchronization
WO2022142912A1 (en) Method and device for realizing conference message synchronization
US9082413B2 (en) Electronic transaction authentication based on sound proximity
WO2018019262A1 (en) Cloud desktop system, cloud desktop, cloud terminal, and multicast method
CN105940657A (en) Lead implantation method
US8929529B2 (en) Managing voice collision in multi-party communications
US10699709B2 (en) Conference call analysis and automated information exchange
US10785270B2 (en) Identifying or creating social network groups of interest to attendees based on cognitive analysis of voice communications
WO2022142619A1 (en) Method and device for private audio or video call
WO2020156524A1 (en) Method and device for determining rescue team information
CN110519153A (en) A kind of method and apparatus sending group session message
WO2022068640A1 (en) Method and device for broadcasting voice information in multi-user voice call
WO2022142504A1 (en) Meeting group merging method and device
US11949677B2 (en) Resource access based on audio signal
WO2020221195A1 (en) Method and device for publishing dynamic information
US11477296B2 (en) Dynamic user group management in group-based communication systems
US11316867B2 (en) Generated audio signal granting access to resource
US10834543B2 (en) Creating a social group with mobile phone vibration
US10075480B2 (en) Notification bot for topics of interest on voice communication devices
CN115499406B (en) Method, equipment and medium for generating community business card
US11632473B2 (en) Dynamic notification tone modification
US20210058380A1 (en) Message security
Chaudhry Scalable Communication Frameworks for Multi-Agency Data Sharing
TW202109277A (en) Screen projection method and apparatus returning, by the server, screen projection information for the screen projection terminal to the user device
CN115914162A (en) Method, apparatus, medium and program product for providing group status

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21913654

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 22/08/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21913654

Country of ref document: EP

Kind code of ref document: A1