CN112751683A - Method and equipment for realizing conference message synchronization - Google Patents

Method and equipment for realizing conference message synchronization Download PDF

Info

Publication number
CN112751683A
CN112751683A CN202011592032.7A CN202011592032A CN112751683A CN 112751683 A CN112751683 A CN 112751683A CN 202011592032 A CN202011592032 A CN 202011592032A CN 112751683 A CN112751683 A CN 112751683A
Authority
CN
China
Prior art keywords
conference
group
message
social
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011592032.7A
Other languages
Chinese (zh)
Other versions
CN112751683B (en
Inventor
程翰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Zhangmen Science and Technology Co Ltd
Original Assignee
Shanghai Zhangmen Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Zhangmen Science and Technology Co Ltd filed Critical Shanghai Zhangmen Science and Technology Co Ltd
Priority to CN202011592032.7A priority Critical patent/CN112751683B/en
Publication of CN112751683A publication Critical patent/CN112751683A/en
Priority to PCT/CN2021/133440 priority patent/WO2022142912A1/en
Application granted granted Critical
Publication of CN112751683B publication Critical patent/CN112751683B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/185Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with management of multicast group membership
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046Interoperability with other network applications or services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

The purpose of the application is to provide a method and a device for realizing conference message synchronization, wherein the method comprises the following steps: receiving a conference voice message sent by user equipment; determining a corresponding first social user and generating a first group synchronization request; the first group synchronization request is sent to the second network device for the second network device to publish the first group message to the first session group with the identity of the first social user. The method and the system have the advantages that the conference information is synchronized in real time through the social network, so that users who are inconvenient to directly participate in the conference or have multiple conferences to participate simultaneously can obtain the conference information in real time through the conversation group, the delay of acquiring the conference information is avoided, and the time utilization rate of the users is improved; the conference content can be recorded through the session group, so that the user can conveniently review the conference content, the social service function is expanded, and the user experience is improved; and the conference server determines the corresponding relation between the participating users and the social users, and can promote the mutual understanding between the participating users and be beneficial to the communication between the participating users.

Description

Method and equipment for realizing conference message synchronization
Technical Field
The present application relates to the field of communications, and in particular, to a technique for synchronizing conference messages.
Background
With the development of the internet, more and more companies or enterprises communicate and coordinate services through web conferences. The participants in the network conference can break through the limitation of regions and realize the face-to-face communication effect through the internet.
Disclosure of Invention
An object of the present application is to provide a method and apparatus for implementing conference message synchronization.
According to an aspect of the present application, there is provided a method for implementing conference message synchronization at a first network device, the method including:
receiving a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference;
responding to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, wherein the first group synchronization request comprises the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network;
sending the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
According to another aspect of the present application, there is provided a method for implementing conference message synchronization at a second network device, the method including:
receiving a first group synchronization request sent by a first network device, wherein the first group synchronization request comprises a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference;
in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user.
According to another aspect of the present application, there is provided a method for implementing conference message synchronization, the method including:
a first network device receives a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference; responding to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, wherein the first group synchronization request comprises the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network; sending the first group synchronization request to a second network device in the social network;
the method comprises the steps that a second network device receives a first group synchronization request sent by a first network device, wherein the first group synchronization request comprises a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference; in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user.
According to an aspect of the present application, there is provided an apparatus for implementing conference message synchronization, the apparatus comprising:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to:
receiving a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference;
responding to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, wherein the first group synchronization request comprises the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network;
sending the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
According to another aspect of the present application, there is provided an apparatus for implementing conference message synchronization, the apparatus comprising:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to:
receiving a first group synchronization request sent by a first network device, wherein the first group synchronization request comprises a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference;
in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user.
According to one aspect of the application, there is provided a computer-readable medium storing instructions that, when executed, cause a system to:
receiving a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference;
responding to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, wherein the first group synchronization request comprises the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network;
sending the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
According to another aspect of the application, there is provided a computer-readable medium storing instructions that, when executed, cause a system to:
receiving a first group synchronization request sent by a first network device, wherein the first group synchronization request comprises a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference;
in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user.
According to an aspect of the application, there is provided a computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the steps of the method of:
receiving a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference;
responding to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, wherein the first group synchronization request comprises the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network;
sending the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
According to an aspect of the application, there is provided a computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the steps of the method of:
receiving a first group synchronization request sent by a first network device, wherein the first group synchronization request comprises a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference;
in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user.
According to an aspect of the present application, there is provided a first network device for implementing conference message synchronization, the first network device comprising:
a module, configured to receive a conference voice message sent by a user equipment in a first conference, where a first participant generates the conference voice message in the first conference;
a second module, configured to determine, in response to the conference voice message, a first social user corresponding to the first participant in a social network, and generate a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network;
a third module for sending the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
According to another aspect of the present application, there is provided a second network device for implementing conference message synchronization, the second network device comprising:
a first module, configured to receive a first group synchronization request sent by a first network device, where the first group synchronization request includes a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference;
means for issuing the first group message to the first session group in an identity of the first social user in response to the first group synchronization request.
Compared with the prior art, the conference voice message is received through the first network device, the corresponding first social contact user is determined based on the conference voice message, the first group synchronization request is generated and sent to the second network device, wherein the first group synchronization request comprises the first social contact user, the first group message corresponding to the conference voice message, and the first conference corresponding to the first session group in the social network. Posting, by a second network device, the first group message to the first session group in the identity of the first social user. According to the conference information synchronization method and device, based on the corresponding relation between the conference participating users and the social contact users, the conference information is synchronized in real time through the social network, so that the users who are inconvenient to directly participate in the conference or have multiple conferences to participate simultaneously can obtain the conference information in real time through the conversation group, the delay of acquiring the conference information is avoided, and the time utilization rate of the users is improved; conference content can be recorded through a session group, so that a user can conveniently review the conference content, the social service function is expanded, and the user experience is improved; and the conference server determines the corresponding relation between the participating users and the social users, and can promote the mutual understanding between the participating users and be beneficial to the communication between the participating users.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 illustrates a system topology according to one embodiment of the present application;
fig. 2 is a flowchart illustrating a method for synchronizing conference messages at a first network device according to an embodiment of the present application;
fig. 3 is a flowchart illustrating a method for synchronizing conference messages at a second network device according to an embodiment of the present application;
FIG. 4 illustrates a user interface diagram for implementing conference message synchronization according to one embodiment of the present application;
FIG. 5 illustrates a flow diagram of a method of implementing conference message synchronization according to one embodiment of the present application;
FIG. 6 is a diagram illustrating a first network device architecture for implementing conference message synchronization according to one embodiment of the present application;
FIG. 7 is a diagram illustrating a second network device architecture for implementing conference message synchronization according to one embodiment of the present application;
FIG. 8 illustrates an exemplary system that can be used to implement the various embodiments described in this application.
The same or similar reference numbers in the drawings identify the same or similar elements.
Detailed Description
The present application is described in further detail below with reference to the attached figures.
In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party each include one or more processors (e.g., Central Processing Units (CPUs)), input/output interfaces, network interfaces, and memory.
The Memory may include volatile Memory in a computer readable medium, Random Access Memory (RAM), and/or nonvolatile Memory such as Read Only Memory (ROM) or Flash Memory. Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, Phase-Change Memory (PCM), Programmable Random Access Memory (PRAM), Static Random-Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), electrically Erasable Programmable Read-Only Memory (EEPROM), flash Memory or other Memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device.
The device referred to in this application includes, but is not limited to, a user device, a network device, or a device formed by integrating a user device and a network device through a network. The user equipment includes, but is not limited to, any mobile electronic product, such as a smart phone, a tablet computer, etc., capable of performing human-computer interaction with a user (e.g., human-computer interaction through a touch panel), and the mobile electronic product may employ any operating system, such as an Android operating system, an iOS operating system, etc. The network Device includes an electronic Device capable of automatically performing numerical calculation and information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded Device, and the like. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud of a plurality of servers; here, the Cloud is composed of a large number of computers or web servers based on Cloud Computing (Cloud Computing), which is a kind of distributed Computing, one virtual supercomputer consisting of a collection of loosely coupled computers. Including, but not limited to, the internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless Ad Hoc network (Ad Hoc network), etc. Preferably, the device may also be a program running on the user device, the network device, or a device formed by integrating the user device and the network device, the touch terminal, or the network device and the touch terminal through a network.
Of course, those skilled in the art will appreciate that the foregoing is by way of example only, and that other existing or future devices, which may be suitable for use in the present application, are also encompassed within the scope of the present application and are hereby incorporated by reference.
In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
Fig. 1 illustrates a system topology for implementing conference message synchronization according to one embodiment of the present application. The system topology map includes a user device, a first network device, and a second network device. And the user equipment acquires the conference voice message of the participant in the first conference and sends the conference voice message to the first network equipment. The first network equipment generates a first group synchronization request according to the conference voice message and sends the first group synchronization request to the second network equipment, wherein the first group synchronization request comprises a first social user corresponding to the conference voice message, a first group message and a first session group corresponding to the first conference in the social network. The second network device publishes the first group message to the first session group with an identity of the first social user according to the first group synchronization request. Here, the user device includes a smart phone, a tablet computer, a microphone, and the like, which can be used to acquire user voice information. The first network device is a conference server. The second network device is a social server, and the first network device and the second network device may be network devices respectively corresponding to different applications or systems (e.g., a first network device corresponding to a conference application, a second network device corresponding to a social application), and may also be network devices performing different functions in the same application or system (e.g., a first network device for providing a conference service and a second network device for providing a social service in an application). The first network device and the second network device are relatively independent and can perform data intercommunication. And the first social user is the corresponding social identity information of the participant who generates the conference voice message in the social server. The first session group may include all or some of the social users corresponding to the participants participating in the conference. Group messages from different conferences may be issued simultaneously in the first talk group, i.e. a synchronization of conference messages of multiple conferences may be performed in the first talk group. The system synchronizes the conference information in real time through the social network, helps users who are inconvenient to directly participate in the conference or have a plurality of conferences to participate simultaneously to acquire the conference information in real time through the conversation group, avoids the delay of acquiring the conference information, and improves the time utilization rate of the users; the conference content can be recorded through the session group, so that the user can conveniently review the conference content, the social service function is expanded, and the user experience is improved; and the conference server determines the corresponding relation between the participating users and the social users, and can promote the mutual understanding between the participating users and be beneficial to the communication between the participating users.
Referring to the system shown in fig. 1, fig. 2 is a flowchart illustrating a method for synchronizing conference messages at a first network device according to an embodiment of the present application, where the method includes steps S11, S12, and S13. In step S11, the first network device receives a conference voice message sent by a user device in a first conference, where the conference voice message is generated by a first participant in the first conference; in step S12, in response to the conference voice message, the first network device determines a first social user corresponding to the first participant in a social network, and generates a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network; in step S13, the first network device sends the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
In step S11, the first network device receives a conference voice message sent by the user device in the first conference, where the conference voice message is generated by the first participant in the first conference. For example, in an online conference, a participating user "zhang san" joins a first conference through his mobile phone or computer, and sends a conference voice message to a first network device through his device. For another example, in an online conference, a conference voice message is acquired by a microphone device assigned to "zhang san" of a participating user and sent to a first network device. In particular, the microphone device assigned to "zhang san" may also be assigned to other participating users, that is, there is a case where conference voice messages of a plurality of participating users are acquired by the same user device in the first conference, where the conference voice message received by the first network device may include a single person voice or a plurality of persons voice.
In step S12, in response to the conference voice message, the first network device determines a first social user corresponding to the first participant in a social network, and generates a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network.
In some embodiments, the first group synchronization request further includes conference identification information for the first conference. The conference identification information of the first conference is used for helping the second network equipment receiving the first group synchronization request to distinguish the conference corresponding to each group message.
In some embodiments, the first network device determines the corresponding first social user according to the conference voice message or user device identification information corresponding to the user device. For example, a first social user matching the voiceprint spectrum feature is determined according to the voiceprint spectrum feature corresponding to the conference voice message. For another example, if the participating user uses information consistent with the user device identification information (for example, the MAC address and the mobile phone number of the device can uniquely distinguish the device from the identification information of other devices) to register in the social network, the corresponding first social user may be queried and determined according to the user device identification information. Here, the first network device may store a mapping relationship between the social user and the voiceprint spectrum feature or the user equipment identification information, which is obtained from the social server.
In some embodiments, if the social user identity corresponding to the participant in the social network is not successfully determined according to the conference voice message or the user equipment identification information corresponding to the user equipment, the first network equipment allocates a social user identification to the participant. The first social user comprises the social user identification, and the social user identification is used for identifying the identity of the first participant of the undetermined corresponding social user in the social network. For example, if the participant "Zhang three" does not use the social network, it may be temporarily assigned a social name (e.g., "meeting user 1") as its identification in the social network to distinguish it from other users.
In some embodiments, the first network device determines a corresponding first session group of the first conference in the social network according to the association information corresponding to the conference voice message. The associated information includes, but is not limited to, an associated conference voice message, conference identification information corresponding to the first conference, and user equipment identification information. For example, the first network device determines the first session group according to a session group corresponding to an associated conference voice message of the same conference as the conference voice message. For another example, the first network device determines, according to the conference identification information corresponding to the conference voice message, a first session group that matches the conference identification information. For example, the first network device determines, according to the user device identification information, a first social user matched with the user device identification information, and then determines, according to the first social user, a corresponding first session group.
In some embodiments, the first group message includes, but is not limited to, a conference voice message, text information converted from a conference voice message. In some embodiments, if the conference voice message includes a multi-person voice, the first group message includes, but is not limited to, a plurality of pieces of sub-voice information of the conference voice message decomposed based on a voiceprint spectrum feature, and sub-text information converted from the sub-voice information.
In step S13, the first network device sends the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
In some embodiments, the first network device sends the first group synchronization request to a second network device in the social network, and if the first social user exists in the social network, the second network device posts the first group message to the first session group in the identity of the first social user; otherwise, the second network device tags and publishes the first group message to the first session group with the first social identification.
In some embodiments, the determining the first social user corresponding to the first participant in the social network includes: step S121 (not shown), the first network device determines the first participant according to the user identification information corresponding to the user device, or by performing voiceprint spectrum analysis on the conference voice message; step S122 (not shown), the first network device determines a first social user corresponding to the first participant in the social network, where social users of the first social user are in one-to-one correspondence with participants of the first participant.
In some embodiments, the first participant comprises one or more participants that collectively generate the conference voice message in the first conference. The participant corresponds to the identity information of the user participating in the first conference in the conference server, for example, the name information used by the user participating in the first conference in the conference server. In some embodiments, the user device is bound with one or more pieces of user identification information, the user identification information corresponds to the participant, and the corresponding participant can be determined according to the one or more pieces of user identification information corresponding to the user device. In some embodiments, the first network device determines spectral feature information corresponding to a conference voice message by performing voiceprint spectral analysis on the conference voice message. And the first network equipment determines the first participant matched with the frequency spectrum characteristic information according to the acquired frequency spectrum characteristic information. In some embodiments, the spectral feature information includes a plurality of voiceprint spectral features, each voiceprint spectrum corresponding to one of the first participants.
In some embodiments, the first network device stores a mapping relationship between the participant and the social user. And the first network equipment determines a first social user corresponding to the first participant in the social network according to the mapping relation between the participant and the social user.
In some embodiments, the first network device may store a mapping relationship between the social users obtained from the social server and the voiceprint spectrum feature or the user device identification information. The user equipment identification information is identification information which can uniquely distinguish the equipment from other equipment, such as the MAC address, the mobile phone number and the like of the equipment. And the first network equipment determines a first social user matched with the voiceprint spectrum characteristic according to the voiceprint spectrum characteristic corresponding to the conference voice message. Or the first network device queries and determines the corresponding first social user according to the user device identification information, for example, if the participating users register in the conference server and the social server with the same mobile phone number, the conference server may query the social user information in the conference server according to the mobile phone number. In some embodiments, the first network device stores the determined correspondence of the first participant with the first social user in a database for use in subsequent query matching.
In some embodiments, the step S121 includes: the first network equipment detects whether the conference voice message meets a spectrum analysis triggering condition; if so, determining the first participant by performing voiceprint spectrum analysis on the conference voice message; otherwise, determining the first participant according to the user identification information corresponding to the user equipment. For example, in a conference, there may be a case where a plurality of persons use the same user equipment (for example, a participant uses the same microphone to speak in a conference room, or a plurality of persons use the same computer to perform a teleconference) or the user equipment does not have a fixed use object (for example, user equipment in a public conference room), and it is difficult to determine the corresponding participant only by the user equipment, so that the corresponding participant is determined by performing voiceprint spectrum analysis on a conference voice message. Otherwise, the first network device determines the first participant according to the user identification information or the user equipment identification information corresponding to the user equipment.
In some embodiments, the determining the first participant by voiceprint spectral analysis of the conference voice message comprises: the first network equipment performs voiceprint spectrum analysis on the conference voice message to determine whether the conference voice message only contains single voice; if so, determining the first participant according to the frequency spectrum characteristic information corresponding to the conference voice message; otherwise, the conference voice message is decomposed into a plurality of pieces of sub-voice information according to the voiceprint spectrum characteristics, wherein each piece of sub-voice information only contains single voice, the plurality of pieces of sub-voice information respectively correspond to different participants in a first conference, and the plurality of participants corresponding to the plurality of pieces of sub-voice information are determined as the first participants generating the conference voice message in the first conference.
In some embodiments, the first network device performs voiceprint spectrum analysis on the conference voice message to determine whether the spectrum feature information corresponding to the conference voice message only contains one voiceprint spectrum feature, and if so, the first network device directly determines the corresponding first participant according to the spectrum feature information. Otherwise, the first network device decomposes the conference voice message based on the time domain or the frequency domain to obtain a plurality of pieces of sub-voice information corresponding to different participants in the first conference. In some embodiments, the decomposing the conference voice message into a plurality of pieces of sub-voice information according to a voiceprint spectrum includes: the method comprises the steps that a first network device cuts conference voice messages into a plurality of voice units according to preset cutting lengths, voiceprint spectrum characteristics corresponding to the voice units are obtained, the voice units with matching values among the voiceprint spectrum characteristics higher than preset matching threshold values in the voice units are stored in the same voice set, and all the voice units in the same voice set are spliced to be used as sub-voice information. And the first network equipment determines a plurality of corresponding participants according to the spectrum characteristic information corresponding to the sub-voice messages, and determines a corresponding first participant according to the participants.
It should be understood by those skilled in the art that the above method for decomposing a conference voice message containing voiceprint spectrum information of a plurality of persons is only an example, and other existing or subsequent methods that may be used for decomposing a conference voice message containing voiceprint spectrum information of a plurality of persons, as applicable to this embodiment, should be included in the scope of protection of this embodiment, and are hereby incorporated by reference.
In some embodiments, the spectrum analysis trigger condition comprises at least any one of: the first conference is an offline conference; the user equipment corresponds to a plurality of user identification information; the user equipment is public equipment or unbound user identification information.
For example, considering that the user devices used in the offline conference may not correspond to the participants one to one, if the first network device determines that the first conference is the offline conference according to the conference type information, the first participant corresponding to the conference voice message of the conference is determined through voiceprint spectrum analysis. For another example, the notebook computer 1 is a conference-dedicated computer for the user a and the user b, and the notebook computer 1 binds the user identification information of the two persons in the conference server. When the conference server obtains the conference voice message through the notebook computer 1, the participant cannot be accurately determined only according to the user identification information, and the participant needs to be determined through voiceprint spectrum analysis. For example, the conference participants use devices in a public conference room, and if the user identification information is not bound, the user devices cannot provide information for identifying the conference participants, so the first network device needs to determine the first conference participant corresponding to the conference voice message of the conference through voiceprint spectrum analysis.
In some embodiments, the method further comprises: in step S14 (not shown), the first network device determines a first group message corresponding to the conference voice message. In some embodiments, the first network device performs voiceprint spectrum analysis on the conference voice message to determine whether spectrum feature information corresponding to the conference voice message only includes a voiceprint spectrum feature, and if so, the first network device uses the conference voice message or text information obtained by converting the conference voice message as a first group message; otherwise, the first network device decomposes the conference voice message according to the voiceprint spectrum characteristic to obtain a plurality of pieces of sub-voice information, and takes the plurality of pieces of sub-voice information or sub-text information obtained by converting the sub-voice information as a first group message.
In some embodiments, the step S14 includes: if the conference voice message contains multiple voices, generating a first group message corresponding to the conference voice message according to multiple pieces of sub-voice information, wherein the first group message comprises multiple first sub-group messages, the multiple first sub-group messages correspond to the multiple pieces of sub-voice information one by one, the multiple pieces of sub-voice information are obtained by decomposing the conference voice message according to the voiceprint spectrum characteristics, and each piece of sub-voice information only contains single voice.
Here, the sub-speech information is obtained in the same or substantially the same manner as the sub-speech information obtained in step S121, and therefore, the description is omitted here and is included herein by reference.
In some embodiments, the first network device generates one or more first subgroup messages from the plurality of pieces of sub-voice information according to a screening rule, and determines a first group message corresponding to the conference voice message according to the first subgroup message. The screening rules include at least any one of: (1) screening the sub-voice information of which the time length is greater than or equal to a preset time threshold; (2) screening sub-voice information which is matched with the participant and user identification information corresponding to the user equipment and corresponds to the sub-voice information; (3) and screening the sub-voice information corresponding to the sub-voice information with the sound intensity larger than or equal to the preset sound intensity threshold value. The screening rule (1) is used for eliminating short and unpractical voice information sent by the participants; the screening rule (2) is used for eliminating the voice information of the voice acquisition object of the non-user equipment so as to avoid repeated acquisition of the voice information; the filtering rule (3) is used for eliminating the voice information with smaller decibel so as to ensure that the voice information can be successfully converted into text information or the voice information can be recognized by a user. In some embodiments, the first subgroup message includes, but is not limited to, sub-voice information, sub-text information obtained by sub-voice information conversion.
In some embodiments, the first group synchronization request further includes a mapping of each of the first subgroup of messages to ones of the first social users.
In some embodiments, the first network device determines, according to the participant corresponding to the first subgroup of messages and the social user of the first social user corresponding to the participant, a mapping relationship between each first subgroup of messages in the first group of messages and the social user of the first social user. Here, the first subgroup messages correspond to social users in the first social users one to one, so as to ensure that the identities of the publishing users corresponding to each first subgroup message in the first group messages published by the second network device are accurate.
In some embodiments, the first group synchronization request further includes a sequential relationship of the plurality of first subgroup messages, the sequential relationship being determined based on an order in which the sub-voice information to which the first subgroup message corresponds is initiated in the conference voice information.
In some embodiments, the first network device sorts according to the starting position of the sub-voice information corresponding to the first sub-group message in the conference voice message; and taking the sequence relation corresponding to the plurality of pieces of sub voice information as the sequence relation of the first subgroup message. For example, the first group synchronization request includes three first subgroup messages: "speech 1", "speech 2" and "speech 3", wherein "speech 1" starts from 0 ' 15 "in the conference speech message," speech 2 "starts from 1 ' 27" in the conference speech message, and "speech 3" starts from 0 ' 58 "in the conference speech message, then the sequence relationship of these three first subgroup messages is: (1) "speech 1", (2) "speech 3", and (3) "speech 2". The sequence numbers (1), (2) and (3) are used for indicating the sequence of the first subgroup messages.
In some embodiments, the method further comprises step S15 (not shown): a first network device receives a second group synchronization request sent by a second network device, wherein the second group synchronization request comprises a second conference message corresponding to the second group message and conference identification information of the first conference; presenting the second conference message in the first conference.
In some embodiments, the second conference message includes, but is not limited to, text information, picture information, audio information, video information. And the first network equipment determines a first conference presenting the second conference message according to the conference identification information, and determines presentation equipment used for presenting the second conference message in the first conference according to the second conference message. The first network device sends the second conference message to the rendering device to render the second conference message in the first conference. For example, if the second conference message is text information, picture information or video information, the first network device may determine the display a in the first conference as the presentation device of the second conference message, and send the second conference message to the display a to present the second conference message. For another example, if the second conference message is voice information, the first network device may determine the speaker B in the first conference as the presentation device of the second conference message, and send the second conference message to the speaker B to play the second conference message.
Referring to the system shown in fig. 1, fig. 3 is a flowchart illustrating a method for implementing conference message synchronization at a second network device according to an embodiment of the present application, where the method includes steps S21 and S22. In step S21, the second network device receives a first group synchronization request sent by the first network device, where the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, where the first participant generates the conference voice message in the first conference; in step S22, in response to the first group synchronization request, the second network device posts the first group message to the first session group in the identity of the first social user.
In step S21, the second network device receives a first group synchronization request sent by the first network device, where the first group synchronization request includes a first group message corresponding to the conference voice message, a first social user corresponding to the first participant in the social network, and a first session group corresponding to the first conference in the social network, and the first participant generates the conference voice message in the first conference.
In some embodiments, the first group synchronization request further includes conference identification information for the first conference. And the second network equipment distinguishes the conference corresponding to each group of messages according to the conference identification information of the first conference. In some embodiments, the first social user includes a social user identification identifying the first participant who does not determine the identity of the corresponding social user in the social network. For example, if the participant "Zhang three" does not use the social network, it may be temporarily assigned a social name (e.g., "meeting user 1") as its identification in the social network to distinguish it from other users. In some embodiments, the first group message includes, but is not limited to, a conference voice message, text information converted from a conference voice message. In some embodiments, if the conference voice message includes a multi-person voice, the first group message includes, but is not limited to, a plurality of pieces of sub-voice information of the conference voice message decomposed based on a voiceprint spectrum feature, and sub-text information converted from the sub-voice information.
In step S22, in response to the first group synchronization request, the second network device posts the first group message to the first session group in the identity of the first social user.
In some embodiments, said posting said first group message to said first session group in the identity of said first social user comprises at least any one of: in a first mode, the first group message is published through a social account corresponding to a first social user; in a second mode, a first social robot is added to a first conversation group, and the first group message is sent through the first social robot, wherein the first group message is marked according to the identity of the first social user. In some embodiments, if the first social user includes a social user identifier, the second network device sends the group message of the participant corresponding to the social user identifier only in the foregoing manner two. For example, the participating user "zhangsan" does not have a corresponding social account in the social network, and the first network device assigns a corresponding social user identifier "zhangsan" to the participating user "zhangsan" and sends a corresponding group synchronization request to the second network device. The second network device adds the first social robot (robot 1 in the interface diagram shown in fig. 4) in the corresponding conversation group according to the group synchronization request. The second network device may send the first social robot a message directly after adding the social user identifier to the first group message (as shown in fig. 4 by sending the "first group message 1", and adding the social user identifier "zhangsan" to the group message), or may label the first group message sent to the first session group (as shown in fig. 4 by sending the "first group message 2", and add a message source prompt to the sent group message).
In some embodiments, the first social user comprises a plurality of social users, the first group of messages comprising a plurality of first subgroups of messages, each first subgroup of messages corresponding to one of the first social users; the step S22 includes: and responding to the first group synchronization request, and sending each first subgroup message in the plurality of first subgroup messages to the first session group by the second network equipment according to the identity of the social user corresponding to the first subgroup message in the first social user. In some embodiments, the sending each of the plurality of first subgroup messages to the first session group with the identity of the social user corresponding to the first subgroup message among the first social users comprises at least any one of: issuing each first subgroup message of the plurality of first subgroup messages to a social account of a corresponding social user of the first social users through the first subgroup message; adding a first social robot in a first session group, and sending each first subgroup message in the plurality of first subgroup messages through the first social robot respectively, wherein each first subgroup message corresponds to the identity tag of the social user in the first social user according to the first subgroup message.
In some embodiments, the first group synchronization request further comprises a sequential relationship of the plurality of first subgroup messages; the step S22 includes: and responding to the first group synchronization request, and sending each first subgroup message in the plurality of first subgroup messages to the first session group by the second network equipment according to the sequence relation by using the identity of the social user corresponding to the first subgroup message in the first social user. In some embodiments, the sequence relationship is determined by the first network device according to the sequence of the starting positions of the sub-voice information corresponding to the first subgroup message in the conference voice message. For example, the first group synchronization request includes three first subgroup messages: "speech 1", "speech 2" and "speech 3", wherein "speech 1" starts from 0 ' 15 "in the conference speech message," speech 2 "starts from 1 ' 27" in the conference speech message, and "speech 3" starts from 0 ' 58 "in the conference speech message, then the sequence relationship of these three first subgroup messages is: (1) "speech 1", (2) "speech 3", and (3) "speech 2". The second network device may sequentially transmit the three first subgroup messages in the order of "voice 1", "voice 3", and "voice 2" according to a preset message transmission time interval (e.g., 3 seconds). The second network equipment sends each first subgroup message according to the sequence relation, so that group members not participating in the first conference in the first session group can be helped to clear the time line of each message, and logic confusion caused by simultaneous sending of a plurality of messages is avoided.
In some embodiments, the step S22 includes: in response to the first group synchronization request, a second network device posts the first group message to the first session group in the identity of the first social user if the first social user has participated in the first session group; otherwise, the first group message is sent to the first session group with the identity of the first social robot corresponding to the first meeting. For example, in the first group synchronization request, the first social users are "zhangsan" and "liquad", and the first conversation group is "plan 1 group", wherein "zhangsan" in the first social users is not a group member of "plan 1 group". The second network device may send a first subgroup message corresponding to the first social user "lie four" to the "plan 1 group" in the identity of "lie four". Meanwhile, the second network device may add the social robot to "plan 1 group", send a first subgroup message corresponding to "zhang san" of the first social user through the social robot, and identify the first subgroup message using "zhang san". Here, the sending method of the first subgroup message is the same as or substantially the same as the sending method of the first subgroup message in step S22, and therefore, the description is omitted and is included herein by reference. In the embodiment, the second network device sends the group message corresponding to the social user through the social robot instead of the social user not in the first conversation group, so that the privacy and the safety of the social user and the conversation group are guaranteed while the message delivery is facilitated.
In some embodiments, the method further comprises step S23: adding the first social user to the first session group if the first social user has not joined the first session group. For example, for a first social user "zhang san" who does not join a first session group, the second network device may add the first social user "zhang san" to the group, and then publish a first group message corresponding to the first social user "zhang san" to the first session group in the identity of "zhang san". In this embodiment, the second network device adds the social user who does not join the first session group to the first session group, which facilitates the social user to continue to communicate with the user who does not participate in the first conference in the first session group even after the conference is finished.
In some embodiments, the method further comprises step S24: the second network equipment receives a second group message sent to the first conference by a second group of users in the first session group; generating a second group synchronization request to be sent to the first network device according to the second group message, wherein the second group synchronization request includes a second conference message corresponding to the second group message and conference identification information of the first conference determined based on the first conference; sending the second group synchronization request to the first network device for presentation of the second conference message in the first conference.
In some embodiments, the second group of users includes social users who are not participating in the first meeting. For example, a social user "zhang san" manages a plurality of project groups, wherein there are 2 project group meeting time conflicts, and then "zhang san" can select one of the project groups to participate and follow up another project group meeting in real time through a conversation group; or "zhang san" can handle other project work and follow up with the 2 project group meetings in real time through the conversation group. In the embodiment, the session group further comprises social users who do not participate in the conference, and the social users can know the conference content in real time through the session group and respond to the conference content, so that the users can conveniently participate in the conference decision in real time, the delay of acquiring the conference content is avoided, and the working efficiency of the users is improved. In some embodiments, the second conference message includes, but is not limited to: the second group message, the text information obtained by converting the voice information in the second group message, and the voice information obtained by converting the text information in the second group message. Here, the presenting manner of the second conference message in the first conference is the same as or substantially the same as the presenting manner of the second conference message in the aforementioned step S15, so that the description is omitted and the presenting manner is included herein by reference.
In some embodiments, the receiving a second group message sent by a second group of users in the first session group to the first conference comprises: and the second network equipment receives a second group message sent by a second group of users in the first session group, and determines a corresponding first conference according to the message synchronization operation of the second group of users. The message synchronization operations include, but are not limited to: (1) a conference for message synchronization is designated when the second group message is sent, e.g., one or more conferences for conference message synchronization in the conversation group are presented in a messaging interface. The second group of users can specify one or more conferences for receiving the second group of messages through the checking operation; (2) referring to one or more first group messages corresponding to the first conference or the first social robot, e.g., the second group of users responding to the utterance of "zhang san" in the first conference, the second group of users may refer to the first group message corresponding to the voice message of the "zhang san" conference when sending the message. For another example, if the first social robot corresponding to the first meeting in the first meeting group is "bot a", the second group of users may refer to the first social robot in the form of "@ bot a" when sending the second group message to synchronize the second group message to the first meeting. In some embodiments, said determining a corresponding first conference according to the message synchronization operation of the second group of users comprises: and determining a corresponding first conference according to a conference designated by a second group of users for message synchronization, or determining a conference matched with one or more first group messages referred by the second group of users or the first social robot as the first conference.
Fig. 5 is a flowchart illustrating a method for synchronizing conference messages according to an embodiment of the present application, the method including: step S11', receiving a conference voice message sent by a user device in a first conference, where a first participant generates the conference voice message in the first conference; step S12', in response to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network; step S13', sending the first group synchronization request to a second network device in the social network; step S21', receiving a first group synchronization request sent by a first network device, where the first group synchronization request includes a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference; step S22', in response to the first group synchronization request, posting the first group message to the first session group with the identity of the first social user.
Here, the specific implementation manners of the steps S11 ', S12 ', S13 ', S21 ', and S22 ' are respectively the same as or substantially the same as the steps S11, S12, S13, S21, and S22 in the foregoing embodiment, and therefore, the detailed descriptions thereof are omitted and are included herein by reference.
Fig. 6 shows a structure diagram of a first network device for implementing conference message synchronization according to an embodiment of the present application, where the first network device includes a one-to-one module 11, a two-to-two module 12, and a three-to-one module 13. A module 11 receives a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference; a second module 12, in response to the conference voice message, determines a first social user corresponding to the first participant in a social network, and generates a first group synchronization request to be sent to the social network, where the first group synchronization request includes the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network; a third module 13 sends the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user. Here, the specific embodiments of the one-to-one module 11, the two-to-two module 12, and the one-to-three module 13 shown in fig. 6 are the same as or similar to the specific embodiments of the step S11, the step S12, and the step S13, respectively, and therefore are not repeated herein and are included by reference.
In some embodiments, the two-module 12 includes a two-one cell 121 (not shown), a two-two cell 122 (not shown). The first participant is determined by the first-second-first unit 121 according to the user identification information corresponding to the user equipment or by performing voiceprint spectrum analysis on the conference voice message; the first-second unit 122 determines a first social user corresponding to the first participant in the social network, where social users of the first social user are in one-to-one correspondence with participants of the first participant. Here, the specific implementation manners of the first-second unit 121 and the second-second unit 122 are the same as or similar to the foregoing steps S121 and S122, and therefore, the detailed descriptions thereof are omitted and are included herein by reference.
In some embodiments, the first network device includes a quad module 14 (not shown). The one-fourth module 14 determines a first group message corresponding to the conference voice message. Here, the specific implementation of the four modules 14 is the same as or similar to the step S14, and therefore, the detailed description thereof is omitted and is included herein by reference.
In some embodiments, the first network device includes a five module 15 (not shown). The first-fifth module 15 receives a second group synchronization request sent by the second network device, where the second group synchronization request includes a second conference message corresponding to the second group message and conference identification information of the first conference; presenting the second conference message in the first conference. Here, the specific implementation manner of the one-five module 15 is the same as or similar to that of the step S15, and therefore, the detailed description thereof is omitted and is included herein by reference.
Fig. 7 shows a structure diagram of a second network device for implementing conference message synchronization according to an embodiment of the present application, where the second network device includes two modules 21 and 22. A first module 21 receives a first group synchronization request sent by a first network device, where the first group synchronization request includes a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference; two module 22 posts the first group message to the first conversation group in the identity of the first social user in response to the first group synchronization request. Here, the corresponding embodiments of the first two modules 21 and the second two modules 22 shown in fig. 7 are the same as or similar to the embodiments of the steps S21 and S22, and therefore are not repeated herein and are included herein by reference.
In some embodiments, the second network device further comprises a second-third module 23 (not shown). The second and third modules 23 add the first social user to the first session group if the first social user has not joined the first session group. Here, the specific implementation manner of the two or three modules 23 is the same as or similar to that of the step S23, and therefore, the detailed description thereof is omitted and is included herein by reference.
In some embodiments, the second network device further includes a twenty-four module 24 (not shown). The twenty-four module 24 receives a second group message sent by a second group of users in the first conversation group to the first social robot; generating a second group synchronization request to be sent to the first network device according to the second group message, wherein the second group synchronization request comprises a second conference message corresponding to the second group message and conference identification information of the first conference determined based on the first social robot; sending the second group synchronization request to the first network device for presentation of the second conference message in the first conference. Here, the specific implementation manner of the two-four module 24 is the same as or similar to that of the step S24, and therefore, the detailed description thereof is omitted and is included herein by reference.
FIG. 8 illustrates an exemplary system that can be used to implement the various embodiments described herein;
in some embodiments, as shown in FIG. 8, the system 300 can be implemented as any of the devices in the various embodiments described. In some embodiments, system 300 may include one or more computer-readable media (e.g., system memory or NVM/storage 320) having instructions and one or more processors (e.g., processor(s) 305) coupled with the one or more computer-readable media and configured to execute the instructions to implement modules to perform the actions described herein.
For one embodiment, system control module 310 may include any suitable interface controllers to provide any suitable interface to at least one of processor(s) 305 and/or any suitable device or component in communication with system control module 310.
The system control module 310 may include a memory controller module 330 to provide an interface to the system memory 315. Memory controller module 330 may be a hardware module, a software module, and/or a firmware module.
System memory 315 may be used, for example, to load and store data and/or instructions for system 300. For one embodiment, system memory 315 may include any suitable volatile memory, such as suitable DRAM. In some embodiments, the system memory 315 may include a double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).
For one embodiment, system control module 310 may include one or more input/output (I/O) controllers to provide an interface to NVM/storage 320 and communication interface(s) 325.
For example, NVM/storage 320 may be used to store data and/or instructions. NVM/storage 320 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more Hard Disk Drives (HDDs), one or more Compact Disc (CD) drives, and/or one or more Digital Versatile Disc (DVD) drives).
NVM/storage 320 may include storage resources that are physically part of the device on which system 300 is installed or may be accessed by the device and not necessarily part of the device. For example, NVM/storage 320 may be accessible over a network via communication interface(s) 325.
Communication interface(s) 325 may provide an interface for system 300 to communicate over one or more networks and/or with any other suitable device. System 300 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols.
For one embodiment, at least one of the processor(s) 305 may be packaged together with logic for one or more controller(s) (e.g., memory controller module 330) of the system control module 310. For one embodiment, at least one of the processor(s) 305 may be packaged together with logic for one or more controller(s) of the system control module 310 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with logic for one or more controller(s) of the system control module 310. For one embodiment, at least one of the processor(s) 305 may be integrated on the same die with logic for one or more controller(s) of the system control module 310 to form a system on a chip (SoC).
In various embodiments, system 300 may be, but is not limited to being: a server, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, system 300 may have more or fewer components and/or different architectures. For example, in some embodiments, system 300 includes one or more cameras, a keyboard, a Liquid Crystal Display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an Application Specific Integrated Circuit (ASIC), and speakers.
In addition to the methods and apparatus described in the embodiments above, the present application also provides a computer readable storage medium storing computer code that, when executed, performs the method as described in any of the preceding claims.
The present application also provides a computer program product, which when executed by a computer device, performs the method of any of the preceding claims.
The present application further provides a computer device, comprising:
one or more processors;
a memory for storing one or more computer programs;
the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any preceding claim.
It should be noted that the present application may be implemented in software and/or a combination of software and hardware, for example, implemented using Application Specific Integrated Circuits (ASICs), general purpose computers or any other similar hardware devices. In one embodiment, the software programs of the present application may be executed by a processor to implement the steps or functions described above. Likewise, the software programs (including associated data structures) of the present application may be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Additionally, some of the steps or functions of the present application may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.
In addition, some of the present application may be implemented as a computer program product, such as computer program instructions, which when executed by a computer, may invoke or provide methods and/or techniques in accordance with the present application through the operation of the computer. Those skilled in the art will appreciate that the form in which the computer program instructions reside on a computer-readable medium includes, but is not limited to, source files, executable files, installation package files, and the like, and that the manner in which the computer program instructions are executed by a computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Computer-readable media herein can be any available computer-readable storage media or communication media that can be accessed by a computer.
Communication media includes media by which communication signals, including, for example, computer readable instructions, data structures, program modules, or other data, are transmitted from one system to another. Communication media may include conductive transmission media such as cables and wires (e.g., fiber optics, coaxial, etc.) and wireless (non-conductive transmission) media capable of propagating energy waves such as acoustic, electromagnetic, RF, microwave, and infrared. Computer readable instructions, data structures, program modules, or other data may be embodied in a modulated data signal, for example, in a wireless medium such as a carrier wave or similar mechanism such as is embodied as part of spread spectrum techniques. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. The modulation may be analog, digital or hybrid modulation techniques.
By way of example, and not limitation, computer-readable storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include, but are not limited to, volatile memory such as random access memory (RAM, DRAM, SRAM); and non-volatile memory such as flash memory, various read-only memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic/ferroelectric memories (MRAM, FeRAM); and magnetic and optical storage devices (hard disk, tape, CD, DVD); or other now known media or later developed that can store computer-readable information/data for use by a computer system.
An embodiment according to the present application comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or a solution according to the aforementioned embodiments of the present application.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.

Claims (20)

1. A method for realizing conference message synchronization at a first network equipment side, wherein the method comprises the following steps:
receiving a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference;
responding to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, wherein the first group synchronization request comprises the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network;
sending the first group synchronization request to a second network device in the social network for the second network device to post the first group message to the first session group in the identity of the first social user.
2. The method of claim 1, wherein the determining the first social user to which the first participant corresponds in the social network comprises:
determining the first participant according to the user identification information corresponding to the user equipment or by performing voiceprint spectrum analysis on the conference voice message;
determining a first social user corresponding to the first participant in a social network, wherein social users of the first social user are in one-to-one correspondence with participants of the first participant.
3. The method of claim 2, wherein the determining the first participant according to the user identification information corresponding to the user equipment or by performing voiceprint spectrum analysis on the conference voice message comprises:
detecting whether the conference voice message meets a spectrum analysis triggering condition;
if so, determining the first participant by performing voiceprint spectrum analysis on the conference voice message; otherwise, determining the first participant according to the user identification information corresponding to the user equipment.
4. The method of claim 3, wherein said determining the first participant by voiceprint spectral analysis of the conference voice message comprises:
performing voiceprint spectrum analysis on the conference voice message to determine whether only single-person voice is contained in the conference voice message;
if so, determining the first participant according to the frequency spectrum characteristic information corresponding to the conference voice message; otherwise, the conference voice message is decomposed into a plurality of pieces of sub-voice information according to the voiceprint spectrum characteristics, wherein each piece of sub-voice information only contains single voice, the plurality of pieces of sub-voice information respectively correspond to different participants in a first conference, and the plurality of participants corresponding to the plurality of pieces of sub-voice information are determined as the first participants generating the conference voice message in the first conference.
5. The method of claim 3 or 4, wherein the spectrum analysis trigger condition comprises at least any one of:
the first conference is an offline conference;
the user equipment corresponds to a plurality of user identification information;
the user equipment is public equipment or unbound user identification information.
6. The method of any of claims 1-5, wherein the method further comprises:
and determining a first group message corresponding to the conference voice message.
7. The method of claim 6, wherein the determining a first group message to which the conference voice message corresponds comprises:
if the conference voice message contains multiple voices, generating a first group message corresponding to the conference voice message according to multiple pieces of sub-voice information, wherein the first group message comprises multiple first sub-group messages, the multiple first sub-group messages correspond to the multiple pieces of sub-voice information one by one, the multiple pieces of sub-voice information are obtained by decomposing the conference voice message according to the voiceprint spectrum characteristics, and each piece of sub-voice information only contains single voice.
8. The method of claim 7, wherein the first group synchronization request further comprises a mapping of each first subgroup of the first group messages to ones of the first social users.
9. The method of claim 8, wherein the first group synchronization request further comprises a sequential relationship of the plurality of first subgroup messages, the sequential relationship determined based on an order in which the sub-voice information to which the first subgroup message corresponds is initiated in the conference voice information.
10. The method of any of claims 1 to 9, wherein the method further comprises:
receiving a second group synchronization request sent by the second network device, wherein the second group synchronization request includes a second conference message corresponding to the second group message and conference identification information of the first conference;
presenting the second conference message in the first conference.
11. A method for implementing conference message synchronization at a second network device, wherein the method comprises:
receiving a first group synchronization request sent by a first network device, wherein the first group synchronization request comprises a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference;
in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user.
12. The method of claim 11, wherein the first social user comprises a plurality of social users, the first group of messages comprising a plurality of first subgroups of messages, each first subgroup of messages corresponding to one of the first social users;
the posting, in response to the first group synchronization request, the first group message to the first session group in the identity of the first social user comprises:
and responding to the first group synchronization request, and sending each first subgroup message in the plurality of first subgroup messages to the first session group respectively in the identity of the social user corresponding to the first subgroup message in the first social users.
13. The method of claim 12, wherein said first group synchronization request further comprises a sequential relationship of said plurality of first subgroup messages;
the posting, in response to the first group synchronization request, the first group message to the first session group in the identity of the first social user comprises:
and responding to the first group synchronization request, and sending each first subgroup message in the plurality of first subgroup messages to the first session group according to the sequence relation by using the identity of the social user corresponding to the first subgroup message in the first social user.
14. The method of any of claims 11-13, wherein the posting the first group message to the first session group in the identity of the first social user in response to the first group synchronization request comprises:
in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user if the first social user has participated in the first session group; otherwise, the first group message is sent to the first session group with the identity of the first social robot corresponding to the first meeting.
15. The method of claim 14, wherein the method further comprises:
adding the first social user to the first session group if the first social user has not joined the first session group.
16. The method of claim 14 or 15, wherein the method further comprises:
receiving a second group message sent to the first conference by a second group of users in the first session group;
generating a second group synchronization request to be sent to the first network device according to the second group message, wherein the second group synchronization request includes a second conference message corresponding to the second group message and conference identification information of the first conference determined based on the first conference;
sending the second group synchronization request to the first network device for presentation of the second conference message in the first conference.
17. A method of implementing conference message synchronization, wherein the method comprises:
a first network device receives a conference voice message sent by user equipment in a first conference, wherein a first participant generates the conference voice message in the first conference; responding to the conference voice message, determining a first social user corresponding to the first participant in a social network, and generating a first group synchronization request to be sent to the social network, wherein the first group synchronization request comprises the first social user, a first group message corresponding to the conference voice message, and a first session group corresponding to the first conference in the social network; sending the first group synchronization request to a second network device in the social network;
the method comprises the steps that a second network device receives a first group synchronization request sent by a first network device, wherein the first group synchronization request comprises a first group message corresponding to a conference voice message, a first social user corresponding to a first participant in a social network, and a first session group corresponding to a first conference in the social network, and the first participant generates the conference voice message in the first conference; in response to the first group synchronization request, posting the first group message to the first session group in the identity of the first social user.
18. An apparatus for synchronizing conference messages, the apparatus comprising:
a processor, and
a memory arranged to store computer executable instructions that, when executed, cause the processor to perform the method of any of claims 1 to 16.
19. A computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform operations of any of the methods of claims 1-16.
20. A computer program product comprising a computer program, characterized in that the computer program realizes the steps of the method according to any one of claims 1 to 16 when executed by a processor.
CN202011592032.7A 2020-12-29 2020-12-29 Method and equipment for realizing conference message synchronization Active CN112751683B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202011592032.7A CN112751683B (en) 2020-12-29 2020-12-29 Method and equipment for realizing conference message synchronization
PCT/CN2021/133440 WO2022142912A1 (en) 2020-12-29 2021-11-26 Method and device for realizing conference message synchronization

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011592032.7A CN112751683B (en) 2020-12-29 2020-12-29 Method and equipment for realizing conference message synchronization

Publications (2)

Publication Number Publication Date
CN112751683A true CN112751683A (en) 2021-05-04
CN112751683B CN112751683B (en) 2022-12-30

Family

ID=75646692

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011592032.7A Active CN112751683B (en) 2020-12-29 2020-12-29 Method and equipment for realizing conference message synchronization

Country Status (2)

Country Link
CN (1) CN112751683B (en)
WO (1) WO2022142912A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022142912A1 (en) * 2020-12-29 2022-07-07 上海掌门科技有限公司 Method and device for realizing conference message synchronization
WO2022142913A1 (en) * 2020-12-29 2022-07-07 上海掌门科技有限公司 Method and device for implementing conference message synchronization

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080281971A1 (en) * 2007-05-07 2008-11-13 Nokia Corporation Network multimedia communication using multiple devices
US9413700B1 (en) * 2015-12-09 2016-08-09 International Business Machines Corporation Operating a group chat session
US20160242216A1 (en) * 2013-09-25 2016-08-18 China Academy Of Telecommunications Technology Group communication method, device and system
WO2017071593A1 (en) * 2015-10-30 2017-05-04 华为技术有限公司 Video conference control method and apparatus
CN206728037U (en) * 2017-05-22 2017-12-08 广东工业大学 It is a kind of can disaster tolerance conference system
CN107911646A (en) * 2016-09-30 2018-04-13 阿里巴巴集团控股有限公司 The method and device of minutes is shared, is generated in a kind of meeting
US10157614B1 (en) * 2016-12-28 2018-12-18 Amazon Technologies, Inc. Message playback using a shared device
WO2019024867A1 (en) * 2017-08-02 2019-02-07 腾讯科技(深圳)有限公司 Method for message interaction in video page, computation device and storage medium
CN110139062A (en) * 2019-05-09 2019-08-16 平安科技(深圳)有限公司 A kind of creation method, device and the terminal device of video conference record
CN110519153A (en) * 2019-08-15 2019-11-29 连尚(新昌)网络科技有限公司 A kind of method and apparatus sending group session message

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546464B (en) * 2011-12-22 2015-09-09 华为技术有限公司 A kind of conference method across IM system and system
CN102572372B (en) * 2011-12-28 2018-10-16 中兴通讯股份有限公司 The extracting method and device of meeting summary
US9356977B2 (en) * 2013-08-30 2016-05-31 Citrix Systems, Inc. Acquiring online meeting data relating to an online meeting
CN112822161B (en) * 2020-12-29 2022-12-30 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization
CN112751683B (en) * 2020-12-29 2022-12-30 上海掌门科技有限公司 Method and equipment for realizing conference message synchronization

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080281971A1 (en) * 2007-05-07 2008-11-13 Nokia Corporation Network multimedia communication using multiple devices
US20160242216A1 (en) * 2013-09-25 2016-08-18 China Academy Of Telecommunications Technology Group communication method, device and system
WO2017071593A1 (en) * 2015-10-30 2017-05-04 华为技术有限公司 Video conference control method and apparatus
US9413700B1 (en) * 2015-12-09 2016-08-09 International Business Machines Corporation Operating a group chat session
CN107911646A (en) * 2016-09-30 2018-04-13 阿里巴巴集团控股有限公司 The method and device of minutes is shared, is generated in a kind of meeting
US10157614B1 (en) * 2016-12-28 2018-12-18 Amazon Technologies, Inc. Message playback using a shared device
CN206728037U (en) * 2017-05-22 2017-12-08 广东工业大学 It is a kind of can disaster tolerance conference system
WO2019024867A1 (en) * 2017-08-02 2019-02-07 腾讯科技(深圳)有限公司 Method for message interaction in video page, computation device and storage medium
CN110139062A (en) * 2019-05-09 2019-08-16 平安科技(深圳)有限公司 A kind of creation method, device and the terminal device of video conference record
CN110519153A (en) * 2019-08-15 2019-11-29 连尚(新昌)网络科技有限公司 A kind of method and apparatus sending group session message

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022142912A1 (en) * 2020-12-29 2022-07-07 上海掌门科技有限公司 Method and device for realizing conference message synchronization
WO2022142913A1 (en) * 2020-12-29 2022-07-07 上海掌门科技有限公司 Method and device for implementing conference message synchronization

Also Published As

Publication number Publication date
CN112751683B (en) 2022-12-30
WO2022142912A1 (en) 2022-07-07

Similar Documents

Publication Publication Date Title
CN107995101B (en) Method and equipment for converting voice message into text message
CN112822161B (en) Method and equipment for realizing conference message synchronization
CN110336735B (en) Method and equipment for sending reminding message
CN112751683B (en) Method and equipment for realizing conference message synchronization
CN110795004B (en) Social method and device
CN112118215A (en) Convenient real-time conversation based on topic determination
CN110336733B (en) Method and equipment for presenting emoticon
US20190378502A1 (en) Conference call analysis and automated information exchange
US11652656B2 (en) Web conference replay association upon meeting completion
WO2020221195A1 (en) Method and device for publishing dynamic information
WO2022068640A1 (en) Method and device for broadcasting voice information in multi-user voice call
WO2022142618A1 (en) Method and device for executing instruction by means of virtual conference robot
CN112422488A (en) Screen projection method and device
CN113329237B (en) Method and equipment for presenting event label information
CN110688586B (en) Method and device for recommending social activities or friends for user
CN112272213A (en) Activity registration method and equipment
EP3942855A1 (en) Resource access based on audio signal
CN111414530B (en) Method and equipment for presenting asynchronous comment information through instant messaging window
US10075480B2 (en) Notification bot for topics of interest on voice communication devices
CN112583696A (en) Method and equipment for processing group session message
CN115914162A (en) Method, apparatus, medium and program product for providing group status
CN115544412A (en) Method, apparatus, medium and program product for presenting real-time status
CN115563398A (en) Method, apparatus, medium, and program product for transmitting resource
CN114339439A (en) Live broadcast method and equipment based on social group chat
CN115544378A (en) Method, device, medium and program product for collaboration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant