CN113595866A - Method and device for establishing audio and video call among multiple devices - Google Patents

Method and device for establishing audio and video call among multiple devices Download PDF

Info

Publication number
CN113595866A
CN113595866A CN202110688591.6A CN202110688591A CN113595866A CN 113595866 A CN113595866 A CN 113595866A CN 202110688591 A CN202110688591 A CN 202110688591A CN 113595866 A CN113595866 A CN 113595866A
Authority
CN
China
Prior art keywords
devices
server
synchronous
audio
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110688591.6A
Other languages
Chinese (zh)
Inventor
刘建国
张鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Technology Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Technology Co Ltd
Priority to CN202110688591.6A priority Critical patent/CN113595866A/en
Publication of CN113595866A publication Critical patent/CN113595866A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/046—Interoperability with other network applications or services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0876—Network architectures or network communication protocols for network security for authentication of entities based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/14—Session management
    • H04L67/141—Setup of application sessions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Power Engineering (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention provides a method and a device for establishing audio and video calls among multiple devices, wherein the method comprises the following steps: receiving a query request sent by an APP for querying talkable equipment in a plurality of synchronous equipment logged under the same account; acquiring the state of the synchronous equipment from the IM server according to the query request; determining a first talkable device set according to the state of the synchronous device; sending an inquiry response carrying the first set of the talkable devices to the APP, wherein the inquiry response is used for indicating the APP to establish audio and video conversation with a plurality of devices in the first set of the talkable devices through the IM server, the problem of how to realize audio and video conversation among a plurality of devices under the same account number in the related technology can be solved, audio and video conversation service among different devices under the same account number is realized, the API server inquires the talkable devices before the APP initiates conversation, the whole control logic is in the API server, convenience, flexibility and low maintenance cost are realized.

Description

Method and device for establishing audio and video call among multiple devices
Technical Field
The invention relates to the field of communication, in particular to a method and a device for establishing audio and video calls among multiple devices.
Background
With the popularization of smart homes, it becomes more important to communicate anytime and anywhere, and after more and more smart devices enter a home, how to get through the interaction between the devices to reduce the communication cost becomes a problem to be solved urgently.
The communication between ordinary smart homes can only be in products of the same manufacturer, and for the former smart homes, which are various in types, the products of the same manufacturer cannot be used in families basically. The communication among a plurality of intelligent devices cannot be communicated, and the communication among partial devices is only supported.
The host device is used for projecting the screen to other devices when receiving the audio and video, the communication is highly dependent on the host device, the multi-device communication in the true sense cannot be achieved, and the operation is complex.
The common video call can be realized only among different account numbers, at least two account numbers are needed for the call among different devices, more devices need more account numbers, and the communication can not be realized under the same account number.
Aiming at the problem of how to realize audio and video calls among a plurality of devices under the same account in the related technology, no solution is provided.
Disclosure of Invention
The embodiment of the invention provides a method and a device for establishing audio and video calls among multiple devices, which are used for at least solving the problem of how to realize the audio and video calls among the multiple devices under the same account in the related technology.
According to an embodiment of the present invention, a method for establishing an audio/video call between multiple devices is provided, which is applied to an Application Programming Interface (API) server, and includes:
receiving a query request sent by an APP (application) for querying talkable devices in a plurality of synchronous devices logged in under the same account;
acquiring the state of the synchronous equipment from an Instant Messaging (IM) server according to the query request;
determining a first set of callable devices from the plurality of synchronous devices according to the state of the synchronous devices;
and sending an inquiry response carrying the first set of devices capable of communicating to the APP, wherein the inquiry response is used for indicating the APP to establish audio and video communication with the plurality of devices in the first set of devices capable of communicating through the IM server.
Optionally, the method further comprises:
receiving a call application which is initiated by other devices except the plurality of synchronous devices and establishes audio and video calls with the plurality of synchronous devices;
acquiring the state of the synchronous equipment from the IM server according to the query request;
determining a second set of devices capable of communicating according to the state of the synchronous device;
and sending the second set of devices capable of talking to the other devices, wherein the other devices are used for establishing audio and video calls with a plurality of devices in the second set of devices capable of talking through the IM server.
Optionally, before receiving an inquiry request sent by the APP to inquire a talkable device of multiple synchronous devices logged in under the same account, the method further includes:
receiving login information sent by the APP, wherein the login information at least includes an account number, a Media Access Control (MAC) address, and device ids (identities) of the plurality of synchronous devices;
generating a virtual device ID according to the login information, and storing the corresponding relation between the virtual device ID and the device IDs of the plurality of synchronous devices;
synchronizing the virtual equipment ID and the account to an IM server;
receiving a login result sent by the IM server after the account is logged in according to the virtual equipment ID;
and sending the login result to the APP.
Optionally, before receiving an inquiry request sent by the APP to inquire a talkable device of multiple synchronous devices logged in under the same account, the method further includes:
judging whether a mutual exclusion device is online or not;
if the judgment result is yes, logging out of the mutual exclusion device;
and synchronizing the state of the mutual exclusion equipment to the IM server.
According to another embodiment of the present invention, there is also provided a method for establishing an audio/video call between multiple devices, which is applied to an APP, and includes:
sending a query request for querying talkable equipment in a plurality of synchronous equipment logged under the same account to an API server;
receiving an inquiry response which is sent by the API and carries a first talking device set, wherein the inquiry response is sent by the API server after the API server determines the first talking device set from the plurality of synchronous devices according to the synchronous device state obtained from the IM server;
and establishing audio and video calls with a plurality of devices in the first call device set through the IM server.
Optionally, establishing an audio/video call with a plurality of devices in the first set of devices capable of talking through the IM server includes:
sending a call invitation for establishing audio and video calls with a plurality of devices in the first call device set to the IM server;
if receiving an answering response of answering the call invitation by one target device in the first call-capable device set sent by the IM server, establishing an audio-video call with the target device;
and if receiving answering responses sent by the IM server and used for answering the call invitation by the target devices in the first call-capable device set, establishing audio and video calls with the target devices.
Optionally, before sending, to the API server, a query request for querying a talkable device in a plurality of synchronous devices logged in under the same account, the method further includes:
sending login information to the API server, wherein the login information at least comprises an account number, an MAC address and equipment IDs of the plurality of synchronous equipment;
and receiving a login result which is forwarded by the API server and sent by the IM server after the account is logged in according to a virtual device ID, wherein the virtual device ID is generated by the API server according to the login information and is synchronized to the IM server, and the API server stores the corresponding relation between the virtual device ID and the device IDs of the plurality of synchronous devices.
Optionally, the method further comprises:
receiving a call invitation of audio and video calls initiated by other devices except the plurality of synchronous devices through the IM server;
answering or canceling the call invitation.
According to another embodiment of the present invention, there is also provided an apparatus for establishing an audio/video call between multiple devices, which is applied to an API server, and includes:
the device comprises a receiving request module, a processing module and a processing module, wherein the receiving request module is used for receiving a query request sent by an APP for querying talkable equipment in a plurality of synchronous equipment logged under the same account;
the first acquisition module is used for acquiring the state of the synchronous equipment from the IM server according to the query request;
a first determining module, configured to determine a first set of callable devices from the multiple synchronous devices according to the state of the synchronous device;
and the response sending module is used for sending an inquiry response carrying the first talking device set to the APP, wherein the inquiry response is used for indicating the APP to establish audio and video conversation with the plurality of devices in the first talking device set through the IM server.
Optionally, the apparatus further comprises:
the receiving application module is used for receiving a call application which is initiated by other equipment except the plurality of synchronous equipment and establishes audio and video calls with the plurality of synchronous equipment;
the second acquisition module is used for acquiring the state of the synchronous equipment from the IM server according to the query request;
a second determining module, configured to determine a second set of devices capable of communicating according to the state of the synchronization device;
and the sending set module is used for sending the second talking device set to the other devices, wherein the other devices are used for establishing audio and video calls with a plurality of devices in the second talking device set through the IM server.
Optionally, the apparatus further comprises:
the information receiving module is used for receiving login information sent by the APP, wherein the login information at least comprises an account number, an MAC address and equipment IDs of the plurality of synchronous equipment;
a generating module, configured to generate a virtual device ID according to the login information, and store a correspondence between the virtual device ID and the device IDs of the multiple synchronization devices;
the first synchronization module is used for synchronizing the virtual equipment ID and the account to an IM server;
the first receiving result module is used for receiving a login result sent by the IM server after the account is logged in according to the virtual equipment ID;
and the result sending module is used for sending the login result to the APP.
Optionally, the apparatus further comprises:
the judging module is used for judging whether the mutual exclusion equipment is online or not;
the quitting module is used for quitting the login of the mutual exclusion equipment under the condition that the judgment result is yes;
and the second synchronization module is used for synchronizing the state of the mutual exclusion equipment to the IM server.
According to another embodiment of the present invention, there is also provided an apparatus for establishing an audio/video call between multiple devices, which is applied to an APP, and includes:
the system comprises a sending request module, a receiving module and a processing module, wherein the sending request module is used for sending a query request for querying talkable equipment in a plurality of synchronous equipment logged under the same account to an API server;
a receiving response module, configured to receive an inquiry response that is sent by the API and carries a first set of callable devices, where the inquiry response is sent by the API server after the API server determines the first set of callable devices from the multiple synchronization devices according to a synchronization device status obtained from an IM server;
and the establishing module is used for establishing audio and video calls with a plurality of devices in the first call device set through the IM server.
Optionally, the establishing module includes:
the sending submodule is used for sending a call invitation for establishing audio and video calls with a plurality of devices in the first call device set to the IM server;
a first establishing submodule, configured to establish an audio/video call with one target device in the first set of devices capable of calling, if an answer response is received, where the answer response is sent by the IM server, and the target device answers the call invitation;
and the second establishing submodule is used for establishing audio and video calls with the target devices if receiving answer responses sent by the IM server and used for answering the call invitation by the target devices in the first call-capable device set.
Optionally, the apparatus further comprises:
the information sending module is used for sending login information to the API server, wherein the login information at least comprises an account number, an MAC address and equipment IDs of the synchronous equipment;
and a second receiving result module, configured to receive a login result sent by the IM server after the account is logged in by the API server according to a virtual device ID, where the virtual device ID is generated by the API server according to the login information and is synchronized with the IM server, and the API server stores a correspondence between the virtual device ID and the device IDs of the multiple synchronization devices.
Optionally, the apparatus further comprises:
the receiving invitation module is used for receiving the call invitation of the audio and video call initiated by other equipment except the plurality of synchronous equipment through the IM server;
and the answering module is used for answering or canceling the call invitation.
According to a further embodiment of the present invention, a computer-readable storage medium is also provided, in which a computer program is stored, wherein the computer program is configured to perform the steps of any of the above-described method embodiments when executed.
According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.
According to the invention, a query request sent by an APP for querying the talkable equipment in a plurality of synchronous equipment logged under the same account is received; acquiring the state of the synchronous equipment from an IM server according to the query request; determining a first talkable device set according to the state of the synchronous device; the method comprises the steps of sending and carrying an inquiry response of a first talking device set by an APP, wherein the inquiry response is used for indicating that the APP passes through an IM server and audio and video calls are established by a plurality of devices in the first talking device set, the problem of how to realize audio and video calls among a plurality of devices under the same account in the related technology can be solved, audio and video call services among different devices under the same account are realized, the talking devices are inquired by the API server before the APP initiates calls, the whole control logic is in the API server, and convenience, flexibility and low maintenance cost are realized.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware structure of a mobile terminal of an audio/video call establishment method between multiple devices according to an embodiment of the present invention;
fig. 2 is a first flowchart of a method for establishing an audio/video call between multiple devices according to an embodiment of the present invention;
FIG. 3 is a second flowchart of a method for establishing an audio/video call between multiple devices according to an embodiment of the present invention;
FIG. 4 is a flow diagram of an inter-device login according to an embodiment of the present invention;
fig. 5 is a flowchart of a multi-device audio-video call under the same account according to an embodiment of the present invention;
fig. 6 is a flowchart of a multi-device audio/video call under different accounts according to an embodiment of the present invention;
fig. 7 is a first block diagram of an apparatus for establishing an audio/video call between multiple devices according to an embodiment of the present invention;
fig. 8 is a second block diagram of the apparatus for establishing an audio/video call between multiple devices according to the embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
Example 1
The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking a mobile terminal as an example, fig. 1 is a hardware structure block diagram of a mobile terminal of an audio/video call setup method between multiple devices according to an embodiment of the present invention, as shown in fig. 1, the mobile terminal may include one or more processors 102 (only one is shown in fig. 1) (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), and a memory 104 for storing data, and optionally, the mobile terminal may further include a transmission device 106 for a communication function and an input/output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration, and does not limit the structure of the mobile terminal. For example, the mobile terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store a computer program, for example, a software program and a module of application software, such as a computer program corresponding to the method for establishing an audio/video call between multiple devices in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 can be a Radio FrequeNcy (RF) module, which is used to communicate with the internet in a wireless manner.
Based on the above mobile terminal or network architecture, in this embodiment, a method for establishing an audio/video call between multiple devices is provided, and fig. 2 is a first flowchart of the method for establishing an audio/video call between multiple devices according to the embodiment of the present invention, and as shown in fig. 2, the method is applied to an API server, and the flowchart includes the following steps:
step S202, receiving a query request sent by an APP for querying talkable equipment in a plurality of synchronous equipment logged under the same account;
in the embodiment of the present invention, multiple synchronization devices (i.e., multiple devices), which may be devices of the same manufacturer or devices of different manufacturers, are registered under the same account and managed by the same account.
Step S204, obtaining the state of the synchronous equipment from the IM server according to the query request;
in the embodiment of the invention, the IM server stores the states of all the devices, and the synchronous device state comprises the online state and the offline state of the devices.
Step S206, determining a first talkable device set from the plurality of synchronous devices according to the state of the synchronous devices;
in step S206, after receiving the state of the synchronization device, the API server may determine the devices that can perform a call under the account, that is, the online devices, according to the correspondence between the previously stored account and the multiple synchronization devices, and combine the first set of call devices.
Step S208, sending an inquiry response carrying the first set of devices capable of communicating to the APP, where the inquiry response is used to instruct the APP to establish an audio/video call with multiple devices in the first set of devices capable of communicating through the IM server.
Through the steps S202 to S208, the problem of how to realize audio and video calls among a plurality of devices under the same account in the related technology can be solved, audio and video call services among different devices under the same account are realized, the API server inquires the call-capable devices before the APP initiates the calls, and the whole control logic is in the API server, so that the system is convenient, flexible and low in maintenance cost.
In an optional embodiment, a call application for establishing an audio/video call with a plurality of synchronization devices, which is initiated by other devices (i.e. devices not under the same account) except the plurality of synchronization devices, is received; because the states of all the devices are stored in the IM server, the state of the synchronous device (namely the device on line can be known) can be obtained from the IM server according to the query request; determining a second set of devices capable of communicating according to the state of the synchronous device, specifically, determining devices capable of communicating under the account, namely online devices, according to the corresponding relation between the previously stored account and a plurality of synchronous devices, and combining the second set of devices capable of communicating; and sending the second set of devices capable of talking to the other devices, wherein the other devices can establish audio and video calls with a plurality of devices in the second set of devices capable of talking through the IM server. The embodiment of the invention not only supports different devices with the same account number, but also supports audio and video calls among different account numbers.
In another optional embodiment, before step S202, login information sent by the APP is received, where the login information at least includes an account, a MAC address, and device IDs of the multiple synchronous devices; generating a virtual device ID according to the login information, and storing the corresponding relation between the virtual device ID and the device IDs of the plurality of synchronous devices; synchronizing the virtual device ID and the account to an IM server; receiving a login result sent by the IM server after the account is logged in according to the virtual equipment ID; and sending the login result to the APP. The IM server as a call provider does not concern the account system and only concerns the equipment. And the API server maintains the relationship between the account and the equipment and the relationship between the equipment, and performs compatibility and processing through the API server.
In another optional embodiment, before the step S202, it is determined whether a mutual exclusion device is online; if the judgment result is yes, logging out of the mutual exclusion device; the state of the mutual exclusion device is synchronized to the IM server. The method can realize mutual exclusion online and synchronous online among different devices of the same account, and can also realize audio and video conversation service among different devices of a single account.
Example 2
According to another embodiment of the present invention, a method for establishing an audio/video call between multiple devices is further provided, fig. 3 is a second flowchart of the method for establishing an audio/video call between multiple devices according to the embodiment of the present invention, as shown in fig. 3, applied to an APP, where the flowchart includes the following steps:
step S302, sending a query request for querying talkable equipment in a plurality of synchronous equipment logged in under the same account to an API server;
in the embodiment of the present invention, multiple synchronization devices (i.e., multiple devices), which may be devices of the same manufacturer or devices of different manufacturers, are registered in the same account, managed by the same account, and the API server records the correspondence between the account and the multiple synchronization devices.
Step S304, receiving an inquiry response which is sent by the API and carries a first talking device set, wherein the inquiry response is sent by the API server after the API server determines the first talking device set from the plurality of synchronous devices according to the synchronous device state obtained from the IM server;
in the embodiment of the invention, the IM server stores the states of all the devices, and the synchronous device state comprises the online state and the offline state of the devices. After receiving the state of the synchronous equipment, the API server can determine equipment capable of carrying out conversation under the account, namely online equipment according to the corresponding relation between the account and the plurality of synchronous equipment stored in the previous step, and the APP can acquire the equipment capable of carrying out audio and video conversation in the plurality of synchronous equipment from the API server by combining a first conversation equipment set.
Step S306, an audio/video call is established with multiple devices in the first set of devices capable of communicating through the IM server.
In an embodiment of the present invention, the step S306 may specifically include: sending a call invitation for establishing audio and video calls with a plurality of devices in the first call-capable device set to the IM server, sending the call invitation to the plurality of devices in the first call-capable client device set through the IM server, wherein the plurality of devices can answer or cancel the invitation; if receiving an answering response of answering the call invitation by one target device in the first call-capable device set sent by the IM server, establishing an audio-video call with the target device; and if receiving answering responses of answering the call invitation by a plurality of target devices in the first call-capable device set sent by the IM server, establishing audio and video calls with the plurality of target devices.
Through the steps S302 to S306, the problem of how to realize audio and video conversation among a plurality of devices under the same account in the related technology can be solved, audio and video conversation service among different devices under the same account is realized, the API server inquires the conversation equipment before the APP initiates conversation, and the whole control logic is in the API server, so that the system is convenient, flexible and low in maintenance cost.
In an optional embodiment, before the step S302, login information is sent to the API server, where the login information at least includes an account number, a MAC address, and device IDs of the multiple synchronization devices; and receiving a login result which is transmitted after the IM server which is forwarded by the API server logs in the account according to the virtual equipment ID, wherein the virtual equipment ID is generated by the API server according to the login information and is synchronized to the IM server, and the API server stores the corresponding relation between the virtual equipment ID and the equipment IDs of the plurality of synchronous equipment. The IM server as a call provider does not concern the account system and only concerns the equipment. And the API server maintains the relationship between the account and the equipment and the relationship between the equipment, and performs compatibility and processing through the API server.
In an optional embodiment, the APP may also perform an audio/video call with other devices that are not the same account, and specifically, receive, by the IM server, a call invitation of the audio/video call initiated by another device other than the multiple synchronization devices, and answer or cancel the call invitation. The method can realize mutual exclusion online and synchronous online among different devices of the same account, and can also realize audio and video conversation service among different devices of a single account.
Fig. 4 is a flowchart of login among multiple devices according to an embodiment of the present invention, and as shown in fig. 4, the APP and the mutual exclusion device 1, the synchronization device 2, and the synchronization device 3 are different devices that log in with the same account (the mutual exclusion device represents a terminal that cannot log in at the same time). And the other equipment is a terminal for logging in other accounts. The IM server is responsible for the establishment of the whole call and data interaction, and the API server is responsible for the corresponding relation of the account system. The multi-device login comprises the following steps:
s401, an API server receives login information sent by an APP, wherein the login information at least comprises an account and an MAC address;
s402, the IPI server generates a virtual device ID according to the login information;
s403, the IPI server synchronizes the virtual equipment ID and the account number to an IM server;
s404, the IM server completes login;
S405-S406, the IM server returns a login result to the APP through the API server;
s407, the API server judges whether the mutual exclusion equipment is online;
s408, the mutual exclusion device is deleted,
s409, the mutual exclusion equipment logs out and synchronizes the state of the mutual exclusion equipment to the IM server;
s410, the AIP server synchronizes the log-out information of the mutual exclusion device to the IM server.
And transmitting the account number, the hardware MAC address, the hardware type and the model, and generating the unique equipment Id by the API server. The device ids of all devices are unique, and in order to implement the mutual exclusion operation, the virtual device ids are generated and are the same for the mutually exclusive devices. There may be options in the login process, and by default all device virtual device ids are different. The refrigerator, the television, the sound, the mobile phone and the platform all correspond to one category. The default newly added device will generate its own type, and when the existing type is selected, it is the same as the virtual device id of the device in the type.
And the API server synchronizes the account information to the IM server, and the IM server completes the final login by using the virtual device id. And returning a login result, after the IM server finishes login, returning the state to the API server, and returning the login result to the APP/terminal by the API server. And meanwhile, the API server judges whether the mutual exclusion device is on line or not, if so, the login of the mutual exclusion device is quitted, and meanwhile, the login is synchronized to the IM server.
Fig. 5 is a flowchart of a multi-device audio/video call under the same account according to an embodiment of the present invention, as shown in fig. 5, including:
s501, the APP sends a query request for querying the talkable device to the API server;
s502, the API server inquires the state of the synchronous equipment from the IM server;
s503, the API server receives the synchronous same-equipment state returned by the IM server;
s504, the API server returns the equipment capable of talking to the APP;
s505, the APP sends a request for dialing the audio and video call to the IM server;
s506, the IM server sends audio and video call invitation to the devices (namely the synchronous device 2 and the synchronous device 3) which can be called;
s507, the IM server receives the answering invitation of the synchronous equipment 2;
s508, the IM server receives the invitation to cancel of the synchronization device 3.
S509, the IM server establishes an audio and video call between the synchronous device 2 and the APP;
and S510, completing page updating display by the APP, and establishing audio and video communication.
The APP/terminal requests an API server, and the API server finds the equipment under the same account and requests the IM server to acquire the equipment state. And the API server returns the online equipment to the APP/terminal. (the mobile phone end always returns, and the mobile phone which is not on-line can send message notice). And the APP/terminal initiates a call invitation to all the acquired online devices. After receiving the call invitation, any device answers, and the other devices are cancelled. The IM server returns the information of establishing the call, and the two parties establish the call.
Fig. 6 is a flowchart of a multi-device audio/video call under different accounts according to an embodiment of the present invention, and as shown in fig. 6, the flowchart includes:
s601, other equipment initiates an audio and video call request to an API server;
s602, the API server inquires the state of the synchronous equipment from the IM server;
s603, the API server receives the synchronous same-equipment state returned by the IM server;
s604, the API server returns the equipment capable of talking to other equipment;
s605, other equipment sends a request for dialing the audio and video call to the IM server;
s606, the IM server sends an audio and video call invitation to the synchronization equipment 2, the synchronization equipment 3 and the APP;
s607, the IM server receives the answer invitation of the synchronous device 2;
s608, the IM server receives the invitation to cancel the synchronization between the device 3 and the APP.
S609, the IM server establishes audio and video communication between the synchronous equipment 2 and other equipment;
and other equipment sends a call application to the API server, and the API server requests the IM server to return the call-enabled equipment to the initiator. Other equipment initiates a conversation invitation, the online equipment receives the conversation invitation, and the offline mobile phone receives a message notice. And any equipment answers and then the call is established. If multiple ends are allowed to listen simultaneously, more devices join the group chat after listening. If the multi-end is not allowed to listen simultaneously, any equipment cancels the invitation after listening.
And different devices perform audio and video call service for the same account. But APP/terminal initiates the conversation after by API server return conversation equipment, whole control logic is at API server, convenient nimble maintenance cost is low. Not only different devices with the same account number but also the logic of communication among different account numbers. As long as you have equipment at one's side, any conversation can not be missed, can accept the conversation invitation anytime and anywhere.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
Example 3
The embodiment also provides an apparatus for establishing an audio/video call between multiple devices, where the apparatus is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated for what has been described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 7 is a first block diagram of an apparatus for establishing an audio/video call between multiple devices according to an embodiment of the present invention, as shown in fig. 7, applied to an API server, including:
a receiving request module 72, configured to receive a query request sent by an APP to query a device that can communicate among multiple synchronous devices logged in under the same account;
a first obtaining module 74, configured to obtain the synchronization device status from the IM server according to the query request;
a first determining module 76, configured to determine a first set of callable devices from the plurality of synchronization devices according to the synchronization device status;
a sending response module 78, configured to send, to the APP, an inquiry response carrying the first set of devices that can talk, where the inquiry response is used to instruct the APP to establish an audio/video call with multiple devices in the first set of devices that can talk through the IM server.
Optionally, the apparatus further comprises:
the receiving application module is used for receiving a call application which is initiated by other equipment except the plurality of synchronous equipment and establishes audio and video calls with the plurality of synchronous equipment;
the second obtaining module is used for obtaining the state of the synchronous equipment from the IM server according to the query request;
a second determining module, configured to determine a second set of devices capable of communicating according to the state of the synchronization device;
and the sending set module is used for sending the second talkable device set to the other devices, wherein the other devices are used for establishing audio and video calls with a plurality of devices in the second talkable device set through the IM server.
Optionally, the apparatus further comprises:
the information receiving module is used for receiving login information sent by the APP, wherein the login information at least comprises an account number, an MAC address and equipment IDs of the plurality of synchronous equipment;
a generating module, configured to generate a virtual device ID according to the login information, and store a correspondence between the virtual device ID and the device IDs of the multiple synchronization devices;
the first synchronization module is used for synchronizing the virtual equipment ID and the account number to the IM server;
a first receiving result module, configured to receive a login result sent by the IM server after logging in the account according to the virtual device ID;
and the result sending module is used for sending the login result to the APP.
Optionally, the apparatus further comprises:
the judging module is used for judging whether the mutual exclusion equipment is online or not;
the quitting module is used for quitting the login of the mutual exclusion equipment under the condition that the judgment result is yes;
and the second synchronization module is used for synchronizing the state of the mutual exclusion device to the IM server.
Example 4
The embodiment also provides an apparatus for establishing an audio/video call between multiple devices, where the apparatus is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated for what has been described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 8 is a second block diagram of the apparatus for establishing an audio/video call between multiple devices according to the embodiment of the present invention, as shown in fig. 8, applied to an APP, including:
a sending request module 82, configured to send, to the API server, a query request for querying a device that can be communicated among multiple synchronous devices logged in under the same account;
a receiving response module 84, configured to receive an inquiry response that is sent by the API and carries the first set of callable devices, where the inquiry response is sent by the API server after the API server determines the first set of callable devices from the multiple synchronization devices according to the synchronization device status obtained from the IM server;
an establishing module 86, configured to establish an audio/video call with multiple devices in the first set of devices capable of talking through the IM server.
Optionally, the establishing module 86 includes:
the sending submodule is used for sending a call invitation for establishing audio and video calls with a plurality of devices in the first call device set to the IM server;
the first establishing submodule is used for establishing audio and video conversation with one target device if receiving an answering response of answering the conversation invitation sent by the IM server and sent by the target device in the first conversable device set;
and the second establishing submodule is used for establishing audio and video calls with the target devices if receiving answer responses sent by the IM server and used for answering the call invitation by the target devices in the first call-capable device set.
Optionally, the apparatus further comprises:
the information sending module is used for sending login information to the API server, wherein the login information at least comprises an account number, an MAC address and equipment IDs of the plurality of synchronous equipment;
and a second receiving result module, configured to receive a login result sent by the IM server after logging in the account according to the virtual device ID forwarded by the API server, where the virtual device ID is generated by the API server according to the login information and is synchronized to the IM server, and the API server stores a correspondence between the virtual device ID and the device IDs of the multiple synchronization devices.
Optionally, the apparatus further comprises:
the receiving invitation module is used for receiving the call invitation of the audio and video call initiated by other equipment except the plurality of synchronous equipment through the IM server;
and the answering module is used for answering or canceling the call invitation.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Example 5
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s11, receiving a query request sent by an APP for querying talkable devices in a plurality of synchronous devices logged in under the same account;
s12, obtaining the synchronous device state from the IM server according to the inquiry request;
s13, determining a first talkable device set from the plurality of synchronous devices according to the synchronous device state;
and S14, sending an inquiry response carrying the first set of devices capable of talking to the APP, wherein the inquiry response is used for indicating that the APP establishes audio and video talking with a plurality of devices in the first set of devices capable of talking through the IM server.
Optionally, in this embodiment, the storage medium may be further configured to store a computer program for executing the following steps:
s21, sending a query request for querying the talking equipment in the synchronous equipment logged under the same account to the API server;
s22, receiving an inquiry response which is sent by the API and carries a first talking device set, wherein the inquiry response is sent by the API after the API server determines the first talking device set from the plurality of synchronous devices according to the synchronous device state obtained from the IM server;
and S23, establishing audio and video calls with a plurality of devices in the first set of devices capable of calling through the IM server.
Optionally, in this embodiment, the storage medium may include, but is not limited to: a usb disk, a Read-ONly Memory (ROM), a RaNdom Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, which can store computer programs.
Example 6
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s11, receiving a query request sent by an APP for querying talkable devices in a plurality of synchronous devices logged in under the same account;
s12, obtaining the state of the synchronous device from the IM server according to the query request;
s13, determining a first talkable device set from the plurality of synchronous devices according to the synchronous device state;
and S14, sending an inquiry response carrying the first set of devices capable of talking to the APP, wherein the inquiry response is used for indicating the APP to establish audio and video talking with a plurality of devices in the first set of devices capable of talking through the IM server.
Optionally, in this embodiment, the processor may be further configured to execute, by the computer program, the following steps:
s21, sending a query request for querying the talking equipment in the synchronous equipment logged under the same account to the API server;
s22, receiving an inquiry response which is sent by the API and carries a first talking device set, wherein the inquiry response is sent by the API after the API server determines the first talking device set from the plurality of synchronous devices according to the synchronous device state obtained from the IM server;
and S23, establishing audio and video calls with a plurality of devices in the first set of devices capable of calling through the IM server.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.

Claims (12)

1. A method for establishing audio and video calls among multiple devices is applied to an Application Program Interface (API) server and is characterized by comprising the following steps:
receiving a query request sent by an application program APP for querying talkable equipment in a plurality of synchronous equipment logged under the same account;
acquiring the state of the synchronous equipment from the communication IM server according to the query request;
determining a first set of callable devices from the plurality of synchronous devices according to the state of the synchronous devices;
and sending an inquiry response carrying the first set of devices capable of communicating to the APP, wherein the inquiry response is used for indicating the APP to establish audio and video communication with the plurality of devices in the first set of devices capable of communicating through the IM server.
2. The method of claim 1, further comprising:
receiving a call application which is initiated by other devices except the plurality of synchronous devices and establishes audio and video calls with the plurality of synchronous devices;
acquiring the state of the synchronous equipment from the IM server according to the query request;
determining a second set of devices capable of communicating according to the state of the synchronous device;
and sending the second set of devices capable of talking to the other devices, wherein the other devices are used for establishing audio and video calls with a plurality of devices in the second set of devices capable of talking through the IM server.
3. The method according to claim 1, wherein before receiving an inquiry request sent by the APP to inquire a talkable device among a plurality of synchronous devices logged in under the same account, the method further comprises:
receiving login information sent by the APP, wherein the login information at least comprises an account number, a Media Access Control (MAC) address and device Identification (ID) of the plurality of synchronous devices;
generating a virtual device ID according to the login information, and storing the corresponding relation between the virtual device ID and the device IDs of the plurality of synchronous devices;
synchronizing the virtual equipment ID and the account to an IM server;
receiving a login result sent by the IM server after the account is logged in according to the virtual equipment ID;
and sending the login result to the APP.
4. The method according to claim 1, wherein before receiving an inquiry request sent by the APP to inquire a talkable device among a plurality of synchronous devices logged in under the same account, the method further comprises:
judging whether a mutual exclusion device is online or not;
if the judgment result is yes, logging out of the mutual exclusion device;
and synchronizing the state of the mutual exclusion equipment to the IM server.
5. A method for establishing audio and video calls among multiple devices is applied to an application program APP and is characterized by comprising the following steps:
sending a query request for querying talkable equipment in a plurality of synchronous equipment logged under the same account to an Application Program Interface (API) server;
receiving an inquiry response which is sent by the API and carries a first talking device set, wherein the inquiry response is sent by the API server after the API server determines the first talking device set from the plurality of synchronous devices according to the synchronous device state obtained from the communication IM server;
and establishing audio and video calls with a plurality of devices in the first call device set through the IM server.
6. The method of claim 5, wherein establishing, by the IM server, an audio-video call with a plurality of devices in the first set of telephony devices comprises:
sending a call invitation for establishing audio and video calls with a plurality of devices in the first call device set to the IM server;
if receiving an answering response of answering the call invitation by one target device in the first call-capable device set sent by the IM server, establishing an audio-video call with the target device;
and if receiving answering responses sent by the IM server and used for answering the call invitation by the target devices in the first call-capable device set, establishing audio and video calls with the target devices.
7. The method according to claim 5, wherein before sending a query request to the API server for querying a talkable device among a plurality of synchronous devices logged under the same account, the method further comprises:
sending login information to the API server, wherein the login information at least comprises an account number, a Media Access Control (MAC) address and device Identification (ID) of the plurality of synchronous devices;
and receiving a login result which is forwarded by the API server and sent by the IM server after the account is logged in according to a virtual device ID, wherein the virtual device ID is generated by the API server according to the login information and is synchronized to the IM server, and the API server stores the corresponding relation between the virtual device ID and the device IDs of the plurality of synchronous devices.
8. The method according to any one of claims 5 to 7, further comprising:
receiving a call invitation of audio and video calls initiated by other devices except the plurality of synchronous devices through the IM server;
answering or canceling the call invitation.
9. The utility model provides an audio and video conversation between many equipment establishes device, is applied to application program interface API server, its characterized in that includes:
the device comprises a receiving request module, a processing module and a processing module, wherein the receiving request module is used for receiving a query request sent by an application program APP for querying talkable equipment in a plurality of synchronous equipment logged under the same account;
the first acquisition module is used for acquiring the state of the synchronous equipment from the communication IM server according to the query request;
a first determining module, configured to determine a first set of callable devices from the multiple synchronous devices according to the state of the synchronous device;
and the response sending module is used for sending an inquiry response carrying the first talking device set to the APP, wherein the inquiry response is used for indicating the APP to establish audio and video conversation with the plurality of devices in the first talking device set through the IM server.
10. The utility model provides an audio and video conversation between many equipment establishes device, is applied to application APP, its characterized in that includes:
the system comprises a sending request module, a receiving module and a processing module, wherein the sending request module is used for sending a query request for querying talkable equipment in a plurality of synchronous equipment logged under the same account to an Application Program Interface (API) server;
a receiving response module, configured to receive an inquiry response carrying a first set of callable devices sent by the API, where the inquiry response is sent by the API server after the API server determines the first set of callable devices from the multiple synchronization devices according to a synchronization device status obtained from the communication IM server;
and the establishing module is used for establishing audio and video calls with a plurality of devices in the first call device set through the IM server.
11. A computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to perform the method of any one of claims 1 to 4, 5 to 8 when executed.
12. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and the processor is configured to execute the computer program to perform the method of any one of claims 1 to 4 and 5 to 8.
CN202110688591.6A 2021-06-21 2021-06-21 Method and device for establishing audio and video call among multiple devices Pending CN113595866A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110688591.6A CN113595866A (en) 2021-06-21 2021-06-21 Method and device for establishing audio and video call among multiple devices

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110688591.6A CN113595866A (en) 2021-06-21 2021-06-21 Method and device for establishing audio and video call among multiple devices

Publications (1)

Publication Number Publication Date
CN113595866A true CN113595866A (en) 2021-11-02

Family

ID=78244176

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110688591.6A Pending CN113595866A (en) 2021-06-21 2021-06-21 Method and device for establishing audio and video call among multiple devices

Country Status (1)

Country Link
CN (1) CN113595866A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105871680A (en) * 2015-11-18 2016-08-17 乐视致新电子科技（天津）有限公司 Communication method, communication system and display device
CN108881779A (en) * 2018-07-17 2018-11-23 聚好看科技股份有限公司 Video calling between smart machine answers transfer method, system and server
CN110138937A (en) * 2019-05-07 2019-08-16 华为技术有限公司 A kind of call method, equipment and system
CN110191241A (en) * 2019-06-14 2019-08-30 华为技术有限公司 A kind of voice communication method and relevant apparatus
CN111064915A (en) * 2019-11-18 2020-04-24 北京小米移动软件有限公司 Audio and video call method, device, equipment and readable storage medium
CN112543447A (en) * 2019-09-19 2021-03-23 华为技术有限公司 Device discovery method based on address list, audio and video communication method and electronic device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105871680A (en) * 2015-11-18 2016-08-17 乐视致新电子科技（天津）有限公司 Communication method, communication system and display device
CN108881779A (en) * 2018-07-17 2018-11-23 聚好看科技股份有限公司 Video calling between smart machine answers transfer method, system and server
CN112492252A (en) * 2018-07-17 2021-03-12 聚好看科技股份有限公司 Call method and intelligent device
CN110138937A (en) * 2019-05-07 2019-08-16 华为技术有限公司 A kind of call method, equipment and system
CN110191241A (en) * 2019-06-14 2019-08-30 华为技术有限公司 A kind of voice communication method and relevant apparatus
CN112543447A (en) * 2019-09-19 2021-03-23 华为技术有限公司 Device discovery method based on address list, audio and video communication method and electronic device
CN111064915A (en) * 2019-11-18 2020-04-24 北京小米移动软件有限公司 Audio and video call method, device, equipment and readable storage medium

Similar Documents

Publication Publication Date Title
CN100574316C (en) The Multimedia session controller
US9729336B2 (en) System and method for delayed phone conferencing
CN108347337B (en) Conference communication method and device
EP1775985B9 (en) Group call system, terminal and group call control method for rejoining group calls
US20110282953A1 (en) Method and apparatus for providing message conversation by group in a messaging service
CN106412680B (en) Multi-screen control method and device
CN112291238B (en) Data communication method, device, equipment and computer readable storage medium
CN104869106A (en) Sound recording method, voice switching equipment, sound recording server and sound recording system
CN104350718A (en) Methods and apparatus for implementing a conference call
US9319436B2 (en) Method for integrating functions of a telecommunications network in a data network
CN114697282A (en) Message processing method and system, storage medium and electronic device
CN111787524B (en) Internet of things equipment call control method, device and system
CN105281923A (en) Video conference call implementing method and device based on user identifier
CN106210362B (en) Call method and device
CN113852667A (en) Message pushing method and device, storage medium and electronic device
CN111866207B (en) Audio and video conference system number distribution method and system
EP2309674A1 (en) Shared media access for real time first and third party media control
CN103875232B (en) Meeting method and apparatus
CN113595866A (en) Method and device for establishing audio and video call among multiple devices
KR20060042377A (en) Automatic conferencing service
CN101305623B (en) Method and apparatus for determining PT server having controlling function
CN102438005A (en) Method, device and system for processing click-to-dial service
US9743255B2 (en) Telephony collaboration system and method for a trusted environment
KR20150100573A (en) Communication server and communication terminal
CN112532509A (en) Cross-application communication method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20211102

RJ01 Rejection of invention patent application after publication