CN106936836B

CN106936836B - Multimedia communication method and device

Info

Publication number: CN106936836B
Application number: CN201710170237.8A
Authority: CN
Inventors: 高毅
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2017-03-21
Filing date: 2017-03-21
Publication date: 2020-06-02
Anticipated expiration: 2037-03-21
Also published as: CN106936836A

Abstract

The disclosure provides a multimedia communication method and device, and belongs to the technical field of internet communication. The method comprises the following steps: detecting whether the first terminal and a user are in the same position area or not in the multimedia communication process of the first terminal and the second terminal, wherein the user is a user logging in the first terminal; when the first terminal and the user are not detected to be in the same position area, determining a device identifier of a target household device, wherein the target household device is a household device which is matched with the current position of the user and is associated with the first terminal; and sending a communication request to the target household equipment according to the equipment identifier of the target household equipment, wherein the communication request is used for indicating the target household equipment to carry out multimedia communication with the second terminal. According to the method and the device, the target household equipment and the second terminal are used for multimedia communication, so that the flexibility of the multimedia communication is improved.

Description

Multimedia communication method and device

Technical Field

The present disclosure relates to the field of internet communication technologies, and in particular, to a method and an apparatus for multimedia communication.

Background

Currently, multimedia communication such as video communication or voice chat is becoming a more common communication mode; the social application installed on the terminal generally has a multimedia communication function, and the user can perform multimedia communication with the friends of the user through the social application, so that information exchange among the users is facilitated.

In the related art, when multimedia communication is performed between a first terminal and a second terminal, the first terminal acquires voice and/or video of a user in real time through a multimedia acquisition device to obtain multimedia data, and sends the multimedia data to a social contact application server in real time, so that the social contact application server forwards the multimedia data to the second terminal.

Disclosure of Invention

In order to overcome the problems in the related art, the present disclosure provides a method and an apparatus for multimedia communication, where the technical solution is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided a method for multimedia communication, the method being applied in a first terminal, the method including:

detecting whether the first terminal and a user are in the same position area or not in the multimedia communication process of the first terminal and the second terminal, wherein the user is a user logging in the first terminal;

when the first terminal and the user are not detected to be in the same position area, determining a device identifier of a target household device, wherein the target household device is a household device which is matched with the current position of the user and is associated with the first terminal;

and sending a communication request to the target household equipment according to the equipment identifier of the target household equipment, wherein the communication request is used for indicating the target household equipment to carry out multimedia communication with the second terminal.

In the embodiment of the disclosure, in a multimedia communication process between a first terminal and a second terminal, the first terminal may detect whether the first terminal and a user are in the same location area in real time, when it is detected that the first terminal and the user are not in the same location area, the first terminal determines a device identifier of a target home device, and sends a communication request indicating that the target home device performs multimedia communication with the second terminal to the target home device, where the target home device is a home device that is matched with a current location of the user and is associated with the first terminal, so that the user may perform multimedia communication with the second terminal through the target home device. Therefore, multimedia communication can still be carried out between the nearby target household equipment and the second terminal without being nearby the first terminal, and therefore the flexibility of multimedia communication is improved.

In one possible implementation manner, the detecting whether the first terminal and the user are in the same location area includes:

acquiring a position area where the current position of the first terminal is located and a position area where the current position of the user is located;

and if the position area where the current position of the first terminal is located is different from the position area where the current position of the user is located, determining that the first terminal and the user are not located in the same position area.

In the embodiment of the disclosure, the first terminal may determine the location area where the first terminal is located and the location area where the user is located, and determine whether the user and the first terminal are in the same location area directly according to whether the location area where the user is located and the location area where the first terminal is located are the same, so that efficiency of detecting whether the first terminal and the user are in the same location area is improved.

acquiring the current position of the first terminal and the current position of the user;

determining the distance between the first terminal and the user according to the current position of the first terminal and the current position of the user;

and if the distance is greater than the preset distance, determining that the first terminal and the user are not in the same position area.

In the embodiment of the disclosure, the first terminal determines the distance between the first terminal and the user according to the current position of the first terminal and the current position of the user, and if the distance is greater than the preset distance, it is determined that the first terminal and the user are not in the same position region, so that the accuracy of determining whether the first terminal and the user are in the same position region is improved.

In one possible implementation manner, before the detecting whether the first terminal and the user are in the same location area, the method further includes:

and when detecting that the position of the user changes and/or the position of the first terminal changes, executing the step of detecting whether the first terminal and the user are in the same position area.

In the embodiment of the disclosure, the first terminal may detect the position of the user and whether the position of the first terminal changes in real time, and when it is detected that the position of the user changes and/or the position of the first terminal changes, the step of detecting whether the first terminal and the user are in the same position area is executed, so that it is not necessary to detect whether the first terminal and the user are in the same position area in real time, and network resources of the first terminal are saved.

In one possible implementation manner, the determining the device identifier of the target home device includes:

determining a position area where each household device associated with the first terminal is located;

selecting home equipment with the same position area as the position area where the current position of the user is located from each home equipment;

and taking the equipment identifier of the selected home equipment as the equipment identifier of the target home equipment.

In the embodiment of the disclosure, the first terminal may directly use the home equipment with the same location area as the location area where the current location of the user is located as the target home equipment, so that the efficiency of determining the target home equipment is improved.

determining the current position of each household device associated with the first terminal;

respectively determining the distance between each piece of household equipment and the user according to the current position of each piece of household equipment and the current position of the user;

selecting the home equipment closest to the user from each home equipment according to the distance between each home equipment and the user;

In the embodiment of the disclosure, the first terminal takes the home equipment closest to the user as the target home equipment according to the distance between each home equipment and the user, so that the accuracy of determining the target home equipment is improved.

detecting whether the automatic switching function of the first terminal is in an opening state;

and if the automatic switching function of the first terminal is in an opening state, executing the step of detecting whether the first terminal and the user are in the same position area.

In the embodiment of the disclosure, the first terminal may provide an automatic switching function, so that a user may open or close the automatic switching function according to a requirement, and when the first terminal detects that the automatic switching function is in an open state, the step of detecting whether the first terminal and the user are in the same area is executed, thereby improving user experience.

In a possible implementation manner, the sending, according to the device identifier of the target home device, a communication request to the target home device includes:

and sending a communication request to a designated server, wherein the communication request carries the equipment identifier of the target household equipment, so that the designated server forwards the communication request to the target household equipment according to the equipment identifier of the target household equipment.

In the embodiment of the disclosure, the first terminal is associated with the target home equipment through the designated server, and therefore, the first terminal can send the communication request to the target home equipment through the designated server, so that the target home equipment can receive the communication request and directly communicate with the second terminal according to the communication request, and the efficiency of the multimedia communication method is improved.

In a possible implementation manner, after the sending, according to the device identifier of the target home device, a communication request to the target home device, the method further includes:

receiving first multimedia data sent by an appointed server, wherein the first multimedia data are obtained by recording the target household equipment;

and forwarding the first multimedia data to a social application server so that the social application server forwards the first multimedia data to the second terminal.

In the embodiment of the disclosure, the first terminal may further obtain, by using the designated server, first multimedia data recorded by the target home device, and send the first multimedia data to the social application server, so that the social application server forwards the first multimedia data to the second terminal, thereby improving the flexibility of the multimedia communication method.

receiving second multimedia data sent by a social application server, wherein the second multimedia data is recorded by the second terminal;

and forwarding the second multimedia data to a designated server so that the designated server forwards the second multimedia data to the target household equipment.

In the embodiment of the disclosure, the first terminal may receive and acquire the second multimedia data recorded by the second terminal through the social application server, and forward the second multimedia data to the designated server, and the designated server forwards the second multimedia data to the target home equipment, so that the user may view or hear the second multimedia data through the target home equipment without being near the first terminal, thereby improving the flexibility of the multimedia communication method.

According to a second aspect of the embodiments of the present disclosure, there is provided a method for multimedia communication, the method being applied in a target home device, the method including:

receiving a communication request of a first terminal associated with the target household equipment;

according to the communication request, starting multimedia acquisition equipment and multimedia playing equipment of the target household equipment;

and carrying out multimedia communication with a second terminal through the multimedia acquisition equipment and/or the multimedia playing equipment, wherein the second terminal is a terminal for carrying out multimedia communication with the first terminal.

In the embodiment of the disclosure, the target home equipment starts the multimedia acquisition equipment and the multimedia playing equipment of the target home equipment by receiving the communication request of the first terminal associated with the target home equipment according to the communication request, wherein the communication request is a communication request for indicating the target home equipment to perform multimedia communication with the second terminal, so that the target home equipment and the second terminal perform multimedia communication. Therefore, the user does not need to be near the first terminal, and can also carry out multimedia communication with the second terminal through the target household equipment, so that the flexibility of the multimedia communication is improved.

In a possible implementation manner, the performing, by the multimedia capturing device and/or the multimedia playing device, multimedia communication with a second terminal includes:

recording through the multimedia acquisition equipment to obtain first multimedia data, and sending the first multimedia data to a designated server so that the designated server forwards the first multimedia data to the second terminal; and/or the presence of a gas in the gas,

and receiving second multimedia data forwarded by the appointed server, and playing the second multimedia data through the multimedia playing equipment, wherein the second multimedia data is recorded by the second terminal.

In the embodiment of the disclosure, the target home equipment may send the first multimedia data recorded by the target home equipment to the second terminal through the designated server, or may receive the second multimedia data of the second terminal through the designated server, so that a function that a user can communicate with the second terminal only through the target home equipment is achieved, and therefore, usability of the multimedia communication method is improved.

According to a third aspect of the embodiments of the present disclosure, there is provided an apparatus for multimedia communication, the apparatus being applied in a first terminal, the apparatus comprising:

the detection module is used for detecting whether the first terminal and a user are in the same position area or not in the multimedia communication process of the first terminal and the second terminal, wherein the user is a user logging in the first terminal;

the determining module is used for determining the equipment identifier of target household equipment when the first terminal and the user are not in the same position area, wherein the target household equipment is household equipment which is matched with the current position of the user and is associated with the first terminal;

and the sending module is used for sending a communication request to the target household equipment according to the equipment identifier of the target household equipment, wherein the communication request is used for indicating the target household equipment to carry out multimedia communication with the second terminal.

In one possible implementation, the detection module includes:

a first obtaining unit, configured to obtain a location area where a current location of the first terminal is located and a location area where a current location of the user is located;

a first determining unit, configured to determine that the first terminal and the user are not in the same location area if a location area where the current location of the first terminal is located is different from a location area where the current location of the user is located.

In one possible implementation, the detection module includes:

a second obtaining unit, configured to obtain a current location of the first terminal and a current location of the user;

a second determining unit, configured to determine a distance between the first terminal and the user according to a current location of the first terminal and a current location of the user;

a third determining unit, configured to determine that the first terminal and the user are not in the same location area if the distance is greater than a preset distance.

In a possible implementation manner, the detecting module is further configured to detect whether the first terminal and the user are in the same location area when detecting that the location of the user changes and/or the location of the first terminal changes.

In one possible implementation, the determining module includes:

a fourth determining unit, configured to determine a location area where each piece of home equipment associated with the first terminal is located;

the first selection unit is used for selecting the household equipment with the same position area as the position area where the current position of the user is located from each household equipment;

the first serving unit is configured to serve the device identifier of the selected home device as the device identifier of the target home device.

In one possible implementation, the determining module includes:

a fifth determining unit, configured to determine a current location of each household device associated with the first terminal;

a sixth determining unit, configured to determine, according to the current location of each piece of home equipment and the current location of the user, a distance between each piece of home equipment and the user respectively;

the second selection unit is used for selecting the household equipment which is closest to the user from the household equipment according to the distance between the household equipment and the user;

and the second is used as a unit for using the device identifier of the selected home device as the device identifier of the target home device.

In a possible implementation manner, the detecting module is further configured to detect whether an automatic switching function of the first terminal is in an on state; and if the automatic switching function of the first terminal is in an opening state, detecting whether the first terminal and the user are in the same position area.

In a possible implementation manner, the sending module is further configured to send a communication request to a designated server, where the communication request carries the device identifier of the target home device, so that the designated server forwards the communication request to the target home device according to the device identifier of the target home device.

In one possible implementation, the apparatus further includes:

the first receiving module is used for receiving first multimedia data sent by a designated server, wherein the first multimedia data is obtained by recording the target household equipment;

the first forwarding module is used for forwarding the first multimedia data to a social application server so that the social application server forwards the first multimedia data to the second terminal.

In one possible implementation, the apparatus further includes:

the second receiving module is used for receiving second multimedia data sent by a social application server, wherein the second multimedia data are recorded by the second terminal;

and the second forwarding module is used for forwarding the second multimedia data to a designated server so that the designated server forwards the second multimedia data to the target household equipment.

According to a fourth aspect of the embodiments of the present disclosure, there is provided an apparatus for multimedia communication, the apparatus being applied in a target home device, the apparatus including:

the third receiving module is used for receiving a communication request of the first terminal associated with the target household equipment;

the starting module is used for starting the multimedia acquisition equipment and the multimedia playing equipment of the target household equipment according to the communication request;

and the communication module is used for carrying out multimedia communication with a second terminal through the multimedia acquisition equipment and/or the multimedia playing equipment, and the second terminal is a terminal for carrying out multimedia communication with the first terminal.

In one possible implementation, the communication module includes:

the recording unit is used for recording through the multimedia acquisition equipment to obtain first multimedia data;

a sending unit, configured to send the first multimedia data to a designated server, so that the designated server forwards the first multimedia data to the second terminal; and/or the presence of a gas in the gas,

a receiving unit, configured to receive the second multimedia data forwarded by the designated server;

and the playing unit is used for playing the second multimedia data through the multimedia playing equipment, wherein the second multimedia data is obtained by recording the second terminal.

According to a fifth aspect of the embodiments of the present disclosure, there is provided an apparatus for multimedia communication, the apparatus being applied in a first terminal, the apparatus comprising:

a first processor;

a first memory for storing first processor-executable instructions;

wherein the first processor is configured to:

According to a sixth aspect of the embodiments of the present disclosure, there is provided an apparatus for multimedia communication, the apparatus being applied in a target home device, the apparatus including:

a second processor;

a second memory for storing second processor-executable instructions;

wherein the second processor is configured to:

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

in the embodiment of the disclosure, in a multimedia communication process between a first terminal and a second terminal, the first terminal may detect whether the first terminal and a user are in the same position area in real time, when it is detected that the first terminal and the user are not in the same position area, the first terminal determines a device identifier of a target home device, and sends a communication request indicating that the target home device performs multimedia communication with the second terminal to the target home device, where the target home device is a home device that is matched with a current position of the user and is associated with the first terminal; the target home equipment receives the communication request of the first terminal associated with the target home equipment, and starts the multimedia acquisition equipment and the multimedia playing equipment of the target home equipment according to the communication request, so that a user does not need to be near the first terminal, and can perform multimedia communication with the second terminal through the target home equipment near the user, and the flexibility of multimedia communication is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a flow chart illustrating a method of multimedia communication, according to an exemplary embodiment;

FIG. 2 is a flow diagram illustrating a method of multimedia communication, according to an exemplary embodiment;

FIG. 3 is a signaling interaction diagram illustrating a multimedia communication, according to an example embodiment;

FIG. 4 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment;

FIG. 5 is a block diagram illustrating the structure of a detection module according to an exemplary embodiment;

FIG. 6 is a block diagram illustrating the structure of a detection module in accordance with an exemplary embodiment;

FIG. 7 is a block diagram illustrating the structure of a determination module in accordance with one illustrative embodiment;

FIG. 8 is a block diagram illustrating the structure of a determination module in accordance with one illustrative embodiment;

FIG. 9 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment;

FIG. 10 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment;

FIG. 11 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment;

FIG. 12 is a block diagram illustrating the structure of a communications module in accordance with an exemplary embodiment;

FIG. 13 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment;

fig. 14 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment.

Detailed Description

To make the objects, technical solutions and advantages of the present disclosure more apparent, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

In the related art, when multimedia communication is performed between a first terminal and a second terminal, the first terminal acquires voice and/or video of a user in real time through a multimedia acquisition device to obtain multimedia data, and sends the multimedia data to a social contact application server in real time, so that the social contact application server forwards the multimedia data to the second terminal. However, in the communication process, the user needs to be near the first terminal, and the first terminal can acquire the voice and/or the video of the user in real time, and when the user is far away from the first terminal, the first terminal cannot acquire the voice and/or the video of the user in real time, that is, the first terminal cannot send multimedia data to the social application server, that is, the first terminal and the second terminal cannot continue to perform multimedia communication, so that the flexibility of the method is poor.

In the embodiment of the disclosure, in the multimedia communication process of the first terminal and the second terminal, the first terminal may detect whether the first terminal and the user are in the same location area in real time, and when it is detected that the first terminal and the user are not in the same location area, the first terminal determines a target home device which is matched with the current location of the user and is associated with the first terminal. Then, the first terminal obtains the device identifier of the target home device and sends a communication request to the target home device, wherein the communication request is used for indicating the target home device to perform multimedia communication with the second terminal, so that the target home device performs multimedia communication with the second terminal. Therefore, even if the user is not near the first terminal, the user can carry out multimedia communication with the second terminal through the target household equipment near the user, and therefore the flexibility of the multimedia communication is improved.

Fig. 1 is a flowchart illustrating a method for multimedia communication, which is applied to a first terminal, according to an exemplary embodiment, and includes the following steps, as shown in fig. 1.

In step 101, during a multimedia communication between a first terminal and a second terminal, it is detected whether the first terminal and a user are in a same location area, and the user is a user logged in the first terminal.

In step 102, when it is detected that the first terminal and the user are not in the same location area, determining a device identifier of a target home device, where the target home device is a home device that is matched with the current location of the user and is associated with the first terminal.

In step 103, a communication request is sent to the target home device according to the device identifier of the target home device, where the communication request is used to instruct the target home device to perform multimedia communication with the second terminal.

In one possible design, detecting whether the first terminal and the user are in the same location area includes:

and if the position area where the current position of the first terminal is located is different from the current position of the user, determining that the first terminal and the user are not in the same position area.

acquiring the current position of a first terminal and the current position of a user;

In one possible design, detecting whether the first terminal and the user are in front of the same location area, the method further includes:

the step of detecting whether the first terminal and the user are in the same location area is performed when a change in the location of the user and/or a change in the location of the first terminal is detected.

In one possible design, determining the device identifier of the target home device includes:

determining a position area where each household device associated with a first terminal is located;

selecting home equipment with the same location area as the location area where the current location of the user is located from each home equipment;

In one possible design, sending a communication request to a target home device according to a device identifier of the target home device includes:

In one possible design, after sending the communication request to the target home device according to the device identifier of the target home device, the method further includes:

receiving first multimedia data sent by an appointed server, wherein the first multimedia data are obtained by recording target household equipment;

receiving second multimedia data sent by the social application server, wherein the second multimedia data is recorded by a second terminal;

In the embodiment of the disclosure, in a multimedia communication process between a first terminal and a second terminal, the first terminal may detect whether the first terminal and a user are in the same location area in real time, when it is detected that the first terminal and the user are not in the same location area, the first terminal determines a device identifier of a target home device, and sends a communication request indicating that the target home device performs multimedia communication with the second terminal to the target home device, where the target home device is a home device that is matched with a current location of the user and is associated with the first terminal, so that the user may perform multimedia communication with the second terminal through the target home device, and thus, the user may still perform multimedia communication with the second terminal through the nearby target home device without being in the vicinity of the first terminal, and thus, flexibility of the multimedia communication is improved.

All the above optional technical solutions may be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described herein again.

Fig. 2 is a flowchart illustrating a method for multimedia communication, which is applied to a target home device, according to an exemplary embodiment, and includes the following steps, as shown in fig. 2.

In step 201, a communication request of a first terminal associated with a target household device is received.

In step 202, according to the communication request, the multimedia acquisition device and the multimedia playing device of the target home device are turned on.

In step 203, multimedia communication is performed with a second terminal through the multimedia capturing device and/or the multimedia playing device, where the second terminal is a terminal performing multimedia communication with the first terminal.

In one possible design, the multimedia communication with the second terminal through the multimedia capturing device and/or the multimedia playing device includes:

recording through the multimedia acquisition equipment to obtain first multimedia data, and sending the first multimedia data to a designated server so that the designated server forwards the first multimedia data to a second terminal; and/or the presence of a gas in the gas,

and receiving second multimedia data forwarded by the appointed server, and playing the second multimedia data through the multimedia playing equipment, wherein the second multimedia data is recorded by a second terminal.

Fig. 3 is a signaling interaction diagram illustrating a multimedia communication, according to an example embodiment, as shown in fig. 3, including the following steps.

In step 301, during multimedia communication between a first terminal and a second terminal, the first terminal detects whether the first terminal and a user, who is a user logged in the first terminal, are in the same location area.

In the embodiment of the disclosure, in the multimedia communication process between the first terminal and the second terminal, when the user is not near the first terminal, the user may also perform multimedia communication with the second terminal through the target home equipment near the user, and therefore, the first terminal needs to detect whether the user and the first terminal are in the same location area in real time.

In this step, the first terminal may determine whether the first terminal and the user are in the same location area by determining whether the location area where the user is located is the same as the location area where the first terminal is located, that is, the following first implementation manner; the first terminal may also determine whether the first terminal and the user are in the same location area according to the distance between the current location of the first terminal and the current location of the user by calculating the distance, that is, the following second implementation manner; the first terminal may further determine whether the first terminal and the user are in the same location area according to a charging state or a current state of the first terminal when the location of the user changes, that is, the following third implementation manner.

In a first implementation, this step may be implemented by the following steps 3011a-3012 a.

In step 3011a, the first terminal obtains a location area where the current location of the first terminal is located and a location area where the current location of the user is located.

The step of the first terminal acquiring the location area where the current location of the first terminal is located may be: the first terminal determines a position area where the current position of the first terminal is located from the corresponding relation between the current position and the position area according to the current position of the first terminal by acquiring the current position of the first terminal.

The first terminal can be provided with a terminal position detection module, and the first terminal can acquire the current position of the first terminal in real time through the terminal position detection module.

The first terminal may be equipped with a Positioning unit such as a GPS (Global Positioning System) for detecting a position of the first terminal, and the terminal position detecting module of the first terminal may obtain a current position of the first terminal in real time through the Positioning unit.

The step of the first terminal acquiring the location area where the current location of the user is located may be: the first terminal acquires the current position of the user, and determines the position area where the current position of the user is located from the corresponding relation between the current position and the position area according to the current position of the user.

The first terminal is provided with a user position detection module, and the first terminal is associated with a human body sensor arranged in a living room, a kitchen and other position areas through the user position detection module; the human body sensor is used for detecting the current position of the user, and therefore, the step of the first terminal acquiring the current position of the user may be:

the first terminal receives a current position of the user detected by the human body sensor.

The first terminal stores a position area in which each human body sensor associated with the first terminal is installed; when a user approaches a certain human body sensor and the human body sensor senses that the user approaches, the human body sensor sends a prompt message for prompting the approach of the user to the first terminal, and the prompt message carries an identifier of the human body sensor; therefore, the step of the first terminal acquiring the location area where the current location of the user is located may be:

the first terminal receives a prompt message of the human body sensor and acquires an identifier of the human body sensor from the prompt message; and determining the position area where the current position of the user is located from the corresponding relation between the position area and the identifier of the human body sensor according to the identifier of the human body sensor.

The user position detection module may be an intelligent home APP (Application, Application software) installed in the first terminal and capable of managing the human body sensor, or may be a module in other software and managing the human body sensor, which is not specifically limited in this embodiment of the disclosure.

In step 3012a, if the location area where the current location of the first terminal is located is different from the location area where the current location of the user is located, the first terminal determines that the first terminal and the user are not in the same location area.

In this step, the first terminal determines whether the location area where the current location of the user is located is the same as the location area where the current location of the first terminal is located, and if the location area where the current location of the user is located is not the same as the location area where the current location of the first terminal is located, it is determined that the first terminal and the user are not located in the same location area. And if the position area where the current position of the user is located is the same as the position area where the current position of the first terminal is located, determining that the first terminal and the user are in the same position area.

In a second implementation, this step may be implemented by the following steps 3011b-3012 b.

In step 3011b, the first terminal obtains a current location of the first terminal and a current location of the user, and determines a distance between the first terminal and the user according to the current location of the first terminal and the current location of the user.

In this step, the first terminal may determine the distance between the first terminal and the user by obtaining the current location of the user and the current location of the first terminal, and then calculating the distance between the current location of the user and the current location of the first terminal according to the current location of the user and the current location of the first terminal.

The first terminal can acquire the current position of the user through the user position detection module, and acquire the current position of the first terminal through the terminal position detection module.

In step 3012b, if the distance is greater than the preset distance, the first terminal determines that the first terminal is not in the same location area as the user.

In this step, the first terminal judges whether the distance is greater than a preset distance according to the distance between the first terminal and the user, and if the distance is greater than the preset distance, the first terminal and the user are determined not to be in the same position area; and if the distance is smaller than or equal to the preset distance, determining that the first terminal and the user are in the same position area.

The preset distance may be set and changed according to a user requirement, which is not specifically limited in the embodiment of the present disclosure. For example, the preset distance may be 10m, 5m, or the like.

In a third implementation, this step may be implemented by the following steps 3011c-3012 c.

In step 3011c, when it is detected that the location of the user has changed, the first terminal acquires a charging status and a current status of the first terminal.

In this step, the first terminal may further detect whether the location of the user changes, and when it is detected that the location of the user changes, the first terminal obtains a charging state or a current state of the first terminal.

The step of the first terminal detecting whether the user location changes may be: the first terminal acquires the current position of a user and the previous position of the user at the previous moment, determines that the position of the user is changed if the previous position of the user is different from the current position, and determines that the position of the user is not changed if the previous position of the user is the same as the current position.

The step of the first terminal acquiring the charging state and the current state of the first terminal may be: the first terminal calls a system interface of the first terminal to acquire the charging state of the first terminal; and the first terminal acquires the current state of the first terminal through a terminal sensor in the first terminal. The charging state may be charging or non-charging, and the current state may be a moving state or a static state.

The first terminal is provided with a user position detection module and a terminal position detection module, the first terminal can detect whether the position of a user changes through the user position detection module, when the user position detection module detects that the position of the user changes, the first terminal can send a detection instruction to the terminal position detection module through the user position detection module, and the detection instruction is used for indicating the terminal position detection module to detect the charging state and the current state detected by the first terminal; the terminal position detection module receives the detection instruction, acquires the current state of the first terminal through the terminal sensor according to the detection instruction, and acquires the charging state of the first terminal by calling a system interface of the first terminal.

The terminal sensor may be a gyroscope or the like installed in the first terminal, which is not particularly limited in this disclosure, and for example, the terminal sensor may also be an acceleration sensor or the like.

In a possible design provided by the embodiment of the present disclosure, when the position movement range of the user is small, the user can still perform multimedia communication with the second terminal through the first terminal, and at this time, the first terminal can ignore the movement of the user within the preset range. Therefore, the step of the first terminal determining whether the location of the user changes according to the location area where the previous location of the user is located and the location area where the current location of the user is located may further be: the first terminal acquires the previous position and the current position of a user, acquires a position area where the current position of the user is located and the position area where the previous position of the user is located according to the current position and the previous position, determines that the position of the user changes if the position area where the current position is located is different from the position area where the previous position is located, and determines that the position of the user does not change if the position area where the current position is located is the same as the position area where the previous position is located.

In step 3012c, the first terminal determines that the first terminal is not in the same location area as the user if it is detected that the first terminal is in a charging and/or stationary state.

In this step, when the first terminal detects that the location of the user changes, because the first terminal in the charging state cannot move along with the change of the location of the user, if the first terminal detects that the charging state of the first terminal is charging, the first terminal may determine that the first terminal and the user are not in the same location area.

If the current state of the first terminal is a stationary state, i.e., the first terminal does not move with the change of the location of the user, the first terminal may determine that the first terminal is not in the same location area as the user.

Similarly, if the charging state of the first terminal is charging and the current state is a static state, the first terminal may also determine that the first terminal and the user are not in the same location area.

The first terminal is provided with a user position detection module and a terminal position detection module, when the user position detection module detects that the position of a user changes, the first terminal sends an acquisition instruction to the terminal position detection module through the user position detection module, and the acquisition instruction is used for indicating the terminal position detection module to acquire the current position of the first terminal according to the acquisition instruction.

For example, when a human body sensor installed in a living room senses that a user approaches, a prompt message is sent to a user position detection module in a first terminal, the first terminal detects that the position of the user is changed from a kitchen to the living room according to the prompt message, at this time, the user position detection module sends an acquisition instruction to a terminal position detection module to acquire the charging state and the current state of the first terminal, if the first terminal is in a charging and/or static state, it can be judged that the position of the first terminal does not move, the first terminal is still in the kitchen, and it is determined that the first terminal and the user are not in the same position area.

In a possible design provided by the embodiment of the present disclosure, when the first terminal and the second terminal perform multimedia communication, both the user and the first terminal are in the same location area, and only when the location of the first terminal or the location of the user changes, the location of the first terminal and the location of the user may not be in the same location area. Therefore, in order to save resources of the first terminal, the first terminal may further determine whether the first terminal and the user are in the same location area when detecting that the location of the user and the location of the first terminal are changed, and therefore, before step 301, the method further includes:

the method comprises the steps that a first terminal detects whether the position of a user changes in real time and detects whether the position of the first terminal changes; the first terminal only performs step 301 when the first terminal detects that the location of the user has changed and/or the location of the first terminal has changed.

When the first terminal detects that the location of the user has not changed and the location of the first terminal has not changed, it continues to detect whether the location of the user has changed in real time, and detects whether the location of the first terminal has changed, until it detects that the location of the user has changed and/or the location of the first terminal has changed, then step 301 is executed.

The step of the first terminal detecting whether the position of the first terminal changes may be: the method comprises the steps that a first terminal obtains the current position of the first terminal and the previous position of the first terminal at the previous moment, if the previous position of the first terminal is different from the current position, the position of the first terminal is determined to be changed, and if the previous position of the first terminal is the same as the current position, the position of the first terminal is determined not to be changed.

Meanwhile, the first terminal may further determine whether the position of the first terminal changes according to the charging state and the current state of the first terminal, that is, the step of the first terminal detecting whether the position of the first terminal changes may further be: the first terminal obtains the charging state and the current state of the first terminal, and if the charging state of the first terminal is in charging and/or the current state of the first terminal is in a static state, the position of the first terminal is determined not to be changed.

In a possible design provided by the embodiment of the present disclosure, an automatic switching function is set in the first terminal, and when the automatic switching function of the first terminal is in an open state, if the first terminal detects that the first terminal and the user are not in the same location area, the first terminal is automatically switched to the target home device, so that the user performs multimedia communication with the second terminal through the target home device, and therefore, before the first terminal detects whether the first terminal and the user are in the same location area, the method further includes: the method comprises the steps that a first terminal detects whether an automatic switching function of the first terminal is in an opening state; if the automatic switching function of the first terminal is in the on state, executing step 301; and if the automatic switching function of the first terminal is in a closed state, prompting a user whether to start the automatic switching function.

In step 302, when it is detected that the first terminal and the user are not in the same location area, the first terminal determines a device identifier of a target home device, where the target home device is a home device that is matched with the current location of the user and is associated with the first terminal.

In this step, when it is detected that the first terminal and the user are not in the same location area, the first terminal may determine, according to the current location of the user, the home equipment that is matched with the current location of the user from the home equipment associated with the first terminal.

The first terminal can send the current position of the user to the home equipment management module in the first terminal through the user position detection module in the first terminal, so that the home equipment management module can determine home equipment matched with the current position of the user from home equipment associated with the first terminal according to the current position of the user.

The target home equipment is home equipment matched with the current position of the user, and the first terminal can directly take home equipment in the position area where the user is located as the target home equipment by determining the position area where each home equipment is located, namely, the following first implementation mode; the first terminal may also take the home device closest to the user as the target home device by determining a distance between the current location of the home device and the current location of the user, that is, the following second implementation manner.

For the first implementation, this step may be implemented by the following steps 3021a to 3023 a.

In step 3021a, the first terminal determines a location area where each household device associated with the first terminal is located.

In this step, the first terminal stores in advance the location area where each home device associated with the first terminal is located.

In this step, the first terminal may also obtain a current location of each piece of home equipment associated with the first terminal, and determine, according to the current location of each piece of home equipment, a location area corresponding to the current location of each piece of home equipment, that is, a location area where each piece of home equipment is located, from a correspondence between the current location and the location area.

The first terminal can determine the location area of each household device through a household device management module in the first terminal. The first terminal is provided with a home equipment management module for managing home equipment in advance, and can be associated with at least one home equipment through the home equipment management module; and acquiring the current position of each household device through the household device management module, and storing the current position of each household device. The home equipment management module determines a position area corresponding to the current position of each home equipment, namely the position area where each home equipment is located, from the corresponding relation between the current position and the position area according to the current position of each home equipment.

The first terminal and the home equipment are associated, namely the first terminal and the home equipment log in a designated server through the same account.

The home device management module may be an intelligent home APP installed in the first terminal, or may also be a management module in other software, which is not specifically limited in this embodiment of the disclosure. The device identifier of the home device may be an ID (Identity) of the home device and/or a name of the device, and the like, which is not specifically limited in this disclosure. The designated server may be a cloud server, or may be another server that can associate the first terminal and the home device, which is not specifically limited in this disclosure.

For example, if the home device management module is an intelligent home APP installed in a first terminal, the designated server is a cloud server, and after the first terminal and the home device are networked, the intelligent home APP in the first terminal can be connected with the home device through the cloud server. The intelligent home APP in the first terminal logs in the cloud server through the cloud service account registered by the user, and the current position of the home equipment associated with the first terminal is obtained through the cloud server.

In step 3022a, the first terminal selects, from each home device, a home device having a location area that is the same as a location area where the current location of the user is located.

In this step, the first terminal determines, according to the location area where the current location of the user is located, home devices whose location areas are the same as the location area where the current location of the user is located from the location area where each home device is located.

The first terminal can select a location area where the current location of the user is located from the location area where each piece of home equipment is located through a home equipment management module in the first terminal.

In step 3023a, the first terminal uses the device identifier of the selected home device as the device identifier of the target home device.

In this step, the first terminal obtains the device identifier of the selected home device, and uses the device identifier as the device identifier of the target home device.

The first terminal can acquire the device identifier of the selected home device through the home device management module, and use the device identifier of the selected home device as the device identifier of the target home device, so that the user is in the location area where the target home device is located.

For the second implementation, this step may be implemented by the following steps 3021b to 3023 b.

In step 3021b, the first terminal determines a current location of each household device associated with the first terminal, and determines a distance between each household device and the user according to the current location of each household device and the current location of the user.

In this step, the step of determining the current position of each home device by the first terminal is the same as step 3021a, which is not described herein again.

Then, the first terminal respectively calculates the distance between the current position of each household device and the current position of the user according to the current position of each household device and the current position of the user. The first terminal can respectively calculate the distance between each piece of home equipment and the user according to the determined current position of each piece of home equipment and the current position of the user through the home equipment management module.

In step 3022b, the first terminal selects a home device closest to the user from each home device according to the distance between the home device and the user.

In this step, in order to facilitate the user to perform multimedia communication with the second terminal through the home device closest to the user, the first terminal may select the home device closest to the user. The first terminal can select the home equipment with the minimum distance between the home equipment and the user from the distances between the plurality of home equipment and the user according to the distance between each home equipment and the user through the home equipment management module.

In step 3023b, the first terminal uses the device identifier of the selected home device as the device identifier of the target home device.

This step is the same as the step 3023a, and is not described herein again.

In step 303, the first terminal sends a communication request to the target home device according to the device identifier of the target home device, where the communication request is used to instruct the target home device to perform multimedia communication with the second terminal.

In the embodiment of the present disclosure, since the target home device is associated with the first terminal through the designated server, the first terminal needs to send a communication request to the first target home device through the designated server. Therefore, the step can be: the first terminal sends a communication request to a designated server, wherein the communication request carries the equipment identifier of the target household equipment, so that the designated server forwards the communication request to the target household equipment according to the equipment identifier of the target household equipment.

Meanwhile, when the first terminal sends a communication request to the target household equipment according to the equipment identification of the target household equipment, the first terminal closes the multimedia acquisition equipment and the multimedia playing equipment of the first terminal.

In this step, the first terminal may send a communication request to the designated server through the multimedia communication module, where the communication request carries the device identifier of the target home device and the first identifier of the first terminal, and the designated server receives the communication request sent by the first terminal, obtains the device identifier of the target home device from the communication request, and forwards the communication request to the target home device according to the device identifier.

The first identifier may be a specific account registered in the specific server by the user, which is not specifically limited in this embodiment of the disclosure. For example, the designated server may be a cloud server, and the designated account may be a mailbox registered by the user in the cloud server or a mobile phone number of the user.

In step 304, the target home device receives the communication request of the first terminal, and starts the multimedia acquisition device and the multimedia playing device of the target home device according to the communication request.

In the embodiment of the disclosure, the target home device has a multimedia control module, so that after receiving the communication request of the first terminal, the target home device can start a multimedia acquisition device and a multimedia playing device through the multimedia control module.

In step 305, the target home device performs multimedia communication with a second terminal through the multimedia capturing device and/or the multimedia playing device, where the second terminal is a terminal performing multimedia communication with the first terminal.

In this embodiment of the disclosure, the target home device may also perform multimedia communication with the second terminal through the designated server, and therefore, this step may be: the target home equipment records through the multimedia acquisition equipment to obtain first multimedia data, and sends the first multimedia data to the designated server so that the designated server forwards the first multimedia data to the second terminal; and/or the target household equipment receives second multimedia data forwarded by the appointed server, and the second multimedia data is played through the multimedia playing equipment and is obtained by recording a second terminal.

The first multimedia data and the second multimedia data may be audio data and/or video data, which is not particularly limited in this disclosure.

It should be noted that, when the first terminal and the second terminal perform multimedia communication, the first terminal may send the multimedia data of the first terminal and the third identifier of the first terminal to the social application server through the video communication module, so that the social application server determines, according to the third identifier, the second terminal performing multimedia communication with the first terminal corresponding to the third identifier, and then forwards the multimedia data to the second terminal according to the second identifier of the second terminal.

The third identifier may be a social application account number registered by the first user in the social application server, or a mobile phone number of the user, and the like, which is not specifically limited in this embodiment of the disclosure.

In order to improve the efficiency of the user performing multimedia communication with the second terminal through the target home equipment, the social application server and the designated server in this step may both be the same server, and the first identifier and the third identifier of the first terminal are the same (for example, the first identifier and the third identifier are both the same phone number or mailbox of the user), at this time, the designated server may obtain the second identifier of the second terminal performing multimedia communication with the first terminal according to the communication request sent by the first terminal and the first identifier of the first terminal, and establish communication connection between the second terminal and the target home equipment, that is, the designated server stores the corresponding relationship between the second identifier of the second terminal and the equipment identifier of the target home equipment; then, the appointed server receives first multimedia data sent by the target household equipment and directly sends the first multimedia data to the second terminal; and/or the presence of a gas in the gas,

and the appointed server receives second multimedia data sent by the second terminal and sends the second multimedia data to the target home equipment, the target home equipment plays the second multimedia data through the multimedia playing equipment, and the second multimedia data are obtained by recording the second terminal. And then, the user can directly carry out multimedia communication with the second terminal through the target household equipment.

Meanwhile, the first terminal disconnects the multimedia communication connection between the first terminal and the second terminal.

In a possible design provided by the embodiment of the present disclosure, the designated server and the social application server are two different servers, that is, the target home device cannot directly perform multimedia communication with the second terminal, at this time, the first terminal obtains first multimedia data recorded by the target home device and forwards second multimedia data sent by the second terminal to the target home device, so that multimedia communication is continuously performed between the first terminal and the second terminal. The process may be: the method comprises the steps that an appointed server receives first multimedia data sent by target household equipment and sends the first multimedia data to a first terminal; the first terminal receives first multimedia data sent by the appointed server, the first multimedia data are sent to a social application server, and the social application server sends the first multimedia data to the second terminal; and/or the presence of a gas in the gas,

the social application server receives second multimedia data sent by the second terminal and sends the second multimedia data to the first terminal; the first terminal receives second multimedia data sent by the social application server, the first terminal sends the second multimedia data to the designated server, the designated server receives the second multimedia data sent by the first terminal and sends the second multimedia data to the target home equipment, the target home equipment plays the second multimedia data through the multimedia playing equipment, and the second multimedia data are obtained by recording the second terminal.

At this time, the first terminal does not disconnect the multimedia communication connection between the first terminal and the second terminal. Furthermore, the user can perform multimedia communication with the second terminal through the target household equipment and the first terminal.

Fig. 4 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment. The apparatus is applied in a first terminal, and referring to fig. 4, the apparatus includes a detection module 401, a determination module 402 and a sending module 403.

The detecting module 401 is configured to detect whether the first terminal and a user are in the same location area during multimedia communication between the first terminal and the second terminal, where the user is a user logging in the first terminal;

the determining module 402 is configured to determine, when it is detected that the first terminal and the user are not in the same location area, a device identifier of a target home device, where the target home device is a home device that matches the current location of the user and is associated with the first terminal;

the sending module 403 is configured to send a communication request to the target home device according to the device identifier of the target home device, where the communication request is used to instruct the target home device to perform multimedia communication with the second terminal.

In one possible design, referring to fig. 5, the detection module 401 includes:

a first obtaining unit 4011, configured to obtain a location area where a current location of the first terminal is located and a location area where a current location of the user is located;

the first determining unit 4012 is configured to determine that the first terminal and the user are not in the same location area if the location area where the current location of the first terminal is located is different from the location area where the current location of the user is located.

In one possible design, referring to fig. 6, the detection module 401 includes:

a second obtaining unit 4013 configured to obtain a current location of the first terminal and a current location of the user;

a second determination unit 4014 configured to determine a distance between the first terminal and the user according to a current location of the first terminal and a current location of the user;

a third determination unit 4015 configured to determine that the first terminal is not in the same location area as the user if the distance is greater than the preset distance.

In one possible design, the detecting module 401 is further configured to detect whether the first terminal and the user are in the same location area when detecting that the location of the user has changed and/or the location of the first terminal has changed.

In one possible design, referring to fig. 7, the determining module 402 includes:

a fourth determining unit 4021, configured to determine a location area where each home device associated with the first terminal is located;

a first selecting unit 4022, configured to select, from each home device, a home device whose location area is the same as a location area where a current location of a user is located;

a first as unit 4023, configured to take the device identifier of the selected home device as the device identifier of the target home device.

In one possible design, referring to fig. 8, the determining module 402 includes:

a fifth determining unit 4024 configured to determine a current location of each home device associated with the first terminal;

a sixth determining unit 4025, configured to determine a distance between each piece of home equipment and the user according to the current location of each piece of home equipment and the current location of the user;

a second selecting unit 4026, configured to select, according to a distance between each household device and a user, a household device closest to the user from each household device;

a second as unit 4027, configured to take the device identifier of the selected home device as the device identifier of the target home device.

In a possible design, the detecting module 401 is further configured to detect whether an automatic switching function of the first terminal is in an on state; and if the automatic switching function of the first terminal is in an opening state, detecting whether the first terminal and the user are in the same position area.

In a possible design, the sending module 403 is further configured to send a communication request to a specified server, where the communication request carries a device identifier of a target home device, so that the specified server forwards the communication request to the target home device according to the device identifier of the target home device.

In one possible design, referring to fig. 9, the apparatus further includes a first receiving module 404 and a first forwarding module 405.

The first receiving module 404 is configured to receive first multimedia data sent by a designated server, where the first multimedia data is recorded by a target home device;

the first forwarding module 405 is configured to forward the first multimedia data to a social application server, so that the social application server forwards the first multimedia data to the second terminal.

In one possible design, referring to fig. 10, the apparatus further includes a second receiving module 406 and a second forwarding module 407.

The second receiving module 406 is configured to receive second multimedia data sent by the social application server, where the second multimedia data is recorded by the second terminal;

the second forwarding module 407 is configured to forward the second multimedia data to a designated server, so that the designated server forwards the second multimedia data to a target home device.

Fig. 11 is a block diagram illustrating an apparatus for multimedia communication, according to an example embodiment. The device is applied to target household equipment, and referring to fig. 11, the device includes a third receiving module 501, a starting module 502 and a communication module 503.

The third receiving module 501 is configured to receive a communication request of a first terminal associated with a target household device;

the starting module 502 is configured to start a multimedia acquisition device and a multimedia playing device of a target home device according to the communication request;

the communication module 503 is configured to perform multimedia communication with a second terminal through the multimedia capturing device and/or the multimedia playing device, where the second terminal is a terminal performing multimedia communication with the first terminal.

In one possible design, referring to fig. 12, the communication module 503 includes:

a recording unit 5031 configured to record, by a multimedia acquisition device, a first multimedia data;

a sending unit 5032 configured to send the first multimedia data to a designated server so that the designated server forwards the first multimedia data to the second terminal; and/or the presence of a gas in the gas,

a receiving unit 5033 configured to receive the second multimedia data forwarded by the designated server;

a playing unit 5034, configured to play the second multimedia data recorded by the second terminal through the multimedia playing device.

It should be noted that: in the multimedia communication apparatus provided in the foregoing embodiment, only the division of the functional modules is illustrated in the foregoing, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the apparatus is divided into different functional modules to complete all or part of the functions described above. In addition, the multimedia communication apparatus and the multimedia communication method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments and are not described herein again.

Fig. 13 is a block diagram illustrating an apparatus 1200 for multimedia communication, according to an example embodiment. For example, the apparatus 1200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 13, the apparatus 1200 may include one or more of the following components: a first processing component 1202, a first memory 1204, a first power component 1206, a first multimedia component 1208, a first audio component 1210, a first input/output (I/O) interface 1212, a first sensor component 1214, and a first communications component 1216.

The first processing component 1202 generally controls overall operation of the apparatus 1200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The first processing component 1202 may include one or more first processors 1220 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the first processing component 1202 may include one or more modules that facilitate interaction between the first processing component 1202 and other components. For example, the first processing component 1202 may include a multimedia module to facilitate interaction between the first multimedia component 1208 and the first processing component 1202.

The first memory 1204 is configured to store various types of data to support operations at the apparatus 1200. Examples of such data include instructions for any application or method operating on the device 1200, contact data, phonebook data, messages, pictures, videos, and so forth. The first memory 1204 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A first power supply component 1206 provides power to the various components of the device 1200. The first power component 1206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the apparatus 1200.

The first multimedia component 1208 comprises a screen providing an output interface between the apparatus 1200 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the first multimedia component 1208 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 1200 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The first audio component 1210 is configured to output and/or input audio signals. For example, first audio assembly 1210 includes a Microphone (MIC) configured to receive external audio signals when apparatus 1200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the first memory 1204 or transmitted via the first communication component 1216. In some embodiments, first audio assembly 1210 further includes a speaker for outputting audio signals.

The first I/O interface 1212 provides an interface between the first processing component 1202 and a peripheral interface module, which may be a keyboard, click wheel, button, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The first sensor assembly 1214 includes one or more sensors for providing various aspects of state assessment for the apparatus 1200. For example, the first sensor assembly 1214 may detect an open/closed state of the apparatus 1200, the relative positioning of the components, such as a display and keypad of the apparatus 1200, the first sensor assembly 1214 may also detect a change in position of the apparatus 1200 or a component of the apparatus 1200, the presence or absence of user contact with the apparatus 1200, an orientation or acceleration/deceleration of the apparatus 1200, and a change in temperature of the apparatus 1200. The first sensor assembly 1214 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The first sensor assembly 1214 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the first sensor assembly 1214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The first communication component 1216 is configured to facilitate communication between the apparatus 1200 and other devices in a wired or wireless manner. The apparatus 1200 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the first communication component 1216 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the first communication component 1216 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 1200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods of multimedia communication.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the first memory 1204 comprising instructions, executable by the processor 1220 of the apparatus 1200 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Fig. 14 is a block diagram illustrating an apparatus 1300 for multimedia communication, according to an example embodiment. For example, apparatus 1300 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and so forth.

Referring to fig. 14, apparatus 1300 may include one or more of the following components: a second processing component 1302, a second memory 1304, a second power component 1306, a second multimedia component 1308, a second audio component 1310, a second input/output (I/O) interface 1312, a second sensor component 1314, and a second communication component 1316.

The second processing component 1302 generally controls overall operation of the apparatus 1300, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The second processing component 1302 may include one or more second processors 1320 to execute instructions to perform all or part of the steps of the method described above. Further, the second processing component 1302 may include one or more modules that facilitate interaction between the second processing component 1302 and other components. For example, the second processing component 1302 may include a multimedia module to facilitate interaction between the second multimedia component 1308 and the second processing component 1302.

The second memory 1304 is configured to store various types of data to support operations at the apparatus 1300. Examples of such data include instructions for any application or method operating on device 1300, contact data, phonebook data, messages, pictures, videos, and so forth. The second memory 1304 may be implemented by any type or combination of volatile or non-volatile memory devices, such as static random access second memory (SRAM), electrically erasable programmable read-only second memory (EEPROM), erasable programmable read-only second memory (EPROM), programmable read-only second memory (PROM), read-only second memory (ROM), magnetic second memory, flash second memory, magnetic or optical disk.

The second power supply component 1306 provides power to the various components of the device 1300. The second power component 1306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 1300.

The second multimedia component 1308 comprises a screen between the apparatus 1300 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the second multimedia component 1308 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 1300 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The second audio component 1310 is configured to output and/or input audio signals. For example, the second audio component 1310 includes a Microphone (MIC) configured to receive an external audio signal when the apparatus 1300 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the second memory 1304 or transmitted via the second communication component 1316. In some embodiments, the second audio component 1310 also includes a speaker for outputting audio signals.

The second I/O interface 1312 provides an interface between the second processing component 1302 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The second sensor assembly 1314 includes one or more sensors for providing various aspects of state assessment for the device 1300. For example, the second sensor assembly 1314 may detect an open/closed state of the device 1300, the relative positioning of components, such as a display and keypad of the device 1300, the second sensor assembly 1314 may also detect a change in position of the device 1300 or a component of the device 1300, the presence or absence of user contact with the device 1300, orientation or acceleration/deceleration of the device 1300, and a change in temperature of the device 1300. The second sensor assembly 1314 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The second sensor assembly 1314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the second sensor assembly 1314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The second communication component 1316 is configured to facilitate communications between the apparatus 1300 and other devices in a wired or wireless manner. The apparatus 1300 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the second communication component 1316 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the second communication component 1316 also includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 1300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods of multimedia communication.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the second memory 1304 comprising instructions, executable by the second processor 1320 of the apparatus 1300 to perform the method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for multimedia communication, the method being applied in a first terminal, the method comprising:

and sending a communication request to the target household equipment according to the equipment identifier of the target household equipment, and closing the multimedia acquisition equipment and the multimedia playing equipment of the first terminal, wherein the communication request is used for indicating the target household equipment to perform multimedia communication with the second terminal.

2. The method of claim 1, wherein the detecting whether the first terminal and the user are in the same location area comprises:

3. The method of claim 1, wherein the detecting whether the first terminal and the user are in the same location area comprises:

4. The method of claim 1, wherein before detecting whether the first terminal and the user are in the same location area, the method further comprises:

5. The method according to claim 1, wherein the determining the device identifier of the target home device comprises:

6. The method according to claim 1, wherein the determining the device identifier of the target home device comprises:

7. The method according to any of claims 1-6, wherein said detecting whether said first terminal and user are in a same location area further comprises:

8. The method according to any one of claims 1 to 6, wherein the sending a communication request to the target home device according to the device identifier of the target home device includes:

9. The method according to any one of claims 1 to 6, wherein after the sending of the communication request to the target home device according to the device identifier of the target home device, the method further comprises:

10. The method according to any one of claims 1 to 6, wherein after the sending of the communication request to the target home device according to the device identifier of the target home device, the method further comprises:

11. A method for multimedia communication is applied to target household equipment, and the method comprises the following steps:

receiving a communication request of a first terminal associated with the target household equipment, wherein a multimedia acquisition device and a multimedia playing device of the first terminal are in a closed state, the communication request is sent when the first terminal detects that the first terminal and a user are not in the same position area, and the communication request is used for indicating the target household equipment and a second terminal to carry out multimedia communication;

and carrying out multimedia communication with the second terminal through the multimedia acquisition equipment and/or the multimedia playing equipment, wherein the second terminal is a terminal for carrying out multimedia communication with the first terminal.

12. The method according to claim 11, wherein the performing multimedia communication with the second terminal through the multimedia capturing device and/or the multimedia playing device comprises:

13. An apparatus for multimedia communication, the apparatus being applied in a first terminal, the apparatus comprising:

and the sending module is used for sending a communication request to the target household equipment according to the equipment identifier of the target household equipment, and closing the multimedia acquisition equipment and the multimedia playing equipment of the first terminal, wherein the communication request is used for indicating the target household equipment to perform multimedia communication with the second terminal.

14. The apparatus of claim 13, wherein the detection module comprises:

15. The apparatus of claim 13, wherein the detection module comprises:

16. The apparatus of claim 13,

the detection module is further configured to detect whether the first terminal and the user are in the same location area when detecting that the location of the user changes and/or the location of the first terminal changes.

17. The apparatus of claim 13, wherein the determining module comprises:

18. The apparatus of claim 13, wherein the determining module comprises:

19. The apparatus of any one of claims 13-18,

the detection module is further configured to detect whether an automatic switching function of the first terminal is in an on state; and if the automatic switching function of the first terminal is in an opening state, detecting whether the first terminal and the user are in the same position area.

20. The apparatus of any one of claims 13-18,

the sending module is further configured to send a communication request to a designated server, where the communication request carries the device identifier of the target home device, so that the designated server forwards the communication request to the target home device according to the device identifier of the target home device.

21. The apparatus of any of claims 13-18, further comprising:

22. The apparatus of any of claims 13-18, further comprising:

23. An apparatus for multimedia communication, wherein the apparatus is applied in a target home device, the apparatus comprising:

a third receiving module, configured to receive a communication request of a first terminal associated with the target home device, where a multimedia acquisition device and a multimedia playing device of the first terminal are in a closed state, the communication request is sent when the first terminal detects that the first terminal and a user are not in the same location area, and the communication request is used to instruct the target home device and a second terminal to perform multimedia communication;

and the communication module is used for carrying out multimedia communication with the second terminal through the multimedia acquisition equipment and/or the multimedia playing equipment, and the second terminal is a terminal for carrying out multimedia communication with the first terminal.

24. The apparatus of claim 23, wherein the communication module comprises:

25. An apparatus for multimedia communication, the apparatus being applied in a first terminal, the apparatus comprising: