CN111107225B

CN111107225B - Interactive communication method and electronic equipment

Info

Publication number: CN111107225B
Application number: CN201911364999.7A
Authority: CN
Inventors: 熊年登
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2019-12-26
Filing date: 2019-12-26
Publication date: 2022-08-02
Anticipated expiration: 2039-12-26
Also published as: CN111107225A

Abstract

The invention provides an interactive communication method and electronic equipment, wherein the method comprises the following steps: collecting first multimedia information; receiving second multimedia information sent by second electronic equipment; and executing preset operation according to the first multimedia information and the second multimedia information. Therefore, the communication connection between the first electronic device and the second electronic device is established, and the multimedia information acquired by the first electronic device is supplemented or adjusted by the multimedia information acquired by the second electronic device, so that the processing effect of the first electronic device on the multimedia information can be effectively improved.

Description

Interactive communication method and electronic equipment

Technical Field

The present invention relates to the field of communications technologies, and in particular, to an interactive communication method and an electronic device.

Background

With the development and progress of technology, people who wear wearable devices and smart phones have been widely used in life. Wherein, wearable equipment such as intelligent bracelet, intelligent wrist-watch, smart glasses not only can detect user's health relevant parameter, still has smart mobile phone's partial function, for example look over time, listen to song, map navigation etc.. However, when electronic devices such as smartphones process multimedia information, the multimedia information collected by the electronic devices is mainly processed, so that the effect of processing the multimedia information by the electronic devices is poor.

Disclosure of Invention

The embodiment of the invention provides an interactive communication method and electronic equipment, and aims to solve the problem that the effect of processing multimedia information by the existing electronic equipment is poor.

In order to solve the technical problem, the invention is realized as follows:

in a first aspect, an embodiment of the present invention provides an interactive communication method, applied to a first electronic device, including:

collecting first multimedia information;

receiving second multimedia information sent by second electronic equipment;

and executing preset operation according to the first multimedia information and the second multimedia information.

In a second aspect, an embodiment of the present invention provides an interactive communication method, applied to a second electronic device, including:

collecting second multimedia information;

and sending second multimedia information to first electronic equipment, wherein the first electronic equipment can execute preset operation according to the second multimedia information and first multimedia information, and the first multimedia information is the multimedia information collected by the first electronic equipment.

In a third aspect, an embodiment of the present invention further provides an electronic device, including:

the acquisition module is used for acquiring first multimedia information;

the receiving module is used for receiving second multimedia information sent by second electronic equipment;

and the execution module is used for executing preset operation according to the first multimedia information and the second multimedia information.

In a fourth aspect, an embodiment of the present invention further provides an electronic device, including:

the acquisition module is used for acquiring second multimedia information;

the sending module is used for sending second multimedia information to first electronic equipment, the first electronic equipment can execute preset operation according to the second multimedia information and first multimedia information, and the first multimedia information is the multimedia information collected by the first electronic equipment.

In a fifth aspect, an embodiment of the present invention further provides an electronic device, which includes a processor, a memory, and a computer program stored on the memory and executable on the processor, and when the computer program is executed by the processor, the steps of the interactive communication method in the first aspect and the steps of the interactive communication method in the second aspect are implemented.

In a sixth aspect, the embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when executed by a processor, the computer program implements the steps of the interactive communication method in the first aspect and the steps of the interactive communication method in the second aspect.

In the embodiment of the invention, the first multimedia information is acquired; receiving second multimedia information sent by second electronic equipment; and executing preset operation according to the first multimedia information and the second multimedia information. Therefore, the communication connection between the first electronic device and the second electronic device is established, and the multimedia information acquired by the first electronic device is supplemented or adjusted by the multimedia information acquired by the second electronic device, so that the processing effect of the first electronic device on the multimedia information can be effectively improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.

FIG. 1 is a block diagram of communications provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of communications provided by an embodiment of the present invention;

FIG. 3 is a flow chart of an interactive communication method provided by an embodiment of the invention;

FIG. 4 is a flow chart of an interactive communication method provided by another embodiment of the present invention;

FIG. 5 is a block diagram of a first electronic device according to an embodiment of the invention;

FIG. 6 is a block diagram of a second electronic device provided in an embodiment of the invention;

FIG. 7 is a block diagram of a first electronic device according to another embodiment of the invention;

fig. 8 is a block diagram of a second electronic device according to another embodiment of the invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention provides an interactive communication method, which is used for improving the communication effect of multimedia information, such as telephone communication and video communication, processed by a first electronic device by establishing communication connection between the first electronic device and a second electronic device. As shown in fig. 1 and 2, the first electronic device 10 includes a first processor 11, a first communication module 12, a first sensor 13, and a first microphone 14; the second electronic device 20 includes a second processor 21, a second communication module 22, a second sensor 23, and a second microphone 24, and establishes a communication connection between the first electronic device 10 and the second electronic device 20 through the first communication module 12 and the second communication module 22.

Wherein, the first communication module 12 comprises a wireless module and a cellular network module; the second communication module 22 also includes a wireless module and a cellular network module. The Wireless module can be a Wireless communication module such as Bluetooth, WIFI (Wireless Fidelity) and BLE; the cellular network module is mainly used for voice call.

The first processor 11 and the second processor 21 are respectively used as core devices of the first electronic device 10 and the second electronic device 20, and are mainly used for performing voice algorithm processing, data control, and the like.

The first sensor 13 and the second sensor 23 are used for recognizing user actions, including but not limited to gravity sensors, gyroscopes, etc.

Wherein the first microphone 14 and the second microphone 24 are used for picking up sound.

Also, the first electronic device 10 and the second electronic device 20 may further include other modules, such as a memory, a camera, and the like.

It should be noted that, in the embodiment of the present invention, the first electronic device 10 is one of a wearable device and a smartphone, and the second electronic device 20 is the other of the wearable device and the smartphone. Wearable equipment includes intelligent wrist-watch, intelligent bracelet etc..

For example, if the first electronic device is a smart watch, the second electronic device is a smart phone; on the contrary, if the first electronic device is a smart phone, the second electronic device is a smart watch.

In the embodiment of the invention, the multimedia information acquired by the first electronic device is supplemented or adjusted by establishing the communication connection between the first electronic device and the second electronic device and utilizing the multimedia information acquired by the second electronic device, so that the processing effect of the first electronic device on the multimedia information can be effectively improved. For example, when the smart phone is used for calling in the handle mode, the call volume of the smart phone can be detected through the microphone of the smart watch, and based on the detection result, the call volume of the smart phone is automatically adjusted, so that the phenomenon of call sound leakage is prevented, and the security of call content is provided.

Referring to fig. 3, fig. 3 is a flowchart of an interactive communication method according to an embodiment of the present invention, where the interactive communication method according to the embodiment of the present invention is applied to a first electronic device, and as shown in fig. 3, the method includes the following steps:

step 301, collecting first multimedia information.

In this step, the first multimedia information may be audio information or video image information.

When the first multimedia information is audio information, the first multimedia information can be picked up through a microphone of the first electronic equipment; and when the first multimedia information is video image information, the first multimedia information can be collected through a camera of the first electronic equipment.

Step 302, receiving second multimedia information sent by a second electronic device.

In this step, the second multimedia information may be audio information or video image information.

When the second multimedia information is audio information, the second multimedia information can be picked up through a microphone of the second electronic device, and when the second multimedia information is video image information, the second multimedia information can be collected through a camera of the second electronic device.

It should be noted that the first multimedia information and the second multimedia information may be audio information at the same time.

When the first multimedia information is video image information, the second multimedia information can be audio information; and when the first multimedia information is audio information, the second multimedia information can be video image information.

And 303, executing a preset operation according to the first multimedia information and the second multimedia information.

In this step, the first multimedia information may be supplemented or adjusted by using the second multimedia information, or the first multimedia information and the second multimedia information may be synthesized to obtain new multimedia information.

Therefore, the communication connection between the first electronic device and the second electronic device is established, and the multimedia information acquired by the first electronic device is supplemented or adjusted by the multimedia information acquired by the second electronic device, so that the processing effect of the first electronic device on the multimedia information can be effectively improved.

Optionally, the first multimedia information includes first audio information, the second multimedia information includes second audio information, and the second audio information is audio information collected by the second electronic device when the first electronic device outputs the first audio information; or the first multimedia information comprises a first identification result, the second multimedia information comprises a second identification result, the first identification result is an identification result of the first electronic device for identifying the audio information collected by the first electronic device, the second identification result is an identification result of the second electronic device for identifying the audio information collected by the second electronic device, and the audio information is audio information output by a target object; or the first multimedia information comprises fifth audio information, and the second multimedia information comprises video image information acquired by the second electronic device; or the first multimedia information comprises video image information, and the second multimedia information comprises fifth audio information acquired by the second electronic device.

In this embodiment, the first multimedia information and the second multimedia information include, but are not limited to, the above information. Moreover, in the embodiment of the present invention, by establishing a communication connection between the first electronic device and the second electronic device, and by receiving the second multimedia information sent by the second electronic device, the first multimedia information acquired by the first electronic device is supplemented or adjusted, so that the processing effect of the first electronic device on the multimedia information can be effectively improved.

The target object can be a user, in the process of speaking of the user, the first electronic device can recognize voice information of the user and obtain a first recognition result, and the second electronic device can recognize voice information of the user and obtain a second recognition result. Therefore, the first recognition result and the second recognition result can be verified and compared to obtain a target recognition result, and the accuracy of voice information recognition is improved.

Optionally, when the first multimedia information includes first audio information and the second multimedia information includes second audio information, the performing a preset operation according to the first multimedia information and the second multimedia information includes: obtaining a first comparison result according to the first audio information and the second audio information; and adjusting the volume of the first electronic equipment based on the first comparison result.

In this embodiment, in the process of using the first electronic device to perform communication, the first audio information output by the first electronic device is compared with the second audio information collected by the second electronic device to adjust the volume of the first electronic device, so as to avoid an output effect of the volume of the first electronic device in different usage scenarios.

For example, under the condition that the first electronic device is a smart phone and the second electronic device is a smart watch, if the smart phone adopts a handle mode to perform a call, the call volume information collected by the smart watch can be used, and based on the noise of the call environment, the call volume of the smart phone is automatically adjusted, so that the phenomenon of sound leakage of a user in the call process is prevented, and the security of the call content is improved. On the contrary, if the first electronic device is the smart watch and the second electronic device is the smart phone, the call volume information collected by the smart phone can be received, and based on the noise of the call environment, the call volume of the smart watch is automatically adjusted, so that the phenomenon of sound leakage of the user in the call process is prevented, and the security of the call content is improved.

In the process of performing interactive communication between the first electronic device and the second electronic device, it may be determined whether the first electronic device and the second electronic device are the same-side arms of a user, for example, the first electronic device is held by a right hand, and the second electronic device is worn; the second electronic device can also be used for judging the magnitude of the environmental noise, when the environmental noise is low, the communication environment is considered to be a quiet environment, then the sound emitted by the first electronic device, such as the sound emitted by a receiver, is picked up, and the picked-up audio information is sent to the first electronic device in a wireless or WiFi mode; the first electronic equipment can judge that the first electronic equipment has the problem of sound leakage by comparing the received audio data with the audio data actually sent by the first electronic equipment, and can automatically turn down the call volume of the first electronic equipment at the moment to prevent the call volume from leaking and protect the privacy of a user; if the environmental noise that second electronic equipment detected is great, then think that the user talks in noisy environment, this is that can improve the conversation volume automatically, avoids the user to appear the problem of not hearing the conversation content clearly. Therefore, in the whole call process, the call volume does not need to be adjusted manually by a user, the call volume can be automatically adjusted through the audio data detected by the first electronic device and the second electronic device based on environmental factors, the operation of manually adjusting the call volume by the user is reduced, and the user experience is improved.

In addition, in the adjusting process of the call volume, the volume picked up by the second electronic device can be fed back and adjusted, so that the call experience of a user is improved, and the call effect is improved.

For example, when a mobile phone calls, a user holds the mobile phone for communication, the smart watch can judge whether an arm wearing the smart watch has a hand-lifting action to answer the call by using a gravity sensor and a gyroscope inside the smart watch, information of the hand-lifting action is sent to the mobile phone in a wireless mode, and the mobile phone can judge whether a hand holding the mobile phone and a hand wearing the smart watch are the same hand after receiving the information. Moreover, in order to more accurately judge whether the hand wearing the smart watch and the hand holding the mobile phone are the same hand, the smart watch can also send the moving track of the mobile phone after the call is received to the mobile phone, the mobile phone compares whether the moving track sent by the smart watch is consistent with the moving track of the mobile phone, and if the moving track sent by the mobile phone is consistent with the moving track of the mobile phone, the hand wearing the smart watch and the hand holding the mobile phone can be accurately judged to be the same hand.

In addition, in the volume adjustment process, if the hand wearing the smart watch and the hand holding the mobile phone are the same hand, the distance between the smart watch and the mobile phone is relatively short, and the volume adjustment range can be relatively small; when the hand wearing the smart watch and the hand holding the mobile phone are different, the distance between the smart watch and the mobile phone is far, and the adjustment range of the volume can be large. By such an arrangement, the accuracy of volume adjustment can be improved.

The distance between the first electronic device and the second electronic device can be detected through the distance sensors on the first electronic device and the second electronic device, and the adjustment range of the volume can be adjusted by judging the relation between the first distance between the first electronic device and the second electronic device and the first preset distance.

For example, if the first distance is greater than the first preset distance, the volume is adjusted according to the first adjustment amplitude; and if the first distance is smaller than or equal to the first preset distance, adjusting the volume according to a second adjustment amplitude, wherein the first adjustment amplitude is larger than the second adjustment amplitude. This can improve the accuracy of volume adjustment.

Optionally, when the first multimedia information includes third audio information and the second multimedia information includes fourth audio information, the performing a preset operation according to the first multimedia information and the second multimedia information includes: obtaining a second comparison result according to the third audio information and the fourth audio information; and executing a preset operation corresponding to the third audio information under the condition that the second comparison result meets a first preset condition.

In this embodiment, the third audio information and the fourth audio information may be compared to obtain a second comparison result; if the second comparison result shows that the accuracy of the third audio information is higher, outputting the third audio information as target content; and if the second comparison result shows that the identification speed of the fourth audio information is higher, outputting the fourth audio information as the target content.

For example, if the similarity between the third audio information and the fourth audio information is greater than a preset threshold (e.g., 98%), the third audio information may be output as the target content, and the fourth audio information may also be output as the target content.

Moreover, the third audio information and the fourth audio information are compared, and complementary enhancement is carried out on the third audio information and the fourth audio information based on the comparison result, so that the accuracy of voice information identification can be improved.

In the process of voice recognition of the smart watch and the smart phone, generally speaking, the word stock of the smart phone is larger than that of the smart watch, so that the recognition speed of the smart watch is faster than that of the smart phone; but the recognition accuracy of the smart phone is higher than that of the smart watch.

It should be noted that, in the actual application process, the adjustment can be performed according to the actual situation to meet the requirements of the user. For example, when the user pursues a faster recognition speed, the recognition result of the smart watch can be used as the standard; when the user pursues an accurate recognition result, the recognition result of the smart phone can be used as a standard. Therefore, the corresponding result can be output according to the requirements of the user, and the satisfaction degree of the user can be improved.

Optionally, before the step of obtaining a second comparison result according to the third audio information and the fourth audio information, the method further includes: detecting whether a second distance between the first electronic device and the second electronic device is smaller than a second preset distance; executing a preset operation corresponding to the third audio information under the condition that the second comparison result meets a first preset condition, wherein the preset operation comprises the following steps: and executing a preset operation corresponding to the third audio information under the condition that the second comparison result meets a first preset condition and the second distance is smaller than the second preset distance.

In this embodiment, a preset operation corresponding to the third audio information may be further performed according to a second distance between the first electronic device and the second electronic device. For example, if the second electronic device is farther from the first electronic device, the third audio information is output as the target content; and if the second electronic equipment is closer to the first electronic equipment, performing complementary enhancement on the third audio information and the fourth audio information to improve the accuracy of voice information identification.

For example, when a user needs to use a voice assistant function of a smart phone, it may be determined whether a hand of the user holding the smart phone and a hand wearing a smart watch are the same side arm. If the arms are the same side arms, optimizing the user experience of the voice assistant by adopting an algorithm A; otherwise, if the arms are different, the user experience of the voice assistant is optimized by adopting the algorithm B.

According to the algorithm A, when a user has a hand-up operation and actively performs a voice assistant function, and when voice is input, the smart watch simultaneously opens a microphone on the device for voice input; the smart watch and the smart phone perform voice recognition simultaneously, if the smart watch completes voice recognition, the recognition result can be synchronously transmitted to the smart phone in a wireless mode through the smart watch, and the voice recognition of the smart phone is supplemented. By carrying out dual-system voice recognition, the accuracy of the voice recognition is improved, and the recognition speed is also improved.

And algorithm B: when the hand of the user wearing the smart watch and the hand holding the smart phone are judged to be not the same hand, or the user does not lift the hand to hold the smart phone to place the smart phone at the mouth, when voice input is carried out, the smart watch directly transmits the voice information to the smart phone through wireless after collecting the voice information of the user, the smart phone can be combined with the voice worn by the smart watch and the voice collected by the microphone of the smart watch to carry out complementary enhancement, and therefore the accuracy of voice recognition is improved.

Optionally, when one of the first multimedia information and the second multimedia information includes fifth audio information and the other includes video image information, the performing a preset operation according to the first multimedia information and the second multimedia information includes: synthesizing the video image information and the fifth audio information to obtain target video information; and executing preset operation related to the target video information.

In the embodiment, the method mainly aims at the scene that the user carries out the video call in a noisy environment, and because the environment of the video call is noisy, a hands-free mode is used, the call content is easily not heard, and call obstacle is caused; if the mode is changed into the receiver mode, the video image cannot be considered, and the video experience is influenced.

In this case, the camera of the second electronic device may be used to collect video image information of the user, and synthesize the received video image information sent by the second electronic device and the voice information collected by the first electronic device to obtain target video information, and perform a preset operation on the target video information, for example, send the target video information to the target terminal.

For example, the first distance between the first electronic device and the head of the user may be obtained, and the second distance between the second electronic device and the head of the user may be obtained; when the third distance is greater than the fourth distance, namely the first electronic device is farther away from the head of the user, the video image information of the user is acquired through the first electronic device, and the fifth audio information of the user is acquired through the second electronic device; on the contrary, when the third distance is less than or equal to the fourth distance, that is, the second electronic device is farther from the head of the user, the fifth audio information of the user is acquired through the first electronic device, and the video image information of the user is acquired through the second electronic device.

The third distance between the first electronic device and the head of the user can be acquired through the distance sensor of the first electronic device, and the fourth distance between the second electronic device and the head of the user can be acquired through the distance sensor of the second electronic device.

The video image information and the audio information are acquired separately, the audio information of the user is acquired by the electronic equipment close to the user, the video image information of the user is acquired by the electronic equipment far away from the user, and the video information is formed in a synthesis mode, so that the quality of the video information is ensured, and the video experience of the user is effectively improved when the user carries out video call in a noisy environment.

According to the interactive communication method, the first multimedia information is collected; receiving second multimedia information sent by second electronic equipment; and executing preset operation according to the first multimedia information and the second multimedia information. Therefore, the communication connection between the first electronic device and the second electronic device is established, and the multimedia information acquired by the first electronic device is supplemented or adjusted by the multimedia information acquired by the second electronic device, so that the processing effect of the first electronic device on the multimedia information can be effectively improved.

Referring to fig. 4, fig. 4 is a flowchart of an interactive communication method according to another embodiment of the present invention, where the interactive communication method according to the embodiment of the present invention is applied to a second electronic device, as shown in fig. 4, and includes the following steps:

step 401, collecting second multimedia information.

Step 402, sending the second multimedia information to the first electronic device.

The first electronic device can execute a preset operation according to the second multimedia information and first multimedia information, wherein the first multimedia information is the multimedia information collected by the first electronic device.

Optionally, the first multimedia information includes first audio information, the second multimedia information includes second audio information, and the second audio information is audio information collected by the second electronic device when the first electronic device outputs the first audio information; or the first multimedia information comprises a first identification result, the second multimedia information comprises a second identification result, the first identification result is an identification result of the first electronic device for identifying the audio information collected by the first electronic device, the second identification result is an identification result of the second electronic device for identifying the audio information collected by the second electronic device, and the audio information is audio information output by a target object; or the first multimedia information comprises fifth audio information, and the second multimedia information comprises video image information acquired by the second electronic device; or, the first multimedia information includes video image information, and the second multimedia information includes fifth audio information acquired by the second electronic device.

The interactive communication method according to the embodiment of the present invention may achieve the same effect as the interactive communication method provided in fig. 3, and is not described herein again to avoid repetition.

Referring to fig. 5, fig. 5 is a block diagram of a first electronic device according to an embodiment of the present invention, and as shown in fig. 5, the first electronic device 500 includes:

an acquisition module 501, configured to acquire first multimedia information;

a receiving module 502, configured to receive second multimedia information sent by a second electronic device;

the executing module 503 is configured to execute a preset operation according to the first multimedia information and the second multimedia information.

Optionally, in a case that the first multimedia information includes first audio information and the second multimedia information includes second audio information, the executing module 503 includes:

the first comparison unit is used for obtaining a first comparison result according to the first audio information and the second audio information;

and the adjusting unit is used for adjusting the volume of the first electronic equipment based on the first comparison result.

Optionally, the adjusting unit is specifically configured to obtain a first distance between the first electronic device and the second electronic device; if the first distance is larger than a first preset distance, adjusting the volume according to a first adjustment amplitude; if the first distance is smaller than or equal to the first preset distance, adjusting the volume according to a second adjustment amplitude; wherein the first adjustment magnitude is greater than the second adjustment magnitude.

Optionally, in a case that the first multimedia information includes third audio information and the second multimedia information includes fourth audio information, the executing module 503 includes:

the second comparison unit is used for obtaining a second comparison result according to the third audio information and the fourth audio information;

and the first execution unit is used for executing the preset operation corresponding to the third audio information under the condition that the second comparison result meets a first preset condition.

Optionally, the first electronic device 500 further includes:

the detection module is used for detecting whether a second distance between the first electronic device and the second electronic device is smaller than a second preset distance;

the first executing unit is specifically configured to execute a preset operation corresponding to the third audio information when the second comparison result meets a first preset condition and the second distance is smaller than the second preset distance.

Optionally, in a case that one of the first multimedia information and the second multimedia information includes fifth audio information, and the other includes video image information, the executing module 503 includes:

a synthesizing unit, configured to synthesize the video image information and the fifth audio information to obtain target video information;

a second execution unit for executing a preset operation with respect to the target video information.

Optionally, the first electronic device 500 further includes:

the acquisition module is used for acquiring a third distance between the first electronic equipment and the head of the user and acquiring a fourth distance between the second electronic equipment and the head of the user;

in a case that the third distance is greater than the fourth distance, the first multimedia information includes the video image information, and the second multimedia information includes the fifth audio information;

in a case where the third distance is less than or equal to the fourth distance, the first multimedia information includes the fifth audio information, and the second multimedia information includes the video image information.

It should be noted that, the first electronic device 500 can implement the processes in the embodiment of the method in fig. 3 of the present invention, and achieve the same beneficial effects, and for avoiding repetition, the detailed description is omitted here.

Referring to fig. 6, fig. 6 is a block diagram of a second electronic device according to an embodiment of the present invention, and as shown in fig. 6, the second electronic device 600 includes:

the acquisition module 601 is configured to acquire second multimedia information;

a sending module 602, configured to send second multimedia information to a first electronic device, where the first electronic device may execute a preset operation according to the second multimedia information and first multimedia information, and the first multimedia information is multimedia information acquired by the first electronic device.

It should be noted that the second electronic device 600 can implement each process in the embodiment of the method in fig. 4 of the present invention and achieve the same beneficial effects, and for avoiding repetition, details are not described here again.

Referring to fig. 7, fig. 7 is a schematic diagram of a hardware structure of a first electronic device for implementing various embodiments of the present invention, and as shown in fig. 7, the first electronic device 700 includes, but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a processor 710, a power supply 711, and the like. Those skilled in the art will appreciate that the first electronic device configuration shown in fig. 7 does not constitute a limitation of the first electronic device, which may include more or fewer components than shown, or some components in combination, or a different arrangement of components. In the embodiment of the present invention, the first electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The input unit 704 is configured to collect first multimedia information; the radio frequency unit 701 is configured to receive second multimedia information sent by a second electronic device; the processor 710 is configured to perform a preset operation according to the first multimedia information and the second multimedia information.

Optionally, in a case that the first multimedia information includes first audio information and the second multimedia information includes second audio information, the processor 710 is configured to obtain a first comparison result according to the first audio information and the second audio information; and adjusting the volume of the first electronic equipment based on the first comparison result.

Optionally, the sensor 705 is configured to acquire a first distance between the first electronic device and the second electronic device; if the first distance is larger than a first preset distance, adjusting the volume according to a first adjustment amplitude; the processor 710 is configured to adjust the volume according to a second adjustment range if the first distance is less than or equal to the first preset distance; wherein the first adjustment magnitude is greater than the second adjustment magnitude.

Optionally, under the condition that the first multimedia information includes third audio information and the second multimedia information includes fourth audio information, the processor 710 is configured to obtain a second comparison result according to the third audio information and the fourth audio information; and executing a preset operation corresponding to the third audio information under the condition that the second comparison result meets a first preset condition.

Optionally, the sensor 705 is configured to detect whether a second distance between the first electronic device and the second electronic device is smaller than a second preset distance; the processor 710 is configured to execute a preset operation corresponding to the third audio information when the second comparison result meets a first preset condition and the second distance is smaller than the second preset distance.

Optionally, in a case that one of the first multimedia information and the second multimedia information includes fifth audio information, and the other includes video image information, the processor 710 is configured to synthesize the video image information and the fifth audio information to obtain target video information; and executing preset operation related to the target video information.

Optionally, the sensor 705 is configured to acquire a third distance between the first electronic device and the head of the user, and acquire a fourth distance between the second electronic device and the head of the user; in a case that the third distance is greater than the fourth distance, the first multimedia information includes the video image information, and the second multimedia information includes the fifth audio information; in a case where the third distance is less than or equal to the fourth distance, the first multimedia information includes the fifth audio information, and the second multimedia information includes the video image information.

The first electronic device 700 is capable of implementing the processes implemented by the first electronic device in the foregoing embodiments, and details are not repeated here to avoid repetition.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and sending signals during a message transmission and reception process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 710; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 may also communicate with a network and other devices through a wireless communication system.

The first electronic device provides the user with wireless broadband internet access via the network module 702, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output related to a specific function performed by the first electronic device 700 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.

The input unit 704 is used to receive audio or video signals. The input Unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042, and the Graphics processor 7041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 706. The image frames processed by the graphic processor 7041 may be stored in the memory 709 (or other storage medium) or transmitted via the radio unit 701 or the network module 702. The microphone 7042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 701 in case of a phone call mode.

The first electronic device 700 further comprises at least one sensor 705, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 7061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 7061 and/or a backlight when the first electronic device 700 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the first electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 705 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 706 is used to display information input by the user or information provided to the user. The Display unit 706 may include a Display panel 7061, and the Display panel 7061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 707 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the first electronic device. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 7071 (e.g., operations by a user on or near the touch panel 7071 using a finger, a stylus, or any other suitable object or attachment). The touch panel 7071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 710, receives a command from the processor 710, and executes the command. In addition, the touch panel 7071 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 707 may include other input devices 7072 in addition to the touch panel 7071. In particular, the other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.

Further, the touch panel 7071 may be overlaid on the display panel 7061, and when the touch panel 7071 detects a touch operation on or near the touch panel 7071, the touch operation is transmitted to the processor 710 to determine the type of the touch event, and then the processor 710 provides a corresponding visual output on the display panel 7061 according to the type of the touch event. Although in fig. 7, the touch panel 7071 and the display panel 7061 are implemented as two independent components to implement the input and output functions of the first electronic device, in some embodiments, the touch panel 7071 and the display panel 7061 may be integrated to implement the input and output functions of the first electronic device, which is not limited herein.

The interface unit 708 is an interface through which an external device is connected to the first electronic apparatus 700. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 708 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the first electronic apparatus 700 or may be used to transmit data between the first electronic apparatus 700 and the external device.

The memory 709 may be used to store software programs as well as various data. The memory 709 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 709 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 710 is a control center of the first electronic device, connects various parts of the entire first electronic device by using various interfaces and lines, and performs various functions of the first electronic device and processes data by running or executing software programs and/or modules stored in the memory 709 and calling data stored in the memory 709, thereby performing overall monitoring of the first electronic device. Processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 710.

The first electronic device 700 may further include a power supply 711 (e.g., a battery) for supplying power to various components, and preferably, the power supply 711 may be logically connected to the processor 710 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

In addition, the first electronic device 700 includes some functional modules that are not shown, and are not described herein again.

Preferably, an embodiment of the present invention further provides a first electronic device, which includes a processor 710, a memory 709, and a computer program stored in the memory 709 and capable of running on the processor 710, where the computer program, when executed by the processor 710, implements each process of the foregoing interactive communication method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the processes of the embodiment of the interactive communication method, and can achieve the same technical effect, and in order to avoid repetition, the computer program is not described herein again. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

Referring to fig. 8, fig. 8 is a schematic diagram of a hardware structure of a second electronic device for implementing various embodiments of the present invention, and as shown in fig. 8, the second electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, and a power supply 811. Those skilled in the art will appreciate that the second electronic device configuration shown in fig. 8 does not constitute a limitation of the second electronic device, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the second electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The input unit 804 is used for acquiring second multimedia information; the radio frequency unit 801 is configured to send second multimedia information to a first electronic device, where the first electronic device may execute a preset operation according to the second multimedia information and first multimedia information, where the first multimedia information is multimedia information collected by the first electronic device.

The second electronic device 800 can implement the processes implemented by the second electronic device in the foregoing embodiments, and details are not repeated here to avoid repetition.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 801 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 810; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio frequency unit 801 can also communicate with a network and other devices through a wireless communication system.

The second electronic device provides the user with wireless broadband internet access via the network module 802, such as helping the user send and receive e-mails, browse webpages, access streaming media, and the like.

The audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 may also provide audio output related to a specific function performed by the second electronic device 800 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.

The input unit 804 is used for receiving an audio or video signal. The input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics processor 8041 processes image data of a still picture or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 806. The image frames processed by the graphics processor 8041 may be stored in the memory 809 (or other storage medium) or transmitted via the radio frequency unit 801 or the network module 802. The microphone 8042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 801 in case of a phone call mode.

The second electronic device 800 further comprises at least one sensor 805, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 8061 according to the brightness of ambient light and a proximity sensor that can turn off the display panel 8061 and/or the backlight when the second electronic device 800 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the second electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer and tapping); the sensors 805 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 806 is used to display information input by the user or information provided to the user. The Display unit 806 may include a Display panel 8061, and the Display panel 8061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 807 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the second electronic device. Specifically, the user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 8071 (e.g., operations by a user on or near the touch panel 8071 using a finger, a stylus, or any other suitable object or accessory). The touch panel 8071 may include two portions of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 810, receives a command from the processor 810, and executes the command. In addition, the touch panel 8071 can be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 8071, the user input unit 807 can include other input devices 8072. In particular, other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 8071 can be overlaid on the display panel 8061, and when the touch panel 8071 detects a touch operation on or near the touch panel 8071, the touch operation is transmitted to the processor 810 to determine the type of the touch event, and then the processor 810 provides a corresponding visual output on the display panel 8061 according to the type of the touch event. Although in fig. 8, the touch panel 8071 and the display panel 8061 are two independent components to implement the input and output functions of the second electronic device, in some embodiments, the touch panel 8071 and the display panel 8061 may be integrated to implement the input and output functions of the second electronic device, which is not limited herein.

The interface unit 808 is an interface through which an external device is connected to the second electronic apparatus 800. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 808 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the second electronic apparatus 800 or may be used to transmit data between the second electronic apparatus 800 and the external device.

The memory 809 may be used to store software programs as well as various data. The memory 809 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 809 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 810 is a control center of the second electronic device, connects various parts of the entire second electronic device by using various interfaces and lines, and performs various functions of the second electronic device and processes data by running or executing software programs and/or modules stored in the memory 809 and calling data stored in the memory 809, thereby integrally monitoring the second electronic device. Processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.

The second electronic device 800 may further comprise a power supply 811 (such as a battery) for supplying power to the various components, and preferably, the power supply 811 may be logically connected to the processor 810 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

In addition, the second electronic device 800 includes some functional modules that are not shown, and are not described in detail herein.

Preferably, an embodiment of the present invention further provides a second electronic device, which includes a processor 810, a memory 809, and a computer program that is stored in the memory 809 and can be run on the processor 810, and when the computer program is executed by the processor 810, the processes of the foregoing embodiment of the interactive communication method are implemented, and the same technical effect can be achieved, and in order to avoid repetition, details are not described here again.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned interactive communication method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. An interactive communication method applied to a first electronic device includes:

collecting first multimedia information;

receiving second multimedia information sent by second electronic equipment;

executing a preset operation according to the first multimedia information and the second multimedia information;

wherein, under the condition that the first multimedia information includes first audio information and the second multimedia information includes second audio information, the executing a preset operation according to the first multimedia information and the second multimedia information includes:

obtaining a first comparison result according to the first audio information and the second audio information;

adjusting the volume of the first electronic device based on the first comparison result;

the adjusting the volume of the first electronic device comprises:

acquiring a first distance between the first electronic device and the second electronic device;

if the first distance is larger than a first preset distance, adjusting the volume according to a first adjustment amplitude;

if the first distance is smaller than or equal to the first preset distance, adjusting the volume according to a second adjustment amplitude;

wherein the first adjustment magnitude is greater than the second adjustment magnitude;

the volume of the first electronic device is the volume of the first electronic device when the first electronic device outputs audio.

2. The method of claim 1, wherein in a case where the first multimedia information includes third audio information and the second multimedia information includes fourth audio information, the performing the predetermined operation according to the first multimedia information and the second multimedia information comprises:

obtaining a second comparison result according to the third audio information and the fourth audio information;

and executing a preset operation corresponding to the third audio information under the condition that the second comparison result meets a first preset condition.

3. The method according to claim 2, wherein before the step of obtaining the second comparison result according to the third audio information and the fourth audio information, the method further comprises:

detecting whether a second distance between the first electronic device and the second electronic device is smaller than a second preset distance;

the executing, when the second comparison result satisfies a first preset condition, a preset operation corresponding to the third audio information, including:

and executing a preset operation corresponding to the third audio information under the condition that the second comparison result meets a first preset condition and the second distance is smaller than the second preset distance.

4. The method of claim 1, wherein in a case where one of the first multimedia information and the second multimedia information includes fifth audio information and the other includes video image information, the performing of the preset operation according to the first multimedia information and the second multimedia information comprises:

synthesizing the video image information and the fifth audio information to obtain target video information;

and executing preset operation related to the target video information.

5. The method of claim 4, wherein prior to the step of collecting the first multimedia information, the method further comprises:

acquiring a third distance between the first electronic device and the head of the user, and acquiring a fourth distance between the second electronic device and the head of the user;

6. An electronic device, comprising:

the acquisition module is used for acquiring first multimedia information;

the execution module is used for executing preset operation according to the first multimedia information and the second multimedia information;

wherein, under the condition that the first multimedia information comprises first audio information and the second multimedia information comprises second audio information, the executing module comprises:

an adjusting unit, configured to adjust a volume of the electronic device based on the first comparison result;

the adjusting unit is specifically configured to obtain a first distance between the electronic device and the second electronic device; if the first distance is larger than a first preset distance, adjusting the volume according to a first adjustment amplitude; if the first distance is smaller than or equal to the first preset distance, adjusting the volume according to a second adjustment amplitude; wherein the first adjustment magnitude is greater than the second adjustment magnitude;

the volume of the electronic equipment is the volume of the electronic equipment when the electronic equipment outputs audio.

7. The electronic device of claim 6, wherein in the case that the first multimedia information includes third audio information and the second multimedia information includes fourth audio information, the execution module comprises:

8. The electronic device of claim 7, further comprising:

the detection module is used for detecting whether a second distance between the electronic equipment and the second electronic equipment is smaller than a second preset distance;

9. The electronic device of claim 6, wherein in a case where one of the first multimedia information and the second multimedia information comprises fifth audio information and the other comprises video image information, the execution module comprises:

10. The electronic device of claim 9, further comprising:

the acquisition module is used for acquiring a third distance between the electronic equipment and the head of the user and acquiring a fourth distance between the second electronic equipment and the head of the user;