WO2023071540A1

WO2023071540A1 - Recording synchronization method based on distributed call, and electronic device and readable storage medium

Info

Publication number: WO2023071540A1
Application number: PCT/CN2022/117356
Authority: WO
Inventors: 王雪; 尹杰; 张鑫
Original assignee: 荣耀终端有限公司
Priority date: 2021-10-27
Filing date: 2022-09-06
Publication date: 2023-05-04
Also published as: CN116033057A

Abstract

The present application belongs to the technical field of electronic devices. Provided are a recording synchronization method based on a distributed call, and an electronic device and a computer-readable storage medium. The method is applied to a system, which comprises a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are in a near-field connection. The method comprises: if a first electronic device enables a recording function, when a second electronic device answers an incoming call event, the first electronic device being capable of synchronizing a recording capability to the second electronic device, so that the second electronic device can realize speech collection and a prompt of recording information; and if the first electronic device does not enable the recording function and the second electronic device enables the recording function, when the second electronic device puts through the incoming call event, the second electronic device synchronizing the recording capability to the first electronic device, so that the first electronic device can display recording prompt information, thereby facilitating the circulation of the recording capability on different devices.

Description

Synchronization method, electronic equipment and readable storage medium based on distributed call recording

This application claims the priority of the Chinese patent application submitted to the China Patent Office on October 27, 2021, with the application number 202111255348.1, and the application name "based on distributed call recording synchronization method, electronic equipment and readable storage medium", all of which The contents are incorporated by reference in this application.

technical field

The invention relates to the field of electronic technology, in particular to a synchronization method based on distributed call recording, electronic equipment and a readable storage medium.

Background technique

With the continuous development of communication technology, more and more electronic devices other than mobile phones can be added to the communication chain, such as tablet computers, smart watches, and vehicle-mounted devices.

In the context of distributed calls, that is, when the calling party sends an incoming call signal of an incoming event to the called party, the received party can be multiple electronic devices associated based on a trust ring, and multiple electronic devices can also receive the incoming call event at the same time, Incoming call resonance occurs. Furthermore, users can realize the transfer of operator calls between different devices within the near field based on the trust ring. However, when an operator's call is transferred between different devices, the recording function enabled on the electronic device on the receiving side of the call cannot be transferred, thereby affecting the user's experience.

Contents of the invention

In view of this, the present invention provides a method for synchronizing call recording based on distributed, electronic equipment, and a computer-readable storage medium to solve the problem of realizing synchronous recording in a distributed call scenario to improve user experience.

Some embodiments of the present application provide a synchronization method based on distributed call recording. The following describes the present application from various aspects, and the implementation manners and beneficial effects of the following aspects can be referred to each other.

In the first aspect, the present invention provides a synchronization method based on distributed call recording, which is applied to a system including a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are in the same local area network, and the first The electronic device is a device with a telephone call function, and the method includes: the first electronic device receives an incoming call event from a calling party; the first electronic device notifies the second electronic device of the incoming call event, and the second electronic device connects to the incoming call event; When the call is hung up, the first electronic device displays a reminder of the recording file, wherein the recording file includes a downstream audio stream from the calling party and an upstream audio stream collected by the second electronic device.

The method for synchronizing call recording in the embodiment of the present application can realize that when an incoming call resonates, as an electronic device capable of making a phone call, whether or not the recording function is turned on, the recording file can be obtained.

In a possible implementation of the first aspect above, when the recording function is enabled on the first electronic device, the first electronic device displays a reminder of the recording file, including: recording the downstream audio stream from the caller by the first electronic device and the upstream audio stream collected by the second electronic device, and when the call is hung up, synthesize the downstream audio stream and the upstream audio stream into a first file, and prompt to save the first recording file.

In a possible implementation of the above first aspect, during the recording process of the first electronic device, the first electronic device displays a first recording prompt on the interface, where the first recording prompt includes at least the first recording duration; The second electronic device displays a second recording prompt on the interface, and the second recording prompt includes the first recording duration and information on recording audio on the first electronic device. When the automatic recording function is enabled on the first electronic device, regardless of whether the automatic recording function is enabled on the second electronic device, the system determines that the automatic recording function is enabled for the first electronic device and synchronizes the recording capability of the first electronic device to the second electronic device , and the recording duration can be displayed on the second electronic device, as well as the audio recording information on the second electronic device, so that the user can feel that the second electronic device also has the function of recording, which is convenient for the user to understand the recording situation and facilitate the recording of important calls Save, improve the user experience.

In a possible implementation of the first aspect above, when the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, the first electronic device displays a reminder of the recording file, including: The second electronic device records the downstream audio stream from the calling party and the upstream audio stream collected by the second electronic device, and when the call is hung up, the second electronic device combines the downstream audio stream from the calling party with the collected upstream audio stream to generate a second recording file; the second electronic device sends the second recording file to the first electronic device, so that the first electronic device receives a prompt to save the second recording file. When the recording is not enabled on the first electronic device, the recording file can be obtained through the second electronic device.

In a possible implementation of the first aspect above, during the recording process of the second electronic device, the second electronic device displays a third recording prompt on the interface, and the third recording prompt includes at least the second recording duration; the first electronic device The device displays a fourth recording prompt on the interface, and the fourth recording prompt includes information about the second recording duration and audio recording on the second electronic device. According to the method of the embodiment of the present application, in the scenario where the automatic recording function is not enabled on the first electronic device and the automatic recording function is enabled on the second electronic device, the recording duration and the audio recording time on the second electronic device can be displayed on the first electronic device. Information, so that the user can feel that the first electronic device also has a recording function, which is convenient for the user to understand the recording situation, and at the same time, facilitates the storage of important call recordings, and improves the user experience.

In a possible implementation of the first aspect above, when the call is hung up, the second electronic device saves the second recording file to the local storage.

In a possible implementation of the first aspect above, the second electronic device sends the second recording file to the first electronic device, including: the second electronic device outputs a prompt interface, and the prompt interface includes whether to synchronize the second recording file to Confirmation information of the first electronic device; when the second electronic device receives the user's operation of confirming and saving on the prompt interface, it sends the second recording file to the first electronic device. This method is beneficial for the user to choose whether to save the second recording file to the second electronic device according to actual needs.

In a possible implementation of the first aspect above, when the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, when the second electronic device receives a call event, the first electronic device The recording button on the interface cannot be clicked to take effect. Further, the effective recording of the second electronic device is ensured.

In a possible implementation of the above first aspect, enabling the recording function of the second electronic device enables the automatic recording function for the second electronic device, or enables the recording function enabled by the user through the recording key on the second electronic device.

In a possible implementation of the first aspect above, when the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, when the first electronic device or the second electronic device exits the local area network, the incoming call event The connection flow from the second electronic device is transferred to the first electronic device; the second electronic device terminates the current recording, and saves the second recording file, so that the file can be saved in time.

Or, the second electronic device sends the current recording information to the cloud, so as to complete the recording of the upstream audio stream and the downstream audio stream of the incoming call event streamed to the first electronic device through the cloud, and save them. This method can be implemented in the first electronic device. After the local area network of the device and the second electronic device is disconnected, if the incoming call event is transferred from the second electronic device to the first electronic device, it can ensure that the recording continues to be recorded by the cloud to ensure that a complete call recording file is recorded.

In a possible implementation of the first aspect above, when the recording function is enabled on the first electronic device, the recording function of the second electronic device is disabled, and the recording button on the interface of the second electronic device cannot be clicked to take effect. Further, it is ensured that the recording of the first electronic device can be performed effectively.

In a possible implementation of the above-mentioned first aspect, enabling the recording function of the first electronic device means that the first electronic device is set to an automatic recording function, or the user activates the recording function through a recording key on the first electronic device.

In a possible implementation of the first aspect above, the first electronic device and the second electronic device receive the incoming call event of the calling party, and respectively inquire whether they have enabled the recording function, and synchronize the query results. When the first electronic device If the recording function is confirmed to be enabled, the system determines that the recording function is enabled for the first electronic device; when the recording function is not enabled for the first electronic device and the recording function is enabled for the second electronic device, the system determines that the recording function is enabled for the second electronic device Condition. The method is convenient for the first electronic device and the second electronic device to confirm synchronously that the recording function is turned on, and facilitates synchronization of recording capabilities.

In a possible implementation of the above-mentioned first aspect, the first electronic device includes a first distributed frame, the second electronic device includes a second distributed frame, and the first electronic device and the second electronic device simultaneously receive an incoming call from a calling party The event includes: the first electronic device communicates with the second distributed frame of the second electronic device through the first distributed framework, so that the first electronic device and the second electronic device receive the incoming call event of the calling party synchronously.

In a possible implementation of the first aspect above, sending the second recording file to the first electronic device includes: the second electronic device synchronizing the second recording file to the first electronic device of the first electronic device through the second distributed framework. A distribution framework for sending the second recording file to the first electronic device.

In a second aspect, the present invention provides a synchronization system based on distributed call recording, including: a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are in the same local area network, and the first electronic device is For a device with a phone call function, the method includes: the first electronic device is used to receive an incoming call event from a calling party; the first electronic device is used to notify the second electronic device of the incoming call event, and the second electronic device connects to the incoming call event; When the call is hung up, the first electronic device is used to display a prompt of a recording file, wherein the recording file includes a downstream audio stream from the calling party and an upstream audio stream collected by the second electronic device.

In a possible implementation of the second aspect above, when the recording function is enabled on the first electronic device, the first electronic device is used to record the downstream audio stream from the calling party and the upstream audio stream collected by the second electronic device, And when the call is hung up, synthesize the downlink audio stream and the uplink audio stream into the first file, and use it as a reminder to save the first recording file.

In a possible implementation of the second aspect above, during the recording process of the first electronic device, the first electronic device is configured to display a first recording prompt on the interface, wherein the first recording prompt includes at least the first recording duration ; The second electronic device is used to display a second recording prompt on the interface, and the second recording prompt includes the first recording duration and information on recording audio on the first electronic device. When the automatic recording function is enabled on the first electronic device, regardless of whether the automatic recording function is enabled on the second electronic device, the system determines that the automatic recording function is enabled for the first electronic device and synchronizes the recording capability of the first electronic device to the second electronic device , and the recording duration can be displayed on the second electronic device, as well as the audio recording information on the second electronic device, so that the user can feel that the second electronic device also has the function of recording, which is convenient for the user to understand the recording situation and facilitate the recording of important calls Save, improve the user experience.

In a possible implementation of the second aspect above, when the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, the second electronic device is used to record the downstream audio stream and The upstream audio stream collected by the second electronic device, and when the call is hung up, the second electronic device is used to combine the downstream audio stream from the calling party and the collected upstream audio stream into a second recording file; the second electronic device It is used for sending the second recording file to the first electronic device, so that the first electronic device receives a prompt to save the second recording file. When the recording is not enabled on the first electronic device, the recording file can be obtained through the second electronic device.

In a possible implementation of the second aspect above, during the recording process of the second electronic device, the second electronic device is configured to display a third recording prompt on the interface, and the third recording prompt includes at least the second recording duration; An electronic device is used to display a fourth recording prompt on the interface, and the fourth recording prompt includes information about the second recording duration and audio recording on the second electronic device. According to the method of the embodiment of the present application, in the scenario where the automatic recording function is not enabled on the first electronic device and the automatic recording function is enabled on the second electronic device, the recording duration and the audio recording time on the second electronic device can be displayed on the first electronic device. Information, so that the user can feel that the first electronic device also has a recording function, which is convenient for the user to understand the recording situation, and at the same time, facilitates the storage of important call recordings, and improves the user experience.

In a possible implementation of the second aspect above, when the call is hung up, the second electronic device is configured to save the second recording file to the local storage.

In a possible implementation of the second aspect above, the second electronic device sends the second recording file to the first electronic device, including: the second electronic device is used to output a prompt interface, and the prompt interface includes whether to send the second recording file Synchronize to the confirmation information of the first electronic device; when the second electronic device receives the user's operation of confirming and saving on the prompt interface, it sends the second recording file to the first electronic device. This method is beneficial for the user to choose whether to save the second recording file to the second electronic device according to actual needs.

In a possible implementation of the second aspect above, when the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, when the second electronic device receives an incoming call event, the first electronic device The recording button on the control interface cannot be clicked to take effect. Further, the effective recording of the second electronic device is ensured.

In a possible implementation of the second aspect above, enabling the recording function of the second electronic device enables the automatic recording function for the second electronic device, or enables the recording function enabled by the user through the recording key on the second electronic device.

In a possible implementation of the second aspect above, when the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, when the first electronic device or the second electronic device exits the local area network, the second electronic device The electronic device is used to transfer incoming call events to the first electronic device for connection; the second electronic device is used to terminate the current recording and save the second recording file, so that the file can be saved in time.

Alternatively, the second electronic device is used to send the current recording information to the cloud, so as to complete the recording of the upstream audio stream and the downstream audio stream of the incoming call event streamed to the first electronic device through the cloud, and save them. This method can be realized in the first After the local area network of the first electronic device and the second electronic device is disconnected, if the incoming call event is transferred from the second electronic device to the first electronic device, it can ensure that the recording continues to be recorded by the cloud to ensure that a complete call recording is recorded document.

In a possible implementation of the second aspect above, when the recording function is enabled on the first electronic device, the second electronic device is used to control the recording function to be turned off, and the recording button on the control interface of the second electronic device cannot Click to take effect. Further, it is ensured that the recording of the first electronic device can be performed effectively.

In a possible implementation of the second aspect above, enabling the recording function of the first electronic device means that the first electronic device is set to an automatic recording function, or the user activates the recording function through a recording key on the first electronic device.

In a possible implementation of the above-mentioned second aspect, the first electronic device and the second electronic device receive an incoming call event from the calling party, and are used to inquire whether they have enabled the recording function, and synchronize the query results. When the first electronic device If the device confirms that the recording function is enabled, the system determines that the recording function is enabled for the first electronic device; when the recording function is not enabled for the first electronic device and the recording function is enabled for the second electronic device, the system determines that the recording function is enabled for the second electronic device Case. The method is convenient for the first electronic device and the second electronic device to confirm synchronously that the recording function is turned on, and facilitates synchronization of recording capabilities.

In a possible implementation of the second aspect above, the first electronic device includes a first distributed framework, the second electronic device includes a second distributed framework, and the first electronic device is configured to use the first distributed framework and the second The second distribution framework of the electronic devices communicates so that the first electronic device and the second electronic device receive the incoming call event of the calling party synchronously.

In a possible implementation of the second aspect above, the second electronic device is used to synchronize the second recording file to the first distribution framework of the first electronic device through the second distribution framework, so that the second recording file can be sent to to the first electronic device.

In a third aspect, the present application also provides an electronic device, including:

memory to store instructions for execution by one or more processors of the device;

The processor is configured to execute instructions, so that the electronic device executes the method executed by the first electronic device or the method executed by the second electronic device in the embodiment of the first aspect above.

In a fourth aspect, the present application provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is run by an electronic device, the electronic device executes the first electronic device in the embodiment of the first aspect. method or a method executed by the second electronic device.

In the fifth aspect, the present application discloses a computer program product containing instructions. When it is run on a computer, it causes the computer to execute the method executed by the first electronic device or the method executed by the second electronic device in the embodiment of the first aspect. method.

Description of drawings

FIG. 1a is a scene diagram of a distributed architecture of a calling system according to an embodiment of the present application;

FIG. 1b is another scene diagram of the distributed architecture of the calling system according to an embodiment of the present application;

FIG. 2a is a schematic structural diagram of a first electronic device according to an embodiment of the present application;

FIG. 2b is a block diagram of the software structure of the first electronic device according to an embodiment of the present application;

Fig. 2c is a schematic diagram of the hardware structure of the second electronic device according to an embodiment of the present application

Fig. 3a is an interactive flow chart based on a distributed call recording synchronization method in a scenario of an embodiment of the present application;

FIG. 3b is an incoming call prompt interface of a mobile phone and a tablet computer according to an embodiment of the present application;

Fig. 4 is a schematic diagram of the interface after the mobile phone is connected to the phone according to an embodiment of the present application;

FIG. 5 is a schematic diagram of the interface after the tablet computer connects to the phone according to an embodiment of the present application;

Fig. 6 is an interactive flow chart based on the distributed call recording synchronization method under another scenario of an embodiment of the present application;

FIG. 7 is a schematic diagram of the interface after the mobile phone is connected to the phone according to an embodiment of the present application;

Fig. 8 is a schematic diagram of the interface of the tablet computer connected to the phone according to an embodiment of the present application;

Fig. 9a is a schematic diagram of the interface when the automatic recording function is enabled on the tablet computer according to an embodiment of the present application;

FIG. 9b is a schematic diagram of the interface in the case where the recording function is manually enabled on the tablet computer according to an embodiment of the present application;

FIG. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

Fig. 11 is a block diagram of a system-on-a-chip according to some embodiments of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

Referring to FIG. 1a, FIG. 1a schematically shows a scene diagram of a distributed architecture of a calling system according to an embodiment of the present application. The scene diagram includes a calling device 101 and a called device, wherein the called device may include at least one first electronic device and at least one second electronic device capable of implementing mobile data communication with the calling device 101 .

In the embodiment of the present application, the first electronic device is an electronic device with a telephone call function. For example, it may be a mobile call capability realized through a base station, such as making and receiving calls, or an IP call capability realized through a cellular network, such as WeChat voice etc. As shown in FIG. 1a, the mobile phone 102 and the tablet computer 103, and the mobile phone 102 and the tablet computer 103 are in-field connections, wherein the in-field connections may be network connections in the same local area network, or Bluetooth connections. When the calling device 101 initiates a phone call to multiple called devices, the mobile phone 102 and the tablet computer 103 in the called device can simultaneously output a prompt of an incoming call event (resonance of an incoming call). The mobile phone 102 and the tablet computer 103 that receive the incoming call signal confirm whether themselves have the state information of opening the automatic recording function, for example, open the state information of the automatic recording or not open the recording, and synchronize the state information with each other, and determine the recording on the mobile phone 102 Or record on the tablet 103 . When the mobile phone 102 turns on the automatic recording function, no matter whether the tablet computer 103 turns on the automatic recording function, then the mobile phone 102 or the tablet computer 103 is determined to be the mobile phone with the automatic recording function turned on. When the recording function is not enabled on the mobile phone 102 and the recording function is enabled on the tablet computer, the mobile phone 102 or the tablet computer determines that the recording function is enabled on the tablet computer.

In the embodiment of the present application, when the mobile phone 102 turns on the recording function, no matter the incoming call event is connected by the mobile phone 102 or the tablet computer 103, that is, the call, the mobile phone 102 will record the downstream audio stream from the caller's device, and record The upstream audio stream collected by the mobile phone 102 or the tablet computer 103 . When the call is hung up, the mobile phone 102 synthesizes the uplink audio stream and the downlink audio stream into a recording file and saves it in the local memory. In addition, when the tablet computer 103 connects the incoming call time, during the recording process, information such as the recording duration can be displayed on the interface of the mobile phone 102, and information such as the recording duration and the recording of the mobile phone can be displayed on the interface of the tablet computer 103, and the user can According to the content displayed on the interface, you can know the recording duration and the device currently recording.

When the mobile phone 102 does not open the recording function, and the tablet computer opens the recording function, if the user uses the tablet computer 103 to connect to the incoming call event, that is, the conversation, then the tablet computer 103 records the downstream audio stream from the mobile phone and is collected by the tablet computer. upstream audio stream. When the call is hung up, the tablet computer 103 synthesizes the upstream audio stream and the downstream audio stream into a recording file, and saves it in the memory of the tablet computer 103 . In addition, the tablet computer 103 displays recording prompt information such as the recording duration on the interface, and the mobile phone 102 displays the recording duration and the recording prompt information that the tablet computer is recording on the interface. device of. Moreover, the embodiment of the present application can realize how to display the recording function of the call interface synchronously and how to save the recording files in the near-field range when the operator's call is transferred between different devices in the context of distributed calls. Save important recording data.

In the above embodiments, the mobile phone is used as the first electronic device, and the tablet computer is used as the second electronic device for illustration. In some embodiments of the present application, the first electronic device may also be a tablet computer or a notebook computer with mobile communication capabilities, or a wearable electronic device such as a watch. The second electronic device may also be an electronic device with mobile communication capabilities, or an electronic device without mobile communication capabilities, but capable of communicating with the first electronic device through network data, for example, a mobile phone, a tablet computer, a notebook computer, a super Mobile personal computer, personal digital assistant (personal digital assistant, PDA), TV, or wearable electronic devices such as watches, wristbands, etc.

In another scenario of the present application, the incoming call resonance can be sent by the server to the mobile phone and the tablet computer at the same time to realize the incoming call resonance of the mobile phone and the tablet computer. Referring to FIG. 1b, FIG. 1b schematically shows another scene diagram of the distributed architecture of the calling system according to the embodiment of the present application. In this scenario, the server 106 can send an incoming call signal to the mobile phone 104, and the mobile phone 104 and the watch 105 can be connected wirelessly, such as Bluetooth, and the mobile phone 104 can send an incoming call signal to the watch 105 through Bluetooth, so that the mobile phone 104 and the watch 105 realize Incoming call resonance. The mobile phone and watch enable the recording function on different devices. The process of call recording and file saving is as described above, and will not be described here.

The following describes the synchronization method based on distributed call recording in the embodiment of the present application in combination with the specific structures of the first electronic device and the second electronic device.

Referring to FIG. 2a, FIG. 2a shows a schematic structural diagram of a first electronic device according to an embodiment of the present application. The first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus) , USB) connector 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.

It can be understood that, the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The processor 110 can generate an operation control signal according to the instruction opcode and the timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193 and the like through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100 .

The I2S interface can be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.

The PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. The audio module 170 can transmit the acquired downlink audio stream data and uplink audio stream data to an electronic device wirelessly connected to the first electronic device through the wireless communication module 160, so that the recorded audio stream can be saved.

In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 and the wireless communication module 160 . For example: the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit the audio signal to the wireless communication module 160 through the UART interface, so as to realize the function of obtaining the downstream audio stream through the electronic device connected with Bluetooth.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device 100 . The processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the electronic device 100 . In some embodiments, recording information can be displayed, for example, recording information such as recording duration and/or the name of the device being recorded.

It can be understood that the interface connection relationship between the modules shown in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 . In some embodiments, the mobile communication module 150 can be used to realize the transmission of call data between two electronic devices. The party device transmits uplink audio stream data.

The wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. applied on the electronic device 100. System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.

In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. In one embodiment of the present application, the electronic device 100 can realize the connection with the local area network of another electronic device through the wireless communication module 160 . The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

In some embodiments, the display screen can display an incoming call reminder interface and an interface with recording information displayed after the incoming call is connected. For example, a recording button can be displayed. The user can click the recording button to manually start the recording function, and can also display the recording duration, recording time, and recording time. Device name and other recording information, so that the user can control the recording function according to the interface content displayed on the display screen, or understand the status information of the recording, etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video, recording files and other files in the external memory card.

The internal memory 121 may be used to store computer-executable program codes including instructions. The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, a recording function, etc.) and the like. The storage data area can store data created during the use of the electronic device 100 (such as uplink audio data, downlink audio data, phonebook, etc.) and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example recording etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .

Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the voice transmitted by the calling device can be heard through the receiver 170B.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can approach the microphone 170C to make a sound through the human mouth, and input the sound signal into the microphone 170C to realize the collection of upstream audio stream.

The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . In some embodiments, when the user clicks and presses the recording function key on the display screen 194, the recording function can be turned on manually.

The touch sensor 180K is also called "touch device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the position of the display screen 194 .

The motor 191 can generate a vibrating reminder. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, after receiving an incoming call signal, a vibration is generated to remind the user that a call needs to be answered.

Referring to FIG. 2b, FIG. 2b shows a software structural block diagram of the first electronic device according to the embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are application program layer, application program framework layer, Android runtime and system library, and kernel layer from top to bottom. In some other embodiments, the Android system is divided into five layers, from top to bottom are application program layer, application program framework layer, Android runtime (Android runtime) and system library, hardware abstraction layer and kernel layer.

The application layer can consist of a series of application packages.

As shown in Figure 2b, the application layer may include call applications and the like. In addition, in some embodiments, applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and recording may also be included.

In some embodiments, the user can obtain the call interface during the call through the call application program, and realize the logical operation of the call process.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 2b, the application framework layer may include a communication protocol framework, a rendering module, a distributed framework, an audio framework, and a file management framework.

The communication protocol framework belongs to a part of the phone manager and is used to provide the communication function of the electronic device 100 . For example, the management of call status (including connected, hung up, etc.).

The drawing and rendering module is part of the video system, including visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, including the recording interface during a call, it may include a view for displaying text and a view for displaying pictures.

A distributed framework for realizing data synchronization of devices within a local area network. For example, synchronizing incoming call signals, making two devices in the LAN resonate for incoming calls, synchronizing recording files, etc.

Audio frameworks can belong to content providers, which are used to store and retrieve data and make these data accessible to applications. The data may include recording duration, recording device name, video, image, audio, calls made and received, etc.

The file management framework is part of the resource manager and is used to provide various resources for applications, such as localized strings, icons, pictures, layout files, recording files, video files, etc.

Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The hardware abstraction layer is an interface layer between the operating system kernel and the hardware circuit, which is used to abstract the hardware and provide a virtual hardware platform for the operating system.

As shown in Figure 2b, the hardware abstraction layer may include a transmission channel module, a display processing module, a trust ring, an audio stream processing module, an external storage module, and the like.

The kernel layer, system security, memory management, process management, network protocol stack and driver model all depend on the kernel layer. At least it can include Inter Process Communication (IPC), display driver, soft bus, audio driver, and storage driver.

The workflow of the software and hardware of the electronic device 100 will be exemplarily described below with reference to the call scene in FIG. 2b.

When the mobile communication module 150 receives an incoming call signal, the kernel layer processes the signal into an incoming call event, the application layer sequence framework layer obtains the incoming call event through the transmission channel module of the hardware layer, and the application layer sequence layer calls the communication protocol framework to obtain the incoming call event, and starts Phone application program, at the same time, the kernel layer starts the display screen 194 through the display driver, so that the corresponding interface of the phone application layer is displayed on the display screen 194, and the user can answer the call or hang up the call through the answer or hang up key on the call interface .

In one embodiment of the present application, the electronic device 100 can communicate with the electronic device A through the local area network, and after receiving the call, the incoming call event is synchronized to the electronic device connected to it through the distributed framework, such as the electronic device A, two Electronic equipment realizes incoming call resonance. In addition, the phone APP of the electronic device 100 may include an automatic recording and monitoring module, through which the status information of whether the automatic recording function is enabled on the current device is monitored. (The electronic device A may also synchronize its state information to the electronic device 100 through the distributed framework). If the user clicks to answer the call on the interface of electronic device A (electronic device A can display the recording on electronic device 100), then electronic device 100 can obtain the upstream audio stream data collected by electronic device A through wireless communication module 160, and at the same time, electronic The device 100 obtains the downlink audio stream through the mobile communication module 150, and combines the uplink audio stream data and the downlink audio data through the audio stream processing module to form a recording file. After the call ends, the recording file is saved through the external storage module.

Referring to FIG. 2c, FIG. 2c shows a schematic diagram of a hardware structure of a second electronic device according to an embodiment of the present application, and the second electronic device 200 may be a tablet computer.

The second electronic device 200 will be specifically described below. It should be understood that the second electronic device 200 shown in FIG. 2c is only an example, and the second electronic device 200 may have more or fewer components than those shown in FIG. 2c, and may combine two or more components, or may have different component configurations. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

In one embodiment of the present application, the hardware structure of the second electronic device may be the same as the structure shown in Figure 2a, the software structure may be the same as the structure shown in Figure 2b, and the hardware structure may also be different from the structure shown in Figure 2a .

As shown in FIG. 2 c , the second electronic device 200 may include: a processor 210 , a memory 220 , a wireless communication module 230 , an audio module 240 , a sensor module 250 , a display 260 and a power supply module. Wherein, the audio module 240 includes a speaker 241 and a microphone 242 . The sensor module 250 includes a pressure sensor 251 and a touch sensor 252 .

Processor 210 may be used to read and execute computer readable instructions. In some embodiments, the processor 210 may include a controller, an arithmetic unit and registers. Among them, the controller is mainly responsible for instruction decoding, and sends out control signals for the operation corresponding to the instruction. The arithmetic unit is mainly responsible for saving the register operands and intermediate operation results temporarily stored during the execution of the instruction. In a specific implementation, the hardware architecture of the processor 201A may be an application-specific integrated circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, or an NP architecture, and the like.

In some embodiments, the processor 210 can be used to analyze the incoming call signal received by the wireless communication module 230, such as answering the call request sent by the sender device, and the status information sent by the first electronic device whether to enable the recording function, the downlink Audio stream and other information. The processor 201A can be used to perform processing operations according to the analysis results, such as invoking the display 260 to display a call interface, where the call interface can include the recording duration and the name of the recording device. It is also possible to determine whether the audio module needs to be invoked for recording through the obtained status information of whether the recording function is enabled, and to save the recording file after the call ends.

The memory 220 is coupled with the processor 210 for storing various software programs and/or sets of instructions. In some embodiments, memory 220 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 202A can store operating systems, such as embedded operating systems such as uCOS, VxWorks, and RTLinux.

In some embodiments, the memory 220 can also store information such as the name of the device connected to it and the recording capability of the device, and then when the device corresponding to the stored device name is in a call, the recording function is turned on, and the call interface is displayed on the display 260. The call interface It can display that the device corresponding to the device name is recording.

The wireless communication module 230 can provide applications on the electronic device 200 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), frequency modulation (frequency) modulation, FM), near field communication (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 230 may be one or more devices integrating at least one communication processing module. The wireless communication module 230 receives electromagnetic waves, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 .

In some embodiments, the electronic device 200 can realize network connection with other electronic devices through the wireless communication module 230, for example, realize connection with the local area network of the electronic device 100, so as to realize functions such as call resonance and recording capability synchronization.

The electronic device 200 may implement audio functions through an audio module 240, a speaker 241, a microphone 242, and an application processor. Such as music playback, recording, etc.

The audio module 240 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 240 may also be used to encode and decode audio signals. And transmit the encoded or decoded audio to the processor 210, so that the processor 210 performs speech recognition based on the encoded or decoded audio, and determines the content corresponding to the audio, such as the audio stream during a call. In some embodiments, the audio module 240 may be set in the processor 210 , or some functional modules of the audio module 240 may be set in the processor 210 .

The microphone 242, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When talking, the user can put his mouth close to the microphone 242 to make a sound, input the sound signal to the microphone 242, and the microphone 242 further sends the sound signal to the processor 210, so that the processor 210 can recognize the voice content. In addition, the audio module 240 can also record the audio data input from the microphone 242, so as to save the call record file.

The pressure sensor 251 is used for sensing pressure signals, and can convert the pressure signals into electrical signals. There are many types of pressure sensors 251, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to the pressure sensor 251, the capacitance between the electrodes changes. The electronic device 200 determines the intensity of pressure according to the change in capacitance. In one embodiment of the present application, the pressure sensor 251 may be disposed on the surface of the electronic device. When a pressing or touching operation acts on the pressure sensor 251, the electronic device 200 detects the strength of the pressing or touching operation according to the pressure sensor 251, and transmits the detected pressing or touching operation strength value to the processor 210, and the processor 210 further Execute the corresponding command. For example, when the pressure value of the user pressing the pressure sensor 251 reaches a preset value, the processor 210 turns on the voice assistant function to make a voice call; logo. The electronic device 200 may also calculate the pressed or touched position according to the detection signal of the pressure sensor 251 . In some embodiments, when the user presses the display screen of the display, the processor 210 can obtain the pressure value and the pressed position through the pressure sensor 251, and determine that the user wants to answer the call or hang up the call, or turn on the recording function Or turn off the recording function, etc.

The touch sensor 252 is also called "touch device". The touch sensor 252 is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. For example, user click or double click events etc. In some other embodiments, the touch sensor 252 may also be disposed on the surface of the electronic device 200 , which is different from the position of the pressure sensor 251 .

The power module 270 can be used to control the power supply of the power supply to the electronic device 200 .

The display 260 includes a display screen for displaying images. In some embodiments, a call interface can be displayed, and the interface can include the current recording duration, or include the recording duration and the prompt information of the device currently recording, for example, the electronic device 100 is recording .

The method for synchronizing call recording based on the distributed call according to the embodiment of the present application will be described below in combination with different scenarios.

The implementation of the embodiments of the present application is based on the fact that when the caller sends an incoming call signal, the first electronic device and the second electronic device can receive the incoming call event synchronously, and simultaneously perform an incoming call notification, so that the user can select one of the devices for communication. Wherein, the first electronic device is a device with a mobile phone calling function, that is, a main device (the first electronic device has mobile data communication capability). The second electronic device may or may not have the mobile phone calling function, which is not limited here.

In the following embodiments, the method is applied to a system composed of a mobile phone (first electronic device) and a tablet computer (second electronic device) as an example. The mobile phone and the tablet computer are used as the called party equipment, and the mobile phone can be as shown in Figure 2a and Figure 2b The first electronic device shown, the tablet computer may be a second electronic device with structures as shown in Fig. 2a, Fig. 2b and Fig. 2c.

In the embodiment of this application, the mobile phone and the tablet computer can be two electronic devices associated based on a trust ring. Then consider implementing a distributed call recording synchronization method to improve the security of user calls.

In the embodiment of the present application, from the perspective of enabling the recording function, two major scenarios may be included, namely, the scenario where the mobile phone is used as the main device to enable the recording function, and the recording function is not enabled on the mobile phone and the recording function is enabled on the tablet computer. Wherein, the scene where the mobile phone turns on the recording function further includes: the mobile phone turns on the sound recording function, and the tablet computer turns on the sound recording function, and the mobile phone turns on the sound recording function, and the tablet computer does not turn on the sound recording function.

The following describes the synchronization method based on distributed call recording in the embodiment of the present application in combination with two scenarios.

scene 1

When the recording function of the mobile phone is turned on, the scene where the tablet computer connects to the incoming call event.

Referring to FIG. 3 a , FIG. 3 a shows an interactive flow chart of a method for synchronizing calls based on distributed call recording in a scenario according to an embodiment of the present application. The method is applied in a system composed of a mobile phone and a tablet computer, as shown in Figure 3a, including a mobile phone and a tablet computer, wherein the mobile phone includes a call interface 11 (display screen), a recording synchronization module 12, a distributed framework 13, and a setting module 14 and filesystem 15. The tablet computer includes a setting module 21, a distributed framework 22, a recording synchronization module 23 and a call interface 24 (display screen). As shown in Fig. 3a, the flowchart includes S301-S319.

S301. The server sends an incoming call signal, and the mobile phone obtains the incoming call signal.

In the embodiment of the present application, the mobile phone can obtain the incoming call signal through the mobile communication module 150 as shown in FIG.

S302, mobile phone and tablet computer call resonance. In conjunction with S301, the distributed framework 13 synchronizes the incoming call event to the distributed framework 22 of the tablet computer, so that the mobile phone and the tablet computer can simultaneously realize the reminder of the incoming call event, such as ringing, vibration, interface prompting, etc.

After the mobile phone and tablet computer receive an incoming call event, before connecting the call, the mobile phone and tablet computer need to confirm the status information of the recording, for example, whether to enable automatic recording or not to enable automatic recording, etc., and synchronize to confirm that the recording is performed by the mobile phone Or record from a tablet. The process of determining the recording device and data synchronization will be described in S303-S308.

S303, the distributed framework 13 of the mobile phone notifies the recording synchronization module 12 of the incoming call event, and the distributed framework 22 notifies the recording synchronization module 23 of the incoming call event.

S304 , the recording synchronization module 12 of the mobile phone inquires the recording enable state request from the setting module 14 , and the recording synchronization module 23 of the tablet computer inquires the recording enable state request from the setting module 21 .

In the embodiment of the present application, in scenario 1, taking the automatic recording function enabled in the mobile phone and not enabled in the tablet computer as an example, the setting module 14 inquires about the state information of enabling the recording function, and the setting module 21 inquires that the recording function is not enabled status information for the recording function,

S305. Return the status information of the recording. For example, the recording synchronization module 12 obtains the status information that the recording function is enabled, and the recording synchronization module 23 obtains the status information that the recording function is not enabled.

S306, the recording synchronization module 12 sends a request for recording capability synchronization to the distributed framework 13.

S307, the recording capability is synchronized. For example, the distributed framework 13 synchronizes the status information and device name of the recording function to the distributed framework 22, so that the name of the recording device can be displayed on the call interface, for example, when the mobile phone A is recording and starting.

S308, the distributed framework 22 sends the recording capability to the voice synchronization module 23, and the distributed framework 13 caches the recording capability of the tablet computer, that is, if the recording function of the mobile phone is enabled, whether the recording function of the tablet computer can be retained.

In addition, in some embodiments, when the recording function is enabled on the mobile phone, in order to ensure the normal progress of the recording capability, the function of enabling recording on the tablet computer can be turned off, that is, on the interface, the recording button is grayed out, and the user cannot use the recording button to record. Turn recording on or off on your tablet. When the recording capabilities of the mobile phone and the tablet are synchronized, the information status of the recording function enabled by the mobile phone is synchronized to the tablet computer. The interface for answering incoming calls is displayed on the mobile phone and the tablet computer.

Referring to FIG. 3b, FIG. 3b exemplarily shows an incoming call prompt interface of a mobile phone and a tablet computer. (1) in Figure 3b is the incoming call prompt interface of the mobile phone, and (2) in Figure 3b is the incoming call prompt interface of the tablet computer. The incoming call prompt interface is output, and the user can answer the call through the accept key on the prompt interface of the mobile phone, or through the accept key on the tablet computer. For the process of incoming call output, refer to the description of S301-S308. In some embodiments of the present application, the incoming call resonance of the mobile phone and the tablet computer may also be directly sent by the server to the mobile phone and the tablet computer, which is not limited here.

In the embodiment of the present application, if the user answers the call on the mobile phone, it is a conventional incoming call answering, which will not be described here. And when the user answers an incoming call from the tablet computer, the ability of its recording function needs to be synchronized, so the data transmission process and interface display will change. Therefore, in the following embodiments, the main description is to answer the call on the tablet computer. Scenes.

As shown in Figure 3a, when the user answers the call through the accept button on the tablet computer, the interaction process of each module can refer to S309-S319.

S309, the recording synchronization module 23 can input the obtained recording capability to the phone application program, so as to update the call interface. In the embodiment of the present application, the recording capability information may include the information of enabling the recording function of the mobile phone and the name of the mobile phone, such as Magic3. After the tablet computer obtains the recording capability of the mobile phone, it will output corresponding information on the interface of answering the call, so that the user can know the recording situation on the call interface of the tablet computer.

When the tablet computer connects to the call, it will inform the mobile phone of the notification of the connected call, as shown in 310-313 in Figure 3a. The mobile phone and the tablet computer realize the connection notification through the distributed framework, and the call interface is updated on the mobile phone. In the embodiment of the present application, S309 and S310-S313 may be executed at the same time, and do not represent a sequential order. In this way, after the user answers the call, he cannot perceive the order in which the mobile phone and the tablet computer update the call interface.

Referring to FIG. 4 , FIG. 4 exemplarily shows a schematic interface of the mobile phone after the call is connected. As shown in FIG. 4 , the interface 410 includes a recording key 411 that can enable or disable the recording function. When the call is connected, the position corresponding to the recording key displays the recording duration, for example, "01:03" seconds. In addition, other function keys can also be displayed on the interface 410, for example, "wait", "add call", "video call", "mute", "contact", "dial pad", "headphone" and hang up The phone's function key "hang up", and the "retract" function key for transferring the incoming call flow to the mobile phone, etc. Users can achieve desired effects through these function keys. In addition, when recording, a recording prompt icon 412 can be displayed on the interface 410, and the user can also know that the mobile phone is recording through the icon.

Referring to FIG. 5 , FIG. 5 exemplarily shows a schematic interface of the tablet computer after the phone is connected. As shown in FIG. 5 , the interface 510 includes a recording key 511 that can enable or disable the recording function. In this application, since the recording function is enabled on the mobile phone side, in order to ensure the normal progress of the recording on the mobile phone side, the recording key on the tablet computer is turned off to enable or disable the recording function, that is, it is grayed out. When the call is connected, the position corresponding to the recording key 511 displays the recording duration, such as "01:03" seconds, and which device is recording, such as "Magic3 is recording", and the user can determine the current recording by observing the device name. safe. In addition, other function keys can also be displayed on the interface 510, for example, "wait", "add call", "video call", "mute", "contact", "dial pad", "headphone" and hang up The function key "hang up" of the phone, and the function key "return to mobile phone" for disconnecting, transferring the call to the mobile phone, etc. Users can achieve desired effects through these function keys.

In addition, after the call is connected, the tablet computer will obtain the voice input by the user. Specifically, the voice input by the user can be obtained through the microphone of the tablet computer. The audio module of the tablet computer converts the sound signal into an electrical signal (uplink audio stream) and transmits To the recording synchronization module 23.

S314, the recording synchronization module 23 sends the upstream audio stream to the distributed framework 22.

S315, the distributed framework 22 synchronizes the upstream audio stream to the distributed framework 13 on the mobile phone side.

S316, the distributed framework 13 transmits the upstream audio stream to the recording synchronization module 12. In the embodiment of the present application, S314-S316 and S310-S312 can be performed simultaneously. In addition, the recording synchronization module 12 also needs to obtain the upstream audio stream sent by the calling device.

S317, the recording synchronization module merges the upstream audio stream and the downstream audio stream.

S318, after the call ends, the recording ends, and the recording synchronization module sends the merged complete recording file to the file system 15 (for example, the internal memory in Figure 2a, which can also be stored in the external memory through the external memory interface) for storage.

According to the call recording synchronization method based on distributed calls in the embodiment of the present application, the synchronization of the recording ability between the mobile phone and the tablet computer can be realized, so that the preservation of important files can be realized. Recording information can be displayed synchronously on the device with recording function, or on the call interface of the mobile phone, such as the recording time, the name of the recording device (Magic3), and the status (recording), so that users can timely Find out if your current recording equipment is capable of keeping your information secure.

In the above-mentioned embodiment, the explanation is carried out by taking the automatic recording function on the mobile phone as an example. In some embodiments, when the automatic recording function is not enabled on the mobile phone and the tablet computer, the user can also use the recording button on the interface, for example , the recording key 411 or the recording key 511 turns on or off the recording function, and after it is confirmed to be turned on, the recording function is synchronized. When the recording function is manually enabled, the synchronization process of the recording capability may refer to S306 and S307 in FIG. 3a. After the manual recording is turned on, the interface diagrams of the mobile phone and the tablet computer can be shown in Figure 4 and Figure 5. The process of collecting audio streams, merging recording files, and saving recording files can refer to S314-S319 in FIG. 3a, and will not be described in detail.

scene 2

When the recording function of the mobile phone is not enabled, when the tablet PC receives an incoming call event.

Referring to FIG. 6 , FIG. 6 shows an interactive flowchart of a distributed call recording synchronization method in another scenario of the embodiment of the present application. This method is applied in the system that is made up of mobile phone and tablet computer, as shown in Figure 6, comprises mobile phone and tablet computer, and wherein mobile phone comprises call interface 11 (display screen), recording synchronization module 12, distributed framework 13, setting module 14 and filesystem 15. The tablet computer includes a setting module 21, a distributed framework 22, a recording synchronization module 23, a call interface 24 (display screen) and a file system. As shown in FIG. 6, the flowchart includes S601-S626.

S601 to S611 are the process of synchronizing the recording capability of each module of the mobile phone and the tablet computer before the interface is displayed. Wherein, the process of S601-S605 is the same as that of S301-S305, and will not be described in detail here.

S606, mobile phone and tablet computer synchronous recording capability. For example, the mobile phone informs the distributed framework 22 of the panel computer that the automatic recording function (recording capability) is not opened through the distributed framework 13, so that the tablet computer confirms that the mobile phone does not open the recording function.

S607, the distributed framework 22 sends the information that the recording function of the mobile phone is not turned on to the recording synchronization module 23.

S608, the recording synchronization module 23 determines that the recording is performed by itself according to the fact that the recording function is enabled by itself, but the recording function of the mobile phone is not enabled.

S609, the recording synchronization module 23 sends a recording capability synchronization request to the distributed framework 22.

S610, the distributed framework 22 synchronizes the recording capability to the distributed framework 13. Wherein, the process of synchronizing the recording ability includes the device name, that is, the name of the tablet computer, such as tablet A, and information about enabling the recording function of the tablet computer. In this way, the mobile phone obtains the name of the recording device, and displays the corresponding recording information.

S611, the distributed framework 23 sends the recording capability to the recording synchronization module 12, so that the recording synchronization module updates the incoming call prompt interface, and the recording synchronization module 23 of the tablet computer updates the call interface to display the incoming call prompt interface. Realize the synchronous recording capability of the tablet computer and the mobile phone, and display the call prompt interface at the same time. The schematic diagram of the interface can be referred to as shown in FIG. 3b.

As shown in Figure 6, when the user answers the call through the accept button on the tablet computer, the interaction process of each module can refer to S612-S626. Wherein, S612-S615 are the same as S310-S313 in Fig. 3a.

When the call is connected, the call interface of the mobile phone and the tablet computer can be referred to as shown in FIG. 7 and FIG. 8 .

Referring to FIG. 7, FIG. 7 shows a schematic diagram of the interface of the mobile phone after the call is connected. As shown in FIG. 7 , the interface 710 includes a recording key 711 that can enable or disable the recording function. When the call is connected, the corresponding position of the recording key displays the recording duration, such as "01:03" seconds, and a text prompt message "Tablet A is recording", and the user confirms whether the current recording is safe according to the prompt message. In some embodiments, since the recording function of the tablet computer is enabled, the function of enabling or disabling the recording of the recording key 711 will be disabled, that is, grayed out. In addition, other function keys can also be displayed on the interface 710, for example, "wait", "add call", "video call", "mute", "contact", "dial pad", "headset" and hang up The phone's function key "hang up", and the "retract" function key for transferring the incoming call flow to the mobile phone, etc. Users can achieve desired effects through these function keys.

Referring to FIG. 8 , FIG. 8 shows a schematic diagram of the interface of the tablet computer after the phone is connected. As shown in FIG. 8 , the interface 810 includes a recording key 811 that can enable or disable the recording function. When the call is connected, the position corresponding to the recording key 811 displays the recording duration, for example, "01:03" seconds. In addition, other function keys can also be displayed on the interface 710, for example, "wait", "add call", "video call", "mute", "contact", "dial pad", "headset" and hang up The function key "hang up" of the phone, and the function key "return to mobile phone" for disconnecting, transferring the call to the mobile phone, etc. Users can achieve desired effects through these function keys.

As shown in Figure 6, S617-S626 is the process of saving the recording file.

S616, the mobile phone synchronizes the downlink audio stream to the recording synchronization module through the distributed framework 13, and this process can further be that the distributed framework 13 synchronizes the downlink voice stream to the distributed framework 22, and then the distributed framework 22 inputs and sends the downlink voice stream To the recording synchronization module 23. , in addition, the recording synchronization module 23 also acquires the upstream audio stream corresponding to the voice input by the user.

S617, the recording synchronization module 23 merges the upstream audio stream and the downstream audio stream.

S618, when the user hangs up the call through the interface, the call interface 24 notifies the recording synchronization module to stop recording.

S619, the recording synchronization module 23 sends the complete recording file recorded during the call to the file system for storage.

In addition, in some embodiments, in order to be able to save the file on the mobile phone, after the call ends, the tablet computer can display confirmation information through the interface, whether to synchronize to the mobile phone, and after receiving the user's confirmation of synchronization information, the The recording files are synchronized to the mobile phone for storage. For the specific implementation process, refer to S620-S625.

S620, after receiving the recording stop notification, the recording synchronization module 23 stops recording, and sends a synchronization file prompt message to the call interface.

S621, the call interface displays an option of whether to synchronize the recording file, so that the user can choose to synchronize to the mobile phone for storage, or to save it on the mobile phone.

In the embodiment of the present application, the content displayed on the call interface can also be displayed differently according to the two situations in which the tablet computer automatically turns on the recording function or manually turns on the recording function. It can also be the same in some embodiments.

Referring to Fig. 9a, Fig. 9a exemplarily shows a schematic diagram of the interface when the automatic recording function is enabled on the tablet computer. As shown in Figure 9a, a prompt box pops up on the main interface of the tablet computer to remind the customer to confirm, such as "the recording file has been saved to the current device, do you want to synchronize the recording file to the mobile phone?" and display the options "yes" and "no" for The user selects, and when the user selects Yes, the call interface executes S622. If you choose No, it ends.

Referring to FIG. 9b, FIG. 9b exemplarily shows a schematic diagram of an interface when the recording function is manually enabled on the tablet computer. As shown in Figure 9b, a prompt box pops up on the call interface of the tablet computer to remind the customer to confirm, such as "the recording file has been saved to the current device, do you want to synchronize the recording file to the mobile phone?" and display options "yes" and "no" for The user selects, and when the user selects Yes, the call interface executes S622. If you choose No, it ends.

S622, the call interface 24 notifies the recording synchronization module 23 to synchronize the recording file.

S623, the recording synchronization module 23 sends a request to the distributed framework 22 for recording file synchronization.

S624, the distributed framework 22 synchronizes the recording file to the distributed framework 13.

S625, the recording synchronization module 12 obtains the recording file from the distributed framework 13.

S626, the recording synchronization module 12 sends it to the file system 15 for storage.

In the above embodiment, when the user is talking on the tablet computer, if the network connection between the mobile phone and the tablet computer is disconnected, for example, the mobile phone is taken out, the tablet computer can transfer the call flow to the mobile phone so that the user can continue Complete the call on your phone. At this point, the recording on the tablet stops. And save the recording file locally. The whole recording is over.

In some embodiments of the present application, when the mobile phone and the tablet computer are disconnected from the network and the recording on the tablet computer stops, and the mobile phone is still talking, in order to ensure the integrity of the entire call recording, the tablet computer can also record Stream to the cloud server, and the cloud server will continue to complete the recording, and after the call on the mobile phone is over, it will request confirmation information from the mobile phone and the tablet whether to synchronize the complete recording file, so that when the LAN is disconnected, the call will be transferred to the mobile phone , can still ensure complete recording during the entire call and improve user experience.

Referring to FIG. 10, the present application also provides an electronic device, including:

memory 1010 for storing instructions to be executed by one or more processors of the device, and

The processor 1020 is configured to execute the method explained with reference to FIG. 3 a and FIG. 6 in the above embodiments.

The present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is run by a processor, the processor executes the method explained in 3a and FIG. 6 in the above embodiment.

The present application also provides a computer program product containing instructions, and when the computer program product is run on an electronic device, the processor is made to execute the method shown in 3a and FIG. 6 in the above embodiment.

Referring now to FIG. 11 , shown is a block diagram of a SoC (System on Chip, system on a chip) 1300 according to an embodiment of the present application. In Fig. 11, similar parts have the same reference numerals. Also, dashed boxes are optional features for more advanced SoCs. In FIG. 11, SoC 1300 includes: interconnection unit 1350, which is coupled to application processor 1310; system agent unit 1380; bus controller unit 1390; integrated memory controller unit 1340; 1320, which may include integrated graphics logic, an image processor, an audio processor, and a video processor; a static random access memory (Static Random Access Memory, SRAM) unit 1330; a direct memory access (DMA) unit 1360. In one embodiment, coprocessor 1320 includes a special purpose processor such as, for example, a network or communication processor, compression engine, GPGPU, high throughput MIC processor, or embedded processor, among others.

Static Random Access Memory (SRAM) unit 1330 may include one or more computer-readable media for storing data and/or instructions. Computer-readable storage media may have instructions stored thereon, and specifically, both temporary and permanent copies of the instructions. The instruction may include: when executed by at least one unit in the processor, causing the Soc1300 to execute the method for establishing a device communication connection according to the above-mentioned embodiment, for details, refer to the method explained in the above-mentioned embodiment 3a and FIG. 6 , and details will not be repeated here. .

Various embodiments of the mechanisms disclosed in this application may be implemented in hardware, software, firmware, or a combination of these implementation methods. Embodiments of the present application may be implemented as a computer program or program code executed on a programmable system comprising at least one processor, a storage system (including volatile and non-volatile memory and/or storage elements) , at least one input device, and at least one output device.

Program code can be applied to input instructions to perform the functions described herein and to generate output information. The output information may be applied to one or more output devices in known manner. For the purposes of this application, a processing system includes any computer having a processor such as, for example, a Digital Signal Processor (DSP), a microcontroller, an Application Specific Integrated Circuit (ASIC), or a microprocessor. system.

The program code can be implemented in a high-level procedural language or an object-oriented programming language to communicate with the processing system. Program code can also be implemented in assembly or machine language, if desired. In fact, the mechanisms described in this application are not limited in scope to any particular programming language. In either case, the language may be a compiled or interpreted language.

In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried by or stored on one or more transitory or non-transitory machine-readable (e.g., computer-readable) storage media, which can be executed by one or more processors read and execute. For example, instructions may be distributed over a network or via other computer-readable media. Thus, a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including, but not limited to, floppy disks, compact discs, compact discs, Compact Disc Read Only Memory , CD-ROMs), magneto-optical disk, read-only memory (Read Only Memory, ROM), random access memory (RAM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, EPROM), electrically erasable Programmable read-only memory (Electrically Erasable Programmable Read Only Memory, EEPROM), magnetic card or optical card, flash memory, or used to transmit information in the form of electricity, light, sound or other forms of transmission using the Internet (for example, carrier waves, infrared signals Tangible machine-readable storage of digital signals, etc.). Thus, a machine-readable medium includes any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).

In the drawings, some structural or methodological features may be shown in a particular arrangement and/or order. However, it should be understood that such specific arrangements and/or orderings may not be required. Rather, in some embodiments, these features may be arranged in a different manner and/or order than shown in the figures of the description. Additionally, the inclusion of structural or methodological features in a particular figure does not imply that such features are required in all embodiments, and in some embodiments these features may not be included or may be combined with other features.

It should be noted that each unit/module mentioned in each device embodiment of this application is a logical unit/module. Physically, a logical unit/module can be a physical unit/module, or a physical unit/module. A part of the module can also be realized with a combination of multiple physical units/modules, the physical implementation of these logical units/modules is not the most important, the combination of functions realized by these logical units/modules is the solution The key to the technical issues raised. In addition, in order to highlight the innovative part of this application, the above-mentioned device embodiments of this application do not introduce units/modules that are not closely related to solving the technical problems proposed by this application, which does not mean that the above-mentioned device embodiments do not exist other units/modules.

It should be noted that in the examples and descriptions of this patent, relative terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply There is no such actual relationship or order between these entities or operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Although this application has been shown and described with reference to certain preferred embodiments thereof, those skilled in the art will understand that various changes in form and details may be made therein without departing from this disclosure. The spirit and scope of the application.

Claims

A synchronization method based on distributed call recording, applied to a system including a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are in a near-field connection, and the first electronic device The device is a device with a phone call function, wherein the method includes:

The first electronic device receives an incoming call event from a calling party;

The first electronic device notifies the second electronic device of the incoming call event, and the second electronic device answers the incoming call event, and the answering of the incoming call event is used to indicate that the second electronic device and said calling party makes a call;

When the call is hung up, the first electronic device displays a reminder of the recording file, wherein the recording file includes the downstream audio stream from the calling party and the upstream audio collected by the second electronic device flow.
The method according to claim 1, characterized in that, when the recording function of the first electronic device is turned on, the first electronic device displays a reminder of the recording file, including:

The first electronic device records the downstream audio stream from the caller and the upstream audio stream collected by the second electronic device, and when the call is hung up, the first electronic device records the The downstream audio stream and the upstream audio stream are synthesized into a first recording file, and a prompt for saving the first recording file is displayed.
The method according to claim 2, wherein, during the recording process of the first electronic device, the first electronic device displays a first recording prompt on the interface, wherein the first recording prompt includes at least The duration of the first recording;

The second electronic device displays a second recording prompt on the interface, and the second recording prompt includes the first recording duration and information about recording audio on the first electronic device.
The method according to claim 1, characterized in that,

When the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, the first electronic device displays a prompt of the recording file, including:

Recording the downstream audio stream from the caller and the upstream audio stream collected by the second electronic device by the second electronic device, and when the call is hung up, the second electronic device will The downstream audio stream of the calling party and the collected upstream audio stream are combined into a second recording file;

The second electronic device sends the second recording file to the first electronic device, so that the first electronic device receives a reminder to save the second recording file.
The method according to claim 4, wherein during the recording process of the second electronic device, the second electronic device displays a third recording prompt on the interface, and the third recording prompt includes at least the second recording time;

The first electronic device displays a fourth recording prompt on the interface, and the fourth recording prompt includes the second recording duration and information about recording audio on the second electronic device.
The method according to claim 4 or 5, wherein when the call is hung up, the second electronic device saves the second recording file to a local memory.
The method according to any one of claims 4-6, wherein the second electronic device sends the second recording file to the first electronic device, comprising:

The second electronic device outputs a prompt interface, and the prompt interface includes confirmation information whether to synchronize the second recording file to the first electronic device;

When the second electronic device receives the user's operation of confirming and saving on the prompt interface, it sends the second recording file to the first electronic device.
The method according to any one of claims 4-7, wherein when the first electronic device does not enable the recording function and the second electronic device enables the recording function, the second electronic device When recording audio,

The recording button on the interface of the first electronic device cannot be clicked to take effect.
The method according to any one of claims 4-8, characterized in that, enabling the recording function of the second electronic device enables the automatic recording function for the second electronic device, or the user presses the recording button on the second electronic device The recording function is turned on.
The method according to any one of claims 4-9, wherein when the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device,

When the first electronic device or the second electronic device exits the local area network, the incoming call event is transferred from the answering stream on the second electronic device to the first electronic device for answering;

The second electronic device terminates the current recording and saves the second recording file; or,

The second electronic device sends the current recording information to the cloud, so as to complete the recording of the upstream audio stream and the downstream audio stream corresponding to the incoming call event streamed to the first electronic device through the cloud.
The method according to claim 2-3, wherein when the recording function of the first electronic device is turned on, the recording function of the second electronic device is turned off, and the interface of the second electronic device The record key cannot be clicked to take effect.
The method according to claim 2, 3 or 10, wherein the recording function of the first electronic device is set to the automatic recording function of the first electronic device, or the user through the first electronic device The recording function is enabled by the recording key.
The method according to any one of claims 1-12, characterized in that,

The first electronic device and the second electronic device receive the incoming call event from the calling party, respectively query whether they have enabled the recording function, and synchronize the query results,

When the first electronic device confirms that the recording function is enabled, the system determines that the recording function is enabled for the first electronic device;

When the recording function is not enabled on the first electronic device and the recording function is enabled on the second electronic device, the system determines that the recording function is enabled on the second electronic device.
The method according to any one of claims 1-13, wherein the first electronic device includes a first distributed framework, the second electronic device includes a second distributed framework, and the first electronic device Simultaneously receiving an incoming call event of a calling party with the second electronic device, comprising:

The first electronic device communicates through the first distributed framework and the second distributed framework of the second electronic device, so that the first electronic device and the second electronic device receive the calling party synchronously. incoming call events.
The method according to claim 11, wherein sending the second recording file to the first electronic device comprises: the second electronic device uploading the second recording file through the second distributed framework The file is synchronized to the first distribution framework of the first electronic device, so that the second electronic device sends the second recording file to the first electronic device.
An electronic device, characterized in that it comprises:

memory for storing instructions to be executed by one or more processors of the device, and

A processor, configured to execute the instructions, so that the electronic device executes the method executed by the first electronic device or the method executed by the second electronic device according to claims 1-15.
A synchronization system based on distributed call recording, characterized in that it includes;

A first electronic device, configured to execute the method performed by the first electronic device according to any one of claims 1-15;

The second electronic device is configured to execute the method performed by the second electronic device according to any one of claims 1-15.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and when the computer program is run by an electronic device, the electronic device executes any one of claims 1-15. The method executed by the first electronic device or the method executed by the second electronic device.
A computer program product containing instructions, characterized in that, when the computer program product is run on an electronic device, the electronic device is made to execute the method or the method performed by the first electronic device according to any one of claims 1-15. A method performed by the second electronic device.