CN113467904A

CN113467904A - Method and device for determining collaboration mode, electronic equipment and readable storage medium

Info

Publication number: CN113467904A
Application number: CN202110587411.5A
Authority: CN
Inventors: 付安岩
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2021-05-27
Filing date: 2021-05-27
Publication date: 2021-10-01
Anticipated expiration: 2041-05-27
Also published as: CN113467904B

Abstract

The application relates to the field of multi-terminal collaboration, and provides a method, a device, electronic equipment and a readable storage medium for determining a collaboration mode, wherein the electronic equipment can be a mobile phone, a tablet computer, wearable equipment, vehicle-mounted equipment and the like, and the method comprises the following steps: a first device acquires a target distance, wherein the target distance is the distance between the first device and a second device; and the first equipment starts a mirror image mode or an extension mode according to the target distance, wherein the mirror image mode or the extension mode is a cooperation mode between the first equipment and the second equipment. The method can avoid inconvenience caused by manual operation of the user, so that the different collaborative modes can be started more conveniently and quickly, and the collaborative experience of the user is improved.

Description

Method and device for determining collaboration mode, electronic equipment and readable storage medium

Technical Field

The present application relates to the field of multi-terminal collaboration technologies, and in particular, to a method and an apparatus for determining a collaboration mode, an electronic device, and a readable storage medium.

Background

With the rapid development of terminal ecology, the scenes of cooperative use of the equipment by people are more and more, and the cooperative use among different equipment also greatly facilitates the work and life of people.

The traditional cooperation mode between the devices can be selected and switched according to manual operation of a user. For example, when the screen of the tablet computer needs to be projected on the screen of the desktop computer for being watched by multiple people, the user may click a button of the mirror mode of the tablet computer to start the mirror mode, and then the interface of the tablet computer may be projected on the screen of the desktop computer. When a user uses a desktop computer, if the user needs to refer to an electronic document to draw by using a drawing tool, the mouse configured for the desktop computer can be operated to start the extension mode, at the moment, the display screen of the tablet computer can be used as the extension display screen of the desktop computer to display the electronic document, and the display screen of the desktop computer is used for displaying a drawing interface, so that the user is prevented from switching back and forth on the same interface.

However, the conventional method of switching the coordination mode by manual operation of the user is cumbersome to operate.

Disclosure of Invention

The application provides a method and a device for determining a collaborative mode, an electronic device and a readable storage medium, which can automatically start different collaborative modes, are more convenient and faster, and improve the collaborative experience of a user.

In a first aspect, a method for determining a collaborative mode is provided, including: a first device acquires a target distance, wherein the target distance is the distance between the first device and a second device; and the first equipment starts a mirror image mode or an extension mode according to the target distance, wherein the mirror image mode or the extension mode is a cooperation mode between the first equipment and the second equipment.

The scenes where the mirror mode and the extended mode are applicable have an association relationship with the target distance, for example, some users are accustomed to using the extended mode when the target distance is small and using the mirror mode when the target distance is large; other users are accustomed to using the extended mode when the target distance is large and the mirror mode when the target distance is small. The user can preset the incidence relation between the target distance and the collaborative mode, and the first device can automatically match the use habits of the user by starting the mirror image mode or the extension mode according to the target distance, so that the inconvenience caused by manual switching of the collaborative mode by the user is avoided, and the collaborative experience of the user is improved.

Optionally, the starting, by the first device, a mirroring mode or an extension mode according to the target distance includes: when the target distance is larger than or equal to a preset distance threshold, the first device starts the mirror image mode according to the target distance; or, when the target distance is smaller than a preset distance threshold, the first device starts the expansion mode according to the target distance.

In general, interfaces displayed by the first device and the second device are different in the extended mode, and a user needs to observe the interfaces of the two devices at the same time, so that the mode is suitable for scenes in which the first device and the second device are close to each other; the interfaces displayed by the first device and the second device are the same in the mirror image mode, a user does not need to observe the interfaces of the two devices at the same time, and the mode is suitable for scenes with longer distance between the first device and the second device. The first device in this embodiment starts the mirror mode when the target distance is greater than or equal to the distance threshold, and starts the extension mode when the target distance is less than the distance threshold, so that the use requirements of most users can be met, and the collaborative experience of the users can be improved.

Optionally, the starting, by the first device, a mirroring mode or an extension mode according to the target distance includes: when the target distance is greater than or equal to a preset distance threshold value and a current application program (APP) is a presentation type APP, starting the mirror image mode by the first device; or when the target distance is smaller than a preset distance threshold and the current APP is a design type APP, the first device starts the extended mode; and the current APP is the APP in the foreground running state on the first device.

The demonstration type APP needs to show demonstration contents to a large number of audiences, and the large number of audiences are difficult to watch the demonstration contents in a narrow space, so the demonstration type APP is usually applied to a scene with a long distance between first equipment and second equipment; in addition, when the first device and the second device are far away, it is difficult for the viewer to simultaneously observe the screens of the first device and the second device, and thus the presentation-like APP is suitable for the mirror mode. The design-class APP generally serves an individual user, the individual user is generally in a narrow space, and multiple interfaces need to be observed, so the design-class APP is generally applied to a scene where the first device and the second device are close to each other, and is suitable for an extended mode. The first device judges the collaborative demand of the user by combining the target distance and the APP in the foreground running state on the first device, starts the collaborative mode matching the collaborative demand of the user, and further improves the collaborative experience of the user.

Optionally, the method further comprises: the first device obtains a plurality of first distances and a plurality of second distances, wherein the first distances are the distances between the first device and the second device when the first device starts the mirror mode, and the second distances are the distances between the first device and the second device when the first device starts the extended mode; the first device generates the distance threshold according to the plurality of first distances and the plurality of second distances, wherein the distance threshold is an average value of the plurality of first distances and an average value of the plurality of second distances.

The plurality of first distances and the plurality of second distances are historical data reflecting the use habits of the user, the first device calculates the average value of the plurality of first distances and the average value of the plurality of second distances to obtain a distance threshold value matching the use habits of the user, and the collaborative experience of the user is improved.

Optionally, the method further comprises: the first device obtains a corrected distance, the corrected distance comprising: the distance between the first device and the second device when a user manually starts a mirror mode of the first device, or the distance between the first device and the second device when the user manually starts an extension mode of the first device; the first device adjusts the distance threshold according to the modified distance, and the modified distance and the distance threshold are positively correlated.

The correction distance is the distance between the first device and the second device when the user manually starts the collaborative mode, the use habit of the user is accurately reflected, and the first device corrects the distance threshold value based on the correction distance, so that the collaborative mode determined based on the distance threshold value is more matched with the requirement of the user, and the collaborative experience of the user is improved.

Optionally, the obtaining, by the first device, the target distance includes: the first equipment receives a switching operation, wherein the switching operation is used for triggering the first equipment to enter an automatic determination cooperation mode; in response to the switching operation, the first device acquires the target distance.

The first device triggers the automatic determination of the collaborative mode by receiving the switching operation input by the user, and can realize the switching of the automatic determination of the collaborative mode based on the user requirement, so that the functions are richer and the application scene is more flexible.

Optionally, the obtaining, by the first device, the target distance includes: the first device selects a target distance measurement model from a plurality of preset distance measurement models according to the configuration type of a short-distance communication module, the type of input data of the target distance measurement model is matched with the configuration type of the short-distance communication module, and the configuration type of the short-distance communication module comprises one or more of a Bluetooth module, a wireless fidelity (Wi-Fi) module and an Ultra Wideband (UWB) module; the first equipment inputs the initial distance into the target distance measuring and calculating model for measuring and calculating to obtain the target distance; the initial distance comprises at least one of a first initial distance, a second initial distance and a third initial distance, the data type of the initial distance is matched with the configuration type of the short-distance communication module, the first initial distance is the distance between the first device and the second device measured by the Bluetooth module, the second initial distance is the distance between the first device and the second device measured by the Wi-Fi module, and the third initial distance is the distance between the first device and the second device measured by the UWB module.

The first device can flexibly select the distance measuring and calculating model matched with the configuration type of the short-distance communication module for distance integration based on the existing short-distance communication module of the first device, so that the target distance can be obtained by fully utilizing the existing hardware configuration of the first device, and the accuracy of the target distance is guaranteed as much as possible.

Optionally, the initial distance includes the first initial distance, the second initial distance, and the third initial distance, and the first device inputs the initial distance into the target distance calculation model to perform calculation to obtain the target distance, including: and the first equipment sums the product of the first initial distance and a first weight coefficient, the product of the second initial distance and a second weight coefficient and the product of the third initial distance and a third weight coefficient to obtain the target distance, wherein the sum of the first weight coefficient, the second weight coefficient and the third weight coefficient is 1.

The first equipment adopts the target distance measuring and calculating model to carry out weighted summation on the first initial distance, the second initial distance and the third initial distance according to respective weights, and can integrate the distances acquired by various different technologies according to set specific gravity, so that the advantages of different ranging technologies are combined, the final integrated result can be corrected, larger errors possibly caused by a single ranging mode are avoided, and the obtained target distance is more accurate.

Optionally, the method further comprises: when the precision requirement of the target distance is higher than a preset precision threshold value, the first device increases the third weight coefficient to a target weight coefficient, and decreases the first weight coefficient and/or the second weight coefficient, wherein the target weight coefficient is more than one third.

Because UWB signal transmission power consumption is lower, and the power consumption of general UWB module is tens of muW, and first equipment uses UWB module to confirm that third initial distance can reduce the complete machine power consumption of first equipment. In addition, the frequency bandwidth of the UWB signal is wide, the wireless power density is low, and the UWB signal is not easily interfered by other devices and not easily interfered by other devices in the transmission process, so that the accuracy of the third initial distance acquired by using the UWB module is high. Due to the fact that the accuracy of the third initial distance obtained by the UWB module is high, the proportion (namely, the third weight coefficient) of the third initial distance is increased, the accuracy of the target distance can be further improved on the basis of combining the advantages of different ranging technologies, and the requirement for higher precision is met.

In a second aspect, an apparatus for determining a collaborative mode is provided, which includes a unit made of software and/or hardware, and is configured to execute any one of the methods in the technical solutions of the first aspect.

In a third aspect, an apparatus for determining a collaborative mode is provided, including: the device comprises a distance measurement module and a processing module;

the distance measurement module is used for controlling the first equipment to obtain the initial distance between the first equipment and the second equipment;

and the processing module is used for controlling the first equipment to determine a target distance according to the initial distance and starting a mirror image mode or an expansion mode according to the target distance, wherein the mirror image mode or the expansion mode is a cooperation mode between the first equipment and the second equipment.

Optionally, the initial distance includes at least one of a first initial distance, a second initial distance, and a third initial distance, and the ranging module includes: at least one of a Bluetooth module, a wireless fidelity Wi-Fi module and an ultra-wideband UWB module;

the Bluetooth module is used for acquiring the first initial distance by adopting a Bluetooth technology;

the Wi-Fi module is used for acquiring the second initial distance by adopting a Wi-Fi technology;

and the UWB module is used for acquiring the third initial distance by adopting UWB technology.

Optionally, the processing module is specifically configured to, when the target distance is greater than or equal to a preset distance threshold, start the mirror mode by the first device according to the target distance; alternatively, the first and second electrodes may be,

and when the target distance is smaller than a preset distance threshold, the first equipment starts the expansion mode according to the target distance.

Optionally, the processing module is specifically configured to control the first device to start the mirror mode when the target distance is greater than or equal to a preset distance threshold and a current application APP is a presentation APP; alternatively, the first and second electrodes may be,

when the target distance is smaller than a preset distance threshold value and the current APP is a design type APP, controlling the first device to start the expansion mode;

and the current APP is the APP in the foreground running state on the first device.

Optionally, the processing module is further configured to control the first device to obtain a plurality of first distances and a plurality of second distances, where the first distances are distances from the second device when the first device enables the mirror mode, and the second distances are distances from the second device when the first device enables the extended mode; and controlling the first device to generate the distance threshold according to the plurality of first distances and the plurality of second distances, wherein the distance threshold is an average value of the plurality of first distances and an average value of the plurality of second distances.

Optionally, the processing module is further configured to control the first device to obtain a corrected distance, where the corrected distance includes: the distance between the first device and the second device when a user manually starts a mirror mode of the first device, or the distance between the first device and the second device when the user manually starts an extension mode of the first device; and controlling the first device to adjust the distance threshold according to the modified distance, wherein the modified distance and the distance threshold are positively correlated.

Optionally, the processing module is specifically configured to control the first device to receive a switching operation, where the switching operation is used to trigger the first device to enter an automatic determination coordination mode; and controlling the first device to acquire the target distance in response to the entering of the automatic determination coordination mode.

Optionally, the processing module is specifically configured to control the first device to select a target distance measurement and calculation model from a plurality of preset distance measurement and calculation models according to a configuration type of a short-range communication module, where a type of input data of the target distance measurement and calculation model is matched with a configuration type of the short-range communication module, and the configuration type of the short-range communication module includes one or a combination of multiple types of a bluetooth module, a wireless fidelity Wi-Fi module, and an ultra wideband UWB module; controlling the first equipment to input the initial distance into the target distance measuring and calculating model for measuring and calculating to obtain the target distance; the initial distance comprises at least one of a first initial distance, a second initial distance and a third initial distance, the data type of the initial distance is matched with the configuration type of the short-distance communication module, the first initial distance is the distance between the first device and the second device measured by the Bluetooth module, the second initial distance is the distance between the first device and the second device measured by the Wi-Fi module, and the third initial distance is the distance between the first device and the second device measured by the UWB module.

Optionally, the initial distance includes the first initial distance, the second initial distance, and the third initial distance, and the processing module is specifically configured to control the first device to sum a product of the first initial distance and a first weight coefficient, a product of the second initial distance and a second weight coefficient, and a product of the third initial distance and a third weight coefficient to obtain the target distance, where a sum of the first weight coefficient, the second weight coefficient, and the third weight coefficient is 1.

Optionally, the processing module is further configured to, when the accuracy requirement of the target distance is higher than a preset accuracy threshold, control the first device to increase the third weight coefficient to a target weight coefficient, and decrease the first weight coefficient and/or the second weight coefficient, where the target weight coefficient is greater than one third.

In a fourth aspect, an electronic device is provided, the electronic device comprising: a processor, a memory, and an interface; the processor, the memory and the interface cooperate with each other to enable the electronic device to perform any one of the methods according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, including a processor; the processor is configured to read and execute the computer program stored in the memory to perform any one of the methods in the technical solutions of the first aspect.

Optionally, the chip further comprises a memory, and the memory is connected with the processor through a circuit or a wire.

Further optionally, the chip further comprises a communication interface.

A sixth aspect provides a computer-readable storage medium, in which a computer program is stored, which, when executed by a processor, causes the processor to perform any of the methods of the first aspect.

In a seventh aspect, a computer program product is provided, the computer program product comprising: computer program code for causing an electronic device to perform any of the methods of the first aspect when said computer program code is run on the electronic device.

Drawings

Fig. 1 is a schematic structural diagram of an example of a terminal device 100 according to an embodiment of the present application;

fig. 2 is a block diagram of a software structure of the terminal device 100 according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram illustrating cooperation of a first device and a second device in an extended mode according to an embodiment of the present application;

fig. 4 is a schematic diagram illustrating cooperation of a first device and a second device in a mirror mode according to an embodiment of the present application;

FIG. 5 is a diagram illustrating an example of entering an automatic coordination mode based on a user-based switching operation according to an embodiment of the present disclosure;

fig. 6 is a schematic flowchart illustrating an example of obtaining a distance between a first device and a second device by using bluetooth technology according to an embodiment of the present application;

fig. 7 is a schematic flowchart illustrating an example of obtaining a distance between a first device and a second device by using Wi-Fi technology according to an embodiment of the present application;

fig. 8 is a schematic flowchart of an example of obtaining a distance between a first device and a second device by using UWB technology according to an embodiment of the present application;

fig. 9 is a schematic flowchart of an example of obtaining a target distance according to the present application;

FIG. 10 is a schematic flowchart of an example of obtaining a target distance according to an embodiment of the present disclosure;

fig. 11 is a schematic flowchart of an example of obtaining a target distance according to the embodiment of the present application;

FIG. 12 is a schematic flowchart illustrating an example of determining a coordination mode according to an embodiment of the present application;

FIG. 13 is a schematic flowchart illustrating an example of determining a coordination mode according to an embodiment of the present application;

fig. 14 is a timing chart illustrating an example of determining a coordination mode according to an embodiment of the present application;

fig. 15 is a schematic structural diagram of an example apparatus for determining a collaborative mode according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.

In the following, the terms "first", "second" and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", "third" may explicitly or implicitly include one or more of the features.

The method for determining the collaborative mode provided by the embodiment of the application can be applied to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, Augmented Reality (AR)/Virtual Reality (VR) devices, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, Personal Digital Assistants (PDAs) and other terminal devices, and the embodiment of the application does not limit the specific types of the terminal devices at all.

For example, fig. 1 is a schematic structural diagram of an example of a terminal device 100 provided in the embodiment of the present application. The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identification Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation to the terminal device 100. In other embodiments of the present application, terminal device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller may be a neural center and a command center of the terminal device 100, among others. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement the touch function of the terminal device 100.

The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may communicate audio signals to the wireless communication module 160 via the I2S interface, enabling answering of calls via a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to implement a function of answering a call through a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

MIPI interfaces may be used to connect processor 110 with peripheral devices such as display screen 194, camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the capture function of terminal device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the terminal device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the terminal device 100, and may also be used to transmit data between the terminal device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other terminal devices, such as AR devices and the like.

It should be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is only an exemplary illustration, and does not constitute a limitation on the structure of the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the terminal device 100. The charging management module 140 may also supply power to the terminal device through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the terminal device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. The structure of the antenna 1 and the antenna 2 in fig. 1 is merely an example. Each antenna in terminal device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied on the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide a solution for wireless communication applied to the terminal device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150 and the antenna 2 is coupled to the wireless communication module 160 so that the terminal device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The terminal device 100 implements a display function by the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

The terminal device 100 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, the application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the terminal device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform fourier transform or the like on the frequency point energy.

Video codecs are used to compress or decompress digital video. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record video in a plurality of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can implement applications such as intelligent recognition of the terminal device 100, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the terminal device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, a phonebook, etc.) created during use of the terminal device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The terminal device 100 may implement an audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The terminal device 100 can listen to music through the speaker 170A, or listen to a handsfree call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the terminal device 100 answers a call or voice information, it is possible to answer a voice by bringing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking the user's mouth near the microphone 170C. The terminal device 100 may be provided with at least one microphone 170C. In other embodiments, the terminal device 100 may be provided with two microphones 170C, which may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The headphone interface 170D is used to connect a wired headphone. The headset interface 170D may be the USB interface 130, or may be an Open Mobile Terminal Platform (OMTP) standard interface of 3.5mm, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used for sensing a pressure signal, and converting the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure from the change in the capacitance. When a touch operation is applied to the display screen 194, the terminal device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The terminal device 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 180B may be used to determine the motion attitude of the terminal device 100. In some embodiments, the angular velocity of terminal device 100 about three axes (i.e., x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the terminal device 100, calculates the distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the terminal device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates an altitude from the barometric pressure measured by the barometric pressure sensor 180C, and assists in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The terminal device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the terminal device 100 is a folder, the terminal device 100 may detect the opening and closing of the folder according to the magnetic sensor 180D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the automatic unlocking of the flip cover is set.

The acceleration sensor 180E can detect the magnitude of acceleration of the terminal device 100 in various directions (generally, three axes). The magnitude and direction of gravity can be detected when the terminal device 100 is stationary. The method can also be used for recognizing the posture of the terminal equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The terminal device 100 may measure the distance by infrared or laser. In some embodiments, shooting a scene, the terminal device 100 may range using the distance sensor 180F to achieve fast focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light to the outside through the light emitting diode. The terminal device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 can utilize the proximity light sensor 180G to detect that the user holds the terminal device 100 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 180G may also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense the ambient light level. The terminal device 100 may adaptively adjust the brightness of the display screen 194 according to the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in a pocket, in order to prevent accidental touches.

The fingerprint sensor 180H is used to collect a fingerprint. The terminal device 100 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint incoming call answering and the like.

The temperature sensor 180J is used to detect temperature. In some embodiments, the terminal device 100 executes a temperature processing policy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the terminal device 100 performs a reduction in performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the terminal device 100 heats the battery 142 when the temperature is below another threshold to avoid the terminal device 100 being abnormally shut down due to low temperature. In other embodiments, when the temperature is lower than a further threshold, the terminal device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on the surface of the terminal device 100, different from the position of the display screen 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, the bone conduction sensor 180M may acquire a vibration signal of the human vocal part vibrating the bone mass. The bone conduction sensor 180M may also contact the human pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 180M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 170 may analyze a voice signal based on the vibration signal of the bone mass vibrated by the sound part acquired by the bone conduction sensor 180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The terminal device 100 may receive a key input, and generate a key signal input related to user setting and function control of the terminal device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the terminal device 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The terminal device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the terminal device 100 employs eSIM, namely: an embedded SIM card. The eSIM card may be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

The software system of the terminal device 100 may adopt a hierarchical architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of the terminal device 100.

Fig. 2 is a block diagram of a software configuration of the terminal device 100 according to the embodiment of the present application. In fig. 2, the distance module newly added at the service side is configured to receive the distance measured by the hardware ranging module, process the measured distance to generate a final distance, and transmit the distance to the control side. And the distance control module is newly added at the control side and used for acquiring the distance output by the distance module at the service side, judging whether to switch the collaborative mode or not based on the prior distance threshold, transmitting the judgment result to the display control module, and performing the switching processing of the collaborative mode by the display control module.

As shown in fig. 2, the cooperation between the terminal devices requires the interaction of a service side, a protocol side, and a control side, and is implemented based on a software Framework (Framework).

In general, the software framework may include: a notification manager (notifiationmanager), a distribution manager (DistributManager), and a connection manager (ConnectManager). The notification manager is used for managing various notification messages, enables the application program to display notification information in the status bar, can be used for conveying notification type messages, can automatically disappear after short-time stopping, and does not need user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the terminal device vibrates, an indicator light flickers, and the like. The distributed manager is used for performing distributed management on various types of services and performing distributed storage on various types of information. The connection manager is used to manage the connections between the various sides, as well as the connections of the cooperating terminal devices.

The protocol side includes: communication protocols, transport protocols, audio protocols and video protocols for providing communication connections and data interactions with corresponding protocols.

The control side includes: the device comprises a connection control module, a transmission control module, an authentication control module, a distance control module and a display control module, wherein the connection control module realizes connection control, the transmission control module realizes transmission control, the authentication control module realizes authentication control, the distance control module realizes distance control and the display control module realizes display control.

The service side comprises an audio and video module, a connection module, a transmission module, a display module and a distance module. The system comprises an audio and video module, a connection module, a transmission module, a display module, a distance module, a self-control interface and a distance integration module, wherein the audio and video module is used for carrying out audio output and video output, the connection module is used for carrying out equipment discovery and equipment connection, the transmission module is used for carrying out equipment discovery and equipment connection so as to carry out data transmission, the display module is used for carrying out interface display, the distance module is used for acquiring information, generating the self-control interface and integrating distance, and the self-control interface is used for displaying for a user and receiving an autonomous selection instruction of the user based on the displayed interface.

For convenience of understanding, the following embodiments of the present application will specifically describe, by taking a terminal device having a structure shown in fig. 1 and fig. 2 as an example, a method for determining a cooperative mode provided by the embodiments of the present application with reference to the accompanying drawings and an application scenario.

In general, in daily work and life, people often use a plurality of electronic devices to perform cooperative operations, where the electronic devices may be the above-mentioned terminal devices. A description will be given of a collaboration mode between two electronic devices, taking a Personal Computer (PC) and a tablet computer (Pad) as examples. In general, the collaborative mode may include both an extended mode and a mirrored mode: in the extended mode, Pad is used as the second display screen of the PC to display different contents from those displayed by the PC, for example, a scene displayed on two screens, as shown in fig. 3; in the mirror mode, the Pad serves as a second screen of the PC to display the same content as the content displayed by the PC, for example, as shown in fig. 4, at this time, the Pad can be operated independently from the PC by the user, and the user can move with the Pad and operate the PC by operating the interface of the Pad.

When the collaboration scene of the user changes, the user often needs to manually switch the collaboration mode. In the embodiment of the application, the electronic devices in cooperation with each other can automatically detect the distance between the two electronic devices in cooperation, identify whether the user needs the extended mode or the mirror mode currently based on the distance, and then start the corresponding cooperation mode, so that the cooperation mode can be automatically switched without manual operation of the user, and the operation is more convenient.

The embodiment of the application refers to two electronic devices cooperating with each other as a first device and a second device. The embodiment of the present application does not limit the device types of the first device and the second device. Both may be the same type of electronic device or different types of electronic devices, e.g. the first device and the second device may be a combination of a PC and a PC, a PC and a mobile phone, a PC and a Pad, a large screen device and a mobile phone, etc.

Optionally, the first device may support automatic determination of turning on and off of the collaborative mode, and the first device may automatically acquire a distance between the first device and the second device and automatically start the extended mode or the mirror mode based on the distance in a case where the collaborative mode is automatically determined to be turned on.

Optionally, the first device may also be compatible with manually determining the collaborative mode and automatically determining the collaborative mode. In the manual determination cooperation mode, the first device may start the extension mode or the mirror mode based on a manual operation by a user. When the first device is in the manual collaboration determining mode, the user may input a switching operation to the first device by clicking a "auto switch" button, which may be specifically shown in fig. 5, where the switching operation is used to trigger the first device to enter the automatic collaboration determining mode. At this time, the first device receives the switching operation input by the user and responds, and the manual determination cooperation mode enters the automatic determination cooperation mode. And under the automatic cooperative mode determination, the first equipment enters a process of acquiring the distance between the first equipment and the second equipment, and automatically starts an expansion mode or a mirror mode according to the distance to realize the cooperation with the second equipment. In this embodiment, the first device triggers the automatically determined collaborative mode by receiving a switching operation input by a user, and can realize switching of the automatically determined collaborative mode based on user requirements, so that the functions are richer and the application scenario is more flexible.

When the electronic device enters the automatic determination coordination mode, taking the first device as a PC and the second device as a Pad as an example, how the first device obtains the distance between the first device and the second device is described.

Fig. 6 is a flowchart illustrating an example of a method for obtaining a distance between electronic devices by using bluetooth technology according to an embodiment of the present application. As shown in fig. 6, the method includes:

s601, the first device and the second device establish connection. The connection mode of the first device and the second device may be bluetooth connection, Wi-Fi connection or UWB connection, and the first device and the second device may also be in a cooperative connection state, which is not limited in this embodiment. In the connected state, the first device and the second device can perform information interaction.

S602, the first device acquires the identification of the second device, the signal intensity and the transmission delay of the Bluetooth signal of the second device.

Specifically, the identifier of the second device may be a bluetooth address, a device name, a device tag, and the like of the second device, as long as the identifier can represent which electronic device the second device is. The first device locks the devices needing to be coordinated as the second device based on the identification of the second device, and acquires the signal intensity of the Bluetooth signal sent by the second device and the transmission delay of the Bluetooth signal.

And S603, inputting the signal intensity and/or the transmission delay of the Bluetooth signal into a preset Bluetooth ranging model by the first equipment for ranging fitting, and outputting the distance between the first equipment and the second equipment.

Alternatively, the first device may also use a fitted regression function d of 10^{(ABS(RSSI)-A)/(10N)}Or the formula of the function is modified to obtain the distance d between the first device and the second device. In this equation, RSSI is the signal strength of the bluetooth signal of the second device detected by the first device, in dbm, which is typically a negative value; ABS means absolute value; a represents the signal strength of the detected bluetooth signal transmitted by the second device when the first device is one meter away from the second device, and may generally take a default value, for example, 59; n represents an environmental attenuation factor, which may generally be a default value, e.g.A value of 2.0 may be assigned.

Optionally, the first device may also employ d ═ c ═ t (t-t)₀) Or a variant of this equation obtains the distance d of the first device and the second device. In the formula, c is the speed of Bluetooth signal transmission, t is the transmission delay, and t is₀Is a preset time constant.

Optionally, the first device may further perform weighted summation on the distance obtained by using the signal strength and the distance obtained by using the transmission delay, so as to obtain the fused distance.

Fig. 7 is a flowchart illustrating an example of a method for obtaining a distance between electronic devices by using Wi-Fi technology according to an embodiment of the present application. As shown in fig. 7, the method includes:

s701, the first device and the second device establish connection. For the way of establishing the connection between the first device and the second device, reference may be made to the description of S601, which is not described herein again.

S702, the first equipment sends the system time of the first equipment to the second equipment through the Wi-Fi signal, so that the second equipment establishes a time difference baseline according to the system time of the first equipment and the system time of the second equipment, and the time difference baseline represents the system time difference between the system time of the first equipment and the system time of the second equipment. And then the first equipment receives the time difference baseline fed back by the second equipment and acquires the sending time when the second equipment sends the Wi-Fi signal. And the first equipment subtracts the influence of the time difference baseline from the time length between the sending time when the second equipment sends the Wi-Fi signal and the arrival time when the second equipment arrives at the first equipment, so as to obtain the time difference of the Wi-Fi signal from the second equipment to the first equipment.

And S703, inputting the time difference into a preset Wi-Fi ranging model by the first equipment for fitting, and outputting the distance between the first equipment and the second equipment.

Alternatively, the distance between the first device and the second device may be obtained by using any one of a time of arrival (TOA) ranging method, a time difference of arrival (TDOA) ranging method, or a Received Signal Strength Indicator (RSSI) ranging method.

Fig. 8 is a schematic flowchart illustrating an example of acquiring a distance between electronic devices by using UWB technology according to an embodiment of the present application.

As shown in fig. 8, the method includes:

s801, the first device and the second device establish connection. For the way of establishing the connection between the first device and the second device, reference may be made to the description of S601, which is not described herein again.

S802, the first device sends the system time of the first device to the second device through a UWB signal, so that the second device establishes a time difference baseline according to the system time of the first device and the system time of the second device, and the time difference baseline represents the system time difference between the system time of the first device and the system time of the second device. And then the first equipment receives the time difference baseline fed back by the second equipment and acquires the sending time when the second equipment sends the UWB signal. The first device subtracts the time difference baseline according to the time length between the sending time when the second device sends the UWB signal and the arrival time at the first device, and then obtains the time difference between the UWB signal and the first device from the second device.

And S803, inputting the time difference into a preset UWB ranging model by the first equipment for fitting, and outputting the distance between the first equipment and the second equipment.

In some embodiments, the first device may use the distance obtained by any one of the above methods as the target distance between the first device and the second device, or use a distance measurement model to integrate the distances obtained by any two or three of the above techniques to generate the target distance. It should be noted that, based on different manners of acquiring the input data, the first device may select different distance measurement models to integrate the distances.

In some embodiments, the first device selects which distance estimation model to use for distance synthesis, which may be referred to the embodiment shown in fig. 9.

Fig. 9 is a schematic flowchart illustrating an example of a process of acquiring a target distance by an electronic device according to an embodiment of the present application. As shown in fig. 9, includes:

s901, selecting a target distance measurement model from a plurality of preset distance measurement models by the first device according to the configuration type of the short-distance communication module, wherein the type of input data of the target distance measurement model is matched with the configuration type of the short-distance communication module, and the configuration type of the short-distance communication module comprises one or more combinations of a Bluetooth module, a Wi-Fi module and a UWB module.

S902, inputting the initial distance into the target distance measuring and calculating model by the first equipment for measuring and calculating to obtain the target distance; wherein the initial distance comprises at least one of a first initial distance, a second initial distance and a third initial distance, and the data type of the initial distance is matched with the configuration type of the short-range communication module.

Generally, the short-distance communication module configured by the first device can be a bluetooth module, a Wi-Fi module, a UWB module, a bluetooth module plus a Wi-Fi module, a bluetooth module plus a UWB module, a Wi-Fi module plus a UWB module, or a bluetooth module plus a Wi-Fi module plus a UWB module.

When the configuration type of the distance communication module of the first device is a bluetooth module, a Wi-Fi module or the bluetooth module plus the Wi-Fi module, the bluetooth module and the Wi-Fi module are common configurations of electronic devices, and the target distance can be obtained without adding new hardware, so that the cost is not increased and the method is easy to implement.

When the first equipment is a UWB module, the power consumption of UWB signal transmission is low, and the power consumption of the UWB module is dozens of muW, so that the power consumption of the whole equipment is reduced; moreover, the frequency bandwidth of the UWB signal is wide, the wireless power density is low, so that the UWB signal is not easy to interfere with other equipment in the transmission process, and is not easy to interfere with other equipment, the self anti-interference performance is strong, and the accuracy of distance measurement by adopting the UWB module is high.

In the embodiment of the present application, a description is given by taking a first initial distance as a distance between a first device and a second device measured by using a bluetooth module according to the method in the embodiment shown in fig. 6, a second initial distance as a distance between the first device and the second device measured by using a Wi-Fi module according to the method in the embodiment shown in fig. 7, and a third initial distance as a distance between the first device and the second device measured by using a UWB module according to the method in the embodiment shown in fig. 8 as an example. Specifically, each configuration type corresponds to a distance measurement model, and the input data of the distance measurement model corresponding to each configuration type is the distance measured by the short-range communication module of the configuration type. For example, when the short-range communication module configured by the first device is a bluetooth module, the input data of the distance measurement model corresponding to the configuration type is a first initial distance measured by the bluetooth module; when the short-distance communication module configured by the first device is a Bluetooth module and a Wi-Fi module, the input data of the distance measurement model corresponding to the configuration type is a first initial distance measured by the Bluetooth module and a second initial distance measured by the Wi-Fi module; when the short-distance communication module configured by the first device is a Bluetooth module plus a Wi-Fi module plus a UWB module, the input data of the distance measurement model corresponding to the configuration type is a first initial distance measured by the Bluetooth module, a second initial distance measured by the Wi-Fi module and a third initial distance measured by the UWB module.

Generally, a memory of the first device may store a plurality of distance measurement models in advance, and the first device selects a target distance measurement model corresponding to the configuration type of its own short-range communication module from the plurality of distance measurement models according to the configuration type of its own short-range communication module. Then, the first device inputs the distance measured by the short-distance communication module of the first device into the target distance measurement model for measurement, and the target distance representing the distance between the first device and the second device is obtained.

Optionally, the multiple distance measurement models may also be stored in the server in advance, and when the first device reports the configuration type of its own short-range communication module to the server, the server selects a target measurement model matching the configuration type of the first device, and issues the target measurement model to the first device, so that the first device generates the target distance.

In the embodiment shown in fig. 9, the first device can flexibly select the distance measurement model matched with the configuration type of the short-range communication module based on the existing short-range communication module of the first device to integrate the distance, so that the existing hardware configuration of the first device can be fully utilized to obtain the target distance, and the accuracy of the target distance is ensured as much as possible.

Alternatively, the obtaining manner of the distance prediction model may be as shown in fig. 10, and first, the first device may download the original distance measurement model from the server, or may use another distance measurement model as the original distance measurement model, which is not limited in this embodiment of the present application. And then the first equipment inputs the training data set into the original distance measurement model for training to obtain the distance measurement model corresponding to the type of the training data set. The training data set is a data set representing distance and can be at least one of Bluetooth data measured by a Bluetooth module, Wi-Fi data measured by a Wi-Fi module and UWB data measured by a UWB module. The first device trains to obtain different distance measurement models according to different types of input training data sets, for example, as shown in fig. 10, the first device inputs bluetooth data and Wi-Fi data into an original distance measurement model to train to obtain a distance measurement model 1, and when the first device inputs a first initial distance and a second initial distance into the distance measurement model 1 to integrate, a target distance is obtained; the first equipment inputs Bluetooth data, Wi-Fi data and UWB data into an original distance measurement model to train to obtain a distance measurement model 2, and when the first equipment inputs a first initial distance, a second initial distance and a third initial distance into the distance measurement model 2 to integrate, a target distance is obtained; the first device inputs Bluetooth data and UWB data into an original distance measurement model to train to obtain a distance measurement model 3, and when the first device inputs the first initial distance and the third initial distance into the distance measurement model 3 to be integrated, the target distance is obtained. If the first device inputs other types of training data sets into the original distance measurement model, other distance measurement models can be obtained through training, and a distance measurement model set is formed, which is not listed any more. Optionally, the process of training the distance measurement model may also be performed by other devices, and the other devices send the trained distance measurement model to the first device, so that the first device integrates the distance measurement model.

Optionally, the process of the first device integrating the initial distance may also be referred to as shown in fig. 11. In fig. 11, the first device calls the bluetooth ranging module to perform ranging on the first device and the second device to obtain a first initial distance, the Wi-Fi module performs ranging on the first device and the second device to obtain a second initial distance, the UWB module performs ranging on the first device and the second device to obtain a third initial distance, and inputs the first initial distance, the second initial distance, and the third initial distance into the target distance measurement model for integration, and outputs the target distance.

Alternatively, the first device may select different distance measurement models according to different short-range communication modules carried by the short-range communication module. For example, when the configuration type of the short-range communication module of the first device is bluetooth module plus Wi-Fi module plus UWB module, the first device may select a distance measurement model with input data of a first initial distance, a second initial distance, and a third initial distance as a target distance measurement model, and then input the first initial distance, the second initial distance, and the third initial distance as initial distances into the target distance measurement model for integration to obtain the target distance. Alternatively, the target distance estimation model may be a model that performs weighted summation processing on input data from a plurality of sources. For example, the first device may sum the product of the first initial distance and the first weight coefficient, the product of the second initial distance and the second weight coefficient, and the product of the third initial distance and the third weight coefficient using the target distance estimation model to obtain the target distance. Wherein the sum of the first weight coefficient, the second weight coefficient and the third weight coefficient is 1. In this embodiment, the first device adopts the target distance measurement and calculation model to perform weighted summation on the first initial distance, the second initial distance and the third initial distance according to respective weights, and can integrate the distances acquired by multiple different technologies according to a set proportion, so that the advantages of different ranging technologies are integrated, a final integrated result can be corrected, a large error possibly caused by a single ranging mode is avoided, and the obtained target distance is more accurate.

Optionally, the first weight coefficient, the second weight coefficient, and the third weight coefficient in the above embodiments may also be adjusted according to user requirements. When the precision requirement of the target distance is higher than a preset precision threshold value, the first device increases a third weight coefficient representing the third initial distance ratio to a preset target weight coefficient, and simultaneously reduces the first weight coefficient and/or the second weight coefficient so as to ensure that the sum of the three weight coefficients is 1. When the target weight coefficient is greater than one-third, the specific gravity of the third initial distance may exceed the first initial distance and the second initial distance. Due to the fact that the accuracy of the third initial distance obtained by the UWB technology is high, the proportion (namely, the third weight coefficient) of the third initial distance is increased, the accuracy of the target distance can be further improved while the advantages of different ranging technologies are fused, and the requirement for higher precision is met. It should be noted that the accuracy threshold represents the accuracy requirement of the user for the target distance, for example, the accuracy threshold may be 80%, 90%, or 95% capable of representing different accuracy requirements. When the accuracy threshold is larger, the accuracy requirement of the characterization on the target distance is higher. The target weight coefficient may be a value greater than one-third and less than one, and the target weight coefficient is positively correlated with the accuracy threshold, and when the accuracy threshold is larger, the target weight coefficient is larger, and when the accuracy threshold is smaller, the target weight coefficient may be set smaller.

Optionally, the first device may further compare the ranging durations of the different modules, and if the ranging duration of one of the modules is significantly longer, the module is considered to be abnormal in the ranging process, and the measured distance may be inaccurate, so that the accuracy of the ranging result may be ensured by reducing the weight coefficient corresponding to the data measured by the module. For example, generally, it takes 0.3 seconds for the first device to perform ranging using a bluetooth module, a Wi-Fi module, or a UWB module, and at this time, the time for ranging using the bluetooth module exceeds 3 seconds, and the ranging using the Wi-Fi module or the UWB module is within 0.5 seconds, it is considered that the bluetooth module may have an abnormality, and therefore, the first weight coefficient representing the proportion of the first initial distance measured by the bluetooth module may be reduced or directly set to 0, and the second weight coefficient and the third weight coefficient may be increased.

Optionally, the first device may also switch from one cooperative mode to another cooperative mode, so that data interaction may also be performed in the initial cooperative mode, and then it is determined to switch to another cooperative mode according to the target distance.

The above embodiment describes a specific process of how the first device obtains the target distance between the first device and the second device, and the following describes how the first device determines the cooperative mode according to the target distance.

Fig. 12 is a flowchart illustrating an example of determining a collaborative mode by an electronic device according to an embodiment of the present application. As shown in fig. 12, includes:

s1201, the first device obtains the target distance. For a specific process of the first device acquiring the target distance, reference may be made to the foregoing embodiments.

S1202, the first device starts a mirror image mode or an extension mode according to the target distance, wherein the mirror image mode or the extension mode is a cooperation mode between the first device and the second device.

Specifically, the scenes to which the mirror mode and the extension mode are applicable have an association relationship with the target distance, for example, some users are accustomed to using the extension mode when the target distance is small, and using the mirror mode when the target distance is large; other users are accustomed to using the extended mode when the target distance is large and the mirror mode when the target distance is small.

Optionally, the first device may determine whether the target distance is within a first range or a second range, where the first range may be a numerical range in which distances between the first device and the second device are distributed when the user manually starts the extended mode for multiple times, and the second range is a numerical range in which distances between the first device and the second device are distributed when the user manually starts the mirror mode for multiple times. When the target distance is within the first range, the first device may automatically start the extension mode; the first device may automatically initiate the mirror mode when the target distance is within the second range. Alternatively, the value in the first range may be smaller than the value in the second range, or may be larger than the value in the second range, which is not limited in this application.

In the embodiment shown in fig. 12, the user may preset the association relationship between the target distance and the collaborative mode, and the first device may start the mirror mode or the extended mode according to the target distance to automatically match the usage habits of the user, so that inconvenience caused by manual switching of the collaborative mode by the user is avoided, and the collaborative experience of the user is improved.

Optionally, one possible implementation manner of the step S1202 may include: when the target distance is greater than or equal to a preset distance threshold, the first device starts a mirror image mode according to the target distance; and when the target distance is smaller than the distance threshold, the first equipment starts an expansion mode according to the target distance. It should be noted that the distance threshold may be an empirical value set by a user based on experience; or the first device counts the boundary value of the distance between the first device and the second device in the mirror image starting mode and the extension mode of the user for multiple times; the threshold value obtained by learning the distance between the first device and the second device when the mirror mode and the extended mode are started may also be obtained by the first device in a deep learning manner. In general, interfaces displayed by the first device and the second device are different in the extended mode, and a user needs to observe the interfaces of the two devices at the same time, so that the mode is suitable for scenes in which the first device and the second device are close to each other; the interfaces displayed by the first device and the second device are the same in the mirror image mode, a user does not need to observe the interfaces of the two devices at the same time, and the mode is suitable for scenes with longer distance between the first device and the second device. The first device in this embodiment starts the mirror mode when the target distance is greater than or equal to the distance threshold, and starts the extension mode when the target distance is less than the distance threshold, so that the use requirements of most users can be met, and the collaborative experience of the users is improved.

In a possible implementation manner, the obtaining manner of the distance threshold may include: the first device may obtain a plurality of first distances between the first device and the second device when the first device enables the mirror mode, and average the plurality of first distances to obtain an average value of the first distances, where the average value of the first distances is used to represent an average level of distances between the devices when the user enables the mirror mode in most cases; the first device obtains a plurality of second distances between the first device and the second device when the first device starts the extended mode, and averages the plurality of second distances to obtain an average value of the second distances, wherein the average value of the second distances is used for representing the average level of the distances between the devices when the user starts the extended image mode under most conditions. Optionally, the manner in which the first device obtains the plurality of first distances and the plurality of second distances may also be by obtaining big data, which is not limited in this embodiment of the application. The first device then calculates the mean of the first distance and the mean of the second distance, i.e. again takes the mean of the two means as the distance threshold. For example, the first device has acquired a plurality of first distances as: 2 meters, 4 meters and 6 meters, the average of the first distance being 4 meters; the first device has acquired a plurality of second distances as: 0.1 meters, 0.2 meters, 0.4 meters, and 0.5 meters, with the average value of the second distance being 0.3 meters. An average of 4 meters and 0.3 meters is 1.85 meters, the first device may use 1.85 meters as the distance threshold. In this implementation manner, the plurality of first distances and the plurality of second distances are historical data reflecting the use habits of the user, and the first device calculates the average value of the plurality of first distances and the average value of the plurality of second distances to obtain a distance threshold matching the use habits of the user, thereby improving the collaborative experience of the user.

Optionally, the distance threshold may be modified according to the usage habit and the usage requirement of the user. Specifically, when the user manually starts the mirror mode or manually starts the extension mode, the first device obtains the distance between the first device and the second device and uses the distance as the corrected distance. The first device may then adjust the distance threshold according to the modified distance, and optionally, the modified distance and the distance threshold are positively correlated, that is, the greater the modified distance, the greater the distance threshold, and the smaller the modified distance, the smaller the distance threshold. For example, when the original distance threshold is 1.85 meters, if the user manually starts the mirroring mode and the correction distance is 2 meters, the first device may adjust the distance threshold of 1.85 meters to 1.9 meters, 1.95 meters, or 2 meters; if the user manually initiates the extended mode with a modified distance of 1.6 meters, the first device may adjust the distance threshold of 1.85 meters to 1.80 meters, 1.75 meters, 1.70 meters, or 1.6 meters. In the implementation manner, the correction distance is the distance between the first device and the second device when the user manually starts the collaborative mode, so that the use habit of the user is accurately reflected, and the first device corrects the distance threshold value based on the correction distance, so that the collaborative mode determined based on the distance threshold value is more matched with the requirement of the user, and the collaborative experience of the user is improved.

Optionally, the first device may further obtain the correction distance when the user manually starts the mirror image mode for multiple times, obtain an average value, and then adjust the distance threshold according to the average value of the correction distance; the first device may also obtain the correction distance when the user manually starts the extension mode for a plurality of times, and calculate an average value, and then adjust the distance threshold according to the average value of the correction distances.

In some embodiments, the first device may further determine a usage scenario of the user in combination with the target distance and an Application (APP) running on the first device, and determine whether to start the extended mode or the mirror mode. Generally, the presentation APP needs to show presentation contents to a large number of audiences, and the large number of audiences are difficult to view the presentation contents in a narrow space, so the presentation APP is generally applied to a scene where the first device and the second device are far away from each other; in addition, when the first device and the second device are far away, it is difficult for the viewer to simultaneously observe the screens of the first device and the second device, and thus the presentation-like APP is suitable for the mirror mode. The design-class APP generally serves an individual user, the individual user is generally in a narrow space, and multiple interfaces need to be observed, so the design-class APP is generally applied to a scene where the first device and the second device are close to each other, and is suitable for an extended mode. When the target distance is greater than or equal to a preset distance threshold value and the current APP in the foreground running state of the first device is a demonstration type APP or a conference type APP, the first device can start a mirror mode; when the target distance is smaller than a preset distance threshold and the current APP is a design-class APP, for example, the current APP is circuit diagram design software or engineering drawing software, the first device may start the extension mode. In this embodiment, the first device determines the collaborative demand of the user by combining the target distance and the APP in the foreground running state on the first device, and starts the collaborative mode matching the collaborative demand of the user, thereby further improving the collaborative experience of the user.

For more clearly describing the technical solution of the present application, the following describes the technical solution of the present application with a specific embodiment, and refer to the flowchart of fig. 13, as shown in fig. 13:

and the user clicks a switching button of the cooperative mode of the first equipment, the manual cooperative mode of the first equipment is switched to the automatic determination cooperative mode, and at the moment, the first equipment enables the distance measuring module to start distance measurement. The distance module may be at least one of the above-mentioned short-distance communication modules, for example, a bluetooth module, a Wi-Fi module, and a UWB module. After the distance module measures the distance to obtain at least one of the first initial distance, the second initial distance and the third initial distance, the measured distance is used as the initial distance to be input into a target distance measuring and calculating model to be integrated to obtain the target distance, and then the target distance is transmitted to a distance control module for controlling the measurement. The distance control module judges whether the target distance is greater than or equal to a preset distance threshold, if the target distance is greater than or equal to the distance threshold, the long distance mode is switched, if the target distance is less than the distance threshold, the short distance mode is switched, and the long distance mode or the short distance mode is sent to the display control module. If the information received by the display control module is in a long-distance mode, the display control module determines that the mirror mode needs to be switched to; if the information received by the display control module is in the short-distance mode, the display control module determines that the information needs to be switched to the expansion mode, and sends the determined collaborative mode to the display module, and the display module can control the display interface to display according to the received mirror image mode or the expansion mode.

Fig. 14 is a timing chart corresponding to the flowchart shown in fig. 13, and as shown in fig. 14, a switching operation may be first input by a user, and the automatic switching module of the first device controls the first device to enter the automatic determination coordination mode based on the switching operation, and enables the distance module on the traffic side to start ranging. And then, the distance module sends the measured initial distance to a distance control module for controlling the measurement to judge the distance and determine whether the current distance mode is in a long-distance mode or a short-distance mode. The distance control module may feed back feedback information of the received initial distance to the distance module after receiving the initial distance, or may feed back feedback information of the unreceived initial distance to the distance module when the initial distance is not received for a period of time or the reception fails, so that the distance module re-measures the distance or re-sends the initial distance. Then, the distance control module sends the long-distance mode or the short-distance mode to the display control module. The display control module may also feed back feedback information of the received distance mode to the distance control module after receiving the distance mode, or may feed back a distance mode not received to the distance control module when the distance mode is not received for a period of time or the reception fails, so that the distance control module retransmits or re-determines the current distance mode. And then, the display control module determines to start a mirror image mode or an expansion mode according to the long-distance mode or the short-distance mode and sends the determined cooperation mode to the display module. The display module may also feed back feedback information of the received collaborative mode to the display control module after receiving the collaborative mode, or may feed back the unreceived collaborative mode to the distance control module when the collaborative mode is not received for a period of time or when the reception fails, so that the display control module retransmits or re-determines the collaborative mode. Optionally, if the feedback information is that the corresponding information is not received or the reception fails, the first device may restart the determining procedure of the cooperative mode.

Examples of methods provided herein to determine a collaborative mode are detailed above. It is understood that the corresponding apparatus contains hardware structures and/or software modules corresponding to the respective functions for implementing the functions described above. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The present application may perform functional module division on the apparatus for determining the collaborative mode according to the above method example, for example, each function may be divided into each functional module, or two or more functions may be integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, the division of the modules in the present application is schematic, and is only a logical function division, and there may be another division manner in actual implementation.

Fig. 15 shows a schematic structural diagram of an apparatus for determining a collaborative mode provided by the present application. The apparatus 1500 includes an acquisition module 1501 and an activation module 1502.

An obtaining module 1501, configured to control a first device to obtain a target distance, where the target distance is a distance between the first device and a second device;

a starting module 1502, configured to control the first device to start a mirror image mode or an extension mode according to the target distance, where the mirror image mode or the extension mode is a coordination mode between the first device and the second device.

Optionally, the starting module 1502 is specifically configured to control the first device to start the mirror image mode according to the target distance when the target distance is greater than or equal to a preset distance threshold; or when the target distance is smaller than a preset distance threshold, controlling the first device to start the expansion mode according to the target distance.

Optionally, the starting module 1502 is specifically configured to control the first device to start the mirror mode when the target distance is greater than or equal to a preset distance threshold and the current application APP is a presentation APP; or, when the target distance is smaller than a preset distance threshold and the current APP is a design-class APP, controlling the first device to start the extended mode; and the current APP is the APP in the foreground running state on the first device.

Optionally, the obtaining module 1501 is further configured to control the first device to obtain a plurality of first distances and a plurality of second distances, where the first distances are distances from the second device when the first device enables the mirror mode, and the second distances are distances from the second device when the first device enables the extended mode; and controlling the first device to generate the distance threshold according to the plurality of first distances and the plurality of second distances, wherein the distance threshold is an average value of the plurality of first distances and an average value of the plurality of second distances.

Optionally, the obtaining module 1501 is further configured to control the first device to obtain a modified distance, where the modified distance includes: the distance between the first device and the second device when a user manually starts a mirror mode of the first device, or the distance between the first device and the second device when the user manually starts an extension mode of the first device; and controlling the first device to adjust the distance threshold according to the modified distance, wherein the modified distance and the distance threshold are positively correlated.

Optionally, the obtaining module 1501 is specifically configured to control the first device to receive a switching operation, where the switching operation is used to trigger the first device to enter an automatic determination coordination mode; and responding to the switching operation, and controlling the first equipment to acquire the target distance.

Optionally, the obtaining module 1501 is specifically configured to control the first device to select a target distance measurement and calculation model from a plurality of preset distance measurement and calculation models according to a configuration type of a short-range communication module, where a type of input data of the target distance measurement and calculation model is matched with a configuration type of the short-range communication module, and the configuration type of the short-range communication module includes one or a combination of multiple types of a bluetooth module, a wireless fidelity Wi-Fi module, and an ultra wideband UWB module; controlling the first equipment to input the initial distance into the target distance measuring and calculating model for measuring and calculating to obtain the target distance; the initial distance comprises at least one of a first initial distance, a second initial distance and a third initial distance, the data type of the initial distance is matched with the configuration type of the short-distance communication module, the first initial distance is the distance between the first device and the second device measured by the Bluetooth module, the second initial distance is the distance between the first device and the second device measured by the Wi-Fi module, and the third initial distance is the distance between the first device and the second device measured by the UWB module.

Optionally, the initial distance includes the first initial distance, the second initial distance, and the third initial distance, and the obtaining module 1501 is specifically configured to control the first device to sum a product of the first initial distance and a first weight coefficient, a product of the second initial distance and a second weight coefficient, and a product of the third initial distance and a third weight coefficient, so as to obtain the target distance, where a sum of the first weight coefficient, the second weight coefficient, and the third weight coefficient is 1.

Optionally, the obtaining module 1501 is specifically configured to, when the precision requirement of the target distance is higher than a preset precision threshold, control the first device to increase the third weight coefficient to a target weight coefficient, and decrease the first weight coefficient and/or the second weight coefficient, where the target weight coefficient is greater than one third.

The specific manner of the apparatus 1500 executing the method for determining the collaborative mode and the beneficial effects thereof may be referred to in the description of the method embodiment, and are not described herein again.

The embodiment of the application also provides electronic equipment which comprises the processor. The electronic device provided by this embodiment may be the terminal device 100 shown in fig. 1, and is configured to execute the method for determining the collaborative mode. In case of an integrated unit, the terminal device may comprise a processing module, a storage module and a communication module. The processing module may be configured to control and manage actions of the terminal device, and for example, may be configured to support the terminal device to execute steps executed by the display unit, the detection unit, and the processing unit. The memory module may be used to support the terminal device in executing stored program codes and data, etc. And the communication module can be used for supporting the communication between the terminal equipment and other equipment.

The processing module may be a processor or a controller. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. A processor may also be a combination of computing functions, e.g., a combination of one or more microprocessors, a Digital Signal Processing (DSP) and a microprocessor, or the like. The storage module may be a memory. The communication module may specifically be a radio frequency circuit, a bluetooth chip, a Wi-Fi chip, or other devices that interact with other terminal devices.

In an embodiment, when the processing module is a processor and the storage module is a memory, the terminal device according to this embodiment may be a device having the structure shown in fig. 1.

The embodiment of the present application further provides a device for determining a collaborative mode, including: the device comprises a ranging module and a processing module.

The terminal device involved in the above-mentioned apparatus for determining the cooperative mode may be a device having the structure shown in fig. 1, wherein the processing module may be the processor 110, and the ranging module may be at least one of a bluetooth module or a Wi-Fi module in the wireless communication module 160.

The present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the processor is caused to execute the method for determining a collaborative mode according to any one of the above embodiments.

The embodiments of the present application further provide a computer program product, which when running on a computer, causes the computer to execute the above related steps to implement the method for determining a collaborative mode in the above embodiments.

The electronic device, the computer-readable storage medium, the computer program product, or the chip provided in this embodiment are all configured to execute the corresponding method provided above, so that the beneficial effects achieved by the electronic device, the computer-readable storage medium, the computer program product, or the chip may refer to the beneficial effects in the corresponding method provided above, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, a module or a unit may be divided into only one logic function, and may be implemented in other ways, for example, a plurality of units or components may be combined or integrated into another apparatus, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed to a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method of determining a collaborative mode, comprising:

a first device acquires a target distance, wherein the target distance is the distance between the first device and a second device;

and the first equipment starts a mirror image mode or an expansion mode according to the target distance, wherein the mirror image mode or the expansion mode is a cooperation mode between the first equipment and the second equipment.

2. The method of claim 1, wherein the first device initiates a mirror mode or an extended mode according to the target distance, comprising:

when the target distance is larger than or equal to a preset distance threshold, the first device starts the mirror image mode according to the target distance; alternatively, the first and second electrodes may be,

3. The method of claim 1, wherein the first device initiates a mirror mode or an extended mode according to the target distance, comprising:

when the target distance is larger than or equal to a preset distance threshold value and a current application program APP is a demonstration type APP, starting the mirror image mode by the first equipment; alternatively, the first and second electrodes may be,

when the target distance is smaller than a preset distance threshold value and the current APP is a design type APP, starting the expansion mode by the first device;

4. A method according to claim 2 or 3, characterized in that the method further comprises:

the first device obtains a plurality of first distances and a plurality of second distances, wherein the first distances are the distances between the first device and the second device when the first device starts the mirror mode, and the second distances are the distances between the first device and the second device when the first device starts the extended mode;

the first device generates the distance threshold according to the plurality of first distances and the plurality of second distances, wherein the distance threshold is an average value of the plurality of first distances and an average value of the plurality of second distances.

5. The method according to any one of claims 2 to 4, further comprising:

the first device obtains a corrected distance, the corrected distance comprising: the distance between the first device and the second device when a user manually starts a mirror mode of the first device, or the distance between the first device and the second device when the user manually starts an extension mode of the first device;

the first device adjusts the distance threshold according to the modified distance, and the modified distance and the distance threshold are positively correlated.

6. The method of any one of claims 1 to 5, wherein the first device obtaining the target distance comprises:

the first equipment receives a switching operation, wherein the switching operation is used for triggering the first equipment to enter an automatic determination cooperation mode;

in response to the entering of the automatic determination of the collaborative mode, the first device obtains the target distance.

7. The method of any one of claims 1 to 6, wherein the first device obtaining the target distance comprises:

the first device selects a target distance measurement model from a plurality of preset distance measurement models according to the configuration type of a short-distance communication module, the type of input data of the target distance measurement model is matched with the configuration type of the short-distance communication module, and the configuration type of the short-distance communication module comprises one or more combinations of a Bluetooth module, a wireless fidelity Wi-Fi module and an ultra wide band UWB module;

the first equipment inputs the initial distance into the target distance measuring and calculating model for measuring and calculating to obtain the target distance;

the initial distance comprises at least one of a first initial distance, a second initial distance and a third initial distance, the data type of the initial distance is matched with the configuration type of the short-distance communication module, the first initial distance is the distance between the first device and the second device measured by the Bluetooth module, the second initial distance is the distance between the first device and the second device measured by the Wi-Fi module, and the third initial distance is the distance between the first device and the second device measured by the UWB module.

8. The method of claim 7, wherein the initial distance comprises the first initial distance, the second initial distance and the third initial distance, and the first device inputs the initial distance into the target distance estimation model for estimation to obtain the target distance, comprising:

and the first equipment sums the product of the first initial distance and a first weight coefficient, the product of the second initial distance and a second weight coefficient and the product of the third initial distance and a third weight coefficient to obtain the target distance, wherein the sum of the first weight coefficient, the second weight coefficient and the third weight coefficient is 1.

9. The method of claim 8, further comprising:

when the precision requirement of the target distance is higher than a preset precision threshold value, the first device increases the third weight coefficient to a target weight coefficient, and decreases the first weight coefficient and/or the second weight coefficient, wherein the target weight coefficient is more than one third.

10. An apparatus for determining a collaborative mode, comprising: a distance measuring module and a processing module,

11. The apparatus of claim 10, wherein the initial distance comprises at least one of a first initial distance, a second initial distance, and a third initial distance, and wherein the ranging module comprises: at least one of a Bluetooth module, a wireless fidelity Wi-Fi module and an ultra-wideband UWB module;

12. The apparatus according to claim 10 or 11, wherein the processing module is specifically configured to control the first device to start the mirror mode according to the target distance when the target distance is greater than or equal to a preset distance threshold; alternatively, the first and second electrodes may be,

and when the target distance is smaller than a preset distance threshold, controlling the first equipment to start the expansion mode according to the target distance.

13. The apparatus according to claim 10 or 11, wherein the processing module is specifically configured to control the first device to start the mirror mode when the target distance is greater than or equal to a preset distance threshold and a current application APP is a presentation APP; alternatively, the first and second electrodes may be,

14. The apparatus according to any one of claims 10 to 13, wherein the processing module is further configured to control the first device to obtain a plurality of first distances and a plurality of second distances, where the first distances are distances from the second device when the first device enables the mirroring mode, and the second distances are distances from the second device when the first device enables the extended mode; and controlling the first device to generate the distance threshold according to the plurality of first distances and the plurality of second distances, wherein the distance threshold is an average value of the plurality of first distances and an average value of the plurality of second distances.

15. An electronic device, comprising: a processor, a memory, and an interface;

the processor, memory and interface cooperate to cause the electronic device to perform the method of any of claims 1-9.

16. A computer-readable storage medium, in which a computer program is stored which, when executed by a processor, causes the processor to carry out the method of any one of claims 1 to 9.