CN113643403A

CN113643403A - Method for determining target communication device, terminal and computer readable storage medium

Info

Publication number: CN113643403A
Application number: CN202010338407.0A
Authority: CN
Inventors: 周越海; 李煜; 陈健; 余谭其; 朱欢欢; 谭威
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-04-26
Filing date: 2020-04-26
Publication date: 2021-11-12

Abstract

The application provides a method for determining a target communication device, a communication terminal and a computer readable storage medium, wherein the method is applied to the communication terminal and comprises the following steps: responding to a received service connection instruction for a target communication service, and acquiring identification information and positioning information of object communication equipment searched by a communication terminal based on a wireless communication mode; displaying an equipment selection interface generated according to the positioning information of the object communication equipment, wherein the equipment selection interface comprises equipment selection controls which correspond to the object communication equipment one by one, and the positions of the equipment selection controls are used for identifying the positioning information of the object communication equipment; and responding to the received control selection operation, and determining the object communication equipment corresponding to the target equipment control selected by the control selection operation as the target communication equipment for the target communication service. By the method, the user can intuitively determine the position of the object communication equipment according to the position of the equipment selection control, and the operation is convenient.

Description

Method for determining target communication device, terminal and computer readable storage medium

Technical Field

The present application relates to the field of terminal technologies, and in particular, to a method for determining a target communication device, a communication terminal, and a computer-readable storage medium.

Background

With the development of various terminal devices such as smart phones, tablet computers, smart screens and the like, applications of the terminal devices relate to aspects of user life, for example, a user can take pictures, play games, browse webpages, perform mobile payment and the like through the terminal devices. The information interaction by using the communication function of the terminal device is a very important application of the terminal device.

Taking file sharing on a mobile phone as an example, the process may be: and after the user selects the file to be shared on the mobile phone interface and clicks the sharing, the mobile phone interface displays the searched equipment list of the opposite terminal equipment.

In the prior art, the searched identification information of the peer device (for example, the device name or the user name of the peer device) is listed in the device list, and in some cases, it is difficult for the user to determine the device to be connected from the identification information of the device itself, especially in the case that the peer device has a duplicate name (for example, fig. 1b includes 3 mobile phones with device names "Mate 20"), which may cause inconvenience to the operation of the user.

Disclosure of Invention

Embodiments of the present application provide a method, a communication terminal and a computer-readable storage medium for determining a target communication device, which are described below in various aspects, embodiments and advantages of which are mutually referenced.

In a first aspect, an embodiment of the present application provides a method for determining a target communication device, which is applied to a communication terminal, and the method includes: in response to a received service connection instruction for a target communication service, acquiring identification information and positioning information of one or more object communication devices searched by a communication terminal based on a wireless communication mode, wherein the positioning information comprises distance information between the object communication devices and the communication terminal and direction information of the object communication devices relative to the communication terminal; displaying an equipment selection interface generated according to the positioning information of the object communication equipment, wherein the equipment selection interface comprises one or more equipment selection controls in one-to-one correspondence with at least part of the object communication equipment in one or more object communication equipment, and the appearance of the equipment selection controls and/or the positions of the equipment selection controls on the equipment selection interface are used for identifying the positioning information of the object communication equipment corresponding to the equipment selection controls; and in response to the received control selection operation acting on the equipment selection interface, determining one or more object communication equipment corresponding to one or more equipment selection controls selected by the control selection operation as target communication equipment for the target communication service.

According to the embodiment of the application, the appearance of the device selection control and/or the position of the device selection control on the device selection interface are determined according to the positioning information of the corresponding object communication device, so that the appearance and/or the position of the device selection control can intuitively reflect the positioning information of the object communication device, and when a user selects the device, the position of each object communication device relative to the communication terminal can be obtained according to the appearance and/or the position of the device selection control, so that the target communication device to be connected can be conveniently selected from the object communication devices, and the convenience in operation is improved. In some embodiments, the wireless communication mode is a bluetooth communication mode, and the bluetooth communication mode is capable of acquiring the positioning information of the target communication device based on a bluetooth direction finding technology and a bluetooth proximity sensing technology.

According to the embodiment of the application, the positioning information of the object communication equipment is acquired in a Bluetooth communication mode, and Bluetooth has the characteristics of low power consumption and low cost and can also have higher positioning precision. For example, the Bluetooth 5.1 specification is formally published by the Bluetooth Special Interest Group (SIG) in 2019, 1 month and 29 days, and the Bluetooth 5.1 specification adds a Direction Finding (DF) function to the Bluetooth 5.0, and cooperates with a Bluetooth proximity sensing technology, so that the device can be detected and found more easily, and the positioning accuracy of the Bluetooth can be improved to the centimeter level.

In some implementations, the appearance elements of the device selection control include one or more of: the area of the device selection control; the shape of the device selection control; the color of the device selection control; the device selects the identifier added to the control. Optionally, the identifier added in the device selection control may be a numerical value, a text, a symbol, a picture, a graphic, and the like.

In some implementations, the area or color of the device selection control is used to identify distance information for the subject communication device to which the device selection control corresponds. Therefore, the user can determine the distance of the object communication equipment according to the area or the color of the equipment selection control, and the target communication equipment can be conveniently selected.

In some embodiments, a direction indication icon is added to the device selection control, and the direction indication icon is used for identifying direction information of the target communication device corresponding to the device selection control. Therefore, the user can determine the direction of the object communication equipment according to the equipment selection control, and the target communication equipment can be conveniently selected.

In some embodiments, the device selection interface includes a central node for identifying the communication terminal, and one or more peripheral nodes formed by one or more device selection controls corresponding to the at least some of the subject communication devices, where the peripheral nodes are distributed on a circumference centered on the central node, and a direction of the peripheral nodes with respect to the central node is used to identify direction information of the subject communication devices corresponding to the peripheral nodes. Therefore, the user can determine the direction of the object communication equipment according to the equipment selection control, and the target communication equipment can be conveniently selected.

In some embodiments, the device selection interface is presented in the form of a topographical map.

In some embodiments, the topographic map comprises a topographic base map, wherein the topographic base map is an electronic map of an area where the communication terminal is located; the topographic map further includes a central landmark disposed on the topographic map for identifying the location of the communication terminal on the electronic map and one or more peripheral landmarks formed by one or more device selection controls corresponding to at least some of the object communication devices for identifying the location of their corresponding object communication devices on the electronic map.

According to the embodiment of the application, the positioning information of the object communication equipment is presented by combining with the electronic map of the area where the communication terminal is located, and a user can intuitively judge the position of each object communication equipment by combining with surrounding geographic elements, so that the convenience of operation is further improved.

In some embodiments, the device selection interface is presented in the form of a radar map.

In some embodiments, the radar map includes a central node and one or more surrounding nodes formed by one or more device selection controls corresponding to at least some of the subject communication devices, the locations of the surrounding nodes relative to the central node being used to identify positioning information of the subject communication devices corresponding to the surrounding nodes.

According to the embodiment of the application, the positioning information of the object communication equipment is presented in the form of the radar map, and a user can intuitively judge the position of each object communication equipment relative to the communication terminal, so that the convenience of operation is further improved.

In some embodiments, the appearance of the device selection control, and/or the projection of the device selection control on the device selection interface for the positioning information of the object communication device corresponding to the device selection control in the horizontal plane; alternatively, the appearance of the device selection control, and/or the position of the device selection control on the device selection interface, is determined from a projection of the positioning information of the subject communication device in a plane parallel to the display screen of the communication terminal.

According to the embodiment of the application, the positioning information of the object communication equipment is projected to the horizontal plane or the parallel plane of the communication terminal display screen for expression, so that the positioning information of the object communication equipment can be clearly displayed through the display screen of the communication terminal, and the observation habit of a user can be better met.

In some embodiments, the area or color of the device selection control is determined according to the height of the object communication device corresponding to the device selection control relative to the communication terminal.

According to the embodiment of the application, when the position of the device selection control is used for reflecting the projection of the positioning information of the target communication device on a two-dimensional plane (for example, a horizontal plane, a plane parallel to a display screen of the communication terminal), the height information of the target communication device from the local device (namely, the communication terminal) can be reflected by the area or the color of the device selection control, so that an auxiliary parameter for judging the position of the target communication device is increased, and the convenience of operation can be further improved.

In some embodiments, the display mode of the device selection interface includes a fixed perspective display mode and/or a follow perspective display mode; when the display mode is a fixed visual angle display mode, the appearance of the equipment selection control and/or the position of the equipment selection control on the equipment selection interface are determined according to the projection of the positioning information of the object communication equipment in a fixed coordinate system; when the display mode is the follow-up view display mode, the appearance of the device selection control, and/or the position of the device selection control on the device selection interface is determined according to the projection of the positioning information of the object communication device in a follow-up coordinate system attached to the communication terminal.

In some implementations, the device selection interface also includes a display mode selection control and/or a display mode toggle control to facilitate user selection of a preferred display mode (either a follow perspective display mode or a fixed perspective display mode).

In some embodiments, the identification information of the subject communication device includes an identification icon and/or an identification name of the subject communication device, the identification icon is a device icon or a user icon of the subject communication device, and the identification name is a device name or a user name of the subject communication device.

In some embodiments, the device selection control is added with an identification icon of the corresponding target communication device, and one side of the device selection control is added with an identification name of the corresponding target communication device.

According to the implementation mode of the application, the equipment selection interface comprises the identification information of the object communication equipment, so that a user can conveniently select the target communication equipment.

In some embodiments, the device selection control is added with an identification icon of the corresponding target communication device, one side of the device selection control is added with a device code number of the corresponding target communication device, the device code number is determined according to the identification name of the target communication device, and the number of characters of the device code number is less than that of the identification name of the target communication device.

According to the implementation mode of the application, the identification information of the object communication equipment displayed on one side of the equipment selection control is replaced by the equipment code, so that the mutual coverage of the identification information and the interface graph can be reduced, the visual effect can be improved, and the identification degree of the equipment positioning information can be improved.

In some embodiments, the control selection operation corresponds to a plurality of different types of gesture operations, each type of gesture operation corresponding to a set control selection mode; in response to the received control selection operation, determining one or more object communication devices corresponding to one or more device selection controls selected by the control selection operation as target communication devices for a target communication service, including: responding to the received control selection operation, and analyzing a gesture operation type corresponding to the received control selection operation; determining one or more equipment selection controls selected by control selection operation according to the corresponding relation between the preset gesture operation type and the control selection mode; and determining one or more object communication devices corresponding to one or more device selection controls selected by the control selection operation as target communication devices for the target communication service.

According to the embodiment of the application, because the positions of the device selection controls on the device selection interface are determined according to the positioning information of the object communication devices, the corresponding device selection controls of the object communication devices with similar spatial positions are distributed at the similar positions on the device selection interface, when a plurality of target communication devices are located in the same spatial region (for example, when a plurality of target communication devices are located in the same conference room), the plurality of device selection controls can be selected at one time on the device selection interface, so that a plurality of target communication devices can be selected through one-time selection operation, and the convenience of operation is further improved.

In some embodiments, each type of gesture operation corresponds to a set control selection mode, including: the clicking gesture is used for selecting a device selection control at the position of the gesture action point; and/or, the long press gesture is used for selecting a device selection control in a set area around the gesture action point; and/or the circle player gesture is used for selecting an equipment selection control in an area enclosed by the circle selection track; and/or the single-point touch swiping gesture is used for selecting a device selection control located on the swiping trajectory; and/or the multi-touch swiping gesture is used for selecting a device selection control in the middle area between the two outermost swiping trajectories.

In some embodiments, a trusted device list is stored in the communication terminal, wherein at least a part of the target communication devices are devices included in the trusted device list.

According to the implementation mode of the application, after the communication terminal searches the object communication device, the searched object communication device is screened according to the device trust list, and only the device selection control of the object communication device included in the device trust list is displayed on the device selection interface. The device selection control is selectively displayed, so that the device selection controls can be clearly displayed, and a user can conveniently select the target communication device.

In some embodiments, the devices in the trusted device list include at least one of: a device that the user adds to the list of trusted devices; a device which establishes a service connection with a communication terminal; the registered account is a device for setting the account.

In some embodiments, the method further comprises: and when one or more object communication devices searched by the communication terminal comprise abnormal devices, the communication terminal sends out an alarm signal.

According to the embodiment of the application, the communication terminal sends out the warning signal when searching the abnormal equipment, so that the condition that a user selects object communication equipment which is not expected to be connected by mistake can be avoided.

In a second aspect, an embodiment of the present application provides a communication terminal, including: a wireless communication unit; a memory for storing instructions for execution by one or more processors of the communication terminal; a processor electrically connected to the wireless communication unit and when the processor executes the instructions in the memory, the following method for determining a target communication device may be performed: in response to a received service connection instruction for a target communication service, acquiring identification information and positioning information of one or more object communication devices searched by a communication terminal based on a wireless communication mode, wherein the positioning information comprises distance information between the object communication devices and the communication terminal and direction information of the object communication devices relative to the communication terminal; displaying an equipment selection interface generated according to the positioning information of the object communication equipment, wherein the equipment selection interface comprises one or more equipment selection controls in one-to-one correspondence with at least part of the object communication equipment in one or more object communication equipment, and the appearance of the equipment selection controls and/or the positions of the equipment selection controls on the equipment selection interface are used for identifying the positioning information of the object communication equipment corresponding to the equipment selection controls; and in response to the received control selection operation acting on the equipment selection interface, determining one or more object communication equipment corresponding to one or more equipment selection controls selected by the control selection operation as target communication equipment for the target communication service.

In some embodiments, the device selection interface includes a central node for identifying the communication terminal, and one or more peripheral nodes formed by one or more device selection controls in one-to-one correspondence with the at least some of the object communication devices, where the peripheral nodes are distributed on a circumference with the central node as a center, and a direction of the peripheral nodes with respect to the central node is used to identify direction information of the object communication devices corresponding to the peripheral nodes. Therefore, the user can determine the direction of the object communication equipment according to the equipment selection control, and the target communication equipment can be conveniently selected.

In some embodiments, the topographic map comprises a topographic base map, wherein the topographic base map is an electronic map of an area where the communication terminal is located; the topographic map further comprises a central landmark and one or more peripheral landmarks, wherein the central landmark is arranged on the topographic map and the one or more peripheral landmarks are formed by one or more device selection controls in one-to-one correspondence with at least some of the object communication devices, the central landmark is used for identifying the position of the communication terminal on the electronic map, and the peripheral landmarks are used for identifying the position of the corresponding object communication device on the electronic map.

In some embodiments, the radar map includes a central node and one or more peripheral nodes formed by one or more device selection controls in one-to-one correspondence with the at least some of the subject communication devices, and the locations of the peripheral nodes relative to the central node are used to identify location information of the subject communication devices corresponding to the peripheral nodes.

In a third aspect, embodiments of the present application provide a computer-readable storage medium having instructions stored thereon, which when executed on a computer cause the computer to perform the method for determining a target communication device according to any of the embodiments of the first aspect of the present application.

The computer storage medium provided by the third aspect is used to execute the method for determining the target communication device provided by any of the embodiments of the first aspect, and therefore, the beneficial effects that can be achieved by the computer storage medium can refer to the beneficial effects of the method provided by any of the embodiments of the first aspect, and are not described herein again.

Drawings

FIGS. 1a and 1b illustrate a picture sharing process in the prior art;

fig. 2 is a schematic diagram illustrating a configuration of a communication terminal according to an embodiment of the present disclosure;

fig. 3 is a diagram illustrating a bluetooth module structure in a communication terminal according to an embodiment of the present disclosure;

fig. 4 is a schematic diagram illustrating an antenna arrangement of a communication terminal according to an embodiment of the present application;

fig. 5 shows a software architecture diagram of a communication terminal provided in an embodiment of the present application;

FIG. 6 illustrates an exemplary application scenario diagram of an embodiment of the present application;

fig. 7 is a flowchart illustrating a method for determining a target communication device according to an embodiment of the present application;

fig. 8 shows a flowchart for acquiring location information of a target communication device according to an embodiment of the present application;

FIG. 9 illustrates exemplary waveforms of direction finding signals provided by embodiments of the present application;

FIG. 10 shows a schematic diagram of the AoA and AoD methods for Bluetooth direction finding;

FIG. 11 illustrates a definition of a following coordinate system provided in an embodiment of the present application;

fig. 12 shows a representation of the positioning information of the object communication device provided in the embodiment of the present application in the coordinate system shown in fig. 11;

FIG. 13 illustrates another exemplary application scenario provided by an embodiment of the present application;

FIG. 14 illustrates a device selection interface diagram provided by an embodiment of the present application;

FIG. 15 illustrates another device selection interface diagram provided by embodiments of the present application;

FIG. 16 illustrates a device selection interface diagram presented in a topographical format as provided by an embodiment of the present application;

FIG. 17 illustrates an exemplary implementation of a topographical map provided by an embodiment of the present application;

FIG. 18 illustrates an exemplary arrangement of a reference coordinate system provided by embodiments of the present application;

FIG. 19 illustrates a device selection interface diagram presented in radar graphics form as provided by an embodiment of the present application;

FIG. 20 illustrates another device selection interface diagram presented in the form of a radar chart provided by an embodiment of the present application;

FIG. 21 illustrates yet another device selection interface diagram presented in radar chart form provided by an embodiment of the present application;

FIG. 22a is a schematic diagram illustrating a gesture operation provided by an embodiment of the present application;

FIG. 22b is a schematic diagram illustrating another gesture operation provided by an embodiment of the present application;

FIG. 22c is a schematic diagram illustrating another gesture operation provided by an embodiment of the present application;

FIG. 22d is a schematic diagram illustrating another gesture operation provided by an embodiment of the present application;

FIG. 22e is a schematic diagram illustrating another gesture operation provided by an embodiment of the present application;

fig. 23 is a block diagram illustrating a communication terminal according to an embodiment of the present invention.

Detailed Description

Embodiments of the present embodiment will be described in detail below with reference to the accompanying drawings.

The application relates to a method for determining a target communication device on a communication terminal, wherein the target communication device is a preset opposite terminal device for carrying out communication connection with the communication terminal to complete target communication service. In the present application, the "target communication service" may be a content sharing service, for example, a sharing service of text, picture, video, multimedia, and the like; or the device pairing service, for example, pairing a mobile phone with a bluetooth headset, pairing a notebook computer with a bluetooth mouse; generally, services that need to perform communication connection with a predetermined peer device to achieve a predetermined function can be the "target communication service" described in this application. The picture sharing service is introduced here.

In the embodiment of the present application, the communication terminal may be a terminal device having a communication function, such as a mobile phone, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a Personal Digital Assistant (PDA), a wearable device, and a virtual reality device, which is not limited in this application.

The target communication device may be the same type of device as the communication terminal or a different type of device from the communication terminal. For example, when the communication terminal is a mobile phone, the target communication device may be a mobile phone, a tablet computer, a netbook, a wearable device, or the like, as long as a communication connection can be established with the mobile phone. It is understood that the target communication device should have communication capabilities that match those of the communication terminal, for example, when the communication terminal communicates with surrounding devices via bluetooth, the target communication device should also have bluetooth communication capabilities.

Fig. 1a and 1b illustrate a picture sharing process in the prior art. Referring to fig. 1a, after a user selects a picture to be shared on a communication terminal and clicks sharing, the communication terminal displays a device selection interface as shown in fig. 1 b. The device selection interface displays a device selection control list of a plurality of peer devices which can currently establish service connection, the device selection control includes identification information (e.g., device icon, device name, user avatar, and user name) of the peer devices, and after a user clicks on the device selection control of the peer device to be shared, the communication terminal establishes service connection with the peer device (i.e., the communication terminal starts to transmit picture data to the peer device).

In the prior art, sometimes it is difficult for a user to determine which device is the peer device to be shared only from the identification information included in the device selection control, for example, when the peer devices listed in the device selection control list have a duplicate name (three mobile phones with device names Mate 20 are included in the device selection control list shown in fig. 1 b), or when the content shown by the identification information of the device selection control is fuzzy (for example, the user head images on the first and third device selection controls are not photos of the user himself), this may cause inconvenience in operation.

In addition, in the prior art, a user clicks an equipment icon once to complete sharing of one equipment, and when content sharing needs to be performed on multiple pieces of equipment, multiple sharing operations need to be performed, so that the operation is complex.

Therefore, when a picture sharing instruction sent by a user is received, a communication terminal searches surrounding object communication devices capable of receiving picture sharing in a wireless communication mode, and acquires identification information (the identification information is a device identification of the object communication device and/or a user identification of the object communication device) and positioning information of the searched object communication devices. Here, the number of target communication devices searched by the communication terminal may be one or more.

And then, the communication terminal generates an equipment selection interface according to the searched positioning information of the object communication equipment, wherein equipment selection controls are arranged on the equipment selection interface and correspond to the searched object communication equipment one by one, and the appearance of the equipment selection controls and/or the position of the equipment selection controls on the equipment selection interface are used for identifying the positioning information of the object communication equipment. Therefore, when the user selects the equipment, the position of each object communication equipment relative to the communication terminal can be intuitively judged according to the appearance and/or the position of the equipment selection control, so that the target communication equipment to be shared by the received pictures can be conveniently selected from the object communication equipment, and the convenience of operation is improved. Illustratively, the appearance elements of the device selection control include one or more of: the area of the device selection control; the shape of the device selection control and the color of the device selection control; and the mark added on the equipment selection control part can be a numerical value, a character, a symbol, a picture, a graph and the like.

Further, in some embodiments, the location of the device selection control on the device selection interface is determined according to the location information of the target communication device, and the location of the device selection control on the device selection interface may be regarded as a mapping of the location information of the target communication device on the device selection interface, that is, the target communication devices with similar spatial locations have corresponding device selection controls located at similar locations on the device selection interface. In this way, when a plurality of target communication devices to receive picture sharing are located in the same spatial region (for example, when a plurality of target communication devices are located in the same conference room), a plurality of device selection controls can be selected at one time on the device selection interface (for example, the plurality of device selection controls can be selected at one time through a gesture operation to be described later), so that the plurality of devices can be subjected to picture sharing through one-time sharing operation, and convenience in operation is further improved.

In an embodiment of the present application, a method for acquiring location information of a target communication device based on a wireless communication method includes:

(1) the wifi positioning technology is used for carrying out triangular positioning through differential calculation according to signal intensity between the equipment and the three wireless network access points;

(2) infrared positioning technology, in which an Infrared (IR) marker is used as a moving point for a target to be positioned, modulated Infrared rays are emitted, and the Infrared rays are received and positioned by an optical sensor installed on a receiving device;

(3) radio Frequency Identification (RFID): the fixed antenna modulates a radio signal into an electromagnetic field by using a radio frequency mode, and the tag attached to the positioned target transmits data by induced current after passing through the electromagnetic field so as to exchange data by a plurality of pairs of bidirectional communication to achieve the purpose of triangular positioning;

(4) GPS positioning technology and Beidou positioning technology;

(5) bluetooth positioning technology, etc.

Hereinafter, the technical solution of the present application will be described with bluetooth as an example of wireless communication. Bluetooth not only has low-power consumption, low-cost characteristics, can also have higher positioning accuracy. For example, the Bluetooth 5.1 specification is formally published by the Bluetooth Special Interest Group (SIG) in 2019, 1 month and 29 days, and the Bluetooth 5.1 specification adds a Direction Finding (DF) function to the Bluetooth 5.0, and cooperates with a Bluetooth proximity sensing technology, so that the device can be detected and found more easily, and the positioning accuracy of the Bluetooth can be improved to the centimeter level.

In addition, in the following embodiments, a mobile phone is described as an example of a communication terminal. Referring to fig. 2, the mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 151, a wireless communication module 152, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display 194, a SIM card interface 195, and the like. The sensor module 180 may include a gyroscope sensor 180A, an acceleration sensor 180B, a proximity light sensor 180G, a fingerprint sensor 180H, and a touch sensor 180K (of course, the mobile phone 100 may further include other sensors, such as a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, an air pressure sensor, a bone conduction sensor, and the like, which are not shown in the figure).

It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the mobile phone 100. In other embodiments of the present application, the handset 100 may include more or fewer components than shown, or some components may be combined, some components may be separated, or a different arrangement of components may be used. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a Neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors. The controller may be a neural center and a command center of the cell phone 100, among others. The processor can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

The processor 110 may run the binary executable file provided in the embodiment of the present application, and may perform compatibility with a parent class object of a static compiling and dynamic language, that is, in an application scenario of the static compiling and dynamic language, the processor 110 of the terminal device executes the method for loading and running the application program provided in the present application, which may solve the problem of binary compatibility, reduce the load of computation at a class loading stage, and improve running efficiency. The processor 110 may include different devices, such as an integrated CPU and a GPU, and the CPU and the GPU may cooperate to execute the method for loading and running the application program provided by the embodiment of the present application, so as to obtain faster processing efficiency.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the cell phone 100 may include 1 or N display screens 194, with N being a positive integer greater than 1. The display screen 194 may be used to display information input by or provided to the user as well as various Graphical User Interfaces (GUIs). For example, the display 194 may display a photograph, video, web page, or file, etc. As another example, display 194 may display a graphical user interface. The graphical user interface comprises a status bar, a hidden navigation bar, a time and weather widget (widget) and an application icon, such as a browser icon. The status bar includes the name of the operator (e.g., china mobile), the mobile network (e.g., 4G), the time and the remaining power. The navigation bar includes a back key icon, a home key icon, and a forward key icon. Further, it is understood that in some embodiments, a Bluetooth icon, a Wi-Fi icon, an add-on icon, etc. may also be included in the status bar. It will also be appreciated that in other embodiments, a Dock bar may also be included in the graphical user interface, and that a commonly used application icon may be included in the Dock bar, etc. When the processor 110 detects a touch event of a finger (or a stylus, etc.) of a user with respect to an application icon, in response to the touch event, a user interface of an application corresponding to the application icon is opened and displayed on the display 194.

In this embodiment, the display screen 194 may be an integrated flexible display screen, or may be a spliced display screen formed by two rigid screens and a flexible screen located between the two rigid screens.

The cameras 193 (front camera or rear camera, or one camera may be both front camera and rear camera) are used to capture still images or video. In general, the camera 193 may include a photosensitive element such as a lens group including a plurality of lenses (convex lenses or concave lenses) for collecting an optical signal reflected by an object to be photographed and transferring the collected optical signal to an image sensor, and an image sensor. And the image sensor generates an original image of the object to be shot according to the optical signal.

Internal memory 121 may be used to store computer-executable program code, such as a binary executable file provided by embodiments of the present application, including instructions. The processor 110 executes various functional applications of the cellular phone 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Wherein the storage program area may store an operating system, codes of application programs (such as a camera application, a WeChat application, etc.), and the like. The storage data area can store data (such as images, videos and the like acquired by a camera application) and the like created during the use of the mobile phone 100, for example, an instantiation object of a storage class.

The internal memory 121 may also store one or more computer programs corresponding to the methods for loading and running an application program provided by the embodiments of the present application. The one or more computer programs stored in the memory 221 and configured to be executed by the one or more processors 210 include instructions that may be used to perform the steps as in the corresponding embodiment of fig. 7.

In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

Of course, the code of the method for loading and running the application program provided by the embodiment of the present application may also be stored in the external memory. In this case, the processor 110 may execute the code of the method of loading and executing the application program stored in the external memory through the external memory interface 120.

The function of the sensor module 180 is described below.

The gyro sensor 180A may be used to determine the motion attitude of the cellular phone 100. In some embodiments, the angular velocity of the handpiece 100 about three axes (i.e., the x, y, and z axes) may be determined by the gyro sensor 180A. I.e., the gyro sensor 280A may be used to detect the current state of motion of the handset 100, such as shaking or standing still.

When the display screen in the embodiment of the present application is a foldable screen, the gyro sensor 180A may be used to detect a folding or unfolding operation acting on the display screen 294. The gyro sensor 180A may report the detected folding operation or unfolding operation as an event to the processor 110 to determine the folded state or unfolded state of the display screen 194.

The acceleration sensor 180B can detect the magnitude of acceleration of the cellular phone 100 in various directions (typically three axes). I.e., the gyro sensor 180A may be used to detect the current state of motion of the handset 100, such as shaking or standing still. When the display screen in the embodiment of the present application is a foldable screen, the acceleration sensor 180B may be used to detect a folding or unfolding operation acting on the display screen 194. The acceleration sensor 180B may report the detected folding operation or unfolding operation as an event to the processor 110 to determine the folded state or unfolded state of the display screen 194.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The mobile phone emits infrared light outwards through the light emitting diode. The handset uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the handset. When insufficient reflected light is detected, the handset can determine that there are no objects near the handset. When the display screen in this embodiment of the application is a foldable screen, the proximity optical sensor 180G may be disposed on the first screen of the foldable display screen 194, and the proximity optical sensor 180G may detect a folding angle or an unfolding angle of the first screen and the second screen according to an optical path difference of the infrared signal.

The gyro sensor 180A (or the acceleration sensor 280B) may transmit the detected motion state information (such as angular velocity) to the processor 210. The processor 210 determines whether the mobile phone is currently in the hand-held state or the tripod state (for example, when the angular velocity is not 0, it indicates that the mobile phone 100 is in the hand-held state) based on the motion state information.

The fingerprint sensor 180H is used to collect a fingerprint. The mobile phone 100 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, take a photograph of the fingerprint, answer an incoming call with the fingerprint, and the like.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on the surface of the mobile phone 100, different from the position of the display 194.

Illustratively, the display screen 194 of the handset 100 displays a main interface that includes icons for a plurality of applications (e.g., a camera application, a WeChat application, etc.). The user clicks the icon of the camera application in the home interface through the touch sensor 180K, which triggers the processor 110 to start the camera application and open the camera 193. The display screen 194 displays an interface, such as a viewfinder interface, for the camera application.

The wireless communication function of the mobile phone 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 151, the wireless communication module 152, the modem processor, the baseband processor, and the like.

The

antennas

1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the handset 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 151 may provide a solution including 2G/3G/4G/5G wireless communication applied to the handset 100. The mobile communication module 251 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 151 may receive electromagnetic waves from the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit the electromagnetic waves to the modem processor for demodulation. The mobile communication module 151 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 251 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 251 may be disposed in the same device as at least some of the modules of the processor 110. In the embodiment of the present application, the mobile communication module 151 may also be used for information interaction with other terminal devices.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 151 or other functional modules, independent of the processor 110.

The wireless communication module 152 may provide solutions for wireless communication applied to the mobile phone 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 152 may be one or more devices integrating at least one communication processing module. The wireless communication module 152 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 152 may also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and convert it into electromagnetic waves via the antenna 2 to radiate it.

Specifically, the wireless communication module 152 includes a bluetooth module 200, and fig. 3 shows one example of the bluetooth module 200. The bluetooth module 200 includes a bluetooth Micro Control Unit (MCU) chip 210 and a bluetooth MCU chip external hardware, wherein the bluetooth MCU chip 210 includes:

(1) bluetooth baseband core 211: and the Bluetooth baseband core part is used for finishing the functions of baseband link control, data stream processing and the like. The Bluetooth baseband core comprises a radio frequency interface which is used for controlling the 2.4GHz radio frequency chip 221 and carrying out data communication; the Bluetooth baseband core also comprises an interrupt and Direct Memory Access (DMA) interface, a data stream processing unit, a control and clock unit for controlling interrupt, clock, frequency and the like;

(2) the internal memory 212: finishing data exchange of the baseband core 211, data exchange of the baseband core 211 and the microprocessor 213, and data exchange with the processor 110 through the UART interface 214;

(5) the UART interface 214: interface with the URAT interface of processor 110;

(6) the microprocessor 213: the bluetooth MCU chip 210 generally controls and runs the firmware to implement the link management function in the bluetooth protocol.

The external hardware of the Bluetooth MCU chip comprises:

(1)2.4GHz Bluetooth radio frequency chip 221: completing the radio frequency transmission and reception of standard Bluetooth 2.4 Hz;

(2) the external memory 222: which may be a Flash Memory (Flash Memory), stores an initialization program and firmware of the microprocessor 213.

In one example, the antenna 2 connected to the rf chip 221 of the bluetooth module 200 is an antenna array, and the antenna array includes at least two antennas. At this time, the antenna of the object communication device may be a single antenna, and the handset 100 may acquire the direction information of the object communication device by an angle of Arrival (AoA) method after receiving the signal wave transmitted by the object communication device. The antenna array may be arranged in a uniform linear array (a), a uniform matrix array (b), a uniform circular array (c) and the like as shown in fig. 4.

In another example, the antenna 2 connected to the rf chip 221 of the bluetooth module 200 may be a single antenna, and the antenna in the target communication device is an antenna array including at least two antennas, in which case, after the mobile phone 100 receives the signal wave transmitted by the target communication device, the direction information of the target communication device may be acquired by an angle of Departure (AoD) method. The arrangement of the antenna array in the object communication device may also be a uniform linear array (a), a uniform matrix array (b), a uniform circular array (c), and the like shown in fig. 4.

The AoA method and AoD method for directivity using bluetooth technology will be explained below.

With continued reference to fig. 2, the handset 100 may implement audio functions via the audio module 170, speaker 170A, microphone 170B, microphone 170C, headphone interface 170D, and application processor, among others. Such as music playing, recording, etc. The handset 100 may receive key 190 inputs, generating key signal inputs relating to user settings and function controls of the handset 100. The handset 100 can generate a vibration alert (e.g., an incoming call vibration alert) using the motor 191. The indicator 192 in the mobile phone 100 may be an indicator light, and may be used to indicate a charging status, a power change, or a message, a missed call, a notification, etc. The SIM card interface 195 in the handset 100 is used to connect a SIM card. The SIM card can be attached to and detached from the cellular phone 100 by being inserted into the SIM card interface 195 or being pulled out from the SIM card interface 195.

It should be understood that in practical applications, the mobile phone 100 may include more or less components than those shown in fig. 2, and the embodiment of the present application is not limited thereto. The illustrated handset 100 is merely an example, and the handset 100 may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The software system of the mobile phone 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application exemplifies a software structure of the mobile phone 100 by taking an Android system with a layered architecture as an example.

Fig. 5 is a block diagram of a software configuration of the mobile phone 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages.

As shown in fig. 5, the application package may include phone, camera, gallery, calendar, talk, map, navigation, WLAN, bluetooth, music, video, short message, etc. applications.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 5, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide the communication functions of the handset 100. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the terminal device vibrates, an indicator light flickers, and the like.

The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), Media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), positioning information calculation modules, and the like. The positioning information calculation module may be configured to calculate a relative position of the object communication device and the mobile phone 100 (i.e., positioning information of the object communication device), and the like.

The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The embodiment of the application provides a method for determining a target communication device, and fig. 6 shows an application scenario of the embodiment of the application. In this scenario, a plurality of object communication devices are distributed around the mobile phone 100, each object communication device has a bluetooth communication module, and each object communication device can be searched by the mobile phone 100 after the mobile phone 100 starts bluetooth.

Referring to fig. 7, a method for determining a target communication device provided in an embodiment of the present application includes:

s10: in response to the received picture sharing instruction, the mobile phone 100 acquires the identification information and the positioning information of the target communication device searched in the bluetooth communication manner.

Fig. 8 shows an exemplary process of the cellular phone 100 acquiring the identification information and the location information of the target communication device searched by the bluetooth communication method. After the bluetooth function of the mobile phone 100 is turned on, the bluetooth module 200 of the mobile phone 100 enters an inquiry sub-state and broadcasts an inquiry data packet. The object communication devices around the handset 100 operate in the inquiry scan substate and can receive inquiry packets broadcast by the handset 100. After the peripheral object communication devices receive the query packet sent by the mobile phone 100 for the first time, in order to avoid collision caused by simultaneous responses of a plurality of object communication devices, a random time may be waited for, and if the object communication devices receive the query packet sent by the mobile phone 100 again, the object communication devices enter a query response sub-state.

In the inquiry response sub-state, the target communication device sends an inquiry response data packet to the mobile phone 100, and in some optional implementation manners, the inquiry response data packet carries identification information of the target communication device; in other words, when the handset 100 receives the inquiry response packet, the identification information of the target communication device can be parsed from the inquiry response packet. The type of the identification information of the target communication device is not limited in the present application, for example, the identification information of the target communication device may be a device identification of the target communication device, for example, a device name, a Media Access Control (MAC) address of a communication module, an International Mobile Equipment Identity (IMEI), and the like; the identification information of the subject communication device may also be the user identification of the subject communication device, e.g., a user name (including a nickname), a user avatar, etc.

Referring to fig. 8, in the query response sub-state, the object communication device may further send a direction finding data packet to the handset 100, where the direction finding data packet carries a direction finding signal, and for example, a waveform of the direction finding signal may be as shown in fig. 9. After receiving the Direction-Finding signal, the mobile phone 100 may orient the target communication device through a Direction Finding (DF) function of the bluetooth 5.1, and then obtain the positioning information (including distance information and/or Direction information) of the target communication device by combining a bluetooth proximity sensing technology. Methods for orienting devices by a Direction Finding (DF) function in bluetooth 5.1 include AoA method and AoD method, the principles of which are briefly described below.

(1) AoA process

In the AoA method, the antenna of the transmitting device (i.e., the target communication device) of the direction-finding signal may be a single antenna, and the antenna of the receiving device (i.e., the mobile phone 100) may be an antenna array, for example, the antenna arrays may be antenna arrays (a) to (c) shown in fig. 4, and generally, a rectangular antenna array (b) and a circular antenna array (c) may achieve relatively higher positioning accuracy.

For clarity, the principle of the AoA method is illustrated by taking two antennas in an antenna array as an example. Referring to (a) of fig. 10, the calculation target of the AoA method is to determine the direction of the transmitting device with respect to the receiving device, i.e., to calculate the value of the angle θ.

In the transmission direction of the signal wave (direction of diagram a), the signal wave first reaches the antenna a which is closer to the transmission device, the time of arrival at the antenna a is t1, and the phase of the signal wave is ψ 1; after the time difference Δ t, the signal wave arrives at the antenna b which is far from the transmission device, the time of arrival at the antenna b is t2, the phase of the signal wave is ψ 2, and a phase difference Δ ψ 2- ψ 1 exists between the signal wave received by the antenna b and the signal wave received by the antenna a.

From the wavelength λ and the phase difference Δ ψ of the signal wave, it can be known that the distance difference Δ L between the signal wave received by the antenna b and the signal wave received by the antenna a in the signal wave transmission direction is λ Δ ψ/2 pi, the distance d between the antenna a and the antenna b is known (the value of the distance d can be preset in the cellular phone 100), and the relationship between Δ L, d and θ satisfies: Δ L λ Δ ψ/2 pi dcos θ, so that the value of angle θ is:

θ＝arccos(λΔψ/2πd)。

(2) AoD method

In contrast to the AoA method, in the AoD method, the antenna of the direction-finding signal receiving apparatus (i.e., the cell phone 100) may be a single antenna, and the antenna of the direction-finding signal transmitting apparatus (i.e., the target communication apparatus) may be an antenna array, and similarly, the antenna array may be antenna arrays (a) to (c) shown in fig. 4, and similarly, the rectangular antenna array (b) and the circular antenna array (c) may generally achieve relatively higher positioning accuracy.

For clarity, the principle of the AoD method is illustrated by using two antennas in the antenna array. Referring to (b) of fig. 10, the calculation target of the AoD method is to determine the direction of the transmitting device with respect to the receiving device, i.e., to calculate the value of the angle θ.

A signal wave transmitted from an antenna a located closer to the receiving device in the transmission direction of the signal wave (direction of diagram a) is first received by the antenna of the receiving device, and the phase of the signal wave when it reaches the receiving device is ψ 1; after the time difference Δ t, the signal wave transmitted from the antenna b, which is far from the receiving apparatus, is received by the antenna of the receiving apparatus, and the phase of the signal wave when it reaches the receiving apparatus is ψ 2, that is, the phase difference Δ ψ 2- ψ 1 exists between the signal wave transmitted from the antenna a and the signal wave transmitted from the antenna b when they reach the receiving apparatus.

From the wavelength λ and the phase difference Δ ψ of the signal wave, it can be known that the distance difference Δ L between the signal wave emitted from the antenna b and the signal wave emitted from the antenna a in the signal wave transmission direction is λ Δ ψ, the distance d between the antenna a and the antenna b is known (the value of the distance d can be preset in the cellular phone 100), and the relationship between Δ L, d and θ satisfies: Δ L λ Δ ψ/2 pi dcos θ, so that the value of angle θ is:

θ＝arccos(λΔψ/2πd)。

in some embodiments, after receiving the direction-finding signal of the target communication device, the bluetooth module 200 of the mobile phone 100 transmits the relevant parameters (e.g., wavelength/frequency information of the direction-finding signal, time difference information, etc.) of the received direction-finding signal to the system library through the kernel layer, and the positioning information calculation module in the system library calculates the positioning information of the target communication device relative to the mobile phone 100 according to the parameters of the direction-finding signal.

In the embodiment of the present application, the positioning information of the target communication device is the relative position information of the target communication device and the mobile phone 100, in other words, the position of the mobile phone 100 should be used as the positioning reference when the positioning information is understood. On the basis of the above, the positioning information can be expressed in a follow-up coordinate system (i.e., a coordinate system moving along with the mobile phone) attached to the mobile phone, or can be expressed in a fixed coordinate system (i.e., a coordinate system which is stationary relative to the ground). In addition, it can be understood that the posture of the mobile phone 100 can be recognized by the gyro sensor 180A and the acceleration sensor 180B in the mobile phone 100, so that coordinate conversion between the fixed coordinate system and the following coordinate system can be realized.

For example, a fixed point in space is used as an origin of the fixed coordinate system, an eastern direction is used as an x-axis forward direction, a northern direction is used as a y-axis forward direction, and a vertically upward direction is used as a z-axis forward direction. The specific establishment method of the following coordinate system is not limited in the present application, as long as the relative position relationship between the target communication device and the mobile phone 100 can be reflected.

Referring to fig. 11, in an example, the origin of the following coordinate system C1 is set on the mobile phone 100, the x-axis of the following coordinate system is parallel to the projection of the wide side of the mobile phone 100 on the horizontal plane where the origin is located, the y-axis of the coordinate axes is parallel to the projection of the long side of the mobile phone 100 on the horizontal plane where the origin is located, and the z-axis of the reference coordinate system is the vertical direction, it can be understood that, when the mobile phone 100 is horizontally placed as shown in fig. 11, the x-axis of the following coordinate system is parallel to the wide side of the mobile phone 100, and the y-axis of the following coordinate system is parallel to the long side of the mobile phone 100. In other examples, the follow-up coordinate system may be established in other ways, such as x-axis being parallel to the long side of the phone, y-axis being parallel to the wide side of the phone, z-axis being perpendicular to the plane of the phone, etc.

In the following embodiments, the positioning information expressed in the following coordinate system C1 shown in fig. 11 is explained.

Fig. 12 shows the position of one of the subject communication apparatuses in the following coordinate system C1 shown in fig. 11, in which point P represents the position of the subject communication apparatus and point O represents the position of the cellular phone 100. Among them, the distance information of the subject communication apparatus (i.e., the straight-line distance l of the subject communication apparatus from the cellular phone 100) can be decomposed into a planar distance s between the subject communication apparatus and the cellular phone 100 (i.e., the length of a projected line segment of a connecting line of the subject communication apparatus and the cellular phone 100 in the x-y plane), and a height h of the subject communication apparatus from the cellular phone 100 (i.e., a perpendicular distance between the subject communication apparatus and the x-y plane).

The directional information of the target communication device can also be decomposed into two components, elevation angle β and azimuth angle α, respectively. The elevation angle β is an angle between a connection line between the target communication device and the mobile phone 100 and the x-y plane, and the azimuth angle α is an angle between a projection line segment of the connection line between the target communication device and the mobile phone 100 in the x-y plane and a direction reference line.

Illustratively, table 1 lists the positioning information of each of the subject communication devices in the scenario shown in fig. 6 in the following coordinate system C1 shown in fig. 11.

TABLE 1

S20: a device selection interface is displayed. The device selection interface is generated by the mobile phone 100 according to the acquired positioning information of the target communication device. Specifically, one or more device selection controls are provided on the device selection interface, and each device selection control corresponds to one object communication device. The appearance of the device selection control and/or the position of the device selection control on the device selection interface are used for identifying the positioning information of the object communication device corresponding to the device selection control. Therefore, when the user selects the equipment, the position of each object communication equipment relative to the communication terminal can be intuitively judged according to the appearance and/or the position of the equipment selection control, so that the target communication equipment to be shared by the received pictures can be conveniently selected from the object communication equipment, and the convenience of operation is improved.

In some embodiments, the device selection interface includes device selection controls of all target communication devices searched by the mobile phone 100, that is, in this embodiment, the number of the device selection controls is the same as the number of the target communication devices searched by the mobile phone 100, and for each target communication device searched by the mobile phone 100, the device selection interface is provided with a device selection control corresponding thereto.

In other embodiments, only the device selection control of the target communication device that meets the setting condition is displayed on the device selection interface, and the setting condition may be one or more of the following: a user-trusted device; a device that has established a service (e.g., a content sharing service, a device pairing service, an audio/video connection service, etc.) connection with the mobile phone 100; the registered account is a device that sets an account (e.g., an account of the user himself, an account of a user's relatives, etc.). It will be appreciated that in this embodiment, the number of device selection controls may be less than the number of subject communication devices searched by the handset 100.

Illustratively, the handset 100 stores a trusted device list, and the devices in the trusted device list are devices that meet the set conditions, that is, the devices included in the trusted device list include one or more of the following: devices that the user added to the device trust list (e.g., the user manually adds a trusted device to the device trust list through an application on the handset 100); a device that has established a service connection with the handset 100; the registered account is a device for setting the account. Thus, after the target communication device is searched, the mobile phone 100 filters the searched target communication device according to the device trust list, and displays only the device selection control of the target communication device included in the device trust list on the device selection interface. In the embodiment, the device selection controls are selectively displayed, so that the device selection controls can be clearly displayed, and a user can conveniently select the target communication device.

In still other embodiments, when the communication device of the object searched by the cell phone 100 includes an abnormal device, the cell phone 100 sends an alert signal, for example, displays an alert mark (e.g., exclamation mark) near the device selection control of the abnormal device, or displays the device selection control of the abnormal device by a special color (e.g., darkened color). Here, the abnormal device may be a device not included in the trusted device trust list of the cell phone 100, or an abnormal device determined by a server, or the like. Illustratively, different warning signals are sent out for abnormal equipment with different trust levels according to the trust level. For example, for the first searched device which is not in the device trust list, an alarm signal with a lower alarm degree is sent out (for example, an alarm mark is added near the device selection control); for devices blacklisted on the handset 100 (e.g., devices with higher risk as determined by the server), an alert signal is issued with a higher alert level (e.g., a device selection control is displayed in a darkened red color). In this embodiment, the mobile phone 100 can prevent the user from mistakenly selecting an object communication device to which the user does not wish to connect by sending an alarm signal to an abnormal device.

In an embodiment of the application, the appearance of the device selection control and/or the position of the device selection control on the device selection interface are used to identify positioning information of the object communication device corresponding to the device selection control. Wherein the appearance elements of the device selection control include one or more of: the area of the device selection control; the shape of the device selection control and the color of the device selection control; and the mark added on the equipment selection control part can be a numerical value, a character, a symbol, a picture, a graph and the like.

It will be appreciated that when the subject communication device location information is expressed in the fixed coordinate system, the coordinate values of the subject communication device will not change as the attitude of the handset 100 changes, and therefore, when the location information is expressed in the fixed coordinate system, the shape and/or position of each device selection control on the device selection interface may remain unchanged after the attitude of the handset 100 changes. For example, in one example, the location information of the subject communication device is expressed in a fixed coordinate system, with an upward direction in the device selection interface representing a north-pointing direction and a rightward direction being an east-pointing direction. The object communication device numbered (1) in the scene shown in fig. 6 will be described as an example. In one example, an arrow is added to the device selection control, the pointing direction of the arrow identifying the direction of the subject communication device relative to the handset 100. The subject communication device (1) is located in the east-ward direction of the cellular phone 100, and then the arrow on the device selection control a for identifying the subject communication device (1) should be pointed to the right to indicate that the subject communication device (1) is located east of the cellular phone 100. When the posture of the mobile phone 100 changes, the pointing direction of the arrow on the device selection control a does not change, and is still the right pointing direction. In summary, when the subject communication device positioning information is expressed in the fixed coordinate system, the shape and/or position of each device selection control on the device selection interface does not change with the change of the posture of the mobile phone 100, and this display mode of the device selection interface is referred to herein as "fixed view display mode".

When the positioning information of the target communication device is expressed in the following coordinate system, the coordinate values of the target communication device may change according to the change of the posture of the mobile phone 100, and therefore, when the positioning information is expressed in the following coordinate system, the shape and/or the position of each device selection control on the device selection interface may change according to the change of the posture of the mobile phone 100. The object communication device numbered (1) in the scene shown in fig. 6 will be described as an example. In one example, the positional information of the subject communication device is expressed in a follow-up coordinate system C1, and an arrow pointing to identify the direction of the subject communication device (1) with respect to the cellular phone 100 is added to the device selection control a corresponding to the subject communication device (1). Then when the orientation of the handset 100 is the orientation shown in fig. 6, the pointing direction of the arrow on the device selection control a is the right direction to indicate that the subject communication device (1) is located on the right side of the handset 100; when the orientation of the cellular phone 100 changes to the right orientation (i.e., orientation in fig. 13), the pointing direction of the arrow on the device selection control a is an upward direction to indicate that the subject communication device (1) is located directly in front of the cellular phone 100. In summary, when the subject communication device positioning information is expressed in the follow-up coordinate system, the shape and/or position of each device selection control on the device selection interface changes as the pose of the handset 100 changes, and this display mode of the device selection interface is referred to herein as a "follow-up perspective display mode".

In the embodiment of the application, a display mode selection control can be further arranged on the equipment selection interface, and a user can select the corresponding control to enable the display mode of the equipment selection interface to be a 'fixed visual angle display mode' or a 'following visual angle display mode'. In other embodiments, a display mode switching control is provided on the device selection interface, and by clicking the switching control, the display mode of the device selection interface can be switched between a "fixed viewing angle display mode" and a "follow viewing angle display mode".

Further, in the embodiment of the present application, the positioning information expressed by the appearance and/or the position of the device selection control may be a projection of the positioning information in a horizontal plane, or a projection of the positioning information in a plane parallel to the display screen of the mobile phone 100, which is described below with reference to a specific example.

Fig. 14 shows a first example of a device selection interface provided in an embodiment of the present application. In this example, a direction indication icon is added to the device selection control, and the direction indication icon is used to identify direction information of the object communication device corresponding to the device selection control. The shape of the direction indication icon in the present embodiment is not limited, and may be a triangle as shown in fig. 14, an arrow, a pointer, a pattern (for example, a hand pattern having a pointing function), or the like as long as the direction information of the target communication device with respect to the mobile phone 100 can be indicated. Therefore, the user can determine the position of the object communication equipment according to the direction indication mark on the equipment selection control, and the user can conveniently select the target communication equipment.

Further, in the present example, the pointing direction of the direction indication icon is determined according to the projection of the direction information of the subject communication device in the horizontal plane, for example, the pointing direction of the direction indication icon is determined according to the azimuth angle α in table 1. However, the present application is not limited thereto, and for example, in other examples, the pointing direction of the direction indication icon is determined according to a projection of the direction information of the subject communication device in a plane parallel to the display screen of the cellular phone 100.

In addition, in this example, the area of the device selection control is used to identify the distance information of the target communication device, and optionally, the area of the device selection control of the target communication device farther away from the mobile phone 100 is smaller, so as to meet the cognitive experience of people that the distance is farther away and the area is smaller. Optionally, the area of the device selection control is determined from a projection of the distance information of the subject communication device in a horizontal plane (e.g., plane distance s in table 1). In this example, the distance information of the target communication device is identified by the area of the device selection control, but the application is not limited thereto, and in other examples, the distance information of the target communication device may be identified by the color of the device selection control, for example, the farther the target communication device is from the mobile phone 100, the lighter the color of the device selection control is; alternatively, distance information or the like of the subject communication device may also be identified by adding a numerical value on the device selection control.

Fig. 15 shows a second example of the device selection interface provided in the embodiment of the present application. Unlike the first example, in this example, the orientation information of the subject communication device is identified by the location of the device selection control. Specifically, the device selection interface includes a central node for identifying the handset 100, and one or more (illustratively 6) peripheral nodes for identifying the subject communication devices, where the peripheral nodes are formed by the device selection controls corresponding to their respective subject communication devices. Referring to fig. 15, in this example, the peripheral nodes are distributed on a circumference with the center node as a circle center, and the directions of the peripheral nodes relative to the center node are used to identify the direction information of the target communication devices corresponding to the peripheral nodes. Therefore, the user can determine the position of the object communication equipment according to the position on the equipment selection control, and the user can conveniently select the target communication equipment. In addition, in this example, the distance information of the target communication device is identified by a numerical value on the device selection control in the addition.

In other examples of the embodiments of the present application, a position of the device selection control on the device selection interface is used to identify positioning information of the target communication device, that is, the position of the device selection control on the device selection interface may be regarded as mapping of the positioning information of the target communication device on the device selection interface, so that a user may intuitively determine the position of each target communication device according to the position of the device selection control, and thus, a target communication device to be received and shared by pictures may be conveniently determined from the target communication devices.

Fig. 16 shows a third example of a device selection interface provided in an embodiment of the present application, in which the device selection interface is presented in the form of a topographic map. Specifically, the topographic map includes a topographic map, which is an electronic map of the area where the mobile phone 100 is located, and the electronic map includes geographic elements such as buildings, roads, water bodies, and/or greenbelts. The topographical map also includes a central landmark (illustrating a five-pointed star) for identifying the location of the handset 100 and surrounding landmarks for identifying the location of each subject communication device, where each surrounding landmark is a device selection control corresponding to each subject communication device. The user can intuitively determine the location of each object communication device by observing the location of the device selection control.

FIG. 17 illustrates an implementation of a topographical map, which includes the steps of:

s201: and generating a topographic base map layer. The map layer of the terrain underlying map includes an electronic map of an area where the mobile phone 100 is located, and the electronic map may be obtained from a map application installed in the mobile phone 100. The positions of the geographic elements in the electronic map are described in a global coordinate system C2 shown in fig. 18, a global coordinate system C2 is a fixed coordinate system, and in this example, an x-y plane of the global coordinate system C2 is a horizontal plane. After the position information of each geographic element described in the global coordinate system C2 is projected to the display coordinate system C3, an electronic map may be formed. In this example, the display coordinate system C3 is a horizontal plane, and the position of each device selection control is determined based on the projection of the positioning information of the target communication device on the horizontal plane. However, the present application is not so limited, and in other examples, the display coordinate system C3 is a plane parallel to the display screen of the cell phone 100, corresponding to the location of each device selection control being determined from the projection of the positioning information of the subject communication device in the plane parallel to the display screen of the cell phone 100. It is understood that when the display coordinate system C3 is a horizontal plane, the electronic map presents a planar visual effect; when the display coordinate system C3 is at an angle (e.g., 15 °) to the horizontal plane, the electronic map exhibits a certain stereoscopic effect.

S202: the coordinates of the handset 100 in the global coordinate system C2 are determined. For example, the coordinates of the mobile phone 100 in the global coordinate system C2 are acquired by satellite positioning or the like.

S203: the coordinates of each of the subject communication devices in the global coordinate system C2 are determined. Referring to fig. 18, after determining the position of the cellular phone 100 in the global coordinate system C2, the coordinates of each of the object communication devices in the global coordinate system C2 can be obtained by projecting the follow-up coordinate system C1 in the global coordinate system C2.

S204: and generating a landmark layer, wherein the landmark layer comprises a central landmark for identifying the position of the mobile phone 100 and peripheral landmarks for identifying the positions of the object communication devices. For example, after the coordinates of the mobile phone 100 in the global coordinate system C2 are projected to the display coordinate system C3, the position of the mobile phone 100 on the electronic map can be obtained, and after an icon for identifying the mobile phone 100 is added to the position, a central landmark can be generated; the coordinates of each object communication device in the global coordinate system C2 are projected to the display coordinate system C3, so that the position of each object communication device on the electronic map can be obtained, and the surrounding landmarks can be formed after the corresponding device selection control is added to the position of each object communication device.

S205: and superposing the terrain base map layer and the landmark map layer to generate a terrain map.

Fig. 19 shows a fourth example of the device selection interface provided in the embodiment of the present application, in which the device selection interface is presented in the form of a radar map, and the radar map may include a center node for identifying a location where the mobile phone 100 is located and one or more peripheral nodes for identifying locations where the object communication devices are located, where the peripheral nodes are device selection controls of the object communication devices. The user can intuitively determine the location of each object communication device by observing the location of the device selection control.

When the device selection interface is presented in the form of a radar map, the position of the device selection control of the subject communication device on the device selection interface is obtained by projecting the position of each subject communication device in the follow-up coordinate system C1 to the display coordinate system C3. To conform to the user's general viewing habits, coordinate system C3 is shown parallel to the horizontal plane in this example. In other examples, the display coordinate system C3 is in other arrangements, for example, the display coordinate system C3 is a plane parallel to the display of the cell phone 100.

In fig. 19, for example, the azimuth angle of the peripheral node is equal to the azimuth angle α of the corresponding target communication device, and the length of the connection line between the peripheral node and the central node is linearly related to the plane distance s of the corresponding target communication device, for example, the length of the connection line between the peripheral node and the central node is the plane distance s of the corresponding target communication device multiplied by a set value (the specific value can be determined according to the screen display range). In the embodiment of the present application, the center node may be a solid pattern or a hollow pattern, as long as the position of the mobile phone 100 can be represented.

In this example, the radar map is provided with a plurality of concentric circles using the center node as the center, and the radar map is further provided with a plurality of radial lines using the center node as the starting point. The concentric circles and the radial lines are auxiliary reference lines for assisting a user in judging the positioning information of each object communication device. In some arrangements, the concentric circles may be added with values for their indicated planar distances s (not shown), and/or the radial lines may be added with values for their indicated azimuthal angles α (not shown).

FIG. 20 illustrates yet another arrangement of a radar map in which the device selection control can also be used to express the height h of the subject communication device. Referring to fig. 20, the area of the device selection control is associated with the height h of the subject communication device, specifically, the greater the height h, the greater the area of its device selection control for the subject communication device. In another example, the height h may also be inversely related to the area of the device selection control, i.e., the larger the height h, the smaller the area of the device selection control of the object communication device, which may be more fit to the cognitive experience of people, the farther away the object is, the smaller the object is. In other examples, the color of the device selection control may also be associated with the height h of the subject communication device, e.g., the greater the height h, the lighter the color of its device selection control for the subject communication device.

In the above example, the difference between the heights is represented by the graphic feature of the device selection control, and in other examples, the height h of the target communication device may be expressed in other manners, for example, a value of the height h is added to the device selection control.

Further, in the device selection interface, the identification information of the target communication device may also be included, the identification information of the target communication device may be a device identification of the target communication device, for example, a device type, a device name, a MAC address, an IMEI device code, and the like of the target communication device, and the identification information of the target communication device may also be a user identification of the target communication device, for example, a user name (including a nickname), a user avatar, and the like. The device identification of the subject communication device may be text and/or an icon. The following explains a manner of adding identification information of the object communication apparatus, taking a presentation form of a radar chart as an example.

In some embodiments, with continued reference to fig. 19, each object selection control is added with an identification icon of its corresponding object communication device, and the icon of the object communication device may be a device icon or a user icon. The device icon is an outline drawing (including an outline sketch) of the target communication device, and the user icon is a user avatar.

Further, one side (e.g., right side, bottom side) of each object selection control is also added with an identification name of its corresponding object communication device, and the identification name of the object communication device may be a device identification name or a user identification name. The device identification name may be a device name, a MAC address, an IMEI device code, etc. of the target communication device, and the user identification name may be a user name (including a user nickname) of the target communication device.

In some embodiments, considering that the display area of the display screen of the mobile phone 100 is limited, the device code may be used to replace the identification name of the target communication device displayed on the side of the device selection control, so as to reduce the mutual coverage between the device identification name and the interface graphics, thereby improving the visual effect. The device code may be determined according to the identification name of the object communication device, and the number of characters of the device code is less than the number of characters of the device identification corresponding to the device code.

Fig. 21 shows an example of the device code number, and this example explains application of the device code number by taking the radar chart of fig. 19 as an example. In this example, the device numbers are numeric serial numbers with parentheses, and the device numbers are distributed below the device selection control. Each target communication device corresponds to a different serial number (the serial numbers corresponding to the target communication devices are shown to be sequentially increased), and in other examples, the target communication devices with the same device identification name may also adopt the same device code number. Further, an equipment list is displayed in the lower area of the radar chart, and the identification name, the plane distance s and the height h of the object communication equipment corresponding to each equipment code are listed in the equipment list.

S30: and receiving a control selection operation acted on the equipment selection interface, wherein the control selection operation is used for selecting a target equipment control from the equipment selection controls on the equipment selection interface. Here, the control selection operation may be a gesture operation applied to the device selection interface by a finger, a stylus pen, or the like, and the gesture operation may be a click operation, a long-press operation, or the like.

S40: and responding to the received control selection operation, and determining the object communication equipment corresponding to the target equipment control as the target communication equipment.

In some examples, the control selection operation is performed through a plurality of different types of gesture operations, each type of gesture operation corresponding to a set control selection manner. After detecting the gesture operation acting on the device selection interface, the mobile phone 100 analyzes the type corresponding to the gesture operation, and determines the device selection control selected by the gesture operation according to the corresponding relationship between the preset gesture operation type and the control selection mode.

Referring to fig. 22a, the first type of gesture operation is a tap gesture, which is preset as a device selection control for selecting a location where a gesture action point is located. In this way, when the mobile phone 100 detects a click operation applied to the device selection control with the device number (3), the target communication device corresponding to the device selection control with the device number (3) is determined as the target communication device. When the mobile phone 100 detects a click operation on a blank region (i.e., a region without a device selection control), it determines that the current operation is an invalid operation (i.e., no device selection control is selected as a target device control).

Referring to fig. 22b, the second type of gesture operation is a long press gesture, which is preset to be used to select a device selection control in a set area around the gesture action point, illustratively, a circular area with the gesture action point as the center and a set value (e.g., 2cm) as the radius. For example, referring to fig. 22b, after the mobile phone 100 detects the long press operation acting on the illustrated position, the device selection controls (illustrated as device selection controls with code numbers (1), (2), and (4)) in the set area around the gesture action point are determined as the target device controls. When the target communication devices to be shared by pictures are concentrated in the same area (for example, when the target communication devices are concentrated in the same meeting), a plurality of target communication devices to be shared can be selected at one time through long-time pressing gestures, and convenience in operation is improved.

Referring to fig. 22c, a third type of the gesture operation is a circle selection gesture, and the circle selection operation is preset to be used for selecting the device selection controls in the area enclosed by the circle selection track, and in the illustration, the device selection controls with device numbers (1), (2), and (3) are located in the circle selection track. When the mobile phone 100 detects the circling operation shown in fig. 22c, the target communication apparatus is determined to be the target communication apparatus with the apparatus numbers (1), (2), and (3). The type of circle selection track is not restricted by the embodiment of the application, the circle selection track can be circular, oval, long-strip-shaped and the like, a user can accurately select multiple target communication devices to be shared by the received pictures at one time through controlling the circle selection track of the circle selection operation, and the convenience of the operation is improved.

Referring to fig. 22d, a fourth type of gesture operation is a single-touch swipe gesture, i.e., a touch swipe operation performed by a single finger. The single-touch swiping operation is preset as a device selection control for selecting a swiping trajectory to pass through, and in the illustration, the swiping trajectory passes through the device selection controls with device numbers (5), (2) and (3). When the mobile phone 100 detects the single-touch swipe operation shown in fig. 22d, the target communication devices having the device numbers (5), (2), and (3) are determined as the target communication devices. When the target communication devices to be shared by the received pictures are approximately linearly arranged, the plurality of target communication devices can be conveniently selected at one time through single-point touch sliding operation, and the convenience of operation is improved.

Referring to fig. 22e, a fifth type of gesture operation is a multi-touch swipe gesture, i.e., a touch swipe operation performed by a plurality of fingers. The multi-touch swiping operation is preset as a device selection control for selecting a middle region between the two outermost swiping trajectories. Fig. 22e shows an example of the two-point touch slide operation, which forms two stroking trajectories containing device selection controls of device numbers (1), (2), (3), (4), (5) in the middle area between the two stroking trajectories. When the mobile phone 100 detects the multi-touch slide operation shown in fig. 22e, the target communication device is determined as the target communication device by the target communication device having the device numbers (1), (2), (3), (4), and (5). When the target communication devices to be shared by the received pictures are arranged in a centralized manner, a plurality of target communication devices can be conveniently selected at one time through multi-point touch sliding operation, and the convenience of operation is improved.

S50: and transmitting the picture data to the target communication equipment to finish picture sharing. The transmission mode of the picture data can be Bluetooth transmission, wifi transmission and the like, and the method is not limited in the application. The transmission process of the picture data can refer to the prior art, and is not described in detail herein.

Referring now to fig. 23, shown is a block diagram of a communication terminal 400 in accordance with one embodiment of the present application. The communication terminal 400 may include one or more processors 401 coupled to a controller hub 403. for at least one embodiment, the controller hub 403 communicates with the processors 401 via a multi-drop Bus such as a Front Side Bus (FSB), a point-to-point interface such as a QuickPath Interconnect (QPI), or similar connection 406. Processor 401 executes instructions that control general types of data processing operations. In one embodiment, Controller Hub 403 includes, but is not limited to, a Graphics Memory Controller Hub (GMCH) (not shown) and an Input Output Hub (IOH) (which may be on separate chips) (not shown), where the GMCH includes a Memory and a Graphics Controller and is coupled to the IOH.

The communication terminal 400 may also include a coprocessor 402 and memory 404 coupled to the controller hub 403. Alternatively, one or both of the memory and GMCH may be integrated within the processor (as described herein), with the memory 404 and coprocessor 402 coupled directly to the processor 401 and controller hub 403, with the controller hub 403 and IOH in a single chip.

The Memory 404 may be, for example, a Dynamic Random Access Memory (DRAM), a Phase Change Memory (PCM), or a combination of the two. Memory 404 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions therein. A computer-readable storage medium has stored therein instructions, and in particular, temporary and permanent copies of the instructions. The instructions may include: instructions that when executed by at least one of the processors cause the electronic device to perform the method as described in fig. 7. The instructions, when executed on a computer, cause the computer to perform the method for selecting a target communication device as disclosed in the above-described embodiments of the present application.

In one embodiment, the coprocessor 402 is a special-purpose processor, such as, for example, a high-throughput Integrated Core (MIC) processor, a network or communication processor, compression engine, graphics processor, General-purpose computing on graphics processing unit (GPGPU), embedded processor, or the like. The optional nature of coprocessor 402 is represented in FIG. 23 by dashed lines.

In one embodiment, the communication terminal 400 may further include a Network Interface Controller (NIC) 406. The network interface 406 may include a transceiver to provide a radio interface for the communication terminal 400 to communicate with any other suitable device (e.g., front end module, antenna, etc.). In various embodiments, the network interface 406 may be integrated with other components of the communication terminal 400. The network interface 406 may implement the functions of the communication unit in the above-described embodiments.

The communication terminal 400 may further include an Input/Output (I/O) device 405. I/O405 may include: a user interface designed to enable a user to interact with the communication terminal 400; the design of the peripheral component interface enables peripheral components to also interact with the communication terminal 400; and/or sensors are designed to determine environmental conditions and/or location information associated with the communication terminal 400.

It is noted that fig. 23 is merely exemplary. That is, although fig. 23 shows that the communication terminal 400 includes a plurality of devices such as a processor 401, a controller hub 403, a memory 404, etc., in practical applications, a device using the methods of the present application may include only a part of the devices of the communication terminal 400, for example, may include only the processor 401 and the NIC 406. The nature of the alternative device in fig. 16 is shown in dashed lines.

It should be noted that, herein, "a and/or B" indicates that there may be three cases, i.e., a alone, B alone, and a and B together.

The method embodiments of the present application may be implemented in software, magnetic, firmware, etc.

Program code may be applied to input instructions to perform the functions described herein and generate output information. The output information may be applied to one or more output devices in a known manner. For purposes of this application, a processing system includes any system having a processor such as, for example, a Digital Signal Processor (DSP), a microcontroller, an Application Specific Integrated Circuit (ASIC), or a microprocessor.

The program code may be implemented in a high level procedural or object oriented programming language to communicate with a processing system. The program code can also be implemented in assembly or machine language, if desired. Indeed, the mechanisms described herein are not limited in scope to any particular programming language. In any case, the language may be a compiled or interpreted language.

One or more aspects of at least one embodiment may be implemented by representative instructions stored on a computer-readable storage medium, which represent various logic in a processor, which when read by a machine causes the machine to fabricate logic to perform the techniques described herein. These representations, known as "IP cores" may be stored on a tangible computer-readable storage medium and provided to a number of customers or manufacturing facilities to load into the manufacturing machines that actually make the logic or processor.

In some cases, an instruction converter may be used to convert instructions from a source instruction set to a target instruction set. For example, the instruction converter may transform (e.g., using a static binary transform, a dynamic binary transform including dynamic compilation), morph, emulate, or otherwise convert the instruction into one or more other instructions to be processed by the core. The instruction converter may be implemented in software, hardware, firmware, or a combination thereof. The instruction converter may be on the processor, off-processor, or partially on and partially off-processor.

Claims

1. A method for determining a target communication device, applied to a communication terminal, comprising:

in response to a received service connection instruction for a target communication service, acquiring identification information and positioning information of one or more object communication devices searched by the communication terminal based on a wireless communication mode, wherein the positioning information comprises distance information between the object communication devices and the communication terminal and direction information of the object communication devices relative to the communication terminal;

displaying a device selection interface generated according to the positioning information of the object communication device, where the device selection interface includes one or more device selection controls in one-to-one correspondence with at least some object communication devices of the one or more object communication devices, and where an appearance of the device selection control and/or a position of the device selection control on the device selection interface is used to identify the positioning information of the object communication device corresponding to the device selection control;

and responding to the received control selection operation acted on the equipment selection interface, and determining one or more object communication equipment corresponding to one or more equipment selection controls selected by the control selection operation as target communication equipment for the target communication service.

2. The method of claim 1, wherein the wireless communication mode comprises a bluetooth communication mode, and wherein the location information of the target communication device is obtained based on bluetooth direction finding technology and bluetooth proximity sensing technology of the bluetooth communication mode.

3. The method of claim 1, wherein the appearance elements of the device selection control comprise one or more of: an area of the device selection control; the device selects a shape of a control; the color of the device selection control; and the equipment selects the identifier added on the control.

4. The method of claim 3, wherein an area or color of the device selection control is used to identify distance information of the subject communication device to which the device selection control corresponds.

5. The method according to claim 1, wherein a direction indication icon is added to the device selection control, and the direction indication icon is used for identifying direction information of the object communication device corresponding to the device selection control.

6. The method according to claim 1, wherein the device selection interface comprises a central node for identifying the communication terminal, and one or more peripheral nodes formed by the one or more device selection controls in one-to-one correspondence with the at least some of the object communication devices, wherein the peripheral nodes are distributed on a circumference centered on the central node, and directions of the peripheral nodes with respect to the central node are used for identifying direction information of the object communication devices corresponding to the peripheral nodes.

7. The method of claim 1, wherein the device selection interface is presented in the form of a topographical map.

8. The method according to claim 7, wherein the topographic map comprises a topographic map, wherein the topographic map is an electronic map of an area in which the communication terminal is located;

the topographic map further comprises a central landmark and one or more peripheral landmarks, wherein the central landmark is arranged on the topographic map and the one or more peripheral landmarks are formed by the one or more device selection controls in one-to-one correspondence with at least some of the object communication devices, the central landmark is used for identifying the position of the communication terminal on the electronic map, and the peripheral landmarks are used for identifying the positions of the object communication devices corresponding to the peripheral landmarks on the electronic map.

9. The method of claim 1, wherein the device selection interface is presented in the form of a radar map.

10. The method of claim 9, wherein the radar map comprises a central node and one or more peripheral nodes formed by the one or more device selection controls in one-to-one correspondence with the at least some of the subject communication devices, and wherein the locations of the peripheral nodes relative to the central node are used to identify location information of the subject communication devices corresponding to the peripheral nodes.

11. The method of claim 1, wherein the appearance of the device selection control and/or the position of the device selection control on the device selection interface is determined according to a projection of positioning information of an object communication device corresponding to the device selection control in a horizontal plane; alternatively, the first and second electrodes may be,

the appearance of the device selection control, and/or the position of the device selection control on the device selection interface, is determined from a projection of the positioning information of the subject communication device in a plane parallel to the display screen of the communication terminal.

12. The method according to claim 1, wherein the area or the color of the device selection control is determined according to the height of the object communication device corresponding to the device selection control relative to the communication terminal.

13. The method of claim 1, wherein the display mode of the device selection interface comprises a fixed view display mode and/or a follow view display mode; wherein the content of the first and second substances,

when the display mode is a fixed view angle display mode, the appearance of the device selection control, and/or the position of the device selection control on the device selection interface is determined according to the projection of the positioning information of the object communication device in a fixed coordinate system;

when the display mode is a follow-up view display mode, the appearance of the device selection control, and/or the position of the device selection control on the device selection interface is determined according to the projection of the positioning information of the object communication device in a follow-up coordinate system attached to the communication terminal.

14. The method of claim 13, wherein the device selection interface further comprises a display mode selection control and/or a display mode toggle control.

15. The method according to claim 1, wherein the identification information of the subject communication device includes an identification icon and/or an identification name of the subject communication device, the identification icon is a device icon or a user icon of the subject communication device, and the identification name is a device name or a user name of the subject communication device.

16. The method according to claim 15, wherein the device selection control is added with an identification icon of the corresponding target communication device, and one side of the device selection control is added with an identification name of the corresponding target communication device.

17. The method according to claim 15, wherein the device selection control is added with an identification icon of the corresponding target communication device, one side of the device selection control is added with a device code of the corresponding target communication device, the device code is determined according to the identification name of the target communication device, and the number of characters of the device code is less than that of the identification name of the target communication device.

18. The method of claim 1, wherein the control selection operation corresponds to a plurality of different types of gesture operations, each type of gesture operation corresponding to a set control selection manner;

in response to a received control selection operation acting on the device selection interface, determining one or more object communication devices corresponding to one or more device selection controls selected by the control selection operation as target communication devices for the target communication service, including:

responding to the received control selection operation, and analyzing a gesture operation type corresponding to the received control selection operation;

determining one or more equipment selection controls selected by the control selection operation according to the corresponding relation between the preset gesture operation type and the control selection mode;

and determining one or more object communication devices corresponding to one or more device selection controls selected by the control selection operation as target communication devices for the target communication service.

19. The method of claim 18, wherein each type of gesture operation corresponds to a set control selection mode, and comprises:

the clicking gesture is used for selecting a device selection control at the position of the gesture action point; and/or the presence of a gas in the gas,

the long press gesture is used for selecting a device selection control in a set area around the gesture action point; and/or the presence of a gas in the gas,

the circle player gesture is used for selecting an equipment selection control in an area surrounded by the circle selection track; and/or the presence of a gas in the gas,

the single-point touch sliding gesture is used for selecting a device selection control located on the sliding track; and/or the presence of a gas in the gas,

the multi-touch swiping gesture is used to select a device selection control in the middle region between the two outermost swiping trajectories.

20. The method according to claim 1, wherein the communication terminal has a trusted device list stored therein, and wherein the at least some subject communication devices are devices included in the trusted device list.

21. The method of claim 20, wherein the devices in the trusted device list comprise at least one of: a device that the user adds to the list of trusted devices; a device which establishes a service connection with the communication terminal; the registered account is a device for setting the account.

22. The method of claim 1, further comprising:

and when one or more object communication devices searched by the communication terminal comprise abnormal devices, the communication terminal sends out a warning signal.

23. A communication terminal, comprising:

a wireless communication unit;

a memory for storing instructions for execution by one or more processors of the communication terminal;

a processor electrically connected to the wireless communication unit and operable when the processor executes the instructions in the memory to perform the method for determining a target communication device of any of claims 1-22.

24. A computer-readable storage medium having stored thereon instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 22.