CN113194454B - Data sharing method and electronic equipment - Google Patents

Data sharing method and electronic equipment Download PDF

Info

Publication number
CN113194454B
CN113194454B CN202010033491.5A CN202010033491A CN113194454B CN 113194454 B CN113194454 B CN 113194454B CN 202010033491 A CN202010033491 A CN 202010033491A CN 113194454 B CN113194454 B CN 113194454B
Authority
CN
China
Prior art keywords
electronic device
user interface
information
graphical user
nearby
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010033491.5A
Other languages
Chinese (zh)
Other versions
CN113194454A (en
Inventor
卢恒惠
卢曰万
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202010033491.5A priority Critical patent/CN113194454B/en
Priority to PCT/CN2021/071112 priority patent/WO2021143650A1/en
Publication of CN113194454A publication Critical patent/CN113194454A/en
Application granted granted Critical
Publication of CN113194454B publication Critical patent/CN113194454B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W8/00Network data management
    • H04W8/005Discovery of network devices, e.g. terminals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/11Allocation or use of connection identifiers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/14Direct-mode setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W8/00Network data management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/12Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion

Abstract

The invention provides a data sharing method and an electronic terminal. The electronic terminal has an antenna array with the capability of measuring angles and beam forming of nearby devices. The user can obtain the direction information of the nearby equipment when sharing data with the nearby equipment, so that the user can select the receiving equipment or the electronic terminal to find the nearby equipment in the direction specified by the user by combining the direction information. The user may also discover nearby devices in a specified direction. The method and the device can enable the user to distinguish the nearby equipment by using the direction information in the process of sharing data to the nearby equipment by using the electronic equipment, improve the speed and convenience for the user to select the receiving equipment, and improve the use satisfaction of the user.

Description

Data sharing method and electronic equipment
Technical Field
The present application relates to the field of wireless communications, and in particular, to a data sharing method and an electronic device.
Background
In recent years, with the development of wireless communication technology, electronic devices such as smartphones and tablet computers start to support sharing data among the devices by using wireless communication technology such as bluetooth and Wifi. With the popularization of intelligent terminals, more and more users share data in a D2D mode. In the process of sharing, a user needs to discover adjacent devices first. In practical applications, when nearby device discovery is performed, the number of adjacent electronic devices is increased. This phenomenon brings trouble for the user to share data in a D2D manner: first, an increase in the number of neighboring devices increases the time for user equipment to detect. In addition, few users maintain the information of their own devices, which results in lack of personalization of device information of discovered devices, and makes it difficult for senders who share data to distinguish receiving devices in a huge number of adjacent device lists. The phenomenon brings inconvenience to the user for selecting the receiving device, and reduces the use satisfaction of the user.
Disclosure of Invention
The invention aims to provide a data sharing method and electronic equipment, which can enable a user to distinguish adjacent equipment more easily in the process of using the electronic equipment to share data, and improve the speed and convenience of selecting receiving equipment by the user.
The above and other objects are achieved by the features of the independent claims. Further implementations are presented in the dependent claims, the description and the drawings.
In a first aspect, a method for data sharing is provided, and the method may include: the electronic equipment displays a first graphical user interface, wherein a first object (such as a picture, a document and the like) is displayed in the first graphical user interface; the electronic device detects a first operation (such as clicking a control to share) in the first graphical user interface, and in response to the first operation, the electronic device displays a second graphical user interface; the electronic equipment displays first information and second information in the second graphical user interface, wherein the first information comprises first direction information, and the second information comprises second direction information. The first information corresponds to a first device, and the second information corresponds to a second device; the first direction information indicates that the first device is located in a first direction of the electronic device, and the second direction information indicates that the second device is located in a second direction of the electronic device. The first device and the second device are discovered by the electronic device via a short-range wireless communication protocol. The electronic equipment detects a second operation (such as clicking first information by a user) in the second graphical user interface, wherein the second operation acts on the first information; in response to the second operation, the electronic device sends the first object to the first device.
Here, the first graphic user interface may be a user interface of the first application program for displaying the object. The first application may be a "gallery" in which pictures are displayed, and the objects displayed may be pictures. The first application may also be an application that displays a file. Without being limited thereto, the first application program may also be another application program that displays objects such as pictures, documents, and characters.
According to the technical scheme described in the first aspect, the electronic equipment can display the direction information of the nearby equipment in the data sharing process, so that a user can distinguish the nearby equipment by combining the direction information, the speed and convenience for selecting the receiving equipment by the user are improved, and the use efficiency of the electronic equipment is improved.
According to the first aspect, in one possible implementation, a second object is also displayed in the first graphical user interface; and, prior to the first operation, further comprising: the electronic equipment detects a third operation in the first graphical user interface, wherein the third operation acts on the first object; in response to the third operation, the first object is displayed as being selected. The third operation may specifically be a long press operation on the first object, or the like.
According to the implementation mode, when a plurality of objects are displayed in the graphical user interface, the user can select the shared object.
According to the first aspect, in another possible implementation manner, the first information further indicates a distance between the electronic device and the first device, and the second information further indicates a distance between the electronic device and the second device.
According to the implementation mode, the distance is further combined on the basis of combining the direction information, and the efficiency of distinguishing the nearby devices by the user is further improved.
According to the first aspect, in another possible implementation manner, before the electronic device displays the first information and the second information in the second graphical user interface, the method further includes: the electronic device detects a fourth operation, and in response to the fourth operation, the electronic device discovers the first device and the second device through a short-range wireless communication protocol. The fourth operation may specifically be sliding down on a status bar of the graphical user interface, and clicking a "directional sharing" switch control in a displayed window.
According to the implementation mode, the electronic equipment can start the discovery process of the nearby equipment before the user starts to share the data, and the response time from data sharing to data sending is shortened.
According to the first aspect, in another possible implementation manner, the second graphical user interface further includes a first option; and, before the electronic device displays the first information and the second information in the second graphical user interface, further comprising: when the electronic device detects a fifth operation acting on the first option, the electronic device discovers the first device and the second device through a short-range wireless communication protocol. The first option may be in the form of an icon, a text, a picture, and the like representing "directional sharing", and the fifth operation may be specifically clicking the first option. Through this step, the user can turn on the nearby device discovery process through the above operation, in the case where the targeted sharing is not turned on.
According to the implementation mode, the electronic equipment is only started to directionally share when needed, and power consumption can be saved.
In another possible implementation form according to the first aspect, the electronic device is provided with an antenna array, and the electronic device determines the first direction of the first device and the second direction of the second device using the antenna array. In a specific implementation, the antenna array may be used to determine the first direction of the first device first, and then the antenna array may be used to determine the second direction of the second device, or the antenna array may be used to determine the first direction of the first device and the second direction of the second device simultaneously.
According to the above implementation, the electronic device is able to determine the relative angle of nearby devices.
According to the first aspect, in another possible implementation manner, third information is further displayed on the second graphical user interface, where the third information includes the first direction information; wherein the third information corresponds to a third device, and the first direction information indicates that the third device is located in the first direction of the electronic device. All nearby devices discovered by the electronic device and direction information of the nearby devices may be displayed on the second graphical user interface.
According to the implementation mode, the user can further select the target receiving device from the plurality of nearby devices by combining the direction information, and the data sharing efficiency of the user is improved.
According to the first aspect, in another possible implementation manner, the first information and the third information have different display effects, and the different display effects indicate that distances between the first device and the electronic device and the third device are different. Through the operation, when the nearby devices are in the same direction, the nearby devices are further distinguished through the distance between the nearby devices and the electronic device, meanwhile, different display effects are configured for the device information of the nearby devices at different distances, a user is prompted very conveniently and visually, and therefore user experience is improved.
According to the first aspect, in another possible implementation manner, a coordinate axis is further displayed on the second graphical user interface, and a central point of the coordinate axis indicates a position of the electronic device. The coordinate axis can indicate reference directions (such as front, back, left and right) for a user, the central point is set to indicate the position of the electronic equipment, the user can more intuitively obtain the relative position relation between the electronic equipment and nearby equipment, and user experience is improved.
In another possible implementation form according to the first aspect, the antenna array is a millimeter wave antenna array.
In a second aspect, a method for data sharing is provided, which is applied to an electronic device with an antenna array. The method can include the electronic device displaying a first graphical user interface in which a first object (e.g., a picture, a document, etc.) is displayed; the electronic device detects a first operation in the first graphical user interface, wherein the first operation indicates a first direction; in response to the first operation, the electronic device sends the first object to the first device; wherein the first device is located in the first direction of the electronic device.
Here, the first graphic user interface may be a user interface of the first application program for displaying the object. The first application may be a "gallery" in which pictures are displayed, and the objects displayed may be pictures. The first application may also be an application that displays a file. Without being limited thereto, the first application program may also be another application program that displays objects such as pictures, documents, characters, and the like.
According to the technical scheme described in the second aspect, in the data sharing process of the electronic equipment, the operation steps of sharing the content by the user are simplified, and the data sharing efficiency is improved.
In a possible implementation form according to the second aspect, the first operation is long-pressing and dragging the first object. The electronic device may determine the first direction by a start point and an end point of the dragging, or by a track of the dragging.
According to the second aspect, in one possible implementation, the electronic device detects a second operation, and in response to the second operation, the electronic device discovers the first device through a short-range wireless communication protocol. The second operation may specifically be sliding down on a status bar of the graphical user interface, and clicking a "directional sharing" switch control in the displayed window.
According to the implementation mode, the electronic equipment can start the discovery process of the nearby equipment in all directions before the user starts to share the data, and the response time from data sharing to data sending is shortened.
According to the second aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: in response to the first operation, the electronic device discovers the first device through a short-range wireless communication protocol. That is, the electronic device may trigger a discovery process of nearby devices in all directions by the first operation.
According to the implementation mode, the electronic equipment is only started to directionally share when needed, and power consumption can be saved.
According to a second aspect, in one possible implementation, the electronic device is provided with an antenna array, the electronic device using the antenna array to determine the first direction of the first device. According to the implementation, the electronic device obtains the relative angle of nearby devices.
According to a second aspect, in one possible implementation, the first device is the only device in the first direction of the nearby devices discovered by the electronic device.
In another possible implementation form according to the second aspect, the electronic device discovers a second device and the electronic device determines using the antenna array that the second device is also in the first direction; and the electronic equipment selects the first equipment and sends the first object to the first equipment.
According to the above implementation, the process of selecting a receiving device by a user is simplified.
In another possible implementation form according to the second aspect, the selection is according to a first rule. In particular, if the first rule is to select a nearby device closest to the electronic device, the above implementation further includes the electronic device determining distances between the electronic device and the first device and the second device.
According to the implementation mode, the nearby device closest to the electronic device is selected as the candidate receiving device, and the process of selecting the receiving device by the user is simplified.
According to the second aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: the electronic device displays a second graphical user interface; the electronic equipment comprises first information in the second graphical user interface, wherein the first information corresponds to the first equipment; the electronic device detects a third operation in the second graphical user interface, and in response to the third operation, the electronic device sends the first object to the first device.
According to the above implementation, the user can be made to confirm the receiving device that is to transmit data.
According to the second aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: the electronic device displays a second graphical user interface; the electronic equipment comprises first information and second information in the second graphical user interface, wherein the first information corresponds to the first equipment, and the second information corresponds to the second equipment; the electronic equipment detects a fourth operation in the second graphical user interface, and the fourth operation acts on the first information; and in response to the third operation, the electronic device sends the first object to the first device.
According to the above implementation, the user can be enabled to select a receiving device among a plurality of devices in a specified direction.
In another possible implementation manner, the first information has a first display effect, and the second information has a second display effect; wherein the first display effect indicates a distance between the first device and the electronic device, and the second display effect indicates a distance between the second device and the electronic device.
According to the implementation mode, the electronic equipment can intuitively prompt the user of the distance between different nearby equipment and the electronic equipment, and the user can select the receiving equipment by referring to the distance.
In another possible implementation form according to the second aspect, the antenna array is a millimeter wave antenna array.
In a third aspect, a method for data sharing is provided, which is applied to an electronic device with an antenna array, and the method includes that the electronic device displays a first graphical user interface, where the first graphical user interface includes a first object; the electronic equipment detects a first operation in the first graphical user interface, wherein the first operation acts on the first object, and the first operation indicates a first direction; in response to the first operation, the electronic device configures the antenna array to receive a first broadcast message sent by a first device in the first direction, and obtains a first identifier from the first broadcast message, wherein the first identifier corresponds to the first device; and according to the first identification, the electronic equipment sends the first object to the first equipment.
According to the technical scheme, the electronic equipment can find the nearby equipment in the direction specified by the user in the data sharing process, the operation steps of sharing content by the user are simplified, the number of the nearby equipment found by the electronic equipment is reduced by using the direction information, and the data sharing efficiency is improved.
According to the third aspect, in a possible implementation manner, in response to the first operation, the electronic device configures the antenna array to send a probe request in the first direction, and after receiving the probe request, the first device sends a probe response to the electronic device, where the electronic device obtains a first identifier from the probe response, and the first identifier corresponds to the first device. Through the implementation, the electronic device discovers the first device in the first direction.
According to the third aspect, in another possible implementation manner, the weight of each antenna in the antenna array is configured by the electronic device according to the posture of the mobile phone and the first direction. Through the implementation mode, when the antenna array is used for finding the equipment in the first direction, the weight of the antenna can be adjusted according to the posture of the mobile phone, and the accuracy of the beam direction is improved.
According to the third aspect, in another possible implementation manner, the first device is the only device discovered by the electronic device in the first direction.
According to the third aspect, in another possible implementation manner, the electronic device configures the antenna array to receive a second broadcast message sent by a second device in the first direction, and obtains a second identifier from the second broadcast message, where the second identifier corresponds to the second device; and the electronic equipment selects the first equipment and sends the first object to the first equipment. According to the implementation mode, the electronic equipment can discover a plurality of equipment in the specified direction and select the candidate receiving equipment from the equipment, and the process of selecting the receiving equipment by a user is simplified.
According to the third aspect, in another possible implementation manner, the selecting is selecting according to a first rule; the first rule is to select the device corresponding to the broadcast message with the strongest signal strength. According to the implementation mode, the electronic equipment can select the equipment with the strongest signal strength from the plurality of equipment in the appointed direction, and the process that the user selects the receiving equipment is simplified.
According to the third aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: in response to the first operation, the electronic device displays a second graphical user interface; the electronic equipment displays first information in the second graphical user interface; wherein the first information is obtained by the electronic device from the first broadcast message; the electronic device detects a second operation in the second graphical user interface; in response to the second operation, the electronic device sends the first object to the first device.
Specifically, the second operation may be clicking the first information, or clicking a confirmation option related to the first information. Through a second graphical user interface, the electronic device displays the discovered nearby devices to the user for selection or confirmation by the user. The first information and the first identifier may be the same or different.
According to the above implementation, the user can be made to confirm the receiving device that is to transmit the data.
According to the third aspect, in one possible implementation, the electronic device further displays second information in the second graphical user interface, where the second information is obtained by the electronic device from the second broadcast message.
Specifically, if the electronic device is triggered to find a nearby device in a specified direction after the first operation, that is, the second device and the first device are both located in the first direction of the electronic device. The second operation may specifically be clicking the first information.
According to the above implementation, the user can be enabled to select a receiving device among a plurality of devices in a specified direction.
According to the third aspect, in a possible implementation manner, the first information and the second information have different display effects, and the different display effects indicate that the signal strengths of the first broadcast message and the second broadcast message are different.
Through the implementation mode, the electronic equipment uses the antenna array to discover nearby equipment in the appointed direction, so that the electronic equipment can only discover the nearby equipment in the direction determined by the user, the number of discovered nearby equipment is reduced, the user can conveniently select receiving equipment, the data sharing efficiency is improved, and the user experience is improved. When the electronic equipment finds a plurality of pieces of equipment in the appointed direction, the electronic equipment can detect the distances between different pieces of equipment and the electronic equipment, so that visual display is performed on a graphical user interface, a user can further select receiving equipment through the distances, and the data sharing efficiency is further improved.
According to the third aspect, in a possible implementation manner, the electronic device detects a third operation on the second graphical user interface, and in response to the third operation, the electronic device updates device information corresponding to other devices that are found in the first direction and are not displayed on the second graphical user interface. Specifically, when only the device information of a part of the devices discovered in the first direction is displayed on the second graphical user interface, for example, only the first information is displayed according to a predetermined rule, or only the device information corresponding to a part of the devices is displayed, and when the electronic device detects the third operation, the electronic device updates and displays the device information corresponding to the other devices discovered in the first direction.
According to the third aspect, in a possible implementation manner, the electronic device detects a fourth operation on the second graphical user interface, and in response to the fourth operation, the electronic device configures the antenna array to receive a third broadcast message sent by a third device in a second direction, obtains a third identifier from the third broadcast message, where the third identifier corresponds to the third device, and updates and displays third information on the second graphical user interface; wherein the third information is obtained by the electronic device from the third broadcast message, the third device being located in the second direction of the electronic device. Specifically, when the second graphical user interface has displayed all the devices found in the first direction, the electronic device updates the device information corresponding to the devices displayed in the second direction when the electronic device detects the fourth operation.
Wherein the first information and the second information have different display effects. The different display effect indicates that the signal strength of the first broadcast message and the second broadcast message is different.
Through the implementation mode, when the electronic equipment discovers the nearby equipment in all directions, the electronic equipment can display the direction information of the equipment on the graphical user interface, so that a user can select the receiving equipment by combining the direction information, the data sharing efficiency is improved, and the user experience is improved. When a plurality of devices are in the same direction, the electronic device can detect the distances between different devices and the electronic device, so that visual display is performed on a graphical user interface, a user can further select a receiving device through the distances, and the data sharing efficiency is further improved.
According to the third aspect, in another possible implementation manner, the antenna array is a millimeter wave antenna array.
In a fourth aspect, a method for data sharing is provided, which may include displaying, by an electronic device, a first graphical user interface in which a first object (e.g., a picture, a document, etc.) is displayed; the electronic device detects a first operation (such as clicking a sharing control) in the first graphical user interface, and responds to the first operation, the electronic device displays a second graphical user interface; the electronic equipment detects a third operation in the second graphical user interface, wherein the third operation indicates a first direction; in response to the third operation, the electronic device sends the first object to the first device; wherein the first device is located in the first direction of the electronic device.
Here, the first graphic user interface may be a user interface of the first application program for displaying the object. The first application may be a "gallery" in which pictures are displayed, and the objects displayed may be pictures. The first application may also be an application that displays a file. Without being limited thereto, the first application program may also be another application program that displays objects such as pictures, documents, characters, and the like.
According to the technical scheme described in the fourth aspect, in the process of data sharing, the electronic device can select the receiving device by combining the direction information, and the efficiency of data sharing is improved.
According to the fourth aspect, in a possible implementation manner, the electronic device displays a plurality of direction options in the second graphical user interface, where the plurality of direction options correspond to a plurality of directions; and the electronic device detects the third operation of the user in the second graphical user interface, the third operation indicating a first direction, further comprising: the third operation is selecting one or more of the direction options, the one or more of the direction options indicating a first direction. According to the implementation mode, the electronic equipment determines the first direction through the direction option selected by the user in the second graphical user interface.
In another possible implementation manner, the third operation is to slide a distance in a designated area of the second graphical user interface, and the electronic device determines a direction of the sliding, and takes the direction of the sliding as the first direction. Through the implementation manner, the electronic equipment determines the first direction through the sliding gesture of the user. According to the implementation manner, the electronic equipment can determine the direction of the receiving equipment through the gesture of the user.
According to a fourth aspect, in one possible implementation, a second object is also displayed in the first graphical user interface; and, prior to the first operation, further comprising: the electronic equipment detects a fourth operation in the first graphical user interface, wherein the fourth operation acts on the first object; in response to the fourth operation, the first object is displayed as being selected. The fourth operation may specifically be a long-press operation on the first object, or a selection operation on a page of the selected object, or the like. According to the fourth operation, when a plurality of objects are displayed on the graphical user interface, the user can select a shared object.
According to a fourth aspect, in one possible implementation, the electronic device detects a fifth operation, and in response to the fifth operation, the electronic device discovers the first device through a short-range wireless communication protocol. The fifth operation may specifically be sliding down on a status bar of the graphical user interface, and clicking a "directional sharing" switch control in a displayed window. Through the step, the electronic equipment can start the discovery process of the nearby equipment in all directions before the user starts to share the data, and the electronic equipment can start the discovery process of the nearby equipment in all directions before the user starts to share the data, so that the response time from data sharing to data sending is shortened.
According to the fourth aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: in response to the third operation, the electronic device discovers the first device through a short-range wireless communication protocol. That is, the electronic device may trigger the discovery process of the nearby devices in all directions by the third operation.
According to the implementation mode, the electronic equipment is only started to directionally share when needed, and power consumption can be saved.
According to a fourth aspect, in a possible implementation form, the electronic device is provided with an antenna array, which the electronic device uses to determine the first direction of the first device. According to the implementation, the electronic device obtains the relative angle of nearby devices.
According to a fourth aspect, in one possible implementation, the first device is the only device in the first direction among nearby devices discovered by the electronic device.
In another possible implementation form according to the fourth aspect, the electronic device discovers a second device, and the electronic device determines that the second device is in the first direction using the antenna array; in response to the first operation, the electronic device selects the first device and sends the first object to the first device.
According to the above implementation, the process of selecting a receiving device by a user is simplified.
In another possible implementation form according to the fourth aspect, the selection is according to a first rule. In particular, if the first rule is to select a nearby device closest to the electronic device, the above implementation further includes the electronic device determining distances between the electronic device and the first device and the second device.
According to the implementation mode, the nearby device closest to the electronic device is selected as the candidate receiving device, and the process of selecting the receiving device by the user is simplified.
According to the fourth aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: the electronic device displays a third graphical user interface; the electronic equipment comprises first information in the third graphical user interface, wherein the first information corresponds to the first equipment; the electronic device detects a sixth operation in the third graphical user interface, and in response to the sixth operation, the electronic device sends the first object to the first device.
According to the above implementation, the user can be made to confirm the receiving device that is to transmit data.
According to the fourth aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: the electronic device displays a fourth graphical user interface; the electronic equipment comprises first information and second information in the fourth graphical user interface, wherein the first information corresponds to the first equipment, and the second information corresponds to the second equipment; the electronic equipment detects a seventh operation in the fourth graphical user interface, wherein the seventh operation acts on the first information; and in response to the seventh operation, the electronic device sends the first object to the first device.
According to the above implementation, the user can be enabled to select a receiving device among a plurality of devices in a specified direction.
In another possible implementation manner, the first information has a first display effect, and the second information has a second display effect; wherein the first display effect indicates a distance between the first device and the electronic device, and the second display effect indicates a distance between the second device and the electronic device.
According to the implementation mode, the electronic equipment can intuitively prompt the user of the distance between different nearby equipment and the electronic equipment, and the user can select the receiving equipment according to the distance
In another possible implementation manner, according to the fourth aspect, the antenna array is a millimeter wave antenna array.
In a fifth aspect, a method for data sharing is provided, which is applied to an electronic device with an antenna array, and the method may include displaying, by the electronic device, a first graphical user interface in which a first object (e.g., a picture, a document, etc.) is displayed; the electronic device detects a first operation (such as clicking a sharing control) in the first graphical user interface, and responds to the first operation, the electronic device displays a second graphical user interface; the electronic device detects a third operation in the second graphical user interface, wherein the third operation indicates a first direction; in response to the third operation, the electronic device configures the antenna array to receive a first broadcast message sent by a first device in the first direction, and obtains a first identifier from the first broadcast message, where the first identifier corresponds to the first device; and according to the first identification, the electronic equipment sends the first object to the first equipment.
Here, the first graphic user interface may be a user interface of the first application program for displaying the object. The first application may be a "gallery" in which pictures are displayed, and the objects displayed may be pictures. The first application may also be an application that displays a file. Without being limited thereto, the first application program may also be another application program that displays objects such as pictures, documents, and characters.
According to the technical scheme, the electronic equipment can select the receiving equipment by combining the direction information in the data sharing process, and the data sharing efficiency is improved.
In a possible implementation manner, in response to the third operation, the electronic device configures the antenna array to send a probe request in the first direction, and after receiving the probe request, the first device sends a probe response to the electronic device, and the electronic device obtains a first identifier from the probe response, where the first identifier corresponds to the first device. Through the implementation manner, the electronic device discovers the first device in the first direction.
According to the fifth aspect, in a possible implementation manner, the electronic device displays a plurality of direction options in the second graphical user interface, where the plurality of direction options correspond to a plurality of directions; and the electronic device detects the third operation of the user in the second graphical user interface, the third operation indicating a first direction, further comprising: the third operation is selecting one or more of the direction options, the one or more of the direction options indicating a first direction. Through the implementation mode, the electronic equipment determines the first direction through the direction option selected by the user in the second graphical user interface.
In another possible implementation manner, the third operation is to slide a distance in a designated area of the second graphical user interface, and the electronic device determines a direction of the sliding, and takes the direction of the sliding as the first direction. Through the implementation manner, the electronic equipment determines the first direction through the sliding gesture of the user.
According to a fifth aspect, in one possible implementation, a second object is also displayed in the first graphical user interface; and, prior to the first operation, further comprising: the electronic equipment detects a fourth operation in the first graphical user interface, wherein the fourth operation acts on the first object; in response to the fourth operation, the first object is displayed as being selected. The fourth operation may specifically be a long press operation on the first object, or a selection operation on a page of the selected object, or the like. According to the fourth operation, when a plurality of objects are displayed in the graphical user interface, the user can select a shared object.
According to the fifth aspect, in another possible implementation manner, the weight of each antenna in the antenna array is configured by the electronic device according to the posture of the mobile phone and the first direction. Through the implementation mode, when the antenna array is used for finding the equipment in the first direction, the weight of the antenna can be adjusted according to the posture of the mobile phone, and the accuracy of the beam direction is improved.
According to the fifth aspect, in another possible implementation manner, the first device is the only device discovered by the electronic device in the first direction.
According to the fifth aspect, in another possible implementation manner, the electronic device configures the antenna array to receive a second broadcast message sent by a second device in the first direction, and obtains a second identifier from the second broadcast message, where the second identifier corresponds to the second device; and the electronic equipment selects the first equipment and sends the first object to the first equipment. According to the implementation mode, the electronic equipment can discover a plurality of equipment in the specified direction and select the candidate receiving equipment from the equipment, and the process of selecting the receiving equipment by a user is simplified.
In another possible implementation form according to the fifth aspect, the selecting is selecting according to a first rule; the first rule is to select the device corresponding to the broadcast message with the strongest signal strength. According to the implementation mode, the electronic equipment can select the equipment with the strongest signal strength from the plurality of equipment in the appointed direction, and the process of selecting the receiving equipment by the user is simplified.
According to the fifth aspect, in another possible implementation manner, before the electronic device sends the first object to the first device, the method further includes: the electronic device displays a third graphical user interface; the electronic device displays first information in the third graphical user interface; wherein the first information is obtained by the electronic device from the first broadcast message; the electronic equipment detects a fifth operation in the third graphical user interface; in response to the fifth operation, the electronic device sends the first object to the first device.
Specifically, the fifth operation may be to click the first information, or click a confirmation option related to the first information. Through a third graphical user interface, the electronic device displays the discovered nearby devices to the user for selection or confirmation by the user. The first information and the first identifier may be the same or different.
According to the above implementation, the user can be made to confirm the receiving device that is to transmit data.
In a possible implementation form according to the fifth aspect, the electronic device further displays second information in the third graphical user interface, wherein the second information is obtained by the electronic device from the second broadcast message.
Specifically, if the electronic device triggers to find a nearby device in a specified direction after the third operation, that is, the second device and the first device are both located in the first direction of the electronic device. The second operation may specifically be clicking the first information.
According to the above implementation, the user can be enabled to select a receiving device among a plurality of devices in a specified direction.
According to the fifth aspect, in a possible implementation manner, the first information and the second information have different display effects, and the different display effects indicate that the signal strengths of the first broadcast message and the second broadcast message are different.
Through the implementation mode, the electronic equipment uses the antenna array to discover nearby equipment in the appointed direction, so that the electronic equipment can discover the nearby equipment only in the direction determined by the user, the number of the discovered nearby equipment is reduced, the user can conveniently select receiving equipment, the data sharing efficiency is improved, and the user experience is improved. When the electronic equipment finds a plurality of pieces of equipment in the appointed direction, the electronic equipment can detect the distances between different pieces of equipment and the electronic equipment, so that visual display is performed on a graphical user interface, a user can further select receiving equipment through the distances, and the data sharing efficiency is further improved.
According to the fifth aspect, in a possible implementation manner, the electronic device detects a sixth operation on the third graphical user interface, and in response to the sixth operation, the electronic device updates device information corresponding to other devices that are found in the first direction and are not displayed on the third graphical user interface. Specifically, when only the device information of a part of the devices discovered in the first direction is displayed on the third graphical user interface, for example, only the first information is displayed according to a predetermined rule, or only the device information corresponding to a part of the devices is displayed, and when the electronic device detects the sixth operation, the electronic device updates and displays the device information corresponding to the other devices discovered in the first direction.
According to the fifth aspect, in a possible implementation manner, the electronic device detects a seventh operation on the third graphical user interface, and in response to the seventh operation, the electronic device configures the antenna array to receive a third broadcast message sent by a third device in a second direction, obtains a third identifier from the third broadcast message, where the third identifier corresponds to the third device, and updates and displays third information on the third graphical user interface; wherein the third information is obtained by the electronic device from the third broadcast message, the third device being located in the second direction of the electronic device. Specifically, when the electronic device detects that the user clicks the second update option, the electronic device updates the device information corresponding to the device displayed in the second direction, when the third graphical user interface has displayed all the devices found in the first direction.
Wherein the first information and the second information have different display effects. The different display effect indicates that the signal strength of the first broadcast message and the second broadcast message is different.
Through the implementation mode, when the electronic equipment discovers the nearby equipment in all directions, the electronic equipment can display the direction information of the equipment on the graphical user interface, so that a user can select the receiving equipment by combining the direction information, the data sharing efficiency is improved, and the user experience is improved. When the plurality of devices are in the same direction, the electronic device can detect the distances between different devices and the electronic device, so that visual display is performed on a graphical user interface, a user can further select a receiving device through the distances, and the data sharing efficiency is further improved.
In another possible implementation form according to the fifth aspect, the antenna array is a millimeter wave antenna array.
In a sixth aspect, there is also provided an electronic device comprising, one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs including instructions for performing the operations of any one of the possible implementations of the first aspect, or any one of the possible implementations of the second aspect, or any one of the possible implementations of the third aspect, or any one of the possible implementations of the fourth aspect, or any one of the possible implementations of the fifth aspect.
A seventh aspect further provides a computer readable medium for storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for performing any one of the possible implementations of the first aspect, or any one of the possible implementations of the second aspect, or any one of the possible implementations of the third aspect, or any one of the possible implementations of the fourth aspect, or any one of the possible implementations of the fifth aspect.
It should be appreciated that the description of technical features, aspects, advantages, or similar language does not imply that all of the features and advantages may be realized in any single embodiment. Rather, it is to be understood that the description of a feature or advantage is intended to include the inclusion of a particular feature, aspect or advantage in at least one embodiment. Thus, descriptions of technical features, technical solutions or advantages in this specification do not necessarily refer to the same embodiment. Furthermore, the technical features, aspects and advantages described in the following embodiments may be combined in any suitable manner. One skilled in the relevant art will recognize that an embodiment may be practiced without one or more of the specific features, aspects, or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments.
Drawings
Fig. 1 is a schematic architecture diagram of a communication system according to an embodiment;
fig. 2A is a schematic diagram of a structure of an electronic device according to an embodiment;
fig. 2B is a schematic diagram of an electronic device with an antenna array according to an embodiment;
fig. 2C is a schematic diagram of a software structure of an electronic device according to an embodiment;
FIG. 3A is a graphical user interface for an application menu on an electronic device provided by an embodiment;
FIG. 3B is a diagram illustrating an embodiment of enabling "directed sharing";
4A-4B provide a graphical user interface for an application gallery on an electronic device according to one embodiment;
FIGS. 5A-5H are graphical user interfaces illustrating a data sharing method according to an embodiment;
6A-6B are graphical user interfaces illustrating a data sharing method according to another embodiment;
FIGS. 7A-7B are graphical user interfaces illustrating a data sharing method according to another embodiment;
fig. 8 is a graphical user interface of a data sharing method according to another embodiment;
fig. 9A-9C are schematic flow diagrams illustrating a data sharing method according to an embodiment;
fig. 10A-10B are schematic diagrams illustrating an embodiment of determining antenna array parameters according to a pose and a sliding direction of a mobile phone.
Detailed Description
The terminology used in the following examples of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of this application and the appended claims, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the listed items.
Embodiments of an electronic device, a graphical user interface for such an electronic device, and for using such an electronic device are presented below. In some embodiments, the electronic device may be a portable electronic device, such as a cell phone, a tablet, a wireless communication enabled device, that also includes other functionality, such as personal digital assistant and/or music player functionalityWearable electronic devices (e.g., smartwatches) capable, and the like. Exemplary embodiments of the portable electronic device include, but are not limited to, a mount
Figure RE-GDA0002518585680000111
Figure RE-GDA0002518585680000112
Or other operating system. The portable electronic device may also be other portable electronic devices such as a Laptop computer (Laptop) with a touch sensitive surface or touch panel, etc. It should also be understood that in other embodiments, the electronic device may not be a portable electronic device, but rather a desktop computer having a touch-sensitive surface or touch panel.
The term "User Interface (UI)" in the specification, claims and drawings of the present application is a medium interface for interaction and information exchange between an application or operating system and a user, and it realizes conversion between an internal form of information and a form acceptable to the user. The user interface of the application program is a source code written by a specific computer language such as java, extensible markup language (XML), and the like, and the interface source code is analyzed and rendered on the terminal device, and finally presented as content that can be recognized by the user, such as a picture, a character, a button, and other controls. Controls, also called widgets, are basic elements of user interfaces, and typically have a toolbar (toolbar), menu bar (menu bar), text box (text box), button (button), scroll bar (scrollbar), picture, and text. The properties and contents of the controls in the interface are defined by tags or nodes, such as XML defining the controls contained by the interface by nodes < Textview >, < ImgView >, < VideoView >, and the like. A node corresponds to a control or attribute in the interface, and the node is displayed as content visible to a user after being parsed and rendered. In addition, many applications, such as hybrid applications (hybrid applications), typically include web pages in their interfaces. A web page, also called a page, can be understood as a special control embedded in an application program interface, the web page is a source code written by a specific computer language, such as hypertext markup language (HTML), cascading Style Sheets (CSS), java scripts (JavaScript, JS), etc., and the web page source code can be loaded and displayed as a content recognizable to a user by a browser or a web page display component similar to a browser function. The specific content contained in the web page is also defined by tags or nodes in the source code of the web page, such as HTML, which defines elements and attributes of the web page by < p >, < img >, < video >, < canvas >.
A commonly used presentation form of the user interface is a Graphical User Interface (GUI), which refers to a user interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
The following embodiments of the application provide a data sharing method, a graphical user interface, an electronic device and a system, so that the electronic device can combine information such as an angle when sharing data with other nearby devices, or share data with nearby devices in a specified direction, and the data sharing efficiency of the electronic device is improved.
In the following embodiments of the present application, the "directional sharing" may be a service or function provided by the electronic device, and may support the electronic device to transmit data to other devices in a specified direction. In some embodiments, "directed sharing" may support the electronic device transmitting data to a nearby device via one or more of bluetooth, wireless fidelity direct (Wi-Fi direct), wi-Fi software access point (software ap), millimeter Wave (mmWave), ultra Wide Band (UWB), and the like. Nearby devices are devices discovered by electronic devices through one or more technologies of Bluetooth, wi-Fi direct (such as Wi-Fi p2 p), wi-Fi softAP and the like, wi-Fi LAN, millimeter wave (mmWave) and Ultra Wide Band (UWB).
It should be understood that "directional sharing" is only a word used in this embodiment, and its representative meaning is described in this embodiment, and its name does not limit this embodiment in any way.
A communication system 10 to which embodiments of the present application relate is described below.
Fig. 1 illustrates a communication system 10 for directed data sharing that implements the present invention. Communication system 10 may include electronic device 100 and one or more nearby electronic devices, such as electronic device 101, electronic device 102, electronic device 103, and so forth. As shown in fig. 1, the electronic device 101 and the electronic device 102 are located in a first direction, i.e., right direction, of the electronic device 100, and the electronic device 103 is located in a second direction, i.e., front left direction, of the electronic device 100.
The electronic device 100 may be a portable electronic device such as a mobile phone and a tablet computer. Specifically, the electronic device 100 may have one or more of a bluetooth module, a WLAN module, a millimeter wave (mmWave) antenna module, and an Ultra Wideband (UWB) antenna module. The electronic device 100 may detect, scan, or directionally detect \ scan devices in the vicinity of the electronic device 100 by transmitting signals through one or more of a bluetooth module, a WLAN module, a millimeter wave (MilliMeterWave) antenna module, and an Ultra Wideband (UWB) antenna module, such that the electronic device 100 may discover or directionally discover nearby devices using one or more short-range wireless communication protocols of bluetooth, WLAN, millimeter wave (mmWave), and Ultra Wideband (UWB), and establish wireless communication connections with the nearby devices, sharing data to the nearby devices through one or more short-range wireless communication protocols of bluetooth, WLAN, millimeter wave (mmWave), and Ultra Wideband (UWB).
The electronic device 101, the electronic device 102, or the electronic device 103 may be an electronic device such as a mobile phone, a tablet computer, or a personal computer having one or more of a bluetooth module, a WLAN module, a millimeter wave (mmWave) antenna module, and an Ultra Wideband (UWB) antenna module, or may be another device such as a printer, a projector, a display, or a speaker having one or more of a bluetooth module, a WLAN module, a millimeter wave (mmWave) antenna module, and an Ultra Wideband (UWB) antenna module.
It is to be understood that the configuration shown in the present embodiment does not constitute a specific limitation to the communication system 10. In other embodiments of the present application, communication system 10 may include more or fewer devices than those shown. For example, communication system 10 may also include an electronic device having one or more of a bluetooth module, a WLAN module, a millimeter wave (mmWave) antenna module, an Ultra Wideband (UWB) antenna module in directions other than the first direction and the second direction.
Fig. 2A shows a schematic structural diagram of the electronic device 100.
The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors. In some embodiments, the electronic device 100 may also include one or more processors 110.
The controller may be, among other things, a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.
A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the electronic device 100.
In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose-input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.
The I2C interface is a bidirectional synchronous serial bus including a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, a charger, a flash, a camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the electronic device 100.
The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus, enabling communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through the I2S interface, so as to implement a function of receiving a call through a bluetooth headset.
The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to implement a function of answering a call through a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.
The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to implement the function of playing music through a bluetooth headset.
MIPI interfaces may be used to connect processor 110 with peripheral devices such as display screen 194, camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the capture functionality of electronic device 100. Processor 110 and display screen 194 communicate via a DSI interface to implement display functions of electronic device 100.
The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, and the like.
The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.
It should be understood that the connection relationship between the modules according to the embodiment of the present invention is only illustrative and is not limited to the structure of the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.
The charging management module 140 is configured to receive a charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.
The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.
The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 150 may provide a solution including wireless communication of 2G/3G/4G/5G, etc. applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.
The fifth generation communication technology (5G) will be commercialized in large scale in 2020, and new communication technologies will bring new requirements to mobile device antennas and base station antennas. The frequency band used in 5G includes a millimeter wave frequency band (mmWave, 30GHz-100 GHz). Therefore, in order to be able to support millimeter wave communication, a terminal supporting 5G communication is provided with a millimeter wave antenna. Compared with the traditional microwave frequency band, in the process of millimeter wave signal propagation, the signal propagation is similar to ray propagation, namely, a direct path and a reflection path are mainly used, no obvious scattering and diffraction phenomena exist, the signal can propagate on a plurality of spatially discrete paths, and the number of effective paths is very rare. On a channel lacking scattering such as millimeter waves, diversity gain can be obtained by means of space division multiplexing (for example, MU-MIMO technology), thereby significantly improving the quality of signals.
The millimeter wave signal wavelength is short, the shorter the length of the antenna. Based on the requirement of transmission rate, the 5G terminal may have a plurality of millimeter wave antenna modules. Fig. 2B illustrates an electronic terminal having an array of millimeter wave antennas, which may be the electronic terminal 100 of fig. 1. In fig. 2B, the electronic terminal 100 has 8 antennas, and the 8 antennas form an antenna array, that is, two or more than two single antennas operating at the same frequency are fed and spatially arranged to form an antenna array, so that the 5G terminal has a beam forming capability, that is, by adjusting the weight of each antenna module, the multiple antennas are coherent and cancelled on the waveform, a lobe pattern with a null point and a maximum pointing direction is formed, and the phased antenna array has the capability of transmitting or receiving signals in a specific direction. The multiple antennas on the electronic device may be laid out in a uniform linear array, a circular array, a rectangular array, etc.
Currently, 5G millimeter wave antenna arrays are generally based on phased arrays. The specific implementation manners can be classified into AoB (Antenna on Board), i.e., the Antenna array is located on the system motherboard, aiP (Antenna in Package), i.e., the Antenna array is located in the Package of the chip, and AiM (Antenna in Module), i.e., the Antenna array and the RFIC form a Module.
In order to achieve wider spatial coverage, the millimeter wave antenna array is usually designed by matching antenna types with complementary radiation beams (such as broadside radiation and end-fire radiation), such as patch antenna (patch antenna) and Quasi-Yagi antenna (Quasi-Yagi antenna), and the antenna feed point is properly designed to achieve dual polarization coverage, thereby greatly improving the range and coverage rate of millimeter wave signals.
The antenna 2 may also have two or more antennas operating at the same frequency and form an antenna array.
The invention is suitable for electronic terminals with antenna arrays, in particular to electronic terminals with millimeter wave antenna arrays.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.
The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), ultra Wideband (UWB), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, performs frequency modulation and filtering on electromagnetic wave signals, and transmits the processed signals to the processor 110. Wireless communication module 160 may also receive signals to be transmitted from processor 110, frequency modulate them, amplify them, and convert them into electromagnetic waves via an antenna for radiation. Illustratively, the wireless communication module 160 may include a Bluetooth module, a Wi-Fi module, and the like.
In some embodiments, a portion of the antenna of the electronic device 100 is coupled to the mobile communication module 150 and another portion of the antenna is coupled to the wireless communication module 160 such that the electronic device 100 can communicate with networks and other devices via wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), millimeter wave (mmWave), BT, GNSS, WLAN, NFC, FM, UWB, and/or IR technology, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).
In some embodiments, a Bluetooth (BT) module or a WLAN module included in the wireless communication module 160 may transmit a signal to detect or scan devices near the electronic device 100, so that the electronic device 100 may discover the nearby devices using wireless communication technologies such as bluetooth or WLAN, establish a wireless communication connection with the nearby devices, and share data to the nearby devices through the connection. Among other things, a Bluetooth (BT) module may provide solutions that include one or more of classic Bluetooth or Bluetooth Low Energy (BLE) Bluetooth communication. The WLAN module may provide solutions that include one or more of Wi-Fi direct, wi-Fi LAN, or Wi-Fi softAP WLAN communications.
In some embodiments, a millimeter wave (mmWave) module included in mobile communication module 150 may transmit or receive a signal in a specified direction to detect or scan nearby devices of electronic device 100 in the specified direction, so that electronic device 100 may discover the nearby devices in the specified direction using a mobile communication technology such as millimeter waves, and establish a mobile communication connection or a wireless communication connection such as WLAN direct connection with the nearby devices, and share data to the nearby devices through the above-mentioned connection.
The electronic device 100 may implement display functions via the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute instructions to generate or change display information.
The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.
The electronic device 100 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display 194, the application processor, and the like.
The ISP is used to process the data fed back by the camera 193. For example, when a user takes a picture, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, an optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and converting into an image visible to the naked eye. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.
The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.
The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.
Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) -1, MPEG-2, MPEG-3, MPEG-4, and so on.
The NPU is a neural-network (NN) computing processor, which processes input information quickly by referring to a biological neural network structure, for example, by referring to a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, data such as music, photos, video, etc. are stored in an external memory card.
Internal memory 121 may be used to store one or more computer programs, which include instructions. The processor 110 may execute the above-mentioned instructions stored in the internal memory 121, so as to enable the electronic device 100 to perform the data sharing method provided in some embodiments of the present application, and various functional applications and data processing. The internal memory 121 may include a program storage area and a data storage area. Wherein, the storage program area can store an operating system; the storage program area may also store one or more application programs (e.g., a gallery, contacts, etc.), and the like. The storage data area may store data (e.g., photos, contacts, etc.) created during use of the electronic device 100. In addition, the internal memory 121 may include a high speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a Universal Flash Storage (UFS), and the like.
The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.
The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The electronic apparatus 100 can listen to music through the speaker 170A or listen to a handsfree call.
The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into a sound signal. When the electronic apparatus 100 receives a call or voice information, it is possible to receive voice by placing the receiver 170B close to the human ear.
The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.
The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a variety of types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic apparatus 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.
The gyro sensor 180B may be used to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects a shake angle of the electronic device 100, calculates a distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the electronic device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.
The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure values measured by barometric pressure sensor 180C to assist in positioning and navigation.
The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.
The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. The method can also be used for recognizing the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.
A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, taking a picture of a scene, electronic device 100 may utilize range sensor 180F to range for fast focus.
The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there are no objects near the electronic device 100. The electronic device 100 can utilize the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 180G can also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.
The ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 may adaptively adjust the brightness of display screen 194 based on the perceived ambient light level. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, answer an incoming call with the fingerprint, and so on.
The temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 implements a temperature processing strategy using the temperature detected by temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 performs a reduction in performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the electronic device 100 heats the battery 142 when the temperature is below another threshold to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than a further threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.
Touch sensor 180K, which may also be referred to as a touch panel or touch sensitive surface. The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided via the display screen 194. In other embodiments, the touch sensor 180K may be disposed on a surface of the electronic device 100, different from the position of the display screen 194.
The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, the bone conduction sensor 180M may acquire a vibration signal of the human vocal part vibrating the bone mass. The bone conduction sensor 180M may also contact the human pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 180M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 170 may analyze a voice signal based on the vibration signal of the bone mass vibrated by the sound part acquired by the bone conduction sensor 180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.
The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The electronic apparatus 100 may receive a key input, and generate a key signal input related to user setting and function control of the electronic apparatus 100.
The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration prompts as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.
Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.
The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic apparatus 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 195 can be inserted with multiple cards at the same time. The types of the plurality of cards can be the same or different. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the electronic device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
The electronic device 100 exemplarily illustrated in fig. 2A may display various graphical user interfaces described in various embodiments below via the display screen 194. The electronic device 100 may detect a touch operation in each graphical user interface through the touch sensor 180K, such as a click operation in each graphical user interface (e.g., a touch operation on an icon, a double-click operation), an upward or downward sliding operation in each graphical user interface, or an operation of performing a circle-drawing gesture, and so on. In some embodiments, the electronic device 100 may detect a motion gesture performed by the user holding the electronic device 100, such as shaking the electronic device, through the gyroscope sensor 180B, the acceleration sensor 180E, and so on. In some embodiments, the electronic device 100 may detect non-touch gesture operations through the camera 193 (e.g., 3D camera, depth camera).
The software system of the electronic device 100 may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention uses an Android system with a hierarchical architecture as an example to exemplarily explain a software structure of the electronic device 100.
Fig. 2C is a block diagram of the software structure of the electronic device 100 according to the embodiment of the present invention.
The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.
The application layer may include a series of application packages.
As shown in fig. 2C, the application package may include camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc. applications.
The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.
As shown in FIG. 2C, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.
The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.
The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
The phone manager is used to provide communication functions of the electronic device 100. Such as management of call status (including on, off, etc.).
The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.
The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scrollbar text in a status bar at the top of the system, such as a notification of a running application in the background, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.
The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.
The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application layer and the application framework layer as binary files. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.
The system library may include a plurality of functional modules. For example: surface managers (surface managers), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), and the like.
The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like.
The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.
The 2D graphics engine is a drawing engine for 2D drawing.
The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
The software system shown in fig. 2C involves application rendering (e.g., gallery, file management) using sharing capabilities, a directed sharing module providing sharing capabilities, and an application framework layer providing WLAN services, bluetooth services, and a kernel and underlying layer providing WLAN bluetooth capabilities and basic communication protocols.
The following describes exemplary workflow of the software and hardware of the electronic device 100 in connection with capturing a photo scene.
When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, a time stamp of the touch operation, and other information). The raw input events are stored at the kernel layer. And the application program framework layer acquires the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch operation, and taking the control corresponding to the touch operation as a control of a camera application icon as an example, the camera application calls an interface of the application framework layer to start the camera application, and then starts the camera drive by calling the kernel layer, and captures a still image or a video through the camera 193.
An exemplary graphical user interface for an application menu on electronic device 100 is described below.
FIG. 3A illustrates an exemplary graphical user interface for an application menu on electronic device 100.
The graphical user interface may include: a status bar 21, a tray 22 with frequently used application icons, a calendar indicator 240, a weather indicator 241, a navigation bar 23, and other application icons. Wherein:
the status bar 21 may include: one or more signal strength indicators 211, battery status indicators 212, and time indicators 213 of mobile communication signals (which may also be referred to as cellular signals).
Calendar indicator 240 may be used to indicate the current time, such as the date, day of the week, time division information, and the like.
The weather indicator 241 may be used to indicate a weather type, such as cloudy sunny, light rain, etc., and may also be used to indicate information such as temperature, etc.
The tray 22 with the common application icons may show: phone icon 221, contact icon 222, text message icon 223, camera icon 224.
The navigation bar 23 may include: a return button 231, a Home screen button 232, a task button 233, and other system navigation keys. When it is monitored that the user clicks the return button 231, the electronic apparatus 100 may display a page previous to the current page. When it is monitored that the user clicks the home interface button 232, the electronic device 100 may display the home interface. When it is monitored that the user clicks the task button 233, the electronic apparatus 100 may display a task that the user has recently opened. The names of the navigation keys can be other keys, and the application does not limit the names. Not limited to virtual keys, each navigation key in the navigation bar 23 may also be implemented as a physical key.
Other application icons may be, for example: icon 242 of Wechat (Wechat), icon 243 of QQ, icon 244 of Twitter (Twitter), icon 245 of Facebook (Facebook), icon 246 of mailbox, icon 247 of cloud sharing, icon 248 of memo, icon 249 of file management, icon 250 of gallery, icon 251 of setting. The graphical user interface may also include a page indicator 252. Other application icons may be distributed across multiple pages and page indicator 252 may be used to indicate which page the user is currently browsing for applications in. The user can slide the area of the other application icons side-to-side to browse the application icons in the other pages.
In some embodiments, the graphical user interface exemplarily shown in fig. 3A may be a Home screen (hoscreen).
In other embodiments, electronic device 100 may also include a home screen key. The home screen key may be a physical key or a virtual key. The home screen key may be used to receive a user's instruction to return the currently displayed UI to the home interface, which may facilitate the user to view the home screen at any time. The instruction may be an operation instruction for the user to press the home screen key once, an operation instruction for the user to press the home screen key twice in a short time, or an operation instruction for the user to press the home screen key for a long time. In other embodiments of the present application, the home screen key may also incorporate a fingerprint recognizer for fingerprint acquisition and recognition therewith when the home screen key is pressed.
It is understood that fig. 3A is only an exemplary illustration of a graphical user interface on the electronic device 100 and should not be construed as a limitation of the embodiments of the present application.
Fig. 3B illustrates an operation of turning on "directed sharing" on the electronic device 100.
As shown in fig. 3B, when a slide-down gesture on status bar 21 is detected, in response to the gesture, electronic device 100 may display window 26 on the graphical user interface, and may display "directional sharing" switch control 261 in window 26, and may also display switch controls for other functions (e.g., wi-Fi, bluetooth, flashlight, etc.). When an operation on switch control 261 in window 26 is detected (e.g., a touch operation on switch control 261), in response to the operation, electronic device 100 may turn on "directional sharing".
That is, the user may make a downward sliding gesture at status bar 21 to open window 26, and may click on "directed share" switch control 261 in window 26 to conveniently turn on "directed share".
The "directional sharing" is not limited to be started in the window 26, and the user may start the "directional sharing" again when selecting data (such as pictures, documents, and the like) for sharing.
Some embodiments of application scenarios to which the present application relates and graphical user interfaces implemented on the electronic device 100 are described below, respectively.
FIG. 4A illustrates a graphical user interface 40 displayed for selection of the "gallery" application in FIG. 3A. The gallery is an application program for managing pictures on electronic devices such as a smart phone and a tablet computer, and may also be called an album. The application program can support various operations, such as browsing, editing, deleting, selecting and the like, of the pictures stored on the electronic equipment by the user. I.e., the "gallery" managed object is a picture. In other cases, the application program may also support the user to perform the above operations on the pictures stored on the cloud server. It is understood that in this embodiment, the picture may be captured by the electronic device using the camera 193, or may be obtained from another application program or downloaded from a web page.
As shown in fig. 4A, the graphical user interface 40 may include: status bar 41, application title bar 42, picture area 43, navigation bar 44. Wherein:
the status bar 41 can refer to the status bar 21 in the graphical user interface 20 shown in fig. 3A, and will not be described in detail here.
The application title bar 42 may include: a return key 421, and a current page indicator 422. The return key 421 may be used to return to a level above the menu. It will be appreciated by those skilled in the art that the logical upper level of a page is fixed and is determined at the time of application design. The current page indicator 422 may be used to indicate a current page, such as the text information "gallery," not limited to text information, but the current page indicator 422 may also be an icon.
One or more pictures, such as picture 431, may be displayed in picture area 43. When the electronic device listens to a swipe operation in the picture area 43 in the upward or downward direction, the electronic device may update the picture displayed in the picture area 43 in response to the swipe operation, so that the user can browse the picture. That is, the user may slide up or down in the picture area 43 to view more pictures. Not limited to the sliding operation up or down, the user may also slide left or right in the picture area 43 to browse more pictures. The picture 431 may be a thumbnail. At this time, the original image corresponding to the picture 431 may be stored on the electronic device, or may be stored on the cloud server. Unless otherwise stated, the pictures referred to in the following embodiments may be stored in the electronic device, or may be stored on the cloud server.
The navigation bar 44 may refer to the navigation bar 23 in the graphical user interface 20 shown in fig. 3A, and will not be described in detail here.
Fig. 4B illustrates an embodiment in which a user shares pictures in a "gallery". As shown in fig. 4B, the electronic device may monitor the operation of the user selecting the picture 431 or the picture 432 to share in the graphical user interface 40. When the electronic device listens for an operation of selecting one or more pictures in the graphic user interface 31 on which one or more pictures are displayed, the electronic device may display a menu 45 in the graphic user interface 40. In some embodiments, the electronic device may also display a marker 433 on the selected picture 431, 432. Marker 433 may indicate that a picture has been selected by the user. In some embodiments, the electronic device may also initially display the menu 45 in the graphical user interface 40, i.e., the menu 45 is not displayed until the user is not required to listen to a picture selection. The menu 45 may include, among other things, controls 451 ("share"), controls 452 ("move"), controls 453 ("select all"), and buttons 454 ("more"). Control 451 may be used for sharing a selected picture by a user, control 452 may be used for monitoring an operation of moving the selected picture to another storage path, control 453 may be used for selecting all pictures in the gallery, and button 454 may be used for monitoring an operation of opening a next-level menu, thereby providing more functions, such as renaming, picture editing, and the like.
In other embodiments, the control 451 may display the textual information "directional sharing," which when monitored by the electronic device by the user triggers an update of the graphical user interface 40, directing the user to select or indicate the orientation of the receiving device.
Not limited to the operation of first selecting one or more pictures and then clicking on the control 451, the operation may also take other forms, such as selecting a picture first and then performing a circle gesture in the picture area, and selecting a picture within a fixed time (e.g., 1 second) after shaking the electronic device. The operation may also be a voice control operation, i.e., the user may speak a voice command to share the picture. The method and the device do not limit the specific implementation of the operation of sharing the selected pictures.
Not limited to pictures in the "gallery," the scene in which the user shares pictures may also include pictures in other applications, such as file management, shared by the user. In addition, the pictures shared by the user can also include the pictures shared by the user on the cloud server.
The graphical user interface 50 illustrated in fig. 5A-5H may be one implementation of a "directed sharing interface".
FIG. 5A illustrates the graphical user interface 50 displayed for selection of control 451 ("share") in FIG. 4B. As shown in fig. 5A, the graphical user interface 50 may include a region 51, a region 52, and a region 53. Wherein: region 51 may be used to display one or more pictures in the gallery, which may include a picture selected by the user, such as selected picture 511, selected picture 512. In some embodiments, the selected pictures 511 and 512 may have marks 513 displayed thereon, and the marks 513 may indicate that the corresponding pictures 511 and 512 are selected by the electronic device (i.e., the pictures are selected by the user). In other embodiments, a control 514 and a control 515 may be displayed in the area 51, and the two controls may be used to switch or update the picture displayed in the area 51. Not limited to the above-mentioned controls, other interactive elements may be displayed in the area 51 for switching or updating the pictures displayed in the area 51. In other embodiments, the electronic device may not display the above-mentioned controls 514 and 515 in the area 51, but the user may make a slide gesture to the left or right in the area 51 to switch or update the picture. The pictures 511, 512 may be thumbnails. The original image corresponding to the picture displayed in the area 51 may be a picture stored on the electronic device, or may be stored on a cloud server.
One or more options (e.g., icons 531) may be displayed in area 53. The application program or protocol corresponding to the option can support sharing the picture selected by the user to the contact or the server. In some embodiments, in response to a monitored operation on the option in the area 53 (e.g., a touch operation on the icon 531), the electronic device may trigger a process of sharing the selected picture to the cloud contact or the server through the application or the protocol corresponding to the option, where the process may include: the electronic equipment opens the application program or the protocol, displays the graphical user interface of the electronic equipment, monitors the data sharing operation of the user in the graphical user interface, responds to the operation, and shares the selected picture to the cloud contact or the server through the application program or the protocol. That is, the user may share data through the application program or the protocol corresponding to the option. For example, sharing the selected photo to one or more contacts of the WeChat, and for example, sharing the selected photo to a dynamic publishing platform (i.e., a server) of the facebook.
In other embodiments, a page indicator 532 may also be displayed in area 53. When there are more options to be displayed in the area 53, these options may be displayed on multiple pages. Page indicator 532 may indicate the page on which the currently displayed option is located.
Area 52 may be used to guide the user in opening targeted sharing. The following describes specific implementations of the region 52 in several cases:
in the case that "directional sharing" is not turned on, as shown in fig. 5A, an icon 521 may be displayed in the area 52, and a prompt message 522 may also be displayed. Icon 521 may be used to listen for an operation to turn on "directed sharing". Prompt 522 may prompt the user to turn on "directed sharing" by clicking on icon 521. In response to this operation, the electronic device updates the areas 52 and 53, the updated graphical user interface being as shown in fig. 5B or 5C. The electronic device listens in the updated graphical user interface 50 for a user selection or indication of the orientation of the receiving device. In some other embodiments, after the user starts "directional sharing" by clicking the icon 521, in response to the operation, the electronic device triggers discovery of nearby devices in all directions, and displays device information corresponding to the discovered nearby devices in the updated graphical user interface, and the graphical user interface is updated as shown in fig. 5D. The prompt 522 may be a text message such as "click here to open directed sharing" or the like. The prompt message 522 may also be in other forms such as a picture, a link, a dynamic picture, and the like, which is not limited in this embodiment. In other embodiments, the prompt 522 in the graphical user interface may not be displayed on the touch screen, but may be audio played through the speaker 170A.
It is understood that in some other embodiments, not limited to the icon 521, the electronic device may also listen to the operation of turning on "directed sharing" through another form of Interactive Element (IE). Illustratively, some or all of the prompt 522 may also be used to receive an operation to turn on "directed sharing". For example, prompting message 522 "click part of the text" click here "in" turn on oriented sharing "may be used to receive an operation to turn on" oriented sharing ".
In other embodiments, control 451 is "directed sharing" in graphical user interface 40 as shown in fig. 4B, and in response to this operation, the electronic device may turn "directed sharing" on when it listens to the user clicking on control 451 ("directed sharing"), and update graphical user interface 40 as shown in fig. 5B or 5C, and listen to the user's selection or indication of the orientation of the receiving device in updated graphical user interface 50. In some other embodiments, when the user turns on "directional sharing" by clicking on the control 451 ("directional sharing"), in response to the operation, the electronic device triggers discovery of nearby devices in all directions, and displays device information corresponding to the discovered nearby devices in an updated graphical user interface, which is updated as shown in fig. 5D.
Fig. 5B and 5C illustrate a graphical user interface by which the electronic device guides a user to select or indicate the orientation of the receiving device in response to turning on "directional sharing".
After the user initiates "directed sharing," the electronic device may update region 52 and region 53 in graphical user interface 50, as shown in fig. 5B. An icon 521 and a prompt message 523 can be displayed in the updated area 52. Wherein the appearance (e.g., color, grayscale, etc.) of the icon 521 in fig. 5B may be different from the icon 521 in fig. 5A to indicate that "directed sharing" has been turned on. The prompt information 523 may be text information, such as "please select the direction of the receiving apparatus" or the like, for prompting the user to operate in the area 53 to select the direction of the receiving apparatus.
In the updated area 53, an icon 533 may be displayed for listening to the user's selection of the orientation of the receiving device. Wherein the icon 533 may include regions 5331-5334 indicating that the electronic device may find nearby devices in the 4 directions indicated by the regions 5331-5334, wherein the region 5331 indicates an angular range of 45 ° to 135 ° counterclockwise with respect to the horizontal direction, i.e., the front of the electronic device, the region 5332 indicates an angular range of 45 ° to 45 ° counterclockwise clockwise with respect to the horizontal direction, i.e., the right of the electronic device, the region 5333 indicates an angular range of 45 ° to 135 ° clockwise with respect to the horizontal direction, i.e., the rear of the electronic device, and the region 5334 indicates an angular range of 135 ° to 225 ° clockwise with respect to the horizontal direction, i.e., the left of the electronic device. As shown in fig. 5B, when the electronic device hears an operation (e.g., a tap, slide, press, or press) on one or more regions of icon 533, in response to the operation, the appearance (e.g., color, grayscale, etc.) of the selected region may be different from that before selection, and the electronic device triggers the discovery of nearby devices within the angle range corresponding to the selected region. For example, in response to an operation of clicking on the area 5332, the electronic device triggers discovery of a nearby device to the right thereof; as another example, in response to a sliding operation in the region 5331 and the region 5332, the electronic apparatus triggers discovery of nearby apparatuses in the front and right. In some other embodiments, the number of the regions in the icon 533 may be any natural number greater than or equal to 2, and the angle range may also be different, such as only indicating the 180-degree range, and the icon 533 is not limited to the form shown in fig. 5B, such as may be in other shapes, such as connected or separated rectangles, triangles, and the like, and may also be in the form of characters, pictures, dynamic pictures, or links representing directions, which is not limited in this embodiment.
In other embodiments, the electronic device indicates the direction of the receiving device by receiving a user gesture. After the user initiates "directed sharing," the electronic device may update region 52 and region 53, as shown in fig. 5C. An icon 521 and a prompt 524 may be displayed in the updated area 52. Wherein the appearance (e.g., color, grayscale, etc.) of the icon 521 in fig. 5C may be different from the icon 521 in fig. 5A to indicate that "directed sharing" has been turned on. Prompt 524 may be a text message, such as "please gesture the direction of the receiving device," etc., for prompting the user to gesture the direction of the receiving device in area 53.
In the updated area 53, the user can continuously slide in a certain direction by a distance L from any point in the area, where the distance L is greater than a predetermined length so that the electronic device can recognize and determine the direction of the sliding. The electronic device may determine the contact positions at the start and end of the swipe and determine the swipe direction based on the contact positions at the start and end of the swipe. For example, when the user slides a distance in a direction counterclockwise by 60 ° with respect to the horizontal direction from an arbitrary point in the area 53, the operation of the electronic apparatus 100 to find a nearby apparatus in the receiving apparatus direction corresponding to the direction is triggered. In other embodiments, the area in which the electronic device listens for user input gestures is not limited to area 53. In addition, the electronic device may also determine the sliding direction by recording the sliding track, and the like, which is not limited in this embodiment.
It will be appreciated that the regions 51, 52 and 53 are merely illustrative and do not represent actual sizes.
In some embodiments, when "orientation sharing" is not turned on, the user clicks control 451 in graphical user interface 40 as shown in fig. 4B ("orientation sharing") or the user clicks control 521 in graphical user interface 40 as shown in fig. 5A, in response to which the electronic device triggers discovery of nearby devices in all directions and determines the relative location of the discovered nearby devices to the electronic device, which displays device information corresponding to the discovered nearby devices in the updated graphical user interface. In other embodiments, such as the user having initiated directed sharing in the graphical user interface shown in fig. 3B, in response to which the electronic device triggers discovery of nearby devices in all directions and determination of the relative location of the discovered nearby devices to the electronic device, the electronic device may update the graphical user interface to that shown in fig. 5D to display the nearby devices discovered by the electronic device when the user clicks control 451 in the graphical user interface 40 shown in fig. 4B ("directed sharing") or the user clicks control 521 in the graphical user interface 40 shown in fig. 5A. FIG. 5D illustrates a graphical user interface for an electronic device displaying a nearby device and its relative position to the electronic device. The relative position may include an angle of arrival (AoA) of the nearby device, and may also include position information such as a distance between the nearby device and the electronic device.
After "directed sharing" is turned on, if the electronic device finds a nearby device and determines its relative position to the electronic device after a period of time, the electronic device may update areas 52 and 53, as shown in fig. 5D, and updated area 52 may display icon 521 and prompt message 525. Wherein the appearance (e.g., color, grayscale, etc.) of the icon 521 in fig. 5D may be different from the icon 521 in fig. 5A to indicate that "directed sharing" has been turned on. The prompt 525 may be a text message, such as "please select the receiving device" or the like, for prompting the user to select the receiving device in the area 53.
In the updated area 53, several pieces of device information and their relative positions to the electronic device may be displayed. As shown in FIG. 5D, a coordinate system 534 can be displayed on the graphical user interface 50, which can include a center point 5341 and a horizontal axis 5342 and a vertical axis 5343. The central point 5341 may represent the electronic device, the horizontal axis 5342 may represent the left-right direction with respect to the electronic device, and the vertical axis 5343 may represent the front-back direction with respect to the electronic device. In addition, the graphical user interface 50 may also display device information for discovered nearby devices. For example, as shown in FIG. 5D, icons 535, 536, 537, 538, and 539 are included in the graphical user interface 50, wherein the icons 535-539 represent nearby devices discovered by the electronic device and display device information corresponding to the nearby devices. Among them, icons 534, 535, and 537 display device information "huaboei P30", and icons 536 and 538 display device information "huaboei Mate30". Further, as shown in fig. 5D, the position of the different icon indicates the relative position of its corresponding nearby device and the electronic device. For example, the icon 536 is located in the right horizontal direction of the center point 5341, which indicates that the nearby device corresponding to the device information "HUAWEI i P30" is located on the right side of the electronic device. Further, the distance of the icon from the center point 5341 indicates the distance of its corresponding nearby device from the electronic device, and the closer the icon is from the center point, the closer the corresponding nearby device is from the electronic device. It will be appreciated that icons 535-539 may also take other forms, such as numbers or other information customized by the user of the device. In other embodiments, icons closer to the center point may have a different display effect than icons further from the center point, e.g., icons closer to the center point may differ in appearance (e.g., icon size, color, etc.) from icons further from the center point.
Icons 535-539 may be used to listen to user selection of a receiving device on graphical user interface 50. For example, as shown in fig. 5D, when the user clicks the icon 536, the electronic device is triggered to establish a communication connection with a nearby device located on the right side of the electronic device and having device information "huamei P30", and the selected picture is sent to the nearby device after the communication connection is established.
In other embodiments, the area displaying the discovered device information of the nearby device and the relative location of the nearby device to the electronic device is not limited to the area 53 as shown in fig. 5D: the electronic device may display device information of the nearby devices that have been found and the relative positions of the nearby devices and the electronic device on the entire screen display area. The electronic device may also display device information of discovered nearby devices and the relative positions of the nearby devices and the electronic device in an edge area of the screen. For example, when a nearby device is found to be located directly in front of the electronic device, the electronic device displays its device information at a position close to the upper edge of the screen. The present embodiment does not set any limit to this.
It will be appreciated that the electronic device may take other forms to display the device information and its relative location information. For example, the electronic device may display the relative position of the device information while displaying the device information in a list or the like. Further, the electronic device may indicate the distance of the nearby device from the electronic device by sequencing or different display effects. For example, the display order of the device information corresponding to a nearby device closer to the electronic device is advanced, or the display effect of the device information corresponding to a device closer to the electronic device is different from that of the device information corresponding to a device farther from the electronic device, and the device information is different in appearance (e.g., icon size, color, etc.).
In other embodiments, in response to a user selecting or gesturing an operation to receive device orientation in the graphical user interface 50 as shown in fig. 5B or 5C, the electronic device may update the graphical user interface as shown in fig. 5D, find nearby devices in all orientations displayed in the graphical user interface 50 as shown in fig. 5D, and display different display effects on device information in the orientation of the receiving device in the graphical user interface 50 as shown in fig. 5D. For example, device information in the direction of the receiving device differs in appearance (e.g., icon size, color, etc.) from device information in other directions. If the device information of the nearby devices is displayed in a list or the like, the device information corresponding to the nearby devices in the receiving device direction may be displayed in a forward order, or may have a different display effect from the device information in the other directions.
In other embodiments, a text message may also be displayed on the graphical user interface 50 as shown in FIG. 5D, which prompts the user to turn the handset so that the receiving device is positioned directly in front of the handset. The position of the icon on the graphical user interface changes accordingly in the process that the user rotates the mobile phone. When the receiving device is positioned directly in front of the handset, its corresponding icon is positioned above on the graphical user interface 50. The electronic device can display other modes such as graphics (arrows), animation and the like or prompt by voice without being limited to text information.
In other embodiments, in response to a user selecting or gesturing an operation in the graphical user interface 50 as shown in fig. 5B or 5C to indicate a direction of the receiving device, the electronic device may trigger discovery of a nearby device in the indicated direction, updating the graphical user interface to display results of discovering the nearby device for different situations. 5E-5G illustrate graphical user interfaces of an electronic device displaying nearby devices found in the indicated direction in different situations.
If, over time, the electronic device finds a nearby device in the indicated direction, the electronic device may update the areas 52 and 53 in the graphical user interface 50. As shown in fig. 5E, device information (e.g., icons, text, etc.) of nearby devices found by the electronic device in the direction indicated by the user, such as icons 525, 526, and 527, may be displayed in the updated area 52, and the device information of the nearby devices may be sorted according to a predetermined sorting rule. In some embodiments, the predetermined ordering rule may be based on the proximity of the nearby device to the electronic device. For example, as shown in fig. 5E, three pieces of device information are displayed in the area 52, which sequentially indicate that the nearby devices corresponding to the three pieces of device information in the drawing are at a distance "mobile phone of MAC" < "tablet of Cindy" < "notebook of Jack" from the electronic device. Further, in other embodiments, different device information may have different display effects in area 52. For example, the icon "MAC handset" may be different in appearance (e.g., color, size, etc.) from other icons to indicate that the nearby device to which the icon corresponds is closest to the electronic device or that the signal strength from the nearby device is highest. Further, the updated region 53 is the same as the region 53 in fig. 5A. In other embodiments, the predetermined ordering rule may be other rules such as the initial order of device IDs, which is not limited in this embodiment.
It will be appreciated that the device information may also take other forms, such as the text information "printer", without being limited to icons. In addition, the device information may also include an account number of a user using the device, for example, as shown in fig. 5E, "MAC" in the text information "mobile phone of MAC" is the user account number, "Cindy" in "tablet of Cindy" is the user account number, "Jack" in "notebook of Jack" is the user account number. In other embodiments, the device information may also be a model of the user equipment or other custom information, such as "huabei P30" or the like.
The device information (e.g., icons 525-527) displayed in area 52 may be used to listen for operations that trigger sharing. In response to a monitored operation on the device information (e.g., a tap operation on icon 525, etc.), the electronic device may trigger sharing of the selected picture to a nearby device selected by the operation.
In some embodiments, controls 528 and/or controls 529 may also be displayed in area 52. Control 528 and/or control 529 can be used to toggle or update device information displayed in area 52 so that more discovered nearby devices can be viewed. Not limited to the above-described controls, other interactive elements may also be used for the device information displayed in the user switching area 52. In other cases, the user may also make a swipe gesture to the left or right in region 52 to toggle or update the device information displayed in region 52.
In other embodiments, the electronic device may automatically update the information in the area 52, and the updated area 52 may display device information corresponding to the nearby device currently found by the electronic device in the indicated direction. Device information corresponding to nearby devices that the electronic device has discovered but cannot currently discover may no longer be displayed in area 52, and in addition, device information corresponding to nearby devices that the electronic device has newly discovered in the indicated direction may be displayed in area 52. In other cases, the area 52 may also display an update control (e.g., "manual update") for a user to manually update device information corresponding to a currently discovered nearby device.
In other embodiments, the area 52 may display another update control (e.g., "other recommendations") for updating the device information corresponding to nearby devices found in other directions displayed by the area 52. The user may also trigger the update of the device information through a specific gesture operation, such as a left-slide or right-slide operation. In some cases, the other direction may be a predetermined angular range adjacent to the indicated direction, for example, a 30 ° angular range adjacent to the indicated direction.
In other embodiments, as shown in fig. 5E, operation prompt information corresponding to the device information may also be displayed in the area 52. The operation prompt message can be used for prompting a user what kind of operation can trigger the electronic device to share data to a nearby device corresponding to the device message. For example, a text message "click to send" displayed under the user icon 525 may prompt the user to click on the icon 525 to trigger the operation of sharing the selected picture to the nearby device "cell phone of MAC".
The above examples are merely some implementations provided by the present embodiment and should not be construed as limiting. The operation prompting information corresponding to the device information can also prompt the user to trigger the electronic device to share data with the nearby device corresponding to the device information through other forms of operations. For example, the action prompt may prompt the user to perform a particular gesture on the user icon that circles counterclockwise to trigger sharing of the selected picture.
In some other embodiments, in response to the user selecting or indicating the orientation of the receiving device in the graphical user interface as shown in fig. 5B or 5C, the electronic device may select one of the discovered nearby devices as the candidate receiving device according to a predetermined display rule, and display the device information of the candidate receiving device in the updated graphical user interface. In some embodiments, the predetermined display rule may be to select a nearby device closest to the electronic device as a candidate receiving device and display device information thereof. As shown in fig. 5F, when the electronic device determines a proximate device closest to the electronic device in the indicated direction, a dialog box 54 may be displayed in the regions 52 and 53, and prompt information 541 and controls 542 and 543 may be included in the dialog box 54. The prompt information 541 may be text information, for example, "you will share pictures with the mobile phone of MAC" and the like, and is used to prompt the user to share pictures with a nearby device whose device information is "mobile phone of MAC". The control 542 may display text information "ok", and a user touching the control may trigger the electronic device to establish a communication connection with a device in the vicinity of the mobile phone whose device information is "MAC" and send data after the connection is successfully established. The control 543 may display the text "obtain recommendation", and the user touching the control can trigger the electronic device to update the area 52, and display the device information corresponding to other nearby devices found in the indicated direction, except for the nearby device whose device information is "the cell phone of MAC", in the area 52, and the order of displaying the device information corresponding to the other nearby devices may be based on a predetermined ordering rule, such as according to the distance between the nearby device and the electronic device or the initial order of the device IDs. In other embodiments, device information corresponding to nearby devices found by the electronic device in other directions may be displayed in the area 52. In some cases, the other direction may be a predetermined angular range adjacent to the indicated direction.
In response to the user clicking on a control 542 ("ok") in the graphical user interface shown in fig. 5F, the electronic device can display a dialog box 55 in region 52 and region 53, as shown in fig. 5G. Prompt information 551 and controls 552 and 553 may be included in the dialog box 55. The prompt message 551 may be a text message, such as "you are sharing pictures with the mobile phone of MAC" and the like, for prompting that the user is sharing pictures with a nearby device whose device information is "mobile phone of MAC". The control 552 may display the text message "end" and the user touching the control can stop data transmission between the electronic device and a nearby device whose device information is "MAC handset". The control 553 may be a straight progress bar for prompting the progress of data transmission. Not limited to a straight-line progress bar, the electronic device may prompt the user for the progress of data transmission using a numeric or other shaped progress bar (e.g., circular, annular, rectangular, etc.).
In other embodiments, the electronic device establishes a communication connection directly with only one nearby device in the indicated receiving device direction or after selecting one nearby device from a plurality of nearby devices that have been found as a candidate receiving device, and transmits data after the connection establishment is successful. That is, the graphical user interface may be updated directly from fig. 5B or fig. 5C to that shown in fig. 5G.
In other embodiments, when the electronic device does not find any device in the indicated direction, as shown in fig. 5H, the electronic device may display a dialog box 56 in the areas 52 and 53, which dialog box 56 may include prompt information 561 and controls 562, 563. The prompt information 561 may be a text message, such as "no device is supported in the designated direction" or the like, for prompting the user that no connectable device is found in the indicated direction. Controls 562 and 563 can be used to prompt and listen to the user for further action. Control 562 can display the textual information "get recommendations," and clicking on the control by the user can trigger updating of region 52 and display device information in region 52 corresponding to nearby devices found in directions other than the indicated direction. In some cases, the other direction is a predetermined angular range adjacent to the indicated direction. The control 563 may display the text message "exit", and the user clicks the control to trigger the exit of the directional sharing. In other embodiments, controls 562 and 563 may correspond to other operations, e.g., control 563 may display the textual information "redirect," clicking on which by the user can trigger the electronic device to update the graphical user interface for reselecting or indicating the orientation of the receiving device, and graphical user interface 50 may be updated as shown in FIG. 5B or FIG. 5C.
It is understood that, in the present embodiment, without being limited to the area 51, the area 52, and the area 53 described above, the "directional sharing interface" may further include other forms of interactive elements, as shown in fig. 5A, the graphical user interface 50 may further include a title bar, a control 501 may be displayed in the title bar, and the indication information 502 may also be displayed. The control 501 may be used to deselect the picture for sharing, that is, the user may click the control 501 to deselect the picture that has been selected for sharing. The indication information 502 may be used to indicate the number of pictures that have been selected.
The graphical user interface 60 exemplarily shown in fig. 6A-6B may be another implementation of a "directed sharing interface".
FIG. 6A illustrates a graphical user interface 60 entered in response to a user tap operation on a picture in the application "gallery" in FIG. 4A. Graphical user interface 60 may include regions 61 and 62. A picture 601 currently viewed by the user may be displayed in the area 61. A menu 602 may be displayed in region 62. The menu 602 may refer to the menu 45 in the graphical user interface 40 shown in fig. 4B, and will not be described in detail here.
As shown in fig. 6A, the electronic device may listen in the graphical user interface 60 for a user operation to click a control 6021 ("share") in the menu 602, thereby triggering sharing of the currently displayed picture 601. In response to the user clicking the control 6021 "share," the electronic device triggers an update of the graphical user interface. If the "directional sharing" is not started, the electronic device monitors the operation of starting the directional sharing by the user in the updated graphical user interface, and the updated graphical user interface may refer to the graphical user interface 50 shown in fig. 5A, which is not described herein again.
In other embodiments, control 6021 may be "directionally shared. And responding to the user clicking the control, triggering and updating the graphical user interface by the electronic equipment, and monitoring the selection operation of the user for the direction of the receiving equipment in the updated graphical user interface. The updated graphical user interface may refer to the graphical user interface 50 shown in FIG. 5B. In some other embodiments, in response to the user clicking the control 6021 "directional sharing", the electronic device triggers the update of the graphical user interface, and monitors the gesture of the user in the updated graphical user interface, and determines the direction of the receiving device through the gesture of the user. The updated graphical user interface may refer to the graphical user interface 50 shown in FIG. 5C. In some cases, before the user clicks the control 6021, the "directed sharing" is already turned on, and in response to the user clicking the control 6021 ("sharing" or "directed sharing"), the electronic device updates the graphical user interface to that shown in fig. 5B or fig. 5C, which is not described here again.
In some other embodiments, in response to the user clicking control 6021 "directed sharing," the electronic device updates the graphical user interface, displays device information corresponding to the nearby device and the relative location of the nearby device and the electronic device, and listens to the user's selection of the receiving device. The updated gui may refer to the gui 50 shown in fig. 5D, and will not be described herein.
In other embodiments, the electronic device may listen to the graphical user interface 60 for user gestures to trigger directional sharing. As shown in fig. 6B, the user can long press and slide a distance L in a certain direction at any position in the area 61. The distance L needs to be greater than a predetermined length to enable the electronic device to recognize and determine the direction in which the user is sliding. In some cases, in response to a long press operation by the user at an arbitrary position in the area 61, the picture in the area 61 may be updated to a thumbnail of the currently viewed picture, the reduced picture is displayed at the position where the user has long pressed, and the thumbnail may move as the position of the contact point changes when the user's finger slides on the screen. In some embodiments, the electronic device determines the contact locations at which the user begins and ends sliding in the area 61, respectively, and determines the sliding direction of the user based on the contact locations at which the sliding begins and ends. It should be understood that the manner of determining the sliding direction is not limited to determining the contact positions at the beginning and the end of the sliding, and the electronic device may also determine the sliding direction by recording the finger sliding track, which is not limited in this embodiment.
In response to a user's long-pressing and continuously sliding a distance L in a certain direction at an arbitrary position in a region 61 of the graphical user interface as shown in fig. 6B, the electronic device updates the graphical user interface and displays the graphical user interfaces of nearby devices found in the indicated direction in different cases.
In some cases, in response to a user long-pressing and sliding a distance L in a certain direction at any position in the area 61 of the graphical user interface as shown in fig. 6B, the electronic device may update the graphical user interface as shown in fig. 5D and display device information corresponding to nearby devices found in all directions in the updated graphical user interface. Since the electronic device can determine the sliding direction through the sliding operation of the user, the device information that can be set in the sliding direction by the electronic device has different display effects. For example, the device information in the sliding direction is different in appearance (such as icon size, color, etc.) from the device information in the other directions. If the device information of the nearby devices is displayed in a list or the like, the display order of the device information corresponding to the nearby devices in the sliding direction may be advanced.
In other cases, in response to a user long-pressing and sliding a distance L in a certain direction at any position in the area 61 of the graphical user interface shown in fig. 6B, the electronic device may update the graphical user interface as shown in fig. 5E or fig. 5F, and display device information corresponding to nearby devices in the sliding direction in the updated graphical user interface.
In other cases, in response to the user long pressing and sliding a distance L in a certain direction at any position in the area 61 of the graphical user interface shown in fig. 6B, the electronic device may trigger a device sharing data in the sliding direction, and the electronic device may update the graphical user interface as shown in fig. 5G.
In other cases, in response to a user long-pressing and sliding a distance L in a direction anywhere in the area 61 of the graphical user interface shown in FIG. 6B, the electronic device may update the graphical user interface as shown in FIG. 5H to indicate that the electronic device does not find a supported device in the sliding direction.
In some other embodiments, after the user taps the picture in the "gallery" of the application program in fig. 4A to enter the gui 60, the electronic device detects a specific operation (for example, a single-finger long press, a double-finger long press, or a counterclockwise circle on the picture) in the gui 60, the electronic device updates the gui, displays the device information corresponding to the nearby devices found in all directions, and monitors the selection of the receiving device by the user, and the updated gui may refer to fig. 5D.
The graphical user interface 70 exemplarily shown in fig. 7A-7B may be yet another implementation of a "directed sharing interface".
FIG. 7A illustrates a graphical user interface 70 entered in response to a user tapping the application "File management" in FIG. 3A. As shown in fig. 7A, the graphical user interface 70 may include icons 701, 703, 705 and corresponding textual information 702, 704, 706. Wherein, icons 701, 703 and 705 are used for representing different file types contained in the electronic equipment, and text messages 702, 704 and 706 are used for prompting a user about the file type names contained in the electronic equipment and the number of the corresponding file types. For example, the content of the text message 702 is "picture 56", which indicates that 56 pictures are stored in the electronic device. The icons 701, 703 and 705 are used for monitoring user operations on the icons and triggering the electronic device to display files of corresponding file types in response to the user operations. For example, the user clicks on icon 703, which triggers the electronic device to display a list of documents stored therein, and graphical user interface 70 is updated as shown in FIG. 7B.
Fig. 7B illustrates operations in the graphical user interface 70 for listening to a user's selection and sharing in a currently displayed list of files. The graphical user interface 70 may include a status bar 71, an application title bar 72, and a file area 73. Wherein:
the status bar 71 can refer to the status bar 21 in the graphical user interface 20 shown in FIG. 3A, and will not be described in detail here.
The application title bar 72 may include: a back key 721, and a current page indicator 722. The return key 721 is an APP level return key, which can be used to return a logically previous level. The current page indicator 722 may be used to indicate a current page, such as the textual information "document," not limited to textual information, but the current page indicator 722 may also be in the form of an icon or the like.
A file list containing one or more file information may be displayed in the file area 73. As shown in fig. 7B, it may include files 731, 732, 733, and 734. When the electronic device listens to the up or down sliding operation in the file area 73, the electronic device may update the file displayed in the file area 73 so that the user can view the file. That is, the user may slide up or down in the file area 73 to browse the file. Not limited to the sliding operation up or down, the user may also slide left or right in the file area 73 to browse the file.
The graphical user interface 70 may also include a navigation bar (not shown) that may be referenced to the navigation bar 23 in the graphical user interface 20 shown in fig. 3A and will not be described in detail herein.
As shown in FIG. 7B, when the electronic device listens to the graphical user interface 70 for an operation to select one or more files, the electronic device may display a menu 74 in the graphical user interface 70. The menu 74 may refer to the menu 45 in the graphical user interface 40 shown in FIG. 4B and will not be described in detail here. In some embodiments, when the electronic device listens to the graphical user interface 70 for an operation to select a file, a mark 7331 is displayed on the selected file. A flag 7331 may indicate that file 733 has been selected by a user.
As shown in fig. 7B, the electronic device may listen in the gui 70 for a user operation to click on a control 741 ("share") in the menu 74, thereby triggering sharing of a selected file (e.g., file 733). And responding to the operation, triggering and updating the graphical user interface by the electronic equipment, and monitoring the operation of starting the directional sharing by the user in the updated graphical user interface. The updating of the graphical user interface by the electronic device may refer to areas 52 and 53 in graphical user interface 50 shown in FIG. 5A. And will not be described in detail herein.
In other embodiments, control 741 may be "share oriented". And responding to the user clicking the control, triggering and updating the graphical user interface by the electronic equipment, and monitoring the selection operation of the user for the direction of the receiving equipment in the updated graphical user interface. The updating of the graphical user interface by the electronic device may refer to areas 52 and 53 in graphical user interface 50 shown in FIG. 5B. In some other embodiments, in response to the user clicking the control "directional sharing", the electronic device triggers the update of the graphical user interface, monitors the gesture of the user in the updated graphical user interface, and determines the direction of the receiving device according to the gesture of the user. The updating of the graphical user interface by the electronic device may refer to areas 52 and 53 in graphical user interface 50 shown in FIG. 5C. In some other embodiments, in response to the user clicking the control "share oriented", the electronic device triggers discovery of nearby devices in all directions and determination of relative positions between the discovered nearby devices and the electronic device, upon discovery of a nearby device and determination of its relative position with the electronic device, the electronic device updates the graphical user interface, displays device information corresponding to the nearby device and the relative positions of the nearby device and the electronic device, and listens for user selection of the receiving device. The updating of the graphical user interface by the electronic device may refer to regions 52 and 53 of graphical user interface 50 shown in FIG. 5D and will not be described in detail here.
The graphical user interface 80 illustrated in fig. 8 may be yet another implementation of a "directed sharing interface".
FIG. 8 illustrates a graphical user interface 80 for entering application sharing in response to a user action on an application icon on the graphical user interface displayed in FIG. 3A. For example, the electronic device listens for a long press operation on an icon of the application 239, in response to which the electronic device may update the menu 81 around the application icon 239, which menu 81 may include controls 811 ("share") and 812 ("unload"). Among other things, control 811 can be used to monitor user operation to share the selected application, and control 812 can be used to monitor user operation to uninstall the selected application.
In some embodiments, the electronic device may monitor the operation of the user tapping the control 811 ("share") in the menu 81 in the graphical user interface 80, and in response to the operation acting on the control 811, the electronic device triggers the updating of the graphical user interface and monitors the operation of the user starting the directed share in the updated graphical user interface. The updating of the graphical user interface by the electronic device may refer to areas 52 and 53 of graphical user interface 50 shown in FIG. 5A and will not be described in detail here.
In other embodiments, control 811 may be "directed sharing". And responding to the user clicking the control, triggering and updating the graphical user interface by the electronic equipment, and monitoring the selection operation of the user for the direction of the receiving equipment in the updated graphical user interface. The updating of the graphical user interface by the electronic device may refer to areas 52 and 53 in graphical user interface 50 shown in FIG. 5B. In some other embodiments, in response to the user clicking the control "directional sharing", the electronic device triggers the update of the graphical user interface, monitors the gesture of the user in the updated graphical user interface, and determines the direction of the receiving device according to the gesture of the user. The updating of the graphical user interface by the electronic device may refer to areas 52 and 53 in graphical user interface 50 shown in FIG. 5C. In some other embodiments, in response to the user clicking the control "share oriented", the electronic device triggers discovery of nearby devices in all directions and determination of relative positions between the discovered nearby devices and the electronic device, and after the nearby devices are discovered and the relative positions between the nearby devices and the electronic device are determined, the electronic device updates the graphical user interface, displays device information corresponding to the nearby devices and the relative positions of the nearby devices and the electronic device, and listens for the user's selection of the receiving device. The updating of the graphical user interface by the electronic device may refer to regions 52 and 53 of graphical user interface 50 shown in FIG. 5D and will not be described in detail here.
In some other embodiments, the user triggers the discovery of nearby devices in all directions and the determination of the relative position between the discovered nearby devices and the electronic device by a specific operation (e.g., double-finger-length pressing, multiple-finger-length pressing, or counterclockwise circling on the application icon) on the application icon on the graphical user interface displayed in fig. 3A, after discovering the nearby devices and determining their relative positions with the electronic device, the electronic device updates the graphical user interface, displays device information corresponding to the nearby devices and the relative positions of the nearby devices and the electronic device, and listens for the user's selection of the receiving device. The updating of the graphical user interface by the electronic device may refer to areas 52 and 53 in graphical user interface 50 shown in FIG. 5D. In some cases, the electronic device triggers an operation of sharing the selected application program to the nearby device by monitoring device information corresponding to the nearby device displayed on the graphical user interface by dragging an application program icon by a user.
In some embodiments, after the electronic device determines the target receiving device, a communication connection is established with the target receiving device, and transmission of the application information is started after the communication connection is established. The application information may include one or more of application installer, application download link, application name and version number, etc.
Fig. 9A illustrates a process of discovering all nearby devices and determining the relative positions of the nearby devices and the electronic device after the electronic device turns on directional sharing, and establishing a connection with a selected receiving device and transmitting data. As shown in fig. 9A, after the electronic device 100 monitors that the directional sharing is turned on, the electronic device 100 is triggered to discover nearby devices in all directions. In which, the user may click on the "directional sharing" control in the graphical user interface shown in fig. 3B, or click on the "directional sharing" control in the graphical user interface shown in fig. 4B, or start directional sharing by clicking on an icon 521 in the graphical user interface shown in fig. 5A, or by a specific gesture operation in the graphical user interface shown in fig. 6B, or the like.
The electronic device 100 may discover nearby devices in several ways:
method 1 for discovering nearby equipment by adopting Wi-Fi direct connection wireless communication technology
In some embodiments, the electronic device 100 may broadcast a probe request (probe request) outward. After listening to the probe request, the nearby device may respond with a probe response (probe response) to notify its existence. In other embodiments, nearby devices may periodically send out Beacon (Beacon) frames. The electronic device 100 may discover nearby devices by listening to Beacon frames transmitted by the nearby devices.
That is, the electronic device 100 may actively discover nearby devices, or may passively discover nearby devices.
Mode 2. Discovery of nearby devices using Bluetooth wireless communication technology
In some embodiments, bluetooth devices (e.g., a cell phone, a tablet, a printer, etc. with a bluetooth module) in the vicinity of the electronic device 100 may perform bluetooth broadcasts. The electronic device 100 may perform a bluetooth scan to scan for broadcast frames broadcast by nearby bluetooth devices to discover nearby bluetooth devices.
Mode 3. Discover devices in the same Wi-Fi LAN
In some embodiments, the electronic device 100 may determine the IP address range of the LAN according to its own IP address and subnet mask in the LAN, and may then discover the devices in the LAN by means of unicast polling. Without being limited thereto, the electronic device 100 may also discover devices in the LAN by broadcasting messages or multicasting messages in the LAN.
The method for discovering the nearby devices by the electronic device is not limited to the above several manners, and in practical application, the electronic device may also discover the nearby devices by using other manners based on communication technologies such as bluetooth, wi-Fi direct, wi-Fi LAN, millimeter waves, and the like, which is not limited in this application.
The electronic device 100 obtains the identification information of the nearby device from a message (such as a probe response, a beacon frame, or a bluetooth broadcast frame) received from the nearby device during the nearby device discovery process, and then obtains the device information through the identification information, or obtains the device information of the nearby device from a message received from the nearby device.
After discovering the electronic device 101, the electronic device 102, and the electronic device 103, the electronic device 100 determines the relative positions of the nearby electronic devices and the electronic device 100, respectively. The relative position includes at least information such as an angle of arrival (AoA). A specific process of the electronic device 100 determining the angle of arrival (AoA) of the nearby device may be as shown in fig. 9B. The electronic device 100 first transmits a first request signal 1011 to the electronic device 101, the first request signal 1011 requesting the electronic device 101 to transmit a first report signal 1012 to perform measurement of an angle of arrival (AoA). After receiving the first request signal 1011, the electronic device 101 transmits a first report signal 1012 to the electronic device 100, and the electronic device 100 receives the first report signal 1012 using an antenna array and estimates an angle of arrival (AoA) of the electronic device 101 from a phase difference of the first report signal 1012 received by different antennas. In some embodiments, the first report signal 1012 may specifically include a fixed frequency spread signal, which may be a data string comprising a series of switch slots and sample slots appended to a normal data packet. When receiving the first report signal 1012, the receiving end switches different receiving antennas in a certain order, and determines an angle of arrival (AoA) according to a phase difference of the fixed frequency spread signals received by the different antennas.
For example, if the millimeter wave antenna array of the electronic device 100 includes 8 millimeter wave antennas A1 to A8, after the first request signal 1011 is sent, the first report signal 1012 sent by the nearby device is received only by using the antenna A1 at time t1, the first report signal 1012 sent by the nearby device is received only by using the antenna A2 at time t2, and so on, after the first report signals 1012 sent by the nearby device are received by the 8 antennas respectively, the electronic device 100 calculates the angle of arrival (AoA) of the nearby device, that is, the relative angle between the nearby device and the electronic device 100, according to the phase difference of the first report signals 1012 received by the 8 antennas.
In other embodiments, the electronic device 100 and the electronic device 101 may employ an angle of emission (AoD) measurement method to determine the relative angle.
Next, the electronic device 100 determines the angle of arrival (AoA) of the electronic device 102 and the electronic device 103, respectively, using the antenna array at different time intervals, using the same procedure as measuring the angle of arrival (AoA) of the electronic device 101. In other embodiments, electronic device 100 may determine angles of arrival (aoas) for multiple or all of the nearby devices simultaneously.
In other embodiments, the electronic device 100 may configure the antenna array to perform beamforming, receive broadcast messages transmitted by nearby devices in only one direction, or transmit probe signals towards that direction, and the nearby devices that receive the probe signals transmit probe responses to the electronic device 100 for discovering nearby devices in that direction. The electronic apparatus 100 acquires the apparatus information of the nearby apparatus and corresponds the nearby apparatus to the direction. Next, the electronic device 100 configures the antenna array for beamforming to find a nearby device in the other direction. That is, by polling in various directions, discovery of nearby devices is completed and the relative angles of the nearby devices are obtained.
In other embodiments, the relative position may also include distance information. The electronic device 100 may determine the distance of the electronic device 100 from the discovered nearby device by receiving the signal strength RSSI of the message from the nearby device in the nearby device discovery process, e.g., the electronic device 100 may determine the distance of the electronic device 100 from the discovered nearby device by receiving the signal strength RSSI of a broadcast message or a response message from the nearby device in the nearby device discovery process; other ranging methods known in the art, such as ToF/ToA/TDoA ranging, may also be used to determine the distance between the electronic device 100 and the discovered nearby device. The present embodiment does not set any limit to this.
After determining the relative positions of the electronic device 101, the electronic device 102, and the electronic device 103 and detecting the operation of sharing data by the user, the electronic device 100 updates the graphical user interface, and includes the device information of the electronic device 101, the electronic device 102, and the electronic device 103 and the relative positions of the devices and the electronic device 100 in the vicinity in the graphical user interface, and the displayed graphical user interface may refer to fig. 5D. Further, in the graphical user interface shown in FIG. 5D, the closer the nearby device is to the electronic device, the closer its corresponding icon is to the center point 5341. The electronic device 100 listens for user selections of receiving devices in the graphical user interface as shown in fig. 5D.
In some other embodiments, the electronic device 100 may determine the signal strength RSSI of the signal received from the nearby device in the nearby device discovery process, for example, the electronic device 100 may determine the signal strength RSSI of the broadcast message or the response message received from the nearby device in the nearby device discovery process, update the graphical user interface after determining the relative angle between the nearby device and the electronic device 100 and detecting the operation of sharing data by the user, and include the device information, the relative angle, and the signal strength of the nearby device in the graphical user interface, which may be shown with reference to fig. 5D. Further, in the graphical user interface shown in fig. 5D, the stronger the signal strength of the nearby device, the closer its corresponding icon is to the center point 5341.
As shown in fig. 9A, if the user selects the electronic apparatus 101 as the receiving apparatus. Next, the electronic device 100 may establish a communication connection with the electronic device 101 through a wireless technology such as bluetooth or WiFi and start transmitting data. The specific process of establishing the communication connection may be: the electronic device 100 sends a connection establishment request message to the electronic device 101, and after receiving the connection establishment request message, the electronic device 101 replies a connection response message to the electronic device 100 to establish a communication connection between the electronic device 100 and the electronic device 101. Next, the electronic apparatus 100 transmits user-selected data, such as an image, a document, an application installer, application information, and the like, to the electronic apparatus 101.
In some other embodiments, if the user indicates the direction information when sharing data, for example, a direction is selected in the graphical user interface shown in fig. 5B, or a direction is indicated in the graphical user interface shown in fig. 5C or 6B using a gesture, the electronic device may set different display effects on the device information corresponding to the nearby device in the indicated direction among the nearby devices found in all directions, or only display the device information corresponding to the nearby device in the indicated direction in the graphical user interface shown in fig. 5E, or when only one nearby device or one candidate nearby device among a plurality of nearby devices in the indicated direction of the electronic device in the indicated direction is selected in the indicated direction, display the corresponding device information in the graphical user interface shown in fig. 5F or directly establish a communication connection with the nearby device and start sending data.
Fig. 9C illustrates a process of determining the direction of the receiving device after the electronic device turns on the directional sharing, finding a nearby device based on the direction, establishing a connection with the selected receiving device, and sending data.
The user of the electronic device 100 may indicate the orientation of the receiving device by selection on the graphical user interface as shown in fig. 5B or by gesture on the graphical user interface as shown in fig. 5C or 6B. For example, if the user selects the area 5332 in the graphical user interface shown in fig. 5B, it indicates that the receiving apparatus direction indicated by the user is in the right direction; in the graphical user interface shown in fig. 5C, if the user slides to the right in the horizontal direction, it indicates that the recipient device direction indicated by the user is to the right, and in the graphical user interface shown in fig. 6B, if the user slides to the right in the horizontal direction while pressing the picture long, it indicates that the recipient device direction indicated by the user is to the right. After determining the receiving device direction indicated by the user, the electronic device 100 determines a beam forming scheme according to the posture of the electronic device 100 determined by the gyroscope, and configures the antenna array to receive the broadcast message sent by the nearby device in the indicated direction for discovering the nearby device in the receiving device direction. Wherein the beamforming scheme may include a weight for each antenna. Specifically, by adjusting the weight of each antenna so that the plurality of antennas are subjected to coherence and cancellation on the waveform, a signal can be received in a specified direction. In some embodiments, the antenna array may be a millimeter wave antenna array that receives a millimeter wave broadcast message transmitted by a nearby device in the direction of the receiving device in a nearby device discovery process, thereby discovering a nearby device in the specified direction. In other embodiments, the antenna array may be an antenna array with wireless communication technologies such as bluetooth or WiFi.
In other embodiments, the electronic device 100, upon determining the direction of the receiving device, configures the antenna array to send a probe request in the indicated direction. The nearby device that receives the probe request responds with a probe response to the electronic device 100 to notify its presence.
By discovering nearby devices in the appointed direction, the number of devices discovered by the electronic device is reduced, and the accuracy and efficiency of selecting the receiving device by the user are improved.
Fig. 10A and 10B illustrate the working principle of determining the beam forming scheme and configuring the antenna array according to the direction of the receiving device selected by the user or indicated by a gesture and the posture of the electronic device in the present embodiment. As shown in fig. 10A, if the electronic device detects a user's sliding up operation in the graphical user interface, the electronic device will find a nearby device directly in front of the electronic device. In fig. 10A, the electronic device is in a horizontal direction, and the electronic device determines the first beamforming scheme, that is, determines the weight of each antenna according to the direction of the receiving device indicated by the user and the posture of the electronic device, so that the beam is directed towards the front of the electronic device. In fig. 10B, the electronic device also detects an operation of sliding the user upwards in the graphical user interface, but since the electronic device has a certain angle with the horizontal direction, the electronic device determines the second beamforming scheme, that is, determines the weight of each antenna so that the beam faces the front of the electronic device according to the direction of the receiving device indicated by the user and the posture of the electronic device. Wherein, although the user sliding operation detected by the electronic device is the same, the parameters of the first beam forming scheme and the second beam forming scheme are different due to the different postures of the electronic device.
With reference to fig. 1 and 9C, since the electronic device 101 and the electronic device 102 are in the same direction, when the user indicates that the direction of the receiving device is on the right side of the electronic device 100, the electronic device 100 may discover the electronic device 101 and the electronic device 102 in the process of discovery of nearby devices. As shown in fig. 9C, if the electronic device 100 discovers the electronic devices 101 and 102, the electronic device 100 receives the broadcast message or the probe response from the electronic devices 101 and 102. The electronic device 100 obtains the device information of the electronic device 101 and the electronic device 102 from the broadcast message or the probe response, determines the signal strength RSSI of the broadcast message or the probe response, and determines the distance between the electronic device 100 and the electronic device 101 and the electronic device 102 according to the signal strength RSSI. In other embodiments, electronic device 100 may obtain the distance between it and nearby devices through other ranging techniques, such as ToF/ToA/TDoA ranging, etc. After discovering the nearby devices and determining the distance between the nearby devices and the electronic device 100, the electronic device may rank the discovered nearby devices according to a predetermined ranking rule and display device information corresponding to the ranked nearby devices in a graphical user interface as shown in fig. 5E. In some embodiments, the predetermined sort rule may be based on a distance of the nearby device from the electronic device. In other embodiments, the ordering of the device messages may be based on the signal strength RSSI of the broadcast message or probe response or other rules such as the initials of the device messages.
Next, referring to fig. 5E and fig. 9C, if the electronic device 100 monitors that the user clicks the icon corresponding to the electronic device 101 in the graphical user interface shown in fig. 5E, it indicates that the user selects the electronic device 101 as the receiving device. The electronic apparatus 100 establishes a communication connection with the electronic apparatus 101 and starts transmitting data after the connection is established. In some embodiments, the electronic device 100 and the electronic device 101 establish a communication connection via a wireless communication technology such as bluetooth or WiFi and transmit data via the wireless communication technology such as bluetooth or WiFi after the connection is established. In other embodiments, a communication connection is established between the electronic device 100 and the electronic device 101, and data is directionally transmitted through the antenna array after the connection is established. In the directional data transmission process, the attitude of the mobile phone may be detected by the gyroscope, and the arrival angle (AoA) or the emission angle (AoD) between the two devices may be measured to obtain the relative position change of the electronic device 100 and the electronic device 101, so as to adjust the beam forming scheme, that is, adjust the weight of each antenna of the antenna array in real time, so that the directional transmission can be performed continuously.
If the electronic device 100 monitors an operation of updating the displayed device information in the graphical user interface shown in fig. 5E, in response to the operation, the electronic device 100 triggers determining a beamforming scheme in another direction different from the designated receiving device direction, that is, determining weights of antennas in the antenna array, and configuring the antenna array to find a nearby device in the other direction. In addition, the electronic device 100 may determine the distance between each nearby device and the electronic device according to the signal strength of a message (e.g., a broadcast message or a probe response) received from the nearby device during the discovery process of the nearby devices, further determine the display order of each nearby device, and display the device information corresponding to the nearby device in the determined order. Wherein the closer the electronic device is, the higher the ranking of the device information corresponding to the nearby device is. In other embodiments, the electronic device 100 may also determine the display order of the nearby devices according to the signal strength of the broadcast messages or probe responses received from the nearby devices. The electronic device 100 updates the device information in the area 52 of the graphical user interface as shown in fig. 5E and listens to the receiving device selected by the user on the displayed graphical user interface. In some cases, the other direction may be a predetermined angular range adjacent to the receiving device direction.
In some other embodiments, after the electronic device 100 finds nearby devices in the specified direction and determines the distance between each nearby device and the electronic device 100, only the device message corresponding to the nearby device closest to the electronic device 100 is displayed, and the confirmation result of the user on the receiving device is monitored in the displayed graphical user interface. In other embodiments, the electronic device 100 discovers nearby devices in a specified direction and determines the signal strength of messages (e.g., broadcast messages or probe responses) received from each nearby device, displays only the device messages corresponding to the nearby devices with the strongest signal strength, and listens for user acknowledgements of the receiving devices in the displayed graphical user interface. The graphical user interface displayed may be as shown with reference to fig. 5F.
If the user clicks on a control 542 in the graphical user interface shown in fig. 5F ("ok"), the electronic device is triggered to establish a communication connection with the selected device, and data is sent after the connection is successfully established. When the user clicks a control 543 (to obtain a recommendation) as shown in fig. 5F, the electronic device is triggered to update the displayed device information, and other nearby devices found in the specified direction are displayed, except for the nearby device closest to the electronic device 100, in the order in which the other nearby devices are displayed based on the distances between the other nearby devices and the electronic device 100. The electronic device 100 listens for user selections of receiving devices in the graphical user interface as described with reference to fig. 5E. In other cases, if there are and only are nearby devices found in the user-specified receiving device direction as shown in fig. 5F, then the user clicking on a control 543 ("get recommendation") as shown in fig. 5F will trigger the electronic device 100 to determine the beamforming scheme in another direction different from the user-specified direction and configure the weights for each antenna in the antenna array so that the antenna array finds nearby devices in that other direction. In some cases, the other direction may be a predetermined angular range adjacent to the user-specified receiving device direction.
In other embodiments, when the electronic device 100 finds only one nearby device in the direction of the receiving device designated by the user or determines a nearby device closest to the user or having the strongest signal strength among the multiple nearby devices found as the receiving device, it directly establishes a communication connection with the nearby device and transmits data after the connection establishment is successful. At which point the graphical user interface may be updated as shown in fig. 5G.
In other embodiments, when device 100 does not find any device in the user-specified orientation of the receiving device, device 100 updates the graphical user interface to alert the user that no device is found. The graphical user interface displayed may refer to fig. 5H. If the user clicks a control 552 ("get recommendation") in the graphical user interface as shown in fig. 5H, in response to this operation, the electronic device 100 triggers the determination of the beamforming scheme in the other direction different from the user-specified direction of the receiving device and configures the weights for each antenna in the antenna array so that the antenna array finds a nearby device in the other direction. In addition, the electronic device 100 estimates the distance between each nearby device and the electronic device based on the signal strength of the message received from the nearby device in the discovery process, determines the display order of each nearby device, and displays the device information corresponding to the nearby devices in the determined order in the graphical user interface as shown with reference to fig. 5E. The electronic device 100 listens for a user-selected recipient device in the graphical user interface described with reference to fig. 5E. In some cases, the other direction may be a predetermined angular range adjacent to the user-specified receiving device direction.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), among others.
One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium includes: various media capable of storing program codes, such as ROM or RAM, magnetic or optical disks, etc.

Claims (11)

1. A method for data sharing in an electronic device with an antenna array, comprising:
the electronic equipment displays a first graphical user interface, wherein the first graphical user interface comprises a first object;
the electronic equipment detects a first operation in the first graphical user interface, wherein the first operation acts on the first object, and the first operation indicates a first direction;
in response to the first operation, the electronic device configures the antenna array to receive a first broadcast message sent by a first device in the first direction, and obtains a first identifier from the first broadcast message, wherein the first identifier corresponds to the first device;
the electronic equipment displays a second graphical interface, wherein the second graphical interface comprises first information; the first information is obtained by the electronic device from the first broadcast message, the first information corresponds to a first device, the first information includes first direction information, and the first direction information indicates that the first device is located in a first direction of the electronic device;
the electronic equipment detects a second operation in the second graphical interface, wherein the second operation acts on the first information;
and responding to the second operation, and sending the first object to the first equipment by the electronic equipment according to the first identification.
2. The method of claim 1, wherein the configuring the antenna array further comprises,
and the electronic equipment detects the gesture of the mobile phone and configures the weight of each antenna in the antenna array according to the gesture of the mobile phone and the first direction.
3. The method of claim 1 or 2, further comprising the electronic device configuring the antenna array to receive a second broadcast message transmitted by a second device in the first direction, and obtaining a second identifier from the second broadcast message, the second identifier corresponding to the second device.
4. The method of claim 3, wherein prior to the electronic device transmitting the first object to the first device, further comprising,
the electronic device selects the first device from the first device and the second device.
5. The method of claim 4, further comprising the electronic device selecting the first device according to a first rule; the first rule is to select the device corresponding to the broadcast message with the strongest signal strength.
6. The method of claim 3, wherein before the electronic device transmits the first object to the first device, further comprising:
the electronic device displays a second graphical user interface;
the electronic device including first information and second information in the second graphical user interface, wherein the first information is obtained by the electronic device from the first broadcast message and the second information is obtained by the electronic device from the second broadcast message;
the electronic equipment detects a third operation in the second graphical user interface, wherein the third operation acts on the first information; and (c) a second step of,
in response to the third operation, the electronic device sends the first object to the first device.
7. The method of claim 6, wherein the first information and the second information have different display effects indicating that signal strengths of the first broadcast message and the second broadcast message are different.
8. The method of claim 6 or 7,
the electronic device detects a fourth operation and,
in response to the fourth operation, the electronic device configures the antenna array to receive a third broadcast message sent by a third device in a second direction, and obtains a third identifier from the third broadcast message, where the third identifier corresponds to the third device; wherein the second direction is different from the first direction;
the electronic device displays third information on the second user interface, the third information being obtained by the electronic device from the third broadcast message.
9. The method of any one of claims 1, 2, 4, 5, 6, 7, wherein the antenna array is a millimeter wave antenna array.
10. An electronic device, comprising,
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured for execution by the one or more processors, the one or more programs comprising instructions for performing the method of any of claims 1-9.
11. A computer readable medium storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method of any of claims 1-9.
CN202010033491.5A 2020-01-13 2020-01-13 Data sharing method and electronic equipment Active CN113194454B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010033491.5A CN113194454B (en) 2020-01-13 2020-01-13 Data sharing method and electronic equipment
PCT/CN2021/071112 WO2021143650A1 (en) 2020-01-13 2021-01-11 Method for sharing data and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010033491.5A CN113194454B (en) 2020-01-13 2020-01-13 Data sharing method and electronic equipment

Publications (2)

Publication Number Publication Date
CN113194454A CN113194454A (en) 2021-07-30
CN113194454B true CN113194454B (en) 2023-02-07

Family

ID=76863588

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010033491.5A Active CN113194454B (en) 2020-01-13 2020-01-13 Data sharing method and electronic equipment

Country Status (2)

Country Link
CN (1) CN113194454B (en)
WO (1) WO2021143650A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114143769A (en) * 2021-12-08 2022-03-04 Oppo广东移动通信有限公司 Content sharing method, device, equipment, medium and computer program
CN114302386B (en) * 2021-12-24 2023-06-09 深圳创维数字技术有限公司 Wireless network connection method, device, access point and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015183756A1 (en) * 2014-05-31 2015-12-03 Apple Inc. Message user interfaces for capture and transmittal of media and location content
CN107943489A (en) * 2017-11-14 2018-04-20 维沃移动通信有限公司 Data sharing method and mobile terminal
CN109690967A (en) * 2016-09-15 2019-04-26 高通股份有限公司 Wireless orientation based on antenna sector is shared
CN110568767A (en) * 2019-07-31 2019-12-13 华为技术有限公司 Intelligent household equipment selection method and terminal

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201235928A (en) * 2011-02-22 2012-09-01 Acer Inc Handheld devices, electronic devices, and data transmission methods and computer program products thereof
CN103257813B (en) * 2012-02-21 2017-12-22 海尔集团公司 The determination method and document transmission method and system of a kind of shared equipment
CN104507160B (en) * 2014-12-16 2018-12-14 福建星网锐捷网络有限公司 Wireless network localization method, access point and location-server
CN106603609A (en) * 2015-10-16 2017-04-26 中兴通讯股份有限公司 File sending and transmission method and device
CN106405495A (en) * 2016-09-30 2017-02-15 上海乐蜗信息科技有限公司 VR equipment positioning system and positioning method thereof
US11032698B2 (en) * 2016-10-27 2021-06-08 International Business Machines Corporation Gesture based smart download
CN107277147A (en) * 2017-06-28 2017-10-20 上海斐讯数据通信技术有限公司 Document transmission method, device and the computer-processing equipment of mobile terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015183756A1 (en) * 2014-05-31 2015-12-03 Apple Inc. Message user interfaces for capture and transmittal of media and location content
CN109690967A (en) * 2016-09-15 2019-04-26 高通股份有限公司 Wireless orientation based on antenna sector is shared
CN107943489A (en) * 2017-11-14 2018-04-20 维沃移动通信有限公司 Data sharing method and mobile terminal
CN110568767A (en) * 2019-07-31 2019-12-13 华为技术有限公司 Intelligent household equipment selection method and terminal

Also Published As

Publication number Publication date
CN113194454A (en) 2021-07-30
WO2021143650A1 (en) 2021-07-22

Similar Documents

Publication Publication Date Title
CN110471639B (en) Display method and related device
WO2020134869A1 (en) Electronic device operating method and electronic device
CN113645351B (en) Application interface interaction method, electronic device and computer-readable storage medium
CN114397982A (en) Application display method and electronic equipment
CN111666119A (en) UI component display method and electronic equipment
CN114461111B (en) Function starting method and electronic equipment
CN112703478A (en) Data sharing method, graphical user interface, electronic device and system
CN113961157B (en) Display interaction system, display method and equipment
CN113794796B (en) Screen projection method and electronic equipment
JP7234379B2 (en) Methods and associated devices for accessing networks by smart home devices
WO2022028537A1 (en) Device recognition method and related apparatus
CN113194454B (en) Data sharing method and electronic equipment
CN114115770A (en) Display control method and related device
WO2022022674A1 (en) Application icon layout method and related apparatus
CN112068907A (en) Interface display method and electronic equipment
CN114201738B (en) Unlocking method and electronic equipment
CN114079691B (en) Equipment identification method and related device
CN114338642B (en) File transmission method and electronic equipment
CN113448658A (en) Screen capture processing method, graphical user interface and terminal
WO2023138305A9 (en) Card display method, electronic device, and computer readable storage medium
WO2023045876A1 (en) Application installation method and related devices
CN114666769A (en) Information processing method and related device and equipment
CN117785340A (en) Card sharing method and device
CN116301483A (en) Application card management method, electronic device and storage medium
CN116541589A (en) Broadcast record display method and related equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant