WO2023165225A9 - 多任务场景下的悬浮球处理方法和电子设备 - Google Patents

多任务场景下的悬浮球处理方法和电子设备 Download PDF

Info

Publication number
WO2023165225A9
WO2023165225A9 PCT/CN2022/140359 CN2022140359W WO2023165225A9 WO 2023165225 A9 WO2023165225 A9 WO 2023165225A9 CN 2022140359 W CN2022140359 W CN 2022140359W WO 2023165225 A9 WO2023165225 A9 WO 2023165225A9
Authority
WO
WIPO (PCT)
Prior art keywords
floating ball
electronic device
ball
suspended
display
Prior art date
Application number
PCT/CN2022/140359
Other languages
English (en)
French (fr)
Other versions
WO2023165225A1 (zh
Inventor
丁一晏
黄丽薇
焦骏婷
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Priority to EP22905473.9A priority Critical patent/EP4270911A1/en
Publication of WO2023165225A1 publication Critical patent/WO2023165225A1/zh
Publication of WO2023165225A9 publication Critical patent/WO2023165225A9/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72451User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to schedules, e.g. using calendar applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72457User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to geographic location
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Definitions

  • This application relates to the field of terminals, and in particular to a suspended ball processing method and electronic equipment in a multi-task scenario.
  • terminal electronic devices such as mobile phones can display a floating ball, or floating capsule, in the window after exiting.
  • the floating ball can always be displayed on the top layer of the window and will not be covered. In this way, the user can quickly and conveniently open the aforementioned closed page or application through the floating ball.
  • This application provides a method for handling suspended balls in a multi-task scenario.
  • This method can be applied to terminal electronic devices such as mobile phones and tablet computers.
  • the above-mentioned electronic device can display multiple suspended balls.
  • the electronic device can set personalized floating ball display rules according to the timeliness characteristics of different floating ball services. In this way, the electronic device can not only provide multiple types of information to the user through multiple floating balls, but also avoid blocking the foreground application due to too many floating balls.
  • this application provides a multi-task interaction method, which method is applied to electronic equipment.
  • the method includes: detecting that the electronic equipment meets the first preset condition, and displaying the first floating ball; wherein, in the first floating ball, The logo of the first application and the first information are displayed; when the first floating ball is displayed on the interface of the electronic device, it is detected that the electronic device meets the second preset condition, and the first floating ball is displayed on the interface of the electronic device at the same time A second floating ball is displayed; wherein the second floating ball displays the logo of the second application and the second information.
  • the electronic device when it is detected that the display conditions for multiple suspended balls are met, the electronic device can display multiple suspended balls at the same time.
  • the logo and prompt information of the associated application are displayed in the floating ball, so that the user can quickly and conveniently obtain the prompt information and the application that provides the above information.
  • the second suspended ball is displayed above the first suspended ball.
  • the electronic device can display the newly generated floating ball on top of the existing floating ball.
  • the user can judge the display time of each floating ball based on the display position of each floating ball, and then determine the priority of the prompt information in each floating ball, so as to rationally arrange time and tasks.
  • the method further includes: determining that no user operation on the first floating ball is detected within a first period of time after the first floating ball is displayed, displaying the abbreviated The first floating ball; the abbreviated first floating ball includes the identification of the first application but does not include the first information.
  • the floating ball after the electronic device displays an expanded floating ball (including application icons and prompt messages) for a period of time, and no user operation on the floating ball, such as a click operation, is detected, the floating ball can be The expanded floating ball is adjusted to the abbreviated state (including application icons) to reduce the display area of the floating ball and reduce occlusion of foreground applications, thus improving the user experience.
  • the method further includes: determining that no user operation on the second floating ball is detected within a second period of time after the second floating ball is displayed, displaying the abbreviated The second floating ball; the abbreviated second floating ball includes the identifier of the second application but does not include the second information.
  • the electronic device can adjust multiple expanded suspended balls to abbreviated state at the same time, further reducing the display area of the suspended balls and reducing the impact on the foreground application. Occlusion.
  • the first duration and the second duration are equal.
  • the electronic device can set the time for displaying the levitation method in the expanded state according to the characteristics of the services corresponding to different levitation balls, thereby improving the user experience. For example, the electronic device can set the display time of the expanded state of the subway floating ball to 30 seconds; set the display time of the expanded state of the airline floating ball to 10 seconds.
  • displaying the second floating ball in the abbreviated state includes: determining other floating balls that are displayed in the abbreviated state on the interface of the electronic device, and placing the second floating ball in the abbreviated state.
  • the suspended ball aggregates with other suspended balls in the abbreviated form to form a third suspended ball; wherein, the third suspended ball displays a logo of the second application.
  • the electronic device when adjusting multiple expanded suspended balls to a reduced state, can also aggregate multiple suspended balls in a reduced state into one , thereby further reducing the display area of the floating ball, reducing the occlusion of the foreground application, and improving the user experience.
  • the application icon part in one suspended ball (the third suspended ball) after aggregation can display the application icon in the latest generated suspended ball.
  • the electronic device displays the second suspended ball after displaying the first suspended ball. Therefore, the second suspended ball can be called the latest generated suspended ball. Therefore, the application icon part in the third suspended ball can display the application icon in the second suspended ball.
  • the application icon is the identifier of the second application. In this way, the user can determine the application to which the latest generated floating ball belongs based on the application icon in the aggregated floating ball, and then determine the priority of the prompt information in each floating ball, so as to arrange time reasonably.
  • the third suspended ball includes indication information, and the indication information is used to indicate that the third suspended ball is an aggregated suspended ball including a plurality of suspended balls.
  • the user can determine whether the suspended ball is obtained by abbreviating an expanded suspended ball or aggregating multiple expanded suspended balls through the application icon of the abbreviated suspended ball, and then determines Whether this abbreviated suspended ball can correspond to multiple suspended balls.
  • the method further includes: detecting a first user operation on the third suspended ball; and displaying multiple suspended balls in response to the first user operation.
  • the electronic device when the electronic device detects a user operation on the polymerized suspended ball, the electronic device can re-split the above-mentioned suspended ball after polymerization into multiple suspended balls before polymerization, and display The above-mentioned multiple suspended balls. Therefore, the user can conveniently obtain the currently needed floating ball at any time, and use the above-mentioned floating ball to obtain more information or complete some necessary operations.
  • the first information is a check-in prompt for the flight booked by the user
  • the first preset condition includes: obtaining a notification of the flight, and the current time of the electronic device is within the check-in time of the flight.
  • the first information is a boarding prompt for the flight booked by the user
  • the first preset conditions include: obtaining a flight notification, the current time of the electronic device is within the waiting time range of the flight, and the electronic device The current location is within the geographical range of the flight's departure airport; or, the first information is a subway ride prompt, and the first preset condition includes: the current location of the electronic device is within the geographical range of the subway station; or, the first information is Translation tips, the first preset condition includes: a copy operation is detected, and the language used in the copied content is a non-system common language.
  • the electronic device when a flight notification is obtained and the current time of the electronic device is within the check-in time range of the flight, the electronic device can display the flight floating ball.
  • the electronic device when a flight notification is obtained, the current time of the electronic device is within the waiting time range of the flight, and the current location of the electronic device is within the geographical range of the departure airport of the flight, the electronic device can display the flight floating ball.
  • the flight floating ball can display relevant information about the flight booked by the user, such as check-in tips, boarding tips, etc.
  • the electronic device When the current location of the electronic device is within the geographical range of the subway station, the electronic device can display the subway floating ball.
  • the subway floating ball can display subway ride prompts, such as subway ride codes, health codes, etc.
  • the electronic device may display a translation floating ball.
  • the method further includes: determining that no user operation on the first floating ball is detected within a third period of time after the first floating ball is displayed, and terminating the display of the first floating ball. ball.
  • the electronic device can confirm that the user does not need the shortcut provided by the above-mentioned floating ball, and then the electronic device can terminate the display of the floating ball to reduce occlusion of the foreground application and avoid interference to the user.
  • it is determined that no user operation on the first floating ball is detected within a third period of time after the first floating ball is displayed, and terminating the display of the first floating ball includes: determining No user operation on the first floating ball is detected within the fourth period of time after the first floating ball is displayed, and the first floating ball in the abbreviated state is displayed; the first floating ball in the abbreviated state includes the logo of the first application.
  • the first floating ball in the abbreviated state also includes a countdown logo, and the countdown logo is used to indicate the remaining display time of the first floating ball in the abbreviated state; the third duration is equal to the fourth duration and the countdown indicated by the countdown logo The sum of the durations; when the countdown mark indicates the end of the countdown, the display of the first suspended ball is terminated.
  • the electronic device can adjust the above-mentioned suspended ball in the expanded state to a reduced state, and display a countdown mark on the suspended ball in the reduced state to remind the user that the suspended ball is about to disappear. If the electronic device has not detected the user's operation on the floating ball when the countdown mark indicates that the countdown is over, the electronic device can confirm that the user does not need the shortcut provided by the floating ball, and then the electronic device can terminate the display of the floating ball. Reduce occlusion of foreground applications and avoid disturbing users.
  • the first information is a navigation prompt
  • the first preset condition includes: a copy operation is detected, and the copied content indicates the first location on the map
  • the first information For the dial prompt the first preset condition includes: a copy operation is detected, and the copied content includes the first phone number.
  • the electronic device when a copy operation is detected and the copied content indicates a specific location on the map, the electronic device may display a navigation floating ball.
  • the navigation floating ball can provide users with quick itinerary planning services.
  • the electronic device may display the dialing floating ball.
  • the dialing floating ball can provide users with fast dialing services, save user operations and improve user experience.
  • the method further includes: detecting a second user operation acting on the first suspended ball; in response to the second user operation, displaying the first page, and the first page displays
  • the third information includes the first information, or the third information is associated with the first information.
  • the electronic device when a user operation on the floating ball is detected, can run an application associated with the floating ball, or display updates associated with the floating ball including prompt information in the floating ball.
  • a rich information page allows users to obtain more relevant information easily and quickly.
  • the first page also includes a second suspended ball; or, it also includes an abbreviated second suspended ball, and the abbreviated second suspended ball includes a second application.
  • the identification does not include the second information.
  • the electronic device After the electronic device displays the page associated with the first suspended ball, it can also display the remaining suspended balls, such as the second suspended ball, on the page. In this way, the user can directly click on the second floating ball on the basis of the above page to obtain more information provided by the second floating ball.
  • the graphic code if the first page displays a graphic code, then the graphic code does not overlap with the second suspended ball; the graphic code includes a two-dimensional code and a barcode.
  • the electronic device can display the remaining floating balls that need to be displayed on the subway. Outside the area occupied by the subway code, avoid blocking the above-mentioned subway code and hindering users from using the subway code, thereby improving the user experience.
  • a fourth suspended ball and a fifth suspended ball are also displayed on the interface of the electronic device, and the fourth suspended ball covers the fifth suspended ball.
  • the method further includes: A third user operation acting on the interface of the electronic device is detected; in response to the third user operation, the fourth suspended ball and the fifth suspended ball are displayed, and the fifth suspended ball is not covered by the fourth suspended ball.
  • the electronic device can fold more than the displayed number of suspended balls when displaying multiple suspended balls. Then, the user can control the electronic device to display the above-mentioned folded floating ball by sliding up/down, and then obtain the quick service provided by the floating ball.
  • the method further includes: detecting a fourth user operation acting on the first floating ball or the second floating ball; in response to the fourth user operation, on the interface of the electronic device The first position displays the first floating ball and the second floating ball, where the first position is the position where the fourth user operation terminates.
  • the electronic device can recognize the user's operation of moving the floating ball, and then move one or more floating balls displayed on the screen to a position designated by the user. In this way, the user can adjust the display position of the floating ball at will to reduce the bad user experience caused by the floating ball blocking the foreground application.
  • the present application provides an electronic device, which includes one or more processors and one or more memories; wherein one or more memories are coupled to one or more processors, and one or more
  • the memory is used to store computer program code.
  • the computer program code includes computer instructions.
  • the present application provides a computer-readable storage medium, including instructions.
  • the electronic device When the instructions are run on an electronic device, the electronic device causes the electronic device to execute as described in the first aspect and any possible implementation manner of the first aspect. method.
  • the present application provides a computer program product containing instructions, which when the computer program product is run on an electronic device, causes the electronic device to execute as described in the first aspect and any possible implementation manner of the first aspect. method.
  • the electronic device provided by the second aspect, the computer storage medium provided by the third aspect, and the computer program product provided by the fourth aspect are all used to execute the method provided by this application. Therefore, the beneficial effects it can achieve can be referred to the beneficial effects in the corresponding methods, and will not be described again here.
  • Figures 1A-1C are user interfaces for displaying suspended balls on a set of electronic devices provided by embodiments of the present application;
  • Figures 2A and 2B are user interfaces for a set of electronic devices provided by an embodiment of the present application to change the suspended ball in the expanded state into the abbreviated state;
  • Figures 2C-2E are user interfaces for a set of electronic devices provided by an embodiment of the present application to aggregate multiple suspended balls into one suspended ball;
  • Figure 3A is a schematic diagram of different types of suspended balls provided by embodiments of the present application.
  • Figure 3B is a schematic diagram of a transient suspended ball provided by an embodiment of the present application.
  • Figures 4A-4N are user interfaces for displaying suspended balls on a set of electronic devices provided by embodiments of the present application;
  • Figures 5A-5K are user interfaces for displaying suspended balls on a set of electronic devices provided by embodiments of the present application;
  • Figures 6A-6O are user interfaces for displaying suspended balls on a set of electronic devices provided by embodiments of the present application.
  • Figure 7 is a software structure block diagram of the suspended ball processing method in a multi-task scenario provided by the embodiment of the present application.
  • Figure 8 is a software structure diagram of a notification application provided by an embodiment of the present application.
  • FIG. 9 is a software structure diagram of another notification application provided by an embodiment of the present application.
  • Figure 10 is a flow chart of a suspended ball processing method in a multi-task scenario provided by an embodiment of the present application.
  • Figure 11 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application.
  • terminal electronic devices such as mobile phones can display a suspended ball, or suspended capsule, in the window after exiting.
  • the floating ball can always be displayed at the top level of the window (the top layer of the display layer) and will not be covered. In this way, users can quickly and easily open previously closed pages or applications by clicking the floating ball anytime, anywhere.
  • FIG. 1A exemplarily shows a user interface of a first electronic device displaying a floating ball.
  • the above-mentioned mobile phone can be called the first electronic device.
  • the user interface may represent a user interface for playing videos on the first electronic device.
  • the user can browse the video.
  • the first electronic device can display a floating ball that prompts the user to have flight information about the flight he has booked, which is recorded as a flight floating ball, such as the floating ball in Figure 1A.
  • the above-mentioned flight information of flights booked by the user can come from an application that provides users with flight booking services, which is recorded as a flight application. Therefore, the above-mentioned flight floating ball can also be called the floating ball corresponding to the flight application.
  • a floating ball can include application icons and tooltips.
  • An application icon may indicate an application associated with the hover ball.
  • the information displayed in the floating ball comes from the above-mentioned associated applications.
  • the floating ball can also provide users with a service to quickly open the above-mentioned associated applications.
  • the electronic device in response to the user's operation of clicking the floating ball, the electronic device can directly open the interface of the application and display the associated interface with prompt information.
  • the specific content displayed in the prompt information is important information that the user is concerned about. In this way, users can obtain important information more conveniently without entering the above-mentioned associated applications.
  • the above-mentioned application icon may be an application icon of a flight application installed on the first electronic device.
  • the above-mentioned flight floating ball is associated with the above-mentioned flight application.
  • the user can know the application program that the first electronic device relies on to provide the above-mentioned floating ball notification service through the above-mentioned application icon.
  • the user can also open the application installed on the first electronic device to obtain more services provided by the application.
  • the above-mentioned flight floating ball is associated with the boarding pass page for booking flights provided by the above-mentioned flight application.
  • This page can display the flight information of the above-mentioned booked flight, such as departure time, arrival time, boarding gate, seat number, etc., refer to Figure 1B.
  • Prompt information in the flight floating ball “52K Boarding Gate” can remind the user to book the boarding gate of the flight in real time when closing the page shown in Figure 1B; "View Boarding Pass” can remind the user to click on the above floating ball Get the boarding pass page to get more flight information available on the boarding pass page.
  • the prompt information displayed in the floating ball is sufficient to meet the user's needs. In some cases, the prompt information displayed in the floating ball may not meet the user's needs. At this time, the user can click the above-mentioned floating ball to obtain more information including the above-mentioned prompt information.
  • users can obtain the boarding gate of the booked flight by displaying "52K gate” in the floating ball.
  • users know the gate information and can confirm which gate to board the flight.
  • the prompt information displayed in the above-mentioned floating ball is sufficient to meet the user's needs.
  • the first electronic device may detect a user operation on the flight floating ball, and in response to the above user operation, the first electronic device may display the user interface showing the boarding pass as shown in FIG. 1C . In this way, users can quickly obtain the flight information of scheduled flights through the above-mentioned flight floating ball.
  • the first electronic device may detect the translation scene. In response to detecting the above translation scenario, the first electronic device may display a translation floating ball to provide the user with fast translation services.
  • the above-mentioned translation floating ball will be occupied by the above-mentioned translation floating ball, that is, the above-mentioned flight floating ball will be terminated. Therefore, users cannot enter the flight application and obtain flight information through the shortcut provided by the above-mentioned flight floating ball.
  • embodiments of the present application provide a method for processing suspended balls in a multi-task scenario.
  • the first electronic device can display multiple suspended balls. In this way, the user can obtain the prompt information of multiple floating balls at the same time. Furthermore, the first electronic device can also adjust the display status of multiple floating balls according to different scenes to avoid too many floating balls from blocking the screen and affecting the user experience.
  • the first electronic device may be provided with multiple suspended balls, and display conditions (display conditions) that each suspended ball needs to meet. Then, the first electronic device can obtain data indicating the current operating status (status data) in real time, and detect whether the status data satisfies the display conditions of one or more of the plurality of suspended balls. When the display conditions for one or more floating balls are met, the first electronic device may display the corresponding one or more floating balls.
  • the first electronic device when it is detected that the current status data of the first electronic device meets the display conditions of the flight floating ball, the first electronic device can generate and display the flight floating ball; when it is detected that the current status data of the first electronic device meets the display conditions of the translation floating ball.
  • the first electronic device can generate and display the translation floating ball. That is to say, in a possible implementation, the flight floating ball and the translation floating ball are displayed simultaneously on the display interface of the first electronic device.
  • the first electronic device can manage the above two floating balls respectively to prevent the translation floating ball generated later from occupying the flight floating ball generated earlier.
  • the first electronic device can set the floating ball display rules according to the timeliness characteristics of different floating ball services. For multiple suspended balls displayed at the same time, the first electronic device can also set a combined display rule for the combined display of suspended balls to avoid blocking the front-end application interface due to too many suspended balls.
  • the above-mentioned foreground application refers to the running application visible on the desktop.
  • the first electronic device may be equipped with a video player, and the video player is calling the display screen to play the video.
  • the above video player can be called a foreground application running on the first electronic device.
  • the first electronic device may detect whether there is a user operation on the floating ball within a preset time. When no user operation on the floating ball is detected within a preset time, the first electronic device can hide the floating ball to reduce the display area of the floating ball and reduce the blocking of the foreground application by the floating ball.
  • the above preset time is long, such as 5 seconds and so on. The embodiments of the present application do not limit this.
  • the first electronic device can aggregate the multiple hidden floating balls and display one aggregated floating ball, thereby further reducing the display area of the floating balls and reducing the suspension.
  • the ball blocks the foreground application interface.
  • FIG. 2A-FIG. 2B exemplarily illustrate the user interface of the first electronic device hiding the floating ball.
  • the interface includes a window 211 and a floating ball 212 .
  • the window 211 can display the home page of the first electronic device and the user interface provided by the application program.
  • the above-mentioned application programs refer to applications installed on the first electronic device other than the application program associated with the floating ball 212 .
  • the content displayed in the window 211 may indicate that the first electronic device is executing a video playback application.
  • the first electronic device may generate and display the flight floating ball.
  • the floating ball 212 may represent the above-mentioned flight floating ball.
  • the above display conditions are, for example: 1.
  • the first electronic device is currently located within the geographical range of the departure airport where the user booked the flight; 2.
  • the current system time of the first electronic device is within the waiting time range of the user's booked flight.
  • the above-mentioned waiting specifically refers to the process in which users complete the security check and wait for boarding at the boarding gate.
  • the above display conditions are extracted based on the characteristics of flight services.
  • the flight floating ball can be associated with the flight application on the first electronic device.
  • the application icon in the floating ball 212 may indicate the flight application associated with the above-mentioned flight floating ball.
  • the prompt information in the floating ball 212 can facilitate the user to quickly obtain important flight information in the current scenario.
  • the above-mentioned current environment may be a scene where the user is about to board a plane.
  • the user can quickly obtain the boarding gate information for the upcoming boarding process, that is, the user can obtain the flight information without entering the above-mentioned flight application.
  • the above-mentioned entering the flight application means that the first electronic device runs the flight application and displays the user interface provided by the flight application.
  • the display state of the floating ball 212 with the application icon and prompt information displayed in FIG. 2A can be called the expanded state of the floating ball.
  • the display area occupied by the floating ball 212 is larger, which may reduce the user experience of using other applications.
  • these multiple expanded floating balls occupy a larger display area in the entire display window, which affects the front-end application interface (the application that is using window 211 to play videos)
  • the occlusion is more serious, which greatly affects the user experience.
  • the first electronic device detects whether there is a user operation on the floating ball 212 within 5 seconds after the floating ball 212 is displayed.
  • the above 5 seconds is an exemplary preset time.
  • the first electronic device can push the above-mentioned floating ball 212 to the right side of the screen and only display the floating ball 212
  • the display area occupied by the floating ball 212 in Figure 2B is significantly reduced, thereby reducing the occlusion of the application currently running in the foreground and improving the user experience.
  • the display state of the floating ball 212 in FIG. 2B can be called the abbreviated state of the floating ball.
  • the process in which the first electronic device shown in FIG. 2A to FIG. 2B changes the floating ball from the expanded state to the reduced state to reduce the display area of the floating ball can be called the first electronic device hiding the floating ball.
  • 2C-2E exemplarily illustrate the user interface of the first electronic device that aggregates multiple abbreviated floating balls.
  • the first electronic device can display multiple expanded floating balls, such as flight floating balls 212 , subway floating balls 213 , and travel floating balls 214 .
  • the flight suspension ball 212 can be referred to the foregoing introduction and will not be described in detail here.
  • the subway floating ball 213 can be used to display the subway bus code.
  • the travel floating ball 214 can be used to display information such as the arrival time of the user's scheduled online taxi or the time to arrive at the designated destination. Different types of suspended balls will be introduced in detail later.
  • the first electronic device can Change the floating ball from the expanded state to the abbreviated state.
  • the first electronic device can aggregate the multiple suspended balls into one during the process of changing the multiple suspended balls to the reduced state, which is called polymerized state suspension. ball.
  • the flight floating ball 212, the subway floating ball 213, and the travel floating ball 214 can all enter the abbreviated state.
  • multiple abbreviated floating balls are detected, and the first electronic device can aggregate the flight floating balls 212, subway floating balls 213, and travel floating balls 214 that have entered the abbreviated state into one, and then display this floating ball.
  • the suspended ball 215 in Figure 2E This suspended ball can be called a polymeric suspended ball.
  • the first electronic device can also be a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, personal computer, etc.
  • Digital assistant personal digital assistant, PDA
  • augmented reality (AR) device virtual reality (VR) device
  • artificial intelligence artificial intelligence, AI
  • wearable device wearable device
  • vehicle-mounted device smart home equipment and/or smart city equipment.
  • FIG. 3A illustrates an exemplary floating ball corresponding to different business scenarios that may be displayed on the first electronic device.
  • the floating ball 301 may represent a flight floating ball that provides flight service notifications.
  • the flight floating ball can be associated with a flight application installed on the first electronic device that provides flight inquiry, flight booking and other services.
  • the information displayed in the flight floating ball can come from the above-mentioned flight applications.
  • the first electronic device may display all flight information of the scheduled flight. Subsequent embodiments will be introduced in detail and will not be elaborated here.
  • the floating ball 302 (that is, the subway floating ball 213 in FIG. 2C mentioned above) can represent a subway floating ball that provides a service of quickly displaying subway bus codes.
  • the subway floating ball can be associated with a subway application installed on the first electronic device that provides subway inquiry, display of subway bus codes and other services.
  • the information displayed in the subway floating ball can be derived from the above-mentioned subway applications.
  • the first electronic device can display the subway ride code, thereby providing the user with a quick code-scanning ride service.
  • the floating ball 303 may represent a translation floating ball that provides translation services.
  • the translation floating ball can translate the copied content recorded in the clipboard of the first electronic device into text expressed in a common system language of the first electronic device.
  • the first electronic device may display a translation page.
  • the above-mentioned translation page may display the above-mentioned copied content and the text of the above-mentioned copied content expressed in a common system language.
  • the floating ball 304 may represent a navigation floating ball that provides map navigation services.
  • the first electronic device can identify the copied location in the clipboard and then generate a navigation floating ball.
  • the navigation floating ball can be associated with an application installed on the first electronic device that provides map display and navigation services, and use the application to determine a route from the current location of the first electronic device to the copied location.
  • the first electronic device may display a navigation page.
  • the navigation page may display a route from the current location of the first electronic device to the above location. Therefore, users can obtain quick navigation services through the above navigation page.
  • the floating ball 305 may represent a call floating ball that provides a quick dialing service.
  • the first electronic device can identify the copied phone number in the clipboard and then generate a call floating ball.
  • the call floating ball can be associated with the call application installed on the first electronic device.
  • the first electronic device can call the above-mentioned copied phone number, thereby providing the user with a quick dialing service.
  • the floating ball 306 may represent a split-screen floating ball that provides split-screen services.
  • the above-mentioned split screen refers to running two applications at the same time on one mobile phone screen and displaying the window views provided by the two applications.
  • the first electronic device also supports adjusting the relative window size of the two applications. It is not limited to two applications, but can also be three or even more applications. The embodiments of the present application do not limit this.
  • the first electronic device may detect user operations in which the user frequently switches between two or more application programs. For example, switching from application A to application B and then to application A frequently changes the operation of the foreground application. At this time, the first electronic device can generate a split-screen floating ball, that is, the floating ball 306 . When detecting a user operation on the floating ball 306, the first electronic device may divide the mobile phone screen into multiple windows. A window displays a view provided by an application. At this time, the split-screen floating ball can prompt the user to display application A and application B in split-screen mode.
  • Application A and Application B are both applications that support split-screen display.
  • the floating ball 307 may represent an express floating ball that provides express delivery inquiry services.
  • the express floating ball can be associated with an express application installed on the first electronic device that provides express inquiry services.
  • the user's express code can be displayed in the express floating ball.
  • the express delivery information displayed in the express floating ball can be derived from the above-mentioned express application.
  • the first electronic device can display more information about the express delivery order, such as content type, content picture, sender, shipping address, etc.
  • the floating ball 308 may represent a takeout floating ball that provides takeout order notifications.
  • the express floating ball can be associated with a takeout application that provides takeout services installed on the first electronic device.
  • the takeaway floating ball can display the remaining delivery time of the takeout ordered by the user.
  • the delivery time information displayed in the take-out floating ball can come from the above-mentioned take-out application.
  • the first electronic device can display more information about the takeout order, such as product list, order number, merchant contact information, receiving address, etc.
  • the floating ball 309 (that is, the floating ball 214 in Figure 2C mentioned above) can represent a travel floating ball that provides online ride-hailing notifications.
  • the travel floating ball can be associated with a travel application that provides taxi services installed on the first electronic device.
  • the travel floating ball can display information such as the arrival time of the user's scheduled online taxi or the time to arrive at the designated destination.
  • the arrival time of online taxis displayed in the travel floating ball can be derived from the above travel applications.
  • the first electronic device can display more information about the above-mentioned travel order, such as order number, vehicle location, departure place, destination, driver contact information, license plate, etc.
  • the first electronic device can set different termination mechanisms (disappearance mechanisms) for different floating balls, so as to not only satisfy the fast services provided by the floating balls, but also avoid redundant display and impact. User browsing experience.
  • the first electronic device may change the suspended ball in the expanded state to The abbreviated state is a floating ball that hides the above expanded state. Then, when the business in the application program associated with the floating ball is completed, the first electronic device can terminate displaying the above-mentioned floating ball. After termination, the first electronic device no longer displays the above-mentioned floating ball.
  • the first electronic device may also directly terminate the suspended ball.
  • the first electronic device can display the expanded floating ball 301. After displaying the expanded floating ball 301 for a period of time, such as 5 seconds, and the first electronic device does not detect a user operation on the floating ball 301 within the above period of time, the first electronic device can display the expanded floating ball 301 . 301 is adjusted to abbreviated form. After detecting that the user has boarded the plane, the first electronic device may terminate display of the floating ball 301 .
  • the first electronic device can display the floating ball 304 in an expanded state. After displaying the expanded floating ball 304 for a period of time, and the first electronic device does not detect a user operation on the floating ball 304 within the above period of time, the first electronic device may adjust the expanded floating ball 301 to a reduced state. A brief attitude. After displaying the abbreviated floating ball 304 for a period of time, and the first electronic device does not detect a user operation on the floating ball 304 within the above period of time, the first electronic device may terminate displaying the floating ball 304 .
  • the corresponding time for different types of suspended balls to change from the expanded state to the abbreviated state or terminate may be the same or different, and the time from the abbreviated state to being terminated may be the same or different, and the embodiments of the present application do not limit this.
  • the above-mentioned floating ball that is terminated because no user operation on the floating ball (navigation floating ball) is detected can be called a transient floating ball.
  • the first electronic device can remind the user which suspended balls are transient suspended balls through the countdown ring, thereby reminding the user to promptly obtain the fast service provided by the above-mentioned transient suspended balls, so as to avoid being unable to re-obtain the above-mentioned transient suspended balls after the transient suspended balls are terminated. ball, and thus cannot obtain the fast service provided by the above-mentioned transient suspension ball.
  • FIG. 3B illustrates an exemplary transient floating ball that may be displayed on the first electronic device.
  • the first electronic device may change the suspended ball in the expanded state to the abbreviated state.
  • the navigation floating ball can be changed from the state shown by the floating ball 304 to the state shown by the floating ball 314 .
  • the first electronic device When displaying the abbreviated navigation floating ball, if no user operation on the navigation floating ball (floating ball 304) is detected within a preset time, the first electronic device will terminate displaying the navigation floating ball. That is to say, the above-mentioned navigation floating ball is a transient floating ball.
  • the first electronic device may additionally display a countdown ring on the application icon in the navigation floating ball, such as the ring 31 in the floating ball 314 in Figure 3B .
  • the countdown ring becomes a complete ring.
  • the ring can gradually decrease counterclockwise from the 12 o'clock position, referring to the state of the suspended ball 324 in Figure 3B.
  • the countdown ring disappears, the countdown ends, and the first electronic device can stop displaying the floating ball 314.
  • the timing duration of the countdown ring is the duration during which the first electronic device displays the floating ball 314 in the abbreviated state.
  • the dial floating ball when the dial floating ball is a temporary floating ball, the dial floating ball (floating ball 305) that enters the abbreviated state can be as shown in the floating ball 315, and then become as shown in the floating ball 325; when the screen is split
  • the split-screen suspended ball (suspended ball 306) that enters the abbreviated state may be as shown in the suspended ball 316, and then become as shown in the suspended ball 326.
  • the first electronic device is not limited to the transient suspended ball shown in Figure 3B.
  • the first electronic device can also configure other types of suspended balls in Figure 3A as transient suspended balls. This is not limited in the embodiment of the present application.
  • Figures 4A to 4H, Figures 5A to 5I, and Figures 6A to 6I show the user interface of the first electronic device for implementing the suspended ball processing method in the multi-task scenario provided by the embodiment of the present application.
  • under. 4A-4H exemplarily illustrate a user interface of a group of first electronic devices displaying multiple suspended balls in a multi-tasking scenario.
  • FIG. 4A shows a user scenario in which a user uses a video playing application to watch a video.
  • the application program video player
  • the application program currently running in the foreground may be called the application program currently running in the foreground.
  • the views or controls displayed in window 411 are provided by the above-mentioned video player.
  • the first electronic device can obtain the current location of the first electronic device in real time and record it as the current location.
  • the embodiments of this application do not limit the specific method by which the first electronic device obtains the current location.
  • the first electronic device can obtain the current position using the global positioning system (GPS), the global navigation satellite system (GLONASS) or the Beidou navigation satellite system (BDS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • the first electronic device may also obtain the current location using a positioning method based on a location fingerprint of a base station signal and/or a high-fidelity wireless communication (wireless fidelity, Wi-Fi) signal.
  • wireless fidelity wireless fidelity
  • the first electronic device can confirm whether the current location is within the geographical range of the subway station and/or the geographical range of the airport.
  • the current location of the first electronic device within the geographical range of the subway station may indicate that the user is currently in the subway station.
  • the current location of the first electronic device within the geographical range of the airport may indicate that the user is currently in the airport.
  • the geographical scope of the above-mentioned subway station and the geographical scope of the airport can be determined through the above-mentioned positioning service. This will not be described again in the embodiments of this application.
  • the first electronic device may display a subway floating ball in the window 411, such as the floating ball 412 shown in FIG. 4B.
  • the first electronic device can also display a flight floating ball in the window 411, such as the floating ball 413 shown in Figure 4C.
  • the first electronic device may display the later generated suspended ball on top of the earlier generated suspended ball. For example, if the first electronic device first determines that the current location is within the geographical range of a subway station, the first electronic device may first generate a subway floating ball (floating ball 412). Then, the first electronic device can generate a flight floating ball (floating ball 413) within the geographical range of the airport according to the current location. At this time, the above-mentioned subway floating ball is a newly generated floating ball, and the above-mentioned flight floating ball is a later generated floating ball. During the process of displaying the flight suspension ball, the first electronic device can move the subway suspension ball downward, and then display the flight suspension ball at the position where the subway suspension ball was originally displayed.
  • the first electronic device can display the above-mentioned subway floating ball at a position of 1/4 from the top to the bottom of the screen.
  • the first electronic device can move the subway floating ball toward the bottom of the screen, and display the flight floating ball at the position where the subway floating ball was originally displayed (1/4 of the screen from top to bottom).
  • the above-mentioned initial display position that is, the position of 1/4 of the screen from top to bottom, is preset.
  • the first electronic device can also set other initial display positions. The embodiments of the present application do not limit this.
  • both the subway floating ball (floating ball 412) and the airline floating ball (floating ball 413) are expanded floating balls.
  • the first electronic device can detect a user operation on the floating ball, such as a click operation. In response to the above user operation, the first electronic device may display more information associated with the currently displayed content of the floating ball.
  • the first electronic device can detect the user operation of clicking the floating ball 413 .
  • the first electronic device may display the user interface shown in FIG. 4E.
  • FIG. 4E exemplarily shows a user interface of the first electronic device displaying the boarding pass.
  • the interface can display the flight number (SF1314), departure point (Shenzhen Baoan Airport T3), destination (Beijing Daxing Airport T3), departure time (9:00), landing Time (13:20), check-in counter (G07), boarding gate (52K), seat number (S-18D) and other flight information.
  • SF1314 flight number
  • departure point Shenzhen Baoan Airport T3
  • destination Beijing Daxing Airport T3
  • departure time 9:00
  • landing Time 13:20
  • check-in counter G07
  • boarding gate 52K
  • seat number S-18D
  • the first electronic device can also display a subway floating ball (floating ball 412) when displaying the boarding pass. In this way, the user can directly obtain the subway ride QR code through the floating ball 412.
  • a subway floating ball floating ball 412
  • the user interface shown in FIG. 4E also includes a control 421.
  • the first electronic device may display the user interface shown in FIG. 4D.
  • the first electronic device may display other interfaces provided by the flight application associated with the flight floating ball, such as a ticket inquiry interface and so on.
  • the first electronic device may detect a user operation of clicking the floating ball 412 .
  • the first electronic device may display the user interface shown in FIG. 4H.
  • the interface may display a QR code 422.
  • the above QR code can be a subway QR code.
  • the user can use the above-mentioned QR code 422 to quickly scan the code to enter the station (subway station), thereby providing convenience for the user to travel by subway.
  • the above-mentioned QR code can also be a bus ride code, etc., and the embodiment of the present application does not limit this.
  • the above-mentioned floating ball may also be a floating ball corresponding to an application used for payment.
  • the first electronic device may display a barcode for payment. Not limited to QR codes and barcodes, the first electronic device can also be adapted to other business scenarios and display other graphic codes.
  • the first electronic device can also display a flight floating ball (floating ball 413) when displaying the QR code.
  • a flight floating ball floating ball 413
  • the first electronic device can move other floating balls displayed on the screen, such as the floating ball 413, outside the area where the QR code is displayed, see Figure 4J to avoid blocking the QR code. code, thereby hindering QR code recognition.
  • the user interface shown in Figure 4H also includes a control 423.
  • the first electronic device may display the user interface shown in FIG. 4C.
  • the first electronic device may display other user interfaces provided by the subway application associated with the subway floating ball.
  • the first electronic device can hide the suspended ball in the expanded state, that is, the suspended ball in the expanded state is suspended.
  • the ball is adjusted to a miniature floating ball to reduce the display area, avoid blocking the foreground application, and thereby improve the user experience.
  • the first electronic device may monitor whether there is a user operation of clicking the floating ball 412 within a preset time.
  • the above preset time can be 5 seconds.
  • the above-mentioned preset time corresponding to different suspended balls may be the same or different.
  • the embodiment of the present application does not limit the specific length of the above-mentioned preset time. For example, in the introduction of subsequent embodiments, the above-mentioned preset time is all 5 seconds.
  • the first electronic device When detecting a user operation of clicking the floating ball 412, the first electronic device may display the boarding pass interface corresponding to the floating ball 412. On the contrary, if the user operation of clicking the floating ball 412 is not detected within the preset time, the first electronic device can push the expanded floating ball 412 to the right side of the screen to hide the floating ball 412, as shown in FIG. 4K, which is about to be suspended. Ball 412 changes to abbreviated form.
  • the first electronic device can monitor whether there is a user operation of clicking the floating ball 413 within a preset time. If the user operation of clicking the floating ball 413 is not detected, the first electronic device may also change the floating ball 413 to a thumbnail state.
  • the first electronic device can aggregate the multiple abbreviated states to display one aggregated suspended ball. Specifically, when adjusting an expanded suspended ball to a reduced state, the first electronic device can detect whether a reduced suspended ball is already displayed on the current screen. When detecting the suspended ball that has been displayed in the abbreviated state, the first electronic device can aggregate the suspended ball that is about to be adjusted to the abbreviated state with the existing suspended ball in the abbreviated state, and then display an aggregated suspended ball. ball.
  • the floating ball 412 and the floating ball 413 can enter the abbreviated state one after another.
  • the first electronic device displays the floating ball 412 first, so the floating ball 412 can enter the abbreviated state first.
  • the first electronic device may detect that the thumbnail state of the floating ball 412 is already displayed on the current screen.
  • the first electronic device can aggregate the suspended ball 412 and the suspended ball 413 into one suspended ball, refer to the suspended ball 414 in FIG. 4L , thereby greatly reducing the blocking of the screen by the suspended ball.
  • the aggregated suspended ball 414 may display the application icon of the last suspended ball that enters the abbreviated state.
  • the suspended ball 413 is the last suspended ball that enters the abbreviated state.
  • the aggregated abbreviated suspended ball 414 may also display an icon specifically indicating the aggregated suspended ball. The embodiments of the present application do not limit this.
  • the first electronic device still maintains multiple suspended balls.
  • the user can instruct the first electronic device to re-display the plurality of suspended balls by operating on the aggregated suspended balls, thereby allowing the user to select the currently needed suspended ball and obtain the services provided by the suspended ball.
  • the first electronic device can detect a user operation, such as a click operation, on the floating ball 414 .
  • the first electronic device may display the user interface shown in FIG. 4N.
  • the first electronic device can re-display the suspended balls 412 and 413 before polymerization. In this way, the user can click on the floating ball 412 or the floating ball 413 to obtain the subway code or boarding pass.
  • the first electronic device can also monitor whether the user performs a preset specific operation. When the above-mentioned specific operation is detected, the first electronic device may display a suspended ball matching the above-mentioned specific operation.
  • under. 5A to 5I exemplarily illustrate a user interface in which the first electronic device displays a translation floating ball or a navigation floating ball that matches the copying operation according to the preset copying operation.
  • FIG. 5A exemplarily shows the user interface of the first electronic device displaying an English page.
  • the window 411 may display a news report expressed in English.
  • an aggregated floating ball 414 is also displayed in window 411 .
  • the suspended ball 414 can be the same as the suspended ball 414 in Figure 4G, and the suspended ball 414 can include a flight suspended ball and a subway suspended ball.
  • the suspension ball 414 in Figure 5A can be referred to the introduction of the suspension ball 414 in Figure 4G, and will not be described again here.
  • the first electronic device can detect a user operation on the English text in the window 411 , such as a long press operation, a frame selection operation, etc.
  • the first electronic device may detect a user operation acting on "Hainan International Convention and Exhibition Center”.
  • the first electronic device may display the menu bar 511.
  • Menu bar 511 may include a "Copy” button. The "Copy” button can be used to copy the text selected by the user above ("Hainan International Convention and Exhibition Center").
  • the first electronic device After detecting the user operation on the "Copy” button, the first electronic device can identify the language used in the text selected by the user. Then, the first electronic device can determine whether the user is browsing foreign language articles or other content expressed in foreign languages by comparing the language used in the text selected by the user with the common language set by the system.
  • the above-mentioned foreign languages refer to other types of languages that are different from the commonly used languages of the system. When the system common language is set to Chinese, the English shown in Figure 5A can be called a foreign language. Other languages such as Japanese, German, French, etc. that are different from the commonly used language "Chinese" in the above system can also be called foreign languages.
  • the first electronic device can display and translate the floating ball.
  • the translation floating ball can provide users with translation services.
  • the first electronic device may determine that the language used in the copied text is not the system common language. At this time, the first electronic device can display the translation floating ball, that is, the floating ball 512.
  • the first electronic device may detect user operations on the floating ball 512 .
  • the first electronic device may display the user interface shown in FIG. 5D.
  • the user interface may include controls 521, 522, text boxes 523, and text boxes 524.
  • the control 521 may display the language used by the copied text recognized by the first electronic device.
  • the control 522 may display common languages set in the first electronic device.
  • Text box 523 may display the copied text ("Hainan International Convention and Exhibition Center").
  • the text box 524 may display the translation result, that is, the expression in the system common language ("Hainan International Convention and Exhibition Center") corresponding to the copied text in a non-system common language.
  • the first electronic device can also display a window in FIG. 5C.
  • the translation results are displayed in this window.
  • the window automatically resizes itself based on the display area required for the translation results. In this way, the first electronic device can quickly and directly display the translation result through the window, and can also minimize the obstruction of the content displayed in Figure 5C by the translation result.
  • the first electronic device may also identify whether the text is an address. When it is confirmed that the above text is the address, the first electronic device may also display a navigation floating ball.
  • the navigation floating ball can be associated with a map application installed on the first electronic device, and obtain positioning services, route planning services, navigation services, etc. provided by the above-mentioned map application. Users can use the above-mentioned navigation floating ball to quickly and easily obtain the route between the current location and the above-mentioned address.
  • the first electronic device can also display a navigation floating ball , with reference to the suspended ball 513 shown in Figure 5E.
  • the above-mentioned copied address may be expressed in a commonly used system language or may be expressed in a non-system commonly used language.
  • the first electronic device can translate the above-mentioned text expressed in a non-system commonly used language into a text expressed in a system commonly used language.
  • the first electronic device may detect the user operation on the floating ball 513 .
  • the first electronic device may display the user interface shown in FIG. 5G.
  • the user interface can display directions from the user's current location to the identified address.
  • the interface displays: location A and location B.
  • the location A may be the current location (current location) of the first electronic device; the location B may be the location recognized by the first electronic device from the copied text, such as the "Hainan International Convention and Exhibition Center” identified above.
  • Figure 5G also shows two routes from location A to location B: route 1 and route 2.
  • the user interface shown in Figure 5G may also display the aggregated floating ball 414, and may not display the transient floating ball 512 of the recommended translation service.
  • the first electronic device may also identify whether the text is a phone number. When recognizing that the above text is a phone number, the first electronic device may also display a call floating ball.
  • the call floating ball can be associated with the call application installed on the first electronic device. When a user operation on the call floating ball is detected, the first electronic device can call the above-mentioned copied phone number, thereby providing the user with a quick dialing service.
  • the first electronic device may also detect user operations in which the user frequently switches between two or more application programs. In response to the above operation, the first electronic device displays the split-screen floating ball.
  • the split-screen floating ball can provide users with quick and separate services.
  • the first electronic device may divide the mobile phone screen into multiple windows. A window displays a view provided by one of two or more of the above applications.
  • the first electronic device can also identify other specific operations and display a suspended ball matching the above specific operations. No more examples will be given here.
  • the first electronic device can determine requirements that are strongly related to the above specific operation. Then, the first electronic device can display the floating ball that meets the above user needs.
  • the first electronic device may determine that the user has a need to translate the text in a language not commonly used by the system. Therefore, the first electronic device can display the translation floating ball, so that the user can quickly and conveniently obtain the translation result through the translation floating ball, providing convenience for the user to browse the foreign text.
  • the navigation floating ball may be a transient floating ball.
  • the first electronic device may detect whether there is a user operation on the floating ball within a preset time. After the above-mentioned preset time is over, the first electronic device can gradually hide the above-mentioned floating ball. Referring to the user interface shown in FIG. 5H , the floating ball 512 and the floating ball 513 gradually move to the right and gradually collapse or reduce the display area of the prompt information, that is, enter the hidden state.
  • the first electronic device may detect whether there is a thumbnail state of the floating ball in the current screen.
  • the first electronic device can aggregate the non-transient suspended ball and the suspended ball in abbreviated state to display a suspended ball in abbreviated state.
  • This abbreviated suspended ball includes the above-mentioned suspended balls in all abbreviated states.
  • the first electronic device can adjust the floating ball 512 to the abbreviated state, as shown in FIG. 5H The suspended ball 512.
  • the first electronic device can aggregate the suspended ball 512 and the suspended ball 414 in the abbreviated state to obtain a new suspended ball in the abbreviated state.
  • the application icon displayed in the floating ball 514 may be the application icon of the last floating ball 512 that enters the abbreviated state.
  • the first electronic device can hide the translation floating ball in time to avoid affecting the user's browsing experience when browsing the page.
  • the user wants to view the translation results, he can click on the abbreviated floating ball 514 to instruct the first electronic device to re-display the hidden translation floating ball (floating ball 512), and then view the translation results through the above-mentioned translation floating ball.
  • the translation floating ball may enter the abbreviated state.
  • the first electronic device may terminate displaying the translation floating ball.
  • the first electronic device may also stop displaying the translation floating ball after a period of time. The above period of time is, for example, 3 minutes. This is not shown in the embodiment of the present application.
  • the first electronic device when the quick service provided by the floating ball displayed by the first electronic device according to the user's specific operation is not what the user currently needs, the first electronic device can shrink the above-mentioned floating ball in a timely manner to avoid occlusion, thereby improving the user's Use experience.
  • the first electronic device can re-display the above-mentioned floating ball, thereby providing the user with the quick service the user needs.
  • the first electronic device displays a translation floating ball based on the operation of copying text expressed in a language not commonly used by the system.
  • the first electronic device can hide the translation floating ball.
  • the first electronic device can re-display the above-mentioned floating ball, thereby providing the user with the translation service that the user currently needs urgently.
  • the first electronic device may start to terminate the timing and display a countdown ring on the suspended ball.
  • the timer expires, the first electronic device can terminate the display of the above-mentioned floating ball.
  • the first electronic device can adjust the floating ball 513 to a thumbnail state. , to reduce the display area.
  • the floating ball 513 can display a countdown ring.
  • the countdown ring has a timing duration of, for example, 5 seconds.
  • the countdown ring can gradually decrease counterclockwise from the 12 o'clock position. The user can know how long the remaining first electronic device will display the floating ball through the countdown ring, so as to remind the user to click on the floating ball and obtain the quick service provided by the floating ball before the floating ball disappears.
  • the first electronic device may display the user interface shown in FIG. 5G .
  • the first electronic device may terminate the floating ball 513 , that is, the floating ball 513 will no longer be displayed.
  • the floating ball 513 is no longer displayed on the screen.
  • the first electronic device also does not aggregate the floating balls 513 into the abbreviated floating balls 514 .
  • the map application corresponding to the floating ball 513 can plan a route for the user. Thereafter, the suspended ball 513 can be changed into a non-transient suspended ball. Users can enter the navigation page and obtain navigation services at any time through the above-mentioned non-transient floating ball.
  • the first electronic device also supports changing the position of the suspended ball, refer to the user interface shown in Figures 6A-6I.
  • aggregated suspended balls 601 are displayed in the user interface shown in FIG. 6A .
  • the first electronic device can detect user operations on the floating ball 601 .
  • the first electronic device can display all the suspended balls included in the suspended ball 601, referring to FIG. 6B, including the translation suspended ball 611, the flight suspended ball 612, and the subway suspended ball 613.
  • the first electronic device can detect a user operation on any one of the plurality of floating balls. In response to the above operation, the first electronic device can provide the user with a quick service corresponding to the floating ball. Refer to FIG. The user interfaces shown in 4E, Figure 4H, and Figure 5D will not be described again here.
  • the first electronic device can detect the user operation of long pressing the translation floating ball 611 .
  • the above operation may also be a double-click operation, which is not limited in the embodiments of the present application.
  • the first electronic device can shrink the translation suspension ball 611, refer to the translation suspension ball 611 in Figure 6D.
  • the first electronic device can change the display position of the floating ball according to the user's drag operation.
  • the first electronic device may also display the delete control 614.
  • the first electronic device can detect the user operation of moving the translation floating ball 611 to the delete control 614. In response to the above operation, the first electronic device can delete the translation floating ball 611, that is, terminate the display of the translation floating ball 611. .
  • the first electronic device can aggregate the remaining flight floating balls 612 and subway floating balls 613 into a new abbreviated floating ball. The abbreviated floating ball no longer includes the translation floating ball 611.
  • the first electronic device can also detect the user operation of dragging the translation floating ball 611 to the lower left of the screen. After the movement is completed, the first electronic device may display the user interface shown in Figure 6H. At this time, the direction translation floating ball 611, the flight floating ball 612, and the subway floating ball 613 originally displayed in the upper right corner of the screen have all been moved to the lower left corner of the screen.
  • the first electronic device After displaying the user interface shown in Figure 6H, if a user operation on any of the above-mentioned floating balls is detected within a preset time, the first electronic device can again aggregate the above-mentioned three floating balls into an abbreviated state. of suspended balls, refer to Figure 6I.
  • the first electronic device can also detect the user operation of dragging the floating ball 601. After the movement is completed, the first electronic device can display the aggregated suspended ball 601 at the moved position, see FIG. 6L.
  • the user can arbitrarily adjust the position of the currently displayed floating ball, thereby minimizing the blocking of the currently displayed user interface by the floating ball and improving the user experience.
  • the first electronic device can support displaying multiple suspended balls.
  • the first electronic device has no limit on the number of suspended balls that support display.
  • the first electronic device can display 6 floating balls: in addition to the translation floating ball 611, flight floating ball 612, and subway floating ball 613 introduced above, it also includes a takeaway floating ball 615, a travel floating ball 616, Express suspended ball 617.
  • the above-mentioned takeout floating ball 615 is a floating ball generated after detecting that the user uses the takeout application to order food, and is used to prompt the takeout ordering process.
  • the user can obtain the ordering process through the above-mentioned floating ball. For example, the user can know through the "4:20 remaining" displayed in the floating ball 615 that the takeaway will be delivered in about 4 minutes and 20 seconds.
  • the travel floating ball 616 is a floating ball that is generated after detecting that the user uses the travel application to book a taxi and is used to prompt the taxi booking process. For example, the user can know that the scheduled taxi will arrive at the departure point in 6 minutes through "6:00 remaining" displayed in the floating ball 615 .
  • the express floating ball 617 can be used to remind users of delivered express delivery.
  • the first electronic device can completely display five suspended balls in an expanded state without overlapping.
  • the first electronic device can fold the remaining floating balls behind the fifth floating ball.
  • the first electronic device can fold and display the floating ball 617 behind the fifth floating ball (the floating ball 616), that is, display part of the floating ball 617 (the floating ball 617 is partially covered by the floating ball 616).
  • the first electronic device can detect the sliding operation acting on the suspended ball area. In response to the above operation, the first electronic device may display the covered floating ball.
  • the first electronic device may detect a user operation of sliding upward on the floating ball area.
  • the first electronic device may display the folded express floating ball 617, see FIG. 6O.
  • the first electronic device can fold the translation floating balls 611 beyond the complete display number.
  • the first electronic device can display multiple suspended balls, thereby avoiding the problem that the user cannot obtain the suspended ball he wants at any time due to the limitation of the number of suspended balls, and thereby obtain the quick operation provided by the suspended ball.
  • the subway floating ball 412 can be called the first floating ball, and the flight floating ball 413 can be called the second floating ball.
  • the icon of the subway application displayed on the subway floating ball 412 may be called the logo of the first application.
  • the subway station information and subway ride code instructions displayed on the subway floating ball 412 can be called the first information.
  • the icon of the flight application displayed in the flight floating ball 413 may be called the logo of the second application.
  • the boarding gate information and electronic boarding pass indication information displayed in the flight floating ball 413 can be called second information.
  • the subway floating ball 412 when the user operation of clicking the subway floating ball 412 is not detected within a period of time when the subway floating ball 412 is displayed, the subway floating ball 412 can be changed to an abbreviated state.
  • the above period of time may be called the first duration.
  • the flight floating ball 413 When the user operation of clicking the flight floating ball 413 is not detected within a period of time when the flight floating ball 413 is displayed, the flight floating ball 413 may be changed to an abbreviated state.
  • the above period of time may be called the second period of time.
  • the first duration and the second duration may be equal, such as 5 seconds, or may not be equal.
  • the suspended ball 414 obtained by aggregating the subway suspended ball 412 and the airline suspended ball 413 can be called the third suspended ball.
  • the overlapping style icon displayed in floating ball 414 may indicate that the floating ball is an aggregated floating ball.
  • the above-mentioned overlapping style icon may be called a third floating ball and includes indication information.
  • the electronic device detects a user operation acting on the floating ball 414, which may be called a first user operation.
  • the electronic device when the electronic device detects a user operation on the subway floating ball 412, it may be called a second user operation.
  • the page shown in Figure 4H may be called the first page.
  • the information displayed on the page shown in Figure 4H may be called third information.
  • the subway floating ball 412 and the flight floating ball 413 are the first floating ball and the second floating ball respectively.
  • the suspended ball 616 can be called the fourth suspended ball, and the suspended ball 617 can be called the fifth suspended ball.
  • the slide-up operation shown in FIG. 6N can be called a third user operation. After performing the above operation, the suspended ball 617 is no longer covered by the suspended ball 616.
  • the translation floating ball 513 may also be called the first floating ball.
  • the time from when the translation suspension ball 513 is displayed in FIG. 5E to when the translation suspension ball 513 is terminated in FIG. 5K may be called the third time period.
  • the time between displaying the translation floating ball 513 in the expanded state in FIG. 5E and displaying the translation floating ball 513 with countdown in the abbreviated state in FIG. 5I can be called the fourth time length.
  • the floating ball 616 may be called a first floating ball or a second floating ball, and the user's operation of dragging the floating ball 616 may be called a fourth user operation.
  • the position where the user stops dragging shown in FIG. 6G may be called the first position.
  • the software system of First Electronic Equipment can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture.
  • the embodiment of the present invention takes the Android system with a layered architecture as an example to illustrate the software structure of the first electronic device.
  • FIG. 7 schematically shows a software structure block diagram of a first electronic device implementing the suspended ball processing method in a multi-task scenario provided by an embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has clear roles and division of labor.
  • the layers communicate through software interfaces.
  • the Android system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime (Android Runtime) and system libraries, and kernel layer.
  • the application layer can include a series of application packages. As shown in Figure 7, the application package can include notification applications, gallery, dialer, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
  • the notification application can obtain data reflecting the current status or environment of the first electronic device, and determine whether to display a floating ball matching the above status or environment based on the above data, thus achieving the goal of providing the user with timely Convenient floating ball notification service.
  • the notification application can obtain data reflecting the current status or environment of the first electronic device, and determine whether the first electronic device is in Within the geographical scope of a subway station or the geographical scope of an airport, or identifying whether the first electronic device is performing an operation of copying text in a language not commonly used by the system, etc.
  • the notification application can call the window manager to display the flight floating ball, subway floating ball, translation floating ball, navigation ball that matches the above geographical range or performs a preset specific operation. Suspended balls, etc.
  • the application framework layer provides an application programming interface (API) and programming framework for applications in the application layer.
  • API application programming interface
  • the application framework layer includes some predefined functions.
  • the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
  • a window manager is used to manage window programs.
  • the window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • displaying the user interface shown in Figures 4A-4N, 5A-5K, and 6A-6O depends on the window manager.
  • the window manager can manage the foreground application or desktop, as well as the display position and area of the floating ball, etc.
  • Content providers are used to store and retrieve data and make this data accessible to applications.
  • Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, etc.
  • a view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • displaying the user interface shown in FIGS. 4A-4N, 5A-5K, and 6A-6O also relies on the view system.
  • the view system can manage text controls in the displayed user interface, controls for displaying pictures, etc., such as suspended balls and prompt information in suspended balls.
  • the phone manager is used to provide communication functions of the first electronic device. For example, call status management (including connected, hung up, etc.).
  • call status management including connected, hung up, etc.
  • the notification application displays the call floating ball, and the function of using the call floating ball to dial depends on the call status management service provided by the phone manager.
  • the resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc.
  • the first electronic device can obtain data reflecting the current status or environment of the first electronic device through resources provided by the resource manager, such as current location, system time, clipboard data, and so on.
  • the notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.
  • the floating ball may be a form for the notification manager to display notification content.
  • the notification manager can also display notification content in the form of cards, banners, notification menus when the screen is locked, etc., which are not listed here.
  • Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for the scheduling and management of the Android system.
  • the core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.
  • the application layer and application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and application framework layer into binary files.
  • the virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.
  • System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), three-dimensional graphics processing libraries (for example: OpenGL ES), two-dimensional (2D) graphics engines (for example: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • 2D Graphics Engine is a drawing engine for 2D drawing.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing.
  • the window manager and view system can realize the user display shown in Figure 4A- Figure 4N, Figure 5A- Figure 5K, Figure 6A- Figure 6O through the image drawing and display capabilities provided by the surface manager, 2D graphics engine, and 3D graphics processing library. Interface functionality.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc.
  • the media library can support multiple audio and video encoding formats.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • the display driver can control the display screen on the first electronic device to display according to a preset user interface, for example, display the user interface shown in Figures 4A-4N, 5A-5K, and 6A-6O.
  • Figure 8 exemplarily shows the specific structure of the notification application. The following will combine each software module of the notification application shown in Figure 8 and the services provided by each of the above-mentioned modules in the process of implementing the suspended ball processing method in a multi-task scenario.
  • the notification application may include a perception module, a service identification module, a service module, and a floating ball management module.
  • the sensing module can be used to obtain preset data for determining the current business scenario of the first electronic device in real time.
  • the business identification module can determine whether to trigger the display of the suspended ball and the type of suspended ball to be displayed based on the data obtained by the sensing module.
  • the business module can obtain the corresponding information to be displayed from the application program corresponding to the floating ball according to the type of floating ball determined by the business identification module.
  • the floating ball management module can display the corresponding floating ball based on the data determined when the business module executes the floating ball business.
  • the sensing module can acquire preset data in real time for determining the business scenario in which the first electronic device is currently located.
  • the above-mentioned preset data used to determine the current business scenario of the first electronic device includes but is not limited to: data indicating the working status of the electronic device, order information, and notification messages.
  • the data indicating the working status of the electronic device includes: positioning data indicating the current location of the first electronic device (current location), the current system time of the first electronic device (current time), and reflecting whether the first electronic device is in contact with the user.
  • positioning data indicating the current location of the first electronic device (current location)
  • the current system time of the first electronic device current time
  • reflecting whether the first electronic device is in contact with the user The interaction state of the interaction, and clipboard data indicating whether the user performed a copy operation and what was copied.
  • the first electronic device may obtain information about orders completed by the user using the application from the installed application.
  • the above orders include flight orders, ride-hailing orders, takeout orders, express delivery orders, etc.
  • the first electronic device may also obtain the above order information by identifying the notification of the above application program. For example, when the departure time of the flight booked by the user is approaching, the application installed by the first electronic device and used by the user to book the flight may receive the flight itinerary notification sent by the server.
  • the above-mentioned server refers to a server corresponding to the flight application installed on the first electronic device and providing services such as flight inquiry and flight booking. Based on the above notification, the first electronic device can obtain information about the flight booked by the user, such as flight number, departure place, departure time, etc. Furthermore, the first electronic device can identify that the user is currently at the airport, checking in, waiting for a flight, or other status or action.
  • the sensing module can also sense other data reflecting the status of the first electronic device.
  • the embodiments of the present application do not limit this.
  • the service identification module can determine whether to trigger the floating ball service based on the data obtained by the sensing module.
  • the business identification module can record the specific type of suspended balls and the display conditions of each suspended ball.
  • Table 1 shows the types of suspended balls recorded in the business identification module and the display conditions of each suspended ball.
  • the service identification module can determine whether the current state or environment of the first electronic device triggers a certain type of floating ball according to Table 1.
  • “Business type” includes: flight, subway, translation, navigation, dialing, split screen.
  • the above flight, subway, translation, navigation, dialing and split-screen services respectively correspond to the flight service, subway service, translation service, navigation service, dial-up service and split-screen service introduced in the aforementioned user interface.
  • “Actions” include: show, hide, terminate and expand.
  • the action of displaying the floating ball 412 shown in FIG. 4B can be called a display action.
  • the action of adjusting the floating ball to a thumbnail state (including aggregation) shown in Figure 4K and Figure 4L can be called a hiding action.
  • the action of no longer displaying the floating ball 513 shown in FIG. 5K can be called a termination action.
  • the action of unfolding the thumbnail floating ball 414 shown in FIG. 4M and FIG. 4N can be called an unfolding action.
  • “Current location” includes: airport geographical scope, non-airport geographical scope, subway station geographical scope and non-subway station geographical scope.
  • the above-mentioned “airport geographical range” means that the current location of the first electronic device is within the preset geographical range of the airport.
  • the above-mentioned “non-airport geographical range” means that the current location of the first electronic device is not within the preset geographical range of the airport. within the range.
  • subway station geographical range means that the current location of the first electronic device is within the preset geographical range of the subway station
  • “non-subway station geographical range” means that the current location of the first electronic device is not within the preset subway station. within the geographical scope of the station.
  • the status of "current time” includes: waiting for flight and taking off.
  • the status of the current time as waiting means that the current time is within a period of time before the flight scheduled by the user takes off.
  • the above period of time is, for example, 4 hours before departure.
  • the embodiments of the present application do not limit this.
  • the status of the current time as having taken off means that the current time of the first electronic device is after the flight scheduled by the user takes off (including taking off).
  • Interactive state includes: no operation within the timer, copying, closing the page, switching back and forth, clicking on the floating ball, etc. No operation within the timing period means that the first electronic device does not detect a user operation on the suspended ball.
  • Copying refers to a user operation of copying images and text detected by the first electronic device.
  • Closing the page refers to a user operation of closing the currently displayed page or the page affected by the copy operation detected by the first electronic device.
  • Round-trip switching refers to a user operation of frequent switching between two or more application programs detected by the first electronic device. For example, switching from application A to application B and then to application A frequently changes the operation of the foreground application.
  • Clicking on the floating ball refers to a clicking operation on the abbreviated floating ball on the screen detected by the first electronic device.
  • “Clipboard data” includes: non-system commonly used languages, addresses, and phone numbers.
  • the language used for the data written in "Clipboard Data” is a non-system common language, which can instruct the user to copy foreign text; the data written in "Clipboard Data” is an address. Instruct the user to copy the address; the data written in "Clipboard Data” is a phone number, which can instruct the user to copy the phone number.
  • indicates the data type that the service identification module does not need to consider when determining whether to trigger a service.
  • the value of the data marked with " ⁇ " in the row will not affect the business identification module's judgment of whether to trigger the business in the row. For example, when the business identification module identifies whether to trigger the display of the flight floating ball, the business identification module does not need to pay attention to the data in "interaction status" and "clipboard data". No matter what values are taken for "interaction status" and "clipboard data", it will not affect whether the business identification module identifies whether to trigger the display of the flight floating ball.
  • the first electronic device can obtain the user's flight order from the flight application, or obtain the user's flight order by monitoring the notification of the flight application, and then determine the user's flight information (departure time, departure location, etc.).
  • the business identification module can determine to trigger the display of the flight floating ball.
  • the prompts in the flight floating ball can include check-in counter, boarding gate, seat number and other information.
  • the flight suspension ball can rotate the above information.
  • the business identification module can further distinguish the specific stage of waiting for the flight at the current time, such as the check-in stage, security check stage, and waiting for boarding stage.
  • the flight suspension ball can display the above information according to the above different stages. If the current location is within the geographical range of the airport, the current time is after the departure time, and a flight delay notification is received (or a delay is detected in the flight order obtained from the flight application), the prompt information displayed in the flight floating ball may also include Delay tips.
  • the business identification module may determine to hide the flight floating ball. Flight levitation ball. If the current location is not within the geographical scope of the airport, and the current time is after the departure time of the scheduled flight (the departure time has been reached and the user is no longer within the scope of the airport), the business identification module may determine to terminate the flight suspension ball.
  • the service identification module can determine to trigger the subway service. At this time, the notification application can confirm that the subway floating ball is displayed. When the current location is not within the geographical scope of the subway station, the business identification module can determine to terminate the subway floating ball. Similarly, if no user operation on the subway floating ball is detected within the timing time, the business identification module can determine to hide the subway floating ball and adjust the expanded subway floating ball to the abbreviated state.
  • the business identification module can determine to display the translation floating ball. After the translation floating ball is displayed and the "interaction status" is a closed page, the business identification module may determine to terminate the translation floating ball. Similarly, if no user operation on the translation floating ball is detected within the timing time, the business identification module may determine to adjust the expanded state of the translation floating ball to the abbreviated state.
  • the service identification module can determine to display the navigation floating ball. If no user operation on the subway floating ball is detected within the timing time, the business identification module can determine to adjust the expanded navigation floating ball to the abbreviated state. After entering the abbreviated state, the navigation floating ball can start a new round of timing. After the new round of timing ends and no user operation on the navigation floating ball is detected, the service identification module may determine to terminate the navigation floating ball.
  • the service identification module can determine to display the dial-up floating ball. If no user operation on the subway floating ball is detected within the timing time, the service identification module can determine to adjust the dial-up floating ball in the expanded state to the abbreviated state. After entering the abbreviated state, dial the floating ball to start a new round of timing. After the new round of timing ends and no user operation on the dialing floating ball is detected, the service identification module may determine to terminate the dialing floating ball.
  • the service identification module can determine to display the split-screen floating ball. No user operation on the subway floating ball is detected within the timing time, and the business identification module can determine to adjust the split-screen floating ball in the expanded state to the abbreviated state. After entering the abbreviated state, the split-screen floating ball can start a new round of timing. After the new round of timing ends and no user operation on the split-screen floating ball is detected, the service identification module may determine to terminate the split-screen floating ball.
  • the above-mentioned multiple abbreviated floating balls can also be aggregated into one.
  • the service identification module may determine to expand the hidden floating ball. Further, if the abbreviated suspended ball is an aggregated suspended ball, the business identification module may determine to expand the aggregated suspended ball.
  • the above-mentioned business types also include express delivery business, takeaway business, and ride-hailing business (taxi-hailing travel).
  • the first electronic device can obtain the user's order information from the application program that performs the above business, and then display the corresponding suspended ball.
  • the first electronic device may obtain the user's express delivery order from the express delivery application.
  • the first electronic device can determine to the user that the express delivery service preset in the notification application is met.
  • the first electron can display the express floating ball, see Figure 3A. Users can obtain express delivery tasks through the above-mentioned express floating ball.
  • the express delivery task has been completed, for example, when the express delivery has been signed for, the above-mentioned express floating ball can be terminated.
  • the business module can be divided into subdivision modules such as flight module, subway module, translation module, navigation module, dialing module, and split-screen module.
  • Each segmentation module records the business logic of each segmentation business.
  • the segmentation module can determine the status of the floating ball (show, hide, terminate, expand) and the information that the floating ball needs to display based on the business instruction information issued by the business identification module.
  • the flight module can receive the business instruction information of displaying the flight floating ball.
  • the flight module may first determine the user's flight information.
  • the flight module can obtain the user's order information from the order information module in the perception module.
  • the above order information includes flight information of the booked flight, such as flight number, date, departure place, departure time, etc.
  • the flight module can determine the prompt information in the flight floating ball to be displayed, such as check-in counter, boarding gate, seat number and other flight information.
  • the flight module can confirm page links.
  • the above page link is a link to the page in the flight application that displays the user’s flight order.
  • the flight module can use the above page link to obtain and display the page in the above flight application that displays the user's flight order.
  • the floating ball management module can construct a floating ball based on the data sent by the business module.
  • the data sent by the above-mentioned business module (or the calling parameters of the business module calling the floating ball management module to construct the floating ball) may include: status, floating ball number (ID), display content, and callback interface.
  • the above state is the state of the suspended ball introduced in Table 1, including display, hide, terminate, and expand.
  • the floating ball management module can determine to display, hide, terminate or expand the floating ball based on the above status.
  • the floating ball management module can determine the animation display effect corresponding to the above display, hide, terminate or expand actions.
  • the floating ball ID can be used to label individual floating balls. Thereafter, when the status of the suspended ball needs to be changed, the suspended ball management module can determine the changed suspended ball based on the suspended ball ID.
  • Display content refers to the content directly displayed by the floating ball in the expanded state, including application icons and prompts. Display content can provide users with the most intuitive notification prompts. The application icons and prompts that need to be displayed in the floating balls corresponding to different services are different. For details, please refer to the introduction in Figure 3A and will not be repeated here.
  • the callback interface can be used to return control commands to the business module.
  • the above control command can instruct the business module to perform subsequent operations, such as displaying a jump page, etc.
  • the floating ball management module can return a control command instructing the click operation to the flight module.
  • the flight module can call the window manager to display the flight details page.
  • the above flight details page is obtained by the flight module from the flight application.
  • the above flight details page is, for example, the boarding pass page shown in Figure 4E.
  • the above control command can also trigger running the flight application. In this way, users can obtain flight information for scheduled flights in the user interface provided by the flight application.
  • the first electronic device may also include other types of notification services, such as card notifications and banner notifications.
  • the services provided by the notification application should also include card notifications, banner notifications and other types of notification services.
  • the notification application may also include a notification management module. Refer to the software structure diagram shown in Figure 9.
  • the notification management module may include a floating ball module, a card module, and a banner module. After receiving the service indication information sent by the service identification module, the notification management module may also determine the form of the notification. For example, when the above service indication information indicates flight service, then the notification management module may determine to display the flight floating ball, flight card and flight banner. At this time, the service indication information sent to the flight service by the notification management module also includes notification form indication information. The flight business can determine which form of notification to generate based on the above notification form indication information, that is, floating ball notification, card notification, or banner notification.
  • the flight service can respectively send the notification content (parameters) to the management module corresponding to each notification form.
  • the notification forms of the flight service indicated by the above notification form indication information include floating ball notifications, card notifications and banner notifications.
  • the flight business can send notification content to the floating ball management module, card management module, and banner management module respectively.
  • the floating ball management module, card management module, and banner management module can generate floating balls, cards, and banners displaying the above notification content based on the above notification content.
  • FIG. 10 shows a flow chart of the first electronic device implementing the floating ball processing method in the aforementioned multi-task scenario.
  • the first electronic device can obtain preset data used to determine the current business scenario of the first electronic device in real time.
  • the sensing module in the notification application can complete the above-mentioned action of obtaining data.
  • the above data includes but is not limited to order information, current location, system time, interaction status, clipboard data, etc.
  • order information, current location, system time, interaction status and clipboard data please refer to the introduction in Figure 8 and will not be repeated here.
  • the status data obtained by the sensing module can be shown in the following table (Table 2):
  • Flight order information Flight order A current location Position S system time Time T interaction state copy Clipboard data Hainan International Convention and Exhibition Center
  • the above-mentioned flight order A may represent the order information of a ticket booked by the user obtained by the first electronic device from the flight application, see FIG. 4E .
  • the first electronic device may obtain the user's flight information from the flight order.
  • the above-mentioned location S may indicate that the current geographical location of the first electronic device is location S.
  • the above-mentioned position S may be latitude and longitude data indicating the position.
  • the map application installed on the first electronic device can convert the above-mentioned latitude and longitude data into a location that is easy for the user to understand, such as location A shown in Figure 5G.
  • the above-mentioned location S may also be directly a converted location, such as the above-mentioned location A.
  • the above time T refers to the current time of the first electronic device.
  • the above time T may also represent the time when the first electronic device obtains the above current location, interaction status and clipboard data.
  • the first electronic device may detect the user's interaction with the first electronic device.
  • the above "copy” may indicate that at time T, the first electronic device detects a copy operation on the content displayed on the first electronic device.
  • the first electronic device can also detect click operations, long-press operations, double-click operations, switching applications, etc. that act on controls displayed in the user interface, which will not be listed here one by one.
  • the copied data selected by the user may be written into the clipboard of the first electronic device.
  • the above data includes but is not limited to text.
  • the languages used in the above texts include but are not limited to Chinese, English, Japanese, German, French, etc.
  • the copied text "Hainan International Convention and Exhibition Center" can be written in the clipboard of the first electronic device.
  • the first electronic device uses the floating ball to provide notification services to users.
  • the business scenario of displaying a flight floating ball provides users with quick access to flight information
  • displaying a subway floating ball provides users with a business scenario of quickly obtaining subway QR codes
  • displaying a translation floating ball provides users with instant translation services. Scenes and more.
  • the first electronic device can be set with trigger conditions for various services, that is, display conditions for displaying the corresponding suspended ball.
  • the first electronic device can obtain status data reflecting its own status, and then the first electronic device can determine whether the above-mentioned status data meets the display conditions for displaying a certain type of suspended ball. When satisfied, the first electronic device may determine to display the suspended ball accordingly.
  • the service type and corresponding trigger conditions can be preset in the service identification module (Table 1). After receiving the status data sent by the sensing module, the service identification module queries the services that match the above status data. After querying the service that matches the above status data, the service identification module can send service indication information to the service module.
  • the first electronic device may query Table 1 for services matching the above status data.
  • location S is within the geographic range of airport S1.
  • the above-mentioned airport S1 is the airport where the flight booked by the user takes off.
  • Airport S1 also includes the Airport Metro Station.
  • location S is also within the geographical range of the airport subway station.
  • Time T is within the check-in time range of the flight booked by the user.
  • the business identification module can confirm that the flight floating ball is displayed.
  • the business identification module can also confirm that the subway floating ball is displayed; according to the interaction status "copy" in Table 2 and the English text in the clipboard data, the business identification module can also confirm that the translation floating ball is triggered to be displayed.
  • the service identification module may send service indication information to the service module.
  • the above-mentioned service instruction information may include displaying the flight floating ball instruction information, displaying the subway floating ball instruction information, and displaying the translation floating ball instruction information.
  • the flight module, subway module, and translation module in the business module can respectively receive the above-mentioned flight floating ball indication information, subway floating ball indication information, and translation floating ball indication information.
  • each of the above-mentioned business modules can display, hide, terminate or expand the floating ball corresponding to the business according to the above-mentioned business instruction information and preset business logic.
  • the flight module may determine the user's order information.
  • the above order information includes flight information of the booked flight, such as flight number, date, departure place, departure time, etc.
  • the flight module can determine the prompt information in the flight floating ball to be displayed, such as check-in counter, boarding gate, seat number and other flight information.
  • the flight module can confirm page links.
  • the above page link is a link to the page in the flight application that displays the user’s flight order.
  • the flight module can use the above page link to obtain and display the page showing the user's flight order in the above flight application.
  • the flight module may send the suspended ball parameters to the suspended ball management module.
  • the above-mentioned floating ball parameters include but are not limited to status, business number (ID), display content, and callback interface.
  • the above parameters of the suspended ball can be referred to the introduction in Figure 8 and will not be repeated here.
  • the flight module can send the floating ball parameters to the floating ball management module as shown in the following table (Table 3):
  • S104 Display the suspended ball according to the suspended ball parameters.
  • the suspended ball management module can display, hide, terminate or expand the suspended ball according to the above suspended ball parameters.
  • the suspended ball management module can construct the suspended ball X, such as the flight suspended ball 413 shown in Figure 4C, and control the window manager to display the above suspended ball X.
  • the above-mentioned suspended ball X number may be the suspended ball ID (0001), or other numbers associated with the suspended ball ID.
  • the floating ball management module locates the above-mentioned floating ball X through the floating ball number or the floating ball ID.
  • the floating ball management module can determine that the application icon displayed in the floating ball X is the icon of the flight application.
  • the prompt information displayed in the floating ball displayed user interface can be determined.
  • the prompt information displayed in the floating ball X carousels the above-mentioned check-in counter, boarding gate and seat number.
  • the floating ball X also includes a callback interface A. After detecting the user operation on the floating ball X, the floating ball X can send an instruction signal to the corresponding business module through the above-mentioned callback interface A. For example, in the scenario shown in FIG. 4C , after detecting the user operation on the floating ball 413 , the floating ball 413 can send an instruction signal to the flight module through the callback interface A.
  • the above indication signal can trigger the flight module to display the user interface shown in Figure 4E, or instruct the flight application to run, and then display the user's flight order, etc.
  • the first electronic device detects the current state.
  • the first electronic device can display multiple suspended balls. In this way, the user can obtain the prompt information of multiple floating balls at the same time.
  • Figure 11 shows a schematic diagram of the hardware structure of the first electronic device.
  • the first electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2.
  • Mobile communication module 150 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, And subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the first electronic device.
  • the first electronic device may include more or less components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • the controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the wireless communication function of the first electronic device can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the first electronic device may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.
  • the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G applied on the first electronic device.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194.
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), and global navigation that are applied on the first electronic device. Satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the first electronic device can obtain flight orders in the flight application, display subway ride codes, browse foreign language web pages, etc. based on the communication services provided by the mobile communication module 150 and/or the wireless communication module 160 .
  • the antenna 1 of the first electronic device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the first electronic device can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the first electronic device can realize real-time positioning based on the above-mentioned wireless communication technology, thereby obtaining positioning data indicating the user's current geographical location.
  • the first electronic device implements the display function through the GPU, the display screen 194, and the application processor.
  • the GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 194 is used to display images, videos, etc.
  • Display 194 includes a display panel.
  • Display 194 includes a display panel.
  • the display panel can use a liquid crystal display (LCD).
  • the display panel can also use organic light-emitting diode (OLED), active matrix organic light-emitting diode or active matrix organic light-emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode ( Manufacturing of flex light-emitting diodes (FLED), miniled, microled, micro-oled, quantum dot light emitting diodes (QLED), etc.
  • the electronic device may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the first electronic device displays the user interface shown in Figures 4A-4N, 5A-5K, and 6A-6O relying on the above-mentioned GPU, display screen 194, and application processor. Show ability.
  • the first electronic device can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
  • the internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).
  • RAM random access memories
  • NVM non-volatile memories
  • Random access memory can include static random-access memory (SRAM), dynamic random-access memory (DRAM), synchronous dynamic random-access memory (SDRAM), double data rate synchronous Dynamic random access memory (double data rate synchronous dynamic random access memory, DDR SDRAM, such as the fifth generation DDR SDRAM is generally called DDR5SDRAM), etc.
  • Non-volatile memory can include disk storage devices and flash memory.
  • the random access memory can be directly read and written by the processor 110, can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data, etc.
  • the non-volatile memory can also store executable programs and user and application program data, etc., and can be loaded into the random access memory in advance for direct reading and writing by the processor 110.
  • the code of the notification application may be stored in a non-volatile memory.
  • the first electronic device can load the code of the notification application into the random access memory, and then execute the notification application to implement the floating ball processing method in a multi-task scenario provided by the notification application.
  • the external memory interface 120 can be used to connect an external non-volatile memory to expand the storage capacity of the first electronic device.
  • the external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement the data storage function.
  • the first electronic device can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.
  • the pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals.
  • the gyro sensor 180B may be used to determine the motion posture of the first electronic device.
  • Air pressure sensor 180C is used to measure air pressure.
  • Magnetic sensor 180D includes a Hall sensor.
  • the first electronic device can use the magnetic sensor 180D to implement functions such as magnetic adhesion.
  • the acceleration sensor 180E can detect the acceleration of the first electronic device in various directions (generally three axes). When the first electronic device is stationary, the magnitude and direction of gravity can be detected.
  • the acceleration sensor 180E can also be used to identify the posture of the electronic device.
  • Distance sensor 180F is used to measure distance.
  • Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode.
  • the first electronic device may use the proximity light sensor 180G to detect that the user is holding the first electronic device close to the ear while talking, so as to automatically turn off the screen.
  • the proximity light sensor 180G can also be used to automatically unlock and lock the screen.
  • the ambient light sensor 180L is used to sense ambient light brightness.
  • Fingerprint sensor 180H is used to collect fingerprints.
  • Temperature sensor 180J is used to detect temperature.
  • Touch sensor 180K also known as "touch device”.
  • the touch sensor 180K can be disposed on the display screen 194.
  • the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K.
  • the touch sensor can pass the detected touch operation to the application processor to determine the touch event type.
  • Visual output related to the touch operation may be provided through display screen 194 .
  • the touch sensor 180K may also be disposed on the surface of the first electronic device, at a location different from that of the display screen 194 .
  • the first electronic device detects whether there is a user operation on the controls in the user interface shown in FIGS. 4A-4H, 5A-5I, or 6A-6I, relying on the touch provided by the touch sensor 180K. Test your ability.
  • Bone conduction sensor 180M can acquire vibration signals.
  • the buttons 190 include a power button, a volume button, etc.
  • Key 190 may be a mechanical key. It can also be a touch button.
  • the first electronic device may receive key input and generate key signal input related to user settings and function control of the first electronic device.
  • the motor 191 can generate vibration prompts. When the first electronic device displays the floating ball, the first electronic device can also use the motor 191 to strengthen the prompt.
  • the indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.
  • the SIM card interface 195 is used to connect a SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to realize contact and separation with the first electronic device.
  • the first electronic device may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • UI user interface
  • the term "user interface (UI)” in the description, claims and drawings of this application is a media interface for interaction and information exchange between an application or operating system and a user, which implements the internal form of information. Conversion to and from a user-acceptable form.
  • the user interface of an application is source code written in specific computer languages such as Java and extensible markup language (XML).
  • XML Java and extensible markup language
  • the interface source code is parsed and rendered on the terminal device, and finally presented as content that the user can recognize.
  • Control also called widget, is the basic element of user interface. Typical controls include toolbar, menu bar, text box, button, and scroll bar. (scrollbar), images and text.
  • the properties and contents of controls in the interface are defined through tags or nodes.
  • XML specifies the controls contained in the interface through nodes such as ⁇ Textview>, ⁇ ImgView>, and ⁇ VideoView>.
  • a node corresponds to a control or property in the interface. After parsing and rendering, the node is rendered into user-visible content.
  • applications such as hybrid applications, often include web pages in their interfaces.
  • a web page also known as a page, can be understood as a special control embedded in an application interface.
  • a web page is source code written in a specific computer language, such as hypertext markup language (GTML), cascading styles Tables (cascading style sheets, CSS), java scripts (JavaScript, JS), etc.
  • web page source code can be loaded and displayed as user-recognizable content by a browser or a web page display component with functions similar to the browser.
  • the specific content contained in the web page is also defined through tags or nodes in the web page source code.
  • GTML defines the elements and attributes of the web page through ⁇ p>, ⁇ img>, ⁇ video>, and ⁇ canvas>.
  • GUI graphical user interface
  • Controls can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.
  • Visual interface elements can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) means.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated.
  • the available media may be magnetic media (eg, floppy disk, hard disk, tape), optical media (eg, DVD), or semiconductor media (eg, solid state drive), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种多任务场景下的悬浮球处理方法和电子设备。该方法可应用于手机、平板电脑等电子设备上。当满足预设条件时,电子设备可显示与上述预设条件匹配的悬浮球。电子设备可显示多个满足预设条件的悬浮球,避免在后生成的悬浮球挤占在先生成的悬浮球,从而影响用户体验。同时,电子设备可根据不同悬浮球业务的时效性特点设置个性化的悬浮球显示规则。对于同时显示的多个悬浮球,电子设备还可设置悬浮球组合显示的组合显示规则,以避免悬浮球数量过多对前台应用程序的遮挡。

Description

多任务场景下的悬浮球处理方法和电子设备
本申请要求于2022年03月03日提交中国专利局、申请号为202210209969.4、申请名称为“多任务场景下的悬浮球处理方法和电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端领域,尤其涉及多任务场景下的悬浮球处理方法和电子设备。
背景技术
手机等终端电子设备在退出某一页面或应用程序后,可以在退出后的窗口中显示一个悬浮球,或称悬浮胶囊。悬浮球可以始终显示在窗口的顶层,不会被覆盖。这样,用户可以通过悬浮球快速便捷的打开前述被关闭的页面或应用程序。
发明内容
本申请提供了一种多任务场景下的悬浮球处理方法。该方法可应用于手机、平板电脑等终端电子设备上。实施该方法,上述电子设备可显示多个悬浮球。进一步的,电子设备可根据不同悬浮球业务的时效性特点设置个性化的悬浮球显示规则。这样,电子设备既可以通过多个悬浮球向用户提供多类信息,又避免悬浮球数量过多对前台应用程序的遮挡。
第一方面,本申请提供了一种多任务交互方法,该方法应用于电子设备,该方法包括:检测到电子设备满足第一预设条件,显示第一悬浮球;其中,第一悬浮球中显示有第一应用的标识和第一信息;在电子设备的界面上显示有第一悬浮球时,检测到电子设备满足第二预设条件,在电子设备的界面上显示第一悬浮球的同时显示第二悬浮球;其中,第二悬浮球中显示有第二应用的标识和第二信息。
实施第一方面提供的方法,在检测到满足多个悬浮球的显示条件时,电子设备可同时显示多个悬浮球。其中,悬浮球中显示有关联的应用程序的标识和提示信息,以便以用户快速便捷的获得提示信息和提供上述信息的应用程序。
结合第一方面提供的方法,在一些实施例中,第二悬浮球显示在第一悬浮球的上方。
这样,电子设备可以将最新生成的悬浮球显示在已有的悬浮球的上方。在显示有多个悬浮球的场景下,用户可以根据各个悬浮球的显示位置判断各个悬浮球的显示时间,进而确定各个悬浮球中的提示信息的优先级,以便于合理安排时间和任务。
结合第一方面提供的方法,在一些实施例中,该方法还包括:确定在显示第一悬浮球后的第一时长内未检测到作用于第一悬浮球的用户操作,显示缩略态的第一悬浮球;缩略态的第一悬浮球中包括第一应用的标识,不包括第一信息。
实施上述实施例提供的方法,电子设备显示一个展开态的悬浮球(包括应用程序图标和提示消息)一段时间后,且没有检测到用户对该悬浮球的操作,例如点击操作等,可以将该展开态的悬浮球调整为缩略态(包括应用程序图标),以减少悬浮球的显示面积,减少对前台应用程序的遮挡,从而提升用户使用体验。
结合第一方面提供的方法,在一些实施例中,该方法还包括:确定在显示第二悬浮球 后的第二时长内未检测到作用于第二悬浮球的用户操作,显示缩略态的第二悬浮球;缩略态的第二悬浮球中包括第二应用的标识,不包括第二信息。
实施上述实施例提供的方法,在显示多个悬浮球的场景下,电子设备可同时将多个展开态的悬浮球调整为缩略态,进一步减少悬浮球的显示面积,减少对前台应用程序的遮挡。
结合第一方面提供的方法,在一些实施例中,第一时长与第二时长相等。
实施上述实施例提供的方法,电子设备可以根据不同悬浮球对应的业务的特点,设定显示展开态的该悬浮法的时间,从而提升用户使用体验。例如,电子设备可以设定地铁悬浮球的展开态的显示时间为30s;设定航班悬浮球的展开态的显示时间为10s。
结合第一方面提供的方法,在一些实施例中,显示缩略态的第二悬浮球,包括:确定在电子设备的界面上显示有缩略态的其他悬浮球,将缩略态的第二悬浮球与缩略态的其他悬浮球聚合为第三悬浮球;其中,第三悬浮球中显示有第二应用的标识。
实施上述实施例提供的方法,在显示多个悬浮球的场景下,在将多个展开态的悬浮球调整为缩略态时,电子设备还可将多个缩略态的悬浮球聚合为一个,从而进一步减少悬浮球的显示面积,减少对前台应用程序的遮挡,提升用户使用体验。
聚合后的一个悬浮球(第三悬浮球)中的应用图标部分可显示最新生成的悬浮球中的应用图标。例如电子设备显示第二悬浮球在显示第一悬浮球之后,因此,第二悬浮球可称为最新生成的悬浮球,于是,第三悬浮球中的应用图标部分可显示第二悬浮球中的应用图标,即第二应用的标识。这样,用户可以根据聚合后的悬浮球中的应用图标确定最新生成的悬浮球所属的应用程序,进而确定各个悬浮球中的提示信息的优先级,以便于合理安排时间。
结合第一方面提供的方法,在一些实施例中,第三悬浮球包括指示信息,指示信息用于指示第三悬浮球为聚合的包括多个悬浮球的悬浮球。
实施上述实施例提供的方法,用户可以通过缩略态的悬浮球的应用图标确定该悬浮球是一个展开态的悬浮球缩略得到的,还是多个展开态的悬浮球聚合得到的,进而确定该缩略态的悬浮球是否可以对应多个悬浮球。
结合第一方面提供的方法,在一些实施例中,该方法还包括:检测到作用于第三悬浮球的第一用户操作;响应于第一用户操作,显示多个悬浮球。
实施上述实施例提供的方法,当电子设备检测到作用于聚合后的悬浮球的用户操作后,电子设备可将上述聚合后的一个悬浮球重新拆分成聚合前的多个悬浮球,并显示上述多个悬浮球。于是,用户可以随时地方便地获得当前需要的悬浮球,并利用上述悬浮球获取更多信息或完成必要的一些操作。
结合第一方面提供的方法,在一些实施例中,第一信息为用户预订的航班的值机提示,第一预设条件包括:获取到航班的通知,电子设备的当前时间在航班的值机时间范围内;或,第一信息为用户预订的航班的登机提示,第一预设条件包括:获取到航班的通知,电子设备的当前时间在航班的候机时间范围内,且电子设备的当前位置在航班的起飞机场的地理范围内;或,第一信息为地铁乘车提示,第一预设条件包括:电子设备的当前位置在地铁站的地理范围内;或,第一信息为翻译提示,第一预设条件包括:检测到复制操作,且被复制的内容所使用的语言为非系统常用语言。
实施上述实施例提供的方法:当获取到航班的通知,且电子设备的当前时间在航班的值机时间范围内时,电子设备可显示航班悬浮球。或者,当获取到航班的通知、电子设备的当前时间在航班的候机时间范围内,且电子设备的当前位置在航班的起飞机场的地理范围内时,电子设备可显示航班悬浮球。航班悬浮球中可展示用户预订的航班的相关信息,例如值机提示、登机提示等。当电子设备的当前位置在地铁站的地理范围内时,电子设备可显示地铁悬浮球。地铁悬浮球可显示地铁乘车提示,例如地铁乘车码、健康码等等。当检测到复制操作,且被复制的内容所使用的语言为非系统常用语言时,电子设备可显示翻译悬浮球。
结合第一方面提供的方法,在一些实施例中,该方法还包括:确定在显示第一悬浮球后的第三时长内未检测到作用于第一悬浮球的用户操作,终止显示第一悬浮球。
实施上述实施例提供的方法,在悬浮球为暂态悬浮球的场景下,例如导航悬浮球、拨号悬浮球,在显示该悬浮球一段时间后,且没有检测到用户对该悬浮球的操作时,电子设备可确认用户不需要上述悬浮球提供的快捷方式,进而电子设备可终止显示该悬浮球,以减少对前台应用程序的遮挡,避免对用户产生干扰。
结合第一方面提供的方法,在一些实施例中,确定在显示第一悬浮球后的第三时长内未检测到作用于第一悬浮球的用户操作,终止显示第一悬浮球,包括:确定在显示第一悬浮球后的第四时长内未检测到作用于第一悬浮球的用户操作,显示缩略态的第一悬浮球;缩略态的第一悬浮球中包括第一应用的标识,不包括第一信息;缩略态的第一悬浮球还包括倒计时标识,倒计时标识用于指示缩略态的第一悬浮球剩余显示时间;第三时长等于第四时长与倒计时标识指示的倒计时时长的和;在倒计时标识指示计时结束时,终止显示第一悬浮球。
实施上述实施例提供的方法,在悬浮球为暂态悬浮球的场景下,例如导航悬浮球、拨号悬浮球,在显示该悬浮球一段时间后,且没有检测到用户对该悬浮球的操作时,电子设备可将展开态的上述悬浮球调整为缩略态,并在缩略态的悬浮球上显示倒计时标识,提示用户该悬浮球即将消失。若在倒计时标识指示倒计时结束时,电子设备仍未检测到用户对该悬浮球的操作,则电子设备可确认用户不需要上述悬浮球提供的快捷方式,进而电子设备可终止显示该悬浮球,以减少对前台应用程序的遮挡,避免对用户产生干扰。
结合第一方面提供的方法,在一些实施例中,第一信息为导航提示,第一预设条件包括:检测到复制操作,且被复制的内容指示了地图上的第一位置;第一信息为拨号提示,第一预设条件包括:检测到复制操作,且被复制的内容包括第一电话号码。
实施上述实施例提供的方法:当检测到复制操作,且被复制的内容指示了地图上的一个具体位置时,电子设备可显示导航悬浮球。导航悬浮球可为用户提供快速的行程规划服务。当检测到复制操作,且被复制的内容指示了一个电话号码时,电子设备可显示拨号悬浮球。拨号悬浮球可为用户提供快速的拨号服务,节省用户操作,提升用户使用体验。
结合第一方面提供的方法,在一些实施例中,该方法还包括:检测到作用于第一悬浮球的第二用户操作;响应于第二用户操作,显示第一页面,第一页面展示有第三信息,第三信息包括第一信息,或者,第三信息与第一信息关联。
实施上述实施例提供的方法,当检测到作用于悬浮球的用户操作时,电子设备可运行与该悬浮球关联的应用程序,或显示该悬浮球关联的包括悬浮球中提示信息在内的更多信息的页面,从而使得用户可以方便快速地获得更多的相关信息。
结合第一方面提供的方法,在一些实施例中,第一页面还包括第二悬浮球;或者,还包括缩略态的第二悬浮球,缩略态的第二悬浮球中包括第二应用的标识,不包括第二信息。
实施上述实施例提供的方法,电子设备在显示与第一悬浮球关联的页面之后,还可在该页面上显示剩余的悬浮球,例如第二悬浮球。这样,用户可以在上述页面的基础上,直接点击第二悬浮球,获取第二悬浮球提供的更多信息。
结合第一方面提供的方法,在一些实施例中,第一页面显示有图形码,则图形码与第二悬浮球不重叠;图像码包括二维码、条形码。
实施上述实施例提供的方法,如果通过悬浮球显示的页面包括图形码,例如通过地铁悬浮球显示的页面包括地铁乘车码,这时,电子设备可以将剩余的需要显示的悬浮球显示在地铁乘车码所占的区域之外,避免对上述地铁乘车码造成遮挡、阻碍用户使用地铁乘车码,进而提升用户使用体验。
结合第一方面提供的方法,在一些实施例中,电子设备的界面上还显示有第四悬浮球、第五悬浮球,第四悬浮球覆盖在第五悬浮球之上,该方法还包括:检测到作用于电子设备的界面的第三用户操作;响应于第三用户操作,显示第四悬浮球与第五悬浮球,且第五悬浮球未被第四悬浮球覆盖。
实施上述实施例提供的方法,电子设备在显示多个悬浮球时可以对将超过显示数量的悬浮球折叠起来。然后,用户可通过上滑/下滑操作控制电子设备显示上述被折叠的悬浮球,然后获取该悬浮球提供的快捷服务。
结合第一方面提供的方法,在一些实施例中,该方法还包括:检测到作用于第一悬浮球或第二悬浮球的第四用户操作;响应于第四用户操作,在电子设备的界面的第一位置显示第一悬浮球和第二悬浮球,其中,第一位置为第四用户操作终止的位置。
实施上述实施例提供的方法,电子设备可以识别用户移动悬浮球的操作,然后将屏幕上显示的一个或多个悬浮球移动到用户指定的位置。这样,用户可以随意的调整悬浮球的显示位置,以减少悬浮球对前台应用程序遮挡带来的不好的使用体验。
第二方面,本申请提供了一种电子设备,该电子设备包括一个或多个处理器和一个或多个存储器;其中,一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机程序代码,计算机程序代码包括计算机指令,当一个或多个处理器执行计算机指令时,使得电子设备执行如第一方面以及第一方面中任一可能的实现方式描述的方法。
第三方面,本申请提供一种计算机可读存储介质,包括指令,当上述指令在电子设备上运行时,使得上述电子设备执行如第一方面以及第一方面中任一可能的实现方式描述的方法。
第四方面,本申请提供一种包含指令的计算机程序产品,当上述计算机程序产品在电子设备上运行时,使得上述电子设备执行如第一方面以及第一方面中任一可能的实现方式描述的方法。
可以理解地,上述第二方面提供的电子设备、第三方面提供的计算机存储介质、第四 方面提供的计算机程序产品均用于执行本申请所提供的方法。因此,其所能达到的有益效果可参考对应方法中的有益效果,此处不再赘述。
附图说明
图1A-图1C是本申请实施例提供的一组电子设备显示悬浮球的用户界面;
图2A-图2B是本申请实施例提供的一组电子设备将展开态的悬浮球变更为缩略态的用户界面;
图2C-图2E是本申请实施例提供的一组电子设备将多个悬浮球聚合为一个悬浮球的用户界面;
图3A是本申请实施例提供的不同类型的悬浮球的示意图;
图3B是本申请实施例提供的暂态悬浮球的示意图;
图4A-图4N是本申请实施例提供的一组电子设备显示悬浮球的用户界面;
图5A-图5K是本申请实施例提供的一组电子设备显示悬浮球的用户界面;
图6A-图6O是本申请实施例提供的一组电子设备显示悬浮球的用户界面;
图7是本申请实施例提供的多任务场景下悬浮球处理方法的软件结构框图;
图8是本申请实施例提供的通知应用的软件结构图;
图9是本申请实施例提供的另一种通知应用的软件结构图;
图10是本申请实施例提供的多任务场景下悬浮球处理方法的流程图;
图11是本申请实施例提供的电子设备的硬件结构示意图。
具体实施方式
本申请以下实施例中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。
在本申请实施例提供的一种方案中:手机等终端电子设备可以在退出后的窗口中显示一个悬浮球,或称悬浮胶囊。悬浮球可以始终显示在窗口的顶层(显示图层的最上面一层),不会被覆盖。这样,用户可以随时随地通过点击悬浮球快速便捷地打开之前被关闭的页面或应用程序。
首先,图1A示例性示出了第一电子设备显示悬浮球的用户界面。上述手机可称为第一电子设备。
如图1A所示,该用户界面可表示第一电子设备播放视频的用户界面。此时,用户可以浏览视频。在播放视频的窗口图层之上,第一电子设备可显示提示用户已预订航班的航班信息的悬浮球,记为航班悬浮球,例如图1A中的悬浮球。其中,上述用户已预订航班的航班信息可来自于为用户提供预订航班服务的应用程序,记为航班应用。于是,上述航班悬浮球也可称为航班应用对应的悬浮球。
一个悬浮球可包括应用图标和提示信息。应用图标可指示与该悬浮球关联的应用程序。一般情况下,悬浮球中显示的信息来自于上述关联的应用程序。同时,悬浮球还可为用户提供快速打开上述关联的应用程序的服务,比如,电子设备响应于用户点击悬浮球的操作,可以直接打开应用程序的界面,显示提示信息关联的界面。提示信息中显示的具体内容为 用户关注的重要信息。这样,用户可以在不进入上述关联的应用程序的情况下更为便捷地获取重要信息。
例如,在图1A中,上述应用图标可以为第一电子设备上安装的航班应用的应用图标。上述航班悬浮球关联了上述航班应用。这样,用户可通过上述应用图标了解第一电子设备提供上述悬浮球通知服务所依赖的应用程序。这样,在看到上述应用图标之后,用户也可打开第一电子设备上安装的上述应用程序,以获取该应用程序提供的更多的服务。
具体的,上述航班悬浮球关联了上述航班应用提供的预订航班的登机牌页面。该页面可显示上述预订航班的航班信息,例如起飞时间、抵达时间、登机口、座位号等等,参考图1B。航班悬浮球中的提示信息:“52K登机口”可在关闭图1B所示的页面的情况下实时的提醒用户预订航班的登机口;“查看登机牌”可提醒用户点击上述悬浮球获取登机牌页面,从而获取登机牌页面提供的更多航班信息。
在一些情况下,悬浮球中的显示的提示信息足以满足用户的需求。在一些情况下,悬浮球中的显示的提示信息也可能不满足用户的需求。此时,用户可以点击上述悬浮球,进而获取包括上述提示信息在内的更多的信息。
以上述航班悬浮球为例,用户可通过悬浮球中显示“52K登机口”获取预订航班的登机口。在一些情况下,用户了解了登机口信息,可以确认前往哪一登机口登机。此时,上述悬浮球中显示提示信息足以满足用户的需求。
然而,在一些情况下,用户可能还需要了解座位号等信息。此时,上述悬浮球中显示提示信息不足以满足用户的需求。此时,用户可以点击上述悬浮球,以获取更多的提示信息中未显示的航班信息。如图1B所示,第一电子设备可检测到作用于航班悬浮球的用户操作,响应于上述用户操作,第一电子设备可显示图1C所示的展示有登机牌的用户界面。这样,用户可通过上述航班悬浮球快捷地获取到预定航班的航班信息。
但是,在多任务场景下,当生成一个新的悬浮球之后,在前生成的悬浮球会被上述新的悬浮球替换。例如,在显示上述航班悬浮球之后,第一电子设备可检测到翻译场景。响应于检测到上述翻译场景,第一电子设备可显示翻译悬浮球,为用户提供快捷的翻译服务。此时,在悬浮球不支持多任务的场景下,在生成上述翻译悬浮球之后,上述航班悬浮球会被上述翻译悬浮球挤占掉,即上述航班悬浮球会被终止。于是,用户便无法在通过上述航班悬浮球提供的快捷方式,进入航班应用程序、获取航班信息。
因此,本申请实施例提供了一种多任务场景下的悬浮球处理方法。
实施该方法,在多任务场景下,第一电子设备可显示多个悬浮球。这样,用户可以同时获取到多个悬浮球的提示信息。进一步的,第一电子设备还可根据不同的场景调整多个悬浮球的显示状态,以避免悬浮球过多对屏幕造成遮挡,影响用户使用体验。
具体的,第一电子设备可设置有多个悬浮球,以及显示各个悬浮球需要满足的条件(显示条件)。然后,第一电子设备可实时地获取指示当前运行状态的数据(状态数据),并检测上述状态数据是否满足上述多个悬浮球中一个或多个悬浮球的显示条件。当满足一个或多个悬浮球的显示条件时,第一电子设备可显示对应的一个或多个悬浮球。
例如,当检测到第一电子设备当前的状态数据满足航班悬浮球的显示条件时,第一电 子设备可生成并显示航班悬浮球;当检测到第一电子设备当前的状态数据满足翻译悬浮球的显示条件时,第一电子设备可生成并显示翻译悬浮球,也就是说,在一种可能的实现方式中,在第一电子设备的显示界面上同时显示有航班悬浮球和翻译悬浮球。第一电子设备可分别管理上述两个悬浮球,避免在后生成的翻译悬浮球挤占在先生成的航班悬浮球。
进一步的,第一电子设备可根据不同悬浮球业务的时效性特点,设置悬浮球显示规则。对于同时显示的多个悬浮球,第一电子设备还可设置悬浮球组合显示的组合显示规则,以避免悬浮球数量过多对前台应用程序界面的遮挡。上述前台应用程序是指在桌面上可见正在运行的应用。参考图1A,第一电子设备可安装有视频播放器,且上述视频播放器正在调用显示屏播放视频。上述视频播放器可称为正在第一电子设备上运行的前台应用。
例如,在显示一个悬浮球之后,第一电子设备可检测预设时间内是否有作用于上述悬浮球的用户操作。当预设时间内未检测到作用于上述悬浮球的用户操作时,第一电子设备可隐藏上述悬浮球,以减少悬浮球的显示区域,降低悬浮球对前台应用程序的遮挡。上述预设时间的时间长例如5秒等等。本申请实施例对此不作限制。
当屏幕中有多个可隐藏的悬浮球时,第一电子设备可将上述多个处于隐藏状态的悬浮球聚合起来,显示一个聚合的悬浮球,从而进一步减小悬浮球的显示区域,降低悬浮球对前台应用程序界面的遮挡。
具体的,图2A-图2B示例性示出了第一电子设备隐藏悬浮球的用户界面。
参考图2A所示的用户界面,该界面包括窗口211、悬浮球212。窗口211可显示第一电子设备的主页面(home page)、应用程序提供的用户界面。上述应用程序是指第一电子设备上安装的除悬浮球212关联的应用程序之外的应用程序。此时,窗口211中显示的内容可表示第一电子设备正在执行视频播放应用。
当检测到第一电子设备当前的状态数据满足航班悬浮球的显示条件时,第一电子设备可生成并显示航班悬浮球。悬浮球212可表示上述航班悬浮球。上述显示条件例如:1、第一电子设备当前定位在用户预订航班的出发地机场的地理范围内;2、第一电子设备的当前系统时间在用户预订航班的候机时间范围内。上述候机具体是指用户完成安检在登机口等待登机的过程。上述显示条件是基于航班业务的特点提取出的。
该航班悬浮球可与第一电子设备上的航班应用关联。悬浮球212中的应用图标可指示与上述航班悬浮球关联的航班应用。悬浮球212中的提示信息可便于用户快速获取当前场景下的重要航班信息。
上述当前环境可以是用户即将登机的场景。这时,通过上述悬浮球212,用户可快速地获取将要进行的登机流程的登机口信息,即不用进入上述航班应用也可获取航班信息。上述进入航班应用是指第一电子设备运行航班应用并显示航班应用提供的用户界面。
此时,图2A中显示有应用图标和提示信息的悬浮球212的显示状态可称为悬浮球的展开态。这时,悬浮球212所占据的显示区域较大,可能降低用户使用其他应用的用户体验。特别的,当显示有多个展开态的悬浮球时,这多个展开态的悬浮球在整个显示窗口所占的显示面积更大,对前台应用程序界面(正在使用窗口211播放视频的应用)的遮挡更严重,极大影响用户的使用体验。
因此,在显示上述悬浮球212之后,第一电子设备检测显示上述悬浮球212之后5秒内是否有作用于悬浮球212的用户操作。上述5秒为示例性的预设时间。
若在上述预设时间内,第一电子设备未检测到作用于展开态的悬浮球212的用户操作,则第一电子设备可将上述悬浮球212向屏幕右侧推入,仅显示悬浮球212的应用图标部分,参考图2B。这时,图2B中悬浮球212所占据的显示区域明显减少,从而降低了对当前处于前台运行状态的应用的遮挡,提升了用户使用体验。图2B中悬浮球212的显示状态可称为悬浮球的缩略态。
图2A到图2B所示的第一电子设备将悬浮球由展开态变更为缩略态,以减少悬浮球显示面积的过程可称为第一电子设备隐藏悬浮球。
图2C-图2E示例性示出了第一电子设备聚合多个缩略态悬浮球的用户界面。
首先,在图2C所示的用户界面中,第一电子设备可显示多个展开态的悬浮球,例如航班悬浮球212、地铁悬浮球213、出行悬浮球214。航班悬浮球212可参考前述介绍,这里不再赘述。地铁悬浮球213可用于显示地铁乘车码。出行悬浮球214可用于显示用户的预定的网约车的抵达时间或到达指定目的地的时间等信息。后续将会详细介绍不同类型的悬浮球。
对于上述任意一个悬浮球来说,在显示该悬浮球之后的5秒(预设时间)内,若第一电子设备未检测到作用于该悬浮球的用户操作,则所述第一电子设备可将该悬浮球由展开态变更为缩略态。当存在多个悬浮球需要变更为缩略态时,第一电子设备可在将上述多个悬浮球变更为缩略态的过程中,将这多个悬浮球聚合为一个,称为聚合态悬浮球。
参考图2D,在显示该悬浮球5秒之后,航班悬浮球212、地铁悬浮球213、出行悬浮球214均可进入缩略态。此时,检测到多个缩略态的悬浮球,第一电子设备可将上述进入缩略态的航班悬浮球212、地铁悬浮球213、出行悬浮球214聚合为一个,然后显示这一个悬浮球,参考图2E中悬浮球215。这一个悬浮球可称为聚合态悬浮球。
不限于手机,第一电子设备还可以是平板电脑、桌面型计算机、膝上型计算机、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、可穿戴式设备、车载设备、智能家居设备和/或智慧城市设备,本申请实施例对该电子设备的具体类型不作特殊限制。
下面,图3A示例性示出了第一电子设备上可能显示的对应不同业务场景的悬浮球。
如图3A所示,悬浮球301(前述图2C中的航班悬浮球212)可表示提供航班业务通知的航班悬浮球。航班悬浮球可与第一电子设备上安装的提供航班查询、航班预订等服务的航班应用程序关联。航班悬浮球中展示的信息可来源于上述航班应用。当检测到作用于悬浮球301的用户操作时,第一电子设备可显示被预定航班的全部航班信息,后续实施例将详细介绍,这里先不展开。
悬浮球302(即前述图2C中的地铁悬浮球213)可表示提供快捷显示地铁乘车码业务的地铁悬浮球。地铁悬浮球可与第一电子设备上安装的提供地铁查询、显示地铁乘车码等服务的地铁应用程序关联。地铁悬浮球中展示的信息可来源于上述地铁应用。当检测到作用于悬浮球302的用户操作时,第一电子设备可显示地铁乘车码,从而为用户提供快捷的扫码乘车服务。
悬浮球303可表示提供翻译服务的翻译悬浮球。翻译悬浮球可将第一电子设备剪贴板中记录的被复制内容翻译成使用第一电子设备常用系统语言表达的文本。当检测到作用于悬浮球303的用户操作时,第一电子设备可显示翻译页面。上述翻译页面中可显示有上述被复制内容和使用常用系统语言表达的上述被复制内容的文本。
悬浮球304可表示提供地图导航服务的导航悬浮球。第一电子设备可识别剪贴板中被复制的地点,然后生成导航悬浮球。导航悬浮球可与第一电子设备上安装的提供显示地图、导航服务的应用程序关联,并利用上述应用程序确定由第一电子设备当前所处位置前往上述被复制的地点的路线。当检测到作用于悬浮球304的用户操作时,第一电子设备可显示导航页面。上述导航页面中可显示有由第一电子设备当前所处位置前往上述地点的路线。于是,用户可通过上述导航页面获取快捷的导航服务。
悬浮球305可表示提供快捷拨号服务的通话悬浮球。第一电子设备可识别剪贴板中被复制的电话号码,然后生成通话悬浮球。通话悬浮球可与第一电子设备上安装的通话应用关联。当检测到作用于悬浮球305的用户操作时,第一电子设备可呼叫上述被复制的电话号码,从而为用户提供快捷拨号服务。
悬浮球306可表示提供分屏服务的分屏悬浮球。上述分屏是指在一块手机屏幕内同时运行两个应用程序并显示这两个应用提供的窗口视图。在一些实施例中,第一电子设备还支持调整两个应用的相对窗口大小。不限于两个应用,还可以是三个甚至更多的应用。本申请实施例对此不作限制。
第一电子设备可检测到用户在两个或多个应用程序之间频繁切换的用户操作。例如,从应用A切换到应用B再切换到应用A的频繁地变更前台应用的操作。这时,第一电子设备可生成分屏悬浮球,即悬浮球306。当检测到作用于悬浮球306的用户操作时,第一电子设备可将手机屏幕划分为多个窗口。一个窗口显示一个应用提供的视图。此时,分屏悬浮球可提示用户分屏显示应用A和应用B。应用A和应用B均为支持分屏显示的应用。
悬浮球307可表示提供快递查询服务的快递悬浮球。快递悬浮球可与第一电子设备上安装的提供快递查询服务的快递应用关联。快递悬浮球中可显示用户的快递编码。快递悬浮球中显示快递信息可来源于上述快递应用。当检测到作用于悬浮球307的用户操作时,第一电子设备可显示上述快递订单的更多信息,例如内容物类型、内容物图片、寄件人、寄件地址等等。
悬浮球308可表示提供外卖订单通知的外卖悬浮球。快递悬浮球可与第一电子设备上安装的提供外卖服务的外卖应用关联。外卖悬浮球中可显示用户的订购的外卖的剩余送达时间。外卖悬浮球中显示的送达时间信息可来源于上述外卖应用。当检测到作用于悬浮球308的用户操作时,第一电子设备可显示上述外卖订单的更多信息,例如商品清单、订单编号、商家联系方式、接收地址等等。
悬浮球309(即前述图2C中的悬浮球214)可表示提供网约车通知的出行悬浮球。出行悬浮球可与第一电子设备上安装的提供打车服务的出行应用关联。出行悬浮球中可显示用户的预定的网约车的抵达时间或到达指定目的地的时间等信息。出行悬浮球中显示的网约车的抵达时间可来源于上述出行应用。检测到作用于悬浮球309的用户操作时,第一电子设备可显示上述出行订单的更多信息,例如订单编号、车辆所在地、出发地、目的地、司机联系方式、车牌等等。
根据不同悬浮球提供的服务的时效性特点,第一电子设备可为不同悬浮球设置不同的终止机制(消失机制),以实现既满足该悬浮球提供的快捷服务,又避免冗余显示、影响用户浏览体验。
在一些实施例中,在显示展开态的悬浮球之后,当在预设时间内未检测到作用于展开态的悬浮球的用户操作时,第一电子设备可将上述展开态的悬浮球变更为缩略态,即隐藏上述展开态的悬浮球。然后,在该悬浮球关联的应用程序中的业务完结时,第一电子设备可终止显示上述悬浮球。终止之后,第一电子设备不再显示上述悬浮球。
在另一些实施例中,在显示展开态的悬浮球之后,当在预设时间内未检测到作用于展开态的悬浮球的用户操作时,第一电子设备还可直接终止上述悬浮球。
以图3A中的航班悬浮球(悬浮球301)为例,当检测到用户完成安检进入候机厅之后,第一电子设备可显示展开态的悬浮球301。在显示展开态的悬浮球301一段时间之后,例如5秒,且在上述一段时间内第一电子设备未检测到作用于悬浮球301的用户操作,则第一电子设备可将展开态的悬浮球301调整为缩略态。当检测到用户已经登机之后,第一电子设备可终止显示悬浮球301。
以图3A中的导航悬浮球(悬浮球304)为例,当检测到复制地点的用户操作之后,第一电子设备可显示展开态的悬浮球304。在显示展开态的悬浮球304一段时间之后,且在上述一段时间内第一电子设备未检测到作用于悬浮球304的用户操作,则第一电子设备可将展开态的悬浮球301调整为缩略态。在显示缩略态的悬浮球304一段时间后,且在上述一段时间内第一电子设备未检测到作用于悬浮球304的用户操作,则第一电子设备可终止显示悬浮球304。
不同类型的悬浮球对应的由展开态进入缩略态或终止的时间可以相同也可以不同,由缩略态到被终止之间的时间可以相同也可以不同,本申请实施例对此不作限制。
上述会因为没有检测到作用于该悬浮球(导航悬浮球)的用户操作而终止的悬浮球可称为暂态悬浮球。第一电子设备可通过倒计时圆环提醒用户哪些悬浮球为暂态悬浮球,从而提醒用户及时获取上述暂态悬浮球提供的快捷服务,以免当暂态悬浮球终止后无法重新获取上述暂态悬浮球,进而无法获取上述暂态悬浮球提供的快捷服务。
图3B示例性示出了第一电子设备上可能显示的暂态悬浮球。
在显示展开态的悬浮球的过程中,若未检测到作用于该悬浮球的用户操作,则第一电子设备可将展开态的悬浮球变更为缩略态。如图3B所示,导航悬浮球可由悬浮球304所示的状态变更为悬浮球314所示的状态。
在显示缩略态的导航悬浮球时,若在预设时间内未检测到作用于导航悬浮球(悬浮球304)的用户操作,第一电子设备会终止显示上述导航悬浮球。也就是说,上述导航悬浮球为暂态悬浮球。第一电子设备在显示缩略态的导航悬浮球(悬浮球314)时,可在上述导航悬浮球中的应用图标上附带显示一个倒计时圆环,如图3B中悬浮球314中的圆环31。
在开始显示缩略态的悬浮球314时,上述倒计时圆环为一个完整的圆环。随着时间推进,圆环可从12点钟位置沿逆时针逐渐减少,参考图3B中悬浮球324所述的状态。当倒计时圆环消失时,倒计时结束,第一电子设备可终止显示悬浮球314。上述倒计时圆环的计时时长即第一电子设备显示缩略态的悬浮球314的时长。
同理,当拨号悬浮球为暂态悬浮球时,进入缩略态的拨号悬浮球(悬浮球305)可为悬浮球315所示的样子,然后变成悬浮球325所示的样子;当分屏悬浮球为暂态悬浮球时,进入缩略态的分屏悬浮球(悬浮球306)可为悬浮球316所示的样子,然后变成悬浮球326所示的样子。不限于图3B示出的暂态的悬浮球,第一电子设备还可将图3A中的其他类型的悬浮球设置为暂态悬浮球,本申请实施例对此不作限制。
下面,图4A-图4H、图5A-图5I、图6A-图6I示出了第一电子设备实施本申请实施例提供的多任务场景下的悬浮球处理方法的用户界面。
下面。图4A-图4H示例性示出了一组第一电子设备在多任务场景下显示多个悬浮球的用户界面。
首先,图4A示出了用户使用视频播放应用观看视频的用户场景。此时,提供播放视频服务的应用程序(视频播放器)可称为当前处于前台运行的应用程序。窗口411中显示的视图或控件是上述视频播放器提供的。
第一电子设备可实时的获取第一电子设备当前所处的位置,记为当前位置。本申请实施例对第一电子设备获取当前位置的具体方法不作限制。例如,第一电子设备可利用全球卫星定位系统(global positioning system,GPS)、全球导航卫星系统(global navigation satellite system,GLONASS)或北斗卫星导航系统(beidou navigation satellite system,BDS)获取当前位置,此外,第一电子设备还可利用基于基站信号,和/或,高保真无线通信(wireless fidelity,Wi-Fi)信号的位置指纹的定位方法获取当前位置。
在获取到当前位置之后,第一电子设备可确认上述当前位置是否在地铁站的地理范围内和/或机场的地理范围内。第一电子设备的当前位置在地铁站的地理范围内可指示用户当前处于地铁站中。同理,第一电子设备的当前位置在机场的地理范围内可指示用户当前处于机场中。上述地铁站的地理范围和机场的地理范围内可通过上述定位服务确定。本申请实施例对此不再赘述。
当第一电子设备的当前位置在地铁站的地理范围内时,第一电子设备可在窗口411中显示地铁悬浮球,如图4B所示的悬浮球412。
同时,若上述当前位置也在机场的地理范围内,则第一电子设备还可在窗口411中显示航班悬浮球,如图4C所示的悬浮球413。
可选的,第一电子设备可将较后生成的悬浮球显示在较先生成的悬浮球的上面。例如, 若第一电子设备首先确定当前位置在地铁站的地理范围内,则第一电子设备可首先生成地铁悬浮球(悬浮球412)。然后,第一电子设备根据当前位置在机场的地理范围内可生成航班悬浮球(悬浮球413)。此时,上述地铁悬浮球为较先生成的悬浮球,上述航班悬浮球为较后生成的悬浮球。在显示航班悬浮球的过程中,第一电子设备可将地铁悬浮球向下移动,然后在原来显示地铁悬浮球的位置显示航班悬浮球。
参考图4B和图4C,在确定显示地铁悬浮球后,第一电子设备可在屏幕由上至下1/4的位置显示上述地铁悬浮球。在确定显示航班悬浮球后,第一电子设备可将上述地铁悬浮球向屏幕下方移动,并在原来显示上述地铁悬浮球的位置(屏幕由上至下1/4的位置)显示航班悬浮球。上述初始显示位置,即上述屏幕由上至下1/4的位置,为预设的。第一电子设备也可设定其他的初始显示位置。本申请实施例对此不作限制。
此时,地铁悬浮球(悬浮球412)和航班悬浮球(悬浮球413)均为展开态的悬浮球。在展开态的显示形态下,第一电子设备可检测到作用于悬浮球的用户操作,例如点击操作。响应于上述用户操作,第一电子设备可显示与该悬浮球当前显示内容关联的更多信息。
如图4D所示,第一电子设备可检测到点击悬浮球413的用户操作。响应于上述用户操作,第一电子设备可显示图4E所示的用户界面。图4E示例性示出了第一电子设备显示登机牌的用户界面。
如图4E所示,该界面可显示有用户出行所搭乘的航班的编号(SF1314)、出发地(深圳宝安机场T3)、目的地(北京大兴机场T3)、起飞时间(9:00)、降落时间(13:20)、值机柜台(G07)、登机口(52K)、座位号(S-18D)等航班信息。这样,通过点击航班悬浮球,用户可快速便捷地获取用户预定的航班的详细航班信息。
可选的,参考图4F,第一电子设备还可在显示登机牌时显示地铁悬浮球(悬浮球412)。这样,用户可以通过悬浮球412直接获取地铁乘车二维码。
图4E(或图4F)所示的用户界面还包括控件421。当检测到作用于控件421的用户操作时,第一电子设备可显示图4D所示的用户界面。或者,第一电子设备可显示与航班悬浮球关联的航班应用提供的其他界面,例如机票查询界面等等。
如图4G所示,第一电子设备可检测到点击悬浮球412的用户操作。响应于上述用户操作,第一电子设备可显示图4H所示的用户界面。如图4H所示,该界面可显示有二维码422。上述二维码可以为地铁二维码。在显示图4H所示的用户界面之后,用户可使用上述二维码422快速扫码入站(地铁站),从而为用户乘坐地铁出行提供便利。上述二维码还可以为公交乘车码等等,本申请实施例对此不作限制。
在一些实施例中,上述悬浮球还可以是对应用于支付的应用程序的悬浮球。检测到点击上述悬浮球的用户操作,第一电子设备可显示用于支付的条形码。不限于二维码、条形码,第一电子设备还可适应于其他业务场景,显示其他图形码。
可选的,参考图4I,第一电子设备还可在显示二维码时显示航班悬浮球(悬浮球413)。这样,用户可以通过悬浮球413直接获取登机牌。优选的,当检测到显示二维码时,第一电子设备可将屏幕中显示其他悬浮球,例如悬浮球413,移动到显示二维码的区域之外,参考图4J,以避免遮挡二维码,从而阻碍二维码识别。
图4H(或图4I、图4J)所示的用户界面还包括控件423。当检测到作用于控件423的用户操作时,第一电子设备可显示图4C所示的用户界面。或者,第一电子设备可显示与地铁悬浮球关联的地铁应用提供的其他用户界面。
在显示展开态的悬浮球的过程中,若在预设时间内未检测到作用于上述展开态的悬浮球的用户操作,则第一电子设备可隐藏上述展开态的悬浮球,即将展开态悬浮球调整为缩略态悬浮球,以减少显示区域、避免遮挡前台应用、进而提高用户使用体验。
参考图4C,在显示悬浮球412后,第一电子设备可监测预设时间内是否有点击悬浮球412的用户操作。参考图2A和图2B的介绍,上述预设时间可以为5秒。可选的,不同悬浮球对应的上述预设时间可以相同,也可以不同,本申请实施例对上述预设时间的具体长度不作限制。示例性的,在后续实施例的介绍中,上述预设时间均为5秒。
当检测到有点击悬浮球412的用户操作时,第一电子设备可显示悬浮球412对应的登机牌界面。反之,若在预设时间内未检测到点击悬浮球412的用户操作,则第一电子设备可将展开态的悬浮球412向屏幕右侧推进隐藏悬浮球412,如图4K所示,即将悬浮球412变更为缩略态。
同样的,在显示悬浮球413后,第一电子设备可监测预设时间内是否有点击悬浮球413的用户操作。若未检测到点击悬浮球413的用户操作,则第一电子设备也可将悬浮球413变更为缩略态。
这时,当存在多个缩略态的悬浮球时,第一电子设备可将上述多个缩略态聚合起来,显示一个聚合的悬浮球。具体的,第一电子设备在将一个展开态悬浮球调整为缩略态时,可检测当前屏幕中是否已经显示有缩略态的悬浮球。当检测到已经显示有缩略态的悬浮球时,第一电子设备可将上述即将调整为缩略态的悬浮球与上述已有的缩略态的悬浮球聚合,然后,显示一个聚合的悬浮球。
如图4K所示,悬浮球412和悬浮球413可先后进入缩略态。其中,第一电子设备先显示悬浮球412,因此,悬浮球412可先进入缩略态。在悬浮球413进入缩略态时,第一电子设备可检测到当前屏幕中已经显示有缩略态的悬浮球412。此时,第一电子设备可将悬浮球412和悬浮球413聚合为一个悬浮球,参考图4L中的悬浮球414,从而极大地减少了悬浮球对屏幕的遮挡。
可选的,聚合后的悬浮球414可显示最后一个进入缩略态的悬浮球的应用图标,例如悬浮球413相比于悬浮球412是最后一个进入缩略态的悬浮球。或者,聚合后的缩略态的悬浮球414还可显示专门指示聚合的悬浮球的图标。本申请实施例对此不作限制。
可以理解的,虽然第一电子设备显示出来的聚合后的悬浮球的数量只有一个,但是,第一电子设备仍然维护有多个悬浮球。用户可以通过作用于聚合后的悬浮球的操作,指示第一电子设备重新显示上述多个悬浮球,从而,使得用户可以选择当前需要的悬浮球,获取该悬浮球提供的服务。
如图4M所示,第一电子设备可检测到作用于悬浮球414的用户操作,例如点击操作。响应于上述用户操作,第一电子设备可显示图4N所示的用户界面。如图4N所示,此时,第一电子设备可重新显示聚合前的悬浮球412和悬浮球413。这样,用户可点击悬浮球412 或悬浮球413,获取地铁乘车码或登机牌。
第一电子设备还可监测用户是否做出预设的特定操作。当检测到上述特定操作时,第一电子设备可显示与上述特定操作匹配的悬浮球。下面。图5A-图5I示例性示出了第一电子设备根据预设的复制操作显示与该复制操作匹配的翻译悬浮球或导航悬浮球的用户界面。
首先,图5A示例性示出了第一电子设备显示英文页面的用户界面。如图5A所示,此时,窗口411可显示有以英文形式表达的一篇新闻报道。在显示该新闻报道的图层之上,窗口411中还显示有一个聚合的悬浮球414。此时,悬浮球414可同图4G中的悬浮球414,悬浮球414可聚合有航班悬浮球和地铁悬浮球。具体的,图5A中的悬浮球414可参考图4G中的悬浮球414的介绍,这里不再赘述。
在图5A所示的场景下,第一电子设备可检测到用户作用于窗口411中英文文本的用户操作,上述操作例如长按操作、框选操作等。例如,参考图5B,第一电子设备可检测到作用于“Hainan International Convention and Exhibition Center”的用户操作。响应于上述操作,第一电子设备可显示菜单栏511。菜单栏511可包括“复制”按钮。“复制”按钮可用于复制上述用户选中的文本(“Hainan International Convention and Exhibition Center”)。
当检测到作用于“复制”按钮的用户操作后,第一电子设备可识别上述用户选中的文本所使用的语言。然后,第一电子设备可通过对比上述用户选中的文本所使用的语言和系统设置的常用语言,判断用户是否在浏览外语文章等其他以外语表达的内容。上述外语是指与系统常用语言不同的其他类型的语言。当系统常用语言被设置为中文时,图5A中显示的英语可称为外语。其他诸如日语、德语、法语等与上述系统常用语言“中文”不同的语言也可称为外语。
当确定上述用户选中的文本与系统常用语言不一致时,第一电子设备可显示与翻译悬浮球。翻译悬浮球可为用户提供翻译服务。
例如,参考图5C,在系统常用语言被设置为中文的场景下,在检测到上述复制操作后,第一电子设备可确定被复制的文本所使用的语言不是系统常用语言。这时,第一电子设备可显示翻译悬浮球,即悬浮球512。
第一电子设备可检测到作用于悬浮球512的用户操作。响应于上述操作,第一电子设备可显示图5D所示的用户界面。如图5D所示,该用户界面可包括控件521、控件522,文本框523、文本框524。控件521可显示第一电子设备识别到的被复制的文本所使用的语言。控件522可显示第一电子设备中设置的常用语言。文本框523可显示被复制的文本(“Hainan International Convention and Exhibition Center”)。文本框524可显示翻译结果,即上述被复制的非系统常用语言的文本对应的系统常用语言的表述(“海南国际会展中心”)。
可选的,响应于上述作用于悬浮球512的用户操作,第一电子设备还可以在图5C中显示一个窗口。该窗口中显示有翻译结果。该窗口可根据翻译结果所需的显示区域自动地调整自身的窗口大小。这样,第一电子设备既可以通过上述窗口快速、直接地显示翻译结果,也可以尽可能的减少上述翻译结果对图5C中显示的内容的遮挡。
这样,通过点击翻译悬浮球,用户可以通过翻译悬浮球快速便捷地获取到将被复制文本的翻译为系统常用语言的翻译结果,从而为用户浏览外文网页提供方便。
在检测到被复制的文本之后,第一电子设备还可识别上述文本是否为地址。当确认上述文本为地址时,第一电子设备还可显示导航悬浮球。导航悬浮球可与第一电子设备上安装的地图应用关联,并获取上述地图应用提供的定位服务、路线规划服务以及导航服务等。用户可利用上述导航悬浮球快速便捷地获取当前位置到上述地址之间的路线。
例如,在图5B所示的场景下,在识别到被复制的文本为地址(“Hainan International Convention and Exhibition Center”,即“海南国际会展中心”)之后,第一电子设备还可显示导航悬浮球,参考图5E中示出的悬浮球513。在本申请实施例中,上述被复制的地址,可以是使用系统常用语言表达的,也可以是使用非系统常用语言表达的。当使用非系统常用语言表达的,第一电子设备可将上述使用非系统常用语言表达的文本翻译为系统常用语言表达的文本。
然后,如图5F所示,第一电子设备可检测到作用于悬浮球513的用户操作。响应于上述操作,第一电子设备可显示图5G所示的用户界面。该用户界面可展示从用户当前所处位置前往上述识别到的地址的路线。
如图5G所示,该界面显示有:地点A和地点B。其中,地点A可以为第一电子设备当前所处的位置(当前位置);地点B可以为第一电子设备从被复制文本中识别到的地点,例如前述识别到的“海南国际会展中心”。图5G中还示出了从地点A前往地点B的两条路线:路线1、路线2。
这样,在显示图5G所示的用户界面之后,用户可以通过该用户界面展示的地点以及路线了解如何从地点A前往地点B。
可选的,图5G所示的用户界面还可显示聚合的悬浮球414,可不显示推荐翻译服务的暂态悬浮球512。
在检测到被复制的文本之后,第一电子设备还可识别上述文本是否为电话号码。当识别到上述文本为电话号码时,第一电子设备还可显示通话悬浮球。通话悬浮球可与第一电子设备上安装的通话应用关联。当检测到作用于通话悬浮球的用户操作时,第一电子设备可呼叫上述被复制的电话号码,从而为用户提供快捷拨号服务。
第一电子设备还可检测到用户在两个或多个应用程序之间频繁切换的用户操作。响应于上述操作,第一电子设备显示分屏悬浮球。分屏悬浮球可为用户提供快捷分别服务。当检测到作用于分屏悬浮球的用户操作时,第一电子设备可将手机屏幕划分为多个窗口。一个窗口显示上述两个或多个应用程序中一个应用提供的视图。
第一电子设备还可识别其他的特定操作,并显示与上述特定操作匹配的悬浮球。这里不再一一例举。
实施上述方法,在识别到用户做出预设的特定操作之后,第一电子设备可确定与上述特定操作强相关的需求。然后,第一电子设备可显示满足上述用户需求的悬浮球。
例如:在识别到复制非系统常用语言的文本的用户操作后,第一电子设备可确定用户存在翻译上述非系统常用语言的文本的需求。于是,第一电子设备可显示翻译悬浮球,从而使用户可以通过翻译悬浮球快速便捷地获取到翻译结果,为用户浏览外文文本提供方便。
在本申请实施例中,上述导航悬浮球可以为暂态悬浮球。
在显示翻译悬浮球(悬浮球512)和导航悬浮球(悬浮球513)之后,第一电子设备可检测预设时间内是否有作用于上述悬浮球的用户操作。在上述预设时间结束后,第一电子设备可逐渐隐藏上述悬浮球。参考图5H所示的用户界面,悬浮球512和悬浮球513逐渐向右移动并逐渐折叠或缩小提示信息的显示区域,即进入隐藏态。
在将处于展开态的非暂态悬浮球的悬浮球调整为缩略态显示时,第一电子设备可检测当前屏幕中是否有缩略态的悬浮球。当检测到有缩略态的悬浮球时,第一电子设备可将上述非暂态悬浮球与上述缩略态的悬浮球聚合起来,显示一个缩略态的悬浮球。这一个缩略态的悬浮球包括上述处于全部缩略态的悬浮球。
以翻译悬浮球(悬浮球512)为例,当预设时间内未检测到作用于悬浮球512的用户操作时,第一电子设备可将悬浮球512调整为缩略态,参考图5H示出的悬浮球512。此时,屏幕中有处于缩略态的悬浮球(悬浮球414)。这时,第一电子设备可将悬浮球512与处于缩略态的悬浮球414进行聚合,得到一个新的缩略态悬浮球,参考图5I中示出的悬浮球514。此时,悬浮球514中显示的应用图标可以为最后一个进入缩略态的悬浮球512的应用图标。
这样,如果用户复制非系统语言文本的操作并不是要想翻译该文本,则第一电子设备可以及时地将上述翻译悬浮球隐藏起来,避免影响用户浏览该页面时的浏览体验。
此后,用户若想要查看翻译结果,则可以点击缩略态的悬浮球514,指示第一电子设备重新显示被隐藏的翻译悬浮球(悬浮球512),进而通过上述翻译悬浮球查看翻译结果。
在第一电子设备显示外文网页的场景下,当在预设时间内未检测到作用于翻译悬浮球的用户操作时,翻译悬浮球可进入缩略态。当第一电子设备不再显示外文网页时,第一电子设备可终止显示上述翻译悬浮球。在一些实施例中,当第一电子设备不在显示外文网页时,第一电子设备也可间隔一段时间,然后终止显示上述翻译悬浮球。上述一段时间例如3分钟。本申请实施例对此不作显示。
实施上述方法,当第一电子设备依据用户特定操作显示的悬浮球所提供的快捷服务不是用户当前需要的时,第一电子设备可适时地将上述悬浮球收缩起来,避免造成遮挡,进而提升用户使用体验。当用户需要上述悬浮球提供的快捷服务时,第一电子设备可重新显示上述悬浮球,进而为用户提供的用户需要的快捷服务。
例如,第一电子设备依据复制非系统常用语言表达的文本的操作显示的翻译悬浮球,当用户无需翻译服务时,第一电子设备可将上述翻译悬浮球隐藏起来。当用户需要上述悬浮球时,第一电子设备可重新显示上述悬浮球,进而为用户提供的用户当前亟需的翻译服务。
在将处于展开态的暂态悬浮球的悬浮球调整为缩略态显示时,第一电子设备可开始终止计时,并在该悬浮球上显示倒计时圆环。当计时结束时,第一电子设备可终止显示上述 悬浮球。
如图5H所示,在显示导航悬浮球(悬浮球513)之后,若预设时间内未检测到作用于悬浮球513的用户操作,则第一电子设备可将悬浮球513调整为缩略态,以减少显示面积。
如图5I所示,在进入缩略态之后,悬浮球513可显示倒计时圆环。该倒计时圆环的计时时长例如是5秒。如图5J所示,该倒计时圆环可从12点钟位置沿逆时针逐渐减少。用户可通过上述倒计时圆环了解剩余的第一电子设备显示该悬浮球的时长,以便于提醒用户在该悬浮球消失之前,点击该悬浮球、获取该悬浮球提供的快捷服务。
如图5J所示,在倒计时圆环的计时结束之前的任意时刻,若检测到点击悬浮球513的用户操作,第一电子设备可显示图5G所示的用户界面。在倒计时圆环的计时结束之后,若未检测到点击悬浮球513的用户操作,则第一电子设备可终止悬浮球513,即不再显示悬浮球513。参考图5K所示的用户界面,在倒计时圆环的计时结束之后,屏幕中不再显示有悬浮球513。第一电子设备也未将悬浮球513聚合到缩略态悬浮球514中。
可选的,在检测到点击悬浮球513的用户操作之后,悬浮球513对应的地图应用程序可为用户规划路线。此后,悬浮球513可变更为非暂态悬浮球。用户可随时通过上述非暂态悬浮球进入导航页面,获取导航服务。
实施上述方法,若第一电子设备依据用户特定操作显示的悬浮球所提供的快捷服务不是用户当前以需要的时,且第一电子设备无法确定未来一段时间内用户会需要上述快捷服务,则第一电子设备可及时地终止上述悬浮球,避免造成遮挡,进而提升用户使用体验。
第一电子设备还支持变更悬浮球的位置,参考图6A-图6I所示的用户界面。
参考图6A,图6A所示的用户界面中显示有聚合的悬浮球601。第一电子设备可检测到作用于悬浮球601的用户操作。响应于上述操作,第一电子设备可显示悬浮球601所包括的全部悬浮球,参考图6B,包括翻译悬浮球611、航班悬浮球612、地铁悬浮球613。
此时,第一电子设备可检测到作用于上述多个悬浮球中的任意一个悬浮球的用户操作,响应于上述操作,第一电子设备可为用户提供该悬浮球对应的快捷服务,参考图4E、图4H、图5D所示的用户界面,这里不再赘述。
如图6C所示,第一电子设备可检测到长按翻译悬浮球611的用户操作。上述操作还可以是双击操作,本申请实施例对此不作限制。响应于上述操作,第一电子设备可将翻译悬浮球611收缩起来,参考图6D中翻译悬浮球611。然后,第一电子设备可根据用户的拖动操作变更悬浮球的显示位置。同时,第一电子设备还可显示删除控件614。
如图6E所示,第一电子设备可检测到将翻译悬浮球611移动到删除控件614的用户操作,响应于上述操作,第一电子设备可删除翻译悬浮球611,即终止显示翻译悬浮球611。第一电子设备可将剩下的航班悬浮球612、地铁悬浮球613聚合为一个新的缩略态的悬浮球。该缩略态的悬浮球也不再包括翻译悬浮球611。
如图6F、图6G所示,第一电子设备还可检测到拖动翻译悬浮球611的向屏幕左下方移动的用户操作。结束移动后,第一电子设备可显示图6H所示的用户界面。此时,原来显示在屏幕右上角方向翻译悬浮球611、航班悬浮球612、地铁悬浮球613均被移动到了屏幕左下方。
在显示图6H所示的用户界面之后,若在预设时间内为检测到作用于上述任一悬浮球的用户操作,则第一电子设备可再次将上述3个悬浮球聚合为一个缩略态的悬浮球,参考图6I。
可选的,如图6J、图6K所示,第一电子设备也可检测到拖动悬浮球601的用户操作。移动完成后,第一电子设备可在移动后的位置上显示聚合的悬浮球601,参考图6L。
实施上述方法,用户可随意地调整当前显示的悬浮球的位置,从而尽可能缩小悬浮球对当前正在显示的用户界面的遮挡,提升用户使用体验。
第一电子设备可支持显示多个悬浮球。第一电子设备对支持显示的悬浮球的数量不做限制。如图6M所示,第一电子设备可显示6个悬浮球:除前述介绍的翻译悬浮球611、航班悬浮球612、地铁悬浮球613之外,还包括外卖悬浮球615、出行悬浮球616、快递悬浮球617。
上述外卖悬浮球615是在检测到用户使用外卖应用点餐之后生成的、用于提示外卖点餐进程的悬浮球。用户可通过上述悬浮球获取点餐进程,例如用户可通过悬浮球615中显示的“剩余4:20”了解到外卖大概4分20秒之后能送达。出行悬浮球616是在检测到用户使用出行应用预约出租车之后生成的、用于提示约车进程的悬浮球。例如用户可通过悬浮球615中显示的“剩余6:00”了解到预定的出租车将会在6分钟之后抵达出发地。快递悬浮球617可用于提示用户已送达的快递。
如图6M所示,第一电子设备可完整的不重叠的显示展开态的悬浮球5个。第一电子设备可将剩余的悬浮球折叠在第5个悬浮球后面。例如,第一电子设备可将悬浮球617在第5个悬浮球(悬浮球616)后面折叠显示,即显示部分的悬浮球617(悬浮球617被悬浮球616覆盖了一部分)。第一电子设备可检测到作用于悬浮球区域上的滑动操作。响应于上述操作,第一电子设备可显示被覆盖的悬浮球。
例如,参考图6N,第一电子设备可检测到作用于悬浮球区域上的向上滑动的用户操作。响应于上述用户操作,第一电子设备可显示被折叠的快递悬浮球617,参考图6O。同时,第一电子设备可将超出完整显示数量的翻译悬浮球611折叠。
当用户无法获取自己想要的悬浮球时,用户需要退出当前显示的界面,打开新的应用、页面等等。这增加了大量的用户操作、提升了交互的复杂度,降低了用户体验。实施上述方法,第一电子设备可显示多个悬浮球,从而避免因为悬浮球数量的限制导致用户无法随时获取自己想要的悬浮球,进而获取该悬浮球提供的快捷操作的问题。
在本申请实施例中,
在图4C所示的用户界面中,地铁悬浮球412可称为第一悬浮球,航班悬浮球413可称为第二悬浮球。地铁悬浮球412中显示地铁应用的图标可称为第一应用的标识。地铁悬浮球412中显示地铁站信息、地铁乘车码指示可称为第一信息。航班悬浮球413中显示的航班应用的图标可称为第二应用的标识。航班悬浮球413中显示的登机口信息、电子登机牌指示信息可称为第二信息。
在图4C、图4K所示的用户界面中,在显示地铁悬浮球412一段时间内未检测到点击 地铁悬浮球412的用户操作时,地铁悬浮球412可变更为缩略态。上述一段时间可称为第一时长。在显示航班悬浮球413一段时间内未检测到点击航班悬浮球413的用户操作时,航班悬浮球413可变更为缩略态。上述一段时间可称为第二时长。第一时长和第二时长可以相等,例如5秒,也可以不相等。
参考图4L,由地铁悬浮球412、航班悬浮球413聚合得到的悬浮球414可称为第三悬浮球。悬浮球414中显示的重叠样式的图标可指示该悬浮球为聚合的悬浮球。上述重叠样式的图标可称为第三悬浮球包括指示信息。
参考图4M,电子设备检测到作用于悬浮球414的用户操作可称为第一用户操作。
参考图4G,电子设备检测到作用于地铁悬浮球412的用户操作时可称为第二用户操作。图4H所示的页面可称为第一页面。图4H所示的页面中展示的信息可称为第三信息。
在图6M所示的用户界面中,地铁悬浮球412、航班悬浮球413分别为第一悬浮球、第二悬浮球。其中悬浮球616可称为第四悬浮球,悬浮球617可称为第五悬浮球。图6N所示的上滑操作可称为第三用户操作。执行上述操作后,悬浮球617不再被悬浮球616覆盖。
在图5E所示的用户界面中,翻译悬浮球513可也可称为第一悬浮球。从图5E中显示翻译悬浮球513到图5K中终止翻译悬浮球513之间的时间可称为第三时长。其中,从显示图5E中的展开态翻译悬浮球513到显示图5I中的缩略态的带倒计时的翻译悬浮球513之间的时间可称为第四时长。
参考图6C-图6D、图6F-图6H,悬浮球616可称为第一悬浮球或第二悬浮球,用户拖动悬浮球616的操作可称为第四用户操作。图6G所示的用户停止拖动的位置可称为第一位置。
第一电子设备的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本发明实施例以分层架构的Android系统为例,示例性说明第一电子设备的软件结构。图7示例性示出了第一电子设备实施本申请实施例提供的多任务场景下的悬浮球处理方法的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android Runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。如图7所示,应用程序包可以包括通知应用,图库,拨号,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
在本申请实施例中,通知应用可获取反映第一电子设备当前状态或所处环境的数据,并根据上述数据判断是否显示与上述状态或所处环境匹配的悬浮球,已达到为用户提供适时方便的悬浮球通知服务。
结合图4A-图4N、图5A-图5K、图6A-图6O所示的用户界面,通知应用可获取反映第一电子设备当前状态或所处环境的数据,判断第一电子设备是否正处于地铁站地理范围或机场地理范围内,或者识别第一电子设备是否正在执行复制非系统常用语言的文本的操作等。当检测到地理范围符合或执行预设的特定操作时,通知应用可调用窗口管理器显示与上述地理范围符合或执行预设的特定操作匹配的航班悬浮球、地铁悬浮球、翻译悬浮球、 导航悬浮球等。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图7所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。在本申请实施例中,显示图4A-图4N、图5A-图5K、图6A-图6O所示的用户界面依赖于窗口管理器。窗口管理器可管理前台应用程序或桌面以及悬浮球的显示位置和区域等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。在本申请实施例中,显示图4A-图4N、图5A-图5K、图6A-图6O所示的用户界面还依赖于视图系统。视图系统可管理被显示的用户界面中的文字的控件,显示图片的控件等,例如悬浮球、悬浮球中的提示信息。
电话管理器用于提供第一电子设备的通信功能。例如通话状态的管理(包括接通,挂断等)。在本申请实施例中,在识别到复制电话号码的操作之后,通知应用显示通话悬浮球,并利用通话悬浮球拨号的功能依赖于电话管理器提供的通话状态的管理服务。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。在本申请实施例中,第一电子设备可通过资源管理器提供的资源获取反映第一电子设备当前状态或所处环境的数据,例如当前位置、系统时间、剪贴板数据等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
在本申请实施例中,悬浮球可以为通知管理器展示通知内容的一种形式。此外,通知管理器展示通知内容的形式还可以是卡片、横幅、以及锁定屏幕时的通知菜单等等,这里不再一一例举。
Android Runtime包括核心库和虚拟机。Android Runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),二维(2D)图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的 融合。2D图形引擎是2D绘图的绘图引擎。三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。窗口管理器、视图系统可通过表面管理器、2D图形引擎、三维图形处理库提供的图像绘制和显示能力实现显示图4A-图4N、图5A-图5K、图6A-图6O所示的用户界面的功能。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。显示驱动可控制第一电子设备上的显示屏按照预设的用户界面进行显示,例如显示图4A-图4N、图5A-图5K、图6A-图6O所示的用户界面。
进一步的,图8示例性示出了通知应用的具体结构。下面将结合图8所示的通知应用的各个软件模块及其上述各模块在实施多任务场景下的悬浮球处理方法的过程中提供的服务。
如图8所示,通知应用可包括感知模块、业务识别模块、业务模块、悬浮球管理模块。
感知模块可用于实时获取预设的用于判断第一电子设备当前所处业务场景的数据。业务识别模块可根据感知模块获取的数据确定是否触发显示悬浮球,以及将要显示的悬浮球的类型。业务模块可根据业务识别模块确定的悬浮球的类型,从该悬浮球对应的应用程序中获取相应地将要展示的信息。悬浮球管理模块可依据业务模块执行悬浮球业务时确定的数据,显示对应的悬浮球。
感知模块可实时的获取预设的用于判断第一电子设备当前所处业务场景的数据。上述预设的用于判断第一电子设备当前所处业务场景的数据包括但不限于:指示电子设备工作状态的数据、订单信息和通知消息。
其中,指示电子设备工作状态的数据包括:指示第一电子设备当前所处位置的定位数据(当前位置)、第一电子设备当前的系统时间(当前时间)、反映第一电子设备是否与用户发生交互的交互状态、以及指示用户是否执行复制操作和被复制的内容的剪贴板数据。
第一电子设备可以从已安装的应用程序中获取用户利用该应用完成的订单的信息。上述订单例如航班订单、约车订单、外卖订单、快递订单等等。
第一电子设备也可通过识别上述应用程序的通知来获取上述订单信息。例如,在临近用户预订的航班的起飞时间时,第一电子设备安装的用户用来预订航班的应用程序可接受到服务器发送的航班行程通知。上述服务器是指与第一电子设备上安装的航班应用对应的,提供航班查询、航班预订等服务的服务器。基于上述通知,第一电子设备可获取到用户预订的航班的信息,例如航班编号、出发地、起飞时间等等。进而,第一电子设备可识别用户当前是在机场、进行值机、候机等状态或动作。
不限于上述例举的当前位置、系统时间、交互状态、剪贴板数据以及应用程序的通知。感知模块还可感知其他反映第一电子设备状态的数据。本申请实施例对此不作限制。
业务识别模块可根据感知模块获取的数据确定是否触发悬浮球业务。
首先,业务识别模块可记录有具体的悬浮球类型和各悬浮球的显示条件。表1示出了业务识别模块中记录的悬浮球类型和各悬浮球的显示条件。业务识别模块可根据表1确定第一电子设备当前的状态或所处环境是否触发了某一类型的悬浮球。
表1
Figure PCTCN2022140359-appb-000001
“业务类型”包括:航班、地铁、翻译、导航、拨号、分屏。上述航班、地铁、翻译、导航、拨号、分屏分别对应前述用户界面介绍的航班业务、地铁业务、翻译业务、导航业务、拨号业务、分屏业务。
“动作”包括:显示、隐藏、终止和展开。图4B所示的显示悬浮球412的动作可称为显示动作。图4K、图4L所示的将悬浮球调整为缩略态(包括聚合)显示的动作可称为隐藏动作。图5K所示的不再显示悬浮球513的动作可称为终止动作。图4M和图4N所示的展开缩略态悬浮球414的动作可称为展开动作。
“当前位置”包括:机场地理范围、非机场地理范围、地铁站地理范围和非地铁站地理范围。上述“机场地理范围”是指第一电子设备的当前位置在预设的机场的地理范围内,反之,上述“非机场地理范围”是指第一电子设备的当前位置不在预设的机场的地理范围内。同理,“地铁站地理范围”是指第一电子设备的当前位置在预设的地铁站的地理范围内,“非地铁站地理范围”是指第一电子设备的当前位置不在预设的地铁站的地理范围内。
“当前时间”所处的状态包括:候机、已起飞。当前时间所处的状态为候机是指当前时间在用户预定的航班起飞之前的一段时间内。上述一段时间例如起飞前4个小时。本申请实施例对此不作限制。当前时间所处的状态为已起飞是指第一电子设备的当前时间在用户预定的航班起飞之后(包含起飞)。
“交互状态”包括:计时时间内无操作、复制、关闭页面、往返切换、点击悬浮球等动作。计时时间内无操作是指第一电子设备没有检测到作用于该悬浮球的用户操作。复制是指第一电子设备检测到的复制图文的用户操作。关闭页面是指第一电子设备检测到的关闭当前显示的页面或复制操作作用的页面的用户操作。往返切换是指第一电子设备检测到的两个或多个应用程序之间频繁切换的用户操作。例如,从应用A切换到应用B再切换到应用A的频繁地变更前台应用的操作。点击悬浮球是指第一电子设备检测到的作用于屏幕中缩略态的悬浮球的点击操作。
“剪贴板数据”包括:非系统常用语言、地址、电话号码。在“交互状态”为复制时,“剪贴板数据”中写入的数据所使用的语言为非系统常用语言可指示用户复制外文文本的动作;“剪贴板数据”中写入的数据为地址可指示用户复制地址的动作;“剪贴板数据”中写入的数据为电话号码可指示用户复制电话号码的动作。
上述“\”表示业务识别模块在判断是否触发业务时无需考虑的数据类型。行中被标记为“\”的数据的取值不会影响业务识别模块判断是否触发该行中的业务。例如,在业务识别模块识别是否触发显示航班悬浮球时,业务识别模块无需关注“交互状态”和“剪贴板数据”中的数据。“交互状态”和“剪贴板数据”取何种数值都不会影响业务识别模块识别是否触发显示航班悬浮球。
在航班业务中:首先,第一电子设备可从航班应用中获取用户的航班订单,或者通过监测航班应用的通知获取用户的航班订单,进而确定用户的航班信息(起飞时间、出发地等)。当检测到当前位置在机场地理范围内,且当前时间为候机时,业务识别模块可确定触发显示航班悬浮球。航班悬浮球中的提示可以为值机柜台、登机口、座位号等信息。进一步的,航班悬浮球可以轮播上述信息。
可选的,业务识别模块还可进一步区别当前时间在候机中具体所处的阶段,例如值机阶段、安检阶段、等候登机阶段。进而,航班悬浮球可根据上述不同阶段展示上述信息。如果当前位置在机场地理范围内,当前时间在起飞时间之后,且接收到航班延误的通知(或者从航班应用获取的航班订单中检测到延误),则航班悬浮球中显示的提示信息还可包括延 误提示。
若第一电子设备在显示展开态航班悬浮球一段时间后,且第一电子设备没有检测到作用于航班悬浮球的用户操作(交互状态:计时时间内无操作)时,业务识别模块可确定隐藏航班悬浮球。若当前位置不在机场地理范围内,且当前时间在预定航班的起飞时间之后(已经达到起飞时间且用户不再机场范围内),则业务识别模块可确定终止航班悬浮球。
在地铁业务中:当前位置在地铁站地理范围内时,业务识别模块可确定触发地铁业务。此时,通知应用可确定显示地铁悬浮球。当前位置不在地铁站地理范围内时,业务识别模块可确定终止地铁悬浮球。同样的,若在计时时间内未检测到作用于地铁悬浮球的用户操作,业务识别模块可确定隐藏地铁悬浮球,将展开态的地铁悬浮球调整为缩略态。
在翻译业务中:当“交互状态”为复制,且被复制的数据所使用的语言为非系统常用语言时,业务识别模块可确定显示翻译悬浮球。在显示翻译悬浮球之后,且“交互状态”为关闭页面时,业务识别模块可确定终止翻译悬浮球。同样的,若在计时时间内未检测到作用于翻译悬浮球的用户操作,业务识别模块可确定将展开态的翻译悬浮球调整为缩略态。
在导航业务中:当“交互状态”为复制,且被复制的数据为地址时,业务识别模块可确定显示导航悬浮球。在计时时间内未检测到作用于地铁悬浮球的用户操作,业务识别模块可确定将展开态的导航悬浮球调整为缩略态。在进入缩略态之后,导航悬浮球可开始新一轮计时。在该新一轮计时结束后,且未检测到作用于导航悬浮球的用户操作,则业务识别模块可确定终止导航悬浮球。
在拨号业务中:当“交互状态”为复制,且被复制的数据为电话号码时,业务识别模块可确定显示拨号悬浮球。在计时时间内未检测到作用于地铁悬浮球的用户操作,业务识别模块可确定将展开态的拨号悬浮球调整为缩略态。在进入缩略态之后,拨号悬浮球可开始新一轮计时。在该新一轮计时结束后,且未检测到作用于拨号悬浮球的用户操作,则业务识别模块可确定终止拨号悬浮球。
在分屏业务中:当“交互状态”为往返切换时,业务识别模块可确定显示分屏悬浮球。在计时时间内未检测到作用于地铁悬浮球的用户操作,业务识别模块可确定将展开态的分屏悬浮球调整为缩略态。在进入缩略态之后,分屏悬浮球可开始新一轮计时。在该新一轮计时结束后,且未检测到作用于分屏悬浮球的用户操作,则业务识别模块可确定终止分屏悬浮球。
进一步的,对于上述航班悬浮球、地铁悬浮球、翻译悬浮球,当上述悬浮球变更为缩略态时,上述多个缩略态的悬浮球还可聚合为一个。
当检测到作用于缩略态悬浮球的用户操作时,例如点击悬浮球的用户操作,业务识别模块可确定展开被隐藏的悬浮球。进一步的,若缩略态的悬浮球为聚合的悬浮球,则业务识别模块可确定展开被聚合的悬浮球。
此外,上述业务类型还包括快递业务、外卖业务、约车业务(打车出行)。第一电子设备可从执行上述业务的应用程序中获取用户的订单信息,进而显示对应的悬浮球。
例如,第一电子设备可从快递应用中获取用户的快递订单。当有待确认接收的订单时,第一电子设备向用户可确定满足通知应用中预设的快递业务。于是,第一电子可显示快递 悬浮球,参考图3A。用户可通过上述快递悬浮球中获取代办的快递任务。当快递任务已完成,例如代签收的快递已签收时,上述快递悬浮球可被终止。
外卖业务、约车业务可参考上述快递业务,这里不再赘述。
根据业务类型,业务模块可分为航班模块、地铁模块、翻译模块、导航模块、拨号模块、分屏模块等细分模块。各个细分模块记录有各个细分业务的业务逻辑。细分模块可根据业务识别模块下发的业务指示信息确定悬浮球状态(显示、隐藏、终止、展开),和悬浮球需要展示的信息。
以确认显示航班悬浮球为例,航班模块可接收到显示航班悬浮球的业务指示信息。响应于上述业务指示信息,航班模块可首先确定用户的航班信息。航班模块可从感知模块中的订单信息模块中获取用户的订单信息。上述订单信息包括被预订航班的航班信息,例如航班编号、日期、出发地、起飞时间等等。基于上述航班信息,航班模块可确定将要显示的航班悬浮球中的提示信息,例如值机柜台、登机口、座位号等航班信息。同时,航班模块可确页面链接。上述页面链接为航班应用中显示用户航班订单的页面的链接。航班模块可利用上述页面链接获取并展示上述航班应用中显示用户航班订单的页面。
悬浮球管理模块可依据业务模块发送的数据构建悬浮球。上述业务模块发送的数据(或称业务模块调用悬浮球管理模块构建悬浮球的调用参数)可包括:状态、悬浮球编号(ID)、展示内容、回调接口。
上述状态即表1中介绍的悬浮球的状态,包括显示、隐藏、终止、展开。悬浮球管理模块可依据上述状态确定显示、隐藏、终止或展开悬浮球。相应地,悬浮球管理模块可确定与上述显示、隐藏、终止或展开动作对应的动画显示效果。
悬浮球ID可用于标记各个悬浮球。此后,当需要变更悬浮球的状态时,悬浮球管理模块可根据悬浮球ID确定被变更的悬浮球。展示内容是指悬浮球在展开态中直接显示的内容,包括应用图标和提示。展示内容能为用户提供最直观的通知提示。不同业务对应的悬浮球中需要展示的应用图标和提示均不同,具体可参考图3A的介绍,这里不再赘述。
回调接口可用于向业务模块传回控制命令。上述控制命令可指示业务模块执行后续操作,例如显示跳转页面等等。以航班悬浮球为例,在检测到用户作用于展开态航班悬浮球的用户操作之后,悬浮球管理模块可向航班模块传回指示点击操作的控制命令。响应于上述控制命令,航班模块可调用窗口管理器显示航班详情页面。上述航班详情页面为航班模块从航班应用中获取的。上述航班详情页面例如图4E所示的登机牌页面。或者,上述控制命令也可以触发运行航班应用。这样,用户可以在航班应用提供的用户界面中获取预定航班的航班信息。
窗口管理器和资源管理可参考图7中的介绍,这里不再赘述。
可选的,除悬浮球提供的通知服务外,第一电子设备上还可包括其他类型的通知服务,例如卡片通知、横幅通知。此时,除悬浮球通知外,通知应用提供的服务还应包括卡片通知、横幅通知等其他类型的通知服务。这时,通知应用还可包括通知管理模块,参考图9 所示的软件结构图。
通知管理模块可包括悬浮球模块、卡片模块、横幅模块。在接收到业务识别模块发送的业务指示信息后,通知管理模块还可确定通知的形式。例如,当上述业务指示信息指示航班业务时,于是,通知管理模块可确定显示航班悬浮球、航班卡片和航班横幅。此时,通知管理模块发送给航班业务的业务指示信息还包括通知形式指示信息。航班业务可根据上述通知形式指示信息确定生成哪一形式的通知,即悬浮球通知、卡片通知、横幅通知。
相应地,根据通知形式指示信息指示的通知形式,航班业务可分别向各通知形式对应的管理模块发送通知内容(参数)。例如,上述通知形式指示信息指示的航班业务的通知形式包括悬浮球通知、卡片通知和横幅通知。此时,航班业务可分别向悬浮球管理模块、卡片管理模块、横幅管理模块发送通知内容。悬浮球管理模块、卡片管理模块、横幅管理模块可根据上述通知内容生成展示有上述通知内容的悬浮球、卡片以及横幅。
图8和图9所示的软件结构仅为示例性例举,不应构成对本申请实施例的限制。
结合图4A-图4N、图5A-图5K所示的用户界面,图10示出了第一电子设备实施前述多任务场景下的悬浮球处理方法的流程图。
S101:获取状态数据。
第一电子设备可实时地获取预设的用于判断第一电子设备当前所处业务场景的数据。具体的,参考图8,通知应用中的感知模块可完成上述获取数据的动作。上述数据包括但不限于订单信息、当前位置、系统时间、交互状态以及剪贴板数据等。上述订单信息、当前位置、系统时间、交互状态以及剪贴板数据具体可参考图8的介绍,这里不再赘述。
例如,在时刻T,感知模块获取到的状态数据可如下表(表2)所示:
表2
订单信息 航班订单A
当前位置 位置S
系统时间 时刻T
交互状态 复制
剪贴板数据 Hainan International Convention and Exhibition Center
上述航班订单A可表示第一电子设备从航班应用获取的用户的预定的一张机票的订单信息,参考图4E。第一电子设备可从航班订单中获取用户的航班信息。
上述位置S可表示第一电子设备当前所处的地理位置为位置S。上述位置S可以是指示位置的经纬度数据。第一电子设备上安装的地图应用可将上述经纬度数据转换为用户容易理解的地点,例如图5G中示出的地点A。或者,上述位置S也可以直接是经过转换的地点,例如上述地点A。
上述时刻T是指第一电子设备的当前时间。上述时刻T同时也可表示第一电子设备获取上述当前位置、交互状态以及剪贴板数据的时间。
第一电子设备可检测用户与第一电子设备的交互操作。上述“复制”可指示在时刻T时,第一电子设备检测到了作用于第一电子设备中显示的内容的复制操作。此外,第一电子设备还可检测到作用于用户界面中显示的控件的点击操作、长按操作、双击操作以及切 换应用等等,这里不再一一例举。
在检测到“复制”操作之后,第一电子设备的剪贴板中可写入用户选中的被复制的数据。上述数据包括但不限于文本。上述文本所使用的语言包括但不限于中文、英语、日语、德语、法语等。例如,参考图5B所示的用户界面,在检测到作用于复制操作之后,第一电子设备的剪贴板中可写入被复制的文本“Hainan International Convention and Exhibition Center”。
S102:确定上述状态数据是否触发预设的业务。
第一电子设备利用悬浮球为用户提供通知服务的场景包括多个。例如,前述介绍的显示航班悬浮球为用户提供快捷查看航班信息的业务场景、显示地铁悬浮球为用户提供快速获取地铁二维码的业务场景,以及显示翻译悬浮球为用户提供即时翻译服务的业务场景等等。
根据各个业务场景的特点,第一电子设备可设置有各类业务的触发条件,即显示相应地悬浮球的显示条件。执行S101,第一电子设备可获取反映自身所处状态的状态数据,然后,第一电子设备可确定上述状态数据是否满足显示某一类悬浮球的显示条件。当满足时,第一电子设备可确定显示相应地悬浮球。
参考前述图8的介绍,业务识别模块中可预设有业务类型和对应的触发条件(表1)。在接收到感知模块发送的状态数据之后,业务识别模块查询与上述状态数据匹配的业务。当查询到与上述状态数据匹配的业务之后,业务识别模块可向业务模块发送业务指示信息。
例如,在接收到表2所示的状态数据之后,第一电子设备可在表1中查询与上述状态数据匹配的业务。假设位置S在机场S1的地理范围内。上述机场S1为用户预订的航班起飞地的机场。机场S1中还包括机场地铁站。同时,位置S也在机场地铁站的地理范围内。时刻T在用户预订的航班的值机时间范围内。此时,业务识别模块可确认显示航班悬浮球。同时,业务识别模块还可确认显示地铁悬浮球;根据表2中的交互状态“复制”和剪贴板数据中的英文文本,业务识别模块还可确认触发显示翻译悬浮球。
S103:依据被触发的业务,构建匹配该业务的悬浮球。
在确定被触发的业务之后,业务识别模块可向业务模块发送业务指示信息。此时,上述业务指示信息中可包括显示航班悬浮球指示信息、显示地铁悬浮球指示信息、显示翻译悬浮球指示信息。业务模块中的航班模块、地铁模块、翻译模块可分别接收到上述显示航班悬浮球指示信息、显示地铁悬浮球指示信息、显示翻译悬浮球指示信息。
在各个业务模块接收到业务指示信息后,上述各个业务模块可依据上述业务指示信息,按预设的业务逻辑,显示、隐藏、终止或展开对应业务的悬浮球。
例如,响应于接收到的显示航班悬浮球指示信息,航班模块可确定用户的订单信息。上述订单信息包括被预订航班的航班信息,例如航班编号、日期、出发地、起飞时间等等。基于上述航班信息,航班模块可确定将要显示的航班悬浮球中的提示信息,例如值机柜台、登机口、座位号等航班信息。同时,航班模块可确页面链接。上述页面链接为航班应用中显示用户航班订单的页面的链接。航班模块可利用上述页面链接获取并展示上述航班应用 中显示用户航班订单的页面。
在确定用户的航班信息之后,航班模块可向悬浮球管理模块发送悬浮球参数。上述悬浮球参数包括但不限于状态、业务编号(ID)、展示内容、回调接口。上述悬浮球参数可参考图8的介绍,这里不再赘述。
此时,航班模块可向悬浮球管理模块发送悬浮球参数可如下表(表3)所示:
表3
Figure PCTCN2022140359-appb-000002
S104:依据悬浮球参数显示悬浮球。
在接收到业务模块下发的悬浮球参数后,悬浮球管理模块可依据上述悬浮球参数显示、隐藏、终止或展开悬浮球。
例如,在接收到表3所示的悬浮球参数之后,悬浮球管理模块可构建悬浮球X,例如图4C所示的航班悬浮球413,并控制窗口管理器显示上述悬浮球X。
上述悬浮球X编号可以为悬浮球ID(0001),也可以是与悬浮球ID关联的其他编号。通过悬浮球编号或悬浮球ID,悬浮球管理模块定位上述悬浮球X。
然后,悬浮球管理模块可确定悬浮球X中展示的应用图标为航班应用的图标,同时,悬浮球X中展示的提示信息为“值机柜台、登机口或座位号”,参考图4C所示的用户界面。或者,悬浮球X中展示的提示信息轮播上述值机柜台、登机口和座位号。
悬浮球X还包括回调接口A。在检测到作用于悬浮球X的用户操作后,悬浮球X可通过上述回调接口A向对应的业务模块发送指示信号。例如,在图4C所示的场景中,在检测作用于悬浮球413的用户操作后,悬浮球413可通过回调接口A向航班模块发送指示信号。上述指示信号可触发航班模块显示图4E所示的用户界面,或指示运行航班应用程序,然后显示用户的航班订单等。
这样,第一电子设备检测当前所处的状态。当触发多类业务时,第一电子设备可显示多个悬浮球。这样,用户可以同时获取到多个悬浮球的提示信息。
图11示出了第一电子设备的硬件结构示意图。
第一电子设备可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气 压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本发明实施例示意的结构并不构成对第一电子设备的具体限定。在本申请另一些实施例中,第一电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
充电管理模块140用于从充电器接收充电输入。电源管理模块141用于连接电池142,充电管理模块140与处理器110。
第一电子设备的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。第一电子设备中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在第一电子设备上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以 是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在第一电子设备上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在本申请实施例中,第一电子设备可基于移动通信模块150和/或无线通信模块160提供的通信服务实现获取航班应用中的航班订单、显示地铁乘车码、浏览外文网页等。
在一些实施例中,第一电子设备的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得第一电子设备可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
在本申请实施例中,第一电子设备可基于上述无线通信技术实现实时定位,从而获取指示用户当前所处地理位置的定位数据。
第一电子设备通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD)。显示面板还可以采用有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),miniled,microled,micro-oled,量子点发光二极管(quantum dot light emitting diodes,QLED)等制造。在一些实施例中,电子设备可以包括1个或N个显示屏194,N为大于1的正整数。
在本申请实施例中,第一电子设备显示图4A-图4N、图5A-图5K、图6A-图6O所示的用户界面依赖于上述GPU,显示屏194,以及应用处理器等提供的显示能力。
第一电子设备可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用 处理器等实现拍摄功能。
内部存储器121可以包括一个或多个随机存取存储器(random access memory,RAM)和一个或多个非易失性存储器(non-volatile memory,NVM)。
随机存取存储器可以包括静态随机存储器(static random-access memory,SRAM)、动态随机存储器(dynamic random access memory,DRAM)、同步动态随机存储器(synchronous dynamic random access memory,SDRAM)、双倍资料率同步动态随机存取存储器(double data rate synchronous dynamic random access memory,DDR SDRAM,例如第五代DDR SDRAM一般称为DDR5SDRAM)等。非易失性存储器可以包括磁盘存储器件、快闪存储器(flash memory)。
随机存取存储器可以由处理器110直接进行读写,可以用于存储操作系统或其他正在运行中的程序的可执行程序(例如机器指令),还可以用于存储用户及应用程序的数据等。非易失性存储器也可以存储可执行程序和存储用户及应用程序的数据等,可以提前加载到随机存取存储器中,用于处理器110直接进行读写。
在本申请实施例中,通知应用的代码可存储在非易失性存储器中。在运行上述通知应用时,第一电子设备可将上述通知应用的代码加载到随机存取存储器,进而执行通知应用,实现通知应用提供的多任务场景下的悬浮球处理方法。
外部存储器接口120可以用于连接外部的非易失性存储器,实现扩展第一电子设备的存储能力。外部的非易失性存储器通过外部存储器接口120与处理器110通信,实现数据存储功能。
第一电子设备可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。陀螺仪传感器180B可以用于确定第一电子设备的运动姿态。气压传感器180C用于测量气压。磁传感器180D包括霍尔传感器。第一电子设备可以利用磁传感器180D实现磁吸贴附等功能。加速度传感器180E可检测第一电子设备在各个方向上(一般为三轴)加速度的大小。当第一电子设备静止时可检测出重力的大小及方向。加速度传感器180E还可以用于识别电子设备姿态。距离传感器180F用于测量距离。接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。第一电子设备可以利用接近光传感器180G检测用户手持第一电子设备贴近耳朵通话,以便自动熄灭屏幕。接近光传感器180G也可用于自动解锁与锁屏。环境光传感器180L用于感知环境光亮度。指纹传感器180H用于采集指纹。温度传感器180J用于检测温度。
触摸传感器180K,也称“触控器件”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于第一电子设备的表面,与显示屏194所处的位置不同。
在本申请实施例中,第一电子设备检测是否有作用于图4A-图4H、图5A-图5I或图 6A-图6I所示用户界面中控件的用户操作依赖于触摸传感器180K提供的触摸检测能力。
骨传导传感器180M可以获取振动信号。按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。第一电子设备可以接收按键输入,产生与第一电子设备的用户设置以及功能控制有关的键信号输入。马达191可以产生振动提示。在第一电子设备显示悬浮球时,第一电子设备也可同时利用马达191,来强化提示。指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和第一电子设备的接触和分离。第一电子设备可以支持1个或N个SIM卡接口,N为大于1的正整数。
本申请的说明书和权利要求书及附图中的术语“用户界面(user interface,UI)”,是应用程序或操作系统与用户之间进行交互和信息交换的介质接口,它实现信息的内部形式与用户可以接受形式之间的转换。应用程序的用户界面是通过java、可扩展标记语言(extensible markup language,XML)等特定计算机语言编写的源代码,界面源代码在终端设备上经过解析,渲染,最终呈现为用户可以识别的内容,比如图片、文字、按钮等控件。控件(control)也称为部件(widget),是用户界面的基本元素,典型的控件有工具栏(toolbar)、菜单栏(menu bar)、文本框(text box)、按钮(button)、滚动条(scrollbar)、图片和文本。界面中的控件的属性和内容是通过标签或者节点来定义的,比如XML通过<Textview>、<ImgView>、<VideoView>等节点来规定界面所包含的控件。一个节点对应界面中一个控件或属性,节点经过解析和渲染之后呈现为用户可视的内容。此外,很多应用程序,比如混合应用(hybrid application)的界面中通常还包含有网页。网页,也称为页面,可以理解为内嵌在应用程序界面中的一个特殊的控件,网页是通过特定计算机语言编写的源代码,例如超文本标记语言(hyper text markup language,GTML),层叠样式表(cascading style sheets,CSS),java脚本(JavaScript,JS)等,网页源代码可以由浏览器或与浏览器功能类似的网页显示组件加载和显示为用户可识别的内容。网页所包含的具体内容也是通过网页源代码中的标签或者节点来定义的,比如GTML通过<p>、<img>、<video>、<canvas>来定义网页的元素和属性。
用户界面常用的表现形式是图形用户界面(graphic user interface,GUI),是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、控件等界面元素,其中控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素。
在本申请的说明书和所附权利要求书中所使用的那样,单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在也包括复数表达形式,除非其上下文中明确地有相反指示。还应当理解,本申请中使用的术语“和/或”是指并包含一个或多个所列出项目的任何或所有可能组合。上述实施例中所用,根据上下文,术语“当…时”可以被解释为意思是“如果…”或“在…后”或“响应于确定…”或“响应于检测到…”。类似地,根据上下文,短语“在确定…时”或“如果检测到(所陈述的条件或事件)”可以被解释为意思是“如果确定…”或“响应 于确定…”或“在检测到(所陈述的条件或事件)时”或“响应于检测到(所陈述的条件或事件)”。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如DVD)、或者半导体介质(例如固态硬盘)等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。

Claims (19)

  1. 一种多任务交互方法,应用于电子设备,其特征在于,所述方法包括:
    检测到所述电子设备满足第一预设条件,显示第一悬浮球;其中,所述第一悬浮球中显示有第一应用的标识和第一信息;
    在所述电子设备的界面上显示有所述第一悬浮球时,检测到所述电子设备满足第二预设条件,在所述电子设备的界面上显示所述第一悬浮球的同时显示第二悬浮球;其中,所述第二悬浮球中显示有第二应用的标识和第二信息。
  2. 根据权利要求1所述的方法,其特征在于,所述第二悬浮球显示在所述第一悬浮球的上方。
  3. 根据权利要求1或2所述的方法,其特征在于,所述方法还包括:
    确定在显示所述第一悬浮球后的第一时长内未检测到作用于所述第一悬浮球的用户操作,显示缩略态的所述第一悬浮球;所述缩略态的所述第一悬浮球中包括所述第一应用的标识,不包括所述第一信息。
  4. 根据权利要求3所述的方法,其特征在于,所述方法还包括:
    确定在显示所述第二悬浮球后的第二时长内未检测到作用于所述第二悬浮球的用户操作,显示缩略态的所述第二悬浮球;所述缩略态的所述第二悬浮球中包括所述第二应用的标识,不包括所述第二信息。
  5. 根据权利要求4所述的方法,其特征在于,所述第一时长与所述第二时长相等。
  6. 根据权利要求4或5所述的方法,其特征在于,所述显示缩略态的所述第二悬浮球,包括:
    确定在所述电子设备的界面上显示有缩略态的其他悬浮球,将所述缩略态的所述第二悬浮球与所述缩略态的其他悬浮球聚合为第三悬浮球;
    其中,所述第三悬浮球中显示有所述第二应用的标识。
  7. 根据权利要求6所述的方法,其特征在于,所述第三悬浮球包括指示信息,所述指示信息用于指示所述第三悬浮球为聚合的包括多个悬浮球的悬浮球。
  8. 根据权利要求7所述的方法,其特征在于,所述方法还包括:
    检测到作用于所述第三悬浮球的第一用户操作;
    响应于所述第一用户操作,显示所述多个悬浮球。
  9. 根据权利要求1-8中任一项所述的方法,其特征在于,
    所述第一信息为用户预订的航班的值机提示,所述第一预设条件包括:获取到所述航班的通知,所述电子设备的当前时间在所述航班的值机时间范围内;
    或,所述第一信息为用户预订的航班的登机提示,所述第一预设条件包括:获取到所述航班的通知,所述电子设备的当前时间在所述航班的候机时间范围内,且所述电子设备的当前位置在所述航班的起飞机场的地理范围内;
    或,所述第一信息为地铁乘车提示,所述第一预设条件包括:所述电子设备的当前位置在地铁站的地理范围内;
    或,所述第一信息为翻译提示,所述第一预设条件包括:检测到复制操作,且被复制的内容所使用的语言为非系统常用语言。
  10. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    确定在显示所述第一悬浮球后的第三时长内未检测到作用于所述第一悬浮球的用户操作,终止显示所述第一悬浮球。
  11. 根据权利要求10所述的方法,其特征在于,所述确定在显示所述第一悬浮球后的第三时长内未检测到作用于所述第一悬浮球的用户操作,终止显示所述第一悬浮球,包括:
    确定在显示所述第一悬浮球后的第四时长内未检测到作用于所述第一悬浮球的用户操作,显示缩略态的所述第一悬浮球;
    所述缩略态的所述第一悬浮球中包括所述第一应用的标识,不包括所述第一信息;所述缩略态的所述第一悬浮球还包括倒计时标识,所述倒计时标识用于指示所述缩略态的所述第一悬浮球剩余显示时间;所述第三时长等于所述第四时长与所述倒计时标识指示的倒计时时长的和;
    在所述倒计时标识指示计时结束时,终止显示所述第一悬浮球。
  12. 根据权利要求10或11所述的方法,其特征在于,
    所述第一信息为导航提示,所述第一预设条件包括:检测到复制操作,且被复制的内容指示了地图上的第一位置;
    所述第一信息为拨号提示,所述第一预设条件包括:检测到复制操作,且被复制的内容包括第一电话号码。
  13. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    检测到作用于所述第一悬浮球的第二用户操作;
    响应于所述第二用户操作,显示第一页面,所述第一页面展示有第三信息,所述第三信息包括所述第一信息,或者,所述第三信息与所述第一信息关联。
  14. 根据权利要求13所述的方法,其特征在于,所述第一页面还包括所述第二悬浮球;或者,还包括缩略态的所述第二悬浮球,所述缩略态的所述第二悬浮球中包括所述第二应用的标识,不包括所述第二信息。
  15. 根据权利要求14所述的方法,其特征在于,
    所述第一页面显示有图形码,则所述图形码与所述第二悬浮球不重叠;所述图像码包括二维码、条形码。
  16. 根据权利要求1所述的方法,其特征在于,所述电子设备的界面上还显示有第四悬浮球、第五悬浮球,所述第四悬浮球覆盖在所述第五悬浮球之上,所述方法还包括:
    检测到作用于所述电子设备的界面的第三用户操作;
    响应于所述第三用户操作,显示所述第四悬浮球与所述第五悬浮球,且所述第五悬浮球未被所述第四悬浮球覆盖。
  17. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    检测到作用于所述第一悬浮球或所述第二悬浮球的第四用户操作;
    响应于所述第四用户操作,在所述电子设备的界面的第一位置显示所述第一悬浮球和所述第二悬浮球,其中,所述第一位置为所述第四用户操作终止的位置。
  18. 一种电子设备,其特征在于,包括一个或多个处理器和一个或多个存储器;其中,所述一个或多个存储器与所述一个或多个处理器耦合,所述一个或多个存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述一个或多个处理器执行所述计算机指令时,使得执行如权利要求1-17任一项所述的方法。
  19. 一种计算机可读存储介质,包括指令,其特征在于,当所述指令在电子设备上运行时,使得执行如权利要求1-17任一项所述的方法。
PCT/CN2022/140359 2022-03-03 2022-12-20 多任务场景下的悬浮球处理方法和电子设备 WO2023165225A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22905473.9A EP4270911A1 (en) 2022-03-03 2022-12-20 Suspended ball processing method in multi-tasking scenario, and electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210209969.4A CN116800882A (zh) 2022-03-03 2022-03-03 多任务场景下的悬浮球处理方法和电子设备
CN202210209969.4 2022-03-03

Publications (2)

Publication Number Publication Date
WO2023165225A1 WO2023165225A1 (zh) 2023-09-07
WO2023165225A9 true WO2023165225A9 (zh) 2023-10-26

Family

ID=87473765

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/140359 WO2023165225A1 (zh) 2022-03-03 2022-12-20 多任务场景下的悬浮球处理方法和电子设备

Country Status (3)

Country Link
EP (1) EP4270911A1 (zh)
CN (1) CN116800882A (zh)
WO (1) WO2023165225A1 (zh)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111399959A (zh) * 2020-03-17 2020-07-10 Oppo广东移动通信有限公司 多任务操作方法、装置、电子设备以及存储介质
CN113645351B (zh) * 2020-04-24 2022-10-28 华为技术有限公司 应用界面交互方法、电子设备和计算机可读存储介质
CN113805747B (zh) * 2021-08-12 2023-07-25 荣耀终端有限公司 信息提醒方法、电子设备及计算机可读存储介质
CN113791850B (zh) * 2021-08-12 2022-11-18 荣耀终端有限公司 一种信息显示方法及电子设备
CN117806516A (zh) * 2021-09-22 2024-04-02 荣耀终端有限公司 一种悬浮窗显示方法及电子设备

Also Published As

Publication number Publication date
EP4270911A1 (en) 2023-11-01
CN116800882A (zh) 2023-09-22
WO2023165225A1 (zh) 2023-09-07

Similar Documents

Publication Publication Date Title
US20230077467A1 (en) Card Display Method, Electronic Device, and Computer Readable Storage Medium
US11847292B2 (en) Method of processing content and electronic device thereof
US11537450B2 (en) Method, apparatus, and mobile terminal for associating notification messages
WO2021000841A1 (zh) 一种生成用户头像的方法及电子设备
WO2021008334A1 (zh) 小程序的数据绑定方法、装置、设备及存储介质
CN105389325A (zh) 内容搜索方法和实施内容搜索方法的电子装置
WO2018223558A1 (zh) 数据处理方法及电子设备
AU2018414730B2 (en) Application window display method and terminal
CN113791850B (zh) 一种信息显示方法及电子设备
US11625255B2 (en) Contextual navigation menu
CN112612386B (zh) 移动终端及其应用卡片的显示方法
US20220308721A1 (en) Message thread prioritization interface
CN108230014A (zh) 电子装置及使用电子装置显示网页的方法
CN111176766A (zh) 一种通信终端及组件显示方法
KR102471739B1 (ko) 전자 장치의 히스토리 정보 관리 장치 및 방법
CN111935353B (zh) 移动终端及其短信显示方法
CN111949350A (zh) 一种界面显示方法和设备
WO2023005751A1 (zh) 渲染方法及电子设备
WO2023165225A9 (zh) 多任务场景下的悬浮球处理方法和电子设备
CN114594894A (zh) 界面元素的标记方法及终端设备、存储介质
CN112825536B (zh) 电子终端及后台卡片显示方法
WO2023246386A1 (zh) 界面显示方法和装置
WO2024037346A1 (zh) 页面管理方法及电子设备
WO2024051555A1 (zh) 一种数据查询方法、电子设备及系统
CN117369916A (zh) 应用的显示方法、电子设备以及存储介质

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2022905473

Country of ref document: EP

Effective date: 20230620

WWE Wipo information: entry into national phase

Ref document number: 18268530

Country of ref document: US