WO2022166713A1 - Electronic device and display method for application thereof, and medium - Google Patents

Electronic device and display method for application thereof, and medium Download PDF

Info

Publication number
WO2022166713A1
WO2022166713A1 PCT/CN2022/074024 CN2022074024W WO2022166713A1 WO 2022166713 A1 WO2022166713 A1 WO 2022166713A1 CN 2022074024 W CN2022074024 W CN 2022074024W WO 2022166713 A1 WO2022166713 A1 WO 2022166713A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
application
area
user
mobile phone
Prior art date
Application number
PCT/CN2022/074024
Other languages
French (fr)
Chinese (zh)
Inventor
胡颖峰
王红军
刘诗聪
崔擎誉
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022166713A1 publication Critical patent/WO2022166713A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

  • the present application relates to a graphic interface display technology in the field of electronic equipment.
  • it relates to an electronic device and a display method and medium for its application.
  • the user needs to pay attention to the content changes of one or more other applications. For example, after starting the navigation application, the user wants to use the instant chat application to chat while always paying attention to the content change of the navigation route in the navigation application. In this case, the user needs to switch back and forth between the navigation application and the instant chat application, which is cumbersome.
  • the purpose of this application is to provide a display method and medium for an electronic device and its application.
  • the electronic device will display the display content of the display interface of the first application on the second application or the desktop through a floating window. in the display interface, so that the user can pay attention to the changes of the first application while using the second application without switching between the two applications.
  • a first aspect of the present application provides an application display method, including: displaying a first display interface of a first application on a screen of an electronic device; displaying a second display interface of a second application and a first display interface of the first application on the screen a display area, wherein a part of the second display interface is blocked by the first display area, and the first display area is a part of the first display interface.
  • the electronic device opens the first application and the second application, selects the first display area from the first display interface of the first application, and displays the first display area on the second display of the second application In the interface, the first display area is smaller than the second display interface.
  • the electronic device may be a mobile phone
  • the first application may be a navigation application
  • the second application may be an instant chat application.
  • the first display interface may be a display interface of a navigation application
  • the second display interface may be a display interface of an instant chat application
  • the first display area may be an area of navigation information displayed in the navigation application.
  • the mobile phone displays the area of the displayed navigation information in the display interface of the instant chat application, so that the area outside the display interface of the instant chat application is invisible.
  • the second display interface of the second application and the first display area of the first application are displayed on the screen.
  • the electronic device may prompt the user whether to enable the multi-application display on the second display interface of the currently running second application.
  • the second display interface of the second application and the first display area of the first application may prompt the user whether to enable the multi-application display on the second display interface of the currently running second application.
  • the user's selection of multi-application display includes the user clicking on an icon used to display the first application in a floating manner.
  • the electronic device may prompt, in the form of an icon, on the second display interface of the currently running second application for confirming the multi-application display.
  • the first display area is selected from the first display interface.
  • the first display area is determined according to the user's selection result.
  • determining the first display area according to the user's selection result includes:
  • the first display area is determined according to the trajectory formed by the user's gesture operation on the first display interface.
  • the first display area is determined after completing the unclosed area.
  • the first application may be a navigation application
  • the first display interface may be the display interface of the navigation application
  • the first display area may be the area of the navigation information displayed in the navigation application, that is, the A local area in the display interface.
  • the user can click the "Partial Window" button in the control center of the mobile phone to enter the selection interface.
  • the user can perform a selection gesture on the display interface of the navigation application in the selection interface, that is, a gesture operation, and the mobile phone determines the local area according to the trajectory of the selection gesture.
  • the trajectory formed by the user's selection gesture is an arc shape
  • the mobile phone can directly connect the part with the gap to complete it.
  • the size and position of the first display area are adjusted, wherein the user's adjustment operation includes at least one of the following:
  • the user may perform, for example, a gesture to expand the displayed content, a gesture to shrink the displayed content, and a gesture to move on the first display area.
  • the first application may be a navigation application
  • the mobile phone may detect the area of the displayed navigation information contained in the navigation application through the view system, and determine the area as the first display area.
  • the number of changes in the picture in the detection area is detected, and when the number of changes exceeds a preset change threshold, it is determined that the area has changed in display content. area.
  • the method that the mobile phone can detect the area of the displayed navigation information contained in the navigation application through the view system may be to detect the refresh frequency of the displayed content in the navigation application, that is, to determine the display content. Whether the number of screen changes exceeds the refresh rate.
  • the first display area is displayed on the screen by means of a floating window.
  • the first display area is displayed in a floating manner on the second display interface of the second application.
  • the first display area is displayed on the screen by means of a floating window in the following manner:
  • the view system of the mobile phone sets the navigation application on the first layer, sets the instant chat application on the second layer, and the first layer covers the second layer.
  • the area of the navigation information of the navigation application is set to be transparent. This displays both the navigation application's navigation information and the live chat application.
  • the first display content in response to a user's first change operation in the first display area, is changed to the second display content in the first display area.
  • a second change operation performed by the user in an area outside the first display area is received, and an instruction corresponding to the second change operation is transmitted to the second layer.
  • the third display content in response to an instruction corresponding to the second change operation, is changed to the fourth display content in the second display interface.
  • the display content of the navigation application will be expanded and displayed, that is, the display content of the first display will be changed to The second display content.
  • the display content of the display interface of the mobile phone's instant chat application achieves an upward movement effect, that is, from the third display The content is changed to the fourth display content.
  • the first display area is displayed on the screen in a picture-in-picture manner.
  • a second aspect of the present application provides an electronic device, characterized in that it includes:
  • the processor is coupled to the memory, and when the program instructions stored in the memory are executed by the processor, the electronic device executes the display method of the application provided by the aforementioned first aspect.
  • a third aspect of the present application provides a readable medium, in which instructions are stored, characterized in that, when the instructions are executed on the readable medium, the readable medium is caused to execute the application provided by the foregoing first aspect. Display method.
  • FIG. 1( a ) shows an example of a display interface of a navigation application of an electronic device according to an embodiment of the present application
  • Fig. 1(b) shows an example in which a display interface of a navigation application of an electronic device is suspended in a display interface of an instant chat application according to an embodiment of the present application;
  • FIG. 2 shows a block diagram of a hardware structure of an electronic device according to an embodiment of the present application
  • FIG. 3 shows a block diagram of a software structure of an electronic device according to an embodiment of the present application
  • FIG. 4 shows a method flowchart of a method for displaying an application of a mobile phone according to an embodiment of the present application
  • Fig. 5(a) shows an example of a guidance interface supporting the display of a floating window of a navigation application according to an embodiment of the present application
  • Fig. 5(b) shows an example of a prompt operation of a guidance interface of a navigation application according to an embodiment of the present application
  • Fig. 5(c) shows an example of a display result of a guidance interface of a navigation application according to an embodiment of the present application
  • FIG. 6( a ) shows an example of a mobile phone acquiring a selection gesture of a display interface of a navigation application according to an embodiment of the present application
  • Fig. 6(b) shows an example of a preview interface of a partial area of a display interface of a navigation application according to an embodiment of the present application
  • Fig. 6(c) shows an example of an instant chat application in which a local area of a navigation application is suspended and displayed according to an embodiment of the present application
  • FIG. 7( a ) shows an example of display content in a floating window of a navigation application according to an embodiment of the present application
  • FIG. 7(b) shows an example of changes in the displayed content in the floating window of the navigation application according to an embodiment of the present application
  • FIG. 8( a ) shows an example of a user performing an operation gesture in a floating window of a navigation application according to an embodiment of the present application
  • Figure 8(b) shows another example of a user performing an operation gesture in a floating window of a navigation application according to an embodiment of the present application
  • FIG. 8( c ) shows an example of changes in the displayed content in the floating window of the navigation application according to an embodiment of the present application
  • Figure 9(a) shows an example of a user performing an operation gesture in the display interface of the instant chat application according to an embodiment of the present application
  • FIG. 9(b) shows an example of changes in the displayed content in the display interface of the instant chat application according to the embodiment of the present application.
  • Figure 10(a) shows an example of a user performing a downward swipe gesture on a display interface of a video playback application according to an embodiment of the present application
  • Fig. 10(b) shows an example of the user clicking the "partial window” button on the display interface of the control center of the mobile phone to enter a selection interface for partial area selection according to an embodiment of the present application
  • Fig. 10(c) shows an example of adjusting the preview frame on the selection interface selected by the user in the local area according to an embodiment of the present application
  • FIG. 10(d) shows an example of a user determining a partial area of a display interface of a video playback application according to an embodiment of the present application
  • FIG. 10(e) shows an example of an instant chat application in which a local area of a video playback application is suspended and displayed according to an embodiment of the present application
  • Fig. 11(a) shows an example of a dynamically changing area in a display interface of a mobile phone identification navigation application according to an embodiment of the present application
  • FIG. 11( b ) shows an example of an instant chat application in which a local area of a navigation application is suspended and displayed according to an embodiment of the present application
  • Fig. 12(a) shows an example in which a user clicks a button displayed in a floating window on a display interface of a video playback application to start a floating display according to an embodiment of the present application
  • Figure 12 (b) shows an example in which the user clicks a button to exit the floating window display in the floating window of the video playback application according to an embodiment of the present application to close the floating display;
  • Fig. 13(a) shows an example of a mobile phone prompting a user that the display content of a navigation application running in the background has changed according to an embodiment of the present application, and the user confirms that the changed display content is displayed;
  • Fig. 13(b) shows an example of the display content of the navigation application displayed by the mobile phone prompting the user through a floating window according to an embodiment of the present application
  • Fig. 13(c) shows an example of an instant chat application in which a local area of a navigation application is suspended and displayed according to an embodiment of the present application
  • Figure 14(a) shows an example of a user performing a downward swipe gesture on a display interface of an instant chat application according to an embodiment of the present application
  • Figure 14(b) shows an example of a user clicking the "Application Floating Display” button on the display interface of the control center of the mobile phone to enter a list interface of applications running in the background according to an embodiment of the present application;
  • Figure 14(c) shows an example of a list interface of applications running in the background according to an embodiment of the present application
  • Fig. 14(d) shows an example of an application displayed by a user selecting a hover display according to an embodiment of the present application
  • FIG. 14(e) shows an example of a video playback application and an instant chat application in which a partial area of a navigation application is suspended and displayed according to an embodiment of the present application
  • FIG. 15 shows an example in which a navigation application, an instant chat application, a reading application and a desktop are displayed through multiple windows according to an embodiment of the present application
  • FIG. 16 shows an example in which a navigation application is displayed in an equal-scale scaling manner according to an embodiment of the present application
  • Fig. 17(a) shows an example of a display interface of a video playback application according to an embodiment of the present application
  • FIG. 17(b) shows an example of a video playback application in which a local area of a video playback application is suspended and displayed according to an embodiment of the present application
  • FIG. 18 shows a block diagram of the hardware structure of the electronic device in the embodiment of the present application.
  • Embodiments of the present application include, but are not limited to, an electronic device and a display method and medium for its application.
  • FIGS. 1(a)-(b) provide a display scenario of an application of an electronic device according to an embodiment of the present application.
  • the first application It is an instant chat application 102
  • the second application is a navigation application 101 .
  • FIG. 1( a ) shows the display interface of the navigation application 101 .
  • the electronic device 100 will display the navigation application 101 in a suspended manner on other interfaces.
  • the user switches to the instant chat application 102, as shown in FIG. 1(b),
  • the view system of the electronic device 100 suspends the entire display interface of the navigation application 101 in the display interface of the instant chat application 102 as a floating window in the form of a small size window, and the display interface of the navigation application 101 is displayed in the floating window.
  • the electronic device 100 can also be dragged on the screen of the electronic device 100 based on the user's gesture operation to change the position of the floating window.
  • FIG. 2 shows another scene diagram of two applications simultaneously displayed on the screen of the electronic device 100 in the embodiment of the present application. As shown in FIG.
  • the view system of the electronic device 100 suspends a part of the display area 1011 of the navigation application 101 on the display of the instant chat application 102 as a floating window in the form of a small-sized window.
  • the part of the display area 1011 of the navigation application 101 displayed in the floating window is the part of the navigation application 101 where the display content changes with time.
  • the electronic device 100 may also receive a gesture operation performed by the user on the display interface of the navigation application 101 in the floating window, so as to change the display content of the display interface of the navigation application 101 in the floating window.
  • the user can also click the “close” button 1018 or the “full screen display” button 1019 in the partial display area 1011 , so that the navigation application 101 is closed or displayed in full screen on the screen of the electronic device 100 .
  • the electronic device 100 can display the display content of the display interface of the first application that the user needs to pay attention to in real time in the display interface of the second application or the desktop by means of a floating window, so that the two applications can be switched without switching between the two applications.
  • the second application it is convenient for the user to pay attention to the changes of the first application while using the second application.
  • the area that the user pays attention to can be displayed to the user more clearly, and the display content in the floating window can be avoided due to the display interface of the entire first application being displayed in a reduced size of the floating window. Problems that become unclear due to zooming out.
  • the first application and the second application here may be third-party applications installed on the electronic device 100 , or may be system applications of the electronic device 100 , for example, the first application and the second application may be the electronic device 100 Apps such as desktop and settings.
  • the electronic device 100 may be various electronic devices, for example, the electronic device 100 includes, but is not limited to, a laptop computer, a desktop computer, a tablet computer, a mobile phone, a server, a wearable device, a headphone Wearable displays, mobile email devices, portable game consoles, portable music players, reader devices, or other electronic devices capable of accessing a network.
  • the embodiments of the present application may also be applied to wearable devices worn by users. For example, smart watches, bracelets, jewelry (eg, devices made into decorative items such as earrings, bracelets, etc.) or glasses, or the like, or as part of a watch, bracelet, jewelry, or glasses, or the like.
  • various applications may be installed on the electronic device 100 , such as video conference applications, instant chat applications, video playback applications, and navigation applications.
  • FIG. 3 is a block diagram of a software structure of an electronic device 100 according to an embodiment of the present invention.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.
  • the application layer can include a series of application packages.
  • the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and so on.
  • the application package may include a startup navigation application 101 , an instant chat application 102 , a reading application 103 , a desktop 104 and a video playing application 105 .
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, an application service management module, a gesture recognition module, and the like.
  • the gesture recognition module is used to recognize the gesture operation performed by the user on the screen of the electronic device 100 .
  • a window manager is used to manage window programs.
  • the window manager can get the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications.
  • the display interface can be composed of one or more views, where the views are used to display the visual controls in the area where the view is located and handle events that occur in the area where the diagram is located. For example, a view can handle events corresponding to gestures generated in the area where the view is located.
  • a display interface of a navigation application it may include a view of navigation content and a view of navigation information
  • an instant chat application it may include a view of chat content and a view of menu.
  • the view system can calculate the local area corresponding to the trajectory from the view of the display interface of the application according to the recognized trajectory of the user's gesture operation, and use the local area as the display area, and use the local area as the display area. It is displayed by means of a floating window.
  • the view system may also automatically determine the display area in the application's display interface.
  • the view system can also place two applications in separate layers, with one layer above the other. This layer is used to host a window corresponding to an application.
  • the phone manager is used to provide the communication function of the electronic device 100 .
  • the management of call status including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • the application business management module can manage the connection between the application and the server.
  • Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
  • the core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library Media Libraries
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.
  • the technical solution of the display method of the application of the mobile phone 100 includes:
  • the mobile phone 100 starts the navigation application 101, and prompts the user that the navigation application 101 supports displaying the display interface of the navigation application 101 by means of a floating window.
  • the mobile phone 100 After the user turns on the mobile phone 100, the user can click the "navigation" icon in the user interface (UI) of the mobile phone 100. After the mobile phone 100 receives the user's click operation instruction, the mobile phone 100 starts the navigation application 101.
  • the display interface of the navigation application 101 displays a guide interface 1013 that the application supports to be displayed by means of a floating window.
  • the guide interface 1013 can be Display the prompt message "Select an area in the display interface to display it in the floating window” and the "Continue" and "Cancel” buttons.
  • the guidance interface 1013 of the navigation application 101 exits.
  • the guidance interface 1013 may prompt the user through animation to display the operation method of displaying the display interface of the navigation application 101 through a floating window.
  • the guidance interface 1013 prompts the user to perform a gesture operation on the display interface of the navigation application 101 to select a display area, and click the "small window display” button 1016, as shown in Fig. 5(c) display, so that the display area 1011 is displayed by means of a floating window. It can be understood that the display area 1011 in FIG.
  • 5( c ) also includes two buttons “close” and “full screen display”. After the user clicks the “close” button 1018 in the display area 1011, the display area 1011 is closed. After the user clicks the “full screen display” button 1019 in the display area 1011 , the navigation application 101 is displayed in the full screen on the screen of the mobile phone 100 . Here, after the user clicks the "got” button 1020 in the guidance interface 1013 of FIG. 5( c ), the guidance interface 1013 of the navigation application 101 is closed.
  • the mobile phone 100 may also start the instant chat application 102 in advance. After the mobile phone 100 determines the display area 1011 displayed in the form of a floating window in the navigation application 101 , the display area 1011 can be displayed on the display interface of the instant chat application 102 .
  • the mobile phone 100 determines the display area 1011 in the display interface of the navigation application 101 .
  • the display area 1011 in the display interface of the navigation application 101 may be a partial area in the display interface of the navigation application 101 , and the partial area may be determined by the mobile phone 100 according to the selection gesture performed by the user on the display interface of the navigation application 101 .
  • the gesture recognition module of the mobile phone 100 can recognize a selection gesture performed by the user on the display interface of the navigation application 101 , and the gesture recognition module obtains the trajectory of the selection gesture, The area selected by the selection gesture is sent to the view system of the mobile phone 100 . As shown in FIG. 6( c ), the view system of the mobile phone 100 determines the area as the display area 1011 in the display interface of the navigation application 101 .
  • the view system of the mobile phone 100 can also determine the size and position of the display area 1011 in the display interface of the navigation application 101 .
  • the size of the display interface of the navigation application 101 may be 90mm ⁇ 120mm (length ⁇ width)
  • the view system of the mobile phone 100 determines that the size of the display area 1011 corresponding to the trajectory of the user’s selection gesture may be 20mm ⁇ 19mm (length ⁇ width).
  • the position of the display area 1011 may be 10 mm from the upper border of the display interface of the navigation application 101 and 10 mm from the left border. The process of determining the display area 1011 in the display interface of the navigation application 101 by the mobile phone 100 will be described in detail below.
  • the mobile phone 100 may also automatically determine the display area 1011 in the display interface of the navigation application 101, and the implementation process of the method will also be described in detail below.
  • the mobile phone 100 displays the display area 1011 of the navigation application 101 in the form of a floating window.
  • the view system of the mobile phone 100 enters the preview interface 120, and the preview interface 120 is set with “small window display” ” button 1202 is used to set the display area 1011 to be displayed by means of a floating window.
  • the view system of the mobile phone 100 displays the display area 1011 of the navigation application 101 on the display interface of the instant chat application 102 of the mobile phone 100 by means of a floating window. Display location.
  • the size of the display area 1011 determined by the user for example, the size of the display area 1011 can be determined as 20mm ⁇ 19mm (length ⁇ width), and the default display position can be an instant distance from the mobile phone 100
  • the upper boundary of the display interface of the chat application 102 is 10 mm, and the right boundary is 10 mm. That is, the display area 1011 of the navigation application 101 is displayed on the upper right of the display interface of the instant chat application 102 .
  • the view system of the mobile phone 100 sets the navigation application 101 on the first layer, and sets the instant chat application 102 of the mobile phone 100 on the second picture layer, the first layer overlays the second layer. That is, the mobile phone 100 runs the navigation application 101 in the first layer, and the mobile phone 100 runs the display interface of the instant chat application 102 in the second layer.
  • the mobile phone 100 sets the display area 1011 of the navigation application 101 to be visible. For example, the area that is 20 mm away from the upper border of the display interface of the navigation application 101 and 19 mm from the left border and the size is 20 mm ⁇ 19 mm (length ⁇ width) is set as visible, and Make the area outside this display area transparent.
  • the mobile phone 100 moves the position of the navigation application 101 in the first layer so that the display area 1011 is located to the display position of the display interface of the instant chat application 102 of the mobile phone 100 in the second layer.
  • the user can browse the display content of the display interface of the instant chat application 102 of the mobile phone 100 in the second layer through the area other than the display area 1011 of the navigation application 101, and at the same time, the display area 1011 of the navigation application 101 can pass through
  • the floating window is displayed on the display interface of the instant chat application 102 of the mobile phone 100 , and the user can also browse the display content of the display area of the navigation application 101 in real time.
  • the display position of the display interface of the instant chat application 102 of the mobile phone 100 may be a parameter preset in the storage area of the mobile phone 100 .
  • the display content of the navigation application 101 in the display area 1011 will change in real time. That is, after the mobile phone 100 sets the navigation application 101 on the first layer, the navigation application 101 is still in the running state. Therefore, the display content in the display interface of the navigation application 101 also changes in real time.
  • the display content of the display area 1011 belongs to the display content of the display interface of the navigation application 101
  • the display content of the navigation application 101 in the display area 1011 on the display interface of the instant chat application 102 of the mobile phone 100 will also change in real time. . For example, as shown in FIGS.
  • the navigation information in the display interface of the navigation application 101 changes. For example, after the vehicle has been running for a period of time, the route of the navigation information changes. The changes will be updated in the display area 1011 on the display interface of the instant chat application 102 of the mobile phone 100 in real time.
  • S404 The mobile phone 100 determines whether a gesture operation performed by the user in the display area 1011 of the navigation application 101 is detected.
  • the mobile phone 100 After the mobile phone 100 receives the gesture operation performed by the user in the display area of the navigation application 101, S405 is performed, and the mobile phone 100 changes the display content in the display area in response to the gesture operation.
  • the mobile phone 100 changes the display content in the display area 1011 .
  • the navigation application 101 of the mobile phone 100 runs in the first layer, and the first layer is overlaid on the second layer. Therefore, the first layer is the current view in the screen of the mobile phone 100 , that is to say, the gesture operations performed by the user on the screen of the mobile phone 100 all act on the first layer. If the user's gesture operation acts on the display area 1011 of the navigation application 101 of the mobile phone 100, it is equivalent to acting on the display interface of the navigation application 101. After the gesture recognition module of the mobile phone 100 recognizes the gesture operation, the navigation The application 101 can respond to the instruction corresponding to the gesture operation, so that the display content of the navigation application 101 in the display area 1011 of the navigation application 101 of the mobile phone 100 is changed.
  • the user performs a gesture to expand the displayed content on the display content of the navigation application 101 , and the gesture recognition module of the mobile phone 100 recognizes the After the gesture operation, the navigation application 101 is made to respond to the gesture, the display content of the navigation application 101 in the display area 1011 of the navigation application 101 of the mobile phone 100 will be enlarged and displayed, and the gesture will not affect the display interface of the instant chat application 102 .
  • the user performs a pull-down gesture on the display content of the navigation application 101 in the display area 1011 of the navigation application 101 of the mobile phone 100, and the gesture recognition of the mobile phone 100
  • the navigation application 101 responds to the gesture, and the display content of the navigation application 101 in the display area 1011 of the navigation application 101 moves downward.
  • the gesture will not have any effect on the display interface of the instant chat application 102 .
  • the mobile phone 100 determines whether a gesture operation performed by the user in an area other than the display area 1011 of the navigation application 101 is detected.
  • S407 is executed, and the mobile phone 100 changes the display content of the instant chat application 102 in response to the gesture operation.
  • the mobile phone 100 changes the display content of the instant chat application 102 .
  • the mobile phone 100 determines that the user performs a gesture operation in an area other than the display area 1011 of the navigation application 101 of the mobile phone 100, the mobile phone 100 is acquiring the instruction corresponding to the gesture operation and making it not in the first layer is executed, the mobile phone 100 transmits the instruction corresponding to the gesture operation to the display interface of the instant chat application 102 of the mobile phone 100 on the second layer, and the display interface of the instant chat application 102 of the mobile phone 100 can respond to the instruction corresponding to the gesture operation, so that The display content of the display interface of the instant chat application 102 of the mobile phone 100 changes.
  • the user executes a For the bottom-up swipe gesture, after acquiring the instruction corresponding to the gesture operation, the mobile phone 100 determines that it is executed in an area other than the display area 1011 of the navigation application 101 of the mobile phone 100, and the mobile phone 100 transfers the instruction corresponding to the bottom-up swipe gesture to the display interface of the instant chat application 102 of the mobile phone 100 on the second layer.
  • the display interface of the instant chat application 102 of the mobile phone 100 responds to the instruction corresponding to the sliding gesture from the bottom to the top, and the instant chat application 102 of the mobile phone 100
  • the display content of the display interface realizes an upward movement effect.
  • a process of determining the display area 1011 in the display interface of the navigation application 101 by the mobile phone 100 described in S402 will be specifically described below.
  • S402a The mobile phone 100 receives a selection gesture performed by the user on the display interface of the navigation application 101.
  • the user can manually select a partial area of the display interface of the navigation application 101 through a selection gesture, and the gesture recognition module of the mobile phone 100 can recognize the selection gesture. trajectory.
  • the display interface of the navigation application 101 here may be a display interface that displays changes in navigation information, such as a navigation route.
  • the user can select a local area on the display interface of the navigation application 101 on the screen of the mobile phone 100 through a selection gesture of sliding with a knuckle. In this way, conflicts with default gestures supported by the navigation application 101 can be avoided.
  • the gesture recognition module may be any existing module for realizing gesture recognition or finger joint recognition, which is not limited herein.
  • S402b The mobile phone 100 selects a local area in the display interface of the navigation application 101 according to the trajectory of the selection gesture.
  • the gesture recognition module of the mobile phone 100 After recognizing the trajectory of the user's selection gesture, the gesture recognition module of the mobile phone 100 sends it to the view system of the mobile phone 100 . According to the local area corresponding to the track, the view system of the mobile phone 100 uses the local area as a display area.
  • the partial region of the display interface of the navigation application 101 selected by the user through the selection gesture may be the display content included in the track formed by the selection gesture performed by the user in the display interface of the navigation application 101 .
  • the view system of the mobile phone 100 sets a method for monitoring gesture events on the view where the display interface of the navigation application 101 is located, for example, the onTouchEvent method, which recognizes the trajectory of the user's selection gesture by starting the gesture recognition module of the mobile phone 100. That is, when the user presses or contacts the screen of the mobile phone 100 with a conductor, the method can detect the position of pressing or contacting the screen of the mobile phone 100 , and the position of pressing or contacting the screen of the mobile phone 100 may be referred to as a contact point for short. When the gesture recognition module detects the touch point, it can be determined that the user's selection gesture is detected.
  • the selection gesture is a gesture that can be slid within the screen of the mobile phone 100 .
  • the method for monitoring gesture events can obtain the x-coordinate value and The y coordinate value. After the user completes the selection gesture, the method for monitoring gesture events can calculate the trajectory formed by the selection gesture according to the x coordinate value and the y coordinate value, and determine the local area corresponding to the trajectory.
  • the trajectory formed by the user's selection gesture may be a closed area or a non-closed area.
  • the selected partial area of the display interface of the navigation application 101 is the display content in the closed area.
  • the selected local area of the display interface of the navigation application 101 may be the area between the trajectory formed by the user's selection gesture and the left and right or upper and lower boundaries of the screen of the mobile phone 100 . Display content within the formed area.
  • the selected local area of the display interface of the navigation application 101 is within the area formed by the straight line, curve or arc and the left and right boundaries or upper and lower boundaries of the screen. Display content.
  • the selected partial area of the display interface of the navigation application 101 may also be the display content in the closed area obtained by completing the non-closed area.
  • the display content of the selected current display page is the display content in the closed area obtained after the V-shaped or arc-shaped complement is completed. Completion may be to directly connect the parts with gaps, or to complete the non-closed area according to the principle of symmetry, or to complete the shape of the non-closed area into a regular figure, etc.
  • S402c The mobile phone 100 adjusts a partial area of the display interface of the navigation application 101 to form a display area of the navigation application 101 .
  • the mobile phone 100 can enter the preview interface 120 of the partial area of the display interface of the navigation application 101, and the preview interface 120 , the view system of the mobile phone 100 may expand the local area to form a rectangle, or other shapes such as a circle or a diamond-shaped frame, as the preview area 1201 . For example, as shown in FIG.
  • the view system of the mobile phone 100 can form a preview area 1201 by circumscribing the circular closed area, for example , the preview area 1201 can be an area with a size of 20mm ⁇ 19mm (length ⁇ width).
  • the user can also adjust the size of the preview area 1201 again through gestures. For example, the user can adjust the size of the display area by dragging the four sides of the rectangle formed by the preview area 1201, and the user can also adjust the display interface of the preview area 1201 in the navigation application 101 by pressing and dragging the rectangle formed by the preview area 1201. in the location.
  • the view system of the mobile phone 100 may also store the size of the preview area 1201 and the default position of the preview area 1201 in its own storage area.
  • the size of the preview area 1201 may be 20mm ⁇ 19mm (length ⁇ width)
  • the default position of the preview area 1201 may be the distance from the center of the preview area 1201 to the four sides of the display interface of the navigation application 101 .
  • the mobile phone 100 obtains a method for the user to perform a selection gesture on the display interface of the navigation application 101 to determine the display area 1011 of the navigation application 101, and several other implementation steps S402 will be described below.
  • the mobile phone 100 determines the display area 1011 of the navigation application 101 .
  • the mobile phone 100 can automatically select the display area 1011 in the display interface of the navigation application 101 through the selection function of the display area of its own control center. After receiving an instruction from the user to enable the selection function set in the control center of the mobile phone 100, the mobile phone 100 enters the local area selection mode of the application. In this selection mode, the view system of the mobile phone 100 can implement the selection of a display area in the display interface of the navigation application 101 as described in S402 above.
  • the user opens the video playback application 105 and the instant chat application 102 on the mobile phone 100 and switches to the video playback application 105 .
  • the mobile phone 100 enters the display interface of the control center 201 .
  • a button 2011 named "partial window” is provided in the display interface of the control center 201.
  • the mobile phone 100 enters the selection interface 202 for selecting a local area on the display interface of the video playback application 105 .
  • a rectangular preview frame 2021 for selecting a partial area and a "small window display” button 2022 will be displayed.
  • the user can drag the four sides of the preview frame 2021 to match Select the size of the local area of the display interface of the video playback application 105 to adjust, the user can also press and drag the preview frame 2021 to adjust the position of the preview frame in the display interface of the video playback application 105 to select the video playback application 105.
  • the partial area of the display interface is used as the display area.
  • Fig. 10(d) after the user has determined the display area in the display interface of the video playback application 105, he can click the "small window display” button 2022 to enter S403, as shown in Fig. 10(e), the display of the mobile phone 100
  • the view system displays the video display area 1051 of the display interface of the video playback application 105 on the display interface of the instant chat application 102 of the mobile phone 100 through a floating window.
  • the mobile phone 100 can implement the display area 1011 in the display interface of the navigation application 101 determined by the mobile phone 100 as described in the above S402 through the floating window display mode of the display area.
  • the mobile phone 100 can activate the floating window display mode. Different from the method described above, in this floating window display mode, the view system of the mobile phone 100 can detect and determine the area in the display interface of the navigation application 101 where the displayed content will change dynamically, And the display area 1012 of the navigation application 101 is determined from the area in which the display content will change dynamically.
  • the area in which the display content will change dynamically described here refers to that the display content in an area of the display interface of an application will change within a period of time.
  • the dynamically changing area contained therein may be the area where the map is located, and the type may be the map view MapView.
  • the display content in the area where the map view is located will change in real time.
  • the view system of the mobile phone 100 can detect each area in the display interface of the navigation application 101.
  • a change threshold for example, A change of 10 frames per second is generated, that is, the refresh rate of the display content is 10FPS.
  • the FPS here refers to the number of frames transmitted per second (FPS, Frames Per Second, frames per second), which refers to the refreshed content in the display per second.
  • the number of pictures, 10FPS means that the number of pictures refreshed in the display content is 10 in one second.
  • the view system of the mobile phone 100 confirms that the area belongs to the area where the display content will change dynamically. In FIG.
  • the mobile phone 100 can radiate from the center of the dynamically changing area to the surrounding area of the dynamically changing area to form a In the rectangular display area 1011, the view system of the mobile phone 100 enters S403, and displays the display area 1011 on the display interface of the instant chat application 102 through a floating window.
  • the view system of the mobile phone 100 may determine which views belong to the dynamically changing region according to the list of view types pre-stored in its own storage region.
  • the dynamically changing area contained in it may be a video playback view, and its type may be VideoView.
  • the mobile phone 100 may also set a button for entering/exiting the floating window display mode for an already opened application. For example, as shown in FIGS. 12( a ) to 12 ( b ), the user can click the “floating window display” button 1052 on the display interface of the video playing application 105 to make the mobile phone 100 determine the display interface of the video playing application 105 The video display area 1051 is displayed in a floating window. After the mobile phone 100 displays the video playing area of the video playing application 105 in the floating window, the user can also click the "exit floating window display” button 1053 in the floating window, so that the mobile phone 100 cancels the display area 1051 of the video of the video playing application 105 Display the floating window.
  • the floating window display mode of the mobile phone 100 can also be used for an application popped up on the mobile phone 100 to realize the determination of the display area 1011 in the display interface of the navigation application 101 by the mobile phone 100 described in S402 above. .
  • the mobile phone 100 After the mobile phone 100 starts the floating window display mode, in the floating window display mode, when the mobile phone 100 detects that the display content of the application running in the background has changed, it prompts the user whether The application is displayed in the form of a floating window, so that the user can always pay attention to the displayed content of the application. For example, as shown in Fig. 13(a), the display interface of the instant chat application 102 is displayed on the screen of the mobile phone 100. At this time, the upper part of the screen of the mobile phone 100 prompts the user that the display content of the display interface of the navigation application 101 running in the background has changed. To click to view.
  • the mobile phone 100 will no longer prompt the user to change the display content of the display interface of the navigation application 101 .
  • the mobile phone 100 prompts the user again whether to display the display interface of the navigation application 101 in the display interface of the instant chat application 102 by means of a floating window. If the user chooses to click "No", the mobile phone 100 will not display the display interface of the navigation application 101 in the form of a floating window. If the user chooses to click “Yes”, as shown in FIG. 13( c ), the view system of the mobile phone 100 can display the display interface of the navigation application 101 in the display interface of the instant chat application 102 by means of a floating window.
  • the mobile phone 100 may also display multiple applications by means of a floating window.
  • the mobile phone 100 can enable the application floating display function. After this function is enabled, the view system of the mobile phone 100 can display the applications already running in the background in a list display mode on the screen of the mobile phone 100. The user can select one of the above applications. Or multiple applications, so that the above applications are displayed in the display interface of the current application by means of a floating window.
  • the following takes the mobile phone 100 running the navigation application 101 , the instant chat application 102 , the reading application 103 and the video playback application 105 as an example for description, wherein the current application displayed on the screen of the mobile phone 100 is the instant chat application 102 .
  • the mobile phone 100 enters the display interface 401 .
  • a button 4011 named “Application Floating Display” is provided in the display interface of the control center 401 . After the user presses the button 4011 of the "application floating display”, the mobile phone 100 enters the list interface 501 of the applications currently running in the background.
  • the identifiers of all the applications currently running in the background will be displayed, for example, the navigation application 101, the reading application 103 and the video playing application 105 will be displayed, and the user will be prompted to select the The application displayed in the form of a window.
  • the user can determine whether to display the application in the display interface of the current application by means of a floating window by clicking on the identifier of each application.
  • the user can click the "OK" button, as shown in Fig.
  • the view system of the mobile phone 100 displays the display interface of the video playback application 105 and the display interface of the navigation application 101 on the display interface of the instant chat application 102 of the mobile phone 100 through a floating window.
  • the user can also click the "Cancel" button to exit the application floating display function.
  • the above-mentioned step 403 describes a method for displaying the display area 1011 of the navigation application 101 on the display interface of the instant chat application 102 by means of a floating window. Another implementation method of the above-mentioned step 403 is described below.
  • the view system of the mobile phone 100 may set the navigation application 101 on the second layer, the instant chat application 102 of the mobile phone 100 on the first layer, and the first layer.
  • the layer overlays the second layer. That is, the mobile phone 100 runs the navigation application 101 in the second layer, and the mobile phone 100 runs the display interface of the instant chat application 102 in the first layer.
  • the mobile phone 100 digs out a local area in the display interface of the instant chat application 102.
  • the mobile phone 100 moves the position of the navigation application 101 in the second layer so that the display area 1011 is aligned with the local area of the instant chat application 102 of the mobile phone 100 in the first layer.
  • the user can browse the display content of the display area 1011 of the display interface of the navigation application 101 of the mobile phone 100 in the second layer through the partial area of the instant chat application 102, and at the same time, the display area of the navigation application 101 can be displayed in the display area of the navigation application 101 through a similar suspension.
  • the window is displayed on the display interface of the instant chat application 102 of the mobile phone 100 , and the user can also browse the displayed content of the display area of the navigation application 101 in real time.
  • the size of the above-mentioned display area may be the same as the size of the display area in step S402, or may be pre-stored in the storage area of the mobile phone 100, for example, 20mm ⁇ 10mm (length ⁇ width).
  • the size of the above-mentioned display area may also be the size of the view in which the dynamically changing area in the display interface of the navigation application 101 is located, and the mobile phone 100 may obtain the type of the view corresponding to the dynamically changing area. At the same time, get the size of the view and set it to the size of the display area.
  • the mobile phone 100 displays the display interface of the navigation application 101 by means of a floating window in the display interface of the instant chat application 102 .
  • the mobile phone 100 starts the navigation application 101 , the instant chat application 102 , the reading application 103 and the desktop 104 .
  • the window manager of the mobile phone 100 divides the screen of the mobile phone 100 into multiple windows to divide the navigation application 101.
  • the instant chat application 102, the reading application 103 and the desktop 104 are displayed in split screens, and a main window is combined with multiple auxiliary windows to display the navigation application 101, the instant chat application 102, the reading application 103 and the desktop 104, respectively. Users can follow Applications in every window.
  • FIG. 16 shows a scene diagram of two applications simultaneously displayed on the screen of the mobile phone 100 in other embodiments of the present application.
  • An instant chat application 102 and a navigation application 101 run on the screen of the mobile phone 100.
  • the view system of the mobile phone 100 can set the window of the navigation application 101 as a resizable (adjustable) type of application.
  • the display style of the display content of the navigation application 101 may remain the same as the display style of the current display interface of the electronic device 100 .
  • the font size and font style of the navigation application 101 in the floating window are the same as the font size and font style of the instant chat application 102 .
  • FIGS. 17( a ) to ( b ) illustrate scenarios in which the display content of the application is displayed in the screen of the mobile phone 100 by means of a floating window in other embodiments of the present application.
  • FIG. 17( a ) shows the display interface of the video playback application 105 .
  • the view system of the mobile phone 100 displays the display area 1051 of the video being played in the video playback application 105 in the display interface of the video playback application 105 by means of a floating window.
  • the window performs gesture operations to control the video being played in the floating window. For example, the user can click on the floating window to pause the playing video.
  • FIG. 18 shows a schematic structural diagram of an electronic device 100 according to an embodiment of the present application.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195 and so on.
  • SIM Subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 .
  • the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (APPlication processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • APPlication processor, AP application processor
  • modem processor graphics processor
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural-network processing unit neural-network processing unit
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
  • the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.
  • the wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
  • the modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • Wi-Fi wireless fidelity
  • BT wireless fidelity
  • GNSS global navigation satellites System
  • frequency modulation frequency modulation
  • FM near field communication technology
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • Display screen 194 is used to display images, videos, and the like.
  • Display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • the electronic device 100 may include one or N display screens 194 , where N is a positive integer greater than one.
  • the electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the camera 193 may be the camera 102 in the embodiments of the present application, and is used to collect scene images of the current environment.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 .
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like.
  • the internal memory 121 stores a list of view types, and the list of view types is used to determine the views belonging to the dynamically changing area.
  • the electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • the audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
  • Speaker 170A also referred to as a "speaker" is used to convert audio electrical signals into sound signals.
  • the electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
  • the receiver 170B also referred to as "earpiece" is used to convert audio electrical signals into sound signals.
  • the voice can be answered by placing the receiver 170B close to the human ear.
  • the microphone 170C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the earphone jack 170D is used to connect wired earphones.
  • the earphone interface 170D may be the USB interface 130, or may be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.
  • Touch sensor 180K also called “touch device”.
  • the touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect gesture operations acting on or near it.
  • the touch sensor can pass the detected gesture operation to the application processor to determine the type of touch event.
  • Visual output related to the gesture operation may be provided via display screen 194 .
  • the touch sensor 180K is used to receive gesture operations performed by the user on the touch screen. For example, the touch sensor 180K can determine that the user has performed a gesture operation of selecting a local area on the display interface of the application and a gesture operation of changing the display content of the display interface of the application by the user.
  • the keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. Touch buttons are also possible.
  • the electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .
  • Motor 191 can generate vibrating cues.
  • the motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback.
  • gesture operations acting on different applications can correspond to different vibration feedback effects.
  • gesture operations acting on different areas of the display screen 194 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, which can be used to indicate a charging state, a change in power, and can also be used to indicate a message, a missed call, a notification, and the like.
  • the SIM card interface 195 is used for connecting a SIM card.
  • the SIM card can be contacted and separated from the electronic device 100 by inserting into the SIM card interface 195 or pulling out from the SIM card interface 195 .
  • references in the specification to "one embodiment,” “an embodiment,” “an illustrative embodiment,” etc. mean that the described embodiment may include a particular feature, structure, or property, but each embodiment may or may not include a particular characteristics, structure or properties. Moreover, these phrases are not necessarily referring to the same embodiment. Furthermore, when certain features are described in conjunction with specific embodiments, the knowledge of those skilled in the art can influence the combination of those features with other embodiments, whether or not those embodiments are explicitly described.
  • module may refer to, being a part of, or including: memory (shared, dedicated, or bank) for running one or more software or firmware programs, an application specific integrated circuit (ASIC), Electronic circuits and/or processors (shared, dedicated, or group), combinational logic circuits, and/or other suitable components that provide the described functionality.
  • memory shared, dedicated, or bank
  • ASIC application specific integrated circuit
  • processors shared, dedicated, or group
  • combinational logic circuits and/or other suitable components that provide the described functionality.

Abstract

The present application relates to an electronic device and a display method for an application thereof, and a medium. The display method for an application comprises: displaying a first display interface of a first application on a screen of an electronic device; and displaying, on the screen, a second display interface of a second application and a first display area of the first application, wherein part of an area of the second display interface is shielded by the first display area, and the first display area is part of the first display interface. By means of the method in the present application, an electronic device displays display content in a display interface of a first application in a display interface of a second application or a desktop by means of a floating window, such that a user pays attention to a change in the first application while using the second application, without switching the two applications.

Description

电子设备及其应用的显示方法和介质Display method and medium for electronic device and its application
本申请要求于2021年02月05日提交中国专利局、申请号为202110162248.8、申请名称为“电子设备及其应用的显示方法和介质”中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on February 5, 2021 with the application number of 202110162248.8 and the application title of "display method and medium for electronic equipment and its application", the entire contents of which are incorporated herein by reference Applying.
技术领域technical field
本申请涉及电子设备领域的图形界面显示技术。尤其涉及一种电子设备及其应用的显示方法和介质。The present application relates to a graphic interface display technology in the field of electronic equipment. In particular, it relates to an electronic device and a display method and medium for its application.
背景技术Background technique
在用户使用电子设备的应用的过程中，有时候在使用一个应用的同时，需要关注其他一个或者多个应用的内容变化。比如，用户在启动导航应用后，在时刻关注导航应用中的导航路线的内容变化的同时，用户想使用即时聊天应用进行聊天。在这种情况下，用户需要在导航应用和即时聊天应用之间来回切换，比较繁琐。In the process of using an application of an electronic device, sometimes while using one application, the user needs to pay attention to the content changes of one or more other applications. For example, after starting the navigation application, the user wants to use the instant chat application to chat while always paying attention to the content change of the navigation route in the navigation application. In this case, the user needs to switch back and forth between the navigation application and the instant chat application, which is cumbersome.
发明内容SUMMARY OF THE INVENTION
本申请的目的在于提供一种电子设备及其应用的显示方法和介质，通过本申请的方法，电子设备会将第一应用的显示界面的显示内容通过悬浮窗口的方式显示在第二应用或者桌面的显示界面内，从而在不通过切换两个应用的前提下，使得用户在使用第二应用的同时关注第一应用的变化。The purpose of this application is to provide a display method and medium for an electronic device and its application. With the method of this application, the electronic device will display the display content of the display interface of the first application on the second application or the desktop through a floating window. in the display interface, so that the user can pay attention to the changes of the first application while using the second application without switching between the two applications.
本申请的第一方面提供了一种应用显示方法，包括：在电子设备的屏幕上显示第一应用的第一显示界面；在屏幕上显示第二应用的第二显示界面和第一应用的第一显示区域，其中，第二显示界面的部分区域被第一显示区域遮挡，并且第一显示区域为第一显示界面的一部分。A first aspect of the present application provides an application display method, including: displaying a first display interface of a first application on a screen of an electronic device; displaying a second display interface of a second application and a first display interface of the first application on the screen a display area, wherein a part of the second display interface is blocked by the first display area, and the first display area is a part of the first display interface.
即在本申请的实施例中，电子设备打开第一应用和第二应用，从第一应用的第一显示界面中选取第一显示区域，将第一显示区域显示在第二应用的第二显示界面内，第一显示区域小于第二显示界面。That is, in the embodiment of the present application, the electronic device opens the first application and the second application, selects the first display area from the first display interface of the first application, and displays the first display area on the second display of the second application In the interface, the first display area is smaller than the second display interface.
例如，电子设备可以是手机，第一应用可以是导航应用，第二应用可以是即时聊天应用。第一显示界面可以是导航应用的显示界面，第二显示界面可以是即时聊天应用的显示界面，第一显示区域可以是导航应用中显示的导航信息的区域。手机将显示的导航信息的区域显示在即时聊天应用的显示界面中，使得即时聊天应用的显示界面之外的区域不可见。For example, the electronic device may be a mobile phone, the first application may be a navigation application, and the second application may be an instant chat application. The first display interface may be a display interface of a navigation application, the second display interface may be a display interface of an instant chat application, and the first display area may be an area of navigation information displayed in the navigation application. The mobile phone displays the area of the displayed navigation information in the display interface of the instant chat application, so that the area outside the display interface of the instant chat application is invisible.
在上述第一方面的一种可能的实现中，在检测到用户选择进行多应用显示的情况下，在屏幕上显示第二应用的第二显示界面和第一应用的第一显示区域。In a possible implementation of the above-mentioned first aspect, when it is detected that the user selects to display multiple applications, the second display interface of the second application and the first display area of the first application are displayed on the screen.
即在本申请的实施例中，电子设备可以在当前运行的第二应用的第二显示界面提示用户 是否开启多应用显示，在用户确认开启的情况下，在电子设备的屏幕中同时显示，第二应用的第二显示界面和第一应用的第一显示区域。That is, in the embodiment of the present application, the electronic device may prompt the user whether to enable the multi-application display on the second display interface of the currently running second application. The second display interface of the second application and the first display area of the first application.
在上述第一方面的一种可能的实现中，用户选择多应用显示包括用户点击用于悬浮显示第一应用的图标。In a possible implementation of the above-mentioned first aspect, the user's selection of multi-application display includes the user clicking on an icon used to display the first application in a floating manner.
即在本申请的实施例中，电子设备可以在当前运行的第二应用的第二显示界面通过图标的方式提示用于确认进行多应用显示。That is, in the embodiment of the present application, the electronic device may prompt, in the form of an icon, on the second display interface of the currently running second application for confirming the multi-application display.
在上述第一方面的一种可能的实现中，还包括：In a possible implementation of the first aspect above, it also includes:
从第一显示界面中选择出第一显示区域。The first display area is selected from the first display interface.
在上述第一方面的一种可能的实现中，还包括：In a possible implementation of the first aspect above, it also includes:
提示用户从第一显示界面中选择出要进行多应用显示的第一显示区域；Prompting the user to select the first display area to be multi-application display from the first display interface;
根据用户的选择结果确定第一显示区域。The first display area is determined according to the user's selection result.
在上述第一方面的一种可能的实现中，根据用户的选择结果确定第一显示区域，包括：In a possible implementation of the above-mentioned first aspect, determining the first display area according to the user's selection result includes:
根据用户在第一显示界面上的手势操作形成的轨迹确定第一显示区域。The first display area is determined according to the trajectory formed by the user's gesture operation on the first display interface.
在上述第一方面的一种可能的实现中，在手势操作形成的轨迹是非闭合区域的情况下，将非闭合区域补全后确定第一显示区域。In a possible implementation of the above-mentioned first aspect, when the trajectory formed by the gesture operation is an unclosed area, the first display area is determined after completing the unclosed area.
即在本申请的实施例中，例如，第一应用可以是导航应用，第一显示界面可以是导航应用的显示界面，第一显示区域可以是导航应用中显示的导航信息的区域，也就是第一显示界面中的局部区域。用户可以点击手机的控制中心的“局部窗口”按钮，进入选取界面。用户可以在选取界面内对导航应用的显示界面执行一个选取手势，也就是手势操作，手机根据选取手势的轨迹确定局部区域。当用户的选取手势所形成的轨迹为圆弧形时，手机可以将有缺口的部分直接连接进行补全。That is, in the embodiment of the present application, for example, the first application may be a navigation application, the first display interface may be the display interface of the navigation application, and the first display area may be the area of the navigation information displayed in the navigation application, that is, the A local area in the display interface. The user can click the "Partial Window" button in the control center of the mobile phone to enter the selection interface. The user can perform a selection gesture on the display interface of the navigation application in the selection interface, that is, a gesture operation, and the mobile phone determines the local area according to the trajectory of the selection gesture. When the trajectory formed by the user's selection gesture is an arc shape, the mobile phone can directly connect the part with the gap to complete it.
在上述第一方面的一种可能的实现中，还包括：In a possible implementation of the first aspect above, it also includes:
响应于用户对第一显示区域的调整操作，调第一显示区域的大小和位置，其中，用户的调整操作包括下列中的至少一项：In response to the user's adjustment operation on the first display area, the size and position of the first display area are adjusted, wherein the user's adjustment operation includes at least one of the following:
移动第一显示区域；Move the first display area;
扩大第一显示区域；Expand the first display area;
缩小第一显示区域。Reduces the first display area.
即在本申请的实施例中，在用户确定了第一显示区域后，用户可以对第一显示区域执行，例如，显示内容扩大的手势，显示内容缩小的手势以及移动的手势。That is, in the embodiment of the present application, after the user determines the first display area, the user may perform, for example, a gesture to expand the displayed content, a gesture to shrink the displayed content, and a gesture to move on the first display area.
在上述第一方面的一种可能的实现中，还包括：In a possible implementation of the first aspect above, it also includes:
获取第一显示界面中显示内容发生变化的区域，确定显示内容变化的区域为第一显示区域。Acquire an area where the display content changes in the first display interface, and determine the area where the display content changes as the first display area.
即在本申请的实施例中，例如，第一应用可以是导航应用，手机可以通过视图系统检测出导航应用中包含的显示的导航信息的区域，并将该区域确定为第一显示区域。That is, in the embodiment of the present application, for example, the first application may be a navigation application, and the mobile phone may detect the area of the displayed navigation information contained in the navigation application through the view system, and determine the area as the first display area.
在上述第一方面的一种可能的实现中，在预设的时间段内，检测区域的画面的变化数量，在变化数量超过预设的变化阈值的情况下，确定区域为显示内容发生变化的区域。In a possible implementation of the above-mentioned first aspect, within a preset time period, the number of changes in the picture in the detection area is detected, and when the number of changes exceeds a preset change threshold, it is determined that the area has changed in display content. area.
即在本申请的实施例中，例如，手机可以通过视图系统检测出导航应用中包含的显示的导航信息的区域的方法可以是检测导航应用中的显示内容的刷新频率，也就是确定显示内容 的画面的变化数量是否超过刷新频率。That is, in the embodiment of the present application, for example, the method that the mobile phone can detect the area of the displayed navigation information contained in the navigation application through the view system may be to detect the refresh frequency of the displayed content in the navigation application, that is, to determine the display content. Whether the number of screen changes exceeds the refresh rate.
在上述第一方面的一种可能的实现中，第一显示区域通过悬浮窗的方式显示在屏幕上。In a possible implementation of the above-mentioned first aspect, the first display area is displayed on the screen by means of a floating window.
即在本申请的实施例中，例如，第一显示区域悬浮显示在第二应用的第二显示界面上。That is, in the embodiment of the present application, for example, the first display area is displayed in a floating manner on the second display interface of the second application.
在上述第一方面的一种可能的实现中，通过以下方式将第一显示区域通过悬浮窗的方式显示在屏幕上：In a possible implementation of the above-mentioned first aspect, the first display area is displayed on the screen by means of a floating window in the following manner:
设置第一显示界面于第一图层，第二显示界面于第二图层，第一图层叠加于第二图层上，并且第一图层上的第一显示界面中除第一显示区域之外的区域设置为透明显示。Set the first display interface on the first layer, the second display interface on the second layer, the first layer is superimposed on the second layer, and the first display interface on the first layer except the first display area The area outside is set to be transparent.
即在本申请的实施例中，例如，手机的视图系统将导航应用设置于第一图层，将即时聊天应用设置于第二图层，第一图层覆盖于第二图层之上。在第一图层中，导航应用的导航信息的区域设置为透明。这样可以同时显示导航应用的导航信息和即时聊天应用。That is, in the embodiment of the present application, for example, the view system of the mobile phone sets the navigation application on the first layer, sets the instant chat application on the second layer, and the first layer covers the second layer. In the first layer, the area of the navigation information of the navigation application is set to be transparent. This displays both the navigation application's navigation information and the live chat application.
在上述第一方面的一种可能的实现中，响应于用户在第一显示区域内的第一改变操作，在第一显示区域内将第一显示内容改变为第二显示内容。In a possible implementation of the above-mentioned first aspect, in response to a user's first change operation in the first display area, the first display content is changed to the second display content in the first display area.
在上述第一方面的一种可能的实现中，接收用户在第一显示区域之外的区域的第二改变操作，将第二改变操作对应的指令传递至第二图层。In a possible implementation of the above-mentioned first aspect, a second change operation performed by the user in an area outside the first display area is received, and an instruction corresponding to the second change operation is transmitted to the second layer.
在上述第一方面的一种可能的实现中，响应于第二改变操作对应的指令，于第二显示界面内将第三显示内容改变为第四显示内容。In a possible implementation of the above-mentioned first aspect, in response to an instruction corresponding to the second change operation, the third display content is changed to the fourth display content in the second display interface.
即在本申请的实施例中，用户在手机的导航应用的悬浮窗内，执行一个将显示内容扩大的手势后，导航应用的的显示内容会扩大后显示，也就是从第一显示内容改变为第二显示内容。用户在手机的导航应用的悬浮窗以外的区域内，执行了一个从下至上的滑动手势后，手机的即时聊天应用的显示界面的显示内容实现了一个上移的效果，也就是从第三显示内容改变为第四显示内容。That is, in the embodiment of the present application, after the user performs a gesture to expand the display content in the floating window of the navigation application of the mobile phone, the display content of the navigation application will be expanded and displayed, that is, the display content of the first display will be changed to The second display content. After the user performs a bottom-to-top sliding gesture in the area other than the floating window of the mobile phone's navigation application, the display content of the display interface of the mobile phone's instant chat application achieves an upward movement effect, that is, from the third display The content is changed to the fourth display content.
在上述第一方面的一种可能的实现中，第一显示区域通过画中画的方式显示在屏幕上。In a possible implementation of the above-mentioned first aspect, the first display area is displayed on the screen in a picture-in-picture manner.
本申请的第二方面提供了一种电子设备，其特征在于，包括：A second aspect of the present application provides an electronic device, characterized in that it includes:
存储器，存储有指令；memory, storing instructions;
处理器，处理器和存储器耦合，当存储器存储的程序指令被处理器执行时使得电子设备执行如前述第一方面提供的应用的显示方法。The processor is coupled to the memory, and when the program instructions stored in the memory are executed by the processor, the electronic device executes the display method of the application provided by the aforementioned first aspect.
本申请的第三方面提供了一种可读介质，可读介质中存储有指令，其特征在于，当指令在可读介质上运行时，使得可读介质执行如前述第一方面提供的应用的显示方法。A third aspect of the present application provides a readable medium, in which instructions are stored, characterized in that, when the instructions are executed on the readable medium, the readable medium is caused to execute the application provided by the foregoing first aspect. Display method.
附图说明Description of drawings
图1(a)示出了根据本申请实施例的一种电子设备的导航应用的显示界面的示例；FIG. 1( a ) shows an example of a display interface of a navigation application of an electronic device according to an embodiment of the present application;
图1(b)示出了根据本申请实施例的一种电子设备的导航应用的显示界面悬浮在即时聊天应用的显示界面内的示例；Fig. 1(b) shows an example in which a display interface of a navigation application of an electronic device is suspended in a display interface of an instant chat application according to an embodiment of the present application;
图2示出了根据本申请实施例的电子设备的硬件结构框图；2 shows a block diagram of a hardware structure of an electronic device according to an embodiment of the present application;
图3示出了根据本申请实施例的电子设备的软件结构框图；3 shows a block diagram of a software structure of an electronic device according to an embodiment of the present application;
图4示出了根据本申请实施例的手机的应用的显示方法的方法流程图；FIG. 4 shows a method flowchart of a method for displaying an application of a mobile phone according to an embodiment of the present application;
图5(a)示出了根据本申请实施例的导航应用的支持悬浮窗的示的引导界面的一种示例；Fig. 5(a) shows an example of a guidance interface supporting the display of a floating window of a navigation application according to an embodiment of the present application;
图5(b)示出了根据本申请实施例的导航应用的引导界面的提示操作的一种示例；Fig. 5(b) shows an example of a prompt operation of a guidance interface of a navigation application according to an embodiment of the present application;
图5(c)示出了根据本申请实施例的导航应用的引导界面的显示结果的一种示例；Fig. 5(c) shows an example of a display result of a guidance interface of a navigation application according to an embodiment of the present application;
图6(a)示出了根据本申请实施例的手机获取导航应用的显示界面的选取手势的一种示例；FIG. 6( a ) shows an example of a mobile phone acquiring a selection gesture of a display interface of a navigation application according to an embodiment of the present application;
图6(b)示出了根据本申请实施例的导航应用的显示界面的局部区域的预览界面的一种示例；Fig. 6(b) shows an example of a preview interface of a partial area of a display interface of a navigation application according to an embodiment of the present application;
图6(c)示出了根据本申请实施例的导航应用的局部区域悬浮显示在的即时聊天应用的一种示例；Fig. 6(c) shows an example of an instant chat application in which a local area of a navigation application is suspended and displayed according to an embodiment of the present application;
图7(a)示出了根据本申请实施例的导航应用的悬浮窗内的显示内容的一种示例；FIG. 7( a ) shows an example of display content in a floating window of a navigation application according to an embodiment of the present application;
图7(b)示出了根据本申请实施例的导航应用的悬浮窗内的显示内容发生变化的一种示例；FIG. 7(b) shows an example of changes in the displayed content in the floating window of the navigation application according to an embodiment of the present application;
图8(a)示出了根据本申请实施例的用户在导航应用的悬浮窗内的执行一个操作手势的一种示例；FIG. 8( a ) shows an example of a user performing an operation gesture in a floating window of a navigation application according to an embodiment of the present application;
图8(b)示出了根据本申请实施例的用户在导航应用的悬浮窗内的执行一个操作手势的另一种示例；Figure 8(b) shows another example of a user performing an operation gesture in a floating window of a navigation application according to an embodiment of the present application;
图8(c)示出了根据本申请实施例的导航应用的悬浮窗内的显示内容发生变化的一种示例；FIG. 8( c ) shows an example of changes in the displayed content in the floating window of the navigation application according to an embodiment of the present application;
图9(a)示出了根据本申请实施例的用户在即时聊天应用的显示界面内的执行一个操作手势的一种示例；Figure 9(a) shows an example of a user performing an operation gesture in the display interface of the instant chat application according to an embodiment of the present application;
图9(b)示出了根据本申请实施例的即时聊天应用的显示界面内的显示内容发生变化的一种示例；FIG. 9(b) shows an example of changes in the displayed content in the display interface of the instant chat application according to the embodiment of the present application;
图10(a)示出了根据本申请实施例的用户在视频播放应用的显示界面执行一个向下滑动的手势的一种示例；Figure 10(a) shows an example of a user performing a downward swipe gesture on a display interface of a video playback application according to an embodiment of the present application;
图10(b)示出了根据本申请实施例的用户在手机的控制中心的显示界面的点击“局部窗口”按钮进入局部区域选取的选取界面的一种示例；Fig. 10(b) shows an example of the user clicking the "partial window" button on the display interface of the control center of the mobile phone to enter a selection interface for partial area selection according to an embodiment of the present application;
图10(c)示出了根据本申请实施例的用户在局部区域选取的选取界面调整预览框的一种示例；Fig. 10(c) shows an example of adjusting the preview frame on the selection interface selected by the user in the local area according to an embodiment of the present application;
图10(d)示出了根据本申请实施例的用户确定视频播放应用的显示界面的局部区域的一种示例；FIG. 10(d) shows an example of a user determining a partial area of a display interface of a video playback application according to an embodiment of the present application;
图10(e)示出了根据本申请实施例的视频播放应用的局部区域悬浮显示在的即时聊天应用的一种示例；FIG. 10(e) shows an example of an instant chat application in which a local area of a video playback application is suspended and displayed according to an embodiment of the present application;
图11(a)示出了根据本申请实施例的手机识别导航应用的显示界面内的动态变化的区域一种示例；Fig. 11(a) shows an example of a dynamically changing area in a display interface of a mobile phone identification navigation application according to an embodiment of the present application;
图11(b)示出了根据本申请实施例的导航应用的局部区域悬浮显示在的即时聊天应用的一种示例；FIG. 11( b ) shows an example of an instant chat application in which a local area of a navigation application is suspended and displayed according to an embodiment of the present application;
图12(a)示出了根据本申请实施例的用户在视频播放应用的显示界面点击一个悬浮窗显示的按钮启动悬浮显示的一种示例；Fig. 12(a) shows an example in which a user clicks a button displayed in a floating window on a display interface of a video playback application to start a floating display according to an embodiment of the present application;
图12(b)示出了根据本申请实施例的用户在视频播放应用的悬浮窗内点击一个退出悬 浮窗显示的按钮关闭悬浮显示的一种示例；Figure 12 (b) shows an example in which the user clicks a button to exit the floating window display in the floating window of the video playback application according to an embodiment of the present application to close the floating display;
图13(a)示出了根据本申请实施例的手机提示用户后台运行的导航应用的显示内容发生变化，用户确认显示变化的显示内容的一种示例；Fig. 13(a) shows an example of a mobile phone prompting a user that the display content of a navigation application running in the background has changed according to an embodiment of the present application, and the user confirms that the changed display content is displayed;
图13(b)示出了根据本申请实施例的手机提示用户通过悬浮窗的方式显示的导航应用的显示内容的一种示例；Fig. 13(b) shows an example of the display content of the navigation application displayed by the mobile phone prompting the user through a floating window according to an embodiment of the present application;
图13(c)示出了根据本申请实施例的导航应用的局部区域悬浮显示在的即时聊天应用的一种示例；Fig. 13(c) shows an example of an instant chat application in which a local area of a navigation application is suspended and displayed according to an embodiment of the present application;
图14(a)示出了根据本申请实施例的用户在即时聊天应用的显示界面执行一个向下滑动的手势的一种示例；Figure 14(a) shows an example of a user performing a downward swipe gesture on a display interface of an instant chat application according to an embodiment of the present application;
图14(b)示出了根据本申请实施例的用户在手机的控制中心的显示界面的点击“应用悬浮显示”按钮进入后台运行的应用的一览界面的一种示例；Figure 14(b) shows an example of a user clicking the "Application Floating Display" button on the display interface of the control center of the mobile phone to enter a list interface of applications running in the background according to an embodiment of the present application;
图14(c)示出了根据本申请实施例的后台运行的应用的一览界面的一种示例；Figure 14(c) shows an example of a list interface of applications running in the background according to an embodiment of the present application;
图14(d)示出了根据本申请实施例的用户选择通过悬浮显示的方式显示的应用的一种示例；Fig. 14(d) shows an example of an application displayed by a user selecting a hover display according to an embodiment of the present application;
图14(e)示出了根据本申请实施例的视频播放应用以及导航应用的局部区域悬浮显示在的即时聊天应用的一种示例；FIG. 14(e) shows an example of a video playback application and an instant chat application in which a partial area of a navigation application is suspended and displayed according to an embodiment of the present application;
图15示出了根据本申请实施例的导航应用、即时聊天应用以及阅读应用和桌面通过多个窗口的方式显示的一种示例；FIG. 15 shows an example in which a navigation application, an instant chat application, a reading application and a desktop are displayed through multiple windows according to an embodiment of the present application;
图16示出了根据本申请实施例的导航应用通过等比例缩放的方式显示的一种示例；FIG. 16 shows an example in which a navigation application is displayed in an equal-scale scaling manner according to an embodiment of the present application;
图17(a)示出了根据本申请实施例的视频播放应用的显示界面的一种示例；Fig. 17(a) shows an example of a display interface of a video playback application according to an embodiment of the present application;
图17(b)示出了根据本申请实施例的视频播放应用的局部区域悬浮显示在的视频播放应用的一种示例；FIG. 17(b) shows an example of a video playback application in which a local area of a video playback application is suspended and displayed according to an embodiment of the present application;
图18示出了本申请实施例中的电子设备的硬件结构框图。FIG. 18 shows a block diagram of the hardware structure of the electronic device in the embodiment of the present application.
具体实施方式Detailed ways
本申请的实施例包括但不限于一种电子设备及其应用的显示方法和介质。Embodiments of the present application include, but are not limited to, an electronic device and a display method and medium for its application.
为使本申请的目的、技术方案和优点更加清楚，下面将结合附图对本申请的实施方式作进一步地详细描述。In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.
为了方便用户在使用一个应用的同时关注另一个应用的显示内容变化，本申请公开了一种电子设备的应用显示方法。具体的，图1(a)-(b)根据本申请实施例提供了一种电子设备的应用的显示场景，在该场景中，以同时显示两个应用为例进行说明，其中，第一应用为即时聊天应用102，第二应用为导航应用101。In order to facilitate the user to pay attention to the display content change of another application while using one application, the present application discloses an application display method of an electronic device. Specifically, FIGS. 1(a)-(b) provide a display scenario of an application of an electronic device according to an embodiment of the present application. In this scenario, two applications are displayed simultaneously as an example for description, wherein the first application It is an instant chat application 102 , and the second application is a navigation application 101 .
具体地，图1(a)示出了导航应用101的显示界面。在该场景中，如果用户选择了将导航应用101悬浮显示，则电子设备100会将导航应用101悬浮显示在其他界面上，例如用户切换到了即时聊天应用102，如图1(b)所示，电子设备100的视图系统将导航应用101的整个显示界面以小尺寸窗口的形式的悬浮窗悬浮在即时聊天应用102的显示界面内，悬浮窗内显示导航应用101的显示界面。电子设备100还可以基于用户的手势操作在电子设备100的屏幕中拖动以改变悬浮窗的位置。Specifically, FIG. 1( a ) shows the display interface of the navigation application 101 . In this scenario, if the user chooses to display the navigation application 101 in a suspended manner, the electronic device 100 will display the navigation application 101 in a suspended manner on other interfaces. For example, the user switches to the instant chat application 102, as shown in FIG. 1(b), The view system of the electronic device 100 suspends the entire display interface of the navigation application 101 in the display interface of the instant chat application 102 as a floating window in the form of a small size window, and the display interface of the navigation application 101 is displayed in the floating window. The electronic device 100 can also be dragged on the screen of the electronic device 100 based on the user's gesture operation to change the position of the floating window.
除了将视图系统将导航应用101的整个显示界面以小尺寸窗口的形式的悬浮窗悬浮在即时聊天应用102的显示界面内，为了让用户更清楚的看到导航应用101的显示内容变化，在本申请的另外一些实施例中，还可以只在悬浮窗内显示导航应用101中显示内容发生变化的部分。例如，图2示出了本申请的实施例中另一种在电子设备100的屏幕中同时显示的两个应用的场景图。如图2所示，在用户选择了将导航应用101悬浮显示后，电子设备100的视图系统将导航应用101的部分显示区域1011以小尺寸窗口的形式的悬浮窗悬浮在即时聊天应用102的显示界面内，其中，悬浮窗中显示的导航应用101的部分显示区域1011为导航应用101中显示内容随时间发生变化的部分。同时，电子设备100还可以接收用户对悬浮窗内的导航应用101的显示界面执行手势操作，以改变悬浮窗内的导航应用101的显示界面的显示内容。并且，用户还可以点击该部分显示区域1011中的“关闭”按钮1018或者“全屏显示”按钮1019，使得导航应用101关闭或者在电子设备100的屏幕内全屏显示。In addition to suspending the entire display interface of the navigation application 101 in the display interface of the instant chat application 102 by the view system in the form of a small-sized window, in order to allow the user to see the changes in the display content of the navigation application 101 more clearly, here In other embodiments of the application, only the part of the navigation application 101 where the displayed content has changed may be displayed in the floating window. For example, FIG. 2 shows another scene diagram of two applications simultaneously displayed on the screen of the electronic device 100 in the embodiment of the present application. As shown in FIG. 2 , after the user chooses to display the navigation application 101 in a suspended manner, the view system of the electronic device 100 suspends a part of the display area 1011 of the navigation application 101 on the display of the instant chat application 102 as a floating window in the form of a small-sized window. In the interface, the part of the display area 1011 of the navigation application 101 displayed in the floating window is the part of the navigation application 101 where the display content changes with time. At the same time, the electronic device 100 may also receive a gesture operation performed by the user on the display interface of the navigation application 101 in the floating window, so as to change the display content of the display interface of the navigation application 101 in the floating window. In addition, the user can also click the “close” button 1018 or the “full screen display” button 1019 in the partial display area 1011 , so that the navigation application 101 is closed or displayed in full screen on the screen of the electronic device 100 .
通过本申请的方法，电子设备100能够将用户需要实时关注的第一应用的显示界面的显示内容通过悬浮窗口的方式显示在第二应用或者桌面的显示界面内，从而在不通过切换两个应用的前提下，方便用户在使用第二应用的同时关注第一应用的变化。此外，通过在悬浮窗口中显示第一应用的部分显示区域，能够让用户关注的区域更清晰的展示给用户，避免由于悬浮窗缩小显示整个第一应用的显示界面，导致悬浮窗中的显示内容因为缩小而变得不清晰的问题。可以理解，这里的第一应用和第二应用可以是安装在电子设备100的第三方应用，也可以是电子设备100自身的系统应用，例如，第一应用和第二应用可以是电子设备100的桌面以及设置等应用。With the method of the present application, the electronic device 100 can display the display content of the display interface of the first application that the user needs to pay attention to in real time in the display interface of the second application or the desktop by means of a floating window, so that the two applications can be switched without switching between the two applications. On the premise of using the second application, it is convenient for the user to pay attention to the changes of the first application while using the second application. In addition, by displaying a part of the display area of the first application in the floating window, the area that the user pays attention to can be displayed to the user more clearly, and the display content in the floating window can be avoided due to the display interface of the entire first application being displayed in a reduced size of the floating window. Problems that become unclear due to zooming out. It can be understood that the first application and the second application here may be third-party applications installed on the electronic device 100 , or may be system applications of the electronic device 100 , for example, the first application and the second application may be the electronic device 100 Apps such as desktop and settings.
在图2示出的场景图中，电子设备100可以是各种电子设备，例如，电子设备100包括但不限于，膝上型计算机、台式计算机、平板计算机、手机、服务器、可穿戴设备、头戴式显示器、移动电子邮件设备、便携式游戏机、便携式音乐播放器、阅读器设备、或能够访问网络的其他电子设备。在一些实施方式中，本申请的实施例也可以应用于由用户穿戴的可穿戴设备。例如，智能手表、手环、首饰(例如，做成诸如耳环、手镯等装饰性物品的设备)或眼镜等，或者作为手表、手环、首饰或眼镜等的一部分。In the scene diagram shown in FIG. 2 , the electronic device 100 may be various electronic devices, for example, the electronic device 100 includes, but is not limited to, a laptop computer, a desktop computer, a tablet computer, a mobile phone, a server, a wearable device, a headphone Wearable displays, mobile email devices, portable game consoles, portable music players, reader devices, or other electronic devices capable of accessing a network. In some implementations, the embodiments of the present application may also be applied to wearable devices worn by users. For example, smart watches, bracelets, jewelry (eg, devices made into decorative items such as earrings, bracelets, etc.) or glasses, or the like, or as part of a watch, bracelet, jewelry, or glasses, or the like.
可以理解，电子设备100上可以安装有各种应用，例如，视频会议应用，即时聊天应用，视频播放应用以及导航应用等，这些应用可以采用本申请的技术方案进行同屏多应用显示。It can be understood that various applications may be installed on the electronic device 100 , such as video conference applications, instant chat applications, video playback applications, and navigation applications.
图3是本发明实施例的电子设备100的软件结构框图。FIG. 3 is a block diagram of a software structure of an electronic device 100 according to an embodiment of the present invention.
分层架构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统分为四层，从上至下分别为应用程序层，应用程序框架层，安卓运行时(Android runtime)和系统库，以及内核层。The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.
应用程序层可以包括一系列应用程序包。The application layer can include a series of application packages.
如图3所示，应用程序包可以包括相机，图库，日历，通话，地图，导航，WLAN，蓝牙，音乐，视频，短信息等应用程序。在本申请的实施例中，应用程序包可以包括启动导航应用101、即时聊天应用102、阅读应用103、桌面104和视频播放应用105。As shown in Figure 3, the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and so on. In the embodiment of the present application, the application package may include a startup navigation application 101 , an instant chat application 102 , a reading application 103 , a desktop 104 and a video playing application 105 .
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
如图3所示，应用程序框架层可以包括窗口管理器，内容提供器，视图系统，电话管理 器，资源管理器，通知管理器，应用业务管理模块，手势识别模块等。As shown in Figure 3, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, an application service management module, a gesture recognition module, and the like.
手势识别模块用于识别用户在电子设备100的屏幕上执行的手势操作。The gesture recognition module is used to recognize the gesture operation performed by the user on the screen of the electronic device 100 .
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。A window manager is used to manage window programs. The window manager can get the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。Content providers are used to store and retrieve data and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
视图系统包括可视控件，例如显示文字的控件，显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的，这里的视图用于显示视图所在的区域内的可视控件以及处理图所在的区域发生的事件。例如，视图可以处理在视图所在的区域内产生的手势操作对应的事件。对于导航应用的显示界面来说，其可以包括导航内容的视图和导航信息的视图，对于即时聊天应用的显示界面来说，其可以包括聊天内容的视图和菜单的视图。在本申请的实施例中，视图系统可以根据识别出的用户的手势操作的轨迹，从应用的显示界面的视图中计算出该轨迹对应的局部区域，并将该局部区域作为显示区域，并将其通过悬浮窗的方式显示。在一些实施例中，视图系统还可以自动确定应用的显示界面中的显示区域。视图系统还可以将两个应用分别设置在不同的图层中，并且使得一个图层位于另一个图层的上方。这里图层用于承载一个应用对应的窗口。The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications. The display interface can be composed of one or more views, where the views are used to display the visual controls in the area where the view is located and handle events that occur in the area where the diagram is located. For example, a view can handle events corresponding to gestures generated in the area where the view is located. For a display interface of a navigation application, it may include a view of navigation content and a view of navigation information, and for a display interface of an instant chat application, it may include a view of chat content and a view of menu. In the embodiment of the present application, the view system can calculate the local area corresponding to the trajectory from the view of the display interface of the application according to the recognized trajectory of the user's gesture operation, and use the local area as the display area, and use the local area as the display area. It is displayed by means of a floating window. In some embodiments, the view system may also automatically determine the display area in the application's display interface. The view system can also place two applications in separate layers, with one layer above the other. This layer is used to host a window corresponding to an application.
电话管理器用于提供电子设备100的通信功能。例如通话状态的管理(包括接通，挂断等)。The phone manager is used to provide the communication function of the electronic device 100 . For example, the management of call status (including connecting, hanging up, etc.).
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。The resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
通知管理器使应用程序可以在状态栏中显示通知信息，可以用于传达告知类型的消息，可以短暂停留后自动消失，无需用户交互。比如通知管理器被用于告知下载完成，消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息，发出提示音，电子设备振动，指示灯闪烁等。The notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
应用业务管理模块，可以对应用程序与服务器之间的连接进行管理。The application business management module can manage the connection between the application and the server.
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。The core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。The application layer and the application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(Media Libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。A system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
表面管理器用于对显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。The Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
2D图形引擎是2D绘图的绘图引擎。2D graphics engine is a drawing engine for 2D drawing.
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。The kernel layer is the layer between hardware and software. The kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.
下面以手机100作为电子设备100的示例，通过从手机100的当前打开的导航应用101中选取一个显示区域，将其通过悬浮窗的方式显示在手机100的即时聊天应用102的显示界面为例，来详细说明本申请的应用的显示方法。Taking the mobile phone 100 as an example of the electronic device 100 below, by selecting a display area from the currently opened navigation application 101 of the mobile phone 100, and displaying it on the display interface of the instant chat application 102 of the mobile phone 100 by means of a floating window as an example, The display method of the application of the present application will be described in detail.
如图4所示，手机100的应用的显示方法的技术方案包括：As shown in FIG. 4 , the technical solution of the display method of the application of the mobile phone 100 includes:
S401：手机100启动导航应用101，提示用户导航应用101支持通过悬浮窗的方式显示导航应用101的显示界面。S401: The mobile phone 100 starts the navigation application 101, and prompts the user that the navigation application 101 supports displaying the display interface of the navigation application 101 by means of a floating window.
在用户打开手机100后，用户可以通过点击手机100的用户界面(user interface，UI)中的“导航”图标，手机100接收到用户点击操作的指令后，手机100启动导航应用101。在手机100首次启动导航应用101的情况下，如图5(a)所示，导航应用101的显示界面内显示该应用支持通过悬浮窗的方式显示的引导界面1013，例如，该引导界面1013可以显示提示信息“在显示界面内选择一个区域可以将其在悬浮窗内显示”以及“继续”和“取消”按钮。在用户点击引导界面1013中的“取消”按钮1015后，导航应用101的引导界面1013退出。在用户点击引导界面1013中的“继续”按钮1014后，该引导界面1013可以通过动画的方式提示用户将导航应用101的显示界面通过悬浮窗的方式显示的操作方法。例如，如图5(b)所示，引导界面1013提示用户可以在导航应用101的显示界面执行一个手势操作选取一个显示区域，并点击“小窗显示”按钮1016，如图5(c)所示，使得该显示区域1011通过悬浮窗的方式显示。可以理解，在图5(c)的显示区域1011内，还包括“关闭”和“全屏显示”两个按钮，在用户点击显示区域1011中的“关闭”按钮1018后，该显示区域1011关闭。在用户点击显示区域1011中的“全屏显示”按钮1019后，导航应用101则在手机100的屏幕内全屏显示。这里，在用户点击图5(c)引导界面1013中的“知道了”按钮1020后，导航应用101的引导界面1013关闭。After the user turns on the mobile phone 100, the user can click the "navigation" icon in the user interface (UI) of the mobile phone 100. After the mobile phone 100 receives the user's click operation instruction, the mobile phone 100 starts the navigation application 101. When the mobile phone 100 starts the navigation application 101 for the first time, as shown in FIG. 5( a ), the display interface of the navigation application 101 displays a guide interface 1013 that the application supports to be displayed by means of a floating window. For example, the guide interface 1013 can be Display the prompt message "Select an area in the display interface to display it in the floating window" and the "Continue" and "Cancel" buttons. After the user clicks the "Cancel" button 1015 in the guidance interface 1013, the guidance interface 1013 of the navigation application 101 exits. After the user clicks the "Continue" button 1014 in the guidance interface 1013, the guidance interface 1013 may prompt the user through animation to display the operation method of displaying the display interface of the navigation application 101 through a floating window. For example, as shown in Fig. 5(b), the guidance interface 1013 prompts the user to perform a gesture operation on the display interface of the navigation application 101 to select a display area, and click the "small window display" button 1016, as shown in Fig. 5(c) display, so that the display area 1011 is displayed by means of a floating window. It can be understood that the display area 1011 in FIG. 5( c ) also includes two buttons “close” and “full screen display”. After the user clicks the “close” button 1018 in the display area 1011, the display area 1011 is closed. After the user clicks the “full screen display” button 1019 in the display area 1011 , the navigation application 101 is displayed in the full screen on the screen of the mobile phone 100 . Here, after the user clicks the "got" button 1020 in the guidance interface 1013 of FIG. 5( c ), the guidance interface 1013 of the navigation application 101 is closed.
在本申请的实施例中，手机100除了启动导航应用101之外，还可以预先启动即时聊天应用102。手机100在导航应用101中确定了通过悬浮窗的方式显示的显示区域1011后，可以将该显示区域1011显示在即时聊天应用102的显示界面上。In the embodiment of the present application, in addition to starting the navigation application 101, the mobile phone 100 may also start the instant chat application 102 in advance. After the mobile phone 100 determines the display area 1011 displayed in the form of a floating window in the navigation application 101 , the display area 1011 can be displayed on the display interface of the instant chat application 102 .
S402：手机100确定导航应用101的显示界面中的显示区域1011。S402 : The mobile phone 100 determines the display area 1011 in the display interface of the navigation application 101 .
这里，导航应用101的显示界面中的显示区域1011可以是导航应用101的显示界面中的一个局部区域，该局部区域可以是手机100根据用户在导航应用101的显示界面上执行的选取手势确定。Here, the display area 1011 in the display interface of the navigation application 101 may be a partial area in the display interface of the navigation application 101 , and the partial area may be determined by the mobile phone 100 according to the selection gesture performed by the user on the display interface of the navigation application 101 .
如图6(a)所示，在一些实施例中，手机100的手势识别模块可以识别出用户在导航应用101的显示界面上执行的一个选取手势，手势识别模块获取该选取手势的轨迹，将通过该选取手势选取的区域发送给手机100的视图系统。如图6(c)所示,手机100的视图系统将该区域确定为导航应用101的显示界面中的显示区域1011。As shown in FIG. 6( a ), in some embodiments, the gesture recognition module of the mobile phone 100 can recognize a selection gesture performed by the user on the display interface of the navigation application 101 , and the gesture recognition module obtains the trajectory of the selection gesture, The area selected by the selection gesture is sent to the view system of the mobile phone 100 . As shown in FIG. 6( c ), the view system of the mobile phone 100 determines the area as the display area 1011 in the display interface of the navigation application 101 .
同时，手机100的视图系统还可以确定该显示区域1011在导航应用101的显示界面中的大小以及位置。例如，导航应用101的显示界面的大小可是90mm×120mm(长×宽)，手 机100的视图系统确定用户的选取手势的轨迹对应的显示区域1011的大小可以是20mm×19mm(长×宽)。显示区域1011的位置可以距离导航应用101的显示界面上边界10mm，左边界10mm的位置。下文会详细介绍手机100确定导航应用101的显示界面中的显示区域1011的过程。At the same time, the view system of the mobile phone 100 can also determine the size and position of the display area 1011 in the display interface of the navigation application 101 . For example, the size of the display interface of the navigation application 101 may be 90mm×120mm (length×width), and the view system of the mobile phone 100 determines that the size of the display area 1011 corresponding to the trajectory of the user’s selection gesture may be 20mm×19mm (length×width). The position of the display area 1011 may be 10 mm from the upper border of the display interface of the navigation application 101 and 10 mm from the left border. The process of determining the display area 1011 in the display interface of the navigation application 101 by the mobile phone 100 will be described in detail below.
而在另外一些实施例中，手机100还可以自动确定导航应用101的显示界面中的显示区域1011，下文也会详细介绍该方法的实现过程。In other embodiments, the mobile phone 100 may also automatically determine the display area 1011 in the display interface of the navigation application 101, and the implementation process of the method will also be described in detail below.
S403：手机100将导航应用101的显示区域1011通过悬浮窗的方式显示。S403: The mobile phone 100 displays the display area 1011 of the navigation application 101 in the form of a floating window.
这里，在确定了导航应用101的显示区域1011后，如图6(b)至图6(c)所示，手机100的视图系统进入预览界面120，在预览界面120中设置有“小窗显示”按钮1202用于将显示区域1011设置为通过悬浮窗的方式显示。手机100响应于用户点击预览界面120中的“小窗显示”按钮1202，手机100的视图系统将导航应用101的显示区域1011通过悬浮窗的方式显示于手机100的即时聊天应用102的显示界面的显示位置。如步骤S402中描述的，用户确定的显示区域1011的大小，例如，可以将显示区域1011的大小确定为20mm×19mm(长×宽)，同时，默认的显示位置可以是可以距离手机100的即时聊天应用102的显示界面上边界10mm，右边界10mm的位置。也就是将导航应用101的显示区域1011显示在即时聊天应用102的显示界面的右上方。Here, after the display area 1011 of the navigation application 101 is determined, as shown in FIG. 6(b) to FIG. 6(c), the view system of the mobile phone 100 enters the preview interface 120, and the preview interface 120 is set with “small window display” ” button 1202 is used to set the display area 1011 to be displayed by means of a floating window. In response to the user clicking the "small window display" button 1202 in the preview interface 120 of the mobile phone 100, the view system of the mobile phone 100 displays the display area 1011 of the navigation application 101 on the display interface of the instant chat application 102 of the mobile phone 100 by means of a floating window. Display location. As described in step S402, the size of the display area 1011 determined by the user, for example, the size of the display area 1011 can be determined as 20mm×19mm (length×width), and the default display position can be an instant distance from the mobile phone 100 The upper boundary of the display interface of the chat application 102 is 10 mm, and the right boundary is 10 mm. That is, the display area 1011 of the navigation application 101 is displayed on the upper right of the display interface of the instant chat application 102 .
在本申请的一个实施例中，在确定了导航应用101的显示区域1011后，手机100的视图系统将导航应用101设置于第一图层，将手机100的即时聊天应用102设置于第二图层，第一图层覆盖于第二图层之上。也就是，手机100将导航应用101运行在在第一图层中，手机100将即时聊天应用102的显示界面运行在在第二图层中。手机100将导航应用101的显示区域1011设置为可见，例如，将距离导航应用101的显示界面上边界20mm、左边界19mm的、大小是20mm×19mm(长×宽)的区域设置为可见，并将该显示区域之外的区域设置为透明。并且，手机100将移动导航应用101在第一图层中的位置，使其显示区域1011位于至第二图层的手机100的即时聊天应用102的显示界面的显示位置。这样使得用户可以透过导航应用101的显示区域1011之外的区域，浏览第二图层中手机100的即时聊天应用102的显示界面的显示内容，同时，使得导航应用101的显示区域1011可以通过悬浮窗的方式显示于手机100的即时聊天应用102的显示界面上，用户还可以实时地浏览导航应用101的显示区域的显示内容。In an embodiment of the present application, after the display area 1011 of the navigation application 101 is determined, the view system of the mobile phone 100 sets the navigation application 101 on the first layer, and sets the instant chat application 102 of the mobile phone 100 on the second picture layer, the first layer overlays the second layer. That is, the mobile phone 100 runs the navigation application 101 in the first layer, and the mobile phone 100 runs the display interface of the instant chat application 102 in the second layer. The mobile phone 100 sets the display area 1011 of the navigation application 101 to be visible. For example, the area that is 20 mm away from the upper border of the display interface of the navigation application 101 and 19 mm from the left border and the size is 20 mm×19 mm (length×width) is set as visible, and Make the area outside this display area transparent. In addition, the mobile phone 100 moves the position of the navigation application 101 in the first layer so that the display area 1011 is located to the display position of the display interface of the instant chat application 102 of the mobile phone 100 in the second layer. In this way, the user can browse the display content of the display interface of the instant chat application 102 of the mobile phone 100 in the second layer through the area other than the display area 1011 of the navigation application 101, and at the same time, the display area 1011 of the navigation application 101 can pass through The floating window is displayed on the display interface of the instant chat application 102 of the mobile phone 100 , and the user can also browse the display content of the display area of the navigation application 101 in real time.
可以理解，在手机100移动导航应用101的显示区域至第二图层的手机100的即时聊天应用102的显示界面的显示位置后，在第一视图中的导航应用101的显示界面的一部分，将位于手机100的屏幕的边界之外。这里的手机100的即时聊天应用102的显示界面的显示位置可以是预先设置在手机100的存储区域内的参数。It can be understood that after the mobile phone 100 moves the display area of the navigation application 101 to the display position of the display interface of the instant chat application 102 of the mobile phone 100 on the second layer, a part of the display interface of the navigation application 101 in the first view will outside the boundaries of the screen of the mobile phone 100 . Here, the display position of the display interface of the instant chat application 102 of the mobile phone 100 may be a parameter preset in the storage area of the mobile phone 100 .
在导航应用101的显示区域1011处于即时聊天应用102的显示界面上时，该显示区域1011内导航应用101的显示内容会实时地发生变化。也就是，手机100在将导航应用101设置于第一图层后，导航应用101仍旧处于运行状态下，因此，导航应用101的显示界面中的显示内容也在实时地发生变化。在显示区域1011的显示内容属于导航应用101的显示界面中的显示内容的情况下，手机100的即时聊天应用102的显示界面上的显示区域1011内导航应用101的显示内容也会实时地发生变化。例如，如图7(a)至(b)所示，导航应用101 的显示界面中的导航信息发生变化，例如，在车辆运行了一段时间后，导航信息的路线发生了变化，该导航信息的变化会实时地在手机100的即时聊天应用102的显示界面上的显示区域1011中更新变化。When the display area 1011 of the navigation application 101 is on the display interface of the instant chat application 102, the display content of the navigation application 101 in the display area 1011 will change in real time. That is, after the mobile phone 100 sets the navigation application 101 on the first layer, the navigation application 101 is still in the running state. Therefore, the display content in the display interface of the navigation application 101 also changes in real time. When the display content of the display area 1011 belongs to the display content of the display interface of the navigation application 101 , the display content of the navigation application 101 in the display area 1011 on the display interface of the instant chat application 102 of the mobile phone 100 will also change in real time. . For example, as shown in FIGS. 7( a ) to ( b ), the navigation information in the display interface of the navigation application 101 changes. For example, after the vehicle has been running for a period of time, the route of the navigation information changes. The changes will be updated in the display area 1011 on the display interface of the instant chat application 102 of the mobile phone 100 in real time.
S404：手机100确定是否检测到用户在导航应用101的显示区域1011执行的手势操作。S404 : The mobile phone 100 determines whether a gesture operation performed by the user in the display area 1011 of the navigation application 101 is detected.
在手机100接收到用户在导航应用101的显示区域执行的手势操作后，执行S405,手机100响应于该手势操作而改变显示区域内的显示内容。After the mobile phone 100 receives the gesture operation performed by the user in the display area of the navigation application 101, S405 is performed, and the mobile phone 100 changes the display content in the display area in response to the gesture operation.
S405：手机100改变显示区域1011内的显示内容。S405 : The mobile phone 100 changes the display content in the display area 1011 .
这里，手机100的导航应用101运行于第一图层内，并且第一图层覆盖于第二图层之上。因此，第一图层是手机100的屏幕内的当前视图，也就是说，用户在手机100的屏幕执行的手势操作，都是作用在第一图层上的。如果用户的手势操作是作用在手机100的导航应用101的显示区域1011内的，就相当于作用在导航应用101的显示界面上，手机100的手势识别模块在识别出该手势操作后，使得导航应用101可以响应该手势操作对应的指令，使得手机100的导航应用101的显示区域1011内的导航应用101的显示内容发生改变。Here, the navigation application 101 of the mobile phone 100 runs in the first layer, and the first layer is overlaid on the second layer. Therefore, the first layer is the current view in the screen of the mobile phone 100 , that is to say, the gesture operations performed by the user on the screen of the mobile phone 100 all act on the first layer. If the user's gesture operation acts on the display area 1011 of the navigation application 101 of the mobile phone 100, it is equivalent to acting on the display interface of the navigation application 101. After the gesture recognition module of the mobile phone 100 recognizes the gesture operation, the navigation The application 101 can respond to the instruction corresponding to the gesture operation, so that the display content of the navigation application 101 in the display area 1011 of the navigation application 101 of the mobile phone 100 is changed.
例如，如图8(a)所示，用户在手机100的导航应用101的显示区域1011内，对导航应用101的显示内容，执行一个将显示内容扩大的手势，手机100的手势识别模块识别出该手势操作后，使得导航应用101响应该手势，手机100的导航应用101的显示区域1011内的导航应用101的显示内容会扩大后显示，该手势不会对即时聊天应用102的显示界面起作用。再如，如图8(b)至8(c)所示，用户在手机100的导航应用101的显示区域1011内，对导航应用101的显示内容，执行一个下拉的手势，手机100的手势识别模块识别出该手势操作后，使得导航应用101响应该手势，导航应用101的显示区域1011内的导航应用101的显示内容向下移动。同样地，该手势不会对即时聊天应用102的显示界面起作用。For example, as shown in FIG. 8( a ), in the display area 1011 of the navigation application 101 of the mobile phone 100 , the user performs a gesture to expand the displayed content on the display content of the navigation application 101 , and the gesture recognition module of the mobile phone 100 recognizes the After the gesture operation, the navigation application 101 is made to respond to the gesture, the display content of the navigation application 101 in the display area 1011 of the navigation application 101 of the mobile phone 100 will be enlarged and displayed, and the gesture will not affect the display interface of the instant chat application 102 . For another example, as shown in FIGS. 8(b) to 8(c), the user performs a pull-down gesture on the display content of the navigation application 101 in the display area 1011 of the navigation application 101 of the mobile phone 100, and the gesture recognition of the mobile phone 100 After the module recognizes the gesture operation, the navigation application 101 responds to the gesture, and the display content of the navigation application 101 in the display area 1011 of the navigation application 101 moves downward. Likewise, the gesture will not have any effect on the display interface of the instant chat application 102 .
S406：手机100确定是否检测到用户在导航应用101的显示区域1011以外的区域执行的手势操作。S406: The mobile phone 100 determines whether a gesture operation performed by the user in an area other than the display area 1011 of the navigation application 101 is detected.
在手机100接收到用户在导航应用101的显示区域1011以外的区域执行的手势操作后，执行S407,手机100响应于该手势操作而改变即时聊天应用102的显示内容。After the mobile phone 100 receives the gesture operation performed by the user in an area other than the display area 1011 of the navigation application 101, S407 is executed, and the mobile phone 100 changes the display content of the instant chat application 102 in response to the gesture operation.
S407：手机100改变即时聊天应用102的显示内容。S407 : The mobile phone 100 changes the display content of the instant chat application 102 .
这里，在S403中，虽然将手机100的导航应用101的显示区域1011之外的区域设置为透明，但是，由于手机100的导航应用101仍然是运行于第一图层内，因此，用户在导航应用101的显示区域1011之外的区域执行的手势操作，也是作用在手机100的导航应用101的显示界面。这时，如果手机100确定用户是在手机100的导航应用101的显示区域1011以外的区域执行的操手势操作，则手机100在获取该手势操作对应的指令，并使其不在第一图层内被执行，手机100将该手势操作对应的指令传递至第二图层的手机100的即时聊天应用102的显示界面，手机100的即时聊天应用102的显示界面可以响应该手势操作对应的指令，使得手机100的即时聊天应用102的显示界面的显示内容发生改变。Here, in S403, although the area outside the display area 1011 of the navigation application 101 of the mobile phone 100 is set to be transparent, since the navigation application 101 of the mobile phone 100 is still running in the first layer, the user is navigating Gesture operations performed in areas other than the display area 1011 of the application 101 also act on the display interface of the navigation application 101 of the mobile phone 100 . At this time, if the mobile phone 100 determines that the user performs a gesture operation in an area other than the display area 1011 of the navigation application 101 of the mobile phone 100, the mobile phone 100 is acquiring the instruction corresponding to the gesture operation and making it not in the first layer is executed, the mobile phone 100 transmits the instruction corresponding to the gesture operation to the display interface of the instant chat application 102 of the mobile phone 100 on the second layer, and the display interface of the instant chat application 102 of the mobile phone 100 can respond to the instruction corresponding to the gesture operation, so that The display content of the display interface of the instant chat application 102 of the mobile phone 100 changes.
例如，如图9(a)至9(b)所示，用户在手机100的导航应用101的显示区域1011以外的区域内，例如，在即时聊天应用102的显示界面的区域内，执行了一个从下至上的滑动手势，手机100在获取该手势操作对应的指令后，确定其执行在手机100的导航应用101的显示区域1011以外的区域，手机100将从下至上的滑动手势对应的指令传递至第二图层的手机100 的即时聊天应用102的显示界面，此时，手机100的即时聊天应用102的显示界面响应该从下至上的滑动手势对应的指令，手机100的即时聊天应用102的显示界面的显示内容实现了一个上移的效果。For example, as shown in FIGS. 9( a ) to 9 ( b ), the user executes a For the bottom-up swipe gesture, after acquiring the instruction corresponding to the gesture operation, the mobile phone 100 determines that it is executed in an area other than the display area 1011 of the navigation application 101 of the mobile phone 100, and the mobile phone 100 transfers the instruction corresponding to the bottom-up swipe gesture to the display interface of the instant chat application 102 of the mobile phone 100 on the second layer. At this time, the display interface of the instant chat application 102 of the mobile phone 100 responds to the instruction corresponding to the sliding gesture from the bottom to the top, and the instant chat application 102 of the mobile phone 100 The display content of the display interface realizes an upward movement effect.
下面具体介绍S402中描述的一种手机100确定导航应用101的显示界面中的显示区域1011的过程。A process of determining the display area 1011 in the display interface of the navigation application 101 by the mobile phone 100 described in S402 will be specifically described below.
S402a：手机100接收用户在导航应用101的显示界面上执行的一个选取手势。S402a: The mobile phone 100 receives a selection gesture performed by the user on the display interface of the navigation application 101.
在本申请的一个实施例中，如图6(a)所示，用户可以通过一个选取手势，手动选取导航应用101的显示界面的局部区域，手机100的手势识别模块可以识别出该选取手势的轨迹。这里的导航应用101的显示界面，可以是显示导航信息变化的显示界面，如：导航的路线。In an embodiment of the present application, as shown in FIG. 6( a ), the user can manually select a partial area of the display interface of the navigation application 101 through a selection gesture, and the gesture recognition module of the mobile phone 100 can recognize the selection gesture. trajectory. The display interface of the navigation application 101 here may be a display interface that displays changes in navigation information, such as a navigation route.
这里，用户可以通过指关节滑动的选取手势在手机100的屏幕上对导航应用101的显示界面选取局部区域。这样，可以避免与导航应用101支持的默认手势冲突。Here, the user can select a local area on the display interface of the navigation application 101 on the screen of the mobile phone 100 through a selection gesture of sliding with a knuckle. In this way, conflicts with default gestures supported by the navigation application 101 can be avoided.
手势识别模块可以是现有的用于实现手势识别或者指关节识别任何模块，在此不做限制。The gesture recognition module may be any existing module for realizing gesture recognition or finger joint recognition, which is not limited herein.
S402b：手机100根据选取手势的轨迹在导航应用101的显示界面内选取一个局部区域。S402b: The mobile phone 100 selects a local area in the display interface of the navigation application 101 according to the trajectory of the selection gesture.
手机100的手势识别模块在识别出用户的选取手势的轨迹后，将其发送给手机100的视图系统。手机100的视图系统根据该轨迹对应的局部区域，将该局部区域作为显示区域。After recognizing the trajectory of the user's selection gesture, the gesture recognition module of the mobile phone 100 sends it to the view system of the mobile phone 100 . According to the local area corresponding to the track, the view system of the mobile phone 100 uses the local area as a display area.
这里，用户通过选取手势所选取的导航应用101的显示界面的局部区域可为用户执行的选取手势在导航应用101的显示界面内所形成的轨迹所包括的显示内容。这里，手机100的视图系统在导航应用101的显示界面所在的视图上设置一个监听手势事件的方法，例如，onTouchEvent方法，该方法通过启动手机100的手势识别模块识别出用户的选取手势的轨迹。也就是，当用户按压或者用导体接触手机100的屏幕时，该方法可以检测到按压或者接触手机100的屏幕的位置，该按压或者接触手机100的屏幕的位置可以简称触点。当手势识别模块检测到触点时，可以确定检测到用户的选取手势。其中，选取手势可以在手机100的屏幕内滑动的手势。Here, the partial region of the display interface of the navigation application 101 selected by the user through the selection gesture may be the display content included in the track formed by the selection gesture performed by the user in the display interface of the navigation application 101 . Here, the view system of the mobile phone 100 sets a method for monitoring gesture events on the view where the display interface of the navigation application 101 is located, for example, the onTouchEvent method, which recognizes the trajectory of the user's selection gesture by starting the gesture recognition module of the mobile phone 100. That is, when the user presses or contacts the screen of the mobile phone 100 with a conductor, the method can detect the position of pressing or contacting the screen of the mobile phone 100 , and the position of pressing or contacting the screen of the mobile phone 100 may be referred to as a contact point for short. When the gesture recognition module detects the touch point, it can be determined that the user's selection gesture is detected. The selection gesture is a gesture that can be slid within the screen of the mobile phone 100 .
当用户在手机100的屏幕内，也就是导航应用101的显示界面内执行一个选取手势的过程中，该监听手势事件的方法可以获取选取手势在导航应用101的显示界面内经过的x坐标值和y坐标值，在用户完成该选取手势后，该监听手势事件的方法可以根据x坐标值和y坐标值计算出选取手势所形成的轨迹，并确定该轨迹对应的局部区域。When the user performs a selection gesture on the screen of the mobile phone 100 , that is, in the display interface of the navigation application 101 , the method for monitoring gesture events can obtain the x-coordinate value and The y coordinate value. After the user completes the selection gesture, the method for monitoring gesture events can calculate the trajectory formed by the selection gesture according to the x coordinate value and the y coordinate value, and determine the local area corresponding to the trajectory.
如图6(a)所示，用户的选取手势所形成的轨迹可为闭合区域或者非闭合区域。当用户的选取手势所形成的轨迹为闭合区域时，选取的导航应用101的显示界面的局部区域为该闭合区域内的显示内容。当用户的选取手势所形成的轨迹为非闭合区域时，选取的导航应用101的显示界面的局部区域可为用户的选取手势所形成的轨迹与手机100的屏幕的左右边界或者上下边界之间所形成的区域内的显示内容。As shown in FIG. 6( a ), the trajectory formed by the user's selection gesture may be a closed area or a non-closed area. When the trajectory formed by the user's selection gesture is a closed area, the selected partial area of the display interface of the navigation application 101 is the display content in the closed area. When the trajectory formed by the user's selection gesture is a non-closed area, the selected local area of the display interface of the navigation application 101 may be the area between the trajectory formed by the user's selection gesture and the left and right or upper and lower boundaries of the screen of the mobile phone 100 . Display content within the formed area.
例如，当用户的选取手势所形成的轨迹为直线或者曲线等时，选取的导航应用101的显示界面的局部区域为直线、曲线或者圆弧与屏幕的左右边界或者上下边界所形成的区域内的显示内容。当用户的选取手势所形成的轨迹为非闭合区域时，选取的导航应用101的显示界面的局部区域还可为非闭合区域补全后所得到的闭合区域内的显示内容。例如，当用户的选取手势所形成的轨迹为V形或者圆弧形时，选取的当前显示页面显示内容为V形或者圆弧形 补全后所得到的闭合区域内的显示内容。补全可为将有缺口的部分直接连接，或者是根据对称原理将非闭合区域补全，或者是根据非闭合区域的形状补全为规则图形等。For example, when the trajectory formed by the user's selection gesture is a straight line or a curve, etc., the selected local area of the display interface of the navigation application 101 is within the area formed by the straight line, curve or arc and the left and right boundaries or upper and lower boundaries of the screen. Display content. When the trajectory formed by the user's selection gesture is a non-closed area, the selected partial area of the display interface of the navigation application 101 may also be the display content in the closed area obtained by completing the non-closed area. For example, when the trajectory formed by the user's selection gesture is V-shaped or arc-shaped, the display content of the selected current display page is the display content in the closed area obtained after the V-shaped or arc-shaped complement is completed. Completion may be to directly connect the parts with gaps, or to complete the non-closed area according to the principle of symmetry, or to complete the shape of the non-closed area into a regular figure, etc.
S402c：手机100对导航应用101的显示界面的局部区域进行调整，形成导航应用101的显示区域。S402c: The mobile phone 100 adjusts a partial area of the display interface of the navigation application 101 to form a display area of the navigation application 101 .
可以理解，在手机100的视图系统确定用户通过选取手势选取了导航应用101的显示界面的局部区域后，手机100可以进入导航应用101的显示界面的局部区域的预览界面120，在该预览界面120中，手机100的视图系统可以将该局部区域进行外扩形成矩形，或如圆形、菱形框的其他形状，作为预览区域1201。例如，如图6(b)所示，在用户通过选取手势形成的轨迹为圆形闭合区域的情况下，手机100的视图系统可以通过对该圆形闭合区域进行外接四边形形成预览区域1201，例如，该预览区域1201可以是一个大小为20mm×19mm(长×宽)的区域。同时，在该预览界面120中，用户还可以通过手势再次调整预览区域1201的大小。例如，用户可以通过拖动预览区域1201形成的矩形的四条边对显示区域的大小进行调整，用户也可以通过按住拖动预览区域1201形成的矩形，调整预览区域1201在导航应用101的显示界面中的位置。手机100的视图系统还可以在自身的存储区域中存储该预览区域1201的大小以及预览区域1201的默认位置。例如，预览区域1201的大小可以是20mm×19mm(长×宽),预览区域1201的默认位置可以是预览区域1201的中心到导航应用101的显示界面的四个边的距离。It can be understood that, after the view system of the mobile phone 100 determines that the user selects a partial area of the display interface of the navigation application 101 through the selection gesture, the mobile phone 100 can enter the preview interface 120 of the partial area of the display interface of the navigation application 101, and the preview interface 120 , the view system of the mobile phone 100 may expand the local area to form a rectangle, or other shapes such as a circle or a diamond-shaped frame, as the preview area 1201 . For example, as shown in FIG. 6( b ), when the trajectory formed by the user's selection gesture is a circular closed area, the view system of the mobile phone 100 can form a preview area 1201 by circumscribing the circular closed area, for example , the preview area 1201 can be an area with a size of 20mm×19mm (length×width). Meanwhile, in the preview interface 120, the user can also adjust the size of the preview area 1201 again through gestures. For example, the user can adjust the size of the display area by dragging the four sides of the rectangle formed by the preview area 1201, and the user can also adjust the display interface of the preview area 1201 in the navigation application 101 by pressing and dragging the rectangle formed by the preview area 1201. in the location. The view system of the mobile phone 100 may also store the size of the preview area 1201 and the default position of the preview area 1201 in its own storage area. For example, the size of the preview area 1201 may be 20mm×19mm (length×width), and the default position of the preview area 1201 may be the distance from the center of the preview area 1201 to the four sides of the display interface of the navigation application 101 .
可以理解，除了在步骤S402中描述的，手机100获取用户在导航应用101的显示界面上执行一个选取手势，来确定导航应用101的显示区域1011的方法，下文还会描述其他几种实现步骤S402中，手机100确定导航应用101的显示区域1011的方法。It can be understood that, in addition to the method described in step S402, the mobile phone 100 obtains a method for the user to perform a selection gesture on the display interface of the navigation application 101 to determine the display area 1011 of the navigation application 101, and several other implementation steps S402 will be described below. In the method, the mobile phone 100 determines the display area 1011 of the navigation application 101 .
手机100可以通过自身的控制中心的显示区域的选取功能，在导航应用101的显示界面中自动选取出显示区域1011。手机100在接收用户开启设置在手机100的控制中心的选取功能的指令后，进入应用的局部区域选取模式。在该选取模式下，手机100的视图系统可以实现上述S402中描述的在导航应用101的显示界面中选取一个显示区域。The mobile phone 100 can automatically select the display area 1011 in the display interface of the navigation application 101 through the selection function of the display area of its own control center. After receiving an instruction from the user to enable the selection function set in the control center of the mobile phone 100, the mobile phone 100 enters the local area selection mode of the application. In this selection mode, the view system of the mobile phone 100 can implement the selection of a display area in the display interface of the navigation application 101 as described in S402 above.
下面以手机100中运行即时聊天应用102以及视频播放应用105为例进行说明。在图10(a)用户在手机100上打开视频播放应用105以及即时聊天应用102并切换至视频播放应用105。用户在视频播放应用105的显示界面执行一个向下滑动的手势后，手机100进入控制中心201的显示界面。在图10(b)中，在控制中心201的显示界面中，设置有一个名称为“局部窗口”的按钮2011。在用户按下该“局部窗口”的按钮2011后，手机100进入对视频播放应用105的显示界面进行局部区域选取的选取界面202。在图10(c)中，在该选取界面202中，会显示一个用于选取局部区域的矩形的预览框2021以及“小窗显示”按钮2022，用户可以通过拖动预览框2021的四条边对选取视频播放应用105的显示界面的局部区域的大小进行调整，用户也可以通过按住拖动预览框2021，调整预览框在视频播放应用105的显示界面中的位置，以选取视频播放应用105的显示界面的局部区域作为显示区域。在图10(d)中,用户确定了视频播放应用105的显示界面中的显示区域后，可以通过点击“小窗显示”按钮2022，进入S403，如图10(e)所示，手机100的视图系统将视频播放应用105的显示界面的视频的显示区域1051通过悬浮窗显示在手机100的即时聊天应用102的显示界面上。The following takes the instant chat application 102 and the video playback application 105 running in the mobile phone 100 as an example for description. In FIG. 10( a ), the user opens the video playback application 105 and the instant chat application 102 on the mobile phone 100 and switches to the video playback application 105 . After the user performs a downward sliding gesture on the display interface of the video playing application 105 , the mobile phone 100 enters the display interface of the control center 201 . In Fig. 10(b), in the display interface of the control center 201, a button 2011 named "partial window" is provided. After the user presses the button 2011 of the "partial window", the mobile phone 100 enters the selection interface 202 for selecting a local area on the display interface of the video playback application 105 . In Fig. 10(c), in the selection interface 202, a rectangular preview frame 2021 for selecting a partial area and a "small window display" button 2022 will be displayed. The user can drag the four sides of the preview frame 2021 to match Select the size of the local area of the display interface of the video playback application 105 to adjust, the user can also press and drag the preview frame 2021 to adjust the position of the preview frame in the display interface of the video playback application 105 to select the video playback application 105. The partial area of the display interface is used as the display area. In Fig. 10(d), after the user has determined the display area in the display interface of the video playback application 105, he can click the "small window display" button 2022 to enter S403, as shown in Fig. 10(e), the display of the mobile phone 100 The view system displays the video display area 1051 of the display interface of the video playback application 105 on the display interface of the instant chat application 102 of the mobile phone 100 through a floating window.
在本申请的另一个实施例中，手机100可以通过显示区域的悬浮窗显示模式，实现上述S402中描述的在手机100确定导航应用101的显示界面中的显示区域1011。In another embodiment of the present application, the mobile phone 100 can implement the display area 1011 in the display interface of the navigation application 101 determined by the mobile phone 100 as described in the above S402 through the floating window display mode of the display area.
手机100可以启动悬浮窗显示模式，与上面描述的方法不同的是，在该悬浮窗显示模式下，手机100的视图系统可以检测并确定导航应用101的显示界面中显示内容会动态变化的区域，并从该显示内容会动态变化的区域中，确定导航应用101的显示区域1012。这里描述的显示内容会动态变化的区域，是指在一个应用的显示界面的一个区域内的显示内容会在一个时间段内发生变化。如图11(a)所示，对于导航应用101的显示界面，其包含的动态变化的区域可以是地图所在的区域，其类型可以是地图视图MapView。该地图视图所在的区域内的显示内容会实时地发生变化，手机100的视图系统可以对导航应用101的显示界面中的每一个区域进行检测，当显示内容的变化超过一个变化阈值时，例如，每秒产生10帧的变化，也就是显示内容的刷新频率为10FPS，这里的FPS是指每秒传输帧数(FPS，Frames Per Second，帧/秒)，就是指每秒内显示内容中刷新的画面数量，10FPS就是指在一秒内，显示内容中刷新的画面数量为10张。则手机100的视图系统确认该区域属于显示内容会动态变化的区域。在图11(b)中，手机100的视图系统确定了导航应用101中的内容会动态变化的区域后，手机100可以从该动态变化的区域的中心向该动态变化的区域的四周辐射形成一个矩形的显示区域1011，手机100的视图系统进入S403，将显示区域1011通过悬浮窗显示在即时聊天应用102的显示界面上。The mobile phone 100 can activate the floating window display mode. Different from the method described above, in this floating window display mode, the view system of the mobile phone 100 can detect and determine the area in the display interface of the navigation application 101 where the displayed content will change dynamically, And the display area 1012 of the navigation application 101 is determined from the area in which the display content will change dynamically. The area in which the display content will change dynamically described here refers to that the display content in an area of the display interface of an application will change within a period of time. As shown in FIG. 11( a ), for the display interface of the navigation application 101 , the dynamically changing area contained therein may be the area where the map is located, and the type may be the map view MapView. The display content in the area where the map view is located will change in real time. The view system of the mobile phone 100 can detect each area in the display interface of the navigation application 101. When the change of the display content exceeds a change threshold, for example, A change of 10 frames per second is generated, that is, the refresh rate of the display content is 10FPS. The FPS here refers to the number of frames transmitted per second (FPS, Frames Per Second, frames per second), which refers to the refreshed content in the display per second. The number of pictures, 10FPS means that the number of pictures refreshed in the display content is 10 in one second. Then, the view system of the mobile phone 100 confirms that the area belongs to the area where the display content will change dynamically. In FIG. 11(b), after the view system of the mobile phone 100 determines the area where the content in the navigation application 101 will change dynamically, the mobile phone 100 can radiate from the center of the dynamically changing area to the surrounding area of the dynamically changing area to form a In the rectangular display area 1011, the view system of the mobile phone 100 enters S403, and displays the display area 1011 on the display interface of the instant chat application 102 through a floating window.
可以理解，在一些实施例中，手机100的视图系统可以根据预先存储在自身的存储区域内的视图类型的列表来确定哪些视图属于动态变化的区域。再如，对于视频播放应用105来说，其包含的动态变化的区域可以是视频播放视图，其类型可以是VideoView。It can be understood that, in some embodiments, the view system of the mobile phone 100 may determine which views belong to the dynamically changing region according to the list of view types pre-stored in its own storage region. For another example, for the video playback application 105, the dynamically changing area contained in it may be a video playback view, and its type may be VideoView.
对于上述的悬浮窗显示模式，手机100还可以对已经打开的应用设置一个进入/退出悬浮窗显示模式的按钮。例如，如图12(a)至图12(b)所示，用户可以通过点击视频播放应用105的显示界面上的“悬浮窗显示”按钮1052，使得手机100确定视频播放应用105的显示界面的视频的显示区域1051，并将其进行悬浮窗显示。在手机100将视频播放应用105的视频播放区域进行悬浮窗显示后，用户还可以点击悬浮窗内的“退出悬浮窗显示”按钮1053，使得手机100取消将视频播放应用105的视频的显示区域1051进行悬浮窗显示。For the above-mentioned floating window display mode, the mobile phone 100 may also set a button for entering/exiting the floating window display mode for an already opened application. For example, as shown in FIGS. 12( a ) to 12 ( b ), the user can click the “floating window display” button 1052 on the display interface of the video playing application 105 to make the mobile phone 100 determine the display interface of the video playing application 105 The video display area 1051 is displayed in a floating window. After the mobile phone 100 displays the video playing area of the video playing application 105 in the floating window, the user can also click the "exit floating window display" button 1053 in the floating window, so that the mobile phone 100 cancels the display area 1051 of the video of the video playing application 105 Display the floating window.
在本申请的另一个实施例中，手机100的悬浮窗显示模式还可以用于手机100上弹出的应用，以实现上述S402中描述的在手机100确定导航应用101的显示界面中的显示区域1011。In another embodiment of the present application, the floating window display mode of the mobile phone 100 can also be used for an application popped up on the mobile phone 100 to realize the determination of the display area 1011 in the display interface of the navigation application 101 by the mobile phone 100 described in S402 above. .
与上面描述的悬浮窗显示模式的作用不同的是，手机100在启动悬浮窗显示模式后，在悬浮窗显示模式下，当手机100检测到后台运行的应用的显示内容发生变化后，提示用户是否将该应用通过悬浮窗的方式显示，以使得用户可以时刻关注该应用的显示内容。例如，如图13(a)手机100的屏幕中显示即时聊天应用102的显示界面，这时，手机100的屏幕的上方提示用户正在后台运行的导航应用101的显示界面的显示内容发生变化，是否要点击查看。如果用户点击了“忽略”按钮后，则手机100将不再提示用户导航应用101的显示界面的显示内容发生变化。在用户点击了“点击查看”按钮后，如图13(b)手机100再次提示用户是否将导航应用101的显示界面通过悬浮窗的方式显示在即时聊天应用102的显示界面内。如果用户选择点击“否”，则手机100不会将导航应用101的显示界面通过悬浮窗的方 式显示。如果用户选择点击“是”，则如图13(c)所示，手机100的视图系统可以将导航应用101的显示界面通过悬浮窗的方式显示在即时聊天应用102的显示界面内。Different from the function of the floating window display mode described above, after the mobile phone 100 starts the floating window display mode, in the floating window display mode, when the mobile phone 100 detects that the display content of the application running in the background has changed, it prompts the user whether The application is displayed in the form of a floating window, so that the user can always pay attention to the displayed content of the application. For example, as shown in Fig. 13(a), the display interface of the instant chat application 102 is displayed on the screen of the mobile phone 100. At this time, the upper part of the screen of the mobile phone 100 prompts the user that the display content of the display interface of the navigation application 101 running in the background has changed. To click to view. If the user clicks the "ignore" button, the mobile phone 100 will no longer prompt the user to change the display content of the display interface of the navigation application 101 . After the user clicks the "click to view" button, as shown in Figure 13(b), the mobile phone 100 prompts the user again whether to display the display interface of the navigation application 101 in the display interface of the instant chat application 102 by means of a floating window. If the user chooses to click "No", the mobile phone 100 will not display the display interface of the navigation application 101 in the form of a floating window. If the user chooses to click “Yes”, as shown in FIG. 13( c ), the view system of the mobile phone 100 can display the display interface of the navigation application 101 in the display interface of the instant chat application 102 by means of a floating window.
可以理解，上述对手机100上弹出的应用进行显示区域的选取以及通过悬浮窗的方式显示的过程可以与步骤S402和S403中描述的相同，这里不再重复描述。It can be understood that the above process of selecting a display area for the application popped up on the mobile phone 100 and displaying it by means of a floating window can be the same as that described in steps S402 and S403, and the description is not repeated here.
除了上述描述的手机100将单个应用通过悬浮窗的方式显示在另一个应用的显示界面上的场景，在本申请的实施例中，手机100还可以将多个应用通过悬浮窗的方式进行显示。In addition to the above-described scenario in which the mobile phone 100 displays a single application on the display interface of another application by means of a floating window, in the embodiment of the present application, the mobile phone 100 may also display multiple applications by means of a floating window.
这里，手机100可以开启应用悬浮显示功能，在开启该功能后，手机100的视图系统可以在手机100的屏幕内通过一览显示的方式显示已经在后台运行的应用，用户可以在上述应用中选择一个或者多个应用，使得上述应用通过悬浮窗的方式显示在当前的应用的显示界面内。Here, the mobile phone 100 can enable the application floating display function. After this function is enabled, the view system of the mobile phone 100 can display the applications already running in the background in a list display mode on the screen of the mobile phone 100. The user can select one of the above applications. Or multiple applications, so that the above applications are displayed in the display interface of the current application by means of a floating window.
下面以手机100中运行导航应用101、即时聊天应用102、阅读应用103以及视频播放应用105为例进行说明，其中，手机100的屏幕中显示的当前的应用是即时聊天应用102。如图14(a)所示，用户在即时聊天应用102的显示界面执行一个向下滑动的手势后，手机100进入401的显示界面。在图14(b)中，在控制中心401的显示界面中，设置有一个名称为“应用悬浮显示”的按钮4011。在用户按下该“应用悬浮显示”的按钮4011后，手机100进入当前正在后台运行的应用的一览界面501。在图14(c)中，在该一览界面501中，会显示当前正在后台运行的所有的应用的标识，例如，将导航应用101、阅读应用103以及视频播放应用105，同时提示用户选择通过悬浮窗的方式显示的应用。用户可以通过点击每一个应用的标识来确定是否将该应用通过悬浮窗的方式显示在当前的应用的显示界面内。在用户选择完应用后，如图14(d)所示，在该一览界面501中，用户选择了导航应用101以及视频播放应用105后，可以点击“确定”按钮，如图14(e)所示，手机100的视图系统将视频播放应用105的显示界面以及导航应用101的显示界面通过悬浮窗显示在手机100的即时聊天应用102的显示界面上。在图14(d)中，用户也可以点击“取消”按钮，退出应用悬浮显示功能。The following takes the mobile phone 100 running the navigation application 101 , the instant chat application 102 , the reading application 103 and the video playback application 105 as an example for description, wherein the current application displayed on the screen of the mobile phone 100 is the instant chat application 102 . As shown in FIG. 14( a ), after the user performs a downward swipe gesture on the display interface of the instant chat application 102 , the mobile phone 100 enters the display interface 401 . In FIG. 14( b ), in the display interface of the control center 401 , a button 4011 named “Application Floating Display” is provided. After the user presses the button 4011 of the "application floating display", the mobile phone 100 enters the list interface 501 of the applications currently running in the background. In Fig. 14(c), in the list interface 501, the identifiers of all the applications currently running in the background will be displayed, for example, the navigation application 101, the reading application 103 and the video playing application 105 will be displayed, and the user will be prompted to select the The application displayed in the form of a window. The user can determine whether to display the application in the display interface of the current application by means of a floating window by clicking on the identifier of each application. After the user selects the application, as shown in Fig. 14(d), in the list interface 501, after the user selects the navigation application 101 and the video playback application 105, the user can click the "OK" button, as shown in Fig. 14(e) As shown, the view system of the mobile phone 100 displays the display interface of the video playback application 105 and the display interface of the navigation application 101 on the display interface of the instant chat application 102 of the mobile phone 100 through a floating window. In Figure 14(d), the user can also click the "Cancel" button to exit the application floating display function.
上述步骤403中描述了一种将导航应用101的显示区域1011通过悬浮窗的方式显示在即时聊天应用102的显示界面上的方法，下面介绍上述步骤403的另一种实现方法，在本申请的另一个实施例中，对于导航应用101和即时聊天应用102，手机100的视图系统可以将导航应用101设置于第二图层，将手机100的即时聊天应用102设置于第一图层，第一图层覆盖于第二图层之上。也就是，手机100将导航应用101运行在在第二图层中，手机100将即时聊天应用102的显示界面运行在第一图层中。手机100在即时聊天应用102的显示界面内挖去一个局部区域，例如，可以是将距离即时聊天应用102的显示界面上边界20mm，左边界10mm的，大小是20mm×19mm(长×宽)的区域挖去，使得用户可以透过该显示区域内浏览第二图层内的导航应用101的显示界面，该局部区域的大小与显示区域1011的大小相同。并且，手机100将移动导航应用101在第二图层中的位置，使其显示区域位1011对准第一图层的手机100的即时聊天应用102的局部区域。这样使得用户可以透过即时聊天应用102的局部区域，浏览第二图层中手机100的导航应用101的显示界面的显示区域1011的显示内容，同时，使得导航应用101的显示区域可以通过类似悬浮窗的方式显示于手机100的即时聊天应用102的显示界面上，用户还可以实时地浏览导航应用101的显示区域的 显示内容。The above-mentioned step 403 describes a method for displaying the display area 1011 of the navigation application 101 on the display interface of the instant chat application 102 by means of a floating window. Another implementation method of the above-mentioned step 403 is described below. In another embodiment, for the navigation application 101 and the instant chat application 102, the view system of the mobile phone 100 may set the navigation application 101 on the second layer, the instant chat application 102 of the mobile phone 100 on the first layer, and the first layer. The layer overlays the second layer. That is, the mobile phone 100 runs the navigation application 101 in the second layer, and the mobile phone 100 runs the display interface of the instant chat application 102 in the first layer. The mobile phone 100 digs out a local area in the display interface of the instant chat application 102. For example, it can be 20mm away from the upper boundary of the display interface of the instant chat application 102 and 10mm from the left boundary, and the size is 20mm×19mm (length×width). The area is cut out so that the user can browse the display interface of the navigation application 101 in the second layer through the display area. The size of the partial area is the same as the size of the display area 1011 . In addition, the mobile phone 100 moves the position of the navigation application 101 in the second layer so that the display area 1011 is aligned with the local area of the instant chat application 102 of the mobile phone 100 in the first layer. In this way, the user can browse the display content of the display area 1011 of the display interface of the navigation application 101 of the mobile phone 100 in the second layer through the partial area of the instant chat application 102, and at the same time, the display area of the navigation application 101 can be displayed in the display area of the navigation application 101 through a similar suspension. The window is displayed on the display interface of the instant chat application 102 of the mobile phone 100 , and the user can also browse the displayed content of the display area of the navigation application 101 in real time.
可以理解，上述的显示区域的大小可以与步骤S402中的显示区域的大小相同，也可以是预先存储在手机100的存储区域内，例如，20mm×10mm(长×宽)。在一些实施例中，上述的显示区域的大小也可以是在导航应用101的显示界面中的动态变化的区域所在的视图的大小，手机100可以在获取该动态变化的区域对应的视图的类型的同时，获取该视图的大小，将其设置为显示区域的大小。It can be understood that the size of the above-mentioned display area may be the same as the size of the display area in step S402, or may be pre-stored in the storage area of the mobile phone 100, for example, 20mm×10mm (length×width). In some embodiments, the size of the above-mentioned display area may also be the size of the view in which the dynamically changing area in the display interface of the navigation application 101 is located, and the mobile phone 100 may obtain the type of the view corresponding to the dynamically changing area. At the same time, get the size of the view and set it to the size of the display area.
可以理解，除了图4中描述的手机100在即时聊天应用102的显示界面内通过悬浮窗的方式显示导航应用101的显示界面的方法。在本申请的其他实施例中，手机100启动了导航应用101、即时聊天应用102以及阅读应用103和桌面104。如图15所示，在用户需要同时浏览导航应用101、即时聊天应用102以及阅读应用103和桌面104的情况下，手机100的窗口管理器通过分割手机100的屏幕成多个窗口，将导航应用101、即时聊天应用102以及阅读应用103和桌面104分屏显示，以一个主要窗口结合多个辅助窗口进行组合，分别显示导航应用101、即时聊天应用102以及阅读应用103和桌面104，用户可以关注每一个窗口中的应用。It can be understood that, except for the method described in FIG. 4 that the mobile phone 100 displays the display interface of the navigation application 101 by means of a floating window in the display interface of the instant chat application 102 . In other embodiments of the present application, the mobile phone 100 starts the navigation application 101 , the instant chat application 102 , the reading application 103 and the desktop 104 . As shown in FIG. 15 , when the user needs to browse the navigation application 101 , the instant chat application 102 , the reading application 103 and the desktop 104 at the same time, the window manager of the mobile phone 100 divides the screen of the mobile phone 100 into multiple windows to divide the navigation application 101. The instant chat application 102, the reading application 103 and the desktop 104 are displayed in split screens, and a main window is combined with multiple auxiliary windows to display the navigation application 101, the instant chat application 102, the reading application 103 and the desktop 104, respectively. Users can follow Applications in every window.
图16示出了本申请的其他实施例中一种在手机100的屏幕中同时显示的两个应用的场景图。手机100的屏幕内上运行有即时聊天应用102以及导航应用101，手机100的视图系统可以将导航应用101的窗口设置为resizable(可调整)类型的应用，在将导航应用101以悬浮窗的方式进行显示的情况下，导航应用101的显示内容的显示风格可以保持与电子设备100的当前的显示界面的显示风格一样。例如，悬浮窗内的导航应用101的字体大小，字体风格等，与即时聊天应用102的字体大小，字体风格相同。FIG. 16 shows a scene diagram of two applications simultaneously displayed on the screen of the mobile phone 100 in other embodiments of the present application. An instant chat application 102 and a navigation application 101 run on the screen of the mobile phone 100. The view system of the mobile phone 100 can set the window of the navigation application 101 as a resizable (adjustable) type of application. In the case of displaying, the display style of the display content of the navigation application 101 may remain the same as the display style of the current display interface of the electronic device 100 . For example, the font size and font style of the navigation application 101 in the floating window are the same as the font size and font style of the instant chat application 102 .
图17(a)至(b)示出了本申请的其他实施例中，在手机100的屏幕内通过悬浮窗的方式显示应用的显示内容的场景。图17(a)示出了视频播放应用105的显示界面。在图17(b)中，手机100的视图系统，将视频播放应用105中正在播放的视频的显示区域1051通过悬浮窗的方式显示在视频播放应用105的显示界面内，同时用户可以通过对悬浮窗执行手势操作，以控制悬浮窗内正在播放的视频。例如，用户可以点击悬浮窗使得正在播放的视频暂停。FIGS. 17( a ) to ( b ) illustrate scenarios in which the display content of the application is displayed in the screen of the mobile phone 100 by means of a floating window in other embodiments of the present application. FIG. 17( a ) shows the display interface of the video playback application 105 . In FIG. 17(b), the view system of the mobile phone 100 displays the display area 1051 of the video being played in the video playback application 105 in the display interface of the video playback application 105 by means of a floating window. The window performs gesture operations to control the video being played in the floating window. For example, the user can click on the floating window to pause the playing video.
图18示出了根据本申请的实施例的电子设备100的结构示意图。FIG. 18 shows a schematic structural diagram of an electronic device 100 according to an embodiment of the present application.
电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195 and so on. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
可以理解的是，本申请实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中，电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组 合实现。It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software or a combination of software and hardware.
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(APPlication processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (APPlication processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
在一些实施例中，处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对电子设备100的结构限定。在本申请另一些实施例中，电子设备100也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
充电管理模块140用于从充电器接收充电输入。电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，显示屏194，摄像头193，和无线通信模块160等供电。The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.
电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。 Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。The mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
调制解调处理器可以包括调制器和解调器。其中，调制器用于将待发送的低频基带信号调制成中高频信号。The modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency  modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等的无线通信的解决方案。The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
电子设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备100可以包括1个或N个显示屏194，N为大于1的正整数。The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the electronic device 100 may include one or N display screens 194 , where N is a positive integer greater than one.
电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。在一些实施例中，摄像头193可以是本申请实施例中的摄像头102，用采集当前环境的场景图像。The electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like. In some embodiments, the camera 193 may be the camera 102 in the embodiments of the present application, and is used to collect scene images of the current environment.
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将音乐，视频等文件保存在外部存储卡中。The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据，电话本等)等。在本申请的实施例中，内部存储器121存储视图类型的列表，视图类型的列表用于确定属于动态变化的区域的视图。Internal memory 121 may be used to store computer executable program code, which includes instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like. In the embodiment of the present application, the internal memory 121 stores a list of view types, and the list of view types is used to determine the views belonging to the dynamically changing area.
电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中，音频模块170可以设置于处理器110中，或将音频模块170的部分功能模块设置于处理器110中。The audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
扬声器170A，也称“喇叭”，用于将音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐，或收听免提通话。Speaker 170A, also referred to as a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.
受话器170B，也称“听筒”，用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时，可以通过将受话器170B靠近人耳接听语音。The receiver 170B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be answered by placing the receiver 170B close to the human ear.
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130，也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform，OMTP)标准接口，美国蜂窝电信工业协会(cellular telecommunications industry association of the USA，CTIA)标准接口。The earphone jack 170D is used to connect wired earphones. The earphone interface 170D may be the USB interface 130, or may be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
指纹传感器180H用于采集指纹。电子设备100可以利用采集的指纹特性实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等。The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.
触摸传感器180K，也称“触控器件”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的手势操作。触摸传感器可以将检测到的手势操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与手势操作相关的视觉输出。在本申请的实施例中，触摸传感器180K用于接收用户在触控屏上执行的手势操作。例如，触摸传感器180K可以确定用户执行了在应用的显示界面上选取一个局部区域的手势操作以及用户对应用的显示界面的显示内容进行改变的手势操作。Touch sensor 180K, also called "touch device". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect gesture operations acting on or near it. The touch sensor can pass the detected gesture operation to the application processor to determine the type of touch event. Visual output related to the gesture operation may be provided via display screen 194 . In the embodiment of the present application, the touch sensor 180K is used to receive gesture operations performed by the user on the touch screen. For example, the touch sensor 180K can determine that the user has performed a gesture operation of selecting a local area on the display interface of the application and a gesture operation of changing the display content of the display interface of the application by the user.
按键190包括开机键，音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入，产生与电子设备100的用户设置以及功能控制有关的键信号输入。The keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. Touch buttons are also possible. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .
马达191可以产生振动提示。马达191可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的手势操作，可以对应不同的振动反馈效果。作用于显示屏194不同区域的手势操作，马达191也可对应不同的振动反馈效果。不同的应用场景(例如：时间提醒，接收信息，闹钟，游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。Motor 191 can generate vibrating cues. The motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback. For example, gesture operations acting on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. For gesture operations acting on different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。The indicator 192 can be an indicator light, which can be used to indicate a charging state, a change in power, and can also be used to indicate a message, a missed call, a notification, and the like.
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195，或从SIM卡接口195拔出，实现和电子设备100的接触和分离。The SIM card interface 195 is used for connecting a SIM card. The SIM card can be contacted and separated from the electronic device 100 by inserting into the SIM card interface 195 or pulling out from the SIM card interface 195 .
应当理解的是，虽然在本文中可能使用了术语“第一”、“第二”等等来描述各个特征，但是这些特征不应当受这些术语限制。使用这些术语仅仅是为了进行区分，而不能理解为指示或暗示相对重要性。举例来说，在不背离示例性实施例的范围的情况下，第一特征可以被称为第二特征，并且类似地第二特征可以被称为第一特征。It will be understood that, although the terms "first," "second," etc. may be used herein to describe various features, these features should not be limited by these terms. These terms are used for distinction only and should not be construed to indicate or imply relative importance. For example, a first feature could be termed a second feature, and, similarly, a second feature could be termed a first feature, without departing from the scope of example embodiments.
此外，各种操作将以最有助于理解说明性实施例的方式被描述为多个彼此分离的操作；然而，描述的顺序不应被解释为暗示这些操作必须依赖描述的顺序，其中的许多操作可以被并行地、并发地或者同时实施。此外，各项操作的顺序也可以被重新安排。当所描述的操作完成时，所述处理可以被终止，但是还可以具有未包括在附图中的附加操作。所述处理可以对应于方法、函数、规程、子例程、子程序等等。Furthermore, various operations will be described as multiple operations separate from each other in a manner that is most helpful in understanding the illustrative embodiments; however, the order of description should not be construed to imply that these operations are necessarily dependent on the order of description, many of which Operations may be performed in parallel, concurrently, or simultaneously. In addition, the order of operations can also be rearranged. The process may be terminated when the described operations are complete, but may also have additional operations not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, subroutines, and the like.
说明书中对“一个实施例”，“实施例”，“说明性实施例”等的引用表示所描述的实施例可以包括特定特征、结构或性质，但是每个实施例也可能或不是必需包括特定的特征、结构或性质。而且，这些短语不一定是针对同一实施例。此外，当结合具体实施例描述特定特征，本领域技术人员的知识能够影响到这些特征与其他实施例的结合，无论这些实施例是否被明确描述。References in the specification to "one embodiment," "an embodiment," "an illustrative embodiment," etc. mean that the described embodiment may include a particular feature, structure, or property, but each embodiment may or may not include a particular characteristics, structure or properties. Moreover, these phrases are not necessarily referring to the same embodiment. Furthermore, when certain features are described in conjunction with specific embodiments, the knowledge of those skilled in the art can influence the combination of those features with other embodiments, whether or not those embodiments are explicitly described.
除非上下文另有规定，否则术语“包含”、“具有”和“包括”是同义词。短语“A/B”表示“A或B”。短语“A和/或B”表示“(A)、(B)或(A和B)”。Unless the context dictates otherwise, the terms "comprising", "having" and "including" are synonyms. The phrase "A/B" means "A or B". The phrase "A and/or B" means "(A), (B) or (A and B)".
如本文所使用的，术语“模块”可以指代，作为其中的一部分，或者包括：用于运行一个或多个软件或固件程序的存储器(共享、专用或组)，专用集成电路(ASIC)，电子电路和/或处理器(共享、专用或组)，组合逻辑电路，和/或提供所述功能的其他合适组件。As used herein, the term "module" may refer to, being a part of, or including: memory (shared, dedicated, or bank) for running one or more software or firmware programs, an application specific integrated circuit (ASIC), Electronic circuits and/or processors (shared, dedicated, or group), combinational logic circuits, and/or other suitable components that provide the described functionality.
在附图中，可能以特定布置和/或顺序示出了一些结构或方法特征。然而，应当理解的是，这样的特定布置和/或排序不是必需的。而是，在一些实施例中，这些特征可以以不同于说明性附图中所示的方式和/或顺序来进行说明。另外，特定附图中所包含得结构或方法特征并不意味着所有实施例都需要包含这样的特征，在一些实施例中，可以不包含这些特征，或者可以将这些特征与其他特征进行组合。In the drawings, some structural or method features may be shown in specific arrangements and/or sequences. It should be understood, however, that no such specific arrangement and/or ordering is required. Rather, in some embodiments, these features may be described in a manner and/or order different from that shown in the illustrative figures. Additionally, the inclusion of structural or method features in a particular figure does not imply that all embodiments require the inclusion of such features, and in some embodiments such features may be excluded or combined with other features.
上面结合附图对本申请的实施例做了详细说明，但本申请技术方案的使用不仅仅局限于本专利实施例中提及的各种应用，各种结构和变型都可以参考本申请技术方案轻易地实施，以达到本文中提及的各种有益效果。在本领域普通技术人员所具备的知识范围内，在不脱离本申请宗旨的前提下做出的各种变化，均应归属于本申请专利涵盖范围。The embodiments of the present application are described in detail above in conjunction with the accompanying drawings, but the application of the technical solutions of the present application is not limited to the various applications mentioned in the embodiments of the present patent, and various structures and modifications can be easily referred to the technical solutions of the present application. implemented in order to achieve the various beneficial effects mentioned herein. Within the scope of knowledge possessed by those of ordinary skill in the art, various changes made without departing from the purpose of the present application shall all belong to the scope of the patent of the present application.

Claims (18)

  1. 一种应用显示方法，其特征在于，包括：An application display method, comprising:
    在电子设备的屏幕上显示第一应用的第一显示界面；displaying the first display interface of the first application on the screen of the electronic device;
    在所述屏幕上显示第二应用的第二显示界面和第一应用的第一显示区域，其中，所述第二显示界面的部分区域被所述第一显示区域遮挡，并且所述第一显示区域为所述第一显示界面的一部分。A second display interface of the second application and a first display area of the first application are displayed on the screen, wherein a partial area of the second display interface is blocked by the first display area, and the first display The area is a part of the first display interface.
  2. 根据权利要求1所述的方法，其特征在于，在检测到用户选择进行多应用显示的情况下，在所述屏幕上显示第二应用的第二显示界面和第一应用的第一显示区域。The method according to claim 1, characterized in that, in the case of detecting that the user selects to display multiple applications, displaying the second display interface of the second application and the first display area of the first application on the screen.
  3. 根据权利要求2所述的方法，其特征在于，所述用户选择多应用显示包括用户点击用于悬浮显示所述第一应用的图标。The method according to claim 2, wherein the selection of the multi-application display by the user comprises the user clicking on an icon used to display the first application in a floating manner.
  4. 根据权利要求1所述的方法，其特征在于，还包括：The method of claim 1, further comprising:
    从所述第一显示界面中选择出所述第一显示区域。The first display area is selected from the first display interface.
  5. 根据权利要求1所述的方法，其特征在于，还包括：The method of claim 1, further comprising:
    提示用户从所述第一显示界面中选择出要进行多应用显示的第一显示区域；prompting the user to select a first display area to be displayed with multiple applications from the first display interface;
    根据用户的选择结果确定所述第一显示区域。The first display area is determined according to the user's selection result.
  6. 根据权利要求5所述的方法，其特征在于，所述根据用户的选择结果确定所述第一显示区域，包括：The method according to claim 5, wherein the determining the first display area according to the user's selection result comprises:
    根据用户在所述第一显示界面上的手势操作形成的轨迹确定所述第一显示区域。The first display area is determined according to a trajectory formed by the user's gesture operation on the first display interface.
  7. 根据权利要求6所述的方法，其特征在于，在所述手势操作形成的轨迹是非闭合区域的情况下，将所述非闭合区域补全后确定所述第一显示区域。The method according to claim 6, wherein, when the trajectory formed by the gesture operation is a non-closed area, the first display area is determined after completing the non-closed area.
  8. 根据权利要求1所述的方法，其特征在于，还包括：The method of claim 1, further comprising:
    响应于用户对所述第一显示区域的调整操作，调所述第一显示区域的大小和位置，其中，用户的所述调整操作包括下列中的至少一项：In response to a user's adjustment operation on the first display area, the size and position of the first display area are adjusted, wherein the user's adjustment operation includes at least one of the following:
    移动所述第一显示区域；moving the first display area;
    扩大所述第一显示区域；expanding the first display area;
    缩小所述第一显示区域。Zoom out the first display area.
  9. 根据权利要求1所述的方法，其特征在于，还包括：The method of claim 1, further comprising:
    获取所述第一显示界面中显示内容发生变化的区域，确定所述显示内容变化的区域为所述第一显示区域。Acquire an area where the display content changes in the first display interface, and determine the area where the display content changes as the first display area.
  10. 根据权利要求9所述的方法，其特征在于，在预设的时间段内，检测区域的画面的变化数量，在所述变化数量超过预设的变化阈值的情况下，确定所述区域为显示内容发生变化的区域。The method according to claim 9, characterized in that, within a preset time period, the number of changes of the picture in the area is detected, and when the number of changes exceeds a preset change threshold, it is determined that the area is displayed The area where the content changes.
  11. 根据权利要求1所述的方法，其特征在于，所述第一显示区域通过悬浮窗的方式显示在所述屏幕上。The method according to claim 1, wherein the first display area is displayed on the screen by means of a floating window.
  12. 根据权利要求11所述的方法，其特征在于，通过以下方式将所述第一显示区域通过悬浮窗的方式显示在所述屏幕上：The method according to claim 11, wherein the first display area is displayed on the screen by means of a floating window in the following manner:
    设置所述第一显示界面于第一图层，所述第二显示界面于第二图层，所述第一图层叠加于所述第二图层上，并且所述第一图层上的第一显示界面中除第一显示区域之外的区域设置为透明显示。Set the first display interface on the first layer, the second display interface on the second layer, the first layer is superimposed on the second layer, and the Areas other than the first display area in the first display interface are set to be transparently displayed.
  13. 根据权利要求12所述方法，其特征在于，响应于用户在所述第一显示区域内的第一改变操作，在所述第一显示区域内将第一显示内容改变为第二显示内容。13. The method of claim 12, wherein, in response to a user's first change operation in the first display area, the first display content is changed to the second display content in the first display area.
  14. 根据权利要求12所述方法，其特征在于，接收用户在所述第一显示区域之外的区域的第二改变操作，将所述第二改变操作对应的指令传递至所述第二图层。The method according to claim 12, wherein a second change operation of a user in an area outside the first display area is received, and an instruction corresponding to the second change operation is transmitted to the second layer.
  15. 根据权利要求14所述方法，其特征在于，响应于所述第二改变操作对应的指令，于所述第二显示界面内将第三显示内容改变为第四显示内容。15. The method according to claim 14, wherein in response to an instruction corresponding to the second change operation, the third display content is changed to the fourth display content in the second display interface.
  16. 根据权利要求1所述的方法，其特征在于，所述第一显示区域通过画中画的方式显示在所述屏幕上。The method according to claim 1, wherein the first display area is displayed on the screen in a picture-in-picture manner.
  17. 一种电子设备，其特征在于，包括：An electronic device, comprising:
    存储器，存储有指令；memory, storing instructions;
    处理器，所述处理器和存储器耦合，当所述存储器存储的程序指令被所述处理器执行时使得所述电子设备执行权利要求1至16中任一项所述的应用的显示方法。A processor, which is coupled to a memory, and when the program instructions stored in the memory are executed by the processor, cause the electronic device to execute the application display method of any one of claims 1 to 16 .
  18. 一种可读介质，所述可读介质中存储有指令，其特征在于，当所述指令在所述可读介质上运行时，使得所述可读介质执行如权利要求1至16中任一项所述的应用的显示方法。A readable medium having instructions stored in the readable medium, characterized in that, when the instructions are executed on the readable medium, the readable medium is caused to execute any one of claims 1 to 16 The display method of the application described in the item.
PCT/CN2022/074024 2021-02-05 2022-01-26 Electronic device and display method for application thereof, and medium WO2022166713A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110162248.8 2021-02-05
CN202110162248.8A CN114879880A (en) 2021-02-05 2021-02-05 Electronic device, display method and medium for application thereof

Publications (1)

Publication Number Publication Date
WO2022166713A1 true WO2022166713A1 (en) 2022-08-11

Family

ID=82667956

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/074024 WO2022166713A1 (en) 2021-02-05 2022-01-26 Electronic device and display method for application thereof, and medium

Country Status (2)

Country Link
CN (1) CN114879880A (en)
WO (1) WO2022166713A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117632329A (en) * 2022-08-19 2024-03-01 荣耀终端有限公司 Display method, storage medium and electronic device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106126236A (en) * 2016-06-24 2016-11-16 北京奇虎科技有限公司 The multi-screen display method of terminal screen, device and terminal
CN106909268A (en) * 2015-12-23 2017-06-30 北京奇虎科技有限公司 A kind of method and device that APP suspended windows are set on equipment desktop
US20190272086A1 (en) * 2018-03-01 2019-09-05 Samsung Electronics Co., Ltd Devices, methods, and computer program for displaying user interfaces
CN110243386A (en) * 2019-07-15 2019-09-17 腾讯科技（深圳）有限公司 Navigation information display methods, device, terminal and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106909268A (en) * 2015-12-23 2017-06-30 北京奇虎科技有限公司 A kind of method and device that APP suspended windows are set on equipment desktop
CN106126236A (en) * 2016-06-24 2016-11-16 北京奇虎科技有限公司 The multi-screen display method of terminal screen, device and terminal
US20190272086A1 (en) * 2018-03-01 2019-09-05 Samsung Electronics Co., Ltd Devices, methods, and computer program for displaying user interfaces
CN110243386A (en) * 2019-07-15 2019-09-17 腾讯科技（深圳）有限公司 Navigation information display methods, device, terminal and storage medium

Also Published As

Publication number Publication date
CN114879880A (en) 2022-08-09

Similar Documents

Publication Publication Date Title
US11893219B2 (en) Method for quickly invoking small window when video is displayed in full screen, graphic user interface, and terminal
CN110471639B (en) Display method and related device
US20220269405A1 (en) Floating Window Management Method and Related Apparatus
WO2021129326A1 (en) Screen display method and electronic device
US11797145B2 (en) Split-screen display method, electronic device, and computer-readable storage medium
US11687235B2 (en) Split-screen method and electronic device
WO2020221063A1 (en) Method of switching between parent page and subpage, and related device
CN113553014A (en) Application interface display method under multi-window screen projection scene and electronic equipment
WO2022068819A1 (en) Interface display method and related apparatus
WO2021175272A1 (en) Method for displaying application information and related device
CN113132526B (en) Page drawing method and related device
CN114077365A (en) Split screen display method and electronic equipment
US20220214891A1 (en) Interface display method and electronic device
WO2022161119A1 (en) Display method and electronic device
WO2022166713A1 (en) Electronic device and display method for application thereof, and medium
WO2021042881A1 (en) Message notification method and electronic device
CN115291779A (en) Window control method and device
US20220291832A1 (en) Screen Display Method and Electronic Device
CN115567666B (en) Screen recording method, electronic device and readable storage medium
EP4210308A1 (en) Message prompting method and electronic device
US11972106B2 (en) Split screen method and apparatus, and electronic device
US20230350569A1 (en) Split screen method and apparatus, and electronic device
US20240086035A1 (en) Display Method and Electronic Device
JP2024513773A (en) Display methods, electronic devices, storage media, and program products
CN117707561A (en) Card data updating method, electronic device and computer readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22748992

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22748992

Country of ref document: EP

Kind code of ref document: A1