WO2021129253A1 - 显示多窗口的方法、电子设备和系统 - Google Patents

显示多窗口的方法、电子设备和系统 Download PDF

Info

Publication number
WO2021129253A1
WO2021129253A1 PCT/CN2020/130112 CN2020130112W WO2021129253A1 WO 2021129253 A1 WO2021129253 A1 WO 2021129253A1 CN 2020130112 W CN2020130112 W CN 2020130112W WO 2021129253 A1 WO2021129253 A1 WO 2021129253A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
window
application
interface
information
Prior art date
Application number
PCT/CN2020/130112
Other languages
English (en)
French (fr)
Inventor
朱登奎
陈晨
徐辉
曹文砚
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to JP2022531601A priority Critical patent/JP2023503679A/ja
Priority to US17/770,372 priority patent/US20220398059A1/en
Priority to EP20905135.8A priority patent/EP4040277A4/en
Publication of WO2021129253A1 publication Critical patent/WO2021129253A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/16—Use of wireless transmission of display information

Definitions

  • the embodiments of the present application relate to the field of electronic technology, and in particular, to a method, electronic device, and system for displaying multiple windows.
  • the screen content and data can be easily shared between the PC and the mobile phone through the screen sharing software, and the user can receive the mobile phone through the PC Notify events on the PC, and use the various functions of the phone on the PC.
  • the user can receive notifications from the mobile phone through the PC, such as making a call through the PC, easily answering the call through a pop-up window, or sending and receiving messages; or, the user can view the incoming call alert; or , Users can realize file sharing between PC and mobile phone.
  • users can quickly share files and text content between PCs and mobile phones by dragging and dropping.
  • the user inserts a photo from the mobile phone into a Word document of the PC, or inserts a file on the PC on the mobile phone while sending a text message or e-mail.
  • the screen sharing software mainly uses mirroring to display all content (such as an application interface) displayed on the screen of the mobile phone in one window of the PC, and cannot achieve multi-window display.
  • This application provides a method, electronic device, and system for displaying multiple windows.
  • the method can display multiple windows of a mobile phone on a PC.
  • the user can execute the mobile phone application through the corresponding window of each mobile phone application displayed on the PC. Operation, thereby improving office efficiency such as file sharing, and improving user experience.
  • a method for displaying multiple windows is provided, which is applied to a system including a first electronic device and a second electronic device that communicate with each other.
  • the method includes: the first electronic device receives the display area of the second electronic device Size information; the first electronic device runs the first application and displays the first interface of the first application; the first electronic device determines the first interface according to the size information of the display area of the second electronic device and the size information corresponding to the first interface The position information of the first window of an interface in the display area of the second electronic device; the first electronic device sends the position information of the first window and the display content information of the first interface to the second electronic device; the second electronic device The device displays the first interface in the first window according to the received position information of the first window and the display content information of the first interface; if the second electronic device detects the first operation, in response to the first operation, Send an instruction to start the second application to the first electronic device; the first electronic device starts the second application according to the received instruction to start the second application; the first electronic device starts the second
  • displaying multiple windows can be understood as “displaying multiple interfaces”, and each window displays a different interface.
  • the PC displays multiple interfaces of the mobile phone through different windows, such as the first interface and the second interface.
  • Each interface is an interface that can be independently controlled. For example, the operation of the user on the first interface and the operation of the second interface are independent of each other. .
  • the first electronic device and the second electronic device may communicate with each other in a variety of different ways, for example, through a connection or by means of a future communication technology to communicate to transmit data.
  • the connection mode may include multiple different connection modes such as wired connection or wireless connection.
  • the first electronic device and the second electronic device may be connected through a USB data cable; the wireless connection between the first electronic device and the second electronic device may be through the establishment of a Wi-Fi connection or near field communication. Proximity connection, Bluetooth scan code connection, etc.
  • the first electronic device and the second electronic device can also use future communication technologies, for example, by installing different or the same applications on a mobile phone and a PC, and transmitting data by means of a 5G communication network. There is no limit to the connection between them.
  • the sequence of the first electronic device's action of receiving the size information of the display area of the second electronic device and the first electronic device's action of running the first application and displaying the first interface of the first application may first run the first application and display the first interface of the first application.
  • the first electronic device may be triggered from the first interface. 2.
  • the action of the electronic device to obtain the size information of the display area of the second electronic device; or, the second electronic device first sends the size information of the display area of the second electronic device to the first electronic device, and the first electronic device runs the first electronic device. Apply and display the first interface of the first application, and perform other actions afterwards.
  • the first electronic device may display the second interface of the second application when starting the second application according to receiving the instruction to start the second application sent by the second electronic device, that is, the first electronic device is running in the foreground The second application; or the second interface of the second application is not displayed, that is, the first electronic device runs the second application in the background, which is not limited in the embodiment of the present application.
  • first application and the second application may be applications installed in the first electronic device, or fast applications that can be run instantly, which is not limited in the embodiment of the present application.
  • the interface of the mobile phone can be displayed through the PC.
  • multiple windows can be displayed on the PC, and each window is used to display a different application; or, the user can start the mobile phone application on the PC and display the application in a separate window.
  • Mobile phone applications this method can improve office efficiency such as file sharing, and can implement mobile phone applications on PCs, which improves user experience.
  • the method further includes: the first electronic device sends the first information of the first application and the second information of the second application to the second electronic device, the The first information of the first application includes at least one of the name, identification ID, and icon information of the first application, and the second information of the second application includes the name, identification ID, and icon information of the second application. At least one; after receiving the first information of the first application and the second information of the second application, the second electronic device automatically displays a third interface, the third interface including the first information of the first application and the second information The second information of the application; or after detecting the second operation of the user, the second electronic device displays the third interface according to the first information of the first application and the second information of the second application.
  • the PC is triggered to send a request to obtain an application to the mobile phone, which is used to request information about the application of the mobile phone, such as the first information of the first application and the second application The second information.
  • the application information of the mobile phone may include at least one of the names, identification (ID), and icons of all applications of the mobile phone.
  • the PC After the PC receives the information of the application, it displays the application on the phone window of the PC according to the name, ID, and icon of each application, and then displays all the applications of the phone.
  • the first window is close to the right edge of the display area of the second electronic device.
  • the second window is located on the left side of the first window and does not overlap with the first window.
  • the second window is located on an upper layer of the first window.
  • the position information of the first window may also include display level information of the first window
  • the position information of the second window may also include display level information of the second window
  • the display of the second window is located one level above the first window.
  • the display level information of the first window is sent by the first electronic device to the second electronic device, and the second electronic device determines which level the first window should be displayed on according to the display level information of the first window.
  • the position information of the first window includes: the coordinate information of the first vertex of the first window, the length information of the first window and the The width information of the first window; or the position information of the first window includes: coordinate information of the four vertices of the first window.
  • the position information of the second window is similar to the position information of the first window. Specifically, the position information of the second window includes: the coordinate information of the second vertex of the second window, the length information of the second window and the width information of the second window; or the position information of the second window includes: the The coordinate information of the four vertices of the second window.
  • the size information of the first window is determined by the first electronic device according to the size information corresponding to the first interface; and the first electronic device is determined according to the first interface 2.
  • the method further includes: The device obtains the size information of the display area of the first electronic device, and determines that the size information of the display area of the first electronic device is the size information corresponding to the first interface, or the size information corresponding to the first interface is the display of the first electronic device The product of the size information of the area and the first multiple, where the first multiple is greater than 0 and not equal to 1.
  • the first electronic device may determine the size information of the first window according to the size of the first interface displayed by itself.
  • the size of the first window is the same as the size of the first interface displayed by itself; or the size of the first interface displayed by itself is enlarged or reduced according to a certain ratio to obtain the size information of the first window.
  • the size information of the first window is determined by the first electronic device according to the size information corresponding to the first interface; and the first electronic device is determined according to the first interface 2.
  • the method further includes: The device obtains the size information of the first interface when displayed on the first electronic device from the configuration information of the first application, and determines that the size information of the first interface when displayed on the first electronic device is corresponding to the first interface Or the first electronic device obtains the size information displayed on the second electronic device of the first interface from the network device, and determines the size information displayed on the second electronic device of the first interface as corresponding to the first interface Size information.
  • the first electronic device may obtain the size information of the first interface displayed by the first electronic device in different ways. For example, when the first application is installed, it is obtained from the configuration information of the first application. In other words, the interface information of the first application on the first electronic device can be queried locally; or the network device can be requested to query the interface information of the second electronic device. Then obtain the size information of the first interface displayed by itself.
  • the first window includes the first interface and the first menu bar; and/or the second window includes the second interface and the second menu bar .
  • the second menu bar includes a close button
  • the method further includes: The second electronic device detects the user's operation of the close button, the second electronic device closes the second window, and sends an instruction to close the second application to the first electronic device; the first electronic device closes the second application according to the Command to close the second application.
  • the method further includes: if the second electronic device detects that the user selects With the operation of the first window, the second electronic device switches the first window to the uppermost display.
  • the second menu bar includes a maximize button
  • the method further includes : If the second electronic device detects the user's operation of the maximize button, the second electronic device displays the second window in full screen.
  • the method further includes: if the first electronic device detects that the user closes The instruction of the second application; the first electronic device closes the second application and notifies the second electronic device to close the second window; the second electronic device closes the second window according to the notification of the first electronic device.
  • the method further includes: the second electronic device detects a selection and dragging operation on the second window, and the second window is selected by the first The location moves to the second location; the second electronic device sends the second location information and the second application information to the first electronic device; the first electronic device receives the second location information and the second application information sent by the second electronic device According to the information of the second application, the second application is determined according to the information of the second application, and the display position of the display content of the second interface is determined according to the information of the second location.
  • each application window displayed on the PC can receive user operations, such as closing, moving, zooming, maximizing and minimizing the window; and the user can display every application on the PC.
  • operations on the mobile phone application are performed, for example, the user clicks on controls such as play music, next song, etc. in the music application window of the PC to control the music playing process.
  • the user's operation of the mobile phone application on the PC does not affect the user's use of other functions of the mobile phone, such as the aforementioned scene where the user uses the mobile phone to play music while using the PC to watch video.
  • the user can perform any control operation of the application.
  • the operation can be returned to the mobile phone, and the mobile phone executes the result of the operation, and then transmits the execution result to the PC, so that The result of the operation performed by the mobile phone can be synchronized in the window of the application on the PC, which improves the use efficiency and use experience of the mobile phone application.
  • the first electronic device starts the second application After that, the method further includes: the first electronic device sends the audio data of the second application to the second electronic device; and the second electronic device plays the audio data of the second application.
  • the user can display the music application window on the PC by playing music on the mobile phone.
  • the mobile phone sends the audio data to the PC, and the PC plays the audio data.
  • the actual playback of the music audio can be based on the principle of "who starts it and plays it". Specifically, for the music application that the user clicks on the mobile phone, the device that actually plays the music audio is the mobile phone. The user plays music through the music application on the mobile phone window of the PC. At this time, the device that actually plays the music audio is the PC.
  • the first electronic device sends the position information of the first window and the display content information of the first interface to the second electronic device, including: The first electronic device encodes the position information of the first window and the display content information of the first interface to generate a first video stream, and sends the first video stream to the second electronic device; the second electronic device receives the first electronic device The first video stream sent, the first video stream is decoded to obtain the position information of the first window and the display content information of the first interface; and the first electronic device is the position information of the second window and the second interface
  • Sending the display content information of the second electronic device to the second electronic device includes: the first electronic device encodes the position information of the second window and the display content information of the second interface to generate a second video stream, which is sent to the second electronic device; The electronic device receives the second video stream sent by the first electronic device, and decodes the second video stream to obtain the position information of the second window and the display content information of the second
  • the method for displaying multiple windows can display the mobile phone application in the mobile phone window of the PC, or in the menu list of the PC, in the case that the PC does not install the mobile phone application .
  • the method can realize the integration of the mobile phone and the PC system, so that the user can call the application installed on the mobile phone from the system menu of the PC.
  • this method can implement multiple mobile phone applications simultaneously and independently on the PC, each application can display an independent window on the PC, multiple windows corresponding to multiple applications are displayed on the interface of the PC at the same time, and multiple mobile phones are running.
  • This application does not affect the user's use of other functions of the phone.
  • the user can use the mobile phone's video application and music application on the PC, and can use the mobile phone to send and receive text messages or make calls at the same time; or the user can operate the mobile phone by using peripheral input devices such as the mouse and keyboard, which completely retains the user's usage habits without frequent Switch between the two devices; run the mobile phone application through the PC's mobile phone window, which improves the efficiency of file review, sharing, and office, and improves the user experience.
  • a method for displaying multiple windows is provided, which is applied to a system including a first electronic device and a second electronic device that communicate with each other.
  • the method includes: the first electronic device receives the display area of the second electronic device Size information; the first electronic device runs the first application and displays the first interface of the first application; the first electronic device determines the first interface according to the size information of the display area of the second electronic device and the size information corresponding to the first interface The position information of the first window of an interface in the display area of the second electronic device; the first electronic device sends the position information of the first window and the display content information of the first interface to the second electronic device; The device receives the instruction to start the second application sent by the second electronic device to start the second application; the first electronic device according to the size information of the display area of the second electronic device and the size information corresponding to the second interface of the second application, Determine the location information of the second window of the second interface in the display area of the second electronic device, the first window and the second window are different windows; the first electronic device
  • the method further includes: the first electronic device sends the first information of the first application and the second information of the second application to the second electronic device, the The first information of the first application includes at least one of the name, identification ID, and icon information of the first application, and the second information of the second application includes the name, identification ID, and icon information of the second application. at least one.
  • the first window is close to the right edge of the display area of the second electronic device.
  • the second window is located on the left side of the first window and does not overlap with the first window.
  • the second window is located on an upper layer of the first window.
  • the position information of the first window includes: the coordinate information of the first vertex of the first window, the length information of the first window and the The width information of the first window; or the position information of the first window includes: coordinate information of the four vertices of the first window.
  • the size information of the first window is determined by the first electronic device according to the size information corresponding to the first interface; and the first electronic device is determined according to the first interface 2.
  • the method further includes: The device obtains the size information of the display area of the first electronic device, and determines that the size information of the display area of the first electronic device is the size information corresponding to the first interface, or the size information corresponding to the first interface is the display of the first electronic device The product of the size information of the area and the first multiple, where the first multiple is greater than 0 and not equal to 1.
  • the size information of the first window is determined by the first electronic device according to the size information corresponding to the first interface; and the first electronic device is determined according to the first interface 2.
  • the method further includes: The device obtains the size information of the first interface when displayed on the first electronic device from the configuration information of the first application, and determines that the size information of the first interface when displayed on the first electronic device is corresponding to the first interface Or the first electronic device obtains the size information displayed on the second electronic device of the first interface from the network device, and determines the size information displayed on the second electronic device of the first interface as corresponding to the first interface Size information.
  • the first window includes the first interface and the first menu bar; and/or the second window includes the second interface and the second interface. Menu Bar.
  • the second menu bar includes a close button
  • the method further includes: the first electronic device receives a second electronic device sent by the second electronic device to close the second application The instruction of detecting the user's operation of the close button, the second electronic device closes the second window, and in response to the instruction to close the second application to the first electronic device, the first electronic device closes the second application.
  • the method further includes: if the first electronic device detects a user's instruction to close the second application; the first electronic device closes the second application , And send an instruction to close the second window to the second electronic device.
  • the first electronic device starts the second application After that, the method further includes: the first electronic device sends the audio data of the second application to the second electronic device.
  • a method for displaying multiple windows is provided, which is applied to a system including a first electronic device and a second electronic device that communicate with each other.
  • the method includes: the second electronic device receives the first electronic device sent by the first electronic device.
  • the position information of the window and the display content information of the first interface, the first interface is the interface that the first electronic device runs and displays the first application;
  • the second electronic device according to the position information of the first window and the display of the first interface Content information, the first interface is displayed in the first window of the display area of the second electronic device; if the second electronic device detects the first operation, in response to the first operation, send to the first electronic device to start the second application
  • the second electronic device receives the location information of the second window and the display content information of the second interface sent by the first electronic device, the second interface is the interface of the second application, the first window and the second window Is a different window;
  • the second electronic device displays the second interface in the second window of the display area of the second electronic device according to the location information of
  • the method further includes: a second electronic device receiving the first information of the first application and the second information of the second application sent by the first electronic device,
  • the first information of the first application includes at least one of the name, identification ID, and icon information of the first application
  • the second information of the second application includes the name, identification ID, and icon information of the second application.
  • the second electronic device automatically displays a third interface that includes the first information of the first application and the second information of the second application; or the second electronic device detects the second operation of the user Then, the third interface is displayed according to the first information of the first application and the second information of the second application.
  • the first window is close to the right edge of the display area of the second electronic device.
  • the second window is located on the left side of the first window and does not overlap with the first window.
  • the second window is located on an upper layer of the first window.
  • the position information of the first window includes: the coordinate information of the first vertex of the first window, the length information of the first window and the The width information of the first window; or the position information of the first window includes: coordinate information of the four vertices of the first window.
  • the size information of the first window is determined by the first electronic device according to the size information corresponding to the first interface; and the first interface corresponds to The size information of is the size information of the display area of the first electronic device, or the size information corresponding to the first interface is the product of the size information of the display area of the first electronic device and the first multiple, and the first multiple is greater than 0 and not Equal to 1.
  • the size information of the first window is determined by the first electronic device according to the size information corresponding to the first interface; and the first interface corresponds to The size information of the first interface is the size information when the first interface is displayed on the first electronic device, or the size information corresponding to the first interface is that the first electronic device obtains from the network device the first interface displayed on the second electronic device Size Information.
  • the first window includes the first interface and the first menu bar; and/or the second window includes the second interface and the second interface. Menu Bar.
  • the second menu bar includes a close button
  • the method further includes: If the second electronic device detects the user's operation of the close button, the second electronic device closes the second window and sends an instruction to close the second application to the first electronic device.
  • the method further includes: if the second electronic device detects that the user selects With the operation of the first window, the second electronic device switches the first window to the uppermost display.
  • the second menu bar includes a maximize button
  • the method further includes : If the second electronic device detects the user's operation of the maximize button, the second electronic device displays the second window in full screen.
  • the method further includes: if the second electronic device receives the first An instruction to close the second window sent by the electronic device; in response to the instruction to close the second window, the second electronic device closes the second window.
  • the method further includes: a second electronic device The audio data of the second application sent by the first electronic device is received, and the audio data of the second application is played.
  • a method for displaying multiple windows is provided, which is applied to a system including a first electronic device and a second electronic device that communicate with each other.
  • the method includes: the first electronic device runs a first application and displays the first electronic device. The first interface of the application; the first electronic device sends the size information corresponding to the first interface and the display content information of the first interface to the second electronic device; the second electronic device according to the size information of the display area of the second electronic device and The size information corresponding to the first interface determines the position information of the first window, and displays the first interface in the first window according to the position information of the first window and the display content information of the first interface; if the second electronic The device detects the first operation, and in response to the first operation, sends an instruction to start the second application to the first electronic device; the first electronic device starts the second application according to the instruction to start the second application; the first electronic device The size information corresponding to the second interface of the second application and the display content information of the second interface are sent to the second electronic device; the second
  • the first electronic device sends the position information of the first window and the display content information of the first interface to the second electronic device, and the second electronic device displays the first window according to the instructions of the first electronic device.
  • the first electronic device may not acquire the size information of the display area of the second electronic device, but only send the display content information of the first interface of the first electronic device, and the second electronic device determines the position information of the first window , And display the first window.
  • the display of the second window can also be determined by the second electronic device, which will not be repeated here.
  • the second electronic device can determine the display position of the first window and the second window according to its own application usage, interface content, etc., which can better adapt to the use process of the second electronic device and reduce the need for the second electronic device. The impact of the use of and improve the user experience.
  • the present application provides a device included in an electronic device, and the device has the function of realizing the foregoing aspects and the behavior of the electronic device in the possible implementation manners of the foregoing aspects.
  • the function can be realized by hardware, or the corresponding software can be executed by hardware.
  • the hardware or software includes one or more modules or units corresponding to the above-mentioned functions. For example, a display module or unit, a detection module or unit, a processing module or unit, and so on.
  • the present application provides an electronic device, including: a touch display screen, wherein the touch display screen includes a touch-sensitive surface and a display; a camera; one or more processors; a memory; a plurality of application programs; and one or Multiple computer programs.
  • one or more computer programs are stored in the memory, and the one or more computer programs include instructions.
  • the electronic device is caused to execute the method for displaying multiple windows in any possible implementation of any one of the foregoing aspects.
  • the present application provides an electronic device including one or more processors and one or more memories.
  • the one or more memories are coupled with one or more processors, and the one or more memories are used to store computer program codes.
  • the computer program codes include computer instructions.
  • the electronic device executes A method for displaying multiple windows in a possible implementation of any one of the foregoing aspects.
  • a system in an eighth aspect, includes: a first electronic device and a second electronic device that execute the method for displaying multiple windows in any one of the possible implementations of the foregoing aspects.
  • the present application provides a computer storage medium, including computer instructions, which when the computer instructions run on an electronic device, cause the electronic device to execute any one of the possible methods for displaying multiple windows in any of the foregoing aspects.
  • this application provides a computer program product that, when the computer program product runs on an electronic device, causes the electronic device to execute any one of the above-mentioned methods for displaying multiple windows.
  • FIG. 1 is a schematic structural diagram of an example of a first electronic device provided by an embodiment of the present application.
  • FIG. 2 is a schematic structural diagram of an example of a second electronic device provided by an embodiment of the present application.
  • Fig. 3 is an example of a software structure block diagram of a mobile phone and a PC according to an embodiment of the present application.
  • Fig. 4 is a schematic diagram of an example of a PC displaying a mobile phone interface according to an embodiment of the present application.
  • Fig. 5 is a schematic diagram of another example of a PC displaying a mobile phone interface according to an embodiment of the present application.
  • Fig. 6 is a schematic diagram of another example of a PC displaying a mobile phone interface according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of another example of a PC displaying a mobile phone interface according to an embodiment of the present application.
  • FIG. 8 is a schematic flowchart of a method for displaying multiple windows provided by an embodiment of the present application.
  • Fig. 9 is a schematic diagram of creating a virtual area on a mobile phone according to an embodiment of the present application.
  • FIG. 10 is a schematic flowchart of another example of a method for displaying multiple windows according to an embodiment of the present application.
  • FIG. 11 is a schematic diagram of another example of creating a virtual area on a mobile phone according to an embodiment of the present application.
  • FIG. 12 is a schematic flowchart of another example of a method for displaying multiple windows according to an embodiment of the present application.
  • FIG. 13 is a schematic flowchart of another example of a method for displaying multiple windows according to an embodiment of the present application.
  • first and second are only used to distinguish, for example, “first electronic device” and “second electronic device” are only used to indicate different electronic devices, “first window” and “second window” “Is only used to indicate different display windows, and “first operation” and “second operation” are only used to indicate operations at different times or for different purposes.
  • the embodiment of the present application provides a method for displaying multiple windows, and the method can be applied to a system including two electronic devices that communicate with each other.
  • the two electronic devices are referred to as the first electronic device and the second electronic device, respectively, where the second electronic device can display the interface of the first electronic device.
  • the second electronic device displays the main interface of the first electronic device through one window, or the second electronic device displays the interfaces of multiple applications of the first electronic device through multiple windows.
  • the method may also be implemented by an application to display multiple windows of the first electronic device on the second electronic device.
  • the application program may be installed only on the second electronic device; or the application program may be installed on the first electronic device and the second electronic device at the same time; or, the application program may be embodied as the first application on the first electronic device
  • the program is embodied as a second application on the second electronic device, where the first application is adapted to the first electronic device, and the second application is adapted to the second electronic device; or, the first application is the first
  • the program code preset on the electronic device may not have a corresponding desktop application icon, and the second application program may be embodied in the form of a desktop application icon on the second electronic device in various possible situations, so as to be implemented on the second electronic device.
  • the main interface of the first electronic device is displayed through one window, or the interfaces of multiple applications of the first electronic device are displayed through multiple windows.
  • the first electronic device may be an electronic device such as a mobile phone, a smart terminal, a wearable device
  • the second electronic device may be a PC, a tablet computer, a mobile phone, a smart terminal, a vehicle-mounted device, or an augmented reality (augmented reality).
  • AR AR/virtual reality
  • VR virtual reality
  • laptops laptops
  • ultra-mobile personal computers UMPC
  • netbooks personal digital assistants
  • PDAs personal digital assistants
  • monitors or TVs etc.
  • the embodiments of the present application do not impose any restrictions on the specific types of the first electronic device and the second electronic device.
  • the first electronic device and the second electronic device may be the same type of electronic device or different types of electronic devices.
  • the mobile phone is used as the first electronic device
  • the PC is used as the second electronic device
  • the multi-window of the mobile phone is displayed on the PC as an example for introduction.
  • FIG. 1 is a schematic structural diagram of an example of a mobile phone 100 provided by an embodiment of the present application.
  • the mobile phone 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone interface 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and user An identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile phone 100.
  • the mobile phone 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait.
  • AP application processor
  • GPU graphics processing unit
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller may be the nerve center and command center of the mobile phone 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the processor 110 may include one or more interfaces.
  • the interface can include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / Or Universal Serial Bus (USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous transmitter receiver/transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).
  • the processor 110 may include multiple sets of I2C buses.
  • the processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively through different I2C bus interfaces.
  • the processor 110 may couple the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to implement the touch function of the mobile phone 100.
  • the I2S interface can be used for audio communication.
  • the PCM interface can also be used for audio communication to sample, quantize and encode analog signals.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • the MIPI interface can be used to connect the processor 110 with the display screen 194, the camera 193 and other peripheral devices.
  • the MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (display serial interface, DSI), and so on.
  • the GPIO interface can be configured through software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the USB interface 130 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on.
  • the USB interface 130 may be used to connect to other electronic devices, for example, a PC or the like may be connected through the USB interface.
  • the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the mobile phone 100.
  • the mobile phone 100 may also adopt different interface connection modes or a combination of multiple interface connection modes in the foregoing embodiments.
  • the charging management module 140 is used to receive charging input from the charger.
  • the wireless communication function of the mobile phone 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • the mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied on the mobile phone 100.
  • the wireless communication module 160 can provide applications on the mobile phone 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellite systems. (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • WiFi wireless fidelity
  • BT bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive a signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2.
  • the mobile phone 100 implements a display function through a GPU, a display screen 194, and an application processor.
  • the GPU is an image processing microprocessor, which is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations and is used for graphics rendering.
  • the processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, and the like.
  • the display screen 194 includes a display panel.
  • the display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active matrix organic light-emitting diode active-matrix organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • AMOLED flexible light-emitting diode
  • FLED flexible light-emitting diode
  • Mini-LED Micro-LED
  • Micro-OLED quantum dot light-emitting diode
  • QLED quantum dot light-emitting diode
  • the mobile phone 100 may include one or N display
  • the mobile phone 100 can realize the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP is used to process the data fed back by the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and is projected to the photosensitive element.
  • the mobile phone 100 may include one or N cameras 193, and N is a positive integer greater than one.
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the mobile phone 100.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the mobile phone 100 by running instructions stored in the internal memory 121.
  • the internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone 100.
  • the mobile phone 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the mobile phone 100 also includes a plurality of sensors.
  • the pressure sensor 180A is used to sense a pressure signal, and the pressure signal can be converted into an electrical signal.
  • the gyro sensor 180B may be used to determine the movement posture of the mobile phone 100.
  • the air pressure sensor 180C is used to measure air pressure.
  • the magnetic sensor 180D includes a Hall sensor.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the mobile phone 100 in various directions (generally three axes). When the mobile phone 100 is at rest, the magnitude and direction of gravity can be detected, and it can also be used to identify the posture of the mobile phone 100, and can be used in applications such as horizontal and vertical screen switching, pedometers and the like.
  • the proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.
  • the ambient light sensor 180L is used to sense the brightness of the ambient light.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the temperature sensor 180J is used to detect temperature.
  • Touch sensor 180K also called "touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”.
  • the touch sensor 180K is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the mobile phone 100, which is different from the position of the display screen 194.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the button 190 includes a power-on button, a volume button, and so on.
  • the button 190 may be a mechanical button. It can also be a touch button.
  • the mobile phone 100 can receive key input, and generate key signal input related to user settings and function control of the mobile phone 100.
  • the motor 191 can generate vibration prompts.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect to the SIM card.
  • FIG. 2 is a schematic structural diagram of an example of a PC 200 provided in an embodiment of the present application.
  • the PC 200 may include a processor 210, a memory 220, a communication module 230, a display screen 240, and so on.
  • the structure of the PC 200 illustrated in the embodiment of the present application does not constitute a specific limitation on the PC 200.
  • the PC 200 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 210 may include one or more processing units, and the processor 210 may be used to control and manage the actions of the PC 200.
  • the memory 220 is used to store program codes and data.
  • the communication module 230 may be used for communication between various internal modules of the PC 200, or communication between the PC 200 and other external devices, and so on. Exemplarily, if the PC 200 communicates with other electronic devices through a wired connection, the communication module 230 may include an interface, such as a USB interface. For the USB interface, refer to the description of the USB interface 130 in FIG. 1.
  • the communication module 230 may include an audio device, a radio frequency circuit, a Bluetooth chip, a wireless fidelity (Wi-Fi) chip, a near-field communication (NFC) module, etc., which can implement the PC 200 and Interaction between other electronic devices.
  • the display screen 240 is used to display images, videos, and the like.
  • the PC 200 may also include peripheral devices 250, such as a mouse, a keyboard, a speaker, a microphone, and so on.
  • the processor 210 can execute computer execution instructions stored in the memory 220, so that the PC 200 and the mobile phone 100 can form an electronic device system that communicates with each other, and further displays multiple information of the mobile phone 100 through the display 240 of the PC 200 window.
  • FIG. 3 is an example of a software structure block diagram of a mobile phone 100 and a PC 200 provided by an embodiment of the present application.
  • the block diagram includes the software structure of the mobile phone 100 and the software structure of the PC 200 for displaying the mobile phone window module.
  • the software structure of the mobile phone 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of the present application takes an Android system with a layered architecture as an example to illustrate the software structure of the mobile phone 100.
  • the layered structure divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface.
  • the Android system includes an application (application, APP) layer, an application framework (framework) layer, a system library, and a kernel layer from top to bottom.
  • the application layer can include a series of application packages.
  • the application layer may include application programs such as short message, music, video, navigation, etc., which are not limited in the embodiment of the present application.
  • the application framework layer can include a variety of service programs or some pre-defined functions.
  • the application framework layer can provide an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • API application programming interface
  • the application framework layer may include an Android installation package (APK) of the discovery link service, a multi-screen framework service APK, and a multicast discovery protocol (multicast source discovery protocol, MSDP). ) Service APK.
  • APIK Android installation package
  • APK multi-screen framework service
  • MSDP multicast source discovery protocol
  • the discovery link service APK is used to discover the PC 200 and connect to the PC 200.
  • the discovery link service APK can include a software development kit (SDK) that implements this function, and the SDK can be a programming language
  • SDK software development kit
  • API application programming interface
  • Some files that provide application programming interface (API) can also implement communication between hardware modules.
  • the MSDP-SDK shown in FIG. 3 can provide an interface for the MSDP service, which is used to inform the data transmission path, so as to realize the process of transmitting the video stream of the MSDP service.
  • the communication between the mobile phone 100 and the PC 200 may be in a variety of different ways, for example, through a connection or by means of a future communication technology to communicate to transmit data.
  • the connection between the mobile phone 100 and the PC 200 may include multiple different connection modes such as wired connection or wireless connection.
  • the wired connection between the mobile phone 100 and the PC 200 may be connected through a USB data cable;
  • the wireless connection between the mobile phone 100 and the PC 200 may be through the establishment of a Wi-Fi connection, or by means of the mobile phone 100 and PC 200 supports the function of near field communication (NFC), close connection through the "touch" function, or, through the mobile phone 100 and PC 200 through Bluetooth scan code connection, etc.
  • NFC near field communication
  • the mobile phone 100 has the NFC function and the NFC function of the mobile phone 100 is turned on first, and the discovery link service APK of the mobile phone 100 can be used to scan and find the information within a certain range. Other devices with NFC enabled. If the PC 200 also has the NFC function enabled, when the mobile phone 100 is close to the PC 200, the discovery link service APK of the mobile phone 100 can send a connection request to the NFC function module of the PC 200, and the NFC function module of the PC 200 accepts the connection request and establishes with the mobile phone 100 Pathway, that is, the process of establishing a connection between the mobile phone 100 and the PC 200 is completed.
  • the electronic device having the NFC function can be realized by the NFC chip included in the electronic device, or an NFC device can be connected to the electronic device, and the NFC function can be realized by pre-setting the application program related to the NFC function on the electronic device.
  • the application embodiment does not limit this.
  • the mobile phone 100 and the PC 200 may be able to display the window of the mobile phone 100 on the PC 200 through 5G communication, for example, By installing different or the same applications on the mobile phone 100 and the PC 200, data is transmitted via the 5G communication network.
  • the discovery link service APK of the mobile phone 100 may not provide the function of discovering and establishing a connection with the PC 200. It should be understood that the embodiment of the present application does not limit the communication mode between the mobile phone 100 and the PC 200. In subsequent embodiments, the establishment of an NFC connection between the mobile phone 100 and the PC 200 will be described in detail as an example.
  • the multi-window manager in the multi-screen framework service APK is used to manage the window programs of the mobile phone 100.
  • the multi-window manager can obtain the size of the window to be displayed on the mobile phone 100, determine the content of the window to be displayed, and so on.
  • the to-be-displayed window of the mobile phone 100 may include a window being displayed on the interface of the mobile phone 100, and may also include a window of one or more application programs running in the background of the mobile phone 100.
  • the message notification manager can make the application display notification information in the status bar of the mobile phone 100, which can be used to convey notification type messages. The messages displayed in the status bar can disappear automatically after a short stay without user interaction.
  • the message displayed in the status bar can be used to inform the user that the download is complete, and other message content reminders, etc.
  • the message notification manager can also provide notifications that appear in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and can also provide notifications that appear on the screen of the mobile phone 100 in the form of a dialogue window.
  • the message notification manager can also provide different types of notifications, such as notification sounds, vibration of the mobile phone 100, and flashing lights.
  • the MSDP service APK is used for data transmission after the mobile phone 100 and the PC 200 have established a connection (for example, an NFC connection), such as the transmission of a video stream between the mobile phone 100 and the PC 200.
  • MSDP service APK can implement functions including video stream encoding, audio stream encoding, window coordinate synchronization, audio device virtualization, and reverse control.
  • the video stream encoding can realize the encapsulation of the video data to be transmitted into a message conforming to the data transmission protocol between the mobile phone 100 and the PC 200.
  • the video stream message may include the type, format, serial number, and serial number of the transmission media. Time stamp and whether there is additional data and other information, and then realize the real-time transmission of the video stream.
  • the audio stream encoding can realize the encapsulation of the audio data to be transmitted into a message conforming to the data transmission protocol between the mobile phone 100 and the PC 200, thereby realizing the real-time transmission of the audio stream.
  • the window coordinate synchronization can determine the coordinates of the window to be displayed of the mobile phone 100 on the PC 200 display screen.
  • the audio device virtualization can create virtual audio from the audio in the mobile phone 100, and then send it to the PC 200, so that the audio can be played on the PC 200.
  • the reverse control can perform corresponding operations on the mobile phone 100 and the PC 200 synchronously according to the operation instructions transmitted between the mobile phone 100 and the PC 200.
  • the PC 200 displays the playback window of the video application of the mobile phone 100.
  • the pause operation can be transmitted back to the mobile phone 100, and the reverse control module of the mobile phone 100 controls the mobile phone 100 to also pause playback.
  • reverse control can also be used to transfer operations on the mobile phone 100 to the PC 200. It should be understood that for different systems, the mobile phone 100 and the PC 200 have different communication modes, and each of the software modules introduced above may partially or fully participate in the process of displaying multiple windows on the PC 200 in the embodiment of the present application.
  • the application framework layer can realize functions such as the discovery of connections between the PC 200 and the mobile phone 100, and the invocation of MSDP services.
  • the multi-screen framework service of the application framework layer can also implement functions such as dragging and sharing of files between the PC 200 and the mobile phone 100, display in a single window mode, and life cycle management of application collaboration.
  • the drag and drop of files between the PC 200 and the mobile phone 100 and the display of a window of the mobile phone 100 on the PC 200 can refer to the existing solutions, which will not be repeated here.
  • the life cycle management of application collaboration is a software tool used to configure and manage applications, and specify the life cycle of the application.
  • the system library can include multiple functional modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
  • the surface manager is used to manage the display subsystem of the mobile phone 100, and provides a combination of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.
  • the 2D graphics engine is a drawing engine for 2D drawing.
  • the Android runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display drivers, audio drivers, etc.
  • the core layer of the mobile phone 100 may include a wireless fidelity (WIFI) module for the mobile phone 100 to connect to, for wireless connection;
  • WIFI wireless fidelity
  • NFC near-field communication
  • the kernel layer may not include WIFI module, NFC module, etc., or the kernel layer may include WIFI module, NFC module, etc., but it does not participate in the process of displaying multiple windows on the PC 200 in this embodiment of the application. .
  • the mobile phone 100 may also have different division methods or include more functional modules, which is not limited in the embodiment of the present application.
  • FIG. 3 also shows the mobile phone display window module of the PC 200.
  • the mobile phone display window module is used to display the interface content of the mobile phone 100.
  • the PC 200 may include a multi-layer architecture, such as a pre-research layer, a PC software layer, an operating system (OS) layer, and a basic read only memory (ROM) multi-screen frame layer.
  • the PC The software layer can run executable files (executable files, exe).
  • the PC 200 may be preset to display the exe program of the mobile phone window, and the exe program that displays the mobile phone window may be embodied in the form of an App on the PC 200, or the exe program that displays the mobile phone window can be used to make the PC 200 has a function of displaying the window of the mobile phone 100.
  • the functional module of the PC 200 that provides the window for displaying the mobile phone 100 is referred to as the "mobile phone window display module". The following will focus on the mobile phone window module for displaying the window of the mobile phone 100 on the PC 200.
  • the display mobile phone window module of the PC 200 can provide functions corresponding to related services of the application framework layer of the mobile phone 100, such as providing multi-screen framework services and MSDP services.
  • the MSDP service APK corresponds to the MSDP service of the mobile phone 100, and is used for data transmission after the PC 200 and the mobile phone 100 are connected.
  • the MSDP service of PC200 can realize functions including video stream decoding, audio stream decoding, window coordinate synchronization, audio device virtualization, and reverse control.
  • the MSDP service APK of the PC 200 can receive the video stream sent by the mobile phone 100 and decode the video stream.
  • the video stream decoding can decapsulate the encapsulated message received by the PC 200 to obtain the decoding After the complete video data.
  • Audio stream decoding can decapsulate the packets received by the PC 200 to obtain audio data.
  • the window coordinate synchronization can determine the coordinates and area used to display the mobile phone window on the screen of the PC 200 according to the information contained in the video stream.
  • the audio device virtually receives the virtual audio sent by the mobile phone 100, and plays the virtual audio by the audio device of the PC 200, so that the audio can be played on the PC 200.
  • the reverse control can perform corresponding operations on the mobile phone 100 and the PC 200 synchronously according to the operation instructions transmitted between the mobile phone 100 and the PC 200.
  • the PC 200 displays the playback window of the video application of the mobile phone 100.
  • the pause operation can be transmitted to the PC 200, and the reverse control module of the PC 200 obtains the instruction and controls the PC 200 to also pause Play.
  • reverse control can also be used to transfer operations on the PC 200 to the mobile phone 100.
  • the MSDP service APK obtains and parses the video frame, and transmits the information of the mobile phone window contained in the video frame to the multi-screen frame service APK.
  • the information of the mobile phone window may include the coordinate information of the mobile phone window, the display content information of the mobile phone window, and so on.
  • the multi-screen framework service APK may include a multi-window manager, a message notification manager, a mobile phone window display, an application lifecycle manager, and so on. Among them, the multi-window manager may determine to display one or more windows of the mobile phone 100 on the display screen of the PC 200 according to the coordinate information of the mobile phone windows.
  • the mobile phone window display is displayed on the display screen of the PC 200 according to the display content information of the mobile phone window.
  • the mobile phone window display may be used to display one or more windows of the mobile phone 100.
  • the message notification manager can be used to display notification information on the PC 200, for example, to display the notification information in the form of a message pop-up window, prompt sound, etc.
  • the application lifecycle manager is used to provide application developers with a convenient interface to access application information, start an application by calling a single application program interface (application programmers interface, API), and process various applications for each running application. It also maintains a program list for the applications installed in the system, and updates the list at any time when the monitored application changes.
  • the transmitted data can include the video stream data described above, and can also include the transmission of intent commands, such as "touch event" and other operations.
  • the transmission of instructions (such as instructions for starting, closing, moving, zooming applications, etc.); the transmitted data may also include the parseable data format defined between the PC 200 and the mobile phone 100, etc. This embodiment of the application does not do this limited.
  • FIG. 3 takes the display of multiple windows of the mobile phone 100 on the PC 200 as an example to introduce the modules and software architectures participating in the process of displaying multiple windows.
  • the mobile phone 100 can also be used as the second electronic device, and the MSDP service APK of the mobile phone 100 can also provide the decoding function of the video stream; or the PC 200 can also be used as the first electronic device, and the MSDP service APK of the PC 200 can also provide the video stream.
  • the coding function is not limited in this embodiment of the application.
  • the mobile phone can be connected to the PC and PC through a data cable.
  • Large-screen devices such as monitors or TVs are connected so that large-screen devices can easily access the mobile phone.
  • Users can use two screens to handle multiple tasks at the same time. For example, users can view videos, pictures, and documents on a larger screen, while they can continue to use their mobile phones to send and receive text messages and answer calls.
  • the method of displaying the mobile phone interface requires the connection of a data cable to project the mobile phone interface to the large-screen device. Moreover, this method cannot realize the integration of the mobile phone and the PC system, and cannot realize the calling of the application installed on the mobile phone from the system menu of the PC.
  • the following embodiments will take the mobile phone 100 having the hardware structure shown in FIG. 1 and the software structure shown in FIG. 3, and the PC 200 having the software structure shown in FIG. 2 and FIG.
  • the method of displaying multiple windows is described in detail below in conjunction with the drawings and application scenarios.
  • Fig. 4 is a schematic diagram of an example of a PC displaying a mobile phone interface according to an embodiment of the present application. As shown in Figure 4(a), after the mobile phone and the PC are connected, the mobile phone window of the PC 200 can display the same interface as the mobile phone 100.
  • Figure 4(a) shows the main interface 401 of the mobile phone 100 after unlocking.
  • the main interface 401 displays a variety of applications (Apps), such as photo albums, settings, videos, music, etc. It should be understood that, The main interface 401 may also include other more application programs, which are not limited in the embodiment of the present application.
  • Fig. 4(a) also shows the main interface 402 of the PC 200.
  • the main interface 402 includes a variety of PC 200 Apps (such as My Computer, Recycle Bin, etc.) and the mobile phone window 10.
  • the mobile phone window 10 can be used to display the interface content of the mobile phone 100.
  • the mobile phone window 10 may also include a gray menu bar 11 as shown in the figure.
  • the gray menu bar 11 may include a button 11-1 that is hidden to the side frame, a button 11-2 that is hidden to the menu bar, and a button 11- to maximize the window. 3. Close the window, press 11-4, etc.
  • click the hide to side frame button 11-1 to hide the mobile phone window 10 to the right frame of the PC 200 display screen
  • the hide to the menu bar button 11-2 can be used to hide the mobile phone window 10 to the menu area 12 .
  • the gray menu bar 11 may include some or all of the keys listed above, and may also include more function keys, which is not limited in the embodiment of the present application.
  • the window maximization button 11-3 can display different forms according to the user's operation, so that the function can be changed. Exemplarily, when the mobile phone window 10 is displayed as a small window, the user clicks the window maximize button 11-3. In response to the user's click operation, the mobile phone window 10 is maximized. At this time, the maximize button 11-3 can be changed. For the window minimization button, the window minimization button 11-5 as shown in FIG. 7(b). The user can click the minimize button 11-5, and in response to the user's click operation, the mobile phone window 10 is reduced to the original small window for display.
  • the area including the gray menu bar 11 may be collectively referred to as the "mobile phone window 10".
  • the main interface 402 may also include a menu area 12, which may include the start menu 13 of the PC 200, a file management shortcut menu, a browser, an input method control menu, a time and date setting menu, and power management. Etc., the embodiment of the present application does not limit this.
  • the interface currently displayed by the mobile phone 100 can be displayed on the mobile phone window 10 of the PC 200.
  • the user clicks on the music application on the main interface 401 of the mobile phone and the interface of the mobile phone 100 and the PC 200 can be as shown in Figure 4 (b).
  • the interface 401 of the mobile phone 100 displays the interface of the music application
  • the mobile phone window 10 of the PC 200 also displays the interface of the music application, keeping the display content of the interface 401 of the mobile phone 100 and the mobile phone window 10 of the PC 200 consistent, and will not be repeated here.
  • the display of the mobile phone window 10 on the PC 200 may be automatically popped up and displayed on the main interface 402 of the PC after the connection between the mobile phone 100 and the PC 200 is established; or, the mobile phone window 10 may be based on After the user's operation, it is displayed on the main interface 402 of the PC.
  • the embodiment of the present application does not limit the display timing and manner of the mobile phone window 10.
  • Fig. 5 is a schematic diagram of another example of a PC displaying a mobile phone interface according to an embodiment of the present application.
  • the user can perform certain operations on the PC 200.
  • the mobile phone window 10 is displayed on the main interface 502 of the PC. .
  • the menu window 20 includes a list of various applications of the PC, such as office software such as Word, PowerPoint, Paint, and calculator, or other applications such as a browser.
  • the menu window 20 may also include a shortcut of the application, for example, the application may be "EMUJI desktop", the menu window 20 EMUJI desktop icons that can be included.
  • the application related to the multi-window display of the mobile phone 100 can be downloaded from the application store and installed on the PC 200, and the method and process of installing the application will not be repeated in the embodiment of the present application.
  • the user can click the EMUJI desktop menu bar of the menu window 20, and in response to the user's click operation, the main interface 502 of the PC 200 displays the mobile phone application window 30, the mobile phone application window 30 All applications of the mobile phone 100 can be displayed.
  • the mobile phone application window 30 may be shown in Figure 5 (c), the application of the mobile phone 100 is displayed in a window on the EMUJI desktop; or, the mobile phone application window 30 may be displayed as the mobile phone window 10, in the mobile phone
  • the window 10 displays an application list of the mobile phone 100, which is not limited in the embodiment of the present application.
  • the mobile phone 100 can send the information of all installed applications to the PC 200, or when the user clicks on the EMUJI desktop menu in the menu window 20, the PC 200 can be triggered to send to the mobile phone 100.
  • the application request is used to request information about the application of the mobile phone 100.
  • the application information here may include the names, identification (ID), icons, and other information of all applications in the application layer.
  • the PC 200 After the PC 200 receives the application information, it displays the application in the mobile phone application window 30 according to the name, ID, and icon of each application, and then displays all the applications of the mobile phone 100.
  • the display may be as shown in FIG. 5(c).
  • the identification of the application may be a package name, and the package name contains a character string, and the PC 200 can determine the current music application based on the package name.
  • a mobile phone window 10 pops up, and the mobile phone window 10 is displayed consistent with the interface 501 of the mobile phone 100.
  • the EMUJI desktop window 30 can pop up on the main interface 502 of the PC 200.
  • the EMUJI desktop All the applications installed on the mobile phone can be displayed on the window 30 of the EMUJI desktop, and the user can click and run any application in the window 30 of the EMUJI desktop.
  • the interface of the mobile phone 100 is displayed on the interface of the PC 200, either through the mobile phone window 10 shown in FIG. 5, or through the operation method described in FIG. 5, from the start menu of the PC 200 A certain application (such as the EMUJI desktop) is invoked in 13, and then the mobile phone window 10 or the window 30 of the EMUJI desktop including all applications of the mobile phone 100 is displayed through the application, which is not limited in the embodiment of the present application.
  • a certain application such as the EMUJI desktop
  • the interface of the mobile phone 100 is displayed on the interface of the PC 200.
  • the main interface 402 of the PC 200 can display multiple corresponding Different application windows.
  • Fig. 5 is a schematic diagram of another example of a PC displaying a mobile phone interface according to an embodiment of the present application. It should be understood that the user can start the application by clicking on the mobile phone, or start the application by clicking on the mobile phone window 10 of the PC, which is not limited in the embodiment of the present application.
  • the "click operation" performed by the user described in the embodiment of the present application may be a different operation for different devices.
  • the user can run the music application through touch and click operations;
  • the user can perform a single-click operation or double-click operation through peripheral input devices such as a mouse and keyboard to run the music application; or, if the PC When it is a device with a touch screen, the user can run the music application by touching and clicking, which is not limited in the embodiment of the present application.
  • the user can click the music application on the main interface 401 of the mobile phone 100.
  • the PC 200 can automatically A window 40 of the music application pops up.
  • the window 40 of the music application may be used to display the main interface of the music application.
  • the user can click the music application 14 on the mobile phone window 10 of the PC 200, and in response to the user's click operation, the main interface 402 of the PC 200 can automatically pop up the music application window 40, which is not limited in this embodiment of the application.
  • the music application window 40 can be directly popped up on the mobile phone window 10 of the PC 200.
  • the original The mobile phone window 10 can be maintained as the main interface of the mobile phone 100.
  • the embodiment of the present application does not limit the display content of the interface of the mobile phone 100.
  • the mobile phone 100 may be in the off-screen state or the display is unlocked.
  • the subsequent main interface may be consistent with the display content of the mobile phone window 10 of the PC 200, and so on.
  • the user when the user clicks and runs a music application on the main interface 401 of the mobile phone 100, or the user can click the music application 14 on the mobile phone window 10 of the PC 200, in response to the user's click operation,
  • the main interface of the music application can be directly jumped to and displayed on the mobile phone window 10 of the PC 200.
  • the user can select and drag the main interface of the music application, so that the music application window 40 reappears on the PC 200.
  • the user can click on any position of the mobile phone window 10 after displaying the main interface of the music application on the mobile phone window 10, and follow the direction shown by the dotted line, Drag to any area outside the mobile phone window 10, so that the interface of the PC 200 is displayed as shown in Figure 6 (a), that is, the window 40 of the music application is displayed separately, and the mobile phone window 10 restores to display the main interface 401 of the mobile phone.
  • FIG. 7 is a schematic diagram of another example of a PC displaying a mobile phone interface according to an embodiment of the present application.
  • the PC 200 can display a corresponding window for each application.
  • the user has already run a music application on the PC 200, and a window 40 of the music application is displayed on the main interface 402 of the PC 200.
  • the user can return to the main interface 401 of the mobile phone 100, and the music application can be in the background running state of the mobile phone 100.
  • the user can also click any other application on the main interface 401 of the mobile phone 100.
  • the user can click the video application 15 on the main interface 401 of the mobile phone 100.
  • the PC 200 can also automatically pop up the video application window 50, and the interface of the mobile phone 100 is displayed as the interface of the video application.
  • the user can return to the main interface 401 of the mobile phone 100, and the video application can be in the background running state of the mobile phone 100.
  • the user can click the video application 15 on the mobile phone window 10 of the PC 200.
  • the PC 200 can automatically pop up the video application window 50, and the mobile phone
  • the interface of 100 can display the main interface 401, that is, it can display any possible interface of the mobile phone 100 without being affected by user operations.
  • Any possible interface here can be a lock screen interface, an interface for the user to use any application on the mobile phone, and so on.
  • the user can perform related operations on the windows of each application appearing on the PC 200.
  • the window 50 of the video application may be the main interface of the video application, including multiple video lists.
  • the user can click on a certain video, for example, the user clicks "When happiness comes knocking", the window 50 of the video application may be displayed as shown in Figure 7. In the interface shown in Figure (a), the video is played through the window 50 of the video application.
  • the embodiment of the present application does not limit the size and location of the windows of multiple applications displayed on the PC 200.
  • the process of determining the size and location of the windows of the applications displayed on the PC 200 can refer to the subsequent step 804 Related description.
  • the user can select a window of an application and drag the window to drag the window to any position on the display screen of the PC 200.
  • the user can use the gray menu bar 11 including hide to side border button 11-1, hide to menu bar button 11-2, window maximize button 11-3, close window button 11-4, etc., for each application The corresponding operation is performed on the window of the video application, or the user can reduce or enlarge the window 50 of the video application by dragging the frame of the window 50 of the video application, which will not be repeated here.
  • the window can be closed on the PC 200, and the application of the mobile phone 100 corresponding to the window can run in the background. Or the application corresponding to the window exits and turns into a closed state, which is not limited in this application.
  • the user can maximize the window in different ways.
  • the user maximizes the video application window 50 to FIG. 7 by clicking the window maximize button 11-3 included in the gray menu bar 11 of the video application window 50 (B) shown in the full-screen display; or, the user clicks the full-screen control 16 included in the window 50 of the video application to maximize the window 50 of the video application to as shown in (b) of FIG. 7,
  • the embodiment of the application does not limit this.
  • the user can click the window reduction control 17 included in the gray menu bar 11 to restore the window 50 of the video application to the one shown in FIG. (a) The non-full-screen display shown in the figure; or the user can restore the window 50 of the video application to the figure shown in (a) of Fig. 7 by clicking the window minimization button 11-5 included in the window 50 of the video application
  • the non-full-screen display of is not limited in this embodiment of the application.
  • the method for displaying multiple windows can display the application program of the mobile phone 100 in the mobile phone window of the PC 200 or in the menu list of the PC 200.
  • it can be clicked on the PC 200 to run the application of the mobile phone 100 and use the functions of the application.
  • the user can experience using the application of the mobile phone 100 with the help of the large screen of the PC 200.
  • the method can realize the integration of the mobile phone and the PC system, so that the user can call the application installed on the mobile phone from the system menu of the PC.
  • this method can realize multiple mobile phone applications simultaneously and independently and in parallel on the PC 200.
  • Each application can display an independent window on the PC 200, and multiple windows corresponding to multiple applications can be displayed on the interface of the PC 200 at the same time and run.
  • the multiple applications of the mobile phone 100 do not affect the user's use of other functions of the mobile phone.
  • the user can use the mobile phone's video applications and music applications on the PC 200, and can use the mobile phone to send and receive text messages or make calls at the same time; or, the user can operate the mobile phone by using peripheral input devices such as the mouse and keyboard, which completely retains the user's usage habits. Switch between the two devices frequently; run the application of the mobile phone 100 through the mobile phone window of the PC 200, which improves the efficiency of file review, sharing, and office, and improves the user experience.
  • the method for displaying multiple windows can be applied to a system including two electronic devices that communicate with each other.
  • the system includes a first electronic device and a first electronic device for displaying the first electronic device.
  • the second electronic device of the electronic device interface.
  • the mobile phone 100 is used as the first electronic device
  • the PC 200 is used as the second electronic device.
  • the PC 200 can display multiple windows of the mobile phone 100. The specific implementation process of the PC 200 displaying multiple windows of the mobile phone 100 will be described below with reference to FIGS. 8 to 12.
  • FIG. 8 is a schematic flowchart of a method for displaying multiple windows according to an embodiment of the present application. As shown in FIG. 8, the method 800 may include the following steps:
  • the mobile phone 100 and the PC 200 establish a connection.
  • the mobile phone 100 and the PC 200 need to communicate with each other, and the communication mode can be referred to the foregoing introduction, which will not be repeated here.
  • the process of establishing a connection between the mobile phone 100 and the PC 200 can be participated by the discovery link service APK of the mobile phone 100 in FIG. 3, and will not be repeated here.
  • the mobile phone 100 obtains the size information of the display screen of the PC 200.
  • the embodiment of the present application does not limit the timing and manner for the mobile phone 100 to obtain the size information of the display screen of the PC 200.
  • the PC 200 can send information such as the size of the display screen to the mobile phone, and the mobile phone 100 can obtain the information such as the size of the display screen of the PC 200.
  • the PC 200 can be triggered according to the user's operation to send information such as the size of the display to the mobile phone, and the mobile phone 100 can obtain the size of the display of the PC 200 And other information.
  • the PC 200 may send information such as the size of the display screen to the mobile phone.
  • the data interaction between the mobile phone 100 and the PC 200 can be transmitted through different channels according to the process of establishing a connection between the two parties.
  • the data between the mobile phone 100 and the PC 200 can be transmitted by discovering and establishing a WiFi p2p channel; or, if the connection between the mobile phone 100 and the PC 200 is established via Bluetooth, information such as the size of the display screen of the PC 200 can be transmitted via the Bluetooth channel It is transmitted to the mobile phone 100, which is not limited in the embodiment of the present application.
  • this step 801 may be participated by the multi-screen framework service APK of the application framework layer of the mobile phone 100.
  • the mobile phone 100 creates a virtual area according to the acquired size information of the display screen of the PC 200.
  • the mobile phone 100 determines the first area of the mobile phone window 10 in the virtual area.
  • the mobile phone 100 may create a virtual area when establishing a connection with the PC 200, and the size of the virtual area is the same as the size of the display screen of the PC 200.
  • FIG. 9 is a schematic diagram of creating a virtual area on the mobile phone 100 according to an embodiment of the present application.
  • the starting point of the upper left corner of the display screen is used as the origin of coordinates, and the pixels in the horizontal direction (X-axis direction) and vertical direction (Y-axis direction) are used to represent the size of the display screen.
  • the size in the following description, the numbers are the position coordinates of the pixels. It should be understood that the more pixels occupied in a certain direction, the finer and more delicate the display effect.
  • Steps 803-804 may correspond to the process performed by the mobile phone 100 shown in (a) in FIG. 9.
  • the size of the display screen of the PC 200 obtained by the mobile phone 100 may be 3000 ⁇ 2000.
  • the display screen of the PC 200 includes 3000 pixels in the horizontal direction (X axis), and in the vertical direction (Y axis) contains 2000 pixels.
  • the mobile phone 100 creates a virtual area (the area shown by the dotted line) as shown in Figure 9(a), and the coordinate origin of the virtual area O( 0, 0), the X-axis direction contains 3000 pixels, and the Y-axis direction contains 2000 pixels.
  • the mobile phone 100 After the mobile phone 100 creates the virtual area, in the virtual area, the first area where the mobile phone window 10 is located is determined.
  • the mobile phone 100 determines the coordinates of the vertex O 1 of the first area, the pixels included in the X-axis direction, and the Y-axis direction includes Of pixels.
  • the vertex coordinates of the first area, the number of pixels included in the X-axis direction, and the number of pixels included in the Y-axis direction may be preset by the system, or the first area is set by the mobile phone 100 and the PC 200 according to preset rules.
  • the size of the display screen is determined, which is not limited in the embodiment of the present application.
  • the mobile phone 100 may specify the initial vertex coordinates, the number of pixels included in the X-axis direction, and the number of pixels included in the Y-axis direction for each window to be displayed.
  • the mobile phone window 10 can be displayed at a position close to the right border of the display screen of the PC 200, such as As shown in Fig. 7(a), the mobile phone window 10 is displayed on the display screen of the PC 200 near the right frame, and the mobile phone window 10 is located in the middle of the upper frame boundary and the lower frame of the PC 200 display screen.
  • the initial coordinate setting can prevent the mobile phone window 10 from blocking the original PC applications displayed on the interface 402 of the PC 200 (such as My Computer, Recycle Bin, etc.), and prevent the mobile phone window 10 from blocking the upper right corner of the interface 402 of the PC 200
  • the PC s input method control menu, time and date setting menu, power management and other shortcut menu options displayed in the area.
  • the mobile phone 100 may specify the number of pixels included in the X-axis direction and the number of pixels included in the Y-axis direction for each window to be displayed according to the display area of the mobile phone to determine the size of the window displayed on the PC 200.
  • the display area of the mobile phone here is the largest area that can be used to display the interface of the mobile phone on the display screen of the mobile phone 100. As shown in Figure 9 (a), the display area of the mobile phone 100 is n ⁇ m.
  • the mobile phone window 10 on the PC 200 may have the same size as the display area (n ⁇ m) of the mobile phone.
  • the size of the mobile phone window 10 includes n pixels in the X-axis direction and m pixels in the Y-axis direction.
  • the mobile phone 100 may enlarge or reduce the display area (n ⁇ m) of the mobile phone according to a certain ratio, and then designate the size as the size of the mobile phone window 10 displayed on the PC 200.
  • the mobile phone window 10 on the PC 200 is used to display the main interface of the mobile phone 100, and the mobile phone window 10 may be the size of the display area (n ⁇ m) of the mobile phone enlarged by 1.5 times.
  • the mobile phone 100 specifies that the mobile phone window 10 includes 1.5 ⁇ n pixels in the X-axis direction and 1.5 ⁇ m pixels in the Y-axis direction.
  • the coordinates of the vertex O 1 of the first region are (2500, 500), the X-axis direction includes 400 pixels, and the Y-axis direction includes 1000 pixels. Pixels.
  • the process of creating the virtual area and the first area of the mobile phone 100 described above may be executed by the processor 110 of the mobile phone 100 in FIG. 1, or corresponding to the multi-screen framework service APK of the mobile phone 100 in the software architecture in FIG. Module to complete.
  • the process of creating a virtual area by the mobile phone 100 can be understood as determining the information of the virtual area
  • the process of determining the first area by the mobile phone 100 can be understood as determining the information of the first area.
  • This process is an internal execution process of the mobile phone 100 and does not need to It is displayed on the mobile phone 100, and the process is completed by the mobile phone 100, and there is no display on the PC 200.
  • the mobile phone 100 determines the information O 1 (2500, 500) of the first area, which includes 400 pixels in the X-axis direction and 1000 pixels in the Y-axis direction.
  • the mobile phone 100 encodes the information of the first area and the display content information of the first area to generate a first video stream.
  • the mobile phone 100 sends the first video stream to the PC 200.
  • the first video stream includes the information of the first area, which may specifically include the vertex coordinates, length, and width information of the first area in the display area of the PC 200.
  • the information of the first area may also include display level information of the mobile phone window 10.
  • the display level here is used to indicate which layer of the PC 200 the window is displayed in the current display method.
  • the PC 200 includes 3 mobile phone windows, the window displayed on the top layer is the first layer display, and the bottom layer The displayed window is the third level display.
  • the hierarchical information may not be sent by the mobile phone 100 to the PC 200, and the PC 200 uniformly manages the hierarchical display of each window according to the time of receiving each window information and the user's operation on the PC 200. For example, when the window 40 of the music application is displayed on the upper layer of the window 50 of the video application, when the user selects the window 50 of the video application on the PC, the PC 200 determines that the window 50 of the video application is displayed on the top layer.
  • the mobile phone window 10 may be displayed on the top layer of the PC 200 by default. Since the display content of the mobile phone window 10 may correspond to the main interface 401 of the mobile phone 100 or include the application program of the mobile phone 100, the mobile phone window 10 It is displayed on the top layer of the PC 200, which is convenient for the user to use, and the mobile phone window 10 is located on the display screen of the PC 200 near the right frame, which will not block the user from using the original PC 200 applications.
  • the display content information of the first area included in the first video stream is used by the PC 200 to display the content of the mobile phone 100 in the mobile phone window 10.
  • the PC 200 can fill the first area according to the display content information of the first area , So that the content displayed in the first area of the display screen of the PC 200 is a certain interface of the mobile phone 100.
  • the display content information of the first area includes the wallpaper of the main interface of the mobile phone 100, icons of all applications, The time, date, and weather window, and the operator name, network signal identification, power display information, etc. in the notification bar at the top of the interface of the mobile phone 100.
  • the display content information of the first area includes the wallpaper of the interface of the music application and the music application interface. Every control, song title, playback progress, singer picture, etc. on the interface.
  • the PC 200 may also display its own currently running application-related windows.
  • the display screen of the PC 200 displays a web page window opened by the user on the PC 200.
  • the mobile phone window 10 appears on the display screen of the PC 200 for the first time, it is displayed on the uppermost layer, which is convenient for the user's operation. If the user does not use the application in the mobile phone window 10 at this time, and continues to use the open web page window of the PC 200, he can click anywhere on the web page window to display the web page window on the top layer of the PC 200, and the mobile phone window 10 moves down one layer. (The second level display).
  • the user can also hide the mobile phone window 10 by clicking the hide to side border button 11-1 or hide to the menu bar button 11-2 in the gray menu bar 11 of the mobile phone window 10.
  • the mobile phone window 10 is temporarily not displayed in On the PC 200's display screen.
  • the encoding process of the above first video stream may be participated by the MSDP service APK of the mobile phone 100 introduced in FIG. 3, and the MSDP service APK may implement functions including video stream encoding.
  • the multi-screen frame service APK of the mobile phone 100 may send the determined information of the first area and the display content information of the first area to the MSDP service APK, and the MSDP service APK will display the information of the first area and the display content of the first area.
  • the content information is encoded into the first video stream.
  • the coding process of the video stream will not be repeated here.
  • the first video stream can be transmitted through a dedicated video stream channel provided by the MSDP service, or through a channel established in the process of establishing a connection between the mobile phone 100 and the PC 200 in step 701, which is not done in this embodiment of the application. limited. It should be understood that the first video stream has a data format that can be parsed by both the mobile phone 100 and the PC 200, and will not be repeated here.
  • Step 805 may correspond to the process performed by the mobile phone 100 shown in (b) in FIG. 9, and the process is also a process of internally encoding a video stream in the mobile phone 100.
  • the PC 200 receives and decodes the first video stream, and obtains the information of the first area and the display content information of the first area.
  • the PC 200 displays the mobile phone window 10 in the corresponding area according to the information of the first area, and displays the corresponding content in the mobile phone window 10 according to the display content information of the first area.
  • the PC 200 receives the first video stream sent by the mobile phone 100, and decodes the first video stream.
  • the decoding method corresponds to the encoding method of the mobile phone 100.
  • This process can be performed by the MSDP service APK of PC 200, and the information of the first area obtained after decoding the first video stream is sent to the multi-screen framework service APK, which is determined by the multi-screen framework service APK according to the information of the first area
  • the vertex coordinates, length, and width information of the mobile phone window 10 on the display screen of the PC 200 are used to determine the display area of the mobile phone window 10.
  • the PC 200 also obtains the display content information of the first area from the first video stream.
  • the PC 200 can fill the mobile phone window 10 according to the display content information of the first area, so that the content displayed on the mobile phone window 10 of the PC 200 display
  • the interface can be the main interface of the mobile phone 100, or the interface of any application of the mobile phone 100
  • the display content information of the first area includes the wallpaper of the music application interface, and everything on the music application interface. A control, song title, playback progress, artist picture, etc.
  • the MSDP service APK sends the acquired display content information of the first area to the multi-screen framework service APK, and finally the mobile phone window display of the multi-screen framework service APK module according to the first area
  • the display content information shows the corresponding interface content.
  • the mobile phone window 10 can be displayed on the display screen of the PC 200, and the mobile phone window 10 can display the main interface of the mobile phone 100, or simultaneously display any interface of the mobile phone 100 during the user's use.
  • the PC 200 may display the mobile phone window 10 on the main interface 402, and the display content of the mobile phone window 10 may continuously display the main interface of the mobile phone 100, or, as shown in the figure As shown in Figure 4 (b), the display content of the mobile phone window 10 of the PC 200 can be synchronized with the mobile phone 100, which is the interface of the music application.
  • Steps 807-808 may correspond to the process performed by the mobile phone 100 shown in (c) in FIG. 9.
  • the PC 200 corresponds the vertex coordinates, length, and width of the first area in the virtual area to the corresponding position of the display screen of the PC 200.
  • the position corresponding to the first area is the display area of the mobile phone window 10.
  • the mobile phone window 10 The coordinates of the display screen of the PC 200 are the coordinates of the first area in the virtual area.
  • the mobile phone 100 can generate the first video stream through encoding together with the information of the virtual area, the information of the first area, and the information of the display content of the first area, and send it to the PC 200.
  • the PC 200 directly determines the position of the mobile phone window 10 on the display screen of the PC 200 according to the position of the first area in the virtual area, and displays the display content of the first area on the mobile phone window 10.
  • the mobile phone 100 only encodes the information of the display area (n ⁇ m) of the mobile phone to generate the first video stream in step 805, and sends the first video stream to the PC 200.
  • the PC 200 determines the position and size of the mobile phone window 10 for displaying the main interface of the mobile phone according to the information of the display area (n ⁇ m) of the mobile phone.
  • the method for the PC 200 to determine the position and size of the mobile phone window 10 may refer to the aforementioned process of the mobile phone 100 determining the vertex coordinates, the number of pixels in the X-axis direction, and the number of pixels in the Y-axis direction of the first region. No longer.
  • the PC 200 may also determine the position and size of the window 40 for displaying the music application according to the information of the interface of the mobile phone displaying the music application sent by the mobile phone 100.
  • the coordinates of the window 40 of the music application can be sent by the PC 200 to the mobile phone 100, and the mobile phone 100 can update the coordinate information of the window 40 of the music application.
  • the information interaction between the mobile phone 100 and the PC 200 is real-time.
  • the PC 200 can inform the mobile phone 100 of the changed window position and size.
  • the window information of the music application can be accurately obtained at any time.
  • the process can be participated by the window coordinate synchronization module of the MSDP service APK of the mobile phone 100 introduced in Figure 3, and the mobile phone 100 can learn in real time the status of each application window displayed on the PC 200.
  • the location, the location of the functional controls included in each application, etc., further realize the application that the user can use and operate the mobile phone 100 on the PC 200.
  • Fig. 10 is a schematic flowchart of another example of a method for displaying multiple windows provided by an embodiment of the present application.
  • the process shown in Fig. 10 can be performed after the process shown in Fig. 8, in other words, when the display screen of the PC 200 has already displayed After the mobile phone window 10, the process shown in FIG. 10 can be continued.
  • the process 1000 may correspond to the process shown in (a) in FIG. 6, where the user performs operations on the mobile phone music application on the mobile phone 100, and responds to the user's operations on the mobile phone 100, except for the original mobile phone on the PC 200.
  • a window 40 of a music application may also be displayed.
  • the method 1000 may include the following steps:
  • the mobile phone window 10 is displayed on the display of the PC 200.
  • the mobile phone 100 receives the user's first operation and runs a music application.
  • the first operation may be a user's click operation on the music application on the mobile phone 100.
  • the mobile phone 100 opens and enters the music application, that is, the mobile phone 100 may display an interface of the music application. Therefore, the music application running here can be running in the foreground, that is, the display screen of the mobile phone 100 displays the interface of the music application. 1003.
  • the mobile phone 100 determines the second area in the virtual area in step 803, and obtains the display content information of the second area.
  • step 803 the size of the virtual area created by the mobile phone 100 is the same as the size of the display screen of the PC 200, and the mobile phone 100 has determined the first area for the mobile phone window 10 in the virtual area. In this step 1003, the mobile phone 100 determines the second area of the window 40 of the music application in the created virtual area.
  • FIG. 11 is a schematic diagram of another example of creating a virtual area by the mobile phone 100 according to an embodiment of the present application. Steps 1003-1004 may correspond to the process performed by the mobile phone 100 shown in (a) in FIG. 11.
  • the mobile phone 100 creates a virtual area shown by a dotted line in step 803.
  • the coordinate origin of the virtual area is O(0,0), and the X-axis direction contains 3000 Pixels, the Y-axis direction contains 2000 pixels.
  • the mobile phone 100 determines the position and size of the mobile phone window 10 according to various possible methods. Similarly, the mobile phone 100 can also determine the position and size of the window displaying the application for each application.
  • the initial vertex coordinates of the window displaying each application on the PC 200 can be set by the mobile phone 100, and the number of pixels included in the X-axis direction and the number of pixels included in the Y-axis direction can also be set by the mobile phone 100. .
  • the mobile phone 100 can specify the initial vertex coordinates, the number of pixels included in the X-axis direction, and the number of pixels included in the Y-axis direction for the window 40 of the music application to be displayed according to the information of the display area (n ⁇ m) of the mobile phone 100.
  • the window 40 of the music application on the PC 200 is used to display the interface of the music application of the mobile phone.
  • the window 40 of the music application may have the same size as the display area (n ⁇ m) of the mobile phone.
  • the music application The number of pixels included in the window 40 in the X-axis direction is n, and the number of pixels included in the Y-axis direction is m.
  • the X-axis coordinate of the vertex O 2 of the music application window 40 is: the X-axis coordinate of O 1 minus n .
  • Y-axis coordinate vertex O 2 and O may be the same coordinate axis Y 1, or Y-axis coordinate is: O Y-axis coordinate of a plus Y-axis dimension of the window 10 of the mobile phone, minus m.
  • the mobile phone 100 determines the second area of the window 40 of the music application, and the second area is in the X-axis direction. Including 400 pixels, including 500 pixels in the Y-axis direction, where 400 is equal to n, and 500 pixels are 0.5 ⁇ m. After the mobile phone 100 determines the size of the second area, it can further determine that the coordinates of the vertex O 2 are (2100, 1000), so as to ensure that the window 40 of the music application is close to the mobile phone window 10.
  • the window 50 of the video application on the PC 200 is used to display the interface of the video application of the mobile phone, and the window 50 of the video application may have the same size as the display area (n ⁇ m) of the mobile phone, and the In the display area (n ⁇ m) of the mobile phone, m is the number of pixels included in the X-axis direction, and n is the number of pixels included in the Y-axis direction.
  • the size of the window 50 of the video application can better adapt to the process of the user watching the video, and improve the user's viewing experience.
  • the mobile phone 100 can specify the number of pixels included in the X-axis direction and the number of pixels included in the Y-axis direction for the window 40 of the music application to be displayed based on the information of the display area (n ⁇ m) of the mobile phone 100 and a preset ratio relationship. number.
  • the window 40 of the designated music application of the mobile phone 100 includes 1.5 ⁇ n pixels in the X-axis direction and 1.5 ⁇ m pixels in the Y-axis direction.
  • the mobile phone 100 may determine the number of pixels included in the X-axis direction and the number of pixels included in the Y-axis direction for the window 40 of the music application to be displayed according to the interface of the music application displayed when the mobile phone is running the music application. To determine the size of the window displayed on the PC 200. It should be understood that the interface for displaying the music application when the mobile phone is running the music application may be smaller than the display area of the mobile phone 100 by n ⁇ m. For example, the size of the interface for displaying the music application when the mobile phone is running the music application is p ⁇ q.
  • the values of n and m can be obtained by the mobile phone 100 according to the information on the display, and the values of p and q can be the information obtained when the mobile phone 100 installs the installation package of the music application, or the mobile phone 100
  • the configuration information of the music application is not limited in the embodiment of the present application.
  • the size of the window 40 of the music application may be the same as the size of the interface (p ⁇ q) of the mobile phone 100 displaying the music application.
  • the number of pixels included in the X-axis direction of the window 40 of the music application is p
  • the number of pixels included in the Y-axis direction is q.
  • the X-axis coordinate of the vertex O 2 of the music application window 40 is: the X-axis coordinate of O 1 minus p .
  • Y-axis coordinate vertex O 2 and O may be the same coordinate axis Y 1, or Y-axis coordinate is: O Y-axis coordinate of a plus Y-axis dimension of the window 10 of the mobile phone, minus q.
  • the mobile phone 100 determines the number of pixels included in the X-axis direction and the number of pixels included in the Y-axis direction according to a preset rule. For example, if the mobile phone 100 determines the initial vertex coordinates, according to a preset rule, the number of pixels included in the X-axis direction and the number of pixels included in the Y-axis direction can be determined.
  • the principle of setting the initial coordinates of the window 40 of the first music application to start and run may be: the right frame of the music application window 40 is close to the left frame of the mobile phone window 10, and the mobile phone window 10 is not blocked. content.
  • the principle for setting the initial coordinates of the window 50 of the second video application that is started and running may be: the right border of the window 50 of the video application is close to the left border of the window 40 of the music application, and the content of the window 40 of the music application is not blocked. . Or, the right border of the window 50 of the second started and running video application is still close to the left border of the mobile phone window 10, and the window 50 of the second started and running video application is located in the first started and running music The upper layer of the window 40 of the application. It should be understood that since the user is currently clicking on a video application, if the window 50 of the video application overlaps with the window 40 of the music application, the window 50 of the video application is displayed on the upper layer of the window 40 of the music application. The window 50 of the application, the window 50 of the music application is then displayed on the upper layer of the window 50 of the video application.
  • the display of the music application window 40 is close to the left frame of the mobile phone window 10, and the music application window 40 is located at the upper frame boundary of the display screen of the PC 200 And the middle of the lower border.
  • the setting of the initial coordinates can prevent the window 40 of the music application from blocking the window 10 of the mobile phone, so that the user can continue to use the application in the window 10 of the mobile phone.
  • the mobile phone 100 has determined the information of the second area, and can also obtain the display content information of the second area for the PC 200 to display the interface content of the music application of the mobile phone 100 in the window 40 of the music application.
  • the PC 200 The second area may be filled according to the display content information of the second area, so that the content displayed in the second area of the display screen of the PC 200 is the interface content of the music application of the mobile phone 100.
  • the information of the second area may also include identification information of a music application.
  • the identification information of the music application is used to identify that the window is a window for a music application, and both the PC 200 and the mobile phone 100 can determine that the window is a window of the music application.
  • the PC 200 can determine that it is an operation for the music application, so that the operation can be accurately transmitted back to the mobile phone 100 in the subsequent.
  • the mobile phone 100 and the PC 200 may also determine the application corresponding to each window in other ways, or determine the application corresponding to the operation performed by the user in the window, so as to accurately provide the service.
  • the information of the second area further includes display level information.
  • the display level here is used to indicate which level of the PC 200 the window 40 of the music application is displayed in the current display method.
  • the music application is displayed as the first level, that is, The top display of the PC 200's display screen.
  • the chat application window on the PC 200 display is displayed on the first layer
  • the video application window is displayed on the second layer
  • the music application window is displayed on the second layer.
  • the window is displayed on the third level.
  • the user clicks on the window of the music application again at this time, the window of the music application is displayed at the top level, which is not repeated in this embodiment of the application.
  • the mobile phone 100 encodes the identification information of the music application, the information of the second area, and the display content information of the second area to generate a second video stream.
  • step 1005 may correspond to the process performed by the mobile phone 100 shown in Figure 11 (b). This process is also a process of internally encoding a video stream in the mobile phone 100.
  • the multi-screen framework service APK sends the determined identification information of the music application, the information of the second area, and the display content information of the second area to the MSDP service APK, and the MSDP service APK sends the information of the second area and the display content of the second area.
  • the information is encoded into a second video stream.
  • the mobile phone 100 sends the second video stream to the PC 200.
  • the PC 200 receives and decodes the second video stream, and obtains the identification information of the music application, the information of the second area, and the display content information of the second area.
  • the PC 200 displays the window 40 of the music application in the corresponding area according to the information of the second area and the display content information of the second area.
  • Step 10061007 may correspond to the process performed by the mobile phone 100 shown in (c) in FIG. 11.
  • the mobile phone window 10 and the music application window 40 can be displayed on the display screen of the PC 200.
  • the PC 200 may display the mobile phone window 10 and the music application window 40 on the main interface 402
  • the display content of the mobile phone window 10 may be the main interface of the mobile phone 100.
  • the display content of the window 40 of the music application may be the interface of the music application of the mobile phone 100.
  • the user starts the music application on the mobile phone 100 and runs the music application in the foreground.
  • step 1007 the window 40 of the music application is displayed on the PC 200.
  • the user starts and runs the music application in the foreground to the completion of step 1007, even if the user exits to the main interface or switches to other applications on the mobile phone 100, the music application is running in the background and will not affect the PC
  • the progress of the window 40 of the music application on 200 is displayed.
  • the window 10 may be displayed as an interface of a music application or a window 40 of a music application may be displayed on the PC 200.
  • the actual playback of music audio can be based on the principle of “who starts who plays”. Specifically, for the music application that the user clicks on the mobile phone 100, the device that actually plays the music audio is the mobile phone 100.
  • the user can play music by clicking the music application 14 in the mobile phone window 10 of the PC 200, as shown in Figure 6 (a), and the music application window 40 is displayed on the PC 200, and the mobile phone window 10 can also be displayed as a music application ,
  • the device that actually plays music and audio at this time is PC 200.
  • the device that actually plays music and audio when the music application is running is the mobile phone 100.
  • the PC 200 can display the interface 402 as shown in (a) in FIG. 7.
  • the actual playback device of the video is PC 200.
  • the mobile phone 100 sends the video content information in the window 50 of the video application through the video stream, after the video content information is acquired by the PC 200, it is played by the PC 200’s display, speakers and other playback devices.
  • 100 is running in the background, so the music being played on the original mobile phone 100 may not be affected.
  • the device for playing music and videos is the PC 200.
  • the principle of audio preemption can refer to the solution of the prior art. For example, if the priority of the video application running later is higher, the audio playback of the music is automatically paused, which is not limited in the embodiment of the present application.
  • the process of displaying two windows (the phone window 10 and the music application window 40) on the PC 200 is described above.
  • the user may have already run more applications for the mobile phone 100, such as video applications, For chat applications, office software applications, etc., multiple windows can be displayed on the PC 200, and each window corresponds to a different mobile phone application, so I won’t repeat them here.
  • the content of the mobile phone 100 can be displayed through the PC 200.
  • multiple windows can be displayed on the PC 200, and each window is used to display a different application.
  • each window can receive user operations, such as closing, moving, zooming, window maximizing, window minimizing, etc.; and the user can display in the window corresponding to each mobile phone application displayed on the PC 200, Perform operations on the mobile phone application, for example, the user clicks on controls such as play music and next music in the window of the music application of the PC 200 to control the music playing process.
  • the user's operation of the mobile phone application on the PC 200 does not affect the user's use of other functions of the mobile phone 100.
  • the aforementioned user uses the mobile phone 100 to play music while using the PC 200 to watch videos. This method can improve office efficiency such as file sharing, and improve user experience.
  • the mobile phone 100 encodes the identification information of the different applications running, the vertex coordinates, length, and width of the window displaying the application on the PC 200, and forms the video stream through encoding.
  • the identification information of the music application, the vertex coordinates, length, and width of the window 40 displaying the music application on the PC 200, and the identification information of the video application, the vertex coordinates, length, and width of the window 50 displaying the video application on the PC 200 The information is encoded in a video stream, and the video stream is sent to the PC 200. After the PC 200 receives the video stream and decodes it, it distinguishes the different information to accurately display the interface content of the music application in the music application. In the window 40 of the video application, the interface content of the video application is displayed in the window 50 of the video application.
  • the one video stream is a video stream sent through a video stream transmission channel. If the video transmission channel meets the transmission conditions, it can also be encoded in multiple channels.
  • the identification information of the music application, the vertex coordinates, length, and width of the window 40 displaying the music application on the PC 200 are encoded into a video stream.
  • Sent through a video stream transmission channel; the identification information of the video application, the vertex coordinates, length, width and other information of the window 50 displaying the video application on the PC 200 are encoded into another video stream and sent through another video stream transmission channel.
  • this method of encoding all the way can save the power consumption of the mobile phone, and does not limit the number of windows of the mobile phone application displayed on the PC 200.
  • the mobile phone 100 sends the location information of the first window and the display content information of the first interface to the PC 200, and the PC 200 displays the first window according to the instructions prepared by the mobile phone 100.
  • the mobile phone 100 may not obtain the size information of the display area of the PC 200, but only send the display content information of the first interface of the mobile phone 100, and the PC 200 determines the position information of the first window and displays the first window.
  • the display of the second window can also be determined by the PC 200.
  • the PC 200 can determine the display position of the first window and the second window according to its own application usage, interface content, etc., which can better adapt to the use process of the PC 200, reduce the impact on the use of the PC 200, and improve users Experience.
  • 10 and 11 described above when the mobile phone window 10 has been displayed on the display of the PC 200 the user can click the music application on the interface of the mobile phone 100, and the music application window 40 can be displayed on the PC 200.
  • the user can click the music application 14 on the mobile phone window 10 of the PC 200, or display the music application window 40 on the PC 200.
  • FIG. 12 is a schematic flowchart of another example of a method for displaying multiple windows according to an embodiment of the present application. As shown in FIG. 12, the method 1200 may include the following steps:
  • the mobile phone window 10 is displayed on the display of the PC 200.
  • the PC 200 receives the second operation of the user, and determines operation information of the second operation.
  • the user clicks and runs the music application 14 in the mobile phone window 10 of the PC 200 as an example for description.
  • the second operation may be an operation that acts on an application to start the application.
  • the first operation and the second operation in the embodiment of the present application may be different operations for different devices.
  • the user can perform a single-click operation or double-click operation through peripheral input devices such as a mouse and a keyboard to run the music application; or, if the PC 200 is a device with a touch screen, the user can touch Click to run the music application.
  • the embodiment of the application does not limit the operation type of the second operation.
  • the operation information of the second operation includes an operation event for an application in the mobile phone window 10, and the operation information of the second operation may also include at least one information such as the name, ID, and icon of the music application.
  • the second operation is an operation event ("touch event").
  • touch event the second operation is an operation event
  • the PC 200 determines the name, ID, icon, and coordinates of the music application on which the "touch event” occurs, that is, determines the operation information of the aforementioned second operation.
  • the PC 200 sends the operation information of the second operation to the mobile phone 100.
  • the mobile phone 100 determines to run the music application according to the received operation information of the second operation.
  • the PC 200 transmits the "touch event” to the mobile phone 100, and the system of the mobile phone 100 determines the “touch event” and sends the "touch event” to the corresponding music application.
  • the music application of the mobile phone 100 determines the "touch event” "Used to click and run the music application. It should be understood that, for the mobile phone 100, running a music application can be running in the foreground, for example, the main interface 401 of the mobile phone 100 directly displays the interface of the music application; or running a music application can be running in the background, for example, the interface of the music application is not on the interface of the mobile phone 100 Display, only running in the background.
  • the mobile phone 100 sends the second video stream to the PC 200.
  • the PC 200 receives and decodes the second video stream, and obtains the identification information of the music application, the information of the second area, and the display content information of the second area.
  • the PC 200 displays the window 40 of the music application in the corresponding area according to the information of the second area and the display content information of the second area.
  • steps 1205-1209 described above can refer to steps 1003-10007 in FIG. 10, and the mobile phone 100 described in FIG.
  • the process of displaying the window 40 of the music application on the display screen will not be repeated here. So far, the music application of the mobile phone 100 can be run on the PC 200 according to the user's operation.
  • the PC 200 does not need to install the application of the mobile phone 100, and can display different applications of the mobile phone 100 through different windows.
  • the user can run the application of the mobile phone 100 on the PC 200 and display a window for each application.
  • the PC 200 can Display multiple windows at the same time.
  • FIG. 13 is a schematic flowchart of another example of a method for displaying multiple windows according to an embodiment of the present application. As shown in FIG. 13, the method 1300 may include the following steps:
  • the mobile phone 100 sends application information to the PC 200.
  • the PC 200 displays all the applications of the mobile phone 100 according to the obtained application information.
  • the mobile phone 100 can automatically send the information of all applications in the application layer shown in FIG. 3 to the PC 200.
  • the PC 200 is triggered to send a request to obtain an application to the mobile phone 100 for requesting to obtain application information of the mobile phone 100.
  • the application information here may include the names, identifications (IDs), icons and other information of all applications in the application layer.
  • the PC 200 After the PC 200 receives the application information, it displays the application in the mobile phone application window 30 according to the name, ID, and icon of each application, and then displays all the applications of the mobile phone 100. The display may be as shown in FIG. 5(c).
  • the identification of the application may be embodied as a package name, and the package name contains a character string, and the PC 200 can determine the music application based on the package name.
  • the PC 200 displays the application list of the mobile phone 100 on the mobile phone application window 30. All the applications in the application list are the applications installed on the mobile phone 100. The PC 200 does not need to install the mobile phone 100 applications, but only through the mobile phone.
  • the application window 30 displays icons of the application list of the mobile phone 100.
  • the PC 200 receives the user's third operation, and determines the operation information of the third operation.
  • the PC 200 sends the operation information of the third operation to the mobile phone 100.
  • the user can click on any application in the application list presented by the EMUJI desktop on the main interface 402 of the PC through peripheral input devices such as mouse and keyboard.
  • the PC can automatically pop up the application list. Run the application on the window of the clicked application.
  • the third operation may be a user's click operation on a certain control in a certain application window on the PC 200 to execute the function of the control.
  • the operation information of the third operation further includes at least one type of information such as the name, ID, and icon of a certain control of the interface of the music application.
  • the operation information of the third operation may include the event type of the third operation and the identification (ID) information of the function control of the third operation.
  • the PC 200 may send the "touch event” event of the click play control to the mobile phone 100, such as the window of the music application where the "touch event” occurred
  • the mobile phone 100 such as the window of the music application where the "touch event” occurred
  • the PC 200 transmits the "touch event” to the mobile phone 100, and the system of the mobile phone 100 determines that the "touch event” occurred in the music application according to the coordinates of the music application window 40, and sends the "touch event” to the corresponding music application ,
  • the music application determines that the "touch event” is used to click the play control according to the play control name, ID, icon, and coordinates on the PC 200. It should be understood that this process may be a background running process of the mobile phone 100.
  • the first operation, the second operation, and the third operation in the embodiments of the present application may be different operations for different devices.
  • the user can run the music application through touch and click operations;
  • the user can perform a single-click operation or double-click operation through peripheral input devices such as a mouse and a keyboard to run the music application.
  • Music application or, if the PC is a device with a touch screen, the user can run the music application by touching and clicking.
  • the embodiment of the present application does not limit the operation types of the first operation, the second operation, and the third operation.
  • the music application of the mobile phone 100 determines the operation result according to the operation information of the third operation, and executes the operation result.
  • the mobile phone 100 sends the operation result to the PC 200.
  • the PC 200 receives the operation result sent by the mobile phone 100, and synchronizes the operation result.
  • the process in which the mobile phone 100 sends the operation result to the PC 200 in step 1306 may correspond to the process in which the mobile phone 100 creates a virtual area in FIG. 9 and FIG. 11 and sends the first video stream to the PC 200, in other words, sends the operation
  • the result of the process can also rely on the sending process of the video stream.
  • the mobile phone 100 performs the operation of clicking the music playback control, it re-determines the first video stream according to the music application currently running on the mobile phone 100 (running in the background or running on the current mobile phone interface) for the PC 200 to display the window of the music application 40. That is, in the window 40 of the music application of the PC 200, the operation of clicking the music playback control is completed, such as pausing the music playback.
  • the music playback control changes to a pause state.
  • the above describes the returning of the user's operations from the PC 200 side to the mobile phone 100.
  • the user can also directly transmit the operations performed on the mobile phone 100 to the PC 200, which will not be repeated here.
  • the process of returning the operation can be participated by the reverse control module of the MSDP service APK of the mobile phone 100 and the PC 200, and it is ensured that the corresponding operations are performed synchronously on the mobile phone 100 and the PC 200.
  • the user can perform any control operation of the application in the window of the mobile phone application displayed on the PC 200.
  • the operation can be transmitted back to the mobile phone 100, and the result of the operation performed by the mobile phone 100 will be executed.
  • the result is then transmitted to the PC 200, so that the result of the operation performed by the mobile phone 100 can be synchronized in the window of the application on the PC 200, which improves the use efficiency and use experience of the mobile application.
  • electronic devices such as mobile phones and PCs include hardware and/or software modules corresponding to each function.
  • the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Those skilled in the art can use different methods for each specific application in combination with the embodiments to implement the described functions, but such implementation should not be considered as going beyond the scope of the embodiments of the present application.
  • the electronic device may be divided into functional modules according to the foregoing method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • This embodiment also provides a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions run on an electronic device, the electronic device executes the above-mentioned related method steps to implement the steps in the above-mentioned embodiment The method of displaying multiple windows.
  • This embodiment also provides a computer program product, which when the computer program product runs on a computer, causes the computer to execute the above-mentioned related steps, so as to realize the method for displaying multiple windows in the above-mentioned embodiment.
  • the embodiments of the embodiments of the present application also provide a device.
  • the device may specifically be a chip, component or module.
  • the device may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the device is running At this time, the processor can execute the computer-executable instructions stored in the memory, so that the chip executes the method for displaying multiple windows in the foregoing method embodiments.
  • the electronic device, computer storage medium, computer program product, or chip provided in this embodiment are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the corresponding method provided above. The beneficial effects of the method will not be repeated here.
  • the disclosed device and method may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of modules or units is only a logical function division.
  • there may be other division methods for example, multiple units or components may be combined or It can be integrated into another device, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product, and the software product is stored in a storage medium. It includes a number of instructions to enable a device (may be a single-chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods in the embodiments of the present application.
  • the foregoing storage media include: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)
  • Digital Computer Display Output (AREA)

Abstract

本申请实施例提供了一种显示多窗口的方法、第一电子设备和第二电子设备，该方法应用于相互通信的第一电子设备和第二电子设备，当手机上运行多个应用时，在PC上可以显示手机的多个窗口，每个窗口对应显示不同的应用。其中，用户可以通过PC上显示的每个手机应用对应的窗口，执行对该手机应用的操作。此外，用户在PC上对手机应用的操作不影响用户对手机的其他功能的使用，提高了文件共享等办公效率，提高了用户体验。

Description

显示多窗口的方法、电子设备和系统
本申请要求于2019年12月26日提交中国专利局、申请号为201911366233.2、申请名称为“显示多窗口的方法、电子设备和系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及电子技术领域，尤其涉及一种显示多窗口的方法、电子设备和系统。
背景技术
移动办公在办公场景的占比越来越大，随着手机的广泛使用，手机已经成为移动办公的主要设备之一，因此，手机和个人电脑(personal computer，PC)之间的互连的需求越来越多，例如，手机和PC文件的互通，手机投屏在PC的显示屏等。
现有的一种将手机界面显示到PC的方案中，在手机和PC之间建立连接之后，通过屏幕共享软件，可以实现PC与手机之间轻松共享屏幕内容与数据，用户可以通过PC接收手机上的通知事件，并在PC上使用手机的多种功能。例如，用户使用该屏幕共享软件连接PC和手机后，可以通过PC接收手机的通知，例如通过PC拨打电话，通过弹出式窗口轻松接听来电，或者收发信息；或者，用户可以查看来电警报；又或者，用户可以在PC和手机之间实现文件共享。可选地，用户通过拖放操作，即可在PC和手机之间快速分享文件和文本内容。示例性的，用户在PC的Word文档中插入手机中的照片，或者，在发送文本信息或电子邮件的同时，在手机上插入PC上的文件。该屏幕共享软件主要通过镜像的方式，将手机屏幕显示的所有内容(例如应用界面)均显示在PC的一个窗口中，无法实现多窗口的显示。
发明内容
本申请提供一种显示多窗口的方法、电子设备和系统，该方法能够在PC上可以显示手机的多个窗口，用户可以通过PC上显示的每个手机应用对应的窗口，执行对该手机应用的操作，从而提高文件共享等办公效率，提高了用户体验。
第一方面，提供了一种显示多窗口的方法，应用于包括相互通信的第一电子设备和第二电子设备的系统中，该方法包括：第一电子设备接收第二电子设备的显示区域的尺寸信息；第一电子设备运行第一应用并显示该第一应用的第一界面；第一电子设备根据第二电子设备的显示区域的尺寸信息和该第一界面对应的尺寸信息，确定该第一界面在第二电子设备的显示区域中的第一窗口的位置信息；第一电子设备将该第一窗口的位置信息和该第一界面的显示内容信息发送给第二电子设备；第二电子设备根据接收的该第一窗口的位置信息和该第一界面的显示内容信息，在该第一窗口显示该第一界面；若第二电子设备检测到第一操作，响应于该第一操作，向第一电子设备发送启动第二应用的指令；第一电子设备根据接收的启动该第二应用的指令，启动该第二应用；第一电子设备根据第二电子设备 的显示区域的尺寸信息和该第二应用的第二界面对应的尺寸信息，确定该第二界面在第二电子设备的显示区域中的第二窗口的位置信息；第一电子设备将该第二窗口的位置信息和该第二界面的显示内容信息发送给第二电子设备；第二电子设备根据接收的该第二窗口的位置信息和该第二界面的显示内容信息，在该第二窗口显示该第二界面，该第一窗口与该第二窗口为不同的窗口。
应理解，在本申请实施例中，“显示多窗口”可以理解为“显示多界面”，每个窗口显示不同的界面。例如，PC通过不同的窗口显示手机的多个界面，如第一界面和第二界面，每个界面都是可以独立控制的界面，如用户对第一界面的操作和第二界面的操作相互独立。
还应理解，第一电子设备和第二电子设备相互通信可以可以有多种不同的方式，例如通过连接的方式或者借助于未来通信技术的方式进行通信以传输数据。其中，连接的方式可以包括有线连接或者无线连接等多种不同连接方式。示例性的，第一电子设备和第二电子设备之间可以是通过USB数据线连接；第一电子设备和第二电子设备之间的无线连接可以是通过建立Wi-Fi连接、近场通信的靠近连接、蓝牙扫码连接等。第一电子设备和第二电子设备还可以借助于未来通信技术的方式，例如通过在手机和PC上安装不同或相同的应用，借助于5G通信网络传输数据，本申请实施例对手机和PC之间的连接方式不做限定。
还应理解，本申请实施例对第一电子设备接收第二电子设备的显示区域的尺寸信息的动作和第一电子设备运行第一应用并显示该第一应用的第一界面的动作的先后顺序不做限定。例如，第一电子设备可以先运行第一应用并显示该第一应用的第一界面，当用户将通过第二电子设备显示第一电子设备的第一界面时，再触发第一电子设备从第二电子设备获取第二电子设备的显示区域的尺寸信息的动作；或者，第二电子设备先将第二电子设备的显示区域的尺寸信息发送给第一电子设备，第一电子设备再运行第一应用并显示该第一应用的第一界面，并执行之后的其他动作。
还应理解，第一电子设备根据接收第二电子设备发送的启动该第二应用的指令，启动该第二应用时，可以显示该第二应用的第二界面，即第一电子设备为前台运行该第二应用；或者不显示该第二应用的第二界面，即第一电子设备为后台运行该第二应用，本申请实施例对此不做限定。
此外，第一应用和第二应用可以是安装于第一电子设备的应用，或者可以即时运行的快应用，本申请实施例对此不做限定。
以手机作为第一电子设备，PC作为第二电子设备为例，通过上述方案，对于相互通信的手机和PC，可以通过PC显示手机的界面。当用户在手机上运行多个应用时，在PC上可以通过显示多个窗口，每个窗口用于显示不同的应用；或者，用户可以在PC上启动手机的应用，并通过独立的窗口显示该手机的应用，该方法可以提高文件共享等办公效率，且可以实现在PC上使用手机的应用，提高了用户体验。结合第一方面，在第一方面的某些实现方式中，该方法还包括：第一电子设备向第二电子设备发送该第一应用的第一信息和该第二应用的第二信息，该第一应用的第一信息包括该第一应用的名称、标识ID、图标的信息中的至少一个，该第二应用的第二信息包括该第二应用的名称、标识ID、图标的信息中的至少一个；第二电子设备接收该第一应用的第一信息和该第二应用的第二信息之后，自动显示第三界面，该第三界面包括该第一应用的第一信息和该第二应用的第二信 息；或者第二电子设备在检测到用户的第二操作后，根据该第一应用的第一信息和该第二应用的第二信息显示该第三界面。
应理解，以手机和PC建立连接为例，当手机和PC建立连接之后，手机可以将已安装所有应用的信息发送给PC，PC直接自动显示手机的应用。
或者，也可以当用户在PC上点击菜单窗口的EMUJI桌面菜单时，触发PC向手机发送获取应用的请求，用于请求获取手机的应用的信息，例如第一应用的第一信息和第二应用的第二信息。
这里手机的应用的信息可以包括手机所有应用的名称、标识(identification，ID)、图标等信息中的至少一种信息。PC接收到应用的信息之后，根据每一个应用的名称、ID、图标在PC的手机窗口显示该应用，进而显示手机的所有应用。
通过上述方案，可以实现在第二电子设备上显示第一电子设备的所有应用。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该第一窗口靠近第二电子设备的显示区域的右侧边缘。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该第二窗口位于该第一窗口的左侧，且与该第一窗口没有重叠。
通过上述方案，可以避免手机窗口遮挡PC的界面上显示的PC的原有应用程序(例如我的电脑、回收站等)，且避免手机窗口遮挡PC的界面上右下角区域显示的PC的输入法控制菜单、时间与日期设置菜单、电源管理等快捷菜单选项。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该第二窗口位于该第一窗口的上层。
可选地，在某些可能的实现方式中，该第一窗口的位置信息还可以包括该第一窗口的显示层级信息，该第二窗口的位置信息还包括该第二窗口的显示层级信息，且该第二窗口的显示位于该第一窗口的上一层级。换言之，该第一窗口的显示层级信息由第一电子设备发送给第二电子设备，第二电子设备根据该第一窗口的显示层级信息确定第一窗口应该显示在哪一层。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该第一窗口的位置信息包括：该第一窗口的第一顶点的坐标信息，该第一窗口的长度信息和该第一窗口的宽度信息；或者该第一窗口的位置信息包括：该第一窗口的四个顶点的坐标信息。同理，第二窗口的位置信息类似于第一窗口的位置信息。具体地，第二窗口的位置信息包括：该第二窗口的第二顶点的坐标信息，该第二窗口的长度信息和该第二窗口的宽度信息；或者该第二窗口的位置信息包括：该第二窗口的四个顶点的坐标信息。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该第一窗口的尺寸信息是第一电子设备根据该第一界面对应的尺寸信息确定；以及第一电子设备根据第二电子设备的显示区域的尺寸信息和该第一界面对应的尺寸信息，确定该第一界面在第二电子设备的显示区域中的第一窗口的位置信息之前，该方法还包括：第一电子设备获取第一电子设备的显示区域的尺寸信息，确定第一电子设备的显示区域的尺寸信息为该第一界面对应的尺寸信息，或者该第一界面对应的尺寸信息为第一电子设备的显示区域的尺寸信息和第一倍数的乘积，该第一倍数大于0且不等于1。
示例性的，第一电子设备在确定第一窗口的尺寸信息的过程中，可以根据自身显示第一界面的尺寸确定第一窗口的尺寸信息。例如第一窗口的尺寸大小和自身显示第一界面的 尺寸大小相同；或者按照一定的比例对自身显示第一界面的尺寸大小进行放大或者缩小，进而得到第一窗口的尺寸信息，该方法可以保证第一界面的内容显示到第二电子设备的第一窗口时，为用户提供如同使用第一电子设备时的显示效果，显示更自然，提高用户体验。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该第一窗口的尺寸信息是第一电子设备根据该第一界面对应的尺寸信息确定；以及第一电子设备根据第二电子设备的显示区域的尺寸信息和该第一界面对应的尺寸信息，确定该第一界面在第二电子设备的显示区域中的第一窗口的位置信息之前，该方法还包括：第一电子设备从该第一应用的配置信息中获取该第一界面在第一电子设备上显示时的尺寸信息，将该第一界面在第一电子设备上显示时的尺寸信息确定为该第一界面对应的尺寸信息；或者第一电子设备从网络设备获取该第一界面在第二电子设备上显示的尺寸信息，将该第一界面在第二电子设备上显示的尺寸信息确定为该第一界面对应的尺寸信息。
示例性的，第一电子设备可以通过不同的方式获取自身显示第一界面的尺寸信息。例如通过安装第一应用时，从第一应用的配置信息中获取，换言之，可以本地查询第一电子设备端第一应用的界面信息；或者，向网络设备请求查询第二电子设备端的界面信息，进而获取自身显示第一界面的尺寸信息。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，第一窗口包括该第一界面和第一菜单栏；和/或第二窗口包括该第二界面和第二菜单栏。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，第二菜单栏包括关闭按钮，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第二电子设备检测到用户对该关闭按钮的操作，第二电子设备关闭该第二窗口，并向第一电子设备发送关闭该第二应用的指令；第一电子设备根据该关闭该第二应用的指令，关闭该第二应用。结合第一方面和上述实现方式，在第一方面的某些实现方式中，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第二电子设备检测到用户选中该第一窗口的操作，第二电子设备将该第一窗口切换到最上层显示。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该第二菜单栏包括最大化按钮，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第二电子设备检测到用户对该最大化按钮的操作，第二电子设备将该第二窗口全屏显示。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第一电子设备检测到用户关闭该第二应用的指令；第一电子设备关闭该第二应用，并通知第二电子设备关闭该第二窗口；第二电子设备根据第一电子设备的通知关闭该第二窗口。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，该方法还包括：第二电子设备检测到对该第二窗口的选中并拖动操作，该第二窗口由第一位置移动到第二位置；第二电子设备向第一电子设备发送该第二位置的信息和该第二应用的信息；第一电子设备接收第二电子设备发送的该第二位置的信息和该第二应用的信息，根据该第二应用的信息确定该第二应用，并根据该第二位置的信息，确定该第二界面的显示内容的显示位置。
通过上述技术方案，PC上显示的每个应用的窗口都可以接收用户的操作，例如对窗口的关闭、移动、缩放、窗口最大化、窗口最小化等操作；且用户可以在PC上显示的每个手机应用对应的窗口中，执行对该手机应用的操作，例如用户在PC的音乐应用的窗口中点击播放音乐、下一曲等控件，控制音乐的播放过程。此外，用户在PC上对手机应用 的操作不影响用户对手机的其他功能的使用，例如前述的用户使用手机播放音乐，同时使用PC观看视频的场景。用户在PC显示的手机应用的窗口中，可以执行对该应用的任意控件的操作，该操作可以回传到手机，并由手机执行该操作的结果，并将执行的结果再传递给PC，使得PC上该应用的窗口中可以同步手机执行的该操作的结果，提高了手机应用的使用效率和使用体验。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，若该第一应用为音频播放应用，并且该第二应用也为音频播放应用，第一电子设备启动该第二应用之后，该方法还包括：第一电子设备将该第二应用的音频数据发送给第二电子设备；第二电子设备播放该第二应用的音频数据。
在一种可能的情况中，用户通过在手机端播放音乐，PC上可以显示音乐应用的窗口。同时，手机将音频数据发送给PC，由PC播放该音频数据。
可选地，音乐音频的实际播放可以按照“谁开启谁播放”原则，具体地，用户在手机上点击的音乐应用，则实际播放音乐音频的设备为手机。用户在PC的手机窗口通过音乐应用播放音乐，此时实际播放音乐音频的设备为PC。
结合第一方面和上述实现方式，在第一方面的某些实现方式中，第一电子设备将该第一窗口的位置信息和该第一界面的显示内容信息发送给第二电子设备，包括：第一电子设备将该第一窗口的位置信息和该第一界面的显示内容信息编码生成第一视频流，将该第一视频流发送给第二电子设备；第二电子设备接收第一电子设备发送的第一视频流，解码该第一视频流获取该第一窗口的位置信息和该第一界面的显示内容信息；以及，第一电子设备将该第二窗口的位置信息和该第二界面的显示内容信息发送给第二电子设备，包括：第一电子设备将该第二窗口的位置信息和该第二界面的显示内容信息编码生成第二视频流，发送给第二电子设备；第二电子设备接收第一电子设备发送的第二视频流，解码该第二视频流获取该第二窗口的位置信息和该第二界面的显示内容信息。
具体的实现过程中，可以借助于视频流的传输过程，手机将发送给PC的所有信息，通过编码形成视频流，例如将音乐应用的界面内容信息、PC上显示音乐应用的窗口的位置信息等，编码在视频流中，将该视频流发送给PC，PC收到视频流进行解码之后，准确地将音乐应用的界面内容显示在音乐应用的窗口中。
综上所述，本申请实施例提供的显示多窗口的方法，可以将手机的应用程序显示在PC的手机窗口中，或者显示在PC的菜单列表中，在PC不安装手机的应用的情况下，就可以在PC上被点击运行手机的应用，并使用该应用的功能，用户可以借助于PC的大屏体验使用手机的应用。该方法可以实现手机和PC的系统的融合，使得用户可以从PC的系统菜单调用手机安装的应用。
此外，该方法可以在PC上，实现多个手机应用同时独立并行，每一个应用可以在PC显示一个独立窗口，多个应用对应的多个窗口同时显示在PC的界面上，且运行手机的多个应用不影响用户使用手机的其他功能。例如用户在PC上使用手机的视频应用、音乐应用，可以同时使用手机收发短信或者拨打电话等；或者，用户使用鼠标、键盘等外设输入设备即可以操作手机，完全保留用户使用习惯，不用频繁在两个设备之间切换；通过PC的手机窗口运行手机的应用，提高了文件查阅、分享、办公的效率，提高了用户体验。
第二方面，提供了一种显示多窗口的方法，应用于包括相互通信的第一电子设备和第二电子设备的系统中，该方法包括：第一电子设备接收第二电子设备的显示区域的尺寸信 息；第一电子设备运行第一应用并显示该第一应用的第一界面；第一电子设备根据第二电子设备的显示区域的尺寸信息和该第一界面对应的尺寸信息，确定该第一界面在第二电子设备的显示区域中的第一窗口的位置信息；第一电子设备将该第一窗口的位置信息和该第一界面的显示内容信息发送给第二电子设备；第一电子设备接收第二电子设备发送的启动第二应用的指令，启动该第二应用；第一电子设备根据第二电子设备的显示区域的尺寸信息和该第二应用的第二界面对应的尺寸信息，确定该第二界面在第二电子设备的显示区域中的第二窗口的位置信息，该第一窗口与该第二窗口为不同的窗口；第一电子设备将该第二窗口的位置信息和该第二界面的显示内容信息发送给第二电子设备。
结合第二方面，在第二方面的某些实现方式中，该方法还包括：第一电子设备向第二电子设备发送该第一应用的第一信息和该第二应用的第二信息，该第一应用的第一信息包括该第一应用的名称、标识ID、图标的信息中的至少一个，该第二应用的第二信息包括该第二应用的名称、标识ID、图标的信息中的至少一个。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第一窗口靠近第二电子设备的显示区域的右侧边缘。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第二窗口位于该第一窗口的左侧，且与该第一窗口没有重叠。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第二窗口位于该第一窗口的上层。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第一窗口的位置信息包括：该第一窗口的第一顶点的坐标信息，该第一窗口的长度信息和该第一窗口的宽度信息；或者该第一窗口的位置信息包括：该第一窗口的四个顶点的坐标信息。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第一窗口的尺寸信息是第一电子设备根据该第一界面对应的尺寸信息确定；以及第一电子设备根据第二电子设备的显示区域的尺寸信息和该第一界面对应的尺寸信息，确定该第一界面在第二电子设备的显示区域中的第一窗口的位置信息之前，该方法还包括：第一电子设备获取第一电子设备的显示区域的尺寸信息，确定第一电子设备的显示区域的尺寸信息为该第一界面对应的尺寸信息，或者该第一界面对应的尺寸信息为第一电子设备的显示区域的尺寸信息和第一倍数的乘积，该第一倍数大于0且不等于1。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第一窗口的尺寸信息是第一电子设备根据该第一界面对应的尺寸信息确定；以及第一电子设备根据第二电子设备的显示区域的尺寸信息和该第一界面对应的尺寸信息，确定该第一界面在第二电子设备的显示区域中的第一窗口的位置信息之前，该方法还包括：第一电子设备从该第一应用的配置信息中获取该第一界面在第一电子设备上显示时的尺寸信息，将该第一界面在第一电子设备上显示时的尺寸信息确定为该第一界面对应的尺寸信息；或者第一电子设备从网络设备获取该第一界面在第二电子设备上显示的尺寸信息，将该第一界面在第二电子设备上显示的尺寸信息确定为该第一界面对应的尺寸信息。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第一窗口包括该第一界面和第一菜单栏；和/或该第二窗口包括该第二界面和第二菜单栏。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该第二菜单栏包括关闭按钮，该方法还包括：第一电子设备接收第二电子设备发送的关闭该第二应用的指令； 检测到用户对该关闭按钮的操作，第二电子设备关闭该第二窗口，并向第一电子设备响应于该关闭该第二应用的指令，第一电子设备关闭该第二应用。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，该方法还包括：若第一电子设备检测到用户关闭该第二应用的指令；第一电子设备关闭该第二应用，并向第二电子设备发送关闭该第二窗口的指令。
结合第二方面和上述实现方式，在第二方面的某些实现方式中，若该第一应用为音频播放应用，并且该第二应用也为音频播放应用，第一电子设备启动该第二应用之后，该方法还包括：第一电子设备将该第二应用的音频数据发送给第二电子设备。
第三方面，提供了一种显示多窗口的方法，应用于包括相互通信的第一电子设备和第二电子设备的系统中，该方法包括：第二电子设备接收第一电子设备发送的第一窗口的位置信息和第一界面的显示内容信息，该第一界面是第一电子设备运行第一应用并显示的界面；第二电子设备根据该第一窗口的位置信息和该第一界面的显示内容信息，在第二电子设备的显示区域的该第一窗口显示该第一界面；若第二电子设备检测到第一操作，响应于该第一操作，向第一电子设备发送启动第二应用的指令；第二电子设备接收第一电子设备发送的第二窗口的位置信息和第二界面的显示内容信息，该第二界面是该第二应用的界面，该第一窗口与该第二窗口为不同的窗口；第二电子设备根据该第二窗口的位置信息和该第二界面的显示内容信息，在第二电子设备的显示区域的该第二窗口显示该第二界面。
结合第三方面，在第三方面的某些实现方式中，该方法还包括：第二电子设备接收第一电子设备发送的该第一应用的第一信息和该第二应用的第二信息，该第一应用的第一信息包括该第一应用的名称、标识ID、图标的信息中的至少一个，该第二应用的第二信息包括该第二应用的名称、标识ID、图标的信息中的至少一个；第二电子设备自动显示第三界面，该第三界面包括该第一应用的第一信息和该第二应用的第二信息；或者第二电子设备在检测到用户的第二操作后，根据该第一应用的第一信息和该第二应用的第二信息显示该第三界面。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第一窗口靠近第二电子设备的显示区域的右侧边缘。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第二窗口位于该第一窗口的左侧，且与该第一窗口没有重叠。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第二窗口位于该第一窗口的上层。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第一窗口的位置信息包括：该第一窗口的第一顶点的坐标信息，该第一窗口的长度信息和该第一窗口的宽度信息；或者该第一窗口的位置信息包括：该第一窗口的四个顶点的坐标信息。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第一窗口的尺寸信息是第一电子设备根据该第一界面对应的尺寸信息确定的；以及该第一界面对应的尺寸信息为第一电子设备的显示区域的尺寸信息，或者该第一界面对应的尺寸信息为第一电子设备的显示区域的尺寸信息和第一倍数的乘积，该第一倍数大于0且不等于1。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第一窗口的尺寸信息是第一电子设备根据该第一界面对应的尺寸信息确定的；以及该第一界面对应的尺寸信息为该第一界面在第一电子设备上显示时的尺寸信息，或者该第一界面对应的尺寸信息为 第一电子设备从网络设备获取该第一界面在第二电子设备上显示的尺寸信息。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第一窗口包括该第一界面和第一菜单栏；和/或该第二窗口包括该第二界面和第二菜单栏。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第二菜单栏包括关闭按钮，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第二电子设备检测到用户对该关闭按钮的操作，第二电子设备关闭该第二窗口，并向第一电子设备发送关闭该第二应用的指令。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第二电子设备检测到用户选中该第一窗口的操作，第二电子设备将该第一窗口切换到最上层显示。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，该第二菜单栏包括最大化按钮，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第二电子设备检测到用户对该最大化按钮的操作，第二电子设备将该第二窗口全屏显示。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，第二电子设备在该第二窗口显示该第二界面之后，该方法还包括：若第二电子设备接收到第一电子设备发送的关闭该第二窗口的指令；响应于该关闭该第二窗口的指令，第二电子设备关闭该第二窗口。
结合第三方面和上述实现方式，在第三方面的某些实现方式中，若该第一应用为音频播放应用，并且该第二应用也为音频播放应用，该方法还包括：第二电子设备接收第一电子设备发送的该第二应用的音频数据，播放该第二应用的音频数据。
第四方面，提供了一种显示多窗口的方法，应用于包括相互通信的第一电子设备和第二电子设备的系统中，该方法包括：第一电子设备运行第一应用并显示该第一应用的第一界面；第一电子设备将第一界面对应的尺寸信息和该第一界面的显示内容信息发送给第二电子设备；第二电子设备根据第二电子设备的显示区域的尺寸信息和该第一界面对应的尺寸信息，确定第一窗口的位置信息，并根据该第一窗口的位置信息和第一界面的显示内容信息，在该第一窗口显示该第一界面；若第二电子设备检测到第一操作，响应于该第一操作，向第一电子设备发送启动第二应用的指令；第一电子设备根据启动该第二应用的指令，启动该第二应用；第一电子设备将该第二应用的第二界面对应的尺寸信息和该第二界面的显示内容信息发送给第二电子设备；第二电子设备根据第二电子设备的显示区域的尺寸信息和该第二界面对应的尺寸信息，确定第二窗口的位置信息，并根据该第二窗口的位置信息和第二界面的显示内容信息，在该第二窗口显示该第二界面，该第一窗口与该第二窗口为不同的窗口。
应理解，前述各个方面介绍了第一电子设备将第一窗口的位置信息和第一界面的显示内容信息发送给第二电子设备，由第二电子设备根据第一电子设备的指示显示第一窗口。可选地，第一电子设备可以不获取第二电子设备的显示区域的尺寸信息，而仅发送第一电子设备的第一界面的显示内容信息，由第二电子设备决定第一窗口的位置信息，并显示第一窗口。同理，第二窗口的显示也可以由第二电子设备决定，此处不再赘述。
通过上述方案，第二电子设备可以根据自身的应用使用情况、界面内容等决定第一窗口、第二窗口的显示位置，可以更好的适应第二电子设备的使用进程，降低对第二电子设备的使用影响，提高用户体验。
第五方面，本申请提供了一种装置，该装置包含在电子设备中，该装置具有实现上述 方面及上述方面的可能实现方式中电子设备行为的功能。功能可以通过硬件实现，也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块或单元。例如，显示模块或单元、检测模块或单元、处理模块或单元等。
第六方面，本申请提供了一种电子设备，包括：触摸显示屏，其中，触摸显示屏包括触敏表面和显示器；摄像头；一个或多个处理器；存储器；多个应用程序；以及一个或多个计算机程序。其中，一个或多个计算机程序被存储在存储器中，一个或多个计算机程序包括指令。当指令被电子设备执行时，使得电子设备执行上述任一方面任一项可能的实现中的显示多窗口的方法。
第七方面，本申请提供了一种电子设备，包括一个或多个处理器和一个或多个存储器。该一个或多个存储器与一个或多个处理器耦合，一个或多个存储器用于存储计算机程序代码，计算机程序代码包括计算机指令，当一个或多个处理器执行计算机指令时，使得电子设备执行上述任一方面任一项可能的实现中的显示多窗口的方法。
第八方面，提供了一种系统，该系统包括：执行上述任一方面任一项可能的实现中的显示多窗口的方法的第一电子设备和第二电子设备。
第九方面，本申请提供了一种计算机存储介质，包括计算机指令，当计算机指令在电子设备上运行时，使得电子设备执行上述任一方面任一项可能的显示多窗口的方法。
第十方面，本申请提供了一种计算机程序产品，当计算机程序产品在电子设备上运行时，使得电子设备执行上述任一方面任一项可能的显示多窗口的方法。
附图说明
图1是本申请实施例提供的一例第一电子设备的结构示意图。
图2本申请实施例提供的一例第二电子设备的结构示意图。
图3是本申请实施例的一例手机和PC的软件结构框图。
图4是本申请实施例提供的一例PC显示手机界面的示意图。
图5是本申请实施例提供的又一例PC显示手机界面的示意图。
图6是本申请实施例提供的又一例PC显示手机界面的示意图。
图7是本申请实施例提供的又一例PC显示手机界面的示意图。
图8是本申请实施例提供的显示多窗口的方法的示意性流程图。
图9是本申请实施例提供的手机创建虚拟区域的示意图。
图10是本申请实施例提供的又一例显示多窗口的方法的示意性流程图。
图11是本申请实施例提供的又一例手机创建虚拟区域的示意图。
图12是本申请实施例提供的又一例显示多窗口的方法的示意性流程图。
图13是本申请实施例提供的又一例显示多窗口的方法的示意性流程图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述。
其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；本文中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，在本申请实施例的描述中，“多个”是指两个或多于两个。
以下，术语“第一”、“第二”仅用于区分，例如“第一电子设备”和“第二电子设备”仅用于指示不同的电子设备，“第一窗口”和“第二窗口”仅用于指示不同的显示窗口，“第一操作”和“第二操作”仅用于指示不同时刻或者不同目的操作。
本申请实施例提供了一种显示多窗口的方法，该方法可以应用于包括两个相互通信的电子设备的系统中。在本申请中，为了区分，将两个电子设备分别称为第一电子设备和第二电子设备，其中，第二电子设备可以显示该第一电子设备的界面。例如，第二电子设备通过一个窗口显示第一电子设备的主界面，或者第二电子设备通过多个窗口显示第一电子设备的多个应用的界面。
应理解，该方法也可以是通过应用程序实现在第二电子设备上显示该第一电子设备的多个窗口。例如，该应用程序可以仅安装在第二电子设备上；或者该应用程序同时安装在第一电子设备和第二电子设备上；又或者，该应用程序在第一电子设备上体现为第一应用程序，在第二电子设备上体现为第二应用程序，其中，第一应用程序适配第一电子设备，第二应用程序适配第二电子设备；又或者，该第一应用程序为第一电子设备上预置的程序代码，可以没有对应的桌面应用图标，该第二应用程序在第二电子设备上可以体现为桌面应用图标的形式等多种可能的情况，以实现在第二电子设备上，通过一个窗口显示第一电子设备的主界面，或者通过多个窗口显示第一电子设备的多个应用的界面。
本申请实施例中，该第一电子设备可以是手机、智能终端、可穿戴设备等电子设备，该第二电子设备可以是PC、平板电脑、手机、智能终端、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)、显示器或者电视等具有显示功能的电子设备，本申请实施例对第一电子设备和第二电子设备的具体类型不作任何限制。
可选地，第一电子设备和第二电子设备可以为相同类型的电子设备或不同类型的电子设备。在本申请实施例中，将以手机作为第一电子设备，PC作为第二电子设备，在PC上显示手机的多窗口为例进行介绍。
示例性的，图1是本申请实施例提供的一例手机100的结构示意图。手机100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。
可以理解的是，本申请实施例示意的结构并不构成对手机100的具体限定。在本申请实施例另一些实施例中，手机100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)， 图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。其中，控制器可以是手机100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了系统的效率。
在一些实施例中，处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit，I2C)接口，集成电路内置音频(inter-integrated circuit sound，I2S)接口，脉冲编码调制(pulse code modulation，PCM)接口，通用异步收发传输器(universal asynchronous receiver/transmitter，UART)接口，移动产业处理器接口(mobile industry processor interface，MIPI)，通用输入输出(general-purpose input/output，GPIO)接口，用户标识模块(subscriber identity module，SIM)接口，和/或通用串行总线(universal serial bus，USB)接口等。
I2C接口是一种双向同步串行总线，包括一根串行数据线(serial data line，SDA)和一根串行时钟线(derail clock line，SCL)。在一些实施例中，处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K，充电器，闪光灯，摄像头193等。例如：处理器110可以通过I2C接口耦合触摸传感器180K，使处理器110与触摸传感器180K通过I2C总线接口通信，实现手机100的触摸功能。
I2S接口可以用于音频通信。PCM接口也可以用于音频通信，将模拟信号抽样，量化和编码。UART接口是一种通用串行数据总线，用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。MIPI接口可以被用于连接处理器110与显示屏194，摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface，CSI)，显示屏串行接口(display serial interface，DSI)等。GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号，也可被配置为数据信号。USB接口130是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口130可以用于连接其他电子设备，例如可以通过该USB接口连接PC等。
可以理解的是，本申请实施例示意的各模块间的接口连接关系，只是示意性说明，并不构成对手机100的结构限定。在本申请实施例另一些实施例中，手机100也可以采用上述实施例中不同的接口连接方式，或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。
手机100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。天线1和天线2用于发射和接收电磁波信号。移动通信模块150可以提供应用在手机100上的包括2G/3G/4G/5G等无线通信的解决方案。无线通信模块160可以提供应用在手机100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星系统(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信 的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
手机100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像，视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Mini-LED，Micro-LED，Micro-OLED，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，手机100可以包括1个或N个显示屏194，N为大于1的正整数。
手机100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。其中，ISP用于处理摄像头193反馈的数据。摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。在一些实施例中，手机100可以包括1个或N个摄像头193，N为大于1的正整数。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展手机100的存储能力。内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行手机100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作系统，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储手机100使用过程中所创建的数据(比如音频数据，电话本等)等。
手机100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
此外，手机100还包括多个传感器。例如，图1中示出的多个传感器，其中，压力传感器180A用于感受压力信号，可以将压力信号转换成电信号。陀螺仪传感器180B可以用于确定手机100的运动姿态。气压传感器180C用于测量气压。磁传感器180D包括霍尔传感器。加速度传感器180E可检测手机100在各个方向上(一般为三轴)加速度的大小。当手机100静止时可检测出重力的大小及方向，还可以用于识别手机100的姿态，应用于横竖屏切换，计步器等应用。距离传感器180F，用于测量距离。接近光传感器180G可以包括例如发光二极管(LED)和光检测器，例如光电二极管。环境光传感器180L用于感知环境光亮度。指纹传感器180H用于采集指纹。温度传感器180J用于检测温度。触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器180K也可以设置于手机100的表面，与显示屏194所处的位置不同。骨传导传感器180M可以获取振动信号。按键190包括开机键，音量键等。按键190可以是机械按键。也可以 是触摸式按键。手机100可以接收按键输入，产生与手机100的用户设置以及功能控制有关的键信号输入。马达191可以产生振动提示。指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。SIM卡接口195用于连接SIM卡。
以上介绍了手机100作为第一电子设备时可能的硬件结构示意图。示例性的，图2是本申请实施例提供的一例PC 200的结构示意图。PC 200作为第二电子设备，可以是包括处理器210、存储器220、通信模块230、显示屏240等。
可以理解的是，本申请实施例示意的PC 200的结构并不构成对PC 200的具体限定。在本申请实施例另一些实施例中，PC 200可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。
其中，处理器210可以包括一个或多个处理单元，处理器210可以用于对PC 200的动作进行控制管理。存储器220用于存储程序代码和数据。通信模块230可以用于PC 200的各个内部模块之间的通信、或者PC 200和其他外部设备之间的通信等。示例性的，如果PC 200通过有线连接的方式和其他电子设备通信，通信模块230可以包括接口等，例如USB接口，该USB接口可以参照图1中对USB接口130的描述。或者，通信模块230可以包括音频器件、射频电路、蓝牙芯片、无线保真(wireless fidelity，Wi-Fi)芯片、近距离无线通讯技术(near-field communication，NFC)模块等，可以实现PC 200与其他电子设备之间的交互。显示屏240用于显示图像、视频等。可选地，PC 200还可以包括外设设备250，例如鼠标、键盘、扬声器、麦克风等。
在本申请实施例中，处理器210可执行存储器220存储的计算机执行指令，以使PC 200可以和手机100组成相互通信的电子设备系统，进一步通过PC 200的显示屏240显示手机100的多个窗口。
图3是本申请实施例提供的一例手机100和PC 200的软件结构框图，其中，该框图包括手机100的软件结构和PC 200的显示手机窗口模块的软件结构。
手机100的软件结构可以采用分层架构，事件驱动架构，微核架构，微服务架构，或云架构。本申请实施例以分层架构的Android系统为例，示例性说明手机100的软件结构。对于手机100的软件结构，以Android系统为例，分层的结构将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android系统从上至下分别包括应用程序(application，APP)层，应用程序框架(framework)层，系统库以及内核层。应用程序层可以包括一系列应用程序包。例如图3所示的手机100，应用程序层可以包括短信、音乐、视频、导航等应用程序，本申请实施例对此不做限定。
应用程序框架层可以包括多种服务程序或者一些预先定义的函数。应用程序框架层可以为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。
在本申请实施例中，如图3所示，应用程序框架层可以包括发现链接服务的安卓安装包(Android package，APK)、多屏框架服务APK和组播发现协议(multicast source discovery protocol，MSDP)服务APK。
其中，发现链接服务APK用于发现PC 200，并与PC 200进行连接，发现链接服务APK中可以包括实现该功能的软件开发工具包(software development kit，SDK)，SDK 可以为某个程序设计语言提供应用程序接口(application programming interface，API)的一些文件，也可以实现硬件模块之间的通信。例如图3中示出的MSDP-SDK可以为MSDP服务提供接口，用于告知进行数据传输的通路，以实现MSDP服务传输视频流的过程。
在本申请实施例中，手机100和PC 200之间的通信可以有多种不同的方式，例如通过连接的方式或者借助于未来通信技术的方式进行通信以传输数据。其中，手机100和PC 200之间连接可以包括有线连接或者无线连接等多种不同连接方式。示例性的，手机100和PC 200之间的有线连接可以是通过USB数据线连接；手机100和PC 200之间的无线连接可以是通过建立Wi-Fi连接的方式，或者，借助于手机100和PC 200支持近场通信(near field communication，NFC)的功能，通过“碰一碰”功能进行靠近连接，又或者，通过手机100和PC 200通过蓝牙扫码连接等。借助于未来通信技术的方式，可以通过在手机100和PC 200上安装不同或相同的应用，借助于5G通信网络传输数据。本申请实施例将以手机100和PC 200之间建立NFC连接为例进行详细的介绍，本申请实施例对手机100和PC 200之间的连接方式不做限定。
示例性的，以手机100和PC 200之间通过NFC建立连接为例，手机100具有NFC功能并先开启手机100的NFC功能，手机100的发现链接服务APK可以用于扫描并发现一定范围内的其他开启了NFC功能的设备。如果PC 200也开启了NFC功能，当手机100靠近PC 200时，手机100的发现链接服务APK可以向PC 200的NFC功能模块发送连接请求，PC 200的NFC功能模块接受连接请求并和手机100建立通路，即完成手机100和PC 200建立连接的过程。应理解，电子设备具有NFC功能可以通过该电子设备包括的NFC芯片来实现，或者给电子设备外接一个NFC设备，通过在电子设备上预置与NFC功能相关的应用程序来实现该NFC功能，本申请实施例对此不做限定。
在一种可能的实现方式中，随着通信技术的发展，通信带宽和速率逐渐提高，手机100和PC 200之间可能在不建立近场通信连接的情况下也可以传输数据。示例性的，未来的第五代(5th generation，5G)移动通信系统等高速率通信方式的普及，手机100和PC 200可能通过5G通信就可以实现在PC 200上显示手机100的窗口，例如，通过在手机100和PC 200上安装不同或相同的应用，借助于5G通信网络传输数据。在该种实现方式中，手机100的发现链接服务APK可以不提供发现，并和PC 200建立连接的功能等。应理解，本申请实施例对手机100和PC 200之间的通信方式不做限定，在后续实施例中，将以手机100和PC 200之间建立NFC连接为例进行详细的介绍。
在手机100和PC 200建立连接之后，多屏框架服务APK中的多窗口管理器用于管理手机100的窗口程序。示例性的，多窗口管理器可以获取手机100上待显示窗口的大小，判断该待显示窗口的内容等。应理解，手机100的待显示窗口可以包括手机100的界面上正在显示的窗口，还可以包括手机100后台运行的一个或多个应用程序的窗口。消息通知管理器可以使应用程序在手机100的状态栏中显示通知信息，可以用于传达告知类型的消息，该状态栏显示的消息可以短暂停留后自动消失，无需用户交互。该状态栏显示的消息可以用于告知用户下载完成，以及进行其他的消息内容提醒等。消息通知管理器还可以提供以图表或者滚动条文本形式出现在系统顶部状态栏的通知，例如后台运行的应用程序的通知，还可以提供以对话窗口形式出现在手机100的屏幕上的通知。消息通知管理器还可以提供例如提示音，手机100的振动，指示灯闪烁等不同类型的通知。
MSDP服务APK用于在手机100和PC 200建立连接(例如NFC连接)之后的数据 传输，例如手机100和PC 200之间视频流的传输。MSDP服务APK可以实现包括视频流编码、音频流编码、窗口坐标同步、音频设备虚拟、反向控制等功能。
示例性的，视频流编码可以实现将待传输的视频数据封装成符合手机100和PC 200之间的数据传输协议的报文，该视频流报文可以包括传输媒体的类型、格式、序列号、时间戳以及是否有附加数据等信息，进而实现视频流的实时传输。同理，音频流编码可以实现将待传输的音频数据封装成符合手机100和PC 200之间的数据传输协议的报文，进而实现音频流的实时传输。窗口坐标同步可以确定手机100的待显示窗口在PC 200显示屏上的坐标。音频设备虚拟可以将手机100中的音频创建虚拟的音频，再将其发送给PC 200，以实现在PC 200上播放该音频。反向控制可以根据手机100和PC 200之间传输的操作指令，同步地在手机100和PC 200执行相应的操作。例如PC 200显示手机100的视频应用的播放窗口，用户在PC 200上暂停播放时，该暂停操作可以被回传到手机100，由手机100的该反向控制模块控制手机100上也暂停播放。相应地，反向控制还可以用于将手机100上的操作传到PC 200。应理解，针对不同的系统，手机100和PC 200之间具有不同的通信方式，以上介绍的各个软件模块可以部分或者全部的参与本申请实施例的PC 200显示多窗口的过程。
综上所述，应用程序框架层可以实现PC 200和手机100的发现连接、调用MSDP服务等功能。此外，应用程序框架层的多屏框架服务还可以实现PC 200和手机100之间文件的拖拽与共享、单窗口模式的显示、应用协同的生命周期管理等功能。PC 200和手机100之间文件的拖拽与共享、PC 200显示手机100的一个窗口可以参照现有的方案，这里不再赘述。应用协同的生命周期管理是用于配置管理应用程序的软件工具，规定应用程序的生命周期等。
系统库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(media libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。其中，表面管理器用于对手机100的显示子系统进行管理，并且为多个应用程序提供了2D和3D图层的融合。媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。2D图形引擎是2D绘图的绘图引擎。
安卓运行时(Android runtime)包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
内核层是硬件和软件之间的层。内核层至少包含显示驱动、音频驱动等。在本申请实施例中，当手机100和PC 200之间为无线连接时，手机100的内核层可以包括用于手机100连接无线保真(wireless fidelity，WIFI)模块，用于进行无线连接；当手机100和PC200之间为NFC连接时，内核层还可以包括近距离无线通讯技术(near-field communication，NFC)模块，用于通过NFC实现手机100和PC 200的连接；当手机100和PC 200之间通过5G等通信网络传输数据时，内核层可以不包括WIFI模块、NFC模块等，或者内核层可以包括WIFI模块、NFC模块等，但是不参与本申请实施例的PC 200显示多窗口的过程。
应理解，手机100除了图3中示出的多个层以及包括的多个功能模块之外，还可以有不同的划分方式或者包括更多的功能模块，本申请实施例对此不做限定。
图3中还示出了PC 200的显示手机窗口模块，PC 200和手机100连接之后，该显示手机窗口模块用于显示手机100的界面内容。应理解，PC 200可以包括多层架构，例如预研层、PC软件层、操作系统(operating system，OS)层以及基础只读存储器(read only memory，ROM)多屏框架层等，其中，PC软件层可以运行可执行文件(executable file，exe)。例如在本申请中，PC 200可以预置用于显示手机窗口的exe程序，该显示手机窗口的exe程序可以在PC 200上体现为App的形式，或者通过运行该显示手机窗口的exe程序使得PC 200具有显示手机100的窗口的功能。本申请将PC 200的提供显示手机100的窗口的功能模块称为“显示手机窗口模块”，下面将重点介绍用于PC 200上用于显示手机100的窗口的显示手机窗口模块。
PC 200的显示手机窗口模块可以提供对应于手机100的应用程序框架层的相关服务的功能，例如提供多屏框架服务和MSDP服务。其中，MSDP服务APK对应于手机100的MSDP服务，用于在PC 200和手机100建立连接之后的数据传输。PC 200的MSDP服务可以实现包括视频流解码、音频流解码、窗口坐标同步、音频设备虚拟、反向控制等功能。
例如，在本申请中，PC 200的MSDP服务APK可以接收到手机100的发送的视频流，并对该视频流进行解码，视频流解码可以实现将PC 200接收的封装报文解封装，获取解码后的完整视频数据。音频流解码可以将PC 200接收的报文解封装，获取音频数据。窗口坐标同步可以根据视频流中包含的信息，确定PC 200的显示屏上用于显示手机窗口的坐标和区域。音频设备虚拟根据接收手机100发送的虚拟音频，将该虚拟音频由PC 200的音频设备播放，以实现在PC 200上播放该音频。反向控制可以根据手机100和PC 200之间传输的操作指令，同步地在手机100和PC 200执行相应的操作。例如PC 200显示手机100的视频应用的播放窗口，用户在手机100上暂停播放时，该暂停操作可以被传到PC 200，由PC 200的该反向控制模块获取指令，控制PC 200上也暂停播放。相应地，反向控制还可以用于将PC 200上的操作传到手机100。
MSDP服务APK获取并解析视频帧，将视频帧中包含的手机窗口的信息传递到多屏框架服务APK，该手机窗口的信息可以包括手机窗口的坐标信息、手机窗口的显示内容信息等。多屏框架服务APK可以包括多窗口管理器、消息通知管理器、手机窗口显示器、应用生命周期管理器等。其中，多窗口管理器可以根据手机窗口的坐标信息，确定在PC 200的显示屏上显示手机100的一个或多个窗口。手机窗口显示器根据手机窗口的显示内容信息，在PC 200的显示屏进行显示，手机窗口显示器可以用于显示手机100的一个或者多个窗口。消息通知管理器可以用于在PC 200显示通知信息，例如以消息弹窗的方式、提示音等方式显示通知信息。应用生命周期管理器用于向应用程序开发人员提供方便地访问应用程序信息的界面，通过调用单个应用程序接口(application programmers interface，API)启动一个应用程序，以及为每个运行中的应用程序处理各种运行时状态，它还为安装在系统中的应用程序维护程序列表，在受监控的应用程序发生变化时随时更新该列表。
应理解，对于PC 200和手机100之间建立链路之后，可以进行数据传输过程，该传输的数据可以包括前述介绍的视频流数据，还可以包括意图类指令传输，例如“touch event”等操作指令(例如启动、关闭、移动、缩放应用等事件的指令)的传输；该传输的数据还可以包括PC 200和手机100之间定义的可解析的数据格式等，本申请实施例对此不做限定。
还应理解，上述图3中以将手机100的多个窗口显示到PC 200为例，介绍了参与该显示多窗口的过程的模块和软件架构。此外，手机100也可以作为第二电子设备，手机100的MSDP服务APK也可以提供视频流的解码功能；或者PC 200也可以作为第一电子设备，PC 200的MSDP服务APK也可以提供视频流的编码功能，本申请实施例对此不做限定。
现有的显示手机窗口的过程中，除了背景技术介绍通过屏幕共享软件，实现PC与手机之间轻松共享屏幕内容与数据之外，在另一种方案中，可以通过数据线将手机和PC、显示器或者电视等大屏设备进行连接，使得大屏设备可以轻松访问手机。用户可以同时使用两个屏幕处理多件任务，例如用户可以在较大的显示屏上查看视频、图片和文档等内容，同时可以继续使用手机收发短信、接听电话等。该显示手机界面的方法需要借助于数据线的连接，将手机的界面投射到大屏设备上。而且该方法无法实现手机和PC的系统的融合，且无法实现从PC的系统菜单调用手机安装的应用。
为了便于理解，以下实施例将以具有图1所示硬件结构和图3所示软件架构的手机100，以及具有图2和图3所示软件结构的PC 200为例，介绍本申请实施例提供的显示多窗口的方法，下面结合附图和应用场景，进行具体阐述。
图4是本申请实施例提供的一例PC显示手机界面的示意图。如图4中(a)图所示，手机和PC在连接之后，PC 200的手机窗口可以和手机100显示相同的界面。
应理解，在本申请实施例中，手机100和PC 200之间传输数据可以采用前述介绍的通信方式，此处不再赘述。图4中(a)图示出了在解锁之后的手机100的主界面401，该主界面401显示了多款应用程序(application，App)，例如相册、设置、视频、音乐等，应理解，主界面401还可以包括其他更多的应用程序，本申请实施例对此不做限定。
图4中(a)图还示出了PC 200的主界面402，该主界面402包括多款PC 200的App(例如我的电脑、回收站等)和手机窗口10。该手机窗口10可以用于显示手机100的界面内容。此外，该手机窗口10还可以包括如图所示的灰色菜单栏11，该灰色菜单栏11可以包括隐藏到侧边框按键11-1、隐藏到菜单栏按键11-2、窗口最大化按键11-3、关闭窗口按键11-4等。可选地，点击隐藏到侧边框按键11-1可以用于将手机窗口10隐藏到PC 200显示屏的右边框，隐藏到菜单栏按键11-2可以用于将手机窗口10隐藏到菜单区域12。
应理解，该灰色菜单栏11可以包括以上列举的部分或者全部按键，还可以包括更多的功能按键，本申请实施例对此不做限定。还应理解，窗口最大化按键11-3可以根据用户的操作显示不同的形态，从而功能可以发生变化。示例性的，当该手机窗口10为小窗口显示时，用户通过点击窗口最大化按键11-3，响应于用户的点击操作，手机窗口10最大化，此时该最大化按键11-3可以变化为窗口最小化按键，如图7的(b)图示出的窗口最小化按键11-5。用户可以通过点击最小化按键11-5，响应于用户的点击操作，手机窗口10缩小到原小窗口显示。
在本申请实施例中，将包括灰色菜单栏11在内的区域可以统一称为“手机窗口10”。在图4中，该主界面402还可以包括菜单区域12，该菜单区域12可以包括PC 200的开始菜单13、文件管理快捷菜单、浏览器、输入法控制菜单、时间与日期设置菜单、电源管理等，本申请实施例对此不做限定。
当手机100和PC 200建立连接之后，可以在PC 200的手机窗口10显示手机100当 前显示的界面。如图4中(a)图所示，用户点击了手机主界面401的音乐应用，手机100和PC 200的界面可以如图4中的(b)图所示。其中，手机100的界面401显示音乐应用的界面，PC 200的手机窗口10也显示该音乐应用的界面，保持手机100的界面401和PC200的手机窗口10的显示内容一致，此处不再赘述。
应理解，对于该手机窗口10的在PC 200上的显示，可以是当手机100和PC 200之间建立连接之后，自动弹出显示在PC的主界面402上；或者，该手机窗口10可以是根据用户的操作之后，显示在PC的主界面402上，本申请实施例对手机窗口10的显示时机和方式不做限定。
图5是本申请实施例提供的又一例PC显示手机界面的示意图。在一种可能的实现方式中，当手机100和PC 200之间建立连接之后，用户可以在PC 200上执行一定的操作，响应于用户的操作，该手机窗口10显示在PC的主界面502上。
示例性的，如图5中的(a)图所示，当手机100和PC 200之间建立连接之后，用户可以在PC 200点击开始菜单13，响应于用户的点击操作，PC 200的主界面502上显示菜单窗口20。该菜单窗口20上包括该PC的多款应用列表，例如Word、Power Point、画图、计算器等办公软件，或者浏览器等其他应用。此外，如果PC 200安装了用于显示手机100的多窗口相关的应用，该菜单窗口20还可以包括该应用的快捷方式，例如该应用可以是“EMUJI桌面(EMUJI desktop)”，该菜单窗口20可以包括的EMUJI桌面的图标。
应理解，用于显示手机100的多窗口相关的应用可以从应用商店下载并安装在PC 200上，本申请实施例对安装该应用的方法和过程不再赘述。
如图5中的(b)图所示，用户可以点击该菜单窗口20的EMUJI桌面菜单栏，响应于用户的点击操作，PC 200的主界面502上显示手机应用窗口30，该手机应用窗口30可以显示手机100的所有应用。可选地，该手机应用窗口30可以如图5中(c)图所示，手机100的应用程序显示在EMUJI桌面的窗口中；或者，该手机应用窗口30可以显示如手机窗口10，在手机窗口10中显示手机100的应用列表，本申请实施例对此不做限定。
应理解，手机100和PC 200建立连接之后，手机100可以将已安装所有应用的信息发送给PC 200，也可以是当用户点击菜单窗口20的EMUJI桌面菜单时，触发PC 200向手机100发送获取应用的请求，用于请求获取手机100的应用的信息。
这里应用的信息可以包括该应用程序层的所有应用的名称、标识(identification，ID)、图标等信息。PC 200接收到应用的信息之后，根据每一个应用的名称、ID、图标在手机应用窗口30显示该应用，进而显示手机100的所有应用，显示可以如图5中(c)图所示。还应理解，应用的标识可以为包名，包名中包含字符串，PC 200根据该包名就可以确定时音乐应用。
可选地，当用户点击EMUJI桌面菜单栏之后，可以如图5中(a)图所示，弹出手机窗口10，该手机窗口10与手机100的界面501保持显示一致。
或者，在一种可能的情况中，如图5中的(c)图所示，当用户点击EMUJI桌面菜单栏之后，可以在PC 200的主界面502上弹出EMUJI桌面的窗口30，该EMUJI桌面的窗口30上可以显示手机上安装的所有应用程序，用户可以对该EMUJI桌面的窗口30的任意一款应用程序执行点击运行的操作。
应理解，在本申请实施例中，在PC 200的界面上显示手机100的界面，可以通过图5中所示的手机窗口10，也可以通过图5介绍的操作方法，从PC 200的开始菜单13中调用 某款应用(例如EMUJI桌面)，再通过该应用显示手机窗口10或者显示包括手机100的所有应用程序的EMUJI桌面的窗口30，本申请实施例对此不做限定。
在本申请实施例中，在PC 200的界面上显示手机100的界面，可以根据用户的需求，当用户运行手机100的多个应用时，在PC 200的主界面402上可以显示多个对应于不同应用的窗口。
图5是本申请实施例提供的又一例PC显示手机界面的示意图。应理解，用户可以通过在手机上的点击操作以启动该应用，或者通过在PC的手机窗口10的点击操作以启动该应用，本申请实施例对此不做限定。
还应理解，本申请实施例中介绍的用户执行的“点击操作”可以是针对不同设备的不同操作。示例性的，对于手机，用户可以通过触摸点击操作运行该音乐应用；对于PC，用户可以是通过鼠标、键盘等外设输入设备执行单击操作或者双击操作，运行该音乐应用；或者，如果PC为具有触摸屏的设备时，用户的可以通过触摸点击运行该音乐应用，本申请实施例对此不做限定。
当手机100和PC 200之间建立连接之后，用户可以在手机100的主界面401上点击音乐应用，响应于用户的点击操作，如图6中的(a)图所示，PC 200上可以自动弹出音乐应用的窗口40。
可选地，该音乐应用的窗口40可以用于显示音乐应用的主界面。
或者，用户可以点击PC 200的手机窗口10上的音乐应用14，响应于用户的点击操作，PC 200的主界面402上可以自动弹出音乐应用的窗口40，本申请实施例对此不做限定。
在一种可能的实现方式中，当用户在PC 200的手机窗口10上点击并运行音乐应用14，响应于用户的点击操作，PC 200的手机窗口10上可以直接弹出音乐应用的窗口40，原手机窗口10可以保持为手机100的主界面。
应理解，用户通过在PC 200的手机窗口10中点击操作音乐应用的过程中，本申请实施例对手机100的界面的显示内容不做限定，例如，手机100可以为灭屏状态，或者显示解锁后的主界面，又或者和PC 200的手机窗口10的显示内容保持一致等。
在另一种可能的实现方式中，当用户在手机100的主界面401上点击并运行音乐应用，或者，用户可以点击PC 200的手机窗口10上的音乐应用14，响应于用户的点击操作，PC 200的手机窗口10上可以直接跳转显示该音乐应用的主界面。如图6中的(b)图所示，用户可以通过选中并拖动该音乐应用的主界面，从而在PC 200上重新出现音乐应用的窗口40。
示例性的，如图6中的(b)图所示的操作，用户可以在手机窗口10显示该音乐应用的主界面之后，点击选中手机窗口10的任意位置，并沿着虚线所示方向，向手机窗口10之外的任意区域拖动，从而PC 200的界面显示如图6中的(a)图所示，即单独显示音乐应用的窗口40，手机窗口10恢复显示手机的主界面401。
图7是本申请实施例提供的又一例PC显示手机界面的示意图，当用户运行多个应用时，PC 200上可以为每一个应用显示对应的窗口。
如图7中的(a)图所示，用户已经在PC 200上运行了音乐应用，在PC 200的主界面402上显示音乐应用的窗口40。例如，用户在手机100上点击运行音乐应用之后，可以返回到手机100的主界面401，音乐应用可以处于手机100的后台运行状态。此时，用户还可以点击手机100的主界面401的其他任意应用。可选地，例如用户可以在手机100 的主界面401上点击视频应用15，响应于用户的点击操作，PC 200上还可以自动弹出视频应用的窗口50，手机100的界面显示为视频应用的界面，用户可以返回到手机100的主界面401，视频应用可以处于手机100的后台运行状态。
或者，如图7中(a)图所示的操作，用户可以点击PC 200的手机窗口10上的视频应用15，响应于用户的点击操作，PC 200上可以自动弹出视频应用的窗口50，手机100的界面可以显示主界面401，即不受用户操作的影响，显示手机100的任一可能的界面。这里任一可能的界面可以是锁屏界面、用户使用手机任一一个应用的界面等。
应理解，用户可以对PC 200上出现的每一个应用的窗口执行相关操作。例如，视频应用的窗口50可以是视频应用的主界面，包括多个视频列表，用户可以点击某个视频，例如用户点击《当幸福来敲门》，该视频应用的窗口50可以显示如图7中(a)图所示的界面，通过该视频应用的窗口50播放该视频。
还应理解，本申请实施例对PC 200上显示的多个应用的窗口的大小和位置不做限定，例如，PC 200上显示的应用的窗口的大小和位置的确定过程可以参考后续步骤804的相关描述。
在一种可能的实现方式中，用户可以通过选中某个应用的窗口并拖动该窗口，将该窗口拖动到PC 200显示屏幕的任意位置。此外，用户可以通过灰色菜单栏11包括的隐藏到侧边框按键11-1、隐藏到菜单栏按键11-2、窗口最大化按键11-3、关闭窗口按键11-4等按键，对每个应用的窗口执行相应的操作，或者，用户可以通过拖动视频应用的窗口50的边框，对该视频应用的窗口50进行缩小或者放大，此处不再赘述。
可选地，当用户在PC 200上点击灰色菜单栏11的关闭按键11-4时，响应于用户的关闭操作，PC 200上可以关闭该窗口，该窗口对应的手机100的应用可以后台运行，或者该窗口对应的应用退出运行转为关闭状态，本申请对此不做限定。
示例性的，如图7中的(a)图所示，当用户在PC 200上打开视频应用显示视频应用的窗口50时，用户点击视频应用的窗口50的灰色菜单栏的关闭按键，响应于用户的关闭操作，PC 200上可以关闭该窗口，手机100的视频应用可以后台运行，或者退出运行。
在另一种可能的实现方式中，用户可以通过不同的方式实现窗口最大化。示例性的，如图7中的(a)图所示，用户通过点击视频应用的窗口50的灰色菜单栏11包括的窗口最大化按键11-3将视频应用的窗口50最大化到如图7中的(b)图所示的全屏显示；或者，用户通过单击该视频应用的窗口50包括的全屏控件16将视频应用的窗口50最大化到如图7中的(b)图所示，本申请实施例对此不做限定。
相应地，当视频应用的窗口50最大化如图7中的(b)图所示，用户可以单击灰色菜单栏11包括的窗口缩小控件17将视频应用的窗口50恢复到如图7中的(a)图所示的非全屏显示；或者用户通过单击该视频应用的窗口50包括的窗口最小化按键11-5将视频应用的窗口50恢复到如图7中的(a)图所示的非全屏显示，本申请实施例对此不做限定。
综上所述，本申请实施例提供的显示多窗口的方法，可以将手机100的应用程序显示在PC 200的手机窗口中，或者显示在PC 200的菜单列表中，在PC 200不安装手机的应用的情况下，就可以在PC 200上被点击运行手机100的应用，并使用该应用的功能，用户可以借助于PC 200的大屏体验使用手机100的应用。该方法可以实现手机和PC的系统的融合，使得用户可以从PC的系统菜单调用手机安装的应用。
此外，该方法可以在PC 200上，实现多个手机应用同时独立并行，每一个应用可以 在PC 200显示一个独立窗口，多个应用对应的多个窗口同时显示在PC 200的界面上，且运行手机100的多个应用不影响用户使用手机的其他功能。例如用户在PC 200上使用手机的视频应用、音乐应用，可以同时使用手机收发短信或者拨打电话等；或者，用户使用鼠标、键盘等外设输入设备即可以操作手机，完全保留用户使用习惯，不用频繁在两个设备之间切换；通过PC 200的手机窗口运行手机100的应用，提高了文件查阅、分享、办公的效率，提高了用户体验。
结合上述实施例及相关附图，本申请实施例提供的显示多窗口的方法，可以应用在包括两个相互通信的电子设备的系统中，例如该系统包括第一电子设备和用于显示第一电子设备界面的第二电子设备。本申请实施例中，手机100作为第一电子设备，PC 200作为第二电子设备的，PC 200可以显示手机100的多个窗口。下面结合图8至图12介绍PC 200显示手机100的多个窗口的具体实现过程。
图8是本申请实施例提供的显示多窗口的方法的示意性流程图，如图8所示，该方法800可以包括以下步骤：
801，手机100和PC 200建立连接。
应理解，在本申请实施例中，手机100和PC 200需要相互通信，通信方式可以参照前述介绍，此处不再赘述。具体以手机100和PC 200之间通过NFC建立连接为例，手机100和PC 200建立连接的过程可以由图3中手机100的发现链接服务APK来参与，此处不再赘述。
802，手机100获取PC 200的显示屏的尺寸信息。
应理解，本申请实施例对手机100获取PC 200的显示屏的尺寸信息的时机和方式不做限定。在一种可能的实现方式中，手机100和PC 200建立连接的时候，PC 200可以将显示屏的尺寸等信息发送给手机，手机100可以获取该PC 200的显示屏的尺寸等信息。
在另一种可能的实现方式中，手机100和PC 200建立连接之后，可以根据用户的操作触发PC 200将显示屏的尺寸等信息发送给手机，手机100可以获取该PC 200的显示屏的尺寸等信息。示例性的，如图4所示的操作过程，当用户操作“EMUJI桌面”时，PC 200可以将显示屏的尺寸等信息发送给手机。
还应理解，手机100和PC 200之间的数据交互可以根据双方建立连接的过程，通过不同的通道进行传输。例如，手机100和PC 200之间的数据可以通过发现并建立WiFi p2p通路进行传输；或者，如果手机100和PC 200之间通过蓝牙建立连接，PC 200的显示屏的尺寸等信息可以通过蓝牙通道传输给手机100，本申请实施例对此不做限定。
具体地，对应于图3中介绍的手机100，该步骤801可以由手机100的应用程序框架层的多屏框架服务APK来参与。
803，手机100根据获取的PC 200的显示屏的尺寸信息，创建虚拟区域。
804，手机100在该虚拟区域中，确定手机窗口10的第一区域。
可选地，手机100可以在和PC 200建立连接的时候即创建一个虚拟区域，该虚拟区域的大小和PC 200的显示屏的尺寸大小相同。
图9是本申请实施例提供的手机100创建虚拟区域的示意图。本申请实施例中，对于PC 200的显示屏，以显示屏的左上角的起点为坐标原点，分别用水平方向(X轴方向)和垂直方向(Y轴方向)的像素来表征显示屏的尺寸大小，在后续的描述中，数字都为像素的位置坐标。应理解，在某个方向上占据的像素个数越多，显示效果就越精细和细腻。
步骤803-804可以对应于图9中的(a)图所示的手机100执行的过程。
示例性的，本申请实施例中，手机100获取PC 200的显示屏的大小可以是3000×2000，换言之，该PC 200的显示屏在水平方向上(X轴)包含3000个像素，垂直方向上(Y轴)包含2000个像素。手机100根据PC 200的显示屏的尺寸(3000×2000)信息，如图9中的(a)图所示，手机100创建虚拟区域(虚线示出的区域)，该虚拟区域的坐标原点O(0，0)，X轴方向包含3000个像素，Y轴方向包含2000个像素。
手机100创建虚拟区域之后，在该虚拟区域中，确定手机窗口10所在的第一区域，换言之，手机100确定该第一区域的顶点O 1的坐标、X轴方向包含的像素和Y轴方向包含的像素。可选地，该第一区域的顶点坐标、X轴方向包含的像素数和Y轴方向包含的像素数可以是系统预设的，或者，该第一区域是手机100根据预设规则和PC 200的显示屏的尺寸大小确定的，本申请实施例对此不做限定。
一种可能的实现方式中，手机100可以为每个待显示的窗口指定初始顶点坐标、X轴方向包含的像素数和Y轴方向包含的像素数。例如手机100为手机窗口10设置的初始顶点坐标、X轴方向包含的像素数和Y轴方向包含的像素数之后，可以使得手机窗口10显示在靠近PC 200的显示屏的右边框处位置，如图7中(a)图所示，该手机窗口10显示在PC 200的显示屏靠近右边框处，且该手机窗口10位于PC 200的显示屏的上边框界和下边框的中部。该初始坐标的设置可以避免手机窗口10遮挡PC 200的界面402上显示的PC的原有应用程序(例如我的电脑、回收站等)，且避免手机窗口10遮挡PC 200的界面402上右下角区域显示的PC的输入法控制菜单、时间与日期设置菜单、电源管理等快捷菜单选项。
可选地，手机100可以根据手机的显示区域为每个待显示的窗口指定X轴方向包含的像素数和Y轴方向包含的像素数，以确定在PC 200上显示的窗口的尺寸大小。应理解，这里手机的显示区域为手机100的显示屏上可以用于显示手机界面的最大区域，如图9中的(a)图所示，手机100的显示区域为n×m。
示例性的，PC 200上的手机窗口10可以和手机的显示区域(n×m)具有相同的尺寸大小。换言之，手机窗口10的尺寸在X轴方向包含n个像素数，在Y轴方向包含m个像素数。
或者，手机100可以按照一定比例放大或者缩小手机的显示区域(n×m)之后，将该尺寸大小指定为在PC 200上显示的手机窗口10的尺寸大小。
示例性的，PC 200上的手机窗口10用于显示手机100的主界面，该手机窗口10可以是将手机的显示区域(n×m)按照1.5倍放大后的尺寸大小。换言之，手机100指定手机窗口10在X轴方向包含1.5×n个像素数，在Y轴方向包含1.5×m个像素数。
示例性的，如图9中的(a)图所示，该第一区域的顶点O 1的坐标为(2500,500)，X轴方向上包括400个像素，在Y轴方向上包括1000个像素。
应理解，以上介绍的手机100创建虚拟区域和第一区域的过程可以由图1中手机100的处理器110来执行，或者对应由图3中软件架构中手机100的多屏框架服务APK对应的模块来完成。此外，手机100创建虚拟区域的过程可以理解为确定该虚拟区域的信息，手机100确定第一区域的过程可以理解为确定该第一区域的信息，该过程为手机100的内部执行过程，不需要在手机100上显示，且该过程由手机100完成，在PC 200也没有任何显示。
手机100确定该第一区域的信息O 1(2500,500)，X轴方向上包括400个像素，在Y轴方向上包括1000个像素。
805，手机100将第一区域的信息和第一区域的显示内容信息，编码生成第一视频流。
806，手机100向PC 200发送该第一视频流。
应理解，该第一视频流中包含第一区域的信息，具体可以包括第一区域在PC 200的显示屏区域内的顶点坐标、长度、宽度信息。
可选地，该第一区域的信息还可以包括手机窗口10的显示层级信息。应理解，这里显示层级用于表示该窗口在当前的显示方法中显示在PC 200的哪一层，例如，PC 200上包括3个手机窗口，最上层显示的窗口为第一层显示，最底层显示的窗口为第三层显示。
可选地，层级信息可以不是手机100发送给PC 200的，而由PC 200根据接收每一个窗口信息的时间以及用户在PC 200上的操作，统一管理每一个窗口的层级显示。例如当音乐应用的窗口40显示在视频应用的窗口50上层，当用户在PC上选中视频应用的窗口50时，PC 200确定视频应用的窗口50为最上层显示。
一种可能的实现方式中，该手机窗口10可以默认为PC 200最上层显示，由于手机窗口10的显示内容可以对应于手机100的主界面401，或者包括手机100的应用程序，所以手机窗口10在PC 200最上层显示，方便于用户的使用，且该手机窗口10位于PC 200的显示屏靠近右边框的位置，不会遮挡用户使用原PC 200的应用。
应理解，第一视频流中包括的第一区域的显示内容信息用于PC 200在手机窗口10中显示手机100的内容，换言之，PC 200可以根据第一区域的显示内容信息填充该第一区域，使得PC 200的显示屏的第一区域显示的内容为手机100的某界面。
示例性的，如图4中的(a)图所示，当手机窗口10显示手机100的主界面时，第一区域的显示内容信息包括手机100的主界面的壁纸、所有应用程序的图标、时间、日期和天气的窗口、以及手机100的界面顶端的通知栏的运营商名称、网络信号标识、电量显示信息等。或者，示例性的，如图4中的(b)图所示，当手机窗口10显示手机100的音乐应用的界面时，第一区域的显示内容信息包括音乐应用的界面的壁纸、音乐应用的界面上的每一个控件、歌名、播放进度、歌手图片等。
一种可能的情况中，在使用PC 200显示手机100的窗口的过程中，PC 200还可能显示自身当前运行的应用相关窗口，例如PC 200的显示屏显示着用户在PC200上打开的网页窗口。可选地，在手机100和PC 200连接之后，手机窗口10初次在PC 200的显示屏上出现时，显示在最上层，方便于用户的操作。用户如果此时不使用手机窗口10中的应用，继续使用PC 200的打开的网页窗口，可以点击该网页窗口的任意位置，将网页窗口显示在PC 200的最上层，手机窗口10下移一层(第二层显示)。或者，用户还可以通过点击手机窗口10的灰色菜单栏11的隐藏到侧边框按键11-1或者隐藏到菜单栏按键11-2，对手机窗口10进行隐藏，此时手机窗口10暂时不显示在PC 200的显示屏上。此外，还应理解，以上第一视频流的编码过程可以由图3中介绍的手机100的MSDP服务APK来参与，MSDP服务APK可以实现包括视频流编码等功能。具体地，手机100的多屏框架服务APK可以将确定的第一区域的信息和第一区域的显示内容信息发送给MSDP服务APK，由MSDP服务APK将第一区域的信息和第一区域的显示内容信息编码成第一视频流。这里对视频流的编码过程不再赘述。
可选地，该第一视频流可以通过MSDP服务提供的视频流专用通道进行传输，或者通 过手机100和PC 200在步骤701中建立连接过程建立的通道进行传输，本申请实施例对此不做限定。应理解，该第一视频流具有手机100和PC 200都可以解析的数据格式，此处不再赘述。
步骤805可以对应于图9中的(b)图所示的手机100执行的过程，该过程也为手机100内部编码视频流的过程。
807，PC 200接收并解码该第一视频流，获取第一区域的信息和第一区域的显示内容信息。
808，PC 200根据第一区域的信息,在对应的区域显示手机窗口10，根据第一区域的显示内容信息，在手机窗口10内显示对应的内容。
PC 200接收手机100发送的第一视频流，对第一视频流进行解码。应理解，该解码方式对应于手机100的编码方式。该过程可以由PC 200的MSDP服务APK来执行，并将解码第一视频流后获取第一区域的信息，发送给多屏框架服务APK，由多屏框架服务APK根据第一区域的信息，确定手机窗口10在PC 200的显示屏的顶点坐标、长度、宽度信息，以确定手机窗口10的显示区域。
此外，PC 200还从第一视频流中获取第一区域的显示内容信息，PC 200可以根据第一区域的显示内容信息填充该手机窗口10，使得PC 200的显示屏的手机窗口10显示的内容为手机100的某界面，该界面可以是手机100的主界面，或者为手机100任意一个应用的界面时，第一区域的显示内容信息包括音乐应用的界面的壁纸、音乐应用的界面上的每一个控件、歌名、播放进度、歌手图片等。
对应于图3中的PC 200的显示手机模块，MSDP服务APK将获取的第一区域的显示内容信息发送给多屏框架服务APK，最后由多屏框架服务APK模块的手机窗口显示器根据第一区域的显示内容信息显示相应的界面内容。
通过以上步骤801-808的过程，PC 200的显示屏上就可以显示手机窗口10，且该手机窗口10中可以显示手机100的主界面，或者同步显示手机100在用户使用过程中的任意界面。示例性的，如图4中的(a)图所示，PC 200可以在主界面402上显示手机窗口10，该手机窗口10的显示内容可以一直持续显示手机100的主界面，或者，如图4中的(b)图所示，PC 200的手机窗口10的显示内容可以和手机100同步，为音乐应用的界面。
步骤807-808可以对应于图9中的(c)图所示的手机100执行的过程。具体地，PC 200将第一区域在虚拟区域的顶点坐标、长度、宽度等对应到PC 200的显示屏的相应位置，该第一区域对应的位置就是手机窗口10的显示区域，换言之，手机窗口10在PC 200的显示屏的坐标即为第一区域在虚拟区域的坐标。
一种可能的实现方式中，手机100在步骤805中可以连同虚拟区域的信息和第一区域的信息、第一区域的显示内容信息，一起经过编码生成第一视频流，发送给PC 200，由PC 200根据第一区域在虚拟区域中的位置，直接确定手机窗口10在PC 200的显示屏上的位置，并在该手机窗口10显示第一区域的显示内容。
在一种可能的实现方式中，手机100在步骤805只将手机的显示区域(n×m)的信息编码生成第一视频流，发送给PC 200。由PC 200根据手机的显示区域(n×m)的信息，确定用于显示手机主界面的手机窗口10的位置和尺寸大小。可选地，PC 200确定手机窗口10的位置和尺寸大小的方式可以参照前述手机100确定第一区域的顶点坐标、X轴方向上的像素数和Y轴方向上的像素数的过程，此处不再赘述。同理，对于音乐应用的窗口 40，也可以由PC 200根据手机100发送的手机显示音乐应用的界面的信息，确定用于显示音乐应用的窗口40的位置和尺寸大小。
应理解，当用户在PC 200上移动了音乐应用的窗口40，该音乐应用的窗口40的坐标可以被PC 200发送给手机100，手机100就可以更新音乐应用的窗口40的坐标信息。换言之，手机100和PC 200之间的信息交互是实时的，当PC 200上的窗口位置、大小等发生该变化时，PC 200可以将变化后的窗口位置、大小等信息告知手机100，手机100可以随时准确获取音乐应用的窗口的信息，该过程可以由图3中介绍的手机100的MSDP服务APK的窗口坐标同步模块来参与，进而手机100可以实时获知PC 200上显示的每一个应用窗口的位置、每一个应用包括的功能控件的位置等，进一步实现用户可以在PC 200上使用并操作手机100的应用。
图10是本申请实施例提供的又一例显示多窗口的方法的示意性流程图，图10示出的过程可以在图8所示的过程之后执行，换言之，当PC 200的显示屏已经显示了手机窗口10之后，可以继续执行图10所示的过程。应理解，该过程1000可以对应于图6中的(a)所示的过程，用户通过在手机100侧执行对手机音乐应用的操作，响应于用户在手机100的操作，PC 200上除了原手机窗口10之外，也可以显示音乐应用的窗口40。
如图10所示，该方法1000可以包括以下步骤：
1001，PC 200的显示屏上显示手机窗口10。
1002，手机100接收用户的第一操作，运行音乐应用。
本申请实施例中以用户点击并运行音乐应用为例进行说明。应理解，第一操作可以是用户在手机100上对音乐应用的点击操作，响应于用户的点击操作，手机100上打开并进入音乐应用，即手机100可以显示音乐应用的界面。因此这里运行音乐应用可以为前台运行，即手机100的显示屏显示的是音乐应用的界面。1003，手机100在步骤803中虚拟区域中，确定第二区域，并获取第二区域的显示内容信息。
应理解，在步骤803中，手机100创建的虚拟区域的大小和PC 200的显示屏的尺寸大小相同，且手机100已经在虚拟区域中为手机窗口10确定了第一区域。在该步骤1003中，手机100在创建的虚拟区域中确定音乐应用的窗口40的第二区域。图11是本申请实施例提供的又一例手机100创建虚拟区域的示意图。步骤1003-1004可以对应于图11中的(a)图所示的手机100执行的过程。
示例性的，如图11中的(a)图所示，手机100在步骤803中创建了虚线示出的虚拟区域，该虚拟区域的坐标原点O(0，0)，X轴方向包含3000个像素，Y轴方向包含2000个像素。
在图8的步骤804中，手机100根据各种可能的方式，确定了手机窗口10的位置和尺寸。同样地，手机100还可以为每个应用确定显示该应用的窗口的位置和尺寸。
一种可能的实现方式中，PC 200上显示每个应用的窗口的初始顶点坐标可以由手机100设定，X轴方向包含的像素数和Y轴方向包含的像素数也可以由手机100设定。
可选地，手机100可以根据手机100的显示区域(n×m)的信息为待显示的音乐应用的窗口40指定初始顶点坐标、X轴方向包含的像素数和Y轴方向包含的像素数。
示例性的，PC 200上的音乐应用的窗口40用于显示手机的音乐应用的界面，该音乐应用的窗口40可以和手机的显示区域(n×m)具有相同的尺寸大小，换言之，音乐应用的窗口40在X轴方向包含的像素数为n，在Y轴方向包含的像素数为m。此时，要保证 该音乐应用的窗口40紧靠手机窗口10且不遮挡手机窗口10的内容，则音乐应用的窗口40的顶点O 2的X轴坐标为：O 1的X轴坐标减去n。顶点O 2的Y轴坐标可以和O 1的Y轴坐标相同，或者Y轴坐标为：O 1的Y轴坐标加上手机窗口10的Y轴尺寸，再减去m。
如图11中的(a)图所示，当n＝400，m＝1000时，在该虚拟区域中，手机100确定音乐应用的窗口40的第二区域，该第二区域在X轴方向上包括400个像素，在Y轴方向上包括500个像素，其中400等于n，500个像素为0.5×m。手机100确定了该第二区域的尺寸大小后，可以进一步确定顶点O 2的坐标为(2100,1000)，从而保证音乐应用的窗口40紧靠手机窗口10。
或者，示例性的，PC 200上的视频应用的窗口50用于显示手机的视频应用的界面，该视频应用的窗口50可以和手机的显示区域(n×m)具有相同的尺寸大小，且将手机的显示区域(n×m)中m作为X轴方向包含的像素数，n作为Y轴方向包含的像素数。该视频应用的窗口50的尺寸大小可以更好地适应用户观看视频的过程，提高用户的观看体验。
可选地，手机100可以根据手机100的显示区域(n×m)的信息和预设的比例关系为待显示的音乐应用的窗口40指定X轴方向包含的像素数和Y轴方向包含的像素数。例如，手机100指定音乐应用的窗口40在X轴方向包含1.5×n个像素数，在Y轴方向包含1.5×m个像素数。
另一种可能的实现方式中，手机100可以根据手机运行该音乐应用时显示音乐应用的界面，为待显示的音乐应用的窗口40确定X轴方向包含的像素数和Y轴方向包含的像素数，以确定在PC 200上显示的窗口的尺寸大小。应理解，这里手机运行该音乐应用时显示音乐应用的界面可以小于手机100的显示区域为n×m，例如手机运行该音乐应用时显示音乐应用的界面尺寸为p×q。应理解，本申请实施例中，n和m的数值可以由手机100根据显示屏的信息获取，p和q的数值可以是手机100安装音乐应用的安装包时获取的信息，或者由手机100为音乐应用配置的信息，本申请实施例对此不做限定。
可选地，音乐应用的窗口40的尺寸大小可以和手机100显示音乐应用的界面(p×q)的尺寸大小相同。换言之，音乐应用的窗口40在X轴方向包含的像素数为p，在Y轴方向包含的像素数为q。此时，要保证该音乐应用的窗口40紧靠手机窗口10且不遮挡手机窗口10的内容，则音乐应用的窗口40的顶点O 2的X轴坐标为：O 1的X轴坐标减去p。顶点O 2的Y轴坐标可以和O 1的Y轴坐标相同，或者Y轴坐标为：O 1的Y轴坐标加上手机窗口10的Y轴尺寸，再减去q。
另一种可能的实现方式中，手机100根据预设的规则确定X轴方向包含的像素数和Y轴方向包含的像素数。例如，手机100如果确定了初始顶点坐标，根据预设的规则，X轴方向包含的像素数和Y轴方向包含的像素数就可以被确定。示例性的，第一个启动并运行的音乐应用的窗口40的初始坐标的设置原则可以是：音乐应用的窗口40的右边框紧靠该手机窗口10的左边框，且不遮挡手机窗口10的内容。第二个启动并运行的视频应用的窗口50的初始坐标的设置原则可以是：视频应用的窗口50的右边框紧靠音乐应用的窗口40的左边框，且不遮挡音乐应用的窗口40的内容。或者，第二个启动并运行的视频应用的窗口50的右边框仍紧靠该手机窗口10的左边框，且第二个启动并运行的视频应用的窗口50位于第一个启动并运行的音乐应用的窗口40的上层。应理解，由于用户当前点击的是视频应用，所以视频应用的窗口50如果和音乐应用的窗口40有重叠区域，将视频应用 的窗口50位于音乐应用的窗口40的上层显示，如果用户点击了音乐应用的窗口50，则音乐应用的窗口50再在视频应用的窗口50的上层显示。
示例性的，如图6中(a)图所示，该音乐应用的窗口40的显示紧靠手机窗口10的左边框处，且该音乐应用的窗口40位于PC 200的显示屏的上边框界和下边框的中部。该初始坐标的设置可以避免音乐应用的窗口40遮挡手机窗口10，方便用户继续使用手机窗口10中的应用程序。
还应理解，手机100确定了第二区域的信息，还可以获取第二区域的显示内容信息，用于PC 200在音乐应用的窗口40中显示手机100的音乐应用的界面内容，换言之，PC 200可以根据第二区域的显示内容信息填充该第二区域，使得PC 200的显示屏的第二区域显示的内容为手机100的音乐应用的界面内容。
可选地，第二区域的信息还可以包括音乐应用的标识信息。具体地，该音乐应用的标识信息用于标识该窗口是针对音乐应用的窗口，PC 200和手机100都可以确定该窗口是音乐应用的窗口。当用户在PC 200上对该窗口执行操作时，PC 200可以确定是针对音乐应用的操作，从而实现后续将该操作准确地传递回手机100。应理解，手机100和PC 200也可以通过其他方式确定每一个窗口对应的应用，或者确定用户在该窗口执行的操作所对应的应用，进而准确地将提供服务。
可选地，第二区域的信息还包括显示层级信息。具体地，这里显示层级用于表示该音乐应用的窗口40在当前的显示方法中显示在PC 200的哪一层，例如用户当前运行的是音乐应用，音乐应用就为第一层显示，即在PC 200的显示屏的最上层显示。同理，当用户依次点击运行了手机100的音乐应用、视频应用、聊天应用时，PC 200显示屏的聊天应用的窗口为第一层显示，视频应用的窗口为第二层显示，音乐应用的窗口为第三层显示。此外，当用户又点击音乐应用的窗口，此时，音乐应用的窗口到最上层显示，本申请实施例不再赘述。
1004，手机100将音乐应用的标识信息、第二区域的信息和第二区域的显示内容信息，编码生成第二视频流。
应理解，步骤1005可以对应于图11中的(b)图所示的手机100执行的过程，该过程也为手机100内部编码视频流的过程，具体可以参照步骤805的过程，由手机100的多屏框架服务APK将确定的音乐应用的标识信息、第二区域的信息和第二区域的显示内容信息发送给MSDP服务APK，由MSDP服务APK将第二区域的信息和第二区域的显示内容信息编码成第二视频流。
1005，手机100向PC 200发送该第二视频流。
1006，PC 200接收并解码该第二视频流，获取音乐应用的标识信息、第二区域的信息和第二区域的显示内容信息。
1007，PC 200根据第二区域的信息和第二区域的显示内容信息，在对应的区域显示音乐应用的窗口40。
步骤10061007可以对应于图11中的(c)图所示的手机100执行的过程。通过以上步骤1001-1007的过程，PC 200的显示屏上就可以显示手机窗口10和音乐应用的窗口40。示例性的，如图6中的(a)图所示，PC 200可以在主界面402上显示手机窗口10和音乐应用的窗口40，该手机窗口10的显示内容可以是手机100的主界面，音乐应用的窗口40的显示内容可以是手机100的音乐应用的界面。
应理解，用户在手机100上启动并在前台运行了音乐应用，到执行完步骤1007之后，在PC 200上显示了音乐应用的窗口40。在用户启动并在前台运行了音乐应用到执行完步骤1007的过程中，即使用户在手机100上退出到主界面或者切换到其他应用，此时音乐应用为后台运行状态，并不会影响在PC 200上显示音乐应用的窗口40的进程。
在另一种可能的情况中，用户通过在手机100的主界面401点击音乐应用的图标，并播放音乐，如图4中的(a)和(b)图所示，PC 200上显示的手机窗口10可以显示为音乐应用的界面或者PC 200上可以显示音乐应用的窗口40。此时关于音乐音频的实际播放可以按照“谁开启谁播放”原则，具体地，用户在手机100上点击的音乐应用，则实际播放音乐音频的设备为手机100。
或者，用户通过点击PC 200的手机窗口10的音乐应用14播放音乐，如图6中的(a)图所示，且PC 200上显示音乐应用的窗口40，手机窗口10也可以显示为音乐应用的界面，此时实际播放音乐音频的设备为PC 200。
同理，在另一种可能的情况中，当用户正在通过手机100播放音乐，如图4中的(a)和(b)图所示，音乐应用运行时实际播放音乐音频的设备为手机100，如果用户又在PC 200的手机窗口10中点击视频应用15，并通过视频应用的窗口50播放视频，PC 200可以显示如图7中的(a)图所示界面402。此时，视频(包括音频和画面)的实际播放设备为PC 200。换言之，通过即使手机100通过视频流发送视频应用的窗口50中的视频内容信息，但是该视频内容信息被PC 200获取后，由PC 200的显示器、喇叭等播放设备进行播放，该视频应用对于手机100来说为后台运行状态，因此可以不影响原手机100的正在播放的音乐。
此外，如果运行音乐应用和视频应用的操作都是用户在PC 200的手机窗口10中完成，则播放音乐、播放视频的设备都为PC 200。此时音频的抢占原则可以参照现有技术的方案，例如后运行的视频应用的优先级较高，则自动暂停音乐的音频播放，本申请实施例对此不做限定。
应理解，以上介绍了PC 200显示2个窗口(手机窗口10和音乐应用的窗口40)的过程，按照上述介绍的方法，用户还可已运行给更多的手机100的应用，例如视频应用、聊天应用、办公软件应用等，PC 200上可以显示多个窗口，每个窗口对应不同的手机应用，此处不再赘述。
通过上述本申请实施例提供的显示多窗口的方法，对于相互通信的手机100和PC200，可以通过PC 200显示手机100的内容。当用户在手机100上运行多个应用时，在PC 200上可以通过显示多个窗口，每个窗口用于显示不同的应用。其中，每个窗口都可以接收用户的操作，例如对窗口的关闭、移动、缩放、窗口最大化、窗口最小化等操作；且用户可以在PC 200上显示的每个手机应用对应的窗口中，执行对该手机应用的操作，例如用户在PC 200的音乐应用的窗口中点击播放音乐、下一曲等控件，控制音乐的播放过程。此外，用户在PC 200上对手机应用的操作不影响用户对手机100的其他功能的使用，例如前述的用户使用手机100播放音乐，同时使用PC 200观看视频的场景。该方法可以提高文件共享等办公效率，提高了用户体验。
具体的实现过程中，借助于视频流的传输过程，手机100将运行的不同的应用的标识信息、PC 200上显示该应用的窗口的顶点坐标、长度、宽度等信息，通过编码形成视频流，例如将音乐应用的标识信息、PC 200上显示音乐应用的窗口40的顶点坐标、长度、宽度 等信息，以及视频应用的标识信息、PC 200上显示视频应用的窗口50的顶点坐标、长度、宽度等信息，编码在一路视频流中，将该视频流发送给PC 200，PC 200收到视频流进行解码之后，分别将不同的信息进行区分，以准确地将音乐应用的界面内容显示在音乐应用的窗口40中，将视频应用的界面内容显示在视频应用的窗口50中。
应理解，该一路视频流是通过一条视频流传输通道发送的视频流。如果在视频传输通道满足传输条件的情况下，也可以多路编码，例如音乐应用的标识信息、PC 200上显示音乐应用的窗口40的顶点坐标、长度、宽度等信息为一路编码成一路视频流，通过一个视频流传输通道发送；视频应用的标识信息、PC 200上显示视频应用的窗口50的顶点坐标、长度、宽度等信息，编码成另一路视频流，通过另一个视频流传输通道发送。该方案相比于目前现有的视频流编码和传输过程，该一路编码的方法可以节省手机功耗，且不限制PC 200上显示的手机应用的窗口的数量。
应理解，前述各个实施例中介绍了手机100将第一窗口的位置信息和第一界面的显示内容信息发送给PC 200，由PC 200根据手机100备的指示显示第一窗口。可选地，手机100可以不获取PC 200的显示区域的尺寸信息，而仅发送手机100的第一界面的显示内容信息，由PC 200决定第一窗口的位置信息，并显示第一窗口。同理，第二窗口的显示也可以由PC 200决定。
通过上述方案，PC 200可以根据自身的应用使用情况、界面内容等决定第一窗口、第二窗口的显示位置，可以更好的适应PC 200的使用进程，降低对PC 200的使用影响，提高用户体验。以上结合图10和图11介绍了当PC 200的显示屏上已经显示了手机窗口10之后，用户可以在手机100的界面点击音乐应用，并可以在PC 200上显示音乐应用的窗口40。此外，用户可以在PC 200的手机窗口10点击音乐应用14，也可以在PC 200上显示音乐应用的窗口40。
图12是本申请实施例提供的又一例显示多窗口的方法的示意性流程图。如图12所示，该方法1200可以包括以下步骤：
1201，PC 200的显示屏上显示手机窗口10。
1202，PC 200接收用户的第二操作，确定第二操作的操作信息。
本申请实施例中以用户在PC 200的手机窗口10中点击并运行音乐应用14为例进行说明。应理解，该第二操作可以是作用于某个应用用于启动该应用的操作。本申请实施例中第一操作、第二操作可以是针对不同设备的不同操作。示例性的，对于PC 200，用户可以是通过鼠标、键盘等外设输入设备执行单击操作或者双击操作，运行该音乐应用；或者，如果PC 200为具有触摸屏的设备时，用户的可以通过触摸点击运行该音乐应用，本申请实施例对第二操作的操作类型不做限定。
可选地，该第二操作的操作信息包括针对手机窗口10中某个应用的操作事件，该第二操作的操作信息还可以包括音乐应用的名称、ID、图标等至少一种信息。
具体地，对于PC 200，第二操作是一个操作事件(“touch event”)。PC 200接收该“touch event”后，确定该“touch event”发生的音乐应用的名称、ID、图标和在PC上的坐标，即确定前述的第二操作的操作信息。
1203，PC 200向手机100发送该第二操作的操作信息。
1204，手机100根据接收的第二操作的操作信息，确定运行音乐应用。
PC 200将该“touch event”传递给手机100，由手机100的系统确定该“touch event”，并 将该“touch event”发送给对应的音乐应用，由手机100的音乐应用确定该“touch event”用于点击并运行音乐应用。应理解，对于手机100来说，运行音乐应用可以为前台运行，例如手机100的主界面401直接显示音乐应用的界面；或者运行音乐应用可以为后台运行，例如音乐应用的界面不在手机100的界面显示，仅为后台运行状态。
1205，在虚拟区域中，确定第二区域,并获取第二区域的显示内容信息。
1206，将音乐应用的标识、第二区域的信息和第二区域的显示内容信息，编码生成第二视频流。
1207，手机100向PC 200发送该第二视频流。
1208，PC 200接收并解码该第二视频流，获取音乐应用的标识信息、第二区域的信息和第二区域的显示内容信息。
1209，PC 200根据第二区域的信息和第二区域的显示内容信息，在对应的区域显示音乐应用的窗口40。
应理解，以上介绍的步骤1205-1209过程可以参考图10中的步骤1003-10007，以及图11介绍的手机100编码第二视频流并向PC 200发送该第二视频流，并在PC 200的显示屏上显示音乐应用的窗口40的过程，此处不再赘述。至此，PC 200上可以根据用户的操作运行手机100的音乐应用。
通过上述方法，PC 200不需要安装手机100的应用，可以通过不同的窗口显示手机100的不同应用，用户可以在PC 200上运行手机100的应用，并针对每一个应用显示一个窗口，PC 200可以同时显示多个窗口。
在另一种可能的实现方式中，当手机100和PC 200之间建立连接之后，如图5中(a)、(b)、(c)图所示的过程，PC 200的主界面402上可以显示手机应用窗口30，该手机应用窗口30可以包括手机100的所有应用。下面结合图13介绍该实现方式中的流程
图13是本申请实施例提供的又一例显示多窗口的方法的示意性流程图，如图13所示，该方法1300可以包括以下步骤：
1301，手机100向PC 200发送应用的信息。
1302，PC 200根据获取的应用的信息，显示手机100的所有应用。
应理解，在该种实现方式中，手机100和PC 200建立连接之后，手机100可以自动将图3中示出的应用程序层的所有应用的信息发送给PC 200。或者，如图4中(b)图所示，当用户点击菜单窗口20的“EMUJI桌面”菜单时，触发PC 200向手机100发送获取应用的请求，用于请求获取手机100的应用的信息。
还应理解，这里应用的信息可以包括该应用程序层的所有应用的名称、标识(identification，ID)、图标等信息。PC 200接收到应用的信息之后，根据每一个应用的名称、ID、图标在手机应用窗口30显示该应用，进而显示手机100的所有应用，显示可以如图5中(c)图所示。还应理解，应用的标识可以体现为包名，包名中包含字符串，PC 200根据该包名就可以确定时音乐应用。还应理解，PC 200通过在手机应用窗口30显示手机100的应用列表，该应用列表中的所有应用程序为安装在手机100的应用程序，PC200上可以不安装手机100的应用程序，仅通过手机应用窗口30显示手机100的应用列表的图标。
1303，PC 200接收用户的第三操作，确定第三操作的操作信息。
1304，PC 200向手机100发送该第三操作的操作信息。
具体地，用户可以通过鼠标、键盘等外设输入设备等，在PC的主界面402上的EMUJI桌面呈现的应用列表中，点击任意一个应用，响应于用户的点击操作，PC上可以自动弹出该被点击的应用的窗口，运行该应用。
应理解，该第三操作可以是用户对PC 200上某应用窗口中的某个控件的点击操作，用于执行该控件的功能。
可选地，该第三操作的操作信息还包括音乐应用的界面的某个控件的名称、ID、图标等至少一种信息。
可选地，该第三操作的操作信息可以包括第三操作的事件类型和该第三操作作用的功能控件的标识(identification，ID)信息。
示例性的，当用户在PC 200的音乐应用的窗口40上点击播放控件，PC 200可以将点击播放控件的“touch event”事件发送给手机100，例如该“touch event”发生的音乐应用的窗口40的坐标、音乐应用的窗口40的播放控件名称、ID、图标和在PC 200上的坐标等。PC 200将该“touch event”传递给手机100，由手机100的系统根据音乐应用的窗口40的坐标确定该“touch event”发生在音乐应用，并将该“touch event”发送给对应的音乐应用，由该音乐应用根据播放控件名称、ID、图标和在PC 200上的坐标等确定该“touch event”用于点击播放控件。应理解，该过程可以为手机100的后台运行过程。
还应理解，本申请实施例中第一操作、第二操作、第三操作可以是针对不同设备的不同操作。示例性的，以运行音乐应用为例，对于手机，用户可以通过触摸点击操作运行该音乐应用；对于PC，用户可以是通过鼠标、键盘等外设输入设备执行单击操作或者双击操作，运行该音乐应用；或者，如果PC为具有触摸屏的设备时，用户的可以通过触摸点击运行该音乐应用，本申请实施例对第一操作、第二操作、第三操作的操作类型不做限定。
1305，手机100的音乐应用根据该第三操作的操作信息确定操作结果，执行操作结果。
1306，手机100向PC 200发送操作结果。
1307，PC 200接收手机100发送的操作结果，并同步该操作结果。
可选地，步骤1306中手机100向PC 200发送操作结果的过程，可以对应于图9和图11中手机100创建虚拟区域，并向PC 200发送第一视频流的过程，换言之，发送该操作结果的过程可以也借助于视频流的发送过程。具体地，手机100执行了点击音乐播放控件的操作之后，再根据当前手机100运行(后台运行或者当前手机界面运行)的音乐应用，重新确定第一视频流，用于PC 200显示音乐应用的窗口40，即在PC 200的音乐应用的窗口40中，完成点击音乐播放控件的操作，如暂停音乐播放，PC 200上的音乐应用的窗口40中，音乐播放控件变化为暂停状态。
应理解，以上介绍了从PC 200侧将用户的操作回传到手机100，同理，用户也可以在手机100执行的操作直接传给PC 200，此处不再赘述。该操作回传的过程可以由手机100和PC 200的MSDP服务APK的反向控制模块来参与，并保证同步地在手机100和PC 200执行相应的操作。
通过上述方案，用户在PC 200显示的手机应用的窗口中，可以执行对该应用的任意控件的操作，该操作可以回传到手机100，并由手机100执行该操作的结果，并将执行的结果再传递给PC 200，使得PC 200上该应用的窗口中可以同步手机100执行的该操作的结果，提高了手机应用的使用效率和使用体验。
可以理解的是，手机和PC等电子设备为了实现上述功能，其包含了执行各个功能相 应的硬件和/或软件模块。结合本文中所公开的实施例描述的各示例的算法步骤，本申请实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行，取决于技术方案的特定应用和设计约束条件。本领域技术人员可以结合实施例对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请实施例的范围。
本实施例可以根据上述方法示例对电子设备进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块可以采用硬件的形式实现。需要说明的是，本实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
本实施例还提供一种计算机可读存储介质，该计算机可读存储介质中存储有计算机指令，当该计算机指令在电子设备上运行时，使得电子设备执行上述相关方法步骤实现上述实施例中的显示多窗口的方法。
本实施例还提供了一种计算机程序产品，当该计算机程序产品在计算机上运行时，使得计算机执行上述相关步骤，以实现上述实施例中的显示多窗口的方法。
另外，本申请实施例的实施例还提供一种装置，这个装置具体可以是芯片，组件或模块，该装置可包括相连的处理器和存储器；其中，存储器用于存储计算机执行指令，当装置运行时，处理器可执行存储器存储的计算机执行指令，以使芯片执行上述各方法实施例中的显示多窗口的方法。
其中，本实施例提供的电子设备、计算机存储介质、计算机程序产品或芯片均用于执行上文所提供的对应的方法，因此，其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果，此处不再赘述。
通过以上实施方式的描述，所属领域的技术人员可以了解到，为描述的方便和简洁，仅以上述各功能模块的划分进行举例说明，实际应用中，可以根据需要而将上述功能分配由不同的功能模块完成，即将装置的内部结构划分成不同的功能模块，以完成以上描述的全部或者部分功能。
在本申请实施例所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，模块或单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个装置，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是一个物理单元或多个物理单元，即可以位于一个地方，或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个可读取存储介质中。基于这样的理解，本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来， 该软件产品存储在一个存储介质中，包括若干指令用以使得一个设备(可以是单片机，芯片等)或处理器(processor)执行本申请实施例各个实施例方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容，仅为本申请实施例的具体实施方式，但本申请实施例的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请实施例揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请实施例的保护范围之内。因此，本申请实施例的保护范围应以权利要求的保护范围为准。

Claims (43)

  1. 一种显示多窗口的方法，其特征在于，应用于包括相互通信的第一电子设备和第二电子设备的系统中，所述方法包括：
    所述第一电子设备接收所述第二电子设备的显示区域的尺寸信息；
    所述第一电子设备运行第一应用并显示所述第一应用的第一界面；
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第一界面对应的尺寸信息，确定所述第一界面在所述第二电子设备的显示区域中的第一窗口的位置信息；
    所述第一电子设备将所述第一窗口的位置信息和所述第一界面的显示内容信息发送给所述第二电子设备；
    所述第二电子设备根据接收的所述第一窗口的位置信息和所述第一界面的显示内容信息，在所述第一窗口显示所述第一界面；
    若所述第二电子设备检测到第一操作，响应于所述第一操作，向所述第一电子设备发送启动第二应用的指令；
    所述第一电子设备根据接收的启动所述第二应用的指令，启动所述第二应用；
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第二应用的第二界面对应的尺寸信息，确定所述第二界面在所述第二电子设备的显示区域中的第二窗口的位置信息；
    所述第一电子设备将所述第二窗口的位置信息和所述第二界面的显示内容信息发送给所述第二电子设备；
    所述第二电子设备根据接收的所述第二窗口的位置信息和所述第二界面的显示内容信息，在所述第二窗口显示所述第二界面，所述第一窗口与所述第二窗口为不同的窗口。
  2. 根据权利要求1所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备向所述第二电子设备发送所述第一应用的第一信息和所述第二应用的第二信息，所述第一应用的第一信息包括所述第一应用的名称、标识ID、图标的信息中的至少一个，所述第二应用的第二信息包括所述第二应用的名称、标识ID、图标的信息中的至少一个；
    所述第二电子设备接收所述第一应用的第一信息和所述第二应用的第二信息之后，自动显示第三界面，所述第三界面包括所述第一应用的第一信息和所述第二应用的第二信息；或者
    所述第二电子设备在检测到用户的第二操作后，根据所述第一应用的第一信息和所述第二应用的第二信息显示所述第三界面。
  3. 根据权利要求1或2所述的方法，其特征在于，所述第一窗口靠近所述第二电子设备的显示区域的右侧边缘。
  4. 根据权利要求1至3任一项所述的方法，其特征在于，所述第二窗口位于所述第一窗口的左侧，且与所述第一窗口没有重叠。
  5. 根据权利要求1至4任一项所述的方法，其特征在于，所述第二窗口位于所述第一窗口的上层。
  6. 根据权利要求1至5任一项所述的方法，其特征在于，所述第一窗口的位置信息包括：所述第一窗口的第一顶点的坐标信息，所述第一窗口的长度信息和所述第一窗口的宽度信息；或者
    所述第一窗口的位置信息包括：所述第一窗口的四个顶点的坐标信息。
  7. 根据权利要求1至5任一项所述的方法，其特征在于，所述第一窗口的尺寸信息是所述第一电子设备根据所述第一界面对应的尺寸信息确定；以及
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第一界面对应的尺寸信息，确定所述第一界面在所述第二电子设备的显示区域中的第一窗口的位置信息之前，所述方法还包括：
    所述第一电子设备获取所述第一电子设备的显示区域的尺寸信息，确定所述第一电子设备的显示区域的尺寸信息为所述第一界面对应的尺寸信息，或者所述第一界面对应的尺寸信息为所述第一电子设备的显示区域的尺寸信息和第一倍数的乘积，所述第一倍数大于0且不等于1。
  8. 根据权利要求1至5任一项所述的方法，其特征在于，所述第一窗口的尺寸信息是所述第一电子设备根据所述第一界面对应的尺寸信息确定；以及
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第一界面对应的尺寸信息，确定所述第一界面在所述第二电子设备的显示区域中的第一窗口的位置信息之前，所述方法还包括：
    所述第一电子设备从所述第一应用的配置信息中获取所述第一界面在所述第一电子设备上显示时的尺寸信息，将所述第一界面在所述第一电子设备上显示时的尺寸信息确定为所述第一界面对应的尺寸信息；或者
    所述第一电子设备从网络设备获取所述第一界面在所述第二电子设备上显示的尺寸信息，将所述第一界面在所述第二电子设备上显示的尺寸信息确定为所述第一界面对应的尺寸信息。
  9. 根据权利要求1至8任一项所述的方法，其特征在于，所述第一窗口包括所述第一界面和第一菜单栏；和/或
    所述第二窗口包括所述第二界面和第二菜单栏。
  10. 根据权利要求9所述的方法，其特征在于，所述第二菜单栏包括关闭按钮，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第二电子设备检测到用户对所述关闭按钮的操作，所述第二电子设备关闭所述第二窗口，并向所述第一电子设备发送关闭所述第二应用的指令；
    所述第一电子设备根据所述关闭所述第二应用的指令，关闭所述第二应用。
  11. 根据权利要求9所述的方法，其特征在于，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第二电子设备检测到用户选中所述第一窗口的操作，所述第二电子设备将所述第一窗口切换到最上层显示。
  12. 根据权利要求9所述的方法，其特征在于，所述第二菜单栏包括最大化按钮，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第二电子设备检测到用户对所述最大化按钮的操作，所述第二电子设备将所述第二窗口全屏显示。
  13. 根据权利要求1至12任一项所述的方法，其特征在于，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第一电子设备检测到用户关闭所述第二应用的指令；
    所述第一电子设备关闭所述第二应用，并通知所述第二电子设备关闭所述第二窗口；
    所述第二电子设备根据所述第一电子设备的通知关闭所述第二窗口。
  14. 根据权利要求1至12任一项所述的方法，其特征在于，若所述第一应用为音频播放应用，并且所述第二应用也为音频播放应用，所述第一电子设备启动所述第二应用之后，所述方法还包括：
    所述第一电子设备将所述第二应用的音频数据发送给所述第二电子设备；
    所述第二电子设备播放所述第二应用的音频数据。
  15. 一种显示多窗口的方法，其特征在于，应用于包括相互通信的第一电子设备和第二电子设备的系统中，所述方法包括：
    所述第一电子设备接收所述第二电子设备的显示区域的尺寸信息；
    所述第一电子设备运行第一应用并显示所述第一应用的第一界面；
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第一界面对应的尺寸信息，确定所述第一界面在所述第二电子设备的显示区域中的第一窗口的位置信息；
    所述第一电子设备将所述第一窗口的位置信息和所述第一界面的显示内容信息发送给所述第二电子设备；
    所述第一电子设备接收所述第二电子设备发送的启动第二应用的指令，启动所述第二应用；
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第二应用的第二界面对应的尺寸信息，确定所述第二界面在所述第二电子设备的显示区域中的第二窗口的位置信息，所述第一窗口与所述第二窗口为不同的窗口；
    所述第一电子设备将所述第二窗口的位置信息和所述第二界面的显示内容信息发送给所述第二电子设备。
  16. 根据权利要求15所述的方法，其特征在于，所述方法还包括：
    所述第一电子设备向所述第二电子设备发送所述第一应用的第一信息和所述第二应用的第二信息，所述第一应用的第一信息包括所述第一应用的名称、标识ID、图标的信息中的至少一个，所述第二应用的第二信息包括所述第二应用的名称、标识ID、图标的信息中的至少一个。
  17. 根据权利要求15或16所述的方法，其特征在于，所述第一窗口靠近所述第二电子设备的显示区域的右侧边缘。
  18. 根据权利要求15至17任一项所述的方法，其特征在于，所述第二窗口位于所述第一窗口的左侧，且与所述第一窗口没有重叠。
  19. 根据权利要求15至18任一项所述的方法，其特征在于，所述第二窗口位于所述第一窗口的上层。
  20. 根据权利要求15至19任一项所述的方法，其特征在于，所述第一窗口的位置信息包括：所述第一窗口的第一顶点的坐标信息，所述第一窗口的长度信息和所述第一窗口的宽度信息；或者
    所述第一窗口的位置信息包括：所述第一窗口的四个顶点的坐标信息。
  21. 根据权利要求15至19任一项所述的方法，其特征在于，所述第一窗口的尺寸信息是所述第一电子设备根据所述第一界面对应的尺寸信息确定；以及
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第一界面对应的尺寸信息，确定所述第一界面在所述第二电子设备的显示区域中的第一窗口的位置信息之前，所述方法还包括：
    所述第一电子设备获取所述第一电子设备的显示区域的尺寸信息，确定所述第一电子设备的显示区域的尺寸信息为所述第一界面对应的尺寸信息，或者所述第一界面对应的尺寸信息为所述第一电子设备的显示区域的尺寸信息和第一倍数的乘积，所述第一倍数大于0且不等于1。
  22. 根据权利要求15至19任一项所述的方法，其特征在于，所述第一窗口的尺寸信息是所述第一电子设备根据所述第一界面对应的尺寸信息确定；以及
    所述第一电子设备根据所述第二电子设备的显示区域的尺寸信息和所述第一界面对应的尺寸信息，确定所述第一界面在所述第二电子设备的显示区域中的第一窗口的位置信息之前，所述方法还包括：
    所述第一电子设备从所述第一应用的配置信息中获取所述第一界面在所述第一电子设备上显示时的尺寸信息，将所述第一界面在所述第一电子设备上显示时的尺寸信息确定为所述第一界面对应的尺寸信息；或者
    所述第一电子设备从网络设备获取所述第一界面在所述第二电子设备上显示的尺寸信息，将所述第一界面在所述第二电子设备上显示的尺寸信息确定为所述第一界面对应的尺寸信息。
  23. 根据权利要求15至22任一项所述的方法，其特征在于，所述第一窗口包括所述第一界面和第一菜单栏；和/或
    所述第二窗口包括所述第二界面和第二菜单栏。
  24. 根据权利要求23所述的方法，其特征在于，所述第二菜单栏包括关闭按钮，所述方法还包括：
    所述第一电子设备接收所述第二电子设备发送的关闭所述第二应用的指令；检测到用户对所述关闭按钮的操作，所述第二电子设备关闭所述第二窗口，并向所述第一电子设备
    响应于所述关闭所述第二应用的指令，所述第一电子设备关闭所述第二应用。
  25. 根据权利要求15至24任一项所述的方法，其特征在于，所述方法还包括：
    若所述第一电子设备检测到用户关闭所述第二应用的指令；
    所述第一电子设备关闭所述第二应用，并向所述第二电子设备发送关闭所述第二窗口的指令。
  26. 根据权利要求15至24任一项所述的方法，其特征在于，若所述第一应用为音频播放应用，并且所述第二应用也为音频播放应用，所述第一电子设备启动所述第二应用之后，所述方法还包括：
    所述第一电子设备将所述第二应用的音频数据发送给所述第二电子设备。
  27. 一种显示多窗口的方法，其特征在于，应用于包括相互通信的第一电子设备和第二电子设备的系统中，所述方法包括：
    所述第二电子设备接收所述第一电子设备发送的第一窗口的位置信息和第一界面的 显示内容信息，所述第一界面是所述第一电子设备运行第一应用并显示的界面；
    所述第二电子设备根据所述第一窗口的位置信息和所述第一界面的显示内容信息，在所述第二电子设备的显示区域的所述第一窗口显示所述第一界面；
    若所述第二电子设备检测到第一操作，响应于所述第一操作，向所述第一电子设备发送启动第二应用的指令；
    所述第二电子设备接收所述第一电子设备发送的第二窗口的位置信息和第二界面的显示内容信息，所述第二界面是所述第二应用的界面，所述第一窗口与所述第二窗口为不同的窗口；
    所述第二电子设备根据所述第二窗口的位置信息和所述第二界面的显示内容信息，在所述第二电子设备的显示区域的所述第二窗口显示所述第二界面。
  28. 根据权利要求27所述的方法，其特征在于，所述方法还包括：
    所述第二电子设备接收所述第一电子设备发送的所述第一应用的第一信息和所述第二应用的第二信息，所述第一应用的第一信息包括所述第一应用的名称、标识ID、图标的信息中的至少一个，所述第二应用的第二信息包括所述第二应用的名称、标识ID、图标的信息中的至少一个；
    所述第二电子设备自动显示第三界面，所述第三界面包括所述第一应用的第一信息和所述第二应用的第二信息；或者
    所述第二电子设备在检测到用户的第二操作后，根据所述第一应用的第一信息和所述第二应用的第二信息显示所述第三界面。
  29. 根据权利要求27或28所述的方法，其特征在于，所述第一窗口靠近所述第二电子设备的显示区域的右侧边缘。
  30. 根据权利要求27至29任一项所述的方法，其特征在于，所述第二窗口位于所述第一窗口的左侧，且与所述第一窗口没有重叠。
  31. 根据权利要求27至30任一项所述的方法，其特征在于，所述第二窗口位于所述第一窗口的上层。
  32. 根据权利要求27至31任一项所述的方法，其特征在于，所述第一窗口的位置信息包括：所述第一窗口的第一顶点的坐标信息，所述第一窗口的长度信息和所述第一窗口的宽度信息；或者
    所述第一窗口的位置信息包括：所述第一窗口的四个顶点的坐标信息。
  33. 根据权利要求27至31任一项所述的方法，其特征在于，所述第一窗口的尺寸信息是所述第一电子设备根据所述第一界面对应的尺寸信息确定的；以及所述第一界面对应的尺寸信息为所述第一电子设备的显示区域的尺寸信息，或者所述第一界面对应的尺寸信息为所述第一电子设备的显示区域的尺寸信息和第一倍数的乘积，所述第一倍数大于0且不等于1。
  34. 根据权利要求27至31任一项所述的方法，其特征在于，所述第一窗口的尺寸信息是所述第一电子设备根据所述第一界面对应的尺寸信息确定的；以及所述第一界面对应的尺寸信息为所述第一界面在所述第一电子设备上显示时的尺寸信息，或者所述第一界面对应的尺寸信息为所述第一电子设备从网络设备获取所述第一界面在所述第二电子设备上显示的尺寸信息。
  35. 根据权利要求27至34任一项所述的方法，其特征在于，所述第一窗口包括所述 第一界面和第一菜单栏；和/或
    所述第二窗口包括所述第二界面和第二菜单栏。
  36. 根据权利要求35所述的方法，其特征在于，所述第二菜单栏包括关闭按钮，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第二电子设备检测到用户对所述关闭按钮的操作，所述第二电子设备关闭所述第二窗口，并向所述第一电子设备发送关闭所述第二应用的指令。
  37. 根据权利要求35所述的方法，其特征在于，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第二电子设备检测到用户选中所述第一窗口的操作，所述第二电子设备将所述第一窗口切换到最上层显示。
  38. 根据权利要求35所述的方法，其特征在于，所述第二菜单栏包括最大化按钮，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第二电子设备检测到用户对所述最大化按钮的操作，所述第二电子设备将所述第二窗口全屏显示。
  39. 根据权利要求27至38任一项所述的方法，其特征在于，所述第二电子设备在所述第二窗口显示所述第二界面之后，所述方法还包括：
    若所述第二电子设备接收到所述第一电子设备发送的关闭所述第二窗口的指令；
    响应于所述关闭所述第二窗口的指令，所述第二电子设备关闭所述第二窗口。
  40. 根据权利要求27至38任一项所述的方法，其特征在于，若所述第一应用为音频播放应用，并且所述第二应用也为音频播放应用，所述方法还包括：
    所述第二电子设备接收所述第一电子设备发送的所述第二应用的音频数据，播放所述第二应用的音频数据。
  41. 一种电子设备，其特征在于，所述电子设备包括：一个或多个处理器；存储器；多个应用程序；以及一个或多个程序，其中所述一个或多个程序被存储在所述存储器中，当所述一个或者多个程序被所述处理器执行时，使得所述电子设备执行如权利要求15至40中任一项所述的显示多窗口的方法。
  42. 一种计算机可读存储介质，其特征在于，包括计算机指令，当所述计算机指令在电子设备上运行时，使得所述第一电子设备执行如权利要求15至40中任一项所述的显示多窗口的方法。
  43. 一种计算机程序产品，其特征在于，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如权利要求15至40中任一项所述的显示多窗口的方法。
PCT/CN2020/130112 2019-12-26 2020-11-19 显示多窗口的方法、电子设备和系统 WO2021129253A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2022531601A JP2023503679A (ja) 2019-12-26 2020-11-19 マルチウィンドウ表示方法、電子デバイス及びシステム
US17/770,372 US20220398059A1 (en) 2019-12-26 2020-11-19 Multi-window display method, electronic device, and system
EP20905135.8A EP4040277A4 (en) 2019-12-26 2020-11-19 METHOD OF DISPLAYING MULTIPLE WINDOWS, AND ELECTRONIC DEVICE AND SYSTEM

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911366233.2 2019-12-26
CN201911366233.2A CN113050841A (zh) 2019-12-26 2019-12-26 显示多窗口的方法、电子设备和系统

Publications (1)

Publication Number Publication Date
WO2021129253A1 true WO2021129253A1 (zh) 2021-07-01

Family

ID=76505339

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/130112 WO2021129253A1 (zh) 2019-12-26 2020-11-19 显示多窗口的方法、电子设备和系统

Country Status (5)

Country Link
US (1) US20220398059A1 (zh)
EP (1) EP4040277A4 (zh)
JP (1) JP2023503679A (zh)
CN (2) CN113050841A (zh)
WO (1) WO2021129253A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4175306A4 (en) * 2021-09-17 2024-01-24 Honor Device Co Ltd COLLABORATION WINDOW PROCESSING METHOD AND SYSTEM AND ELECTRONIC DEVICE

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022099487A (ja) * 2020-12-23 2022-07-05 セイコーエプソン株式会社 画像表示システム、画像表示システムの制御方法、及び、表示装置の制御方法
CN115543163A (zh) * 2021-06-30 2022-12-30 华为技术有限公司 一种投屏显示方法及电子设备
CN113391782A (zh) * 2021-06-30 2021-09-14 深圳市斯博科技有限公司 计算机控制移动终端的方法、系统、电子设备及存储介质
CN115617427A (zh) * 2021-07-13 2023-01-17 华为技术有限公司 应用的跨平台显示方法、可读介质和电子设备
CN116069224A (zh) * 2021-10-29 2023-05-05 华为终端有限公司 输入控制方法及电子设备
US20230393890A1 (en) * 2022-06-03 2023-12-07 Snap Inc. Auto-recovery for ar wearable devices
CN115146192B (zh) * 2022-09-02 2023-01-24 荣耀终端有限公司 内容接续方法和相关装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104376090A (zh) * 2014-11-20 2015-02-25 北京安奇智联科技有限公司 计算设备的浏览器与移动终端的屏幕同步
CN105518643A (zh) * 2013-08-30 2016-04-20 三星电子株式会社 多显示方法、存储介质和电子装置
CN106201389A (zh) * 2015-03-06 2016-12-07 维斯吉特株式会社 用户装置间分配画面并共享界面的多屏幕实现方法及装置
US20170177690A1 (en) * 2015-12-21 2017-06-22 Sap Se Data synchronization error resolution

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2605611B1 (en) * 2010-08-13 2020-12-23 LG Electronics Inc. Mobile/portable terminal device for displaying and method for controlling same
US20160054757A1 (en) * 2012-02-29 2016-02-25 Z124 Unified desktop docking flow
EP4164203A1 (en) * 2012-09-10 2023-04-12 Samsung Electronics Co., Ltd. Method for connecting mobile terminal and external display and apparatus implementing the same
KR102043049B1 (ko) * 2013-04-01 2019-11-11 삼성전자 주식회사 앱 운용 방법 및 앱 운용 장치와, 이를 지원하는 앱 출력 장치
CN105828139A (zh) * 2016-04-06 2016-08-03 乐视控股（北京）有限公司 一种视频投屏方法及装置
KR102597036B1 (ko) * 2016-10-11 2023-11-02 삼성전자주식회사 듀얼 디스플레이를 가지는 전자 장치 및 이의 운용 방법
WO2018117719A1 (ko) * 2016-12-23 2018-06-28 삼성전자 주식회사 전자 장치 및 그의 제어 방법
US10796412B2 (en) * 2017-07-07 2020-10-06 Intelligent Waves Llc System, method and computer program product for remoting orientation changes
US20190296930A1 (en) * 2018-03-20 2019-09-26 Essential Products, Inc. Remote control of an assistant device using an adaptable user interface
CN110086938A (zh) * 2019-04-29 2019-08-02 百度在线网络技术（北京）有限公司 投屏显示的控制方法、系统、电子设备及计算机可读介质
CN110515576B (zh) * 2019-07-08 2021-06-01 华为技术有限公司 显示控制方法及装置
CN110471639B (zh) * 2019-07-23 2022-10-18 华为技术有限公司 显示方法及相关装置
KR20210016936A (ko) * 2019-08-06 2021-02-17 삼성전자주식회사 전자 장치 및 전자 장치의 데이터 공유 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105518643A (zh) * 2013-08-30 2016-04-20 三星电子株式会社 多显示方法、存储介质和电子装置
CN104376090A (zh) * 2014-11-20 2015-02-25 北京安奇智联科技有限公司 计算设备的浏览器与移动终端的屏幕同步
CN106201389A (zh) * 2015-03-06 2016-12-07 维斯吉特株式会社 用户装置间分配画面并共享界面的多屏幕实现方法及装置
US20170177690A1 (en) * 2015-12-21 2017-06-22 Sap Se Data synchronization error resolution

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4040277A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4175306A4 (en) * 2021-09-17 2024-01-24 Honor Device Co Ltd COLLABORATION WINDOW PROCESSING METHOD AND SYSTEM AND ELECTRONIC DEVICE

Also Published As

Publication number Publication date
JP2023503679A (ja) 2023-01-31
US20220398059A1 (en) 2022-12-15
CN115793916A (zh) 2023-03-14
CN113050841A (zh) 2021-06-29
EP4040277A1 (en) 2022-08-10
EP4040277A4 (en) 2022-12-21

Similar Documents

Publication Publication Date Title
WO2021057830A1 (zh) 一种信息处理方法及电子设备
WO2021227770A1 (zh) 应用窗口显示方法和电子设备
WO2021129253A1 (zh) 显示多窗口的方法、电子设备和系统
WO2021052147A1 (zh) 一种数据传输的方法及相关设备
WO2022100315A1 (zh) 应用界面的生成方法及相关装置
WO2022052772A1 (zh) 多窗口投屏场景下的应用界面显示方法及电子设备
WO2022052773A1 (zh) 多窗口投屏方法及电子设备
WO2022100305A1 (zh) 画面跨设备显示方法与装置、电子设备
WO2022052671A1 (zh) 一种显示窗口的方法、切换窗口的方法、电子设备和系统
WO2021121052A1 (zh) 一种多屏协同方法、系统及电子设备
WO2022105445A1 (zh) 基于浏览器的应用投屏方法及相关装置
WO2022083296A1 (zh) 一种显示方法及电子设备
CN112527174B (zh) 一种信息处理方法及电子设备
CN112527222A (zh) 一种信息处理方法及电子设备
WO2022127661A1 (zh) 应用共享方法、电子设备和存储介质
WO2022089294A1 (zh) 一种设备间屏幕协同方法及设备
WO2022083465A1 (zh) 电子设备的投屏方法及其介质和电子设备
WO2023130921A1 (zh) 一种适配多设备的页面布局的方法及电子设备
WO2024021519A1 (zh) 卡片显示方法、终端设备
WO2021052488A1 (zh) 一种信息处理方法及电子设备
WO2022142674A1 (zh) 一种快捷方式的创建方法及相关设备
WO2024001871A1 (zh) 一种操控方法和电子设备
WO2023078133A1 (zh) 视频播放方法和装置
CN114281440B (zh) 一种双系统中用户界面的显示方法及电子设备
WO2023217142A1 (zh) 窗口尺寸调整方法、相关装置及通信系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20905135

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020905135

Country of ref document: EP

Effective date: 20220505

ENP Entry into the national phase

Ref document number: 2022531601

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE