WO2022100326A1 - 电子设备及其设备间屏幕协同方法和介质 - Google Patents

电子设备及其设备间屏幕协同方法和介质 Download PDF

Info

Publication number
WO2022100326A1
WO2022100326A1 PCT/CN2021/122792 CN2021122792W WO2022100326A1 WO 2022100326 A1 WO2022100326 A1 WO 2022100326A1 CN 2021122792 W CN2021122792 W CN 2021122792W WO 2022100326 A1 WO2022100326 A1 WO 2022100326A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
electronic device
display
screen
mobile phone
Prior art date
Application number
PCT/CN2021/122792
Other languages
English (en)
French (fr)
Inventor
牛庆建
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Priority to US18/001,380 priority Critical patent/US20230229375A1/en
Priority to EP21890854.9A priority patent/EP4145268A4/en
Publication of WO2022100326A1 publication Critical patent/WO2022100326A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/04Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/16Use of wireless transmission of display information
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/22Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
    • G09G5/24Generation of individual character patterns
    • G09G5/26Generation of individual character patterns for modifying the character dimensions, e.g. double width, double height
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/22Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
    • G09G5/30Control of display attribute

Definitions

  • the present application relates to the field of terminal technologies, and in particular, to an electronic device and a method and medium for screen collaboration between devices.
  • the user when the multi-screen collaborative display is performed between the mobile phone 100 and the tablet computer 200, the user can start the mobile phone by clicking the multi-screen collaborative button in the drop-down menu of the mobile phone 100.
  • 100 multi-screen collaborative display function As shown in FIG. 1( c ), after the user determines that the collaboration object is the tablet computer 200 , the mobile phone 100 and the tablet computer 200 complete the communication connection through the wireless communication function.
  • the display interface 202 of the tablet computer 200 mirrors the display interface 103 of the mobile phone 100 , similar to projecting the window of the mobile phone 100 to the display interface 202 of the tablet computer 200 . It can be seen from FIG.
  • the font style of the tablet computer 200 is Song type, and the background color is white, while the font style of the characters in the current display interface 103 of the mobile phone 100 is italic type, and a “ripple” background pattern (for example, The background color is pink or blue, and there are ripples on the background pattern). Therefore, after the display interface 103 of the mobile phone 100 is projected to the display interface 202 of the tablet computer 200, there is a style difference between the display interface 202 of the tablet computer 200 and the display interface 103 of the tablet computer 200. coordination issues.
  • the purpose of this application is to provide an electronic device and a method and medium for screen collaboration between devices.
  • the electronic device will modify the display style of the display content to be projected according to the display style of the screen-projected device, and then Perform screen projection, so that the display style of the displayed content of the projection screen is consistent with the display style of the co-displayed device to be projected.
  • a first aspect of the present application provides a method for screen collaboration between devices, which is applied to a screen collaboration system including a first electronic device and a second electronic device, the method comprising: establishing multi-screen collaboration between the first electronic device and the second electronic device connected; the first electronic device displays a first interface, the first interface includes first content, and the first interface has first display parameters; the second electronic device displays a second interface, the second interface includes second content, and the second interface has the first display parameter. two display parameters; the first electronic device sends a third interface to the second electronic device; in response to the received third interface, the second electronic device displays a fourth interface, the fourth interface includes the second content and the first window, the first The window includes first content, and the first content in the first window has second display parameters.
  • the generated display content is the same as the first interface but the display parameters are the same as those of the second electronic device.
  • a third interface with the same interface so that when the second electronic device simultaneously displays its own second content and the first content projected by the first electronic device (in the first window) on the fourth interface, the display styles of the two are consistent. .
  • the first electronic device may be a mobile phone
  • the second electronic device may be a smart watch.
  • the first interface here can be a display interface of a mobile phone, and the display interface includes: a contact icon, a contact name, etc., which are the first content.
  • the font of the characters in the display interface of the mobile phone is italics, and the background color is pink , which is the first display parameter.
  • the second interface here may be the display interface of the smart watch, and the display interface includes: date and time, etc., which is the second content.
  • the font of the characters in the display interface of the smart watch is Huawen Caiyun
  • the background color is white , which is the second display parameter.
  • the third interface can be a screen projection interface generated by the mobile phone for projecting the screen to the second electronic device.
  • the mobile phone modifies the font style in the third interface from italics to Chinese Caiyun, and modifies the background color to white, that is, modifying is the second display parameter, and then the third interface is projected to the display interface of the smart watch.
  • the fourth interface here may be the display interface of the smart watch, and the first window is a partial screen projection area in the display interface of the smart watch.
  • the smart watch receives the third interface of the mobile phone, in addition to displaying the date and time on the display interface, it also displays the third interface in the partial screen projection area, that is, the contact icon, the contact name, the prompt content, and the cancel button. and switching to the voice button, etc., is the first content.
  • the font of the characters in the first content is Huawen Caiyun
  • the background color is white, that is, the second display parameter.
  • the display parameters include at least one of font style, font size, font color, icon color, icon size, background color, background pattern, and control attributes, and the display parameters include the first Display parameter and second display parameter.
  • the second display parameter includes a display style identifier
  • the display style identifier corresponds to the display style of the second interface, wherein, corresponding to different display style identifiers, the second interface of the second electronic device At least one of font style, font size, font color, icon color, icon size, background color, background pattern, and control properties differs in .
  • the display parameters may be parameters that specifically represent font style, font size, font color, icon color, icon size, background color, background pattern, control attributes, etc., or may be corresponding to different font styles, Identification of font size, font color, icon color, icon size, background color, background pattern, control properties, etc.
  • the display style ID1 corresponding to display parameter A the corresponding font is Arial
  • the font color is black
  • the background color is white
  • the display style ID2 corresponding to display parameter B the corresponding font is italic
  • the font color is light gray
  • the background color is black.
  • the above-mentioned method includes: the first electronic device receives the second display parameter sent by the second electronic device, and generates a third interface based on the received second display parameter, wherein the first electronic device The three interfaces include first content and have second display parameters.
  • the first electronic device generates a third interface with the same display content as the first interface of the first electronic device, but with the same display style as the second interface of the second electronic device, and then Project the screen to the second electronic device.
  • the first electronic device generates the third interface in the following manner: the first electronic device increases the font size in the third interface to the second interface with the second electronic device
  • the font size of the third interface is the same, the number of characters in the third interface is reduced, and the property of at least one control in the third interface is modified to be invisible.
  • the font size of the first window is larger than the font size of the first interface and the same as the font size in the second interface of the second electronic device, and the number of characters in the first window is Less than the number of characters in the first interface, and the attribute of at least one control of the first content is visible in the first interface, and the attribute in the first window is invisible.
  • the display style of the second interface of the second electronic device is elderly mode or simplified mode
  • the first electronic device is in non-elderly mode
  • the first interface in the first window After the display style of the first display content is adjusted to the elderly mode or simplified mode of the second electronic device, the font will become larger, and the corresponding number of characters will be reduced after the font becomes larger.
  • the first electronic device generates the third interface in the following manner: the first electronic device adjusts the background color in the third interface to the background of the second interface with the second electronic device The color is the same, and the color of the characters and icons in the third interface is adjusted to be different from the background color.
  • the background color of the first window is the same as the background color of the second interface of the second electronic device or the second content in the fourth interface, and the characters and icons in the first window is different from the background color.
  • the display style of the second interface of the second electronic device is dark mode, that is, the background color of the second electronic device is dark, the characters and icons therein are light, and the first interface of the first electronic device is dark
  • the background color is light, and the characters and icons are darker.
  • the background color of the third interface generated by the first electronic device will also change to dark, and after the screen is projected to the second electronic device, the background color of the first display content in the first window is also dark. color, and the colors of characters and icons are changed to light colors accordingly.
  • the third interface is an invisible view in the first electronic device or the third interface is generated on a virtual screen of the first electronic device.
  • the size of the third interface is smaller than the size of the screen of the first electronic device, and the third interface and the first interface are simultaneously displayed on the screen of the first electronic device.
  • the first electronic device may generate the third interface in a picture-in-picture manner.
  • the first electronic device further acquires the size of the first window from the second electronic device, and the size of the third interface generated by the first electronic device is the same as the size of the first window.
  • the second electronic device displays the third interface in the local screen projection area where its own display interface is heavy.
  • the first electronic device here may be a mobile phone
  • the second electronic device is a smart watch.
  • the third interface may be a window created by the mobile phone, and the window and the display interface of the mobile phone are displayed at the same time.
  • the size of the window can be the size of the local projection area obtained by the mobile phone from the smart watch.
  • the first electronic device further acquires the size of the first window from the second electronic device
  • the first electronic device sends the second electronic device a third interface that is reduced in size or enlarged to the same size as the first window.
  • the first electronic device may reduce or enlarge the third interface before sending it to the second electronic device, and the second electronic device displays the third interface in a partial screen projection area of the screen, i.e. in the first window.
  • the mobile phone determines that the size of the first window is smaller than the size of the screen projection interface of the mobile phone, and the mobile phone reduces the screen projection interface and sends it to the smart watch.
  • the screen coordination system further includes a third electronic device
  • the method further includes: the first electronic device further establishes a multi-screen coordination connection with the third electronic device, and the third electronic device Displaying a fifth interface, the fifth interface includes third content, and the fifth interface has third display parameters; the first electronic device sends the sixth interface to the third electronic device; in response to the received sixth interface, the third electronic device displays A seventh interface, the seventh interface includes a third content and a second window, the second window includes the first content, and the first content in the second window has a third display parameter.
  • the first electronic device can project the first interface to the second electronic device and the third electronic device at the same time, and corresponding to the display styles of the second electronic device and the third electronic device, correspondingly generate the third interface and the seventh interface, So that when the first content is displayed on the second electronic device and the third electronic device, the display style is the same as that of the second electronic device and the third electronic device, respectively.
  • the sixth interface includes the first content and has third display parameters.
  • the first electronic device generates and sends a third interface to the second electronic device when the user determines to modify the display style; and the first electronic device determines not to modify the display when the user determines
  • the first interface is sent to the second electronic device, and the second electronic device displays an eighth interface in response to the received first interface, the eighth interface includes the second content and the third window, and the third window includes the first interface. an interface.
  • the user may decide whether to modify the display style and then perform screen projection during the multi-screen collaborative display process.
  • the first interface of the first electronic device includes at least one of a display desktop of the first electronic device, a left-swipe display interface, a pull-down menu, and an application display interface.
  • a second aspect of the present application provides a method for inter-device screen collaboration, including: establishing a multi-screen collaborative connection between a first electronic device and a second electronic device; the first electronic device displays a first interface, and the first interface includes first content, The first interface has first display parameters; the first electronic device receives second display parameters sent by the second electronic device, wherein the second electronic device has a second interface for displaying, the second interface includes second content, and the second interface has a second interface Display parameters; the first electronic device generates a third interface according to the second display parameters; the first electronic device sends a third interface to the second electronic device, and the third interface includes the first content and has the second display parameters.
  • the display parameters include at least one of font style, font size, font color, icon color, icon size, background color, background pattern, and control attributes, and the display parameters include the first display parameter and the second display parameter.
  • the second display parameter includes a display style identifier corresponding to a display style of the second interface of the second electronic device, wherein, corresponding to different display style identifiers, the first display style identifier of the second electronic device At least one of font style, font size, font color, icon color, icon size, background color, background pattern, and control properties in the two interfaces is different.
  • the third interface includes the first content and has second display parameters.
  • the font size of the first interface of the first electronic device is smaller than the font size of the first window of the second electronic device, and the number of characters in the first interface is larger than that in the first window The number of characters in the first content, and the attribute of at least one control of the first content is visible in the first interface, but the attribute in the first window is invisible.
  • the background color of the first interface on the first electronic device is different from the background color of the first window in the fourth interface on the second electronic device.
  • the screen coordination system further includes a third electronic device, wherein the third electronic device displays a fifth interface, the fifth interface includes third content, and the fifth interface has third display parameters
  • the method further includes: establishing a multi-screen collaborative connection between the first electronic device and the third electronic device; the first electronic device sends a sixth interface to the third electronic device, and the sixth interface causes the third electronic device to display a seventh interface, wherein the sixth interface
  • the seven interface includes third content and a second window, the second window includes the first content, and the first content in the second window has a third display parameter.
  • the sixth interface includes the first content and has third display parameters.
  • the first electronic device generates and sends a third interface to the second electronic device when the user determines to modify the display style; and the first electronic device determines not to modify the display when the user determines
  • the first electronic device sends a first interface to the second electronic device, wherein the first interface causes the second electronic device to display an eighth interface, wherein the eighth interface includes the second content and a third window, and the third window Including the first interface.
  • the first interface of the first electronic device includes at least one of a display desktop, a left-swipe display interface, a pull-down menu, and an application display interface of the first electronic device.
  • a third aspect of the present application provides an apparatus, the apparatus is included in an electronic device, and the apparatus has a function of implementing the behavior of the electronic device in the above-mentioned aspect and possible implementations of the above-mentioned aspect.
  • the functions can be implemented by hardware, or by executing corresponding software by hardware.
  • the hardware or software includes one or more modules or units corresponding to the above functions. For example, a communication connection unit or module (such as a Bluetooth or WIFI module), a display parameter acquisition unit or module, a display interface generation unit or module, and a multi-screen collaboration unit or module (such as a processor with the function of the module or unit), etc. .
  • the communication connection unit or module is used to support the first electronic device and the second electronic device in the multiple electronic devices to establish a multi-screen collaborative connection;
  • the display parameter acquisition unit or module is used to support the first electronic device from the second electronic device.
  • the display interface generation unit or module is used to support the first electronic device to generate a third interface according to the second display parameter pair received by the display parameter acquisition unit or module, and the third interface includes the first electronic device.
  • the first content of an interface, and the first content has a second display parameter.
  • the multi-screen collaboration unit or module is used to support the first electronic device to send a third interface to the second electronic device; the second electronic device displays a fourth interface in response to the received third interface, and the fourth interface includes the second content and A first window, the first window includes first content, and the first content in the first window has a second display parameter.
  • a fourth aspect of the present application provides an electronic device, comprising: a memory storing instructions; a processor, where the processor is coupled to the memory, and when program instructions stored in the memory are executed by the processor, the electronic device executes the foregoing first aspect Or the inter-device screen collaboration method provided by the second aspect.
  • a fifth aspect of the present application provides a readable medium in which instructions are stored, characterized in that, when the instructions are executed on the readable medium, the readable medium is caused to perform the aforementioned first aspect or the second aspect Provides a screen collaboration method between devices.
  • FIG. 1 shows an example in the prior art that a mobile phone projects its own display interface to a tablet computer for multi-screen collaborative display;
  • FIG. 2 shows a screen collaboration system according to an embodiment of the present application
  • FIG. 3a shows a screen projection scenario between electronic devices according to an embodiment of the present application
  • FIG. 3b shows a screen projection scenario between electronic devices according to an embodiment of the present application
  • FIG. 3c shows a screen projection scenario between electronic devices according to an embodiment of the present application
  • FIG. 3d shows a screen projection scenario between electronic devices according to an embodiment of the present application
  • FIG. 3e shows a screen projection scenario between electronic devices according to an embodiment of the present application
  • FIG. 4 shows a block diagram of a hardware structure of an electronic device in an embodiment of the present application
  • FIG. 5 shows an example of a screen coordination system on an electronic device in an embodiment of the present application
  • FIG. 6 shows a flowchart of a method for projecting a display interface on a mobile phone to a screen of a tablet computer for multi-screen collaborative display according to an embodiment of the present application
  • FIG. 7 shows an example of enabling a consistent display mode on a mobile phone according to an embodiment of the present application
  • FIG. 8 shows another example of enabling a consistent display mode on a mobile phone according to an embodiment of the present application
  • FIG. 9 shows an example of prompting on a mobile phone whether to enable the consistent display mode according to an embodiment of the present application
  • FIG. 10 shows an example of prompting on the mobile phone that the consistent display mode cannot be turned on according to an embodiment of the present application
  • FIG. 11a shows an example in which the background color of the display interface on the mobile phone is consistent with the background color of the display interface of the tablet computer after the display interface on the mobile phone is projected to the tablet computer according to an embodiment of the present application;
  • FIG. 11b shows an example in which the background pattern of the display interface on the mobile phone is consistent with the background pattern of the display interface of the tablet computer after the display interface on the mobile phone is projected to the tablet computer according to an embodiment of the present application;
  • 11c shows an example in which the font style of the display interface on the mobile phone is consistent with the font style of the display interface of the tablet computer after the display interface on the mobile phone is projected to the tablet computer according to the embodiment of the present application;
  • FIG. 12 shows an example of screen projection between electronic devices in a picture-in-picture manner according to an embodiment of the present application
  • FIG. 13 is a flowchart of a method for projecting a display interface on a mobile phone to a smart watch screen for multi-screen collaborative display according to an embodiment of the present application
  • FIG. 14 is a flowchart of a method for simultaneously projecting a display interface on a mobile phone to a screen of a smart watch and a car machine for multi-screen collaborative display according to an embodiment of the present application;
  • FIG. 15 shows a flowchart of a method for performing screen collaboration between a first electronic device and a second electronic device according to an embodiment of the present application
  • FIG. 16 shows a block diagram of a software structure of an electronic device according to an embodiment of the present application.
  • the present application provides a screen projection solution.
  • the electronic device modifies the display style of the display content to be projected according to the display style of the screen projected device, and then performs screen projection.
  • the display style of the electronic device can be represented by display parameters, and the display parameters include at least one of font style, font size, font color, icon color, icon size, background color, background pattern, and control attributes.
  • the display interface described in this application has display parameters, which may mean that the display content on the display interface is displayed according to certain parameters.
  • FIG. 2 illustrates a screen collaboration system according to some embodiments of the present application.
  • the screen coordination system includes a first electronic device 100 , a second electronic device 200 and a server 300 .
  • the first electronic device 100 is capable of wirelessly communicating with the second electronic device 200 and the server 300, respectively.
  • the first electronic device 100 may acquire the display parameters of the current display interface 202 of the second electronic device 200 from the second electronic device 200 .
  • the first electronic device 100 generates a screen projection interface 104
  • the display content of the screen projection interface 104 is the same as the display content of the display interface 103 currently displayed on the screen of the first electronic device 100, but the first electronic device 100 according to the acquired
  • adjust the display parameters of the screen projection interface 104 to be the same as those sent by the second electronic device 200 , so that the display style of the screen projection interface 104 is consistent with the display style of the display interface 202 of the second electronic device 200
  • the first electronic device projects the screen projection interface 104 with the adjusted display style to the second electronic device 200 , and during this process, the original display style of the current display interface 103 of the first electronic device 100 may not be changed.
  • the display parameters may include the font style, font size, font color, icon color, icon size, background color, and background pattern of the characters being used in the display interface 202 of the second electronic device 200 , control properties and other parameters, which will be described in detail below.
  • font style, font size, font color, icon color, icon size, background color, background pattern, control properties, etc. can also be uniformly included in one theme mode. , for example, elderly mode (easy mode), dark mode, etc.
  • the controls here may include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, etc. in the display interface 103 of the first electronic device 100 .
  • Control properties may include the size, position, arrangement order and whether to display or not of the above controls.
  • the first electronic device 100 may also obtain the above-mentioned missing display function from the server 300 .
  • the server 300 may be used for storing and updating the display function, and at the request of the first electronic device 100 or actively sending the stored or updated display function to the first electronic device 100 .
  • the server 300 can collect and update display functions by itself.
  • the server 300 may collect information included in different display styles from each electronic device (such as each second electronic device 200 ) or from each font size, font style, background pattern, background color, and control attributes, or from the developer of the theme mode.
  • Various display functions for example, the developer registers or lists the font size, font style, background pattern, background color and control attributes, theme mode in the application store of the server 300; for another example, the server 300 requests each electronic device to report the font size, font style, background pattern, background color and control properties, theme mode).
  • the server 300 may also send the newly collected display style parameters such as font size, font style, background pattern, background color, control attributes, theme mode and other display style parameters to the first electronic device 100 based on the request of the first electronic device 100 or by means of regular push. device 100.
  • the partial screen projection area of the first electronic device 100 in the second electronic device 200 may be the display interface 103 of the first electronic device 100 in the screen of the second electronic device 200 Or a local screen projection area with the same screen size, for example, project the display interface on the mobile phone to the local screen projection area on a tablet computer with a screen size larger than that of the mobile phone.
  • the display interface of the electronic device may also be reduced and then projected to the second electronic device 200.
  • the first electronic device 100 can also project the display interface 103 on the screen to a plurality of second electronic devices 200 at the same time, and adapt to the display style of each second electronic device 200 to be projected.
  • Figures 3a to 3e respectively show various projection scenarios.
  • the first electronic device 100 is a mobile phone 100 as an example
  • the second electronic device 200 is a tablet computer 200 as an example
  • the mobile phone 100 and the tablet computer 200 perform the above-mentioned multi-screen collaborative display, that is, the mobile phone 100
  • the display interface 103 is displayed in the partial screen projection area of the display interface 202 on the tablet computer 200 .
  • the size of the partial screen projection area is the same as the size of the current display interface 103 of the mobile phone 100 .
  • the mobile phone 100 can acquire the display parameters of the display interface 202 of the tablet computer 200, and adjust the display parameters of the display interface 103 according to the acquired display parameters of the tablet computer 200, thereby adjusting the display style of the display interface 103, for example, In FIG.
  • the mobile phone 100 can generate a screen-casting interface 104 in a non-display mode (ie, invisible to the user), the display content of the screen-casting interface 104 is the same as that of the display interface 103, and the fonts in the screen-casting interface 104
  • the style is changed from italics to Song type, the background color is changed from pink to white, the background pattern is changed from a ripple pattern to a non-ripple pattern, and the current display interface 103 on the screen of the mobile phone 100 is kept unchanged, and finally the screen after the style modification is displayed.
  • the screen interface 104 is projected into a partial screen projection area of the tablet computer 200 . It can be seen from FIG. 3 a that the display style of the screen projection interface 104 of the mobile phone 100 displayed on the display interface 202 of the tablet computer 200 is consistent with the display style of the display interface 202 of the tablet computer 200 .
  • the first electronic device 100 and the second electronic device 200 are still taken as examples of the mobile phone 100 and the tablet computer 200 respectively, and the mobile phone 100 and the tablet computer 200 perform multi-screen collaborative display, wherein the current display of the mobile phone An instant messaging application (Application, APP) is displayed in the interface 103 , and the current display style of the display interface 202 of the tablet computer 200 is an elderly mode (simple mode).
  • An instant messaging application Application, APP
  • the current display style of the display interface 202 of the tablet computer 200 is an elderly mode (simple mode).
  • the mobile phone 100 can create a screen projection interface 104 with the same display content as the current display interface 103 of the mobile phone 100 (non-display mode, invisible to the user), and Corresponding to the old man mode, the mobile phone 100 increases the font size of the characters in the screen projection interface 104, the font style is changed from italic to Song type, the background color is changed from pink to white, the background pattern is changed from a ripple pattern to a non-ripple pattern, and the current pattern is simplified.
  • the display content of the displayed instant messaging APP for example, the search bar 1002 in the instant messaging APP in the screen projection interface 104 is set to not be displayed, and at the same time, the content preview of the "work group" in the communication column 1003 is set to not be displayed (can be. It is understood that, in other embodiments, the text content in the work group may also be reduced), and finally the screen projection interface 104 with the modified display style is projected into a partial screen projection area of the tablet computer 200 . It can be seen from FIG. 3 b that the display style of the screen projection interface 104 of the mobile phone 100 displayed on the display interface 202 of the tablet computer 200 is consistent with the display style of the display interface 202 of the tablet computer 200 .
  • FIG. 3c is similar to the scene shown in FIG. 3b, except that the display style of the tablet computer 200 is a dark mode.
  • the mobile phone 100 can also create a display content and the current display interface 103 of the mobile phone 100 The same screen projection interface 104 (non-display mode, invisible to the user), and corresponding to the dark mode, the mobile phone 100 sets the text content of the instant messaging APP in the screen projection interface 104 and the icons in the communication column 1003 to light colors, Such as white, and change the background color to a dark color that is the same color as the display interface 202 of the tablet computer 200 .
  • the screen projection interface 104 with the modified display style is projected into the partial projection area of the tablet computer 200 .
  • the display style of the screen projection interface 104 of the mobile phone 100 displayed on the display interface 202 of the tablet computer 200 is consistent with the display style of the display interface 202 of the tablet computer 200 .
  • the first electronic device 100 is a mobile phone as an example
  • the second electronic device 200 is a smart watch.
  • the screen of the smart watch 200 is smaller than the screen of the mobile phone 100 or the size of the display interface 103 on the mobile phone 100 .
  • the display interface 103 can be reduced by proportional scaling and then sent to the smart watch 200 for display.
  • the mobile phone 100 acquires the display parameters of the smart watch 200 and the size information of the local projection area used by the smart watch 200 for screen projection, and the mobile phone 100 adjusts the display of the display interface 103 according to the display parameters of the watch 200 parameters to adjust the display style of the display interface 103, for example, as shown in FIG.
  • the mobile phone 100 can modify the font style in the generated screen projection interface 104 from italics to Song type, and then according to the acquired size information of the partial screen projection area, the screen projection interface 104 is scaled in equal proportions.
  • the screen is then projected to a partial screen projection area of the display interface 202 of the smart watch 200 .
  • the display style of the screen projection interface 104 of the mobile phone 100 displayed on the display interface 202 of the smart watch 200 is consistent with the display style of the display interface 202 of the smart watch 200 .
  • the mobile phone 100 can also be directly sent to the smart watch 200, and the smart watch 200 scales it according to the size of the local screen projection area used for screen projection and displays it on the smart watch. on the display interface 202 of the watch 200 .
  • a scenario in which the display interface of the first electronic device 100 is simultaneously projected to a plurality of second electronic devices 200 is disclosed.
  • the description is given by taking the example of simultaneously projecting the display interface 103 of the mobile phone 100 to the smart watch 200-1 and the car device 200-2.
  • the mobile phone 100 can receive the corresponding display parameters from the smart watch 200-1 and the car device 200-2 respectively, and then create corresponding smart watches 200-1 and 200-1 according to the display parameters of the two.
  • the first screen projection interface 105 and the second screen projection interface 106 of the car device 200-2, and the created first screen projection interface 105 and the second screen projection interface 106 are projected to the smart watch 200-1 and the car device 200 respectively.
  • the font of the characters in the display interface 103 of the mobile phone 100 is italics, and the background color is pink;
  • the font of the characters in the display interface 202 of the smart watch 200-1 is Chinese colorful clouds, and the background color is white;
  • the font of the characters in the display interface 204 of the vehicle machine 200-2 is Arial, and the background color is white.
  • the mobile phone modifies the font style in the first screen projection interface 105 from italics to Huawen Caiyun, changes the background color to white, and then displays the modified first screen projection interface 105 as follows: The screen is projected to the local projection area of the display interface 202 of the smart watch 200-1 in a proportionally scaling manner.
  • the mobile phone 100 can modify the font style in the second screen projection interface 106 from italics to Song type, and then project the second screen projection interface 106 with the modified display style to the partial projection of the display interface 204 of the car 200-2. within the screen area. It can be seen from FIG.
  • the display styles of the first screen projection interface 105 and the second screen projection interface 106 displayed by the two electronic devices respectively are the same as the display interfaces of the smart watch 200-1 and the car machine 200-2, respectively.
  • the display styles of 202 and the display interface 204 are kept the same.
  • the first electronic device 100 and the second electronic device 200 in this application may be various computing devices capable of communicating with each other, for example, the first electronic device 100 and the second electronic device 200 may include, but are not limited to, a laptop computer, Desktop computers, tablet computers, cell phones, servers, wearable devices, head-mounted displays, mobile email devices, in-car devices, portable game consoles, portable music players, reader devices, in which one or more is embedded or coupled A television with a processor, or other electronic device capable of accessing a network.
  • the first electronic device 100 is a mobile phone 100 and the second electronic device 200 is a tablet computer 200 as examples to illustrate the technical solutions of the present application.
  • the following description takes the multi-screen collaborative display between the mobile phone 100 and the tablet computer 200 as an example for description.
  • the screen projection solution of the present application is applicable to any screen projection function between electronic devices.
  • FIG. 4 shows a schematic structural diagram of the mobile phone 100 or the tablet computer 200 .
  • the mobile phone 100 or the tablet computer 200 may include a processor 110 , an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , and a power management module 141 , battery 142, antenna 1, antenna 2, wireless communication module 160, audio module 170, sensor module 180, button 190, camera 191, display screen 192, and subscriber identification module (subscriber identification module, SIM) card interface 193 and so on.
  • a processor 110 the external memory interface 120
  • an internal memory 121 a universal serial bus (USB) interface 130
  • USB universal serial bus
  • charging management module 140 a charging management module 140
  • a power management module 141 battery 142
  • antenna 1, antenna 2 wireless communication module 160
  • audio module 170 audio module 170
  • sensor module 180 button 190
  • camera 191 display screen 192
  • subscriber identification module subscriber identification module
  • the structures illustrated in the embodiments of the present invention do not constitute a specific limitation of the mobile phone 100 and the tablet computer 200 .
  • the mobile phone 100 and the tablet computer 200 may include more or less components than shown, or some components may be combined, or some components may be separated, or different component arrangements.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units, and a memory may also be provided in the processor 110 for storing instructions and data. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory.
  • the USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the wireless communication function of the mobile phone 100 and the tablet computer 200 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the mobile phone 100 and the tablet computer 200 .
  • the wireless communication module 160 can provide applications on the mobile phone 100 and the tablet computer 200 including wireless local area networks (WLAN) (such as Wi-Fi networks), bluetooth (BT), global navigation satellite system (global navigation satellite system) system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • FM near field communication technology
  • NFC near field communication technology
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the mobile phone 100 and the tablet computer 200 may communicate with the tablet computer 200 and the server 300 through the mobile communication module 150 or the wireless communication module 160 .
  • Multi-screen collaborative display is performed between the mobile phone 100 and the tablet computer 200 . After a multi-screen collaborative display request is sent to the tablet computer 200 , the tablet computer 200 will display the window of the mobile phone 100 .
  • the mobile phone 100 can also acquire display parameters from the tablet computer 200 and acquire missing display functions from the server 300 .
  • the mobile phone 100 implements a display function through a GPU, a display screen 192, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 192 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 192 is used to display images, videos, and the like.
  • the display screen 192 includes a display panel.
  • the cell phone 100 and the tablet computer 200 may include one or N display screens 192 , where N is a positive integer greater than one.
  • the mobile phone 100 can realize the shooting function through the ISP, the camera 191, the video codec, the GPU, the display screen 192 and the application processor.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100 .
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.
  • the Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone 100 and the like.
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the processor 110 executes various functional applications and data processing of the mobile phone 100 and the tablet computer 200 by executing the instructions stored in the internal memory 121 and/or the instructions stored in the memory provided in the processor.
  • the internal memory 121 may be used to store display parameters.
  • the mobile phone 100 and the tablet computer 200 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor. Such as music playback, recording, etc.
  • the audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals.
  • the keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key.
  • the cell phone 100 can receive key input and generate key signal input related to user settings and function control of the cell phone 100 .
  • the SIM card interface 193 is used to connect a SIM card.
  • FIG. 5 shows a schematic structural diagram of a screen coordination system of the mobile phone 100 .
  • the handset 100 may include a display system service 101 .
  • the display system service 101 is used to obtain the display content of the view system of the mobile phone 100, and the display content may be an application interface or a view, such as a view of the main interface of the mobile phone.
  • the display system service 101 refers to a program, routine or process that executes a specified system function, so as to support other programs, especially low-level (close to hardware) programs.
  • the display system service 101 shown in FIG. 5 can be used to manage the current display interface and the screen projection interface running on the mobile phone, and is the current display interface and projection interface of the mobile phone 100.
  • the display system service 101 can read display parameters and other application program resources from the memory of the mobile phone to configure the current display interface.
  • the display style of the current display interface of the mobile phone 100 is font size 1, font style 1, background pattern 1, background color 1, and the display system service 101 can create a display content that is the same as the current display interface.
  • the display style of the screen-casting interface is modified through display parameters such as font size 2, font style 2, background pattern 2, and background color 2 obtained from the tablet computer 200.
  • the instant messaging APP displayed on the display interface 103 of the mobile phone 100 is taken as an example for description here, and the instant messaging APP here is only exemplary, and the technical solutions of the present application are applicable to various systems on the mobile phone 100 including system applications.
  • the display interface of this application is not limited here.
  • the display interface 103 may also be a display desktop of the mobile phone 100, a pull-down menu of the mobile phone 100, an interface displayed after left sliding on the mobile phone 100, and the like.
  • the process for the mobile phone 100 to project the current display interface 103 to the tablet computer 200 includes:
  • S601 The mobile phone 100 establishes a communication connection with the tablet computer 200, and sends a multi-screen collaboration request to the tablet computer 200.
  • the mobile phone 100 may communicate with the tablet computer 200 through wireless communication methods such as Bluetooth, WIFI, or NFC.
  • the mobile phone 100 can also be communicatively connected to the tablet computer 200 through wired communication, for example, the mobile phone 100 is communicatively connected to the tablet computer 200 through a data cable and a Universal Serial Bus (Universal Serial Bus, USB) interface.
  • USB Universal Serial Bus
  • the user Before or after the communication connection between the mobile phone 100 and the tablet computer 200 is established, the user can enable the multi-screen collaboration function of the mobile phone 100, as shown in Figures 1(a) and 1(b). After the user enables the multi-screen collaborative display function of the mobile phone 100 , the user may choose to send a multi-screen collaborative display request to the tablet 200 that is communicatively connected to the mobile phone 100 .
  • S602 The mobile phone 100 confirms whether the consistent display mode is turned on, and if it is turned on, it goes to S604; if it is not turned on, it goes to S603.
  • the mobile phone 100 can configure corresponding parameters for enabling/disabling the consistent display mode. For example, the mobile phone 100 configures the consistent display mode as the parameter name consistencyDisplayMode through the display system service 101, configures the parameter value corresponding to turning on the consistency display mode to 1, and configures the parameter value corresponding to turning off the consistency display mode to 0,
  • the above parameters and parameter values are stored in the memory of the mobile phone 100 .
  • the mobile phone 100 sends a multi-screen collaborative display request to the tablet computer, the mobile phone 100 queries the parameter consistencyDisplayMode and the parameter value corresponding to the parameter. If the parameter value corresponding to the consistencyDisplayMode is 1, the mobile phone 100 confirms that the consistent display mode is turned on. If the value of the parameter corresponding to the consistencyDisplayMode is 0, the mobile phone 100 confirms that the consistency display mode is not enabled.
  • the mobile phone 100 can configure the option 1011 of enabling/disabling the consistent display mode in the system settings of its own operating system.
  • the user can turn on/off the consistent display mode by clicking the on/off option 1011 .
  • the user can also configure the on/off of the consistent display mode through a button set on the mobile phone 100 .
  • the mobile phone 100 is provided with a side key 1012 for turning on/off the consistent display mode, and the user can turn on/off the consistent display mode by toggling the side key 1012.
  • the mobile phone 100 can prompt the user whether to turn on the consistent display mode.
  • 100 Turns on the consistent display mode. For example, as shown in Figure 9.
  • a prompt box 1013 will pop up on the screen of the mobile phone 100 to prompt the user whether to enable the consistent display mode. If Yes is selected, the mobile phone 100 enables the consistent display mode; otherwise, the mobile phone 100 does not enable the consistent display mode.
  • the first electronic device 100 can obtain the display parameters of the current display interface 202 of the second electronic device 200 from the second electronic device 200.
  • the first electronic device determines that the current display on its screen is When the display style of the display interface 103 is inconsistent with the display style of the display interface 202, the first electronic device 100 may pop up a prompt box to prompt the user whether to enable the consistent display mode.
  • the mobile phone 100 projects the unmodified display interface 103 into a partial projection area of the display interface 202 of the tablet computer 200 .
  • the mobile phone 100 projects the display interface 103 whose display style has not been modified to a partial projection area of the display interface 202 of the tablet computer 200 .
  • the mobile phone 100 sends an instruction to acquire the display parameters of the tablet computer 200 to the tablet computer 200, and confirms whether the tablet computer 200 returns the display parameters.
  • the display parameters sent by the tablet computer 200 to the mobile phone 100 may include specific display style parameters such as font size, font style, background pattern, background color, and control attributes, for example, background pattern: ripples, font style : Arial, font size: large, search bar: invisible (as in the old man mode shown in Figure 3b, the search bar 1002 is not visible) and so on.
  • specific display style parameters such as font size, font style, background pattern, background color, and control attributes, for example, background pattern: ripples, font style : Arial, font size: large, search bar: invisible (as in the old man mode shown in Figure 3b, the search bar 1002 is not visible) and so on.
  • the display parameters sent by the tablet computer 200 to the mobile phone 100 may include only one logo, and the mobile phone 100 stores the display style parameters corresponding to the logos, for example, as shown in Table 1 below, wherein the logo 1
  • the corresponding background pattern is Ripple, the font style is Song type, and the background color is white without shading;
  • the font style corresponding to logo 2 is Kai body, the font size is 14, and the background color is black;
  • the font style corresponding to logo 3 is Chinese Xinwei.
  • S605 The mobile phone 100 prompts whether to continue screen projection under the condition that the consistent display function cannot be completed.
  • a prompt box 1014 may pop up on the screen of the mobile phone 100 to prompt the user whether to continue the multi-screen collaborative display if the consistent display function cannot be completed. If the user selects Yes, then execute S603, and the mobile phone 100 projects the display interface 103 with the unmodified display style to the tablet computer 200.
  • the mobile phone 100 ends the screen projection, that is, terminates the screen projection of the display interface 103 to the tablet computer 200, and the user is prompted to end the multi-screen collaborative display, that is, S610 is executed to end the multi-screen collaborative display.
  • the mobile phone 100 can also perform S604 repeatedly, and the mobile phone 100 can send an instruction to acquire the display parameters of the tablet computer 200 to the tablet computer 200 again.
  • the mobile phone 100 may send an instruction to acquire display parameters to the tablet computer 200 after establishing a communication connection with the tablet computer 200, and the mobile phone 100 does not need to wait until the consistent display mode is turned on before sending the display parameter. Get instructions.
  • the tablet computer 200 can also actively send display parameters to the mobile phone 100, and the mobile phone 100 does not need to send the tablet computer 200 to obtain the display parameters instruction.
  • the mobile phone 100 determines whether the mobile phone 100 has a display function corresponding to the display parameters through the display system service 101.
  • a screen projection interface 104 with a modified display style is created, and the process goes to S608; if it does not have some display functions, a configuration file corresponding to the display functions needs to be downloaded from the server, and the process goes to S607.
  • the mobile phone 100 may search its own memory for the configuration file of the display function corresponding to the display parameters through the display system service 101 .
  • the display system service 101 of the mobile phone 100 can search its own memory for the configuration file of the background pattern "Ripple”.
  • the mobile phone 100 obtains, from the server 300, a configuration file corresponding to a display function that the mobile phone 100 does not have.
  • the mobile phone 100 can An acquisition request is sent to the server 300, and the configuration file of the font "Chinese New Wei" is received from the server 300, so as to be used in subsequent processing.
  • the mobile phone 100 creates a screen projection interface 104 with the same display content as the current display interface 103, and modifies the display style of the screen projection interface 104 based on the acquired display parameters.
  • the mobile phone 100 can create the screen projection interface 104 in various ways, for example, the mobile phone 100 can generate the screen projection interface 104 by creating an invisible view (View), creating a virtual screen, or in a picture-in-picture format.
  • the display content of the instant messaging APP in the screen projection interface is made consistent with the instant messaging APP in the current display interface 103 of the mobile phone 100 .
  • the specific technical details of creating the screen projection interface 104 and modifying the display style will be described in detail below.
  • the mobile phone 100 projects the screen projection interface 104 into a partial screen projection area of the display interface 202 of the tablet computer 200, and the tablet computer 200 displays the screen projection interface 104 in the partial screen projection area.
  • the requests sent/returned between the mobile phone 100 and the tablet computer 200, and the mobile phone 100 and the server 300 may be socket requests (socket requests).
  • the socket request is used for two-way communication between different electronic devices in a wireless network or wired network, and between applications of different electronic devices.
  • Method 1 Generate a screencasting interface by creating an invisible view
  • the screen projection interface 104 here may be an invisible view of the current display interface 103 created by the mobile phone 100 through the display system service 101, and the mobile phone 100 sets the screen projection interface 104 to be invisible.
  • the display content of the screen projection interface 104 is consistent with the display content of the current display interface 103 on the screen of the mobile phone 100 .
  • the mobile phone 100 modifies the display style of the screen projection interface 104 based on the acquired display parameters of the tablet computer 200 through the display system service 101 .
  • the mobile phone 100 modifies display parameters such as font size, font style, background pattern, background color and control properties, or theme mode of the instant messaging APP in the screen projection interface 104 through the display system service 101 .
  • FIGS. 11 a to 11 c describe that the mobile phone 100 obtains the screen projection interface 104 by creating an invisible view of the current display interface 103 of the mobile phone 100 when the consistent display mode is turned on, and modifies the screen projection based on the current display style of the tablet computer 200 Specific technical details of the display style of the interface 104 .
  • the instant messaging APP displayed in the current display interface 103 of the mobile phone 100 is composed of multiple controls, for example, including a title bar 1001 , a search bar 1002 and a communication bar 1003 .
  • two communication objects are displayed in the communication column 1003, and the two communication objects are "commuting record" and "work group” respectively.
  • Each communication object also includes: object icon and communication content.
  • the background color 10011 of the instant messaging APP is set to light gray
  • the background color 10012 of the communication content of each communication object in the communication column 1003 is set to dark gray.
  • the mobile phone 100 acquires display parameters from the tablet computer 200, and the display parameters include: the background color is white.
  • the mobile phone 100 creates a screen projection interface 104 identical to the display interface 103, and the background color 10011 of the instant messaging APP in the screen projection interface 104 and the background color 10012 of the communication content part of the communication object in the communication column 1003 are changed to white.
  • the mobile phone 100 projects the screen projection interface 104 with the modified display style to the display interface 202 of the tablet computer 200 .
  • the instant messaging APP displayed in the current display interface 103 of the mobile phone 100 includes a title bar 1001, a search bar 1002 and a communication column 1003, and a background pattern 10013 of “ripples” is also set.
  • the mobile phone 100 acquires display parameters from the tablet computer 200, and the display parameters include: the background pattern is the default background pattern.
  • the mobile phone 100 modifies the background pattern in the instant messaging APP in the screen projection interface 104 to the default background pattern, that is, removes the "ripple" background pattern 10013, and then modifies the The screen is projected to the display interface 202 of the tablet computer 200 through the screen projection interface 104 of the display style.
  • the instant messaging APP displayed in the current display interface 103 of the mobile phone 100 includes a title bar 1001, a search bar 1002 and a communication column 1003, in which the characters of The font style 10014 is italic, while the font style of the tablet 200 is Song. Therefore, after the mobile phone 100 modifies the font style 10014 of the characters in the created screen projection interface 104 to Arial, the mobile phone 100 projects the screen projection interface 104 with the modified display style to the display interface 202 of the tablet computer 200 .
  • Method 2 Create a screen-casting interface through a virtual screen
  • the mobile phone 100 may create a screen projection interface 104 on the virtual screen with the same display content as the current display interface 103 , and project the screen projection interface 104 with the modified display style to the display interface of the tablet computer 200 . 202.
  • the mobile phone 100 can create a virtual screen, and the mobile phone 100 creates and modifies the screen based on display parameters such as font size, font style, font color, icon size, icon color, background pattern, background color, and control properties obtained from the tablet computer 200 .
  • the screen interface 104 is displayed on the virtual screen.
  • the screen size, resolution and pixel density of the virtual screen may be the same as the current display interface 103 of the mobile phone 100 .
  • the mobile phone 100 can use the createVirtualDisplay(String,int,int,int,Surface) of the display system service DisplayManager of the Android system by using the screen size, resolution, pixel density, etc. of the current display interface 103 as parameters.
  • the virtual screen in order not to affect the display interface 103 on the mobile phone 100, the virtual screen may be set to be invisible to the user. In other embodiments, in order to allow the user to determine whether the style of the modified display interface meets the user's requirements, the virtual screen may be set to be visible to the user, and the screen projection is sent to the tablet computer 200 only after the user confirms the modification. interface 104 .
  • Method 3 Create a screen-casting interface by means of picture-in-picture
  • a new window 1021 can also be created in the mobile phone 100 in the form of a picture-in-picture, and the modified display
  • the styled screen projection interface 104 is displayed in the window 1021 .
  • the window 1021 is displayed simultaneously with the original display interface 103 , and then the newly created window 1021 is projected onto the display interface 202 of the smart watch 200 .
  • the size of the partial screen projection area used by the tablet computer 200 for receiving the screen projection is greater than or equal to the size of the screen of the mobile phone 100, but the difference is that, as shown in FIG. 3d , and there is also a scenario in which an electronic device with a larger screen size (such as a mobile phone 100 ) is projected to an electronic device with a smaller screen size (such as a smart watch).
  • FIG. 13 shows that in the scenario shown in FIG. 3d , the mobile phone 100 and the smart watch 200 realize the function of multi-screen collaborative display. Specifically, as shown in Figure 13, it includes:
  • S1301 The mobile phone 100 establishes a communication connection with the smart watch 200, and sends a multi-screen collaboration request to the smart watch 200.
  • S1302 The mobile phone 100 confirms whether the consistent display mode is turned on, and if it is turned on, it goes to S1304; if it is not turned on, it goes to S1303.
  • the mobile phone 100 projects the unmodified display interface 103 into a partial projection area of the display interface 202 of the smart watch 200 .
  • S1304 The mobile phone 100 sends an instruction to acquire the display parameters of the smart watch 200 to the smart watch 200, and confirms whether the tablet computer 200 returns the display parameters.
  • S1305 The mobile phone 100 prompts whether to continue screen projection under the condition that the consistent display function cannot be completed. If the user selects No, the mobile phone 100 ends the screen projection, that is, the operation of projecting the display interface 103 to the smart watch 200 is terminated, and the user is prompted to end the multi-screen collaborative display, that is, S1310 is executed to end the multi-screen collaborative display.
  • the mobile phone 100 determines whether the mobile phone 100 has a display function corresponding to the display parameters through the display system service 101. If the mobile phone has these display functions, a screen projection interface 104 with a modified display style is created, and the process goes to S1308; if it does not have some display functions, a configuration file corresponding to the display functions needs to be downloaded from the server, and the process goes to S1307.
  • the mobile phone 100 obtains, from the server 300 , a configuration file corresponding to a display function that the mobile phone 100 does not possess.
  • the mobile phone 100 creates a screen projection interface 104 with the same display content as the current display interface 103, and modifies the display style of the screen projection interface 104 based on the acquired display parameters.
  • the mobile phone 100 modifies the font style of the screen projection interface 104 to italic.
  • the display parameters may further include: font size, font style, background pattern, background color, and other display style parameters such as controls. For the specific process here, you can refer to the above to create the screen projection interface and modify the display style.
  • the mobile phone 100 projects the screen projection interface 104 into the local projection area of the display interface 202 of the smart watch 200 , and the smart watch 200 displays the projection interface 104 in a reduced manner according to the size of the local projection area.
  • the width and height of the screen of the smart watch 200 are 100 and 200 respectively
  • the size of the local projection area in the screen of the smart watch 200 is 50 wide and 100 high
  • the width and height of the mobile phone 100 are 200 and 400 respectively.
  • the width and height of the projection interface 104 can be based on the width and height of the local projection area of the display interface 202 of the smart watch 200 . High scale scaling to 50 and 100.
  • the smart watch 200 described in the above S1309 displays the screen projection interface 104 by scaling according to the size of the local screen projection area. It can also be completed at the mobile phone 100. 100 can also acquire the size of the partial screen projection area of the display interface 202 of the smart watch 200 at the same time. After that, the mobile phone 100 can create a screen-casting interface 104 with the same size as the local screen-casting area of the smart watch 200 . After modifying the display style of the screen-casting interface 104 , it will be the same size as the local screen-casting area of the smart watch 200 . The screen projection interface 104 is projected to the smart watch 200 .
  • the mobile phone 100 in addition to reducing the screen projection interface 104 and then projecting the screen to the screen of the second electronic device 200 , the mobile phone 100 can also enlarge the screen projection interface 104 to perform screen projection.
  • the width and height of the screen of the smart TV 200 are 1500 and 1000 respectively, and the size of the partial projection area in the screen of the smart TV 200 is 300 wide and 600 high.
  • the width and height of the mobile phone 100 are 200 and 400 respectively.
  • the width and height of the screen projection interface 104 can be determined according to the local projection in the screen of the smart TV 200 .
  • the width and height of the screen area are scaled to 300 and 600 proportionally.
  • the mobile phone 100 can also project the display interface 103 to a plurality of second electronic devices 200. At this time, the mobile phone 100 will create a plurality of screen projection interfaces for the display interface 103, and project the multiple screen projection interfaces to a plurality of second electronic devices respectively.
  • the mobile phone 100 configures a screencasting interface ID (Display Id) for each screencasting interface. Therefore, it is convenient for the mobile phone 100 to search and manage the screen-casting interface through the screen-casting interface ID of the screen-casting interface when performing screen-casting on multiple second electronic devices 200.
  • the mobile phone 100 projects the display interface 103 to the smart watch 200-1 and the car 200-2.
  • the difference from the process described in FIG. 6 is that the mobile phone 100 needs to create the display interface 103 at the same time.
  • the first screen projection interface 105 and the second screen projection interface 106 As shown in Figure 14, it specifically includes:
  • the mobile phone 100 communicates with the smart watch 200-1 and the car device 200-2, and sends a multi-screen collaboration request to the smart watch 200 and the car device 200-2.
  • S1402 The mobile phone 100 confirms whether the consistent display mode is turned on, and if it is turned on, it goes to S1404; if it is not turned on, it goes to S1403.
  • the mobile phone 100 projects the unmodified display interface 103 to the partial projection area of the display interface 202 of the smart watch 200-1 and the display interface 204 of the vehicle 200-2.
  • S1404 The mobile phone 100 respectively sends an instruction to acquire the display parameters to the smart watch 200-1 and the car machine 200-2, and confirms whether the smart watch 200-1 and the car machine 200-2 return the display parameters.
  • S1405 The mobile phone 100 prompts whether to continue screen projection under the condition that the consistent display function cannot be completed. If the user chooses No, the mobile phone 100 ends the screen projection, that is, the operation of projecting the display interface 103 to the smart watch 200-1 and the car device 200-2 is terminated, and the user is prompted to end the multi-screen collaborative display, that is, S1410 is executed to end the multi-screen collaborative display. screen collaborative display.
  • the mobile phone 100 determines whether the mobile phone 100 has a display function corresponding to the display parameters through the display system service 101. If the mobile phone has these functions, create the first screen projection interface 105 and the second screen projection interface 106 with modified display styles, and enter S1408; Enter S1407.
  • the mobile phone 100 obtains, from the server 300, a configuration file corresponding to a display function that the mobile phone 100 does not possess.
  • the mobile phone 100 respectively creates the first screen projection interface 105 and the second screen projection interface 106 with the same display content as the current display interface 103, and modifies the first screen projection interface 106 based on the different display parameters of the smart watch 200-1 and the car 200-2, respectively.
  • the display styles of the first screen projection interface 105 and the second screen projection interface 106 are described in detail below.
  • the display parameters of the smart watch 200-1 and the car machine 200-2 may be: the background color is white, and the font style is Arial, and the display style of the display interface 103 of the mobile phone 100 at this time is, the background color is gray, and the font style is In italics, the mobile phone 100 creates a first screen projection interface 105 and a second screen projection interface 106 through the display system service 101 respectively. In the projection screen to the car machine 200-2.
  • the mobile phone 100 uniformly modifies the display styles of the first screen projection interface 105 and the second screen projection interface 106 through the display system service 101 so that the background color is white and the font style is Arial.
  • the mobile phone 100 projects the first screen projection interface 105 to the partial screen projection area of the display interface 202 of the smart watch 200, and projects the second screen projection interface 106 to the partial screen projection of the display interface 204 of the car 200-2. area.
  • FIG. 15 is a flowchart showing another method for performing screen collaborative display by the screen collaborative system shown in FIG. 2 according to other embodiments of the present application. Specifically, as shown in Figure 15, it includes:
  • the method of establishing a multi-screen collaborative connection please refer to the process of establishing a multi-screen collaborative connection between the mobile phone 100 and the tablet computer 200 in S601 .
  • the mobile phone 100 communicates with the tablet computer 200 and sends a multi-screen collaboration request to the tablet computer 200 .
  • the second electronic device may also be the smart watch 200-1 in FIG. 3e or the car machine 200-2.
  • the first electronic device displays a first interface, the first interface includes first content, and the first interface has a first display parameter.
  • the first interface here can be the display interface 103 of the mobile phone 100.
  • the display interface 103 includes: a title bar, a search bar, a communication column, etc., which are the first content.
  • the display interface The font of the characters in 103 is italics, the background color is pink, and the background pattern is a ripple pattern, which is the first display parameter.
  • the first content in the display interface 103 of the mobile phone 100 may also include a contact icon, a contact name, prompt content, a cancel button, and a switch to voice button.
  • the first display parameter includes parameters such as the font in the display interface 103 is italics, the background color is pink and so on.
  • the second electronic device displays a second interface, the second interface includes second content, and the second interface has second display parameters.
  • the second interface here can be the display interface 202 of the tablet computer 200.
  • the display interface 202 includes: settings, power consumption ranking, etc., which are the second content.
  • the characters in the display interface 202 The font is Arial, and the background color is white, which is the second display parameter.
  • the second interface may also be the display interface 202 of the smart watch 200-1, which includes the date and time, etc., that is, the second content.
  • the second display parameter includes that in the display interface 202 of the smart watch 200-1, the font of the characters is Chinese Caiyun, and the background color is white.
  • the second interface may also be the display interface 204 of the vehicle machine 200-2.
  • the display interface 204 includes: music playback information, music playback progress, music playback buttons, etc., which is the second content.
  • the second display parameter includes that the font of the characters in the display interface 204 of the vehicle machine 200-2 is Arial, and the background color is white.
  • steps S1501 to S1503 is not limited to the order shown in the figure, and can be any order, for example, it can be the order of S1502, S1503, S1501, or the order of S1501, S1503, S1502, or the order of S1501, S1503 , S1502 are performed simultaneously.
  • the first electronic device sends a third interface to the second electronic device.
  • the third interface may be the screen projection interface 104 generated by the mobile phone 100.
  • the mobile phone 100 modifies the font style in the screen projection interface 104 from italics to Song type, the background color is changed to white, and the background pattern is changed from
  • the ripple pattern is modified to a non-ripple pattern, that is, the second display parameter is modified, and then the screen projection interface 104 is projected to the display interface 202 of the tablet computer 200 .
  • the third interface may be the first screen projection interface 105 generated by the mobile phone 100, and the mobile phone 100 uses the second display parameters, for example, the font of the characters is Chinese Color Cloud, and the background color is white. Modify the first screen projection interface 105 .
  • the third interface can also be the second screen projection interface 106 generated by the mobile phone 100.
  • the mobile phone 100 uses the second display parameters, such as: the font of the characters is Arial and the background color is white, and the second screen projection interface 106 is modified.
  • the second electronic device In response to the received third interface, the second electronic device displays a fourth interface, the fourth interface includes the second content and the first window, the first window includes the first content, and the first content in the first window has the first content Two display parameters.
  • the fourth interface here is the display interface 202 of the tablet computer 200
  • the first window is a partial screen projection area in the display interface 202 of the tablet computer 200 .
  • the tablet computer 200 displays the screen projection interface 104, that is, the title bar, the search bar, the communication column, etc., in addition to the display settings, power consumption ranking, etc. in the display interface 202, which is: first content.
  • the font of the characters in the first content is Arial
  • the background color is white
  • there is no background pattern that is, the second display parameter.
  • the fourth interface here may be the display interface 202 of the smart watch 200-1.
  • the display interface In 202 the second display parameter is used, for example, the font of the character is Chinese Caiyun, and the background color is white, and the first screen projection interface 105 containing the first content is displayed.
  • the fourth interface here can also be the display interface 204 of the vehicle 200-2.
  • the vehicle 200-2 uses the second display parameters in the display interface 204, such as : The font is Arial and the background color is white, and the second screen projection interface 106 containing the first content is displayed.
  • FIG. 16 is a block diagram of the software structure of the mobile phone 100 according to the embodiment of the present invention.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer.
  • the application layer can include a series of application packages.
  • the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system may be the display system service 101 of the mobile phone 100 , which is used to manage and modify the display style of the application program of the mobile phone 100 .
  • the view system obtains the display function corresponding to the above-mentioned display style parameters, and is used to configure the application program of the mobile phone 100 .
  • the phone manager is used to provide the communication function of the mobile phone 100 .
  • the management of call status including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the resource manager may also be used to store the Overlay configuration file.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
  • the core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library Media Libraries
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.
  • the disclosed apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • Units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium.
  • a readable storage medium including several instructions to make a device (may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods of the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本申请涉及一种电子设备及其设备间屏幕协同方法。该方法包括:屏幕协同系统中的第一电子设备上显示有包括第一内容且具有第一显示参数的第一界面,在第一电子设备向屏幕协同系统中的第二电子设备投屏第一界面时,将第一界面的显示参数修改为与第二电子设备上显示的第二界面的显示参数相同,从而使得第二电子设备上协同显示的两个电子设备的内容显示风格是一致的。通过本申请的方法可以使得在第二电子设备协同显示的第一电子设备的内容和第二电子设备的内容显示风格保持一致,解决协同显示设备同时显示不同设备内容时显示风格不协调的问题。

Description

电子设备及其设备间屏幕协同方法和介质
申请要求于2020年11月16日提交中国专利局、申请号为202011279269.X、申请名称为“电子设备及其设备间屏幕协同方法和介质”中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域,尤其涉及一种电子设备及其设备间屏幕协同方法和介质。
背景技术
随着电子设备之间的通信技术的发展,用户可以更加方便地将自己的电子设备上的界面投屏到其他电子设备。由于各种电子设备之间的字体大小、字体样式、背景图案,背景颜色以及控件属性等显示风格可能并不一样,将电子设备的界面投屏到与之风格不同的另一电子设备上时,会存在显示风格不协调的问题。
例如,如图1(a)和图1(b)所示,在手机100与平板电脑200之间进行多屏协同显示时,用户可以通过点击手机100下拉菜单中的多屏协同按键,启动手机100的多屏协同显示功能。如图1(c)所示,在用户确定协同对象为平板电脑200后,手机100与平板电脑200通过无线通信功能完成通信连接。如图1(d)所示,平板电脑200的显示界面202上会镜像显示手机100的显示界面103,类似于将手机100的窗口投屏至平板电脑200的显示界面202。从图1(d)可以看出,平板电脑200的字体样式是宋体,背景颜色为白色,而手机100当前显示界面103中字符的字体样式是楷体,并且采用了“涟漪”背景图案(例如,背景颜色为粉色或者蓝色,背景图案上有涟漪),因此,在将手机100的显示界面103投屏至平板电脑200的显示界面202后,与平板电脑200的显示界面202之间存在风格不协调的问题。
发明内容
本申请的目的在于提供一种电子设备及其设备间屏幕协同方法和介质,通过本申请的方法,电子设备会根据被投屏设备的显示风格修改将要投屏的显示内容的显示风格,然后再进行投屏,使得投屏的显示内容的显示风格与协同显示的被投屏设备的显示风格保持一致。
本申请的第一方面提供了一种设备间屏幕协同方法,应用于包括第一电子设备和第二电子设备的屏幕协同系统,该方法包括:第一电子设备和第二电子设备建立多屏协同连接;第一电子设备显示第一界面,第一界面包括第一内容,第一界面具有第一显示参数;第二电子设备显示第二界面,第二界面包括第二内容,第二界面具有第二显示参数;第一电子设备向第二电子设备发送第三界面;响应于接收到的第三界面,第二电子设备显示第四界面,第四界面包括第二内容和第一窗口,第一窗口包括第一内容,第一窗口中的第一内容具有第二显示参数。
即在本申请的实施例中,在第一电子设备将第一界面投屏至第二电子设备上进行协同显示时,生成显示内容与第一界面相同但是显示参数与第二电子设备的第二界面相同的第三界面,从而使得第二电子设备在第四界面同时显示自身的第二内容和第一电子设备投屏的第一内容(在第一窗口中)时,两者的显示风格一致。
例如,第一电子设备可以是手机,第二电子设备可以是智能手表。这里的第一界面可以是手机的显 示界面,该显示界面中包括:联系人图标,联系人姓名等,即为第一内容,同时,手机的显示界面中字符的字体为楷体,背景颜色为粉色,也就是第一显示参数。这里的第二界面可以是智能手表的显示界面,该显示界面中包括:日期和时间等,即为第二内容,同时,智能手表的显示界面中字符的字体为华文彩云,且背景颜色为白色,也就是第二显示参数。这里,第三界面可以是手机生成的用于向第二电子设备投屏的投屏界面,手机将第三界面内的字体样式从楷体修改为华文彩云,将背景颜色修改为白色,也就是修改为第二显示参数,然后将第三界面投屏至智能手表的显示界面。这里的第四界面,可以是智能手表的显示界面,第一窗口是智能手表的显示界面内的局部投屏区域。智能手表在接收到手机的第三界面后,在显示界面中除了显示日期和时间等,还在局部投屏区域内显示第三界面,也就是联系人图标,联系人姓名,提示内容,取消按键和切换到语音按键等,即为第一内容。并且,第一内容中字符的字体为华文彩云,且背景颜色为白色,也就是第二显示参数。
在上述第一方面的一种可能的实现中,显示参数包括字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中的至少一个,并且显示参数包括第一显示参数和第二显示参数。
在上述第一方面的一种可能的实现中,第二显示参数包括显示风格标识,显示风格标识对应第二界面的显示风格,其中,对应不同的显示风格标识,第二电子设备的第二界面中的字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中的至少一个不同。
即在本申请的实施例中,显示参数可以是具体表示字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中等的参数,也可以是对应不同字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性等的标识。例如,对应显示参数A的显示风格标识ID1,对应的字体为宋体、字体颜色为黑色、背景颜色为白色,而对应显示参数B的显示风格标识ID2,对应的字体为楷体、字体颜色为浅灰色、背景颜色为黑色。
在上述第一方面的一种可能的实现中,上述方法包括:第一电子设备接收第二电子设备发送的第二显示参数,并基于接收到的第二显示参数生成第三界面,其中,第三界面包括第一内容,并且具有第二显示参数。
即在本申请的实施例中,第一电子设备生成一个与显示内容与第一电子设备的第一界面相同,但是显示风格与第二电子设备的第二界面相同的第三界面,然后将其投屏给第二电子设备。
在上述第一方面的一种可能的实现中,第一电子设备通过以下方式生成第三界面:第一电子设备将第三界面中的字体大小调大至与第二电子设备的第二界面中的字体大小相同,并减少第三界面中字符的数量,以及将第三界面中的至少一个控件的属性修改为不可见。
在上述第一方面的一种可能的实现中,第一窗口的字体大小大于第一界面的字体大小并与第二电子设备的第二界面中的字体大小相同,并且第一窗口中字符的数量少于第一界面中字符的数量,以及第一内容的至少一个控件在第一界面中的属性为可见,而在第一窗口中的属性为不可见。例如,如果第二电子设备的第二界面的显示风格是老人模式或者简化模式,而第一电子设备为非老人模式,则相比于第一电子设备的第一界面,第一窗口中的第一显示内容的显示风格调整至第二电子设备的老人模式或者简化模式后,字体会变大,字体变大后相应的字符数减少。
在上述第一方面的一种可能的实现中,第一电子设备通过以下方式生成第三界面:第一电子设备将第三界面中的背景颜色调整为与第二电子设备的第二界面的背景颜色相同,并将第三界面中字符和图标的颜色调整为与背景颜色不同。
在上述第一方面的一种可能的实现中,第一窗口的背景颜色与第二电子设备的第二界面或者第四界 面中的第二内容的背景颜色相同,并且第一窗口中字符和图标的颜色与背景颜色不同。
例如,如果第二电子设备的第二界面的显示风格是深色模式,即第二电子设备的背景颜色为深色,其中的字符和图标等为浅色,而第一电子设备的第一界面的背景颜色为浅色,且字符和图标的颜色较深。则在投屏时,第一电子设备生成的第三界面中的背景颜色也会改变为深色,且投屏至第二电子设备后,第一窗口中的第一显示内容的背景颜色也是深色,并且字符和图标的颜色相应的也被改成浅色。
在上述第一方面的一种可能的实现中,第三界面为第一电子设备中不可见的视图或者第三界面生成在第一电子设备的虚拟屏上。
在上述第一方面的一种可能的实现中,第三界面的尺寸小于第一电子设备的屏幕的尺寸,并且第三界面与第一界面同时显示在第一电子设备的屏幕上。
即在本申请的实施例中,第一电子设备可以通过画中画的方式生成第三界面。
在上述第一方面的一种可能的实现中,第一电子设备还从第二电子设备获取第一窗口的尺寸,并且第一电子设备生成的第三界面的尺寸与第一窗口的尺寸相同。
即在本申请的实施例中,第二电子设备将第三界面显示在自身的显示界面重的局部投屏区域中。
例如,这里的第一电子设备可以是手机,第二电子设备是智能手表。第三界面可是手机的创建的窗口,窗口与手机的显示界面同时显示。窗口的尺寸可以是手机从智能手表处获取的局部投屏区域的尺寸。
在上述第一方面的一种可能的实现中,第一电子设备还从第二电子设备获取第一窗口的尺寸,并且
在第一电子设备生成的第三界面的尺寸不同于第一窗口的尺寸的情况下,第一电子设备向第二电子设备发送尺寸缩小或者放大至与第一窗口的尺寸相同的第三界面。
即在本申请的实施例中,第一电子设备可以将第三界面缩小或放大后,再发送给第二电子设备,第二电子设备将第三界面显示在屏幕的一个局部投屏区域中,即第一窗口中。
例如,手机从智能手表处获取了第一窗口的尺寸后,手机确定第一窗口的尺寸小于手机的投屏界面的尺寸,手机将投屏界面缩小后,发送给智能手表。
在上述第一方面的一种可能的实现中,屏幕协同系统还包括第三电子设备,并且,方法还包括:第一电子设备还与第三电子设备建立多屏协同连接,并且第三电子设备显示第五界面,第五界面包括第三内容,第五界面具有第三显示参数;第一电子设备向第三电子设备发送第六界面;响应于接收到的第六界面,第三电子设备显示第七界面,第七界面包括第三内容和第二窗口,第二窗口包括第一内容,第二窗口中的第一内容具有第三显示参数。
即第一电子设备可以同时将第一界面投屏到第二电子设备和第三电子设备,并分别对应第二电子设备和第三电子设备的显示风格,对应生成第三界面和第七界面,以使得第一内容在第二电子设备和第三电子上显示时,显示风格分别与第二电子设备和第三电子设备相同。
在上述第一方面的一种可能的实现中,第六界面包括第一内容,并且具有第三显示参数。
在上述第一方面的一种可能的实现中,第一电子设备在用户确定修改显示风格的情况下,生成并向第二电子设备发送第三界面;并且第一电子设备在用户确定不修改显示风格的情况下,向第二电子设备发送第一界面,并且第二电子设备响应于接收到的第一界面显示第八界面,第八界面包括第二内容和第三窗口,第三窗口包括第一界面。
即在本申请的实施例中,可以由用户决定在多屏协同显示过程中,是否修改显示风格后进行投屏。
在上述第一方面的一种可能的实现中,第一电子设备的第一界面包括第一电子设备的显示桌面、左滑显示界面、下拉菜单、应用显示界面中的至少一个。
本申请的第二方面提供了一种设备间屏幕协同方法,包括:第一电子设备和第二电子设备建立多屏 协同连接;第一电子设备显示第一界面,第一界面包括第一内容,第一界面具有第一显示参数;第一电子设备接收第二电子设备发送的第二显示参数,其中第二电子设备有显示第二界面,第二界面包括第二内容,第二界面具有第二显示参数;第一电子设备根据第二显示参数生成第三界面;第一电子设备向第二电子设备发送第三界面,第三界面包括第一内容,并且具有第二显示参数。
在上述第二方面的一种可能的实现中,显示参数包括字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中的至少一个,显示参数包括第一显示参数和第二显示参数。
在上述第二方面的一种可能的实现中,第二显示参数包括对应第二电子设备的第二界面的显示风格的显示风格标识,其中,对应不同的显示风格标识,第二电子设备的第二界面中的字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中的至少一个不同。
在上述第二方面的一种可能的实现中,第三界面包括第一内容,并且具有第二显示参数。
在上述第二方面的一种可能的实现中,第一电子设备的第一界面的字体大小小于第二电子设备的第一窗口的字体大小,并且第一界面种字符的数量多于第一窗口中字符的数量,以及第一内容的至少一个控件在第一界面中的属性为可见,而在第一窗口中的属性为不可见。
在上述第二方面的一种可能的实现中,第一电子设备上第一界面的背景颜色与第二电子设备上第四界面中的第一窗口的背景颜色不同。
在上述第二方面的一种可能的实现中,屏幕协同系统还包括第三电子设备,其中,第三电子设备显示第五界面,第五界面包括第三内容,第五界面具有第三显示参数,并且方法还包括:第一电子设备与第三电子设备建立多屏协同连接;第一电子设备向第三电子设备发送第六界面,第六界面使得第三电子设备显示第七界面,其中第七界面包括第三内容和第二窗口,第二窗口包括第一内容,第二窗口中的第一内容具有第三显示参数。
在上述第二方面的一种可能的实现中,第六界面包括第一内容,并且具有第三显示参数。
在上述第二方面的一种可能的实现中,第一电子设备在用户确定修改显示风格的情况下,生成并向第二电子设备发送第三界面;并且第一电子设备在用户确定不修改显示风格的情况下,第一电子设备向第二电子设备发送第一界面,其中,第一界面使得第二电子设备显示第八界面,其中第八界面包括第二内容和第三窗口,第三窗口包括第一界面。
在上述第二方面的一种可能的实现中,第一电子设备的第一界面包括第一电子设备的显示桌面、左滑显示界面、下拉菜单、应用显示界面中的至少一个。
本申请的第三方面提供了一种装置,该装置包含在电子设备中,该装置具有实现上述方面及上述方面的可能实现方式中电子设备行为的功能。功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块或单元。例如,通信连接单元或模块(如可以是蓝牙或者WIFI模块),显示参数获取单元或模块,显示界面生成单元或模块和多屏协同单元或模块(如具有该模块或单元功能的处理器)等。例如,通信连接单元或模块用于支持多个电子设备中的第一电子设备和第二电子设备建立多屏协同连接;显示参数获取单元或模块,用于支持第一电子设备从第二电子设备接收第二显示参数;显示界面生成单元或模块,用于支持第一电子设备根据显示参数获取单元或模块接收的第二显示参数对生成一个第三界面,第三界面包括第一电子设备的第一界面的第一内容,且该第一内容具有第二显示参数。多屏协同单元或模块,用于支持第一电子设备向第二电子设备发送第三界面;第二电子设备响应于接收到的第三界面,显示第四界面,第四界面包括第二内容和第一窗口,第一窗口包括第一内容,第一窗口中的第一内容具有第二显示参数。
本申请的第四方面提供了一种电子设备,包括:存储器,存储有指令;处理器,处理器和存储器耦 合,当存储器存储的程序指令被处理器执行时使得电子设备执行如前述第一方面或第二方面提供的设备间屏幕协同方法。
本申请的第五方面提供了一种可读介质,可读介质中存储有指令,其特征在于,当指令在可读介质上运行时,使得可读介质执行如前述第一方面或第二方面提供的设备间屏幕协同方法。
附图说明
图1示出了现有技术中手机将自身的显示界面投屏至平板电脑进行多屏协同显示的一种示例;
图2根据本申请实施例示出了一种屏幕协同系统;
图3a根据本申请实施例示出了一种电子设备间的投屏场景;
图3b根据本申请实施例示出了一种电子设备间的投屏场景;
图3c根据本申请实施例示出了一种电子设备间的投屏场景;
图3d根据本申请实施例示出了一种电子设备间的投屏场景;
图3e根据本申请实施例示出了一种电子设备间的投屏场景;
图4示出了本申请实施例中的电子设备的硬件结构框图;
图5示出了本申请实施例中的电子设备上的屏幕协同系统的示例;
图6根据本申请实施例示出了将手机上的显示界面投屏至平板电脑屏幕上进行多屏协同显示的方法流程图;
图7根据本申请实施例示出了在手机上开启一致性显示模式的一种示例;
图8根据本申请实施例示出了在手机上开启一致性显示模式的另一种示例;
图9根据本申请实施例示出了在手机上提示是否开启一致性显示模式的一种示例;
图10根据本申请实施例示出了在手机上提示无法开启一致性显示模式的一种示例;
图11a根据本申请实施例示出了手机上的显示界面投屏至平板电脑的后,背景颜色与平板电脑显示界面的背景颜色保持一致的示例;
图11b根据本申请实施例示出了手机上的显示界面投屏至平板电脑后,背景图案与平板电脑显示界面的背景图案保持一致的示例;
图11c根据本申请实施例示出了手机上的显示界面投屏至平板电脑后,字体样式与平板电脑的显示界面的字体样式保持一致的示例;
图12根据本申请实施例,示出了以画中画方式进行电子设备间的投屏的一种示例;
图13根据本申请实施例将手机上的显示界面投屏至智能手表屏幕上进行多屏协同显示的方法流程图;
图14根据本申请实施例将手机上的显示界面同时投屏至智能手表和车机的屏幕上进行多屏协同显示的方法流程图;
图15根据本申请实施例,示出了第一电子设备,第二电子设备之间进行屏幕协同的方法流程图;
图16示出了根据本申请的实施例的电子设备的软件结构框图。
具体实施方式
下面将结合附图对本申请的实施例作进一步地详细描述。
为了解决上述投屏过程中两个电子设备显示风格不一致的问题,本申请提供了一种投屏方案。在本申请实施例的投屏方案中,电子设备会根据被投屏设备的显示风格修改将要投屏的显示内容的显示风格, 然后再进行投屏。电子设备的显示风格可以用显示参数来表示,显示参数包括字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中的至少一个。本申请中描述的显示界面具有显示参数,可以是指显示界面上的显示内容按照一定的参数进行显示。
图2根据本申请的一些实施例示出了一种屏幕协同系统。
具体地,如图2所示,该屏幕协同系统包括第一电子设备100、第二电子设备200以及服务器300。其中,第一电子设备100能够分别与第二电子设备200和服务器300进行无线通信。当第一电子设备100向第二电子设备200进行投屏时,第一电子设备100可以从第二电子设备200获取第二电子设备200当前的显示界面202的显示参数。然后第一电子设备100生成一个投屏界面104,投屏界面104的显示内容与第一电子设备100屏幕上当前显示的显示界面103的显示内容相同,但是第一电子设备100根据获取到的第二电子设备200的显示参数,调整投屏界面104的显示参数与第二电子设备200发送的相同,以使得投屏界面104的显示风格与第二电子设备200的显示界面202的显示风格协调一致,然后第一电子设备将显示风格调整后的投屏界面104投屏至第二电子设备200,并且在此过程中,可以不改变第一电子设备100的当前显示界面103的原有显示风格。
可以理解,在本申请的一些实施例中,显示参数可以包括第二电子设备200显示界面202中正在使用的字符的字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性等参数,下文将进行详细描述。可以理解,对于一些电子设备,如手机、平板电脑等,字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性等也可以统一地包括在一种主题模式中,例如,老人模式(简易模式),深色模式等。这里的控件可以包括第一电子设备100的显示界面103中的图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏等。控件属性可以包括上述控件的大小,位置,排列顺序以及是否显示等属性。
在第一电子设备100上不具备第二电子设备200的显示参数所代表的显示功能时,例如,第一电子设备100不具备显示参数中的字体大小、字体样式、背景图案,背景颜色等参数所对应的显示功能的情况下,第一电子设备100还可以服务器300获取上述缺失的显示功能。其中,服务器300可以用于存储和更新显示功能,并应第一电子设备100的请求或者主动将存储或者更新后的显示功能发送给第一电子设备100。
如图2所示,服务器300可以自行收集和更新的显示功能。例如,服务器300可以从各个电子设备(如各第二电子设备200)或从各个字体大小、字体样式、背景图案、背景颜色以及控件属性,或者主题模式的开发者处收集不同显示风格所包括的各种显示功能(例如,开发者在服务器300的应用商店中注册或上架字体大小、字体样式、背景图案,背景颜色以及控件属性,主题模式;再如,服务器300请求各个电子设备上报自身存储的字体大小、字体样式、背景图案,背景颜色以及控件属性,主题模式)。服务器300还可以基于第一电子设备100的请求或者通过定期推送的方式,将最新收集到的字体大小、字体样式、背景图案,背景颜色以及控件属性,主题模式等显示风格参数发送给第一电子设备100。
此外,可以理解,在本申请的实施例中,第一电子设备100在第二电子设备200的局部投屏区域,可以是第二电子设备200的屏幕中与第一电子设备100的显示界面103或者屏幕的尺寸相同的局部投屏区域,例如,将手机上的显示界面投屏到屏幕尺寸大于手机的平板电脑上的局部投屏区域内。也可以是将电子设备的显示界面缩小后投屏到第二电子设备200中,例如,在第二电子设备200接受投屏的区域或者第二电子设备200的屏幕尺寸可以小于第一电子设备100的显示界面103的尺寸的应用场景中。此外,第一电子设备100还可以将屏幕上的显示界面103同时投屏到多个第二电子设备200,并分别适应每个被投屏的第二电子设备200的显示风格。
图3a至图3e分别示出了多种投屏场景。其中,在图3a所示的场景中,第一电子设备100以手机100为例,第二电子设备200以平板电脑200为例,手机100与平板电脑200进行上述多屏协同显示,即手机100将显示界面103显示在平板电脑200上的显示界面202的局部投屏区域中。该局部投屏区域的大小与手机100当前显示界面103的大小相同。在进行投屏时,手机100可以获取平板电脑200的显示界面202的显示参数,并根据获取的平板电脑200的显示参数调整显示界面103的显示参数,从而调整显示界面103的显示风格,例如,在图3a,手机100可以生成一个处于非显示模式(即对于用户不可见)的投屏界面104,该投屏界面104的显示内容与显示界面103相同,而将该投屏界面104内的字体样式从楷体修改为宋体,背景颜色从粉色修改为白色,背景图案从有涟漪图案修改为无涟漪图案,并保持手机100的屏幕中当前的显示界面103不改变,最后将显示风格修改后的投屏界面104投屏至平板电脑200的局部投屏区域内。从图3a可以看出,在平板电脑200的显示界面202上显示的手机100的投屏界面104的显示风格与平板电脑200的显示界面202的显示风格保持了一致。
在图3b所示的场景中,第一电子设备100和第二电子设备200还是分别以手机100和平板电脑200为例,并且手机100与平板电脑200进行多屏协同显示,其中手机当前的显示界面103中显示有即时通信应用(Application,APP),平板电脑200当前的显示界面202的显示风格为老人模式(简易模式)。手机100从平板电脑200获取到的显示参数表示老人模式后,手机100可以创建一个显示内容与手机100的当前的显示界面103相同的投屏界面104(非显示模式,对用户不可见),并对应于老人模式,手机100将投屏界面104中字符的字体调大、字体样式从楷体修改为宋体、背景颜色从粉色修改为白色,背景图案从有涟漪图案修改为无涟漪图案、并简化当前显示的即时通信APP的显示内容,例如,将投屏界面104中即时通信APP中的搜索栏1002设置为不显示,同时,将通信栏目1003中“工作群”的内容预览设置为不显示(可以理解,在其他实施例中,也可以是减少工作群中的文字内容),最后将显示风格修改后的投屏界面104投屏至平板电脑200的局部投屏区域内。从图3b可以看出,在平板电脑200的显示界面202上显示的手机100的投屏界面104的显示风格与平板电脑200的显示界面202的显示风格保持了一致。
图3c与图3b所示的场景类似,不同之处在于平板电脑200的显示风格为深色模式。手机100从平板电脑200获取到显示参数表示深色模式或者获取到的显示参数包括背景颜色、图标颜色、字体颜色等参数时,手机100同样可以创建一个显示内容与手机100的当前的显示界面103相同的投屏界面104(非显示模式,对用户不可见),并对应于深色模式,手机100将投屏界面104中即时通信APP的文字内容以及通信栏目1003内的图标设置为浅色,如白色,并将背景颜色改为颜色与平板电脑200的显示界面202相同的深色。最后将显示风格修改后的投屏界面104投屏至平板电脑200的局部投屏区域内。从图3c可以看出,在平板电脑200的显示界面202上显示的手机100的投屏界面104的显示风格与平板电脑200的显示界面202的显示风格保持了一致。
在图3d所示的场景中,第一电子设备100以手机为例,第二电子设备200以智能手表为例,智能手表200的屏幕小于手机100的屏幕或者手机100上显示界面103的大小,在手机100将显示界面103投屏到智能手表200的显示界面202的局部投屏区域时,可以将显示界面103通过等比例缩放的方式缩小后发送给智能手表200进行显示。具体地,在进行投屏时,手机100获取智能手表200的显示参数和智能手表200用于投屏的局部投屏区域的尺寸信息,并且手机100根据手表200的显示参数调整显示界面103的显示参数,从而调整显示界面103的显示风格,例如,如图3d所示,智能手表200的显示界面202中的字体为宋体,而手机100的显示界面103中的字体为楷体。手机100根据显示参数中的字体参数,可以将生成的投屏界面104内的字体样式从楷体修改为宋体,然后根据获取到的局部投屏区域的 尺寸信息,将投屏界面104按照等比例缩放后投屏至智能手表200的显示界面202的局部投屏区域内。从图3d可以看出,在智能手表200的显示界面202上显示的手机100的投屏界面104的显示风格与智能手表200的显示界面202的显示风格保持了一致。此外,可以理解,手机100在生成投屏界面104后,也可以直接发送给智能手表200,由智能手表200根据自身用于投屏的局部投屏区域的大小,对其进行缩放后显示在智能手表200的显示界面202上。
在图3e所示的场景中,公开了将第一电子设备100的显示界面同时投屏到多个第二电子设备200的场景。其中,以将手机100的显示界面103同时投屏到智能手表200-1和车机200-2上为例进行说明。如图3e所示,在投屏时,手机100可以从智能手表200-1和车机200-2分别接收各自对应的显示参数,然后根据两者的显示参数创建分别对应智能手表200-1和车机200-2的第一投屏界面105和第二投屏界面106,并将创建的第一投屏界面105和第二投屏界面106分别投屏至智能手表200-1和车机200-2。具体地,如图3e所示,手机100的显示界面103中字符的字体为楷体,背景颜色为粉色;智能手表200-1的显示界面202中字符的字体为华文彩云,且背景颜色为白色;车机200-2的显示界面204中字符的字体为宋体,且背景颜色为白色。故在生成第一投屏界面105时,手机将第一投屏界面105内字体样式从楷体修改为华文彩云,将背景颜色修改为白色,然后将显示风格修改后的第一投屏界面105按照等比例缩放的方式投屏至智能手表200-1的显示界面202的局部投屏区域内。同时,手机100可以将第二投屏界面106内的字体样式从楷体修改为宋体,然后将显示风格修改后的第二投屏界面106投屏至车机200-2的显示界面204的局部投屏区域内。从图3e可以看出,投屏后,两个电子设备分别显示的第一投屏界面105和第二投屏界面106的显示风格分别与智能手表200-1和车机200-2的显示界面202和显示界面204的显示风格保持了一致。
本申请中的第一电子设备100和第二电子设备200可以是能够互相通信的各种计算设备,例如,第一电子设备100和第二电子设备200可以包括但不限于,膝上型计算机、台式计算机、平板计算机、手机、服务器、可穿戴设备、头戴式显示器、移动电子邮件设备、车机设备、便携式游戏机、便携式音乐播放器、阅读器设备、其中嵌入或耦接有一个或多个处理器的电视机、或能够访问网络的其他电子设备。
在下文的描述中,为了简化说明,以第一电子设备100为手机100,第二电子设备200为平板电脑200为例说明本申请的技术方案。为了便于说明,下文以手机100与平板电脑200之间进行多屏协同显示为例进行说明。但是,可以理解,本申请的投屏方案适用于任何电子设备间投屏功能。
图4示出了手机100或平板电脑200的一种结构示意图。
如图4所示,手机100或平板电脑200可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,无线通信模块160,音频模块170,传感器模块180,按键190,摄像头191,显示屏192,以及用户标识模块(subscriber identification module,SIM)卡接口193等。
可以理解的是,本发明实施例示意的结构并不构成手机100和平板电脑200的具体限定。在本申请另一些实施例中,手机100和平板电脑200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,处理器110中还可以设置存储器,用于存储指令和数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。
充电管理模块140用于从充电器接收充电输入。电源管理模块141用于连接电池142,充电管理模 块140与处理器110。手机100和平板电脑200的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。
移动通信模块150可以提供应用在手机100和平板电脑200上的包括2G/3G/4G/5G等无线通信的解决方案。
无线通信模块160可以提供应用在手机100和平板电脑200上的包括无线局域网(wireless local area networks,WLAN)(如Wi-Fi网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。
可以理解,在本发明的实施例中,手机100和平板电脑200可以通过移动通信模块150或者无线通信模块160与平板电脑200以及服务器300进行通信。手机100与平板电脑200之间进行多屏协同显示,向平板电脑200发出多屏协同显示请求后,平板电脑200上会显示手机100的窗口。同时,手机100还可以从平板电脑200获取显示参数,以及从服务器300处获取缺失的显示功能。
手机100通过GPU,显示屏192,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏192和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏192用于显示图像,视频等。显示屏192包括显示面板。在一些实施例中,手机100和平板电脑200可以包括1个或N个显示屏192,N为大于1的正整数。
手机100可以通过ISP,摄像头191,视频编解码器,GPU,显示屏192以及应用处理器等实现拍摄功能。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展手机100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储手机100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在内部存储器121的指令,和/或存储在设置于处理器中的存储器的指令,执行手机100和平板电脑200的各种功能应用以及数据处理。例如,在本发明的实施例中,内部存储器121可以用于存储显示参数。
手机100和平板电脑200可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。手机100可以接收按键输入,产生与手机100的用户设置以及功能控制有关的键信号输入。
SIM卡接口193用于连接SIM卡。
图5示出了手机100的一种屏幕协同系统的结构示意图。
如图5所示,手机100可以包括显示系统服务101。显示系统服务101用于获取手机100的视图系统的显示内容,显示内容可以是应用界面,也可以是一个视图,例如手机主界面的视图。
其中,显示系统服务101,是指执行指定系统功能的程序、例程或进程,以便支持其他程序,尤其是底层(接近硬件)程序。例如,在本发明的实施例中,如图5所示的显示系统服务101,其可以用于管理运行在手机上的当前的显示界面以及投屏界面,并为手机100当前的显示界面以及投屏界面设置不同的字体大小、字体样式、背景图案,背景颜色以及控件,或者主题模式等显示参数。当用户在手机打开当前的显示界面时,显示系统服务101可以从手机的存储器中读取显示参数以及其他应用程序资源用于配置当前的显示界面。在手机开启一致性显示模式,手机100的当前的显示界面的显示风格为字体大小1、字体样式1、背景图案1,背景颜色1,显示系统服务101可以创建一个显示内容与当前的显示界面相同的投屏界面,通过从平板电脑200获取的字体大小2、字体样式2、背景图案2,背景颜色2等显示参数,修改投屏界面的显示风格。
下面结合图6至图11c说明本申请的投屏技术方案。
可以理解,此处以手机100的显示界面103显示即时通信APP为例进行说明,并且此处的即时通信APP仅仅是示例性的,本申请的技术方案适用于手机100上包括系统应用在内的各种应用的显示界面,在此不做限制。此外,显示界面103还可以是手机100的显示桌面、手机100的下拉菜单、在手机100上左滑后显示的界面等等。
具体地,参考图3a-3c所示的场景,如图6所示,手机100将当前显示界面103投屏至平板电脑200的过程包括:
S601:手机100与平板电脑200建立通信连接,并向平板电脑200发出多屏协同请求。
例如,手机100可以通过、蓝牙、WIFI、或NFC等无线通信方式与平板电脑200通信连接。在一些实施例中,手机100也可以通过有线通信方式与平板电脑200通信连接,例如,手机100通过数据线以及通用串行总线(Universal Serial Bus,USB)接口与平板电脑200通信连接。
在手机100与平板电脑200建立通信连接前或者建立通信连接后,用户可以开启手机100的多屏协同功能,如图1(a)和1(b)所示。在用户开启手机100的多屏协同显示功能后,用户可以选择向与手机100通信连接的平板200发出多屏协同显示请求。
S602:手机100确认是否开启一致性显示模式,如果开启则进入S604;如果没有开启则进入S603。
手机100可以对一致性显示模式的开启/关闭配置相对应的参数。例如,手机100通过显示系统服务101将一致性显示模式配置为参数名consistenceDisplayMode,将一致性显示模式的开启对应的参数值配置为1,将一致性显示模式的关闭对应的参数值配置为0,上述参数以及参数值保存在手机100的存储器中。在手机100向平板电脑发出多屏协同显示请求的同时,手机100查询参数consistenceDisplayMode以及该参数对应的参数值,如果查询到consistenceDisplayMode对应的参数值为1,则手机100确认开启一致性显示模式。如果查询到consistenceDisplayMode对应的参数值为0,手机100确认未开启一致性显示模式。
在本申请的一些实施例中,如图7所示,手机100可以通过在自身的操作系统的系统设置里配置一致性显示模式的开启/关闭的选项1011。用户可以通过点击该开启/关闭的选项1011实现开启/关闭一致性显示模式。
在本申请的另一些实施例中,如图8所示,用户还可以通过设置在手机100上的按键来配置一致性显示模式的开启/关闭。例如,手机100上设置有开启/关闭一致性显示模式的侧键1012,用户可以通 过拨动该侧键1012实现开启/关闭一致性显示模式。
可以理解,在手机100向平板电脑200发出多屏协同显示请求的同时,如果手机100尚未开启一致性显示模式,则手机100可以提示用户是否要开启一致性显示模式,在用户确认开启后,手机100开启一致性显示模式。例如,如图9所示。在手机100与平板电脑200之间进行多屏协同显示时,如果手机100尚未开启一致性显示模式,则在手机100的屏幕中弹出一个提示框1013,提示用户是否开启一致性显示模式,如果用户选择是,则手机100开启一致性显示模式,否则,手机100不开启一致性显示模式。
在手机100与平板电脑200建立多屏协同,第一电子设备100可以从第二电子设备200获取第二电子设备200当前的显示界面202的显示参数,当第一电子设备确定其屏幕上当前显示的显示界面103的显示风格与显示界面202的显示风格不一致时,第一电子设备100可以弹出提示框,提示用户是否要开启一致性显示模式。
S603:手机100将未修改的显示界面103投屏至平板电脑200的显示界面202的局部投屏区域中。
例如,如图1所示,手机100将未修改过显示风格的显示界面103投屏至平板电脑200的显示界面202的局部投屏区域。
S604:手机100向平板电脑200发出获取平板电脑200的显示参数的指令,并确认平板电脑200是否返回显示参数。
如果平板电脑200返回显示参数,则执行S606;否则执行S605。
可以理解,在一些实施例中,平板电脑200向手机100发送的显示参数可以包括字体大小、字体样式、背景图案,背景颜色、控件属性等具体显示风格参数,例如,背景图案:涟漪,字体样式:宋体,字体大小:大,搜索栏:不可见(如在图3b所示的老人模式下,搜索栏1002不可见)等等。
而在另外一些实施例中,平板电脑200向手机100发送的显示参数可以仅包含一个标识,手机100上存储有各标识所对应的显示风格参数,例如,如下表1所示,其中,标识1对应的背景图案是涟漪,字体样式是宋体,背景颜色为白色无底纹;标识2对应的字体样式是楷体,字体大小是14,背景颜色为黑色;标识3对应的字体样式是华文新魏。
如下表1所示,不同的显示参数具有不同的种类、名称、标识,并对应不同的参数。
Figure PCTCN2021122792-appb-000001
表1
S605:手机100提示是否在无法完成一致性显示功能的情况下继续进行投屏。
例如,如图10所示,在手机100向平板电脑200发出获取平板电脑200的显示参数的指令后,如果手机100并未收到平板电脑200返回的显示参数。这时,手机100的屏幕中可以弹出一个提示框1014,提示用户无法完成一致性显示功能,是否继续进行多屏协同显示。如果用户选是,则执行S603,手机100将未修改显示风格的显示界面103投屏至平板电脑200,如果用户选择否,则手机100结束投屏,即终止将显示界面103投屏至平板电脑200的操作,并提示用户多屏协同显示结束,即执行S610,结束多屏协同显示。
可以理解,在另一些实施例中,如果用户选择否,手机100还可以重复执行S604,手机100可以再次向平板电脑200发出获取平板电脑200的显示参数的指令。
此外,可以理解,在另外一些实施例中,手机100可以在与平板电脑200建立通信连接之后,向平板电脑200发送获取显示参数的指令,手机100无需等到开启一致性显示模式后,才发送该获取指令。
此外,还可以理解的是,在另外一些实施例中,在手机100与平板电脑200通信连接之后,平板电脑200也可以主动向手机100发送显示参数,手机100无需向平板电脑200发送获取显示参数的指令。
S606:手机100基于获取的显示参数,通过显示系统服务101确定手机100是否具备显示参数所对应的显示功能。
如果手机具备这些功能,则创建显示风格修改后的投屏界面104,进入S608;如果不具备某些显示功能,则需要从服务器下载显示功能对应的配置文件,进入S607。
例如,手机100在获取了显示参数后,可以通过显示系统服务101在自身的存储器中查找与显示参数对应的显示功能的配置文件。例如,手机100从平板电脑200处获取的显示参数中包含:背景图案“涟漪”,则手机100的显示系统服务101可以在自身的存储器中查找背景图案“涟漪”的配置文件。
S607:手机100从服务器300获取手机100所不具备的显示功能所对应的配置文件。
例如,假如手机100接收到的显示参数包括的显示风格参数包括:背景图案“涟漪”以及字体“华文新魏”,其中,手机100的存储器中没有存储字体“华文新魏”,则手机100可以向服务器300发送获取请求,从服务器300接收字体“华文新魏”的配置文件,从而用于后续处理中。
S608:手机100创建与当前的显示界面103的显示内容相同的投屏界面104,基于获取的显示参数修改投屏界面104的显示风格。
可以理解,手机100可以通过各种方式创建投屏界面104,例如手机100可以通过创建不可见视图(View)、创建虚拟屏、或者以画中画的形式生成投屏界面104。在创建投屏界面104时,使得该即时通信APP在投屏界面中的显示内容与手机100当前的显示界面103中的即时通信APP一致。创建投屏界面104以及修改显示风格的具体技术细节将在下文进行详细介绍。
S609:手机100将投屏界面104投屏至平板电脑200的显示界面202的局部投屏区域内,平板电脑200在局部投屏区域内显示投屏界面104。
上述S601至S608中,手机100与平板电脑200,以及手机100与服务器300之间发送/返回的请求可以是socket请求(套接字请求)。socket请求用于无线网络或者有线网络中不同电子设备之间,不同电子设备的应用程序之间进行双向通信。
下面介绍在S608中,创建投屏界面104的几种方式。
方式一:通过创建不可见视图生成投屏界面
这里的投屏界面104可以是手机100通过显示系统服务101创建的当前显示界面103的不可见视图,手机100将该投屏界面104设置为不可见。在创建后,投屏界面104的显示内容与手机100屏幕上当前的显示界面103中的显示内容一致。之后,手机100通过显示系统服务101基于获取的平板电脑200的显示参数修改投屏界面104的显示风格。例如,手机100通过显示系统服务101修改投屏界面104中的即时通信APP的字体大小、字体样式、背景图案,背景颜色以及控件属性,或者主题模式等显示参数。
图11a至图11c描述了手机100在开启一致性显示模式的情况下,通过创建手机100当前显示界面103的不可见视图得到投屏界面104,并基于平板电脑200的当前的显示风格修改投屏界面104的显示风格的具体技术细节。
如图11a所示,手机100当前的显示界面103中显示的即时通信APP由多个控件组成,例如,包括标题栏1001、搜索栏1002以及通信栏目1003。其中,通信栏目1003中显示两个通信对象,这两个通 信对象分别是“通勤记录”、“工作群”。每个通信对象还包括:对象图标和通信内容。在图11a中,即时通信APP的背景颜色10011设置为浅灰色,通信栏目1003中的每个通信对象的通信内容的背景颜色10012设置为深灰色。
手机100从平板电脑200获取显示参数,该显示参数包括:背景颜色为白色。手机100创建一个与显示界面103相同的投屏界面104,将该投屏界面104中的即时通信APP的背景颜色10011以及通信栏目1003中通信对象的通信内容部分的背景颜色10012都修改为白色。最后,手机100将修改过显示风格的投屏界面104投屏至平板电脑200的显示界面202。
下面参考图11b中,手机100的当前的显示界面103中显示的即时通信APP除了包括标题栏1001、搜索栏1002以及通信栏目1003,其还设置了“涟漪”的背景图案10013。手机100从平板电脑200获取了显示参数,该显示参数包括:背景图案为默认背景图案。手机100通过创建一个与显示界面103相同的投屏界面104,将该投屏界面104中的即时通信APP中的背景图案修改为默认背景图案,即去掉“涟漪”的背景图案10013,再将修改过显示风格的投屏界面104投屏至平板电脑200的显示界面202。
最后参考图11c,与图11a和图11b不同的是,在图11c中,手机100的当前的显示界面103中显示的即时通信APP包括标题栏1001、搜索栏1002以及通信栏目1003,其中字符的字体样式10014为楷体,而平板电脑200的字体样式为宋体。因此,手机100将创建的投屏界面104中字符的字体样式10014修改为宋体后,将修改过显示风格的投屏界面104投屏至平板电脑200的显示界面202。
方式二:通过虚拟屏创建投屏界面
在另一实施例中,手机100可以在虚拟屏上创建与当前的显示界面103显示内容相同的投屏界面104,并将修改过显示风格的投屏界面104投屏至平板电脑200的显示界面202。
例如,手机100可以创建一个虚拟屏,手机100基于从平板电脑200处获取的字体大小、字体样式、字体颜色、图标大小、图标颜色、背景图案,背景颜色以及控件属性等显示参数创建并修改投屏界面104,并将其显示在虚拟屏中。该虚拟屏的屏幕尺寸、分辨率以及像素密度可以与手机100的当前的显示界面103相同。例如,在Android系统中,手机100可以通过将当前的显示界面103的屏幕尺寸、分辨率、像素密度等作为参数,使用Android系统的显示系统服务DisplayManager的createVirtualDisplay(String,int,int,int,Surface,int)的方法来创建虚拟屏。此外,在一些实施例中,为了不影响手机100上的显示界面103,可以设置虚拟屏为对用户不可见。而在另外一些实施例中,为了让用户确定修改后的显示界面的风格是否满足用户的要求,可以将虚拟屏设置为对用户可见,在用户确认该修改后,才向平板电脑200发送投屏界面104。
方式三:通过画中画的方式创建投屏界面
除了可以通过上述创建不可见视图和虚拟屏的形式来创建投屏界面104外,如图12所示,还可以在手机100中以类似画中画的形式,新建一个窗口1021,将修改过显示风格的投屏界面104显示在窗口1021内。该窗口1021与原来的显示界面103同时显示,然后将新建的窗口1021投屏到智能手表200的显示界面202。
上述手机100投屏平板电脑200的实施例中,平板电脑200用于接收投屏的局部投屏区域的大小大于或者等于手机100的屏幕的尺寸,而与之不同的是,如图3d所示,还存在将屏幕尺寸较大的电子设备(如手机100)投屏至屏幕较小的电子设备(如智能手表)的场景。
图13示出了图3d所示的场景下,手机100和智能手表200实现多屏协同显示的功能。具体地,如图13所示,包括:
S1301:手机100与智能手表200建立通信连接,并向智能手表200发出多屏协同请求。
S1302:手机100确认是否开启一致性显示模式,如果开启则进入S1304;如果没有开启则进入S1303。
S1303:手机100将未修改的显示界面103投屏至智能手表200的显示界面202的局部投屏区域中。
S1304:手机100向智能手表200发出获取智能手表200的显示参数的指令,并确认平板电脑200是否返回显示参数。
S1305:手机100提示是否在无法完成一致性显示功能的情况下继续进行投屏。如果用户选择否,则手机100结束投屏,即终止将显示界面103投屏至智能手表200的操作,并提示用户多屏协同显示结束,即执行S1310,结束多屏协同显示。
S1306:手机100基于获取的显示参数,通过显示系统服务101确定手机100是否具备显示参数所对应的显示功能。如果手机具备这些显示功能,则创建显示风格修改后的投屏界面104,进入S1308;如果不具备某些显示功能,则需要从服务器下载显示功能对应的配置文件,进入S1307。
S1307:手机100从服务器300获取手机100所不具备的显示功能所对应的配置文件。
上述S1301至S1307与图6中描述的S601至S607相同,这里不再详述。
S1308:手机100创建与当前的显示界面103的显示内容相同的投屏界面104,基于获取的显示参数修改投屏界面104的显示风格。
例如,手机100的显示界面103的字体样式是楷体,而智能手表200返回的显示参数包括字体样式是宋体,则手机100将投屏界面104的字体样式修改为楷体。在另一实施例中,显示参数还可以包括:字体大小、字体样式、背景图案,背景颜色以及控件等其他显示风格参数。这里的具体过程可以参考上文进行投屏界面的创建和显示风格的修改。
S1309:手机100将投屏界面104投屏至智能手表200的显示界面202的局部投屏区域内,智能手表200根据局部投屏区域的大小,以缩小的方式显示投屏界面104。
例如,智能手表200的屏幕的宽和高分别为100和200,智能手表200的屏幕内的局部投屏区域的大小为,宽50高100,手机100的宽和高分别为200和400,在手机100将投屏界面104投屏至智能手表200的显示界面202的局部投屏区域内后,投屏界面104的宽和高可以根据智能手表200的显示界面202的局部投屏区域的宽和高等比例地缩放为50和100。
上述S1309中描述的智能手表200根据局部投屏区域的大小通过缩放的方式显示投屏界面104,也可以在手机100处完成,例如,手机100在从智能手表200处获取显示参数的同时,手机100还可以同时获取智能手表200的显示界面202的局部投屏区域的尺寸。之后,手机100可以创建一个与智能手表200的局部投屏区域的尺寸相同的投屏界面104,在对投屏界面104修改了显示风格后,将与智能手表200的局部投屏区域的尺寸相同的投屏界面104投屏至智能手表200。
可以理解,在其他实施例中,手机100除了可以将投屏界面104缩小后投屏至第二电子设备200的屏幕,手机100还可以将投屏界面104放大后进行投屏。
例如,在第二电子设备200是智能电视200的情况下,智能电视200的屏幕的宽和高分别为1500和1000,智能电视200的屏幕内的局部投屏区域的大小为,宽300高600,手机100的宽和高分别为200和400,在手机100将投屏界面104投屏至智能电视200的屏幕后,投屏界面104的宽和高可以根据智能电视200的屏幕内的局部投屏区域的宽和高等比例地缩放为300和600。
此外,手机100还可以将显示界面103投屏至多个第二电子设备200,这时,手机100将为显示界面103创建多个投屏界面,将多个投屏界面分别投屏至多个第二电子设备200,同时为了将多个投屏界面进行区分,在创建投屏界面时,手机100对每个投屏界面配置一个投屏界面ID(Display Id)。从而 便于手机100在对多个第二电子设备200进行投屏时,通过投屏界面的投屏界面ID对投屏界面进行查找和管理。
参考图3e,下面说明手机100将显示界面103投屏至智能手表200-1和车机200-2的过程,与图6描述的过程的不同之处在于,手机100需要同时创建显示界面103的第一投屏界面105和第二投屏界面106。如图14所示,具体包括:
S1401:手机100与智能手表200-1和车机200-2通信连接,并向智能手表200和车机200-2发出多屏协同请求。
S1402:手机100确认是否开启一致性显示模式,如果开启则进入S1404;如果没有开启则进入S1403。
S1403:手机100将未修改的显示界面103投屏至智能手表200-1的显示界面202和车机200-2的显示界面204的局部投屏区域。
S1404:手机100向智能手表200-1和车机200-2分别发出获取显示参数的指令,并确认智能手表200-1和车机200-2是否返回显示参数。
S1405:手机100提示是否在无法完成一致性显示功能的情况下继续进行投屏。如果用户选择否,则手机100结束投屏,即终止将显示界面103投屏至智能手表200-1和车机200-2的操作,并提示用户多屏协同显示结束,即执行S1410,结束多屏协同显示。
S1406:手机100基于获取的显示参数,通过显示系统服务101确定手机100是否具备显示参数所对应的显示功能。如果手机具备这些功能,则创建显示风格修改后的第一投屏界面105和第二投屏界面106,进入S1408;如果不具备某些显示功能,则需要从服务器下载显示功能对应的配置文件,进入S1407。
S1407:手机100从服务器300获取手机100所不具备的显示功能所对应的配置文件。
上述S1401至S1407与图6中描述的S601至S607相同,这里不再详述。
S1408:手机100分别创建与当前的显示界面103的显示内容相同的第一投屏界面105和第二投屏界面106,基于智能手表200-1和车机200-2的不同显示参数分别修改第一投屏界面105和第二投屏界面106的显示风格。
例如,智能手表200-1和车机200-2的显示参数可以是:背景颜色为白色,字体样式为宋体,而这时手机100的显示界面103的显示风格是,背景颜色为灰色,字体样式为楷体,手机100通过显示系统服务101分别创建第一投屏界面105和第二投屏界面106,第一投屏界面105用于投屏至智能手表200-1,第二投屏界面106用于投屏至车机200-2。手机100通过显示系统服务101将第一投屏界面105和第二投屏界面106的显示风格统一修改为背景颜色为白色,字体样式为宋体。
S1409:手机100将第一投屏界面105投屏至智能手表200的显示界面202的局部投屏区域,将第二投屏界面106投屏至车机200-2的显示界面204的局部投屏区域。
图15根据本申请的另外一些实施例,示出了图2所示的屏幕协同系统进行屏幕协同显示的另一种方法流程图。具体地,如图15所示,包括:
S1501:第一电子设备和第二电子设备建立多屏协同连接。
建立多屏协同连接的方式请参考S601中,手机100与平板电脑200建立多屏协同连接的过程,例如,此处第一电子设备可以是手机100,第二电子设备可以是平板电脑200。手机100与平板电脑200进行通信连接,并向平板电脑200发出多屏协同请求。
此外,可以理解,第二电子设备也可以是图3e中的智能手表200-1或者是车机200-2。
S1502:第一电子设备显示第一界面,第一界面包括第一内容,第一界面具有第一显示参数。
例如,如图图3a所示,此处的第一界面可以是手机100的显示界面103,显示界面103中包括: 标题栏,搜索栏,通信栏目等,即为第一内容,同时,显示界面103中字符的字体为楷体,背景颜色为粉色,背景图案为有涟漪图案,也就是第一显示参数。
再例如,如图3e所示,手机100的显示界面103中的第一内容也可以包括联系人图标,联系人姓名,提示内容,取消按键和切换到语音按键等。这时,第一显示参数包括显示界面103中的字体为楷体,背景颜色为粉色等参数。
S1503:第二电子设备显示第二界面,第二界面包括第二内容,第二界面具有第二显示参数。
例如,如图3a所示,这里的第二界面可以是平板电脑200的显示界面202,显示界面202中包括:设置,耗电排行等,即为第二内容,同时,显示界面202中字符的字体为宋体,且背景颜色为白色,也就是第二显示参数。
再例如,如图3e所示,第二界面还可以是智能手表200-1的显示界面202,其包括:日期和时间等,即为第二内容。这时,第二显示参数包括智能手表200-1的显示界面202中,字符的字体为华文彩云,且背景颜色为白色。第二界面也可以是车机200-2的显示界面204,显示界面204中包括:音乐播放信息,音乐播放进步,音乐播放按钮等,即为第二内容。这时,第二显示参数包括车机200-2的显示界面204中字符的字体为宋体,且背景颜色为白色。
可以理解,上述步骤S1501至S1503的顺序不限于图示的顺序,可以是任意顺序,例如,可以是S1502、S1503、S1501的顺序,也可以是S1501、S1503、S1502的顺序,或着S1501、S1503、S1502同时进行。
S1504:第一电子设备向第二电子设备发送第三界面。
例如,如图图3a所示,第三界面可以是手机100生成的投屏界面104,手机100将投屏界面104内字体样式从楷体修改为宋体,将背景颜色修改为白色,背景图案从有涟漪图案修改为无涟漪图案,也就是修改为第二显示参数,然后将投屏界面104投屏至平板电脑200的显示界面202。
再例如,如图3e所示,第三界面可以是手机100生成的第一投屏界面105,手机100使用第二显示参数,如:字符的字体为华文彩云,且背景颜色为白色。修改第一投屏界面105。第三界面也可以是手机100生成的第二投屏界面106,手机100使用第二显示参数,如:字符的字体为宋体,且背景颜色为白色,修改第二投屏界面106。
S1505:响应于接收到的第三界面,第二电子设备显示第四界面,第四界面包括第二内容和第一窗口,第一窗口包括第一内容,第一窗口中的第一内容具有第二显示参数。
例如,如图3a所示,这里的第四界面,是平板电脑200的显示界面202,第一窗口是平板电脑200的显示界面202内的局部投屏区域。平板电脑200在接收到手机100的投屏界面104后,在显示界面202中除了显示设置,耗电排行等,还显示投屏界面104,也就是标题栏,搜索栏,通信栏目等,即为第一内容。并且,第一内容中字符的字体为宋体,且背景颜色为白色,无背景图案,也就是第二显示参数。
再例如,如图3e所示,这里的第四界面,可以是是智能手表200-1的显示界面202,智能手表200-1在接收到手机100的第一投屏界面105后,在显示界面202中使用第二显示参数,如:字符的字体为华文彩云,且背景颜色为白色,显示包含第一内容的第一投屏界面105。
这里的第四界面,还可以是车机200-2的显示界面204,车机200-2在接收到手机100的第二投屏界面106后,在显示界面204中使用第二显示参数,如:字体为宋体,且背景颜色为白色,显示包含的第一内容的第二投屏界面106。
图16是本发明实施例的手机100的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
图16所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
图16所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统可以是手机100的显示系统服务101,用于管理和修改手机100的应用程序的显示风格。视图系统根据手机100从平板电脑200处获取的显示参数中包含的显示风格参数,获取与上述显示风格参数对应的显示功能,用于配置手机100的应用程序。
电话管理器用于提供手机100的通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
在本发明的实施例中,资源管理器还可以用于存储Overlay配置文件。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
通过以上实施方式的描述,所属领域的技术人员可以了解到,为描述的方便和简洁,仅以上述各功 能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。

Claims (19)

  1. 一种设备间屏幕协同方法,应用于包括第一电子设备和第二电子设备的屏幕协同系统,其特征在于,包括:
    所述第一电子设备和所述第二电子设备建立多屏协同连接;
    所述第一电子设备显示第一界面,所述第一界面包括第一内容,所述第一界面具有第一显示参数;
    所述第二电子设备显示第二界面,所述第二界面包括第二内容,所述第二界面具有第二显示参数;
    所述第一电子设备向所述第二电子设备发送第三界面;
    响应于接收到的所述第三界面,所述第二电子设备显示第四界面,所述第四界面包括所述第二内容和第一窗口,所述第一窗口包括所述第一内容,所述第一窗口中的所述第一内容具有所述第二显示参数。
  2. 根据权利要求1所述方法,其特征在于,显示参数包括字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中的至少一个,并且
    所述显示参数包括所述第一显示参数和第二显示参数。
  3. 根据权利要求1所述的方法,其特征在于,所述第二显示参数包括显示风格标识,所述显示风格标识对应所述第二界面的显示风格,其中,对应不同的显示风格标识,所述第二电子设备的所述第二界面中的字体样式、字体大小、字体颜色、图标颜色、图标大小、背景颜色、背景图案、控件属性中的至少一个不同。
  4. 根据权利要求1所述的方法,其特征在于,还包括:
    所述第一电子设备接收所述第二电子设备发送的所述第二显示参数,并基于接收到的所述第二显示参数生成所述第三界面,其中,所述第三界面包括所述第一内容,并且具有所述第二显示参数。
  5. 根据权利要求4所述的方法,其特征在于,所述第一电子设备通过以下方式生成所述第三界面:
    所述第一电子设备将所述第三界面中的字体大小调大至与所述第二电子设备的第二界面中的字体大小相同,并减少所述第三界面中字符的数量,以及将所述第三界面中的至少一个控件的属性修改为不可见。
  6. 根据权利要求1所述的方法,其特征在于,所述第一窗口的字体大小大于所述第一界面的字体大小并与所述第二电子设备的第二界面中的字体大小相同,并且
    所述第一窗口中字符的数量少于所述第一界面中字符的数量,以及
    所述第一内容的至少一个控件在所述第一界面中的属性为可见,而在所述第一窗口中的属性为不可见。
  7. 根据权利要求4所述的方法,其特征在于,所述第一电子设备通过以下方式生成所述第三界面:
    所述第一电子设备将所述第三界面中的背景颜色调整为与所述第二电子设备的第二界面的背景颜色相同,并将所述第三界面中字符和图标的颜色调整为与所述背景颜色不同。
  8. 根据权利要求1所述的方法,其特征在于,所述第一窗口的背景颜色与所述第二电子设备的第二界面或者第四界面中的所述第二内容的背景颜色相同,并且所述第一窗口中字符和图标的颜色与所述背景颜色不同。
  9. 根据权利要求1所述的方法,其特征在于,所述第三界面为所述第一电子设备中不可见的视图或者所述第三界面生成在所述第一电子设备的虚拟屏上。
  10. 根据权利要求1所述的方法,其特征在于,所述第三界面的尺寸小于所述第一电子设备的屏幕的尺寸,并且所述第三界面与第一界面同时显示在第一电子设备的屏幕上。
  11. 根据权利要求10所述的方法,其特征在于,所述第一电子设备还从所述第二电子设备获取所述第一窗口的尺寸,并且所述第一电子设备生成的第三界面的尺寸与第一窗口的尺寸相同。
  12. 根据权利要求1所述的方法,其特征在于,所述第一电子设备还从所述第二电子设备获取所述第一窗口的尺寸,并且
    在所述第一电子设备生成的第三界面的尺寸不同于所述第一窗口的尺寸的情况下,所述第一电子设备向所述第二电子设备发送尺寸缩小或者放大至与所述第一窗口的尺寸相同的第三界面。
  13. 根据权利要求1所述的方法,其特征在于,所述屏幕协同系统还包括第三电子设备,并且,所述方法还包括:
    所述第一电子设备还与所述第三电子设备建立多屏协同连接,并且所述第三电子设备显示第五界面,所述第五界面包括第三内容,所述第五界面具有第三显示参数;
    所述第一电子设备向所述第三电子设备发送第六界面;
    响应于接收到的所述第六界面,所述第三电子设备显示第七界面,所述第七界面包括所述第三内容和第二窗口,所述第二窗口包括所述第一内容,所述第二窗口中的所述第一内容具有所述第三显示参数。
  14. 根据权利要求1所述的方法,其特征在于,所述第一电子设备的第一界面包括所述第一电子设备的显示桌面、左滑显示界面、下拉菜单、应用显示界面中的至少一个。
  15. 一种设备间屏幕协同方法,其特征在于,包括:
    第一电子设备和第二电子设备建立多屏协同连接;
    所述第一电子设备显示第一界面,所述第一界面包括第一内容,所述第一界面具有第一显示参数;
    所述第一电子设备接收所述第二电子设备发送的第二显示参数,其中所述第二电子设备有显示第二界面,所述第二界面包括第二内容,所述第二界面具有所述第二显示参数;
    所述第一电子设备根据所述第二显示参数生成第三界面;
    所述第一电子设备向所述第二电子设备发送所述第三界面,所述第三界面包括所述第一内容,并且具有所述第二显示参数。
  16. 根据权利要求15所述的方法,其特征在于,所述第一电子设备的第一界面的字体大小小于所述第二电子设备的第一窗口的字体大小,并且所述第一界面种字符的数量多于所述第一窗口中字符的数量,以及
    所述第一内容的至少一个控件在所述第一界面中的属性为可见,而在所述第一窗口中的属性为不可见。
  17. 根据权利要求15所述的方法,其特征在于,所述第一电子设备上所述第一界面的背景颜色与所述第二电子设备上第四界面中的第一窗口的背景颜色不同。
  18. 一种电子设备,其特征在于,包括:
    存储器,存储有指令;
    处理器,所述处理器和存储器耦合,当所述存储器存储的程序指令被所述处理器执行时使得所述电子设备执行权利要求1至17中任一项所述的设备间屏幕协同方法中第一电子设备或者第二电子设备的功能。
  19. 一种可读介质,所述可读介质中存储有指令,其特征在于,当所述指令在所述可读介质上运行时,使得所述可读介质执行如权利要求1至17中任一项所述的设备间屏幕协同方法中第一电子设备或者第二电子设备的功能。
PCT/CN2021/122792 2020-11-16 2021-10-09 电子设备及其设备间屏幕协同方法和介质 WO2022100326A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US18/001,380 US20230229375A1 (en) 2020-11-16 2021-10-09 Electronic Device, Inter-Device Screen Coordination Method, and Medium
EP21890854.9A EP4145268A4 (en) 2020-11-16 2021-10-09 ELECTRONIC DEVICE AND METHOD FOR INTEROPERATION BETWEEN DEVICE SCREENS AND MEDIUM THEREOF

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011279269.XA CN114510203A (zh) 2020-11-16 2020-11-16 电子设备及其设备间屏幕协同方法和介质
CN202011279269.X 2020-11-16

Publications (1)

Publication Number Publication Date
WO2022100326A1 true WO2022100326A1 (zh) 2022-05-19

Family

ID=81546832

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/122792 WO2022100326A1 (zh) 2020-11-16 2021-10-09 电子设备及其设备间屏幕协同方法和介质

Country Status (4)

Country Link
US (1) US20230229375A1 (zh)
EP (1) EP4145268A4 (zh)
CN (1) CN114510203A (zh)
WO (1) WO2022100326A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115686405A (zh) * 2021-07-31 2023-02-03 华为技术有限公司 一种显示方法及电子设备
CN115562539A (zh) * 2022-11-09 2023-01-03 维沃移动通信有限公司 控件显示方法及装置、电子设备和可读存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060100011A1 (en) * 2004-09-16 2006-05-11 Morrow James W User interface system and method for creating and verifying signed content
CN101582053A (zh) * 2008-05-13 2009-11-18 苹果公司 将用户界面推到远程设备
CN103019499A (zh) * 2011-09-19 2013-04-03 通用汽车环球科技运作有限责任公司 定制由便携设备向界面设备放映的信息的方法和系统
CN104640239A (zh) * 2015-03-04 2015-05-20 深圳一智信息技术有限公司 一种用户可自定义界面的车载通信多媒体设备

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160148521A1 (en) * 2011-04-11 2016-05-26 Ali Mohammad Bujsaim Sensitivity adjustment for talking book
CN108170472B (zh) * 2016-12-05 2021-06-18 法法汽车(中国)有限公司 一种移动终端的皮肤切换方法和装备及移动终端
CN107145319B (zh) * 2017-04-26 2020-07-14 海南云江科技有限公司 一种数据共享方法、设备和系统
CN110381195A (zh) * 2019-06-05 2019-10-25 华为技术有限公司 一种投屏显示方法及电子设备
CN117492611A (zh) * 2019-12-24 2024-02-02 华为技术有限公司 一种文件处理方法、电子设备、系统和存储介质
CN111432070B (zh) * 2020-03-17 2022-04-08 阿波罗智联(北京)科技有限公司 应用投屏控制方法、装置、设备和介质
CN111736692B (zh) * 2020-06-01 2023-01-31 Oppo广东移动通信有限公司 显示方法、显示装置、存储介质与头戴式设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060100011A1 (en) * 2004-09-16 2006-05-11 Morrow James W User interface system and method for creating and verifying signed content
CN101582053A (zh) * 2008-05-13 2009-11-18 苹果公司 将用户界面推到远程设备
CN103019499A (zh) * 2011-09-19 2013-04-03 通用汽车环球科技运作有限责任公司 定制由便携设备向界面设备放映的信息的方法和系统
CN104640239A (zh) * 2015-03-04 2015-05-20 深圳一智信息技术有限公司 一种用户可自定义界面的车载通信多媒体设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4145268A4

Also Published As

Publication number Publication date
US20230229375A1 (en) 2023-07-20
EP4145268A1 (en) 2023-03-08
EP4145268A4 (en) 2024-01-17
CN114510203A (zh) 2022-05-17

Similar Documents

Publication Publication Date Title
US10735377B2 (en) System for remotely controlling electronic device and method of operating the same
CN113553014B (zh) 多窗口投屏场景下的应用界面显示方法及电子设备
WO2022100326A1 (zh) 电子设备及其设备间屏幕协同方法和介质
EP4002107B1 (en) Data binding method, apparatus, and device of mini program, and storage medium
CN114356258A (zh) 电子设备及其投屏方法和介质
CN111597000A (zh) 一种小窗口管理方法及终端
EP4257217A1 (en) Image processing method, electronic device, and storage medium
KR102116996B1 (ko) 전자기기 원격제어 시스템 및 이의 운용방법
CN111031377B (zh) 移动终端及视频制作方法
WO2023109764A1 (zh) 一种壁纸显示方法及电子设备
CN112799557B (zh) 一种水墨屏显示控制方法、终端及计算机可读存储介质
CN113360122B (zh) 移动终端及其文本显示方法
CN111324255B (zh) 一种基于双屏终端的应用处理方法及通信终端
CN114675786A (zh) 一种大容量存储挂载方法、装置、终端及介质
CN115941674B (zh) 多设备应用接续方法、设备及存储介质
EP4343533A1 (en) Screen projection method and related apparatus
CN115061758B (zh) 应用的显示方法、终端、电子设备以及存储介质
WO2024066992A1 (zh) 一种多设备组网系统、方法及终端设备
CN113253905B (zh) 基于多指操作的触控方法及智能终端
WO2024087808A1 (zh) 界面显示方法及电子设备
CN112230906B (zh) 列表控件的创建方法、装置、设备及可读存储介质
CN114675762A (zh) 一种终端设备、功能搜索方法和存储介质
CN115509661A (zh) 一种显示设备及osd界面绘制方法
CN117014543A (zh) 图像显示方法和相关装置
CN112817667A (zh) 终端及控件图标显示方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21890854

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021890854

Country of ref document: EP

Effective date: 20221128

NENP Non-entry into the national phase

Ref country code: DE