WO2024067052A1 - Procédé d'affichage de duplication d'écran, dispositif électronique et système - Google Patents

Procédé d'affichage de duplication d'écran, dispositif électronique et système Download PDF

Info

Publication number
WO2024067052A1
WO2024067052A1 PCT/CN2023/118085 CN2023118085W WO2024067052A1 WO 2024067052 A1 WO2024067052 A1 WO 2024067052A1 CN 2023118085 W CN2023118085 W CN 2023118085W WO 2024067052 A1 WO2024067052 A1 WO 2024067052A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
vehicle
information
electronic device
mounted terminal
Prior art date
Application number
PCT/CN2023/118085
Other languages
English (en)
Chinese (zh)
Inventor
饶刚
庄効谚
邢海峰
李自由
卢恒惠
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2024067052A1 publication Critical patent/WO2024067052A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the embodiments of the present application relate to the field of terminal technology, and in particular to a screen projection display method, electronic device and system.
  • in-vehicle terminals support screen projection technology.
  • Electronic devices such as mobile phones, tablets, etc.
  • a user enters a car while listening to music through a mobile phone music application.
  • the mobile phone establishes a connection with the vehicle terminal, and the user can continue to listen to the unfinished music previously played through the mobile phone through the vehicle terminal.
  • the application in the electronic device must first support screen projection to the vehicle terminal for display before screen projection can be realized.
  • the developer of the same application also needs to develop multiple types of applications that are suitable for different models of vehicle terminals, and the application development is difficult.
  • the number of screen projection applications is limited, and the vehicle terminal application ecosystem is not perfect, which cannot meet the user's demand for the use of vehicle terminals.
  • the embodiments of the present application provide a screen projection display method, electronic device and system.
  • the technical solution provided by the embodiments of the present application is that the electronic device adaptively adjusts the application screen projection content according to the vehicle terminal information, so that the application has better universality, while ensuring the screen projection effect, reducing the difficulty of application development.
  • a screen projection display method includes: an electronic device obtains first information sent by a vehicle-mounted terminal, and the first information includes vehicle-mounted terminal information.
  • the electronic device receives a screen projection request.
  • the electronic device determines the first interface information of the first application indicated by the screen projection request.
  • the electronic device determines the screen projection data based on the vehicle-mounted terminal information and the first interface information.
  • the screen projection data is sent to the vehicle-mounted terminal, and the screen projection data is used to enable the vehicle-mounted terminal to display the screen projection interface.
  • the first application is installed in the electronic device, and the first application is installed or not installed in the vehicle terminal.
  • the electronic device can display the first interface of the first application and determine the first interface information of the first interface.
  • the electronic device does not display the first application, and the electronic device determines the first interface information and the projection data in the background of the first application.
  • the electronic device can adaptively adjust the display of the application interface to be projected based on the vehicle terminal information and the identified display information of the application interface to be projected, so as to improve the application projection display effect and enhance the user experience.
  • the in-vehicle terminal information includes application layout information.
  • the application layout information includes desktop layout information of the vehicle-mounted terminal.
  • application layout information is used to represent the display of the vehicle terminal display screen.
  • the vehicle terminal displays a desktop
  • the display content on the desktop includes the function icons of the vehicle terminal (such as seat adjustment map icons, air conditioning control icons, etc.), and may also include icons of vehicle terminal applications.
  • the application layout information may include desktop layout information, such as information on multiple icons displayed, icon location information, etc.
  • the vehicle terminal displays an application interface
  • the application layout information includes the layout information of the displayed application interface.
  • the application layout information is used by subsequent electronic devices to re-layout the interface display content of the application to be projected and the display content of the vehicle terminal.
  • the electronic device can adaptively adjust the screen projection content of the application according to the content that the vehicle terminal needs to display fixedly (such as the content corresponding to the application layout information). This ensures that during the screen projection process, the vehicle terminal can still display the fixed content to meet the user's usage needs.
  • the vehicle-mounted terminal information also includes display screen size information
  • the method also includes: in response to a screen projection request, determining whether the display status of the electronic device and the vehicle-mounted terminal is the same or different based on the display screen size information, and the display status is used to indicate horizontal screen display or vertical screen display.
  • the display screen size information is used to indicate the size of the display area corresponding to the display screen of the vehicle terminal, such as length, width and other information, where the display area is used for display on the vehicle terminal.
  • the electronic device first determines the display status of the electronic device and the vehicle terminal to determine the method of obtaining the projection data. For example, if the electronic device display screen and the vehicle terminal display screen are both horizontal or vertical, the electronic device can directly scale the application display interface to meet the display requirements of the vehicle terminal display screen. If the electronic device display screen is vertical and the vehicle terminal display screen is horizontal, or the electronic device display screen is horizontal and the vehicle terminal display screen is vertical. Then, the electronic device needs to rearrange the display content on the application interface to achieve a better display effect on the vehicle terminal display screen.
  • determining whether the display states of the electronic device and the vehicle-mounted terminal are the same or different based on the display screen size information includes: determining a first aspect ratio of the display screen of the electronic device, and determining a second aspect ratio of the display screen of the vehicle-mounted terminal based on the display screen size information.
  • the absolute value of the difference between the first aspect ratio and the second aspect ratio is less than or equal to a first threshold
  • the display states of the electronic device and the vehicle-mounted terminal are the same.
  • the absolute value of the difference between the first aspect ratio and the second aspect ratio is greater than the first threshold, the display states of the electronic device and the vehicle-mounted terminal are different.
  • the display screen of the vehicle terminal can be rotated to switch between horizontal and vertical display. Then, in the process of determining the projection data, the electronic device needs to determine whether the current display state of the vehicle terminal is horizontal or vertical display. Afterwards, the electronic device can determine whether the display state of the electronic device is the same as the current display state of the vehicle terminal.
  • the horizontal dimension and the vertical dimension indicated in the display screen size information sent by the vehicle terminal correspond to the horizontal dimension and the vertical dimension of the vehicle terminal in the current display state.
  • the vehicle terminal switches the original horizontal dimension and the original vertical dimension, determines the new horizontal dimension (ie, the original vertical dimension) and the vertical dimension (ie, the original horizontal dimension) to generate new display screen size information and send it to the electronic device.
  • the electronic device can also switch the display state by rotating the display screen. Then, when the electronic device starts the application to determine the projection data, it needs to determine whether the current display state of the electronic device is horizontal or vertical display. Similarly, the electronic device determines the horizontal and vertical dimensions of the display area during the current display process to determine the aspect ratio. Afterwards, the electronic device can determine whether the display state of the electronic device is the same as the current display state of the vehicle-mounted terminal. Alternatively, the electronic device determines whether the display state of the corresponding electronic device is horizontal or vertical display based on the application background data. Afterwards, the electronic device can determine whether the display state of the electronic device is the same as the current display state of the vehicle-mounted terminal.
  • the display states of the electronic device and the vehicle-mounted terminal are different, and in response to a screen projection request, determining the first interface information of the first application indicated by the screen projection request includes: determining the first interface of the first application to be projected in response to the screen projection request. Dividing the functional area of the first interface and determining the first interface information.
  • the electronic device when determining the projection data, determines that the display states of the electronic device and the vehicle-mounted terminal are different, and the application interface display content needs to be re-layouted. Therefore, the electronic device can also perform structural division on the layout of the projection interface.
  • the electronic device divides the functional areas on the screen to be projected, and divides each functional area into a waterfall structure.
  • the functional area identification process includes, for example, identifying a tabulator (TAB) page, a search bar, a banner page, a grid bar, a title bar, a player, etc. included in the screen to be projected.
  • TAB tabulator
  • the projection data is determined according to the vehicle terminal information and the first interface information, including: according to the first interface information, the display screen size information, and the application layout information, the first display content corresponding to the functional area after the division and the second display content corresponding to the application layout information are re-layouted to generate the second interface information.
  • the projection data is generated according to the second interface information.
  • the electronic device can adaptively adjust the display of the application interface to be projected based on the vehicle terminal information and the identified display information of the application interface to be projected, so as to improve the application projection display effect and enhance the user experience.
  • the first display content corresponding to the functional area and the second display content corresponding to the application layout information are re-layouted according to the first interface information, the display screen size information, and the application layout information to generate the second interface information, including: according to the functional area, the display screen size information, and the application layout information, the display area corresponding to the display screen of the vehicle terminal is divided into a first display area and a second display area, the first display area is used to display the first display content, and the second display area is used to display the second display content.
  • the first display area is re-layouted
  • the second display content is re-layouted.
  • the second interface information is determined.
  • the electronic device can divide the adaptation interface placement area (i.e., the first display area) on the screen to be projected and the in-vehicle application function placement area (i.e., the first display area) based on the in-vehicle terminal information (e.g., display screen size information, application layout information) and the application interface information of the electronic device.
  • the adapter interface placement area is used to display the application interface of the projection screen (i.e. the first display content), and the in-vehicle application function placement area is used to display the content that the in-vehicle terminal needs to display first, such as desktop icons (i.e. the second display content).
  • the screen to be projected may only include the adaptation interface placement area, and the vehicle-mounted terminal may subsequently display the projected application interface in full screen.
  • a division template of the screen to be projected interface of the vehicle terminal is pre-configured, and the second display content to be displayed on the vehicle terminal and the first display content of the screen to be projected are mixed and arranged and optimized to determine the adaptation interface placement area and the vehicle application function placement area.
  • the electronic device can adaptively adjust the display of the application interface to be projected based on the vehicle terminal information and the identified display information of the application interface to be projected, so as to improve the application projection display effect and enhance the user experience.
  • the display status of the electronic device and the vehicle-mounted terminal is the same, and the projection data is determined according to the vehicle-mounted terminal information and the first interface information, including: determining the first display area for projecting and displaying the first application according to the display screen size information and the application layout information, the first display area being the display area other than the second display content corresponding to the application layout information.
  • the first display area the first interface of the first application corresponding to the first interface information is enlarged or reduced to generate the third interface information.
  • the projection data is determined according to the third interface information and the application layout information.
  • the electronic device first determines the display status of the electronic device and the vehicle-mounted terminal.
  • the projection data can be directly determined by scaling the application interface to be projected, thereby effectively improving the projection efficiency under the same display status.
  • the vehicle-mounted terminal information also includes application information of the vehicle-mounted terminal
  • the second display content includes function icons corresponding to the application layout information and/or commonly used application icons of the vehicle-mounted terminal
  • the function icons are function icons displayed by the vehicle-mounted terminal before screen projection and/or function icons used to control electronic devices
  • the commonly used application icons are icons of commonly used applications of the vehicle-mounted terminal determined by the electronic device based on the application information.
  • application information is used to represent information about applications installed in the vehicle-mounted terminal, such as application usage information, and the electronic device can subsequently determine the commonly used applications of the vehicle-mounted terminal based on the application usage information.
  • the screen projection data determined by the electronic device may include icons of commonly used applications of the vehicle terminal.
  • the vehicle terminal can display icons of commonly used applications during the subsequent screen projection process, which is convenient for users to use.
  • the electronic device may also determine the electronic device function icon to be displayed on the vehicle terminal during the process of generating the projection data. Afterwards, the projection data sent by the electronic device to the vehicle terminal includes the electronic device function icon. Subsequently, the vehicle terminal includes the electronic device function icon in the projection interface displayed according to the projection data.
  • the user can control the electronic device through the electronic device function icon on the vehicle terminal, thereby improving the user experience.
  • the vehicle terminal information also includes a display screen control method and hardware information of the vehicle terminal, the display screen control method is used to indicate whether the vehicle terminal is a touch screen or a non-touch screen, and before sending the projection data to the vehicle terminal, the method also includes: determining the operation response mode corresponding to the first control in the projection data. A binding relationship is generated based on the first control, the operation response mode, the hardware information, and the display screen control method, and the binding relationship is used to indicate the first response of the vehicle terminal after detecting the user's operation on the first control displayed in the projection interface.
  • the control method of the display screen is used to indicate whether the display screen is a touch screen or non-touch screen, key or knob controlled information, etc.
  • Hardware information includes, for example, information of hardware devices such as microphones, speakers, loudspeakers, cameras, etc. installed in the vehicle terminal.
  • the method further includes: sending the binding relationship to the vehicle-mounted terminal.
  • the display content of the projected application interface is bound to the corresponding operation response, while ensuring the display effect, the interactive function of the application interface is retained to ensure the user experience.
  • the screen projection request is a screen projection request determined after the electronic device receives the user's screen projection operation, or the screen projection request is a screen projection request sent by the vehicle-mounted terminal.
  • the electronic device when the electronic device is displaying the first interface of the first application, if it detects that the user clicks the screen projection control, it can be determined that the user instructs to project the currently displayed first interface to the vehicle terminal for display. Before the application is projected, the vehicle terminal displays the desktop or other applications, which are vehicle terminal applications or projection applications.
  • the vehicle terminal can obtain information about applications installed in the electronic device, and display corresponding application icons based on the information.
  • the vehicle terminal detects the user's operation on an application icon, it can send a screen projection request to the electronic device to request the electronic device to project the first application corresponding to the application icon, thereby determining that the screen needs to be projected to the vehicle terminal for display.
  • the first application is shown.
  • the first application is, for example, a video application, a music application, a navigation application, or the like.
  • an embodiment of the present application provides a screen projection display method, which is applied to a vehicle-mounted terminal.
  • the method includes: sending first information to an electronic device, the first information including vehicle-mounted terminal information.
  • Receive projection data sent by the electronic device, the projection data is the electronic device responding to the received projection request, and the first interface information of the first application indicated by the projection request and the vehicle-mounted terminal information are determined.
  • display the projection interface According to the projection data, display the projection interface.
  • the in-vehicle terminal information includes application layout information.
  • the application layout information includes desktop layout information of the vehicle-mounted terminal.
  • the vehicle terminal information also includes display screen size information, and the display screen size information is used for the electronic device to determine the display status of the vehicle terminal, and the display status is used to indicate horizontal screen display or vertical screen display.
  • the method also includes: receiving a binding relationship sent by an electronic device, the binding relationship is used to indicate a first response of the vehicle-mounted terminal after detecting a user operation on a first control displayed on the projection interface;
  • the vehicle-mounted terminal information also includes a display screen control method and hardware information of the vehicle-mounted terminal, and the display screen control method and hardware information are used to enable the electronic device to generate a binding relationship.
  • the method before receiving the projection data sent by the electronic device, the method also includes: sending a projection request to the electronic device in response to the user's projection operation.
  • an embodiment of the present application provides an electronic device.
  • the electronic device includes: a processor and a memory, the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor reads the computer instructions from the memory, the electronic device executes: obtain the first information sent by the vehicle-mounted terminal, the first information includes the vehicle-mounted terminal information.
  • Receive a screen projection request In response to the screen projection request, determine the first interface information of the first application that the screen projection request indicates is projected. Determine the screen projection data based on the vehicle-mounted terminal information and the first interface information. Send the screen projection data to the vehicle-mounted terminal, and the screen projection data is used to enable the vehicle-mounted terminal to display the screen projection interface.
  • the in-vehicle terminal information includes application layout information.
  • the application layout information includes desktop layout information of the vehicle-mounted terminal.
  • the vehicle-mounted terminal information also includes display screen size information.
  • the processor reads computer-readable instructions from the memory, it also enables the electronic device to perform the following operations: in response to the screen projection request, determine whether the display status of the electronic device and the vehicle-mounted terminal is the same or different based on the display screen size information, and the display status is used to indicate horizontal screen display or vertical screen display.
  • determining whether the display states of the electronic device and the vehicle-mounted terminal are the same or different based on the display screen size information includes: determining a first aspect ratio of the display screen of the electronic device, and determining a second aspect ratio of the display screen of the vehicle-mounted terminal based on the display screen size information.
  • the absolute value of the difference between the first aspect ratio and the second aspect ratio is less than or equal to a first threshold
  • the display states of the electronic device and the vehicle-mounted terminal are the same.
  • the absolute value of the difference between the first aspect ratio and the second aspect ratio is greater than the first threshold, the display states of the electronic device and the vehicle-mounted terminal are different.
  • the display states of the electronic device and the vehicle-mounted terminal are different, and in response to a screen projection request, determining the first interface information of the first application indicated by the screen projection request includes: determining the first interface of the first application to be projected in response to the screen projection request. Dividing the functional area of the first interface and determining the first interface information.
  • the projection data is determined according to the vehicle terminal information and the first interface information, including: according to the first interface information, the display screen size information, and the application layout information, the first display content corresponding to the functional area after the division and the second display content corresponding to the application layout information are re-layouted to generate the second interface information.
  • the projection data is generated according to the second interface information.
  • the first display content corresponding to the functional area and the second display content corresponding to the application layout information are re-layouted.
  • the second interface information is generated by: dividing the display area corresponding to the display screen of the vehicle terminal into a first display area and a second display area according to the functional area, the display screen size information, and the application layout information, wherein the first display area is used to display the first display content and the second display area is used to display the second display content.
  • the first display content is re-layouted according to the first display area
  • the second display content is re-layouted according to the second display area.
  • the second interface information is determined according to the re-layouted first display content and the second display content.
  • the display status of the electronic device and the vehicle-mounted terminal is the same, and the projection data is determined according to the vehicle-mounted terminal information and the first interface information, including: determining the first display area for projecting and displaying the first application according to the display screen size information and the application layout information, the first display area being the display area other than the second display content corresponding to the application layout information. According to the first display area, the first interface of the first application corresponding to the first interface information is enlarged or reduced to generate the third interface information. The projection data is determined according to the third interface information and the application layout information.
  • the vehicle-mounted terminal information also includes application information of the vehicle-mounted terminal
  • the second display content includes function icons corresponding to the application layout information and/or commonly used application icons of the vehicle-mounted terminal
  • the function icons are function icons displayed by the vehicle-mounted terminal before screen projection and/or function icons used to control electronic devices
  • the commonly used application icons are icons of commonly used applications of the vehicle-mounted terminal determined by the electronic device based on the application information.
  • the vehicle terminal information also includes a display screen control method and hardware information of the vehicle terminal.
  • the display screen control method is used to indicate whether the vehicle terminal is a touch screen or a non-touch screen.
  • the processor reads computer-readable instructions from the memory, it also causes the electronic device to perform the following operations: determine the operation response mode corresponding to the first control in the projection data.
  • a binding relationship is generated based on the first control, the operation response mode, the hardware information, and the display screen control method. The binding relationship is used to indicate the first response of the vehicle terminal after detecting the user's operation on the first control displayed in the projection interface.
  • the electronic device when the processor reads the computer-readable instructions from the memory, the electronic device is also caused to perform the following operation: sending the binding relationship to the vehicle-mounted terminal.
  • the screen projection request is a screen projection request determined after the electronic device receives the user's screen projection operation, or the screen projection request is a screen projection request sent by the vehicle-mounted terminal.
  • an embodiment of the present application provides a vehicle-mounted terminal.
  • the vehicle-mounted terminal includes: a processor, a memory, and a display screen, the memory and the display screen are coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor reads the computer instructions from the memory, the vehicle-mounted terminal executes: sending first information to the electronic device, the first information includes vehicle-mounted terminal information.
  • Receive the projection data sent by the electronic device the projection data is the electronic device responding to the received projection request, according to the first interface information of the first application indicated by the projection request and the vehicle-mounted terminal information. According to the projection data, display the projection interface.
  • the in-vehicle terminal information includes application layout information.
  • the application layout information includes desktop layout information of the vehicle-mounted terminal.
  • the vehicle-mounted terminal information also includes display screen size information, and the display screen size information is used to enable the electronic device to determine the display status of the vehicle-mounted terminal, and the display status is used to indicate horizontal screen display or vertical screen display.
  • the vehicle-mounted terminal when the processor reads computer-readable instructions from the memory, the vehicle-mounted terminal also performs the following operations: receiving a binding relationship sent by an electronic device, the binding relationship is used to indicate the first response of the vehicle-mounted terminal after detecting the user's operation on the first control displayed on the projection interface; the vehicle-mounted terminal information also includes the display screen control method and hardware information of the vehicle-mounted terminal, and the display screen control method and hardware information are used to enable the electronic device to generate a binding relationship.
  • the processor when the processor reads computer-readable instructions from the memory, it also enables the vehicle-mounted terminal to perform the following operations: in response to the user's screen projection operation, send a screen projection request to the electronic device.
  • an embodiment of the present application provides a screen projection display system, which includes an electronic device and a vehicle-mounted terminal.
  • the vehicle-mounted terminal is used to send a first information to the electronic device, and the first information includes vehicle-mounted terminal information.
  • the electronic device is used to receive a screen projection request.
  • the electronic device is also used to determine, in response to the screen projection request, the first interface information of the first application that the screen projection request indicates to be projected.
  • the electronic device is also used to determine the projection data based on the first interface information and the vehicle-mounted terminal information in the received first information.
  • the electronic device is also used to send the projection data to the vehicle-mounted terminal.
  • the vehicle-mounted terminal is also used to display the projection interface based on the received projection data.
  • the in-vehicle terminal information includes application layout information.
  • the application layout information includes desktop layout information of the vehicle-mounted terminal.
  • the vehicle terminal information also includes display screen size information.
  • the electronic device is also used to respond to the screen projection request and determine, based on the display screen size information, whether the display states of the electronic device and the vehicle terminal are the same or different, and the display state is used to indicate horizontal screen display or vertical screen display.
  • the electronic device when the display states of the electronic device and the vehicle-mounted terminal are different, the electronic device is further used to determine the first interface of the first application to be projected in response to the screen projection request. The electronic device is also used to divide the functional area of the first interface and determine the first interface information.
  • the electronic device is further used to re-layout the first display content corresponding to the divided functional area and the second display content corresponding to the application layout information according to the first interface information, the display screen size information, and the application layout information, and generate the second interface information.
  • the electronic device is also used to generate the projection data according to the second interface information.
  • the electronic device when the display status of the electronic device and the vehicle-mounted terminal are the same, the electronic device is also used to determine the first display area for projecting and displaying the first application based on the display screen size information and the application layout information, and the first display area is the display area other than the second display content corresponding to the application layout information.
  • the electronic device is also used to enlarge or reduce the first interface of the first application corresponding to the first interface information based on the first display area to generate third interface information.
  • the electronic device is also used to determine the projection data based on the third interface information and the application layout information.
  • an embodiment of the present application provides an electronic device having the function of implementing the screen projection display method described in the first aspect and any possible implementation thereof.
  • the function can be implemented by hardware, or by hardware executing corresponding software.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • an embodiment of the present application provides a vehicle-mounted terminal, which has the function of implementing the screen projection display method described in the second aspect and any possible implementation thereof.
  • the function can be implemented by hardware, or by hardware executing corresponding software.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • a computer-readable storage medium stores a computer program (also referred to as an instruction or code), and when the computer program is executed by an electronic device, the electronic device executes the method of the first aspect or any one of the implementations of the first aspect.
  • a computer program also referred to as an instruction or code
  • a computer-readable storage medium stores a computer program (also referred to as an instruction or code), and when the computer program is executed by a vehicle-mounted terminal, the vehicle-mounted terminal executes the method of the second aspect or any one of the implementations of the second aspect.
  • a computer program also referred to as an instruction or code
  • an embodiment of the present application provides a computer program product.
  • the computer program product When the computer program product is run on an electronic device, Enable the electronic device to execute the method of the first aspect or any one of the embodiments of the first aspect.
  • an embodiment of the present application provides a computer program product.
  • the computer program product When the computer program product is run on a vehicle-mounted terminal, the vehicle-mounted terminal executes the method of the second aspect or any one of the implementations of the second aspect.
  • an embodiment of the present application provides a circuit system, the circuit system includes a processing circuit, and the processing circuit is configured to execute the method of the first aspect or any one of the embodiments of the first aspect; or, the processing circuit is configured to execute the method of the second aspect or any one of the embodiments of the second aspect.
  • an embodiment of the present application provides a chip system, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to at least one processor, and when the at least one processor executes the instructions, the at least one processor executes the method of the first aspect or any one of the embodiments of the first aspect; or, the at least one processor executes the method of the second aspect or any one of the embodiments of the second aspect.
  • FIG1 is a schematic diagram of a communication system to which a screen projection display method is applied according to an embodiment of the present application
  • FIG2 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
  • FIG3A is a schematic diagram of an in-car scene provided in an embodiment of the present application.
  • FIG3B is a schematic diagram of a display screen of a vehicle terminal provided in an embodiment of the present application.
  • FIG4 is a schematic diagram of a flow chart of a screen projection display method provided in an embodiment of the present application.
  • FIG5 is a schematic diagram of a screen projection scenario provided in an embodiment of the present application.
  • FIG6 is a second schematic diagram of a screen projection scenario provided in an embodiment of the present application.
  • FIG. 7 is a second schematic flow chart of the screen projection display method provided in an embodiment of the present application.
  • FIG8 is a third schematic diagram of a screen projection scenario provided in an embodiment of the present application.
  • FIG9 is a fourth schematic diagram of a screen projection scenario provided in an embodiment of the present application.
  • FIG10 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
  • FIG. 11 is a schematic diagram of the structure of the vehicle-mounted terminal provided in an embodiment of the present application.
  • references to "one embodiment” or “some embodiments” etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements “in one embodiment”, “in some embodiments”, “in some other embodiments”, “in some other embodiments”, etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean “one or more but not all embodiments", unless otherwise specifically emphasized in other ways.
  • the terms “including”, “comprising”, “having” and their variations all mean “including but not limited to”, unless otherwise specifically emphasized in other ways.
  • connection includes direct connection and indirect connection, unless otherwise specified. "First” and “second” are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
  • words such as “exemplarily” or “for example” are used to indicate examples, illustrations or descriptions. Any embodiment or design described as “exemplary” or “for example” in the embodiments should not be interpreted as being more preferred or advantageous than other embodiments or designs. Specifically, the use of words such as “exemplary” or “for example” is intended to present the relevant concepts in a specific way.
  • electronic devices such as mobile phones, tablets, etc.
  • the mobile phone when a user is playing music on a mobile phone, he or she enters the car. In response to the user's operation, the mobile phone establishes a screen projection connection with the in-vehicle terminal, and the in-vehicle terminal can continue to play the music that the mobile phone has not finished playing.
  • the vehicle-mounted terminal receives the projection data sent by the mobile phone and displays the projected video based on the projection data, so that users can get a better video playback experience on the vehicle-mounted terminal.
  • a screen projection connection is established between the electronic device and the vehicle-mounted terminal.
  • the vehicle-mounted terminal can receive the screen projection data sent by the electronic device through the screen projection connection, and the screen projection data is the data of the application in the electronic device.
  • the vehicle-mounted terminal displays the corresponding application interface based on the screen projection data.
  • the screen projection process includes, for example, push screen projection and mirror screen projection.
  • the display content of the vehicle-mounted terminal and the electronic device may not be synchronized.
  • the mirror screen projection process the display content of the vehicle-mounted terminal and the electronic device is synchronized.
  • the application list information of the electronic device can be obtained. Then, the vehicle terminal can display the corresponding application icon according to the application list information. In response to the user's operation on the application icon, the vehicle terminal can request the electronic device to obtain the application data corresponding to the application icon. Then, the vehicle terminal displays the corresponding application interface according to the obtained application data.
  • the developer can create a display template based on a preset display template (such as Functions, etc.), develop application types adapted to different vehicle terminals according to the needs of different vehicle terminals, such as display screen size, system requirements, etc. In this way, subsequent users can project application content to the vehicle terminal display through electronic devices.
  • a preset display template such as Functions, etc.
  • in-vehicle terminals there are many types of in-vehicle terminals at present. During the development process of the same application, it is necessary to develop multiple types of applications to adapt to different types of in-vehicle terminals, which makes application development difficult. As a result, the number of screen-casting applications is limited, and the in-vehicle terminal application ecosystem is not perfect, which cannot meet the user's demand for in-vehicle terminals.
  • the embodiment of the present application provides a screen projection display method, during the screen projection process, the electronic device can adaptively adjust the application screen projection content according to the display information of the vehicle terminal, such as the size of the vehicle terminal display screen, the desktop display content, etc., to achieve screen projection.
  • the electronic device application has better universality, while ensuring the screen projection effect, reducing the difficulty of application development.
  • Fig. 1 is a schematic diagram of a communication system for the screen projection display method provided in an embodiment of the present application. As shown in Fig. 1, the communication system includes an electronic device 100 and a vehicle terminal 200.
  • the electronic device 100 may be, for example, a mobile phone, a tablet computer, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a wearable device, an artificial intelligence (AI) device, or other terminal device with a screen projection function.
  • the operating system installed in the electronic device 100 includes but is not limited to: Or other operating systems. This application does not limit the specific type of the electronic device 100 or the installed operating system.
  • the vehicle-mounted terminal 200 may be a vehicle, automobile, vehicle computer, or other terminal.
  • the operating system installed in the vehicle-mounted terminal 200 includes but is not limited to Or other operating systems.
  • the vehicle terminal 200 may not be installed with an operating system. This application does not limit the specific type of the vehicle terminal 200, whether an operating system is installed, and the installed operating system.
  • a communication connection is established between the electronic device 100 and the vehicle terminal 200, and the communication connection can be a wired connection or a wireless communication connection.
  • the electronic device and the vehicle terminal 200 can establish a wired connection through a universal serial bus (USB) interface.
  • the wireless communication technology for establishing a wireless communication connection includes but is not limited to at least one of the following: Bluetooth (BT) (for example, traditional Bluetooth or low energy (BLE) Bluetooth), wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), near field communication (NFC), Zigbee, frequency modulation (FM), infrared (IR), ultra-wideband (UWB), etc.
  • screen projection data can be transmitted through the communication connection to achieve screen projection.
  • FIG. 2 is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application.
  • the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
  • a processor 110 an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM)
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently.
  • the components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc.
  • AP application processor
  • GPU graphics processor
  • ISP image signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • Different processing units may be independent devices or integrated in one or more processors.
  • the controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
  • the processor 110 may include one or more interfaces.
  • the interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.
  • I2C inter-integrated circuit
  • I2S inter-integrated circuit sound
  • PCM pulse code modulation
  • UART universal asynchronous receiver/transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).
  • the processor 110 may include multiple groups of I2C buses.
  • the processor 110 may be coupled to the touch sensor, the charger, the flash, the camera 193, etc. through different I2C bus interfaces.
  • the processor 110 may be coupled to the touch sensor through the I2C interface, so that the processor 110 communicates with the touch sensor through the I2C bus interface to realize the touch function of the electronic device 100.
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193.
  • the MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc.
  • the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100.
  • the processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.
  • the USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones.
  • the interface can also be used to connect other electronic devices, such as AR devices, etc.
  • the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100.
  • the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the charging management module 140 is used to receive charging input from a charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 can receive charging input from a wired charger through the USB interface 130.
  • the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it can also charge the battery 142 through the power management module 130.
  • Block 141 provides power to the electronic device.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc.
  • the power management module 141 can also be set in the processor 110.
  • the power management module 141 and the charging management module 140 can also be set in the same device.
  • the wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas.
  • antenna 1 can be reused as a diversity antenna for a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G, etc., applied to the electronic device 100.
  • the mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc.
  • the mobile communication module 150 may receive electromagnetic waves from the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 may also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.
  • at least some of the functional modules of the mobile communication module 150 may be arranged in the processor 110.
  • at least some of the functional modules of the mobile communication module 150 may be arranged in the same device as at least some of the modules of the processor 110.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the application processor outputs a sound signal through an audio device, or displays an image or video through a display screen 194.
  • the modem processor may be an independent device.
  • the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like applied to the electronic device 100.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared
  • the wireless communication module 160 can be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the processor 110.
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna 2.
  • the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technology.
  • the GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and/or a satellite based augmentation system (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation system
  • the electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor.
  • the GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, etc.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display.
  • the display 194 may be a liquid crystal display (LCD), for example, an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini-LED, a Micro-LED, a Micro-oled, a quantum dot light-emitting diode (QLED), etc.
  • the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and projects it onto the photosensitive element.
  • the photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor.
  • CMOS complementary metal oxide semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • the DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format.
  • the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
  • the internal memory 121 can be used to store computer executable program codes, which include instructions.
  • the internal memory 121 may include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.
  • the data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 170 can also be used to encode and decode audio signals.
  • the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
  • the electronic device 100 can use the audio module 170, such as music playing, recording, etc.
  • the audio module 170 can include a speaker, a receiver, a microphone, a headphone interface, and an application processor to implement audio functions.
  • the sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
  • a touch sensor is also called a "touch control device”.
  • the touch sensor can be arranged on the display screen 194.
  • the touch sensor and the display screen 194 form a touch screen, also called a "touch control screen”.
  • the touch sensor is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor can also be arranged on the surface of the electronic device 100, which is different from the position of the display screen 194.
  • the key 190 includes a power key, a volume key, etc.
  • the key 190 may be a mechanical key or a touch key.
  • the electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.
  • Motor 191 can generate vibration prompts.
  • Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations acting on different applications can correspond to different vibration feedback effects.
  • touch operations acting on different areas of the display screen 194 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminders, receiving messages, alarm clocks, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.
  • the SIM card interface 195 is used to connect a SIM card.
  • the SIM card can be connected to or disconnected from the electronic device 100 by inserting or removing the SIM card interface 195.
  • the electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the electronic device 100 can communicate with the vehicle terminal 200 through the wireless communication module 160 or the USB interface 130. Establish a communication connection. After that, the electronic device 100 can obtain the display screen size information of the vehicle terminal 200. The processor 110 of the electronic device 100 can adaptively adjust the display of the screen interface to be projected according to the display screen size information of the vehicle terminal 200, determine the projection data, and send the projection data to the vehicle terminal 200 through the wireless communication module 160. After receiving the projection data, the vehicle terminal 200 can also display the corresponding application interface on the display screen according to the projection data.
  • the electronic device 100 and the vehicle terminal 200 in the embodiment of the present application can be implemented by different devices, and the different devices can have the same, similar or somewhat different hardware structures.
  • the vehicle terminal can also have the hardware structure shown in FIG.
  • vehicle terminal 200 may include more or fewer components than the hardware structure shown in Figure 2, or combine some components, or split some components, or arrange the components differently.
  • the hardware structure of the vehicle terminal may not include the mobile communication module 150, etc.
  • the vehicle terminal 200 may be configured with one or more display screens. As shown in FIG3A , the vehicle terminal 200 includes a central control screen 21, a display screen 22 in front of the driver, a display screen 23 in front of the co-pilot seat, or may also include a display screen in front of the rear passenger seat, etc.
  • the different display screens of the vehicle-mounted terminal 200 may be touch screens or non-touch screens.
  • the touch screen may receive a user's touch operation on the display screen.
  • the touch screen and non-touch screen may also receive a user's operation on a button in the vehicle-mounted terminal.
  • the steering wheel 23 of the vehicle terminal 200 is provided with a square control key 231, and the user can control the display of the display screen of the vehicle terminal 200 through the square control key 231.
  • the display screen can display the corresponding interface.
  • the display screen 24 is a non-touch screen.
  • the user can control the display on the display screen 24 through the knob 241 and the button 242 .
  • the electronic device 100 can obtain information such as the size of the display screen of the vehicle terminal 200 to be projected, whether it is a touch screen, button or knob control, etc.
  • the following takes the electronic device 100 as an electronic device and the vehicle-mounted terminal 200 as a vehicle-mounted terminal as an example to introduce the screen projection display method provided in the embodiment of the present application in detail.
  • Fig. 4 is a flow chart of a screen projection display method provided in an embodiment of the present application. As shown in Fig. 4, the method includes the following steps.
  • S401 The electronic device and the vehicle-mounted terminal establish a communication connection.
  • the communication connection may be a wired connection or a wireless connection, and the communication connection may be used for screen projection.
  • the electronic device and the vehicle-mounted terminal are configured with a screen projection function, and the screen projection function is turned on to allow screen projection.
  • electronic devices and vehicle-mounted terminals establish screen projection connections through Bluetooth, vehicle-mounted Wi-Fi networks, USB connections, etc.
  • the vehicle-mounted terminal sends vehicle-mounted terminal information to the electronic device.
  • the vehicle-mounted terminal information includes, for example, one or more of the display screen size information, display screen control method, application layout information, application information, and hardware information of the vehicle-mounted terminal.
  • the display screen size information is used to indicate the size of the display area corresponding to the display screen of the vehicle terminal, such as length, width and other information, wherein the display area is used for the display of the vehicle terminal.
  • the control method of the display screen is used to indicate whether the display screen is a touch screen or a non-touch screen, a button or a knob control information, etc.
  • the application layout information is used to indicate the display of the vehicle terminal display screen.
  • the vehicle terminal displays the desktop, and the display content on the desktop includes the function icons of the vehicle terminal (such as seat adjustment map icons, air conditioning control icons, etc.), and may also include icons of vehicle terminal applications.
  • the application layout information may include desktop layout information, such as information including multiple icons displayed, icon location information, etc.
  • the vehicle terminal displays the application interface
  • the application layout information includes the layout information of the displayed application interface.
  • the application layout information is used for subsequent electronic devices to re-layout the interface display content of the application to be projected and the display content of the vehicle terminal.
  • the application information is used to indicate the information of the applications installed in the vehicle terminal, such as application usage information, etc., and the subsequent electronic devices can determine the commonly used applications of the vehicle terminal based on the application usage information.
  • Hardware information for example, includes information on hardware devices such as microphones (mic), speakers, loudspeakers, cameras, etc. installed in the vehicle terminal.
  • the electronic device 100 and the vehicle terminal 200 establish a communication connection.
  • some icons are displayed on the desktop of the vehicle terminal display screen, and the application layout information includes the display information of these icons.
  • the icons may include icons that are fixedly displayed on the desktop, such as navigation icons, seat adjustment icons, air conditioning control icons and other functional icons.
  • the icons may also include icons of commonly used applications of the vehicle terminal.
  • the icons that are fixedly displayed on the desktop are used to indicate that these icons need to be displayed on the desktop to facilitate users to use the car.
  • the icon can be moved according to the user's operation or according to the projection data.
  • the vehicle terminal information may correspond to the display screen to be projected, or to all the display screens of the vehicle terminal. Subsequently, before projecting the screen, the electronic device may first determine the vehicle terminal information corresponding to the display screen to be projected, so as to generate corresponding projection data and realize the projection.
  • the determined vehicle-mounted terminal information may be sent to the electronic device.
  • the electronic device receives the vehicle-mounted terminal information sent by the vehicle-mounted terminal.
  • step S402 is an optional step. After the electronic device establishes a communication connection with the vehicle terminal for the first time and obtains the vehicle terminal information, the vehicle terminal information can be saved. After that, after the electronic device establishes a communication connection with the vehicle terminal and determines that screen projection is required, the corresponding screen projection data can be directly determined based on the saved vehicle terminal information without having to obtain the vehicle terminal information again.
  • the vehicle terminal information may change. After the vehicle terminal establishes a communication connection with the electronic device, the vehicle terminal may send the updated vehicle terminal information to the electronic device.
  • the vehicle terminal information includes the application layout information of the vehicle terminal.
  • the application layout information changes, such as adding an icon of a newly downloaded application. Then, the vehicle terminal may update the vehicle terminal information and send the updated vehicle terminal information to the electronic device.
  • S403 The electronic device receives a screen projection request.
  • the screen projection request may be a screen projection request determined by the electronic device after receiving the screen projection operation of the user.
  • the screen projection request may also be a screen projection request sent by the vehicle-mounted terminal and received by the electronic device.
  • the electronic device detects a screen projection operation, or receives a screen projection request sent by the vehicle terminal, and determines that the application needs to be projected to the vehicle terminal for display.
  • the electronic device has the application to be projected installed, and the vehicle terminal may or may not have the application to be projected installed.
  • the application to be projected is the first application installed in the electronic device, and the interface of the first application to be projected is the first interface of the first application.
  • the electronic device when it is displaying the application interface of the first application, if it detects that the user clicks the screen projection control, it can determine that the user instructs to project the currently displayed application interface to the vehicle terminal for display. Before the application is projected, the vehicle terminal displays the desktop or other applications, which are vehicle terminal applications or projection applications.
  • the vehicle terminal can obtain information about applications installed in the electronic device, and display the corresponding application icon based on the information.
  • the vehicle terminal can send a screen projection request to the electronic device to request the electronic device to project the first application corresponding to the application icon, and then determine that the first application needs to be projected and displayed on the vehicle terminal.
  • the first application is, for example, a video application, a music application, a navigation application, or the like.
  • step S403 is an optional step. After the electronic device and the vehicle terminal establish a communication connection, the electronic device is directly triggered to project the screen to the vehicle terminal, that is, the following step S404 is triggered. If the electronic device determines that a communication connection is established with the vehicle terminal, the running application can be directly projected to the vehicle terminal for display.
  • the present application does not limit the execution order of step S402 and step S403.
  • the electronic device may request the vehicle terminal to obtain the vehicle terminal information, that is, first execute step S403 and then execute step S402.
  • S404 The electronic device determines the projection data according to the vehicle terminal information and the application interface information.
  • the electronic device can determine the corresponding projection data based on the vehicle-mounted terminal information and the application interface information of the application to be projected.
  • the size, aspect ratio, and resolution of the electronic device and the vehicle terminal display screen are not uniform, so during the screen projection process, the electronic device needs to re-determine the projection data that matches the vehicle terminal display screen.
  • the electronic device can adjust the display size of the application interface to be projected based on the display size information of the vehicle terminal included in the vehicle terminal information to determine the corresponding projection data.
  • the display screen of the vehicle terminal can be horizontal or vertical.
  • the long side of the display screen of the vehicle terminal 200 is the bottom side, and the short side is the side side, and the display screen of the vehicle terminal 200 is displayed in horizontal mode.
  • the long side of the display screen of the vehicle terminal 200 is the side side, and the short side is the bottom side, and the display screen of the vehicle terminal 200 is displayed in vertical mode.
  • the display screen of the electronic device can also be divided into horizontal and vertical screens. If the display screen of the electronic device and the display screen of the vehicle terminal are both horizontal or both vertical, then the electronic device can directly scale the application display interface to meet the display requirements of the display screen of the vehicle terminal.
  • the display screen of the electronic device is vertical and the display screen of the vehicle terminal is horizontal, or the display screen of the electronic device is horizontal and the display screen of the vehicle terminal is vertical. Then, the electronic device The display content on the application interface needs to be rearranged to achieve better display effects on the vehicle terminal display screen.
  • the electronic device when determining the projection data, the electronic device needs to determine whether it is necessary to rearrange the application interface display content.
  • step S404 may include steps S701 to S705 .
  • step S701 The electronic device determines that the display states of the electronic device and the vehicle-mounted terminal are different. If yes, execute step S702; if not, execute step S705.
  • the electronic device can determine whether the electronic device and the vehicle-mounted terminal are in the same display state by the aspect ratio of the display screen (i.e., the ratio of the bottom edge to the side edge length), and the display state includes horizontal screen display and vertical screen display.
  • the aspect ratio of the display screen i.e., the ratio of the bottom edge to the side edge length
  • the electronic device determines the aspect ratio of the electronic device display screen, and determines the aspect ratio of the vehicle terminal display screen based on the acquired vehicle terminal information. Afterwards, the electronic device determines the absolute value of the difference between the two aspect ratios. If the absolute value of the difference is less than or equal to a preset threshold, then the electronic device can determine that the electronic device and the vehicle terminal are in the same display state, such as both are displayed in horizontal screens, or both are displayed in vertical screens. If the absolute value of the difference is greater than the preset threshold, then the electronic device can determine that the electronic device and the vehicle terminal are not in the same display state.
  • the display screen of the vehicle terminal can be rotated to switch between horizontal and vertical display. Then, in the process of determining the projection data, the electronic device needs to determine whether the current display state of the vehicle terminal is horizontal or vertical display. Afterwards, the electronic device can determine whether the display state of the electronic device is the same as the current display state of the vehicle terminal.
  • the horizontal dimension and the vertical dimension indicated in the display screen size information sent by the vehicle terminal correspond to the horizontal dimension and the vertical dimension of the vehicle terminal in the current display state.
  • the vehicle terminal switches the original horizontal dimension and the original vertical dimension, determines the new horizontal dimension (ie, the original vertical dimension) and the vertical dimension (ie, the original horizontal dimension) to generate new display screen size information and send it to the electronic device.
  • the electronic device can also switch the display state by rotating the display screen. Then, when the electronic device starts the application to determine the projection data, it needs to determine whether the current display state of the electronic device is horizontal or vertical display. Similarly, the electronic device determines the horizontal and vertical dimensions of the display area during the current display process to determine the aspect ratio. Afterwards, the electronic device can determine whether the display state of the electronic device is the same as the current display state of the vehicle-mounted terminal. Alternatively, the electronic device determines whether the display state of the corresponding electronic device is horizontal or vertical display based on the application background data. Afterwards, the electronic device can determine whether the display state of the electronic device is the same as the current display state of the vehicle-mounted terminal.
  • the display screen size information in the vehicle-mounted terminal information includes information for indicating the display state of the vehicle-mounted terminal. Then, after acquiring the vehicle-mounted terminal information, the electronic device can directly determine the display state of the vehicle-mounted terminal. Afterwards, the electronic device can determine the display state of the electronic device according to the display screen size of the electronic device. Afterwards, the electronic device can determine whether the display state of the electronic device is the same as the display state of the vehicle-mounted terminal.
  • the electronic device determines that the display states of the electronic device and the vehicle terminal are different, and can re-layout the application interface display content according to the vehicle terminal information, and generate corresponding projection data, that is, execute the following steps S702-S704.
  • the electronic device determines that the display states of the electronic device and the vehicle terminal are the same, and can scale the application interface display content according to the vehicle terminal information, and generate corresponding projection data, that is, execute the following step S705.
  • S702 The electronic device obtains application interface information.
  • the electronic device can obtain interface information of the application's screen projection interface, such as layout data and control data, through control tree recognition or AI recognition.
  • the control data includes the position, size, color and other data of the control.
  • the electronic device draws the control according to the control data to display the control visible to the user.
  • the layout data is used to represent the layout format and layout strategy.
  • the layout data includes the control data of multiple controls and the layout information of the control data.
  • the electronic device can obtain a description file (such as an XML file, etc.) of the current screen to be projected, or a screenshot of the screen. Afterwards, the electronic device can identify controls such as text, images, and icons on the screen to be projected based on the description file or the screenshot, through control tree recognition or AI recognition, etc., and the control can be used as a human-computer interaction interface to receive user operations on the application.
  • a description file such as an XML file, etc.
  • controls such as text, images, and icons on the screen to be projected based on the description file or the screenshot, through control tree recognition or AI recognition, etc.
  • the electronic device can also structurally divide the layout of the screen to be projected. For example, the electronic device divides the functional areas on the screen to be projected, and divides each functional area into a waterfall structure.
  • the identification process of the functional area includes, for example, identifying the tabulator (TAB) page, search bar, banner page, grid bar, title bar, player, etc. included in the screen to be projected.
  • TAB tabulator
  • the electronic device 100 (such as a mobile phone) is in a vertical display mode, and the vehicle-mounted terminal 200 is in a horizontal display mode.
  • the electronic device 100 determines the application interface information of the application to be projected.
  • the functional area includes a top tab page 52, a search bar 53, a banner page 54, a grid bar 55, a grid bar 56, and a bottom function tab page 57.
  • Different functional areas may include one or more controls.
  • the interface shown in Figure 5 is used to illustrate the application interface information of the application to be projected.
  • the electronic device does not need to display the application interface, and the electronic device can determine the projection data in the application background.
  • the electronic device can display or not display the application.
  • the advertising information can be displayed floating on the application interface or embedded in the application interface.
  • the display position of the advertising information may cause abnormal recognition of control data and layout data, resulting in abnormal final projection display.
  • the electronic device removes non-essential information from the control tree and resource files during the process of obtaining the application interface information. If the application interface information finally obtained by the electronic device does not include non-essential information, then the corresponding subsequent application interface displayed on the vehicle terminal will not include non-essential information.
  • the electronic device rearranges the application interface according to the vehicle terminal information and the application interface information.
  • the electronic device after the electronic device obtains the application interface information, it can rearrange the application interface according to the vehicle terminal information.
  • the electronic device can divide the adaptation interface placement area and the vehicle-mounted application function placement area on the screen to be projected according to the vehicle-mounted terminal information (such as display screen size information) and the application interface information of the electronic device.
  • the adaptation interface placement area is used to display the application interface of the projection screen
  • the vehicle-mounted application function placement area is used to display the icons that the vehicle-mounted terminal needs to display on the desktop first.
  • the screen to be projected may also only include the adaptation interface placement area, and the subsequent vehicle-mounted terminal can display the projected application interface in full screen.
  • the vehicle-mounted application function placement area can be displayed in a floating manner on the adaptation interface placement area, such as the icon of the vehicle-mounted terminal can be displayed in a floating manner on the projection application interface.
  • the electronic device matches the display area required to be occupied by the application interface corresponding to the display application interface information on the vehicle terminal display screen according to the application interface information, divides the display area into the video interface placement area, and then divides the remaining display area into the vehicle-mounted application function placement area.
  • the electronic device 100 determines that the icons that need to be displayed on the desktop of the vehicle terminal include the fixed icons in the dotted box shown by the reference numeral 51, based on the application layout information in the vehicle terminal information of the vehicle terminal 200.
  • the electronic device can determine whether it is necessary to adjust the display area of these fixed icons based on the acquired application interface information and display screen size information. If no adjustment is required, as shown in Figure 5, the electronic device determines that the interface to be projected includes an adaptation interface placement area 58 and a vehicle application function placement area 51. If adjustment is required, the electronic device can adjust the display position of the fixed icons of the vehicle terminal to achieve a better application projection effect.
  • the electronic device determines the commonly used applications of the vehicle terminal based on the application information in the vehicle terminal information, and can display the icons of the commonly used applications on the desktop first.
  • the vehicle terminal can determine the fixed icons to be displayed based on the application layout information in the vehicle terminal information.
  • the electronic device can divide the display area according to the commonly used application icons, fixed icons, display screen size information, and application interface information, determine the adaptation interface placement area and the vehicle application function placement area, and re-layout the application interface.
  • a partition template of the screen to be projected of the vehicle terminal is pre-configured, and the fixed icons to be displayed on the vehicle terminal and the content of the screen to be projected are mixed and arranged to optimize, so as to determine the placement area of the adaptation interface and the placement area of the vehicle application function.
  • different numbers of fixed icons can correspond to different templates, so that the fixed icons can be displayed in the edge display area of the vehicle terminal, such as distributed display on both sides of the display screen, or distributed display on one side of the display, to ensure the application projection effect.
  • the vehicle terminal may display the desktop or application. Then, if the vehicle terminal displays the application, the application layout information in the vehicle terminal information includes the display information of the application. Then, when the electronic device is re-layouting the application interface according to the vehicle terminal information and the application interface information, the divided adaptation interface placement area is used to display the projection application interface, and the vehicle application function placement area is used to display the display content of the application displayed by the vehicle terminal before this projection. That is, the electronic device re-layouts the display content of the two applications, the projection application and the original display application of the vehicle terminal, to achieve the subsequent determination of the projection data.
  • different functional areas of the application interface are configured with different adaptation templates.
  • the electronic device rearranges the controls and layout according to the determined adaptation interface placement area, the information of the functional area in the application interface information, and the adaptation template.
  • the re-layout interface information includes new control data and layout data.
  • the new interface data and layout data can be saved and transmitted in a corresponding file format, such as a re-layout interface partition file and an adaptive adaptation layout description file.
  • the re-layout interface partition file includes, for example, adjusted functional area information, such as location coordinate information, etc.
  • the adaptive adaptation layout description file includes resource information of the functional area, such as control data and other information used for subsequent interface rendering.
  • the display state of the electronic device 100 is a vertical screen display
  • the display state of the vehicle-mounted terminal 200 is a horizontal screen display.
  • the top label tab bar 52 of the electronic device 100 it is necessary to rearrange the text of the label tab bar 52 according to the horizontal screen design concept of the display screen of the vehicle-mounted terminal 200, and wrap the line after the determined control data and layout data meet the width constraint.
  • the banner page 54 of the electronic device 100 it is adapted to a wider horizontal screen display, and the determined control data and layout data can display the banner page hidden on the electronic device 100 side.
  • the electronic device when the electronic device is playing a video in a video application, in response to the user's instruction to cast the screen, it determines that a screen casting request has been received. In addition, the electronic device determines that the display state of the electronic device is portrait display, and the display state of the vehicle terminal is landscape display. Then, in the process of re-layouting the application interface, the electronic device may determine that some playback control controls in the video application are not displayed due to the size of the electronic device's display screen, and the application interface information after re-layout may include information about these playback control controls. The vehicle terminal may then display these playback control controls. That is, the content of the screen casting application displayed by the vehicle terminal may be different from the content of the screen casting application displayed by the electronic device.
  • the electronic device generates screen projection data according to the rearranged application interface information.
  • the electronic device after the electronic device re-layouts the application interface and determines the application interface information after the re-layout, it can draw and render the corresponding control data and layout data according to the re-layout interface partition file and the adaptive adaptation layout description file to generate projection data, which is used for the subsequent vehicle-mounted terminal to display the projection interface.
  • the electronic device can adaptively adjust the display of the application interface to be projected based on the vehicle terminal information and the identified display information of the application interface to be projected, so as to improve the application projection display effect and enhance the user experience.
  • the electronic device matches the application interface to the display area size and generates corresponding screen projection data.
  • the electronic device determines that the display status of the electronic device and the vehicle-mounted terminal is the same. Then, the electronic device can directly divide the adaptation interface placement area and the vehicle-mounted application function placement area according to the display screen size information, application layout information and other information of the vehicle-mounted terminal in the vehicle-mounted terminal information. Afterwards, the electronic device scales the size of the interface to be projected according to the size information of the adaptation interface placement area so that the application interface matches the size of the adaptation interface placement area (ie, the display area). The electronic device draws and renders the corresponding interface based on the scaled projection interface information to generate projection data.
  • the electronic device can realize screen projection by determining that only the screen to be projected needs to be scaled. Then, the electronic device can divide the area of the original vehicle terminal used to display fixed icons into the vehicle application function placement area, and the area outside the area used to display fixed icons is the adaptation interface placement area.
  • the electronic device 100 determines that the display states of the electronic device 100 and the vehicle-mounted terminal 200 are both displayed in portrait mode. Based on the acquired vehicle-mounted terminal information, the electronic device 100 can determine that the display area of the display screen of the vehicle-mounted terminal 200 includes an adaptation interface placement area 62 and a vehicle-mounted application function placement area 61. Afterwards, the electronic device 100 can adaptively scale the application interface to be projected based on the size information of the adaptation interface placement area 62.
  • the electronic device can adjust the display position of the area used by the original vehicle terminal to display fixed icons, and divide the adjusted display position into the vehicle application function placement area.
  • the area outside the area used to display fixed icons is the adaptation interface placement area.
  • the electronic device since the electronic device does not recognize the controls in the interface to be projected and does not perform layout division, the electronic device will not perform mixed arrangement optimization on the fixed icons and the controls in the interface to be projected.
  • the vehicle application function placement area can be divided above or below, to the left or to the right of the adaptation interface placement area to meet display requirements.
  • the electronic device first determines the display status of the electronic device and the vehicle-mounted terminal.
  • the projection data can be directly determined by scaling the application interface to be projected, thereby effectively improving the projection efficiency under the same display status.
  • Step S702 That is, after determining that screen projection is required, the electronic device directly generates corresponding screen projection data according to the method for determining screen projection data when the display states of the electronic device and the vehicle-mounted terminal are different (such as steps S701 to S704).
  • the electronic device can adaptively adjust the display of the application interface to be projected based on the vehicle terminal information and the identified display information of the application interface to be projected, so as to improve the application projection display effect and enhance the user experience.
  • the electronic device can determine the projection data, and then through the following steps, the electronic device can instruct the vehicle terminal to display the projection interface according to the projection data.
  • the electronic device sends the screen projection data to the vehicle-mounted terminal.
  • the electronic device may send the projection data to the vehicle-mounted terminal.
  • the vehicle-mounted terminal receives the projection data sent by the electronic device.
  • the vehicle-mounted terminal displays the screen projection interface according to the screen projection data.
  • the vehicle-mounted terminal after receiving the projection data, can display the corresponding application projection interface according to the projection data.
  • the vehicle terminal 200 may display the interface shown in FIG8 after receiving the projection data.
  • the display content of the projection application interface displayed by the vehicle terminal 200 is different from the display content of the electronic device 100.
  • the display content indicated by reference numeral 81 is more compatible with the large-screen display of the vehicle terminal 200 display screen, and the display content is richer, which effectively improves the projection display effect.
  • the vehicle terminal 200 displays the fixed icon of the vehicle terminal at the lower edge display position of the display screen.
  • the electronic device 100 adaptively adjusts the position of the vehicle application function placement area for displaying fixed icons, such as displaying the fixed icons at the left edge display position and the lower edge display position of the display screen, respectively, to ensure the application screen projection effect in the adaptation interface placement area.
  • the vehicle-mounted terminal 200 may display the interface shown in Figure 9 after receiving the projection data.
  • the electronic device 100 has determined the adaptation interface placement area 62 and the vehicle-mounted application function placement area 61, and generated corresponding projection data.
  • the vehicle-mounted terminal 200 displays the application projection interface in the corresponding adaptation interface placement area.
  • the vehicle-mounted terminal 200 still displays the fixed icon at the display position on the left edge of the display screen, and displays the enlarged application interface at the display position on the right side of the display screen.
  • the electronic device can adaptively adjust the display of the application interface to be projected according to the vehicle terminal information to match the vehicle terminal display screen and improve the application projection display effect.
  • the electronic device can adaptively adjust the interface information of the screen projection application according to the content (such as icons, etc.) that the vehicle terminal needs to display fixedly, thereby ensuring that during the screen projection process, the vehicle terminal can still display the fixed content to meet the user's functional usage needs.
  • the content such as icons, etc.
  • the projection data may also include audio data and other data, so that the vehicle-mounted terminal can play corresponding audio while displaying the application projection interface.
  • the audio played by the music application in the electronic device is the local audio data of the electronic device.
  • the electronic device may also include audio data in the screen projection data sent to the vehicle terminal to ensure that the vehicle terminal can play the corresponding audio when displaying the screen projection interface of the music application.
  • the vehicle terminal may receive user operations on the projection application during the process of displaying the application projection interface. Therefore, the electronic device can bind the operation response mode of the control corresponding to the operation event on the electronic device interface with the operation event on the vehicle terminal to generate a binding relationship. In this way, the vehicle terminal can support interactive operations on the content displayed on the display screen, and after receiving the user's operation on the content displayed on the display screen, the corresponding operation response can be triggered.
  • the vehicle terminal encapsulates information such as the position information of the control operated by the user into an operation event and sends it to the electronic device to determine the operation to be performed. And/or, the vehicle terminal directly determines the operation response of the control to be performed based on the binding relationship.
  • the vehicle terminal may generate a corresponding operation event, which may include information such as the position information of the control operated by the user.
  • the vehicle terminal may send the operation event to the electronic device.
  • the electronic device determines the operation response mode of the control corresponding to the operation event based on the received operation event and the pre-generated binding relationship, so as to execute or instruct the vehicle terminal to execute the corresponding operation.
  • the electronic device sends the binding relationship to the vehicle-mounted terminal.
  • the vehicle-mounted terminal can determine the control operated by the user according to the binding relationship.
  • the display screen of the vehicle terminal is a touch screen.
  • the electronic device can bind the controls on the application interface with the corresponding functions to generate a binding relationship.
  • the display screen of the vehicle terminal is a non-touch screen, or the display screen of the vehicle terminal can be controlled by a button or a knob.
  • the electronic device can bind the virtual selection of the button or knob with the control selection on the application interface to generate a binding relationship.
  • the electronic device determines that the display screen of the vehicle terminal is a non-touch screen and supports knob control according to the vehicle terminal information obtained through the above step S402. Then, after the electronic device determines the projection data through the above step S704 or step S705, it can divide the application interface, number the controls therein according to the matrix grid, match the rotation of the knob to the forward, backward, selection and other operations, and correspond to the controls with the corresponding numbers to generate a binding relationship.
  • the vehicle terminal information obtained by the electronic device also includes the hardware information of the vehicle terminal.
  • the electronic device can virtualize the hardware resources of the vehicle terminal on the electronic device side, so that in the process of determining the binding relationship, the response mode of the control can also be adjusted to correspond to the corresponding virtual hardware resources, which is used to indicate the hardware operation of the vehicle terminal, such as turning on the speaker and camera of the vehicle terminal.
  • the display content of the projected application interface is bound to the corresponding operation response, while ensuring the display effect, the interactive function of the application interface is retained to ensure the user experience.
  • an application for screen projection and display of an electronic device may or may not be installed in the vehicle terminal. Then, in the case where the vehicle terminal is installed with an application for screen projection and display of an electronic device, the vehicle terminal may determine whether the display frame rate meets the frame rate threshold requirement when the application is started and displayed through the chip of the vehicle terminal in the process of displaying the application interface according to the received screen projection data. If satisfied, the vehicle terminal can start the application and instruct the electronic device not to project and display the application, that is, switch the application to the vehicle terminal, thereby improving the application operation efficiency. If not satisfied, the vehicle terminal can continue to display the screen projection application according to the received screen projection data, so that the screen projection application runs on the electronic device.
  • the electronic device may also determine the electronic device function icon to be displayed on the vehicle terminal during the process of generating the projection data. Afterwards, the projection data sent by the electronic device to the vehicle terminal includes the electronic device function icon. Subsequently, the vehicle terminal includes the electronic device function icon in the projection interface displayed according to the projection data, and the user can control the electronic device through the electronic device function icon on the vehicle terminal.
  • the vehicle terminal when it detects the user's operation on the electronic device function icon during the display of the projection interface, it can send an indication message to the electronic device, and the indication message can carry information about the electronic device function icon operated by the user. Afterwards, the electronic device can execute the function corresponding to the electronic device function icon operated by the user according to the indication message.
  • Figure 10 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
  • the electronic device 1000 may include: a transceiver unit 1001 and a processing unit 1002.
  • the electronic device 1000 may be used to implement the functions of the electronic device involved in the above method embodiment.
  • the transceiver unit 1001 is used to support the electronic device 1000 to execute S401, S402 and S405 in FIG. 4 .
  • the processing unit 1002 is used to support the electronic device 1000 to execute S403 and S404 in Figure 4; and/or to support the electronic device 1000 to execute S701-S705 in Figure 7.
  • the transceiver unit may include a receiving unit and a sending unit, which may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module.
  • the operations and/or functions of each unit in the electronic device 1000 are respectively to implement the corresponding process of the projection display method described in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit. For the sake of brevity, it will not be repeated here.
  • the electronic device 1000 shown in FIG10 may further include a storage unit (not shown in FIG10 ), in which a program or instruction is stored.
  • a storage unit not shown in FIG10
  • the electronic device 1000 shown in FIG10 may execute the screen projection display method described in the above method embodiment.
  • the technical effects of the electronic device 1000 shown in FIG. 10 may refer to the technical effects of the screen projection display method described in the above method embodiment, and will not be repeated here.
  • the technical solution provided by the present application may also be a functional unit or chip in the electronic device, or a device used in conjunction with the electronic device.
  • FIG11 is a schematic diagram of the structure of the vehicle terminal provided in an embodiment of the present application.
  • the vehicle terminal 1100 may include: a transceiver unit 1101, a processing unit 1102, and a display unit 1103.
  • the vehicle terminal 1100 may be used to implement the functions of the vehicle terminal involved in the above method embodiment.
  • the transceiver unit 1101 is used to support the vehicle terminal 1100 to execute S401, S402 and S405 in Figure 4.
  • processing unit 1102 is used to support the vehicle terminal 1100 to execute S406 in Figure 4.
  • the display unit 1103 is used to support the vehicle-mounted terminal 1100 to execute S406 in FIG. 4 .
  • the transceiver unit may include a receiving unit and a sending unit, which may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module.
  • the operations and/or functions of each unit in the vehicle terminal 1100 are respectively to implement the corresponding process of the projection display method described in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit. For the sake of brevity, it will not be repeated here.
  • the vehicle-mounted terminal 1100 shown in FIG11 may further include a storage unit (not shown in FIG11 ), in which a program or instruction is stored.
  • a storage unit not shown in FIG11
  • the vehicle-mounted terminal 1100 shown in FIG11 may execute the screen projection display method described in the above method embodiment.
  • the technical effects of the vehicle-mounted terminal 1100 shown in FIG. 11 can refer to the technical effects of the screen projection display method described in the above method embodiment, and will not be repeated here.
  • the technical solution provided by the present application may also be a functional unit or chip in the vehicle-mounted terminal, or a device used in conjunction with the vehicle-mounted terminal.
  • An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.
  • the processor in the chip system may be one or more.
  • the processor may be implemented by hardware or by software.
  • the processor may be a logic circuit, an integrated circuit, etc.
  • the processor may be a general-purpose processor implemented by reading software code stored in a memory.
  • the memory in the chip system may also be one or more.
  • the memory may be integrated with the processor or may be separately arranged with the processor, which is not limited in the embodiments of the present application.
  • the memory may be a non-transient processor, such as a read-only memory ROM, which may be integrated with the processor on the same chip or may be arranged on different chips respectively.
  • the embodiments of the present application do not specifically limit the type of memory and the arrangement of the memory and the processor.
  • the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.
  • FPGA field programmable gate array
  • ASIC application specific integrated circuit
  • SoC system on chip
  • CPU central processor unit
  • NP network processor
  • DSP digital signal processor
  • MCU microcontroller unit
  • PLD programmable logic device
  • each step in the above method embodiment can be completed by an integrated logic circuit of hardware in a processor or by instructions in the form of software.
  • the method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.
  • An embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored.
  • the computer program When the computer program is run on a computer, the computer executes the above-mentioned related steps to implement the screen projection display method in the above-mentioned embodiment.
  • An embodiment of the present application also provides a computer program product.
  • the computer program product When the computer program product is run on a computer, the computer executes the above-mentioned related steps to implement the screen projection display method in the above-mentioned embodiment.
  • an embodiment of the present application further provides a device.
  • the device may be a component or a module, and the device may include one or more processors and a memory connected to each other.
  • the memory is used to store a computer program.
  • the computer program is executed by one or more processors, the device performs the screen projection display method in the above-mentioned method embodiments.
  • the apparatus, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are used to execute The corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
  • the steps of the method or algorithm described in conjunction with the disclosed content of the embodiments of the present application can be implemented in hardware or by executing software instructions by a processor.
  • the software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, read-only compact disks (CD-ROMs) or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium.
  • the storage medium can also be a component of the processor.
  • the processor and the storage medium can be located in an application specific integrated circuit (ASIC).
  • ASIC application specific integrated circuit
  • the disclosed method can be implemented in other ways.
  • the device embodiments described above are merely schematic.
  • the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of modules or units, which can be electrical, mechanical or other forms.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
  • Computer-readable storage media include, but are not limited to, any of the following: USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks or optical disks, and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente demande se rapporte au domaine technique des terminaux et concerne un procédé d'affichage de duplication d'écran, un système électronique et un système. Dans la présente demande, un dispositif électronique ajuste de manière adaptative un contenu de duplication d'écran d'une application selon des informations de terminal embarqué, de telle sorte que l'application présente une meilleure universalité, et la difficulté de développement d'application est réduite tout en garantissant l'effet de duplication d'écran. Le procédé comprend les étapes suivantes : un dispositif électronique acquiert des premières informations envoyées par un terminal embarqué, les premières informations comprenant des informations de terminal embarqué ; ensuite, après réception d'une demande de duplication d'écran, le dispositif électronique détermine des données de duplication d'écran selon des premières informations d'interface d'une première application indiquée par la demande de duplication d'écran et les informations de terminal embarqué ; le dispositif électronique envoie les données de duplication d'écran au terminal embarqué, de telle sorte que le terminal embarqué affiche une interface de duplication d'écran selon les données de duplication d'écran.
PCT/CN2023/118085 2022-09-30 2023-09-11 Procédé d'affichage de duplication d'écran, dispositif électronique et système WO2024067052A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211214674.2 2022-09-30
CN202211214674.2A CN117850715A (zh) 2022-09-30 2022-09-30 投屏显示方法、电子设备及系统

Publications (1)

Publication Number Publication Date
WO2024067052A1 true WO2024067052A1 (fr) 2024-04-04

Family

ID=90476038

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/118085 WO2024067052A1 (fr) 2022-09-30 2023-09-11 Procédé d'affichage de duplication d'écran, dispositif électronique et système

Country Status (2)

Country Link
CN (1) CN117850715A (fr)
WO (1) WO2024067052A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111399789A (zh) * 2020-02-20 2020-07-10 华为技术有限公司 界面布局方法、装置及系统
CN111443884A (zh) * 2020-04-23 2020-07-24 华为技术有限公司 投屏方法、装置和电子设备
CN113542839A (zh) * 2021-06-09 2021-10-22 荣耀终端有限公司 电子设备的投屏方法和电子设备
CN113741840A (zh) * 2020-09-10 2021-12-03 华为技术有限公司 多窗口投屏场景下的应用界面显示方法及电子设备
CN114356258A (zh) * 2020-09-30 2022-04-15 华为技术有限公司 电子设备及其投屏方法和介质
CN114442972A (zh) * 2020-10-31 2022-05-06 华为技术有限公司 一种投屏方法及电子设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111399789A (zh) * 2020-02-20 2020-07-10 华为技术有限公司 界面布局方法、装置及系统
CN111443884A (zh) * 2020-04-23 2020-07-24 华为技术有限公司 投屏方法、装置和电子设备
CN113741840A (zh) * 2020-09-10 2021-12-03 华为技术有限公司 多窗口投屏场景下的应用界面显示方法及电子设备
CN114356258A (zh) * 2020-09-30 2022-04-15 华为技术有限公司 电子设备及其投屏方法和介质
CN114442972A (zh) * 2020-10-31 2022-05-06 华为技术有限公司 一种投屏方法及电子设备
CN113542839A (zh) * 2021-06-09 2021-10-22 荣耀终端有限公司 电子设备的投屏方法和电子设备

Also Published As

Publication number Publication date
CN117850715A (zh) 2024-04-09

Similar Documents

Publication Publication Date Title
WO2020244495A1 (fr) Procédé d'affichage par projection d'écran et dispositif électronique
WO2020244492A1 (fr) Procédé d'affichage par projection d'écran et dispositif électronique
EP4030276B1 (fr) Procédé de continuation de contenu et dispositif électronique
US11934352B2 (en) Card rendering method and electronic device
WO2022100305A1 (fr) Procédé et appareil d'affichage d'image entre dispositifs, et dispositif électronique
WO2021121052A1 (fr) Procédé et système de coopération à écrans multiples et dispositif électronique
CN114115769B (zh) 一种显示方法及电子设备
US10347221B2 (en) Electronic device and method for controlling display thereof
WO2021104114A1 (fr) Procédé de fourniture de service d'accès à un réseau wi-fi (wireless fidelity), et dispositif électronique
US20230410809A1 (en) Method for interaction between mobile terminal and in-vehicle terminal, terminal, and system
US20230350631A1 (en) Projection display method and electronic device
CN114489529A (zh) 电子设备的投屏方法及其介质和电子设备
WO2021121036A1 (fr) Procédé et dispositif de personnalisation de touche pour un dispositif pliable, et support de stockage
US20230350629A1 (en) Double-Channel Screen Mirroring Method and Electronic Device
WO2024067052A1 (fr) Procédé d'affichage de duplication d'écran, dispositif électronique et système
EP4365722A1 (fr) Procédé d'affichage d'une barre d'accueil dans un lanceur et dispositif électronique
EP4354270A1 (fr) Procédé de recommandation de service et dispositif électronique
US20230297309A1 (en) Screen display method and apparatus, electronic device, and computer storage medium
WO2022188632A1 (fr) Procédé et appareil d'affichage de thème, terminal et support de stockage informatique
WO2023179435A1 (fr) Procédé de configuration adaptative pour application montée sur véhicule, et terminal monté sur véhicule
US20230336654A1 (en) Display method and electronic device
CN215268564U (zh) 新型车载互联投屏盒子
US20230376264A1 (en) Display Method and Electronic Device
WO2024037332A1 (fr) Procédé de duplication d'écran, dispositif électronique et système
WO2023065877A1 (fr) Procédé d'affichage d'écran d'instrument et dispositif terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23870291

Country of ref document: EP

Kind code of ref document: A1