CN117676503A - Method for projecting screen to vehicle based on mobile terminal, electronic equipment and storage medium - Google Patents

Abstract

The application provides a method for projecting a screen to a vehicle based on a mobile terminal, electronic equipment and a readable storage medium. The screen projection method comprises the following steps: in response to receiving a screen-throwing instruction, acquiring vehicle-to-machine information of a vehicle and equipment information of a plurality of display screens from the vehicle; determining a screen-throwing data template applicable to a vehicle based on vehicle-to-machine information; generating screen throwing content to be thrown on the basis of equipment information of a plurality of display screens, a screen throwing data template and vehicle data acquired from a vehicle; converting the screen contents into a plurality of screen data suitable for a plurality of display screens respectively; and transmitting the plurality of screen throwing data to the vehicle to display screen throwing content corresponding to each display screen at the display screen. According to the method and the device, different screen throwing contents can be displayed on the multiple display screens of the vehicle, so that the screen throwing contents can be dynamically configured according to different requirements or scenes of a user, and the use experience of the user is improved.

Description

Method for projecting screen to vehicle based on mobile terminal, electronic equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method for projecting a screen to a vehicle based on a mobile terminal, a screen projecting system, an electronic device, and a readable storage medium.

Background

With the development of the internet of vehicles industry, mobile phone interconnection is becoming an internet of vehicles solution with low cost and high efficiency, wherein the scheme of mapping with mobile phone screens is most widely applied. The screen mapping refers to a technology for projecting screen contents of a mobile phone to a car display screen, so that functions running on the mobile phone screen are displayed on the car display screen. The functions frequently used in the vehicle-mounted environments such as navigation and music can be displayed on the display screen of the vehicle, so that the characteristics of large screen and good sound effect of the display screen of the vehicle are effectively utilized, and the advantages of high performance, high software updating speed and the like of the mobile phone are combined.

The existing mobile phone interconnection scheme cannot show the relevant modules of the vehicle such as the instrument, the control air conditioner and the seat of the vehicle, cannot dynamically configure the content of the projection screen according to different scenes, and is poor in use experience of users. In addition, current cell phone interconnect schemes fail to achieve simultaneous multi-screen projection when there are screens on the vehicle that represent multiple functions.

Disclosure of Invention

One aspect of the application is to provide a method, a screen projection system, an electronic device and a readable storage medium for projecting a screen to a vehicle based on a mobile terminal, which can respectively project the screen to display different screen projection contents on a plurality of display screens of the vehicle, so that the screen projection contents can be dynamically configured according to different requirements or scenes of a user, various screen projection requirements of the user are met, and the use experience of the user is improved.

According to the method, the system, the electronic equipment and the readable storage medium for projecting the screen to the vehicle based on the mobile terminal, when the display screen representing a plurality of functions exists on the vehicle, the simultaneous screen projection of a plurality of screens can be realized through the mobile terminal.

According to the method, the system, the electronic equipment and the readable storage medium for projecting the screen to the vehicle based on the mobile terminal, the screen projecting data template required by projecting the screen can be locally fetched from the server in communication connection with the mobile terminal or from the mobile terminal, so that the interface layout, the color design, the control types and the like of the screen projecting are controlled and determined by the mobile terminal, the personalized setting of the screen projecting interface is realized, and the use experience of a user is improved.

According to the method, the system, the electronic equipment and the readable storage medium for projecting the screen to the vehicle based on the mobile terminal, the vehicle data are updated in real time in the screen projection interface of the vehicle display screen in the screen projection process, so that a user can know the real-time data of the vehicle, and the safety of driving the vehicle by the user is improved.

According to the method, the system, the electronic equipment and the readable storage medium for screen projection to the vehicle based on the mobile terminal, after screen projection connection is disconnected, the data items related to the screen projection data in the screen projection process are cached to the local of the mobile terminal, so that after subsequent screen projection connection, the data items are directly fetched, and the screen projection connection speed is improved.

According to the method, the system, the electronic equipment and the readable storage medium for projecting the screen to the vehicle based on the mobile terminal, the scheme of projecting the screen fuses part of vehicle control functions, and in the process of projecting the screen, a user can control the vehicle related functions by clicking icons or characters related to the control functions in the display screen and based on interconnection between the mobile terminal and the vehicle machine, so that better use experience is obtained.

According to a first aspect of the present application, there is provided a method for projecting a screen to a vehicle having a plurality of display screens based on a mobile terminal, the method may include: in response to receiving a screen-throwing instruction, acquiring vehicle-to-machine information of a vehicle and equipment information of a plurality of display screens from the vehicle; determining a screen-throwing data template applicable to a vehicle based on vehicle-to-machine information; generating screen throwing content to be thrown on the basis of equipment information of a plurality of display screens, a screen throwing data template and vehicle data acquired from a vehicle; converting the screen contents into a plurality of screen data suitable for a plurality of display screens respectively; and transmitting the plurality of screen throwing data to the vehicle to display screen throwing content corresponding to each display screen at the display screen.

According to a second aspect of the application, there is also provided a screen projection system, which comprises a mobile terminal for executing the method and a vehicle machine for establishing a communication connection with the mobile terminal. The vehicle machine is configured to transmit vehicle machine information, device information of a plurality of display screens and vehicle data to the mobile terminal, and receive a plurality of screen throwing data from the mobile terminal, and display screen throwing content corresponding to each display screen at each display screen.

According to a third aspect of the present application, there is also provided an electronic device comprising a processor and a memory communicatively coupled to the processor. The memory stores a program executable by the processor, which when executed by the processor is capable of performing a method for projecting a screen to a vehicle based on a mobile terminal as described above.

According to a fourth aspect of the present application, there is also provided a readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method for projecting a screen onto a vehicle based on a mobile terminal as described above.

It should be understood that what is described in this section is not intended to identify key features or essential features of the embodiments of the application, nor is it intended to be used to limit the scope of the application. Other features of the present application will become apparent from the description that follows.

Drawings

The above and other advantages of embodiments of the present application will become apparent by reference to the following detailed description of the embodiments with reference to the accompanying drawings, which are intended to illustrate exemplary embodiments of the present application and not to limit them. In the drawings:

FIG. 1 is a schematic diagram of an exemplary system architecture suitable for applying a mobile terminal-based method of screening a vehicle in accordance with exemplary embodiments of the present application;

FIG. 2 is a flow chart of a method of screen casting to a vehicle based on a mobile terminal according to an embodiment of the present application;

fig. 3A to 3E are timing diagrams of a method for projecting a screen to a vehicle based on a mobile terminal according to an exemplary embodiment of the present application; and

fig. 4 is a schematic structural view of an electronic device according to an exemplary embodiment of the present application.

Detailed Description

For a better understanding of the present application, various aspects of the present application will be described in more detail with reference to the accompanying drawings. It should be understood that these detailed description are merely illustrative of exemplary embodiments of the application and are not intended to limit the scope of the application in any way. Like reference numerals refer to like elements throughout the specification. The expression "and/or" includes any and all combinations of one or more of the associated listed items.

It will be further understood that terms such as "comprises," "comprising," "includes," "including," "having," "containing," and/or "including" are open ended and not closed ended in this specification, and mean that there are stated features, but do not preclude the presence or addition of one or more other features, and/or groups thereof. Furthermore, when describing embodiments of the present application, use of "may" means "one or more embodiments of the present application. Also, the term "exemplary" is intended to refer to an example or illustration.

Unless otherwise defined, all terms (including engineering and technical terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other. In addition, unless explicitly defined or contradicted by context, the particular steps included in the methods described herein are not necessarily limited to the order described, but may be performed in any order or in parallel.

Various aspects of the application will be described in detail below with reference to the drawings.

Fig. 1 illustrates an exemplary system architecture 100 suitable for applying a mobile terminal-based method of screening a vehicle according to an exemplary embodiment of the present application. The system architecture 100 includes a mobile terminal 110 and a vehicle 120. The vehicle 120 includes a vehicle system 126 and a plurality of display screens having different functions connected to the vehicle system 126. The plurality of display screens are, for example, a first display screen 121, a second display screen 122, a third display screen 123, a fourth display screen 124, and a fifth display screen 125. The first to fifth display screens 121 to 125 may be screens respectively representing different functions. As an example, the first display screen 121 may be a center control screen, the third display screen 123 may be an instrument display screen, the fourth display screen 124 may be a screen that controls vehicle related functions (e.g., air conditioner, seat, etc.), and the second display screen 122 and the fifth display screen 125 may be one of a secondary driving screen, a rear pillow screen, an entertainment screen.

The communication connection may be established between the mobile terminal 110 and the on-board system 126 of the vehicle 120 by way of any suitable short-range transmission connection.

It should be understood that the number and function of the display screens provided by the vehicle 120 in fig. 1 is merely illustrative. According to actual needs, the vehicle 120 may be provided with at least two display screens, such as a first display screen 121, a second display screen 122, a third display screen 123, a fourth display screen 124, and a fifth display screen 125. As an example, the vehicle 120 may also be provided with a display screen for other functions.

A method for projecting a screen to a vehicle based on a mobile terminal according to an exemplary embodiment of the present application will be described below with reference to fig. 2 to 3E.

Fig. 2 shows a flowchart of a method 200 for projecting a screen to a vehicle based on a mobile terminal according to an embodiment of the present application. The method 200 may be performed, for example, at a mobile terminal as described in fig. 1, or at an electronic device 400 as described in fig. 4, for example. An example of the execution of the method 200 at a mobile terminal is described below. It should be understood that method 200 may also include additional steps not shown and/or that the illustrated steps may be omitted, the scope of the application is not limited in this respect.

S210

At step S210, the mobile terminal 110 acquires the vehicle-machine information of the vehicle and the device information of the plurality of display screens from the vehicle in response to receiving the screen-casting instruction, as shown in fig. 3A. The screen throw instruction may refer to a user input made by a user when the screen throw function is enabled, which may include, but is not limited to, touch screen input, key input, voice input, and the like. Upon receiving a user input including information to enable the screen-cast function, the mobile terminal 110 may enable the screen-cast function and obtain the vehicle information and device information for the plurality of display screens from the vehicle's vehicle system 126.

The communication connection between the mobile terminal 110 and the in-vehicle system 126 may be established by way of any suitable short-range transmission connection. After receiving the screen-throwing instruction, the mobile terminal 110 issues an instruction for collecting the vehicle information of the vehicle and the equipment information of the multiple display screens to the vehicle system 126, and the vehicle system 126 then transmits the vehicle information of the vehicle and the equipment information of the multiple display screens back to the mobile terminal 110.

As an example, the vehicle-machine information may include, for example, information of a vehicle type, VIN code, MCU version, MPU version, OS version, and the like. The device information of the display screen may include, for example, information of a function of the display screen, a screen size, a resolution, and the like.

It will be appreciated that when a screen projection to, for example, the third display 123 and/or the fourth display 124 is desired, the vehicle system 126 may also be required to transmit vehicle data to the mobile terminal 110 to cause the mobile terminal 110 to convert the vehicle data into screen projection data.

As an example, the vehicle data may include, for example, at least one of a vehicle speed, a motor speed, an engine speed, a brake air pressure, a battery charge, a power battery charge, an oil amount, a coolant temperature, a shift position, a lamp state, a door state, and a seat belt state, which are displayed on the third display screen 123, and at least one of air conditioner, a vehicle seat, battery charge, a horn, and the like, which are displayed on the fourth display screen 124.

Illustratively, the vehicle system 126 is connected to a control center such as a vehicle can to obtain vehicle-related control data, so as to ensure that the vehicle system 126 can control related components of the vehicle. The vehicle system 126 may also obtain meter data related to fuel consumption, etc. through a control center such as a vehicle can.

In some embodiments, mobile terminal 110 may establish a connection with in-vehicle system 126 using a wireless short-range transmission connection, such as WiFi or bluetooth.

Specifically, when the mobile terminal 110 and the car system 126 are connected for the first time by WiFi or bluetooth, the mobile terminal 110 and the car system 126 need to be paired, and after the WiFi or bluetooth pairing between the mobile terminal 110 and the car system 126 is successful, the connection can be automatically completed in the subsequent use process.

For example, after the mobile terminal 110 receives the screen-throwing command, it is determined whether WiFi or bluetooth of the mobile terminal 110 is turned on. Under the condition that the WiFi or Bluetooth of the mobile terminal 110 is not started, prompting the user to start the WiFi or Bluetooth until the WiFi or Bluetooth of the mobile terminal 110 is detected to be started, and then carrying out the next step.

In the case where WiFi or bluetooth of mobile terminal 110 is on, mobile terminal 110 looks for WiFi or bluetooth of car set system 126. In the event that WiFi or bluetooth of the vehicle system 126 is detected, the WiFi or bluetooth paired to the vehicle system 126 may be communicatively coupled to the vehicle system 126 to transmit data and instructions.

In the event that no WiFi or bluetooth is detected for the in-car system 126, a prompt message is generated at the mobile terminal 110 prompting that no connectable WiFi or bluetooth is found. At this time, the user may restart the vehicle system 126, and after restarting the vehicle system 126, the mobile terminal 110 again searches for WiFi or bluetooth of the vehicle system 126.

Alternatively, mobile terminal 110 may establish a connection with in-vehicle system 126 using a wired connection, such as USB.

For example, when the mobile terminal 110 and the vehicle system 126 are both Android systems, the mobile terminal 110 and the vehicle system 126 may establish a connection based on an Android AOA (Android Open Accessory, open accessory support) function protocol, so that the mobile terminal 110 may interact with the vehicle system 126. One of the mobile terminal 110 and the car system 126 serves as a USB host, and the other serves as a USB accessory, so that communication connection between the two can be realized.

S220

After the mobile terminal 110 acquires the vehicle information of the vehicle in step S210, it determines a screen data template applicable to the vehicle based on the acquired vehicle information in step S220, as shown in fig. 3A.

In some embodiments, mobile terminal 110 may retrieve the above-described screen shot data template from a server communicatively coupled to mobile terminal 110 based on the vehicle information. Alternatively, the mobile terminal 110 locally stores the screen data template, and the mobile terminal 110 may locally retrieve the screen data template matching the vehicle information from the mobile terminal 110 based on the vehicle information. In the scheme, the screen-throwing data template required by screen throwing can be locally fetched from a server in communication connection with the mobile terminal or from the mobile terminal, so that the interface layout, the color design, the control types and the like of the screen throwing are controlled and decided by the mobile terminal, the personalized setting of the screen throwing interface is realized, and the use experience of a user is improved.

By way of example, a screen-casting application supporting a vehicle multi-screen casting is installed on the mobile terminal 110. After the mobile terminal 110 obtains the information of the vehicle, the template matched with the information of the vehicle can be matched through the screen-throwing application program.

The screen projection data template comprises data such as how the vehicle can support several screen projection schemes, functions under different screen projection, and resolution required by screen projection.

Alternatively, when it is required to display the meter data on the third display screen 123, the screen data template may include a display icon pattern corresponding to the meter data and a display pattern of a numerical value corresponding to the meter data. The display patterns may include a shape, a color, and a display mode, for example, the night display pattern may be selected to be a darker mode, which may reduce visual fatigue, and the daytime display pattern may be selected to be a daytime mode, which may prevent the driver from not seeing the related display content information of the third display screen 123 in a strong light environment. When it is necessary to screen the fourth display screen 124 to display the vehicle control data, the screen-projection data template may further include icons corresponding to the vehicle control data, page layouts of a plurality of icons, and the like. For example, icons of air conditioner on/off, icons of temperature increase/decrease, and the like. When it is required to display the page data of the ecological three parties to the first display screen 121, the screen data template may further include data such as a mode of integrating the ecological three parties.

In some embodiments, the user can set the layout, the digital format, the size and other UI interfaces of the screen-throwing interface according to the own use habit, so as to realize personalized setting of the display interface, thereby improving the use experience of the user.

S230

After the mobile terminal 110 acquires the device information of the plurality of display screens in step S210 and determines a screen-throwing data template applicable to the vehicle in step S220, in step S230, screen-throwing contents to be thrown on the basis of the device information of the plurality of display screens, the screen-throwing data template, and the vehicle data acquired from the vehicle are generated, as shown in fig. 3A.

As an example, after the mobile terminal 110 determines a display screen to be projected based on the device information of the plurality of display screens and the projection data template, the mobile terminal 110 forms projection content for projection display according to the projection data template based on the acquired vehicle meter data, vehicle control data and projection data required by the mobile terminal 110.

For example, the screen content may be formed using a corresponding interface according to different platform types used by the mobile terminal 110. The type of platform used by the mobile terminal 110 is, for example, an android system, an IOS system, a hong-mo system, etc.

Before forming the plurality of screen contents, the mobile terminal 110 should also determine the size of each screen content according to the setting information such as the resolution of the display screen to be screen-projected.

S240

After the mobile terminal 110 generates the screen contents in step S230, the screen contents are converted into a plurality of screen data suitable for a plurality of display screens, respectively, in step S240, as shown in fig. 3A.

In some embodiments, converting the screen content into a plurality of screen data suitable for a plurality of display screens, respectively, in step S240 includes: and converting the screen throwing content into video stream data.

Each of the screen contents is encoded as a frame image into video stream data by a video encoder, for example. Optionally, the coding is performed by adopting coding formats of H.264, H.263, VC-1 and the like.

S250

After the mobile terminal 110 converts the screen contents into a plurality of screen data suitable for a plurality of display screens, respectively, in step S240, the plurality of screen data is transmitted to the vehicle to display the screen contents corresponding to the display screens at each display screen, as shown in fig. 3A, in step S250.

In some embodiments, in step S250, transmitting the plurality of screen-cast data to the vehicle to display at each display screen the screen-cast content corresponding to the display screen includes: video stream data is sent to the vehicle to display at each display screen the cast content corresponding to that display screen.

Illustratively, the in-vehicle system 126 includes a video decoder that decodes the video stream data to screen display screen content corresponding to a plurality of display screens of the in-vehicle.

In some embodiments, after the screen is projected on the plurality of display screens of the vehicle, the method 200 further comprises the steps of: and in response to determining that the vehicle data acquired from the vehicle changes, updating the screen projection data based on the changed vehicle data, and transmitting the screen projection data updated based on the changed vehicle data to the vehicle so as to update the screen projection content of the display screen.

In the scheme, the vehicle data is updated in real time in the screen projection interface of the vehicle display screen in the screen projection process, so that a user can know the real-time data of the vehicle, and the safety of driving the vehicle by the user is improved.

For example, as shown in fig. 3B, in some scenarios, the display screen requiring projection includes a third display screen 123, and since the meter data of the vehicle, such as the vehicle speed, the rotation speed, the oil amount/power, etc., may change in real time during the running of the vehicle, the vehicle system 126 should upload the meter data to the mobile terminal 110 in real time. After receiving the meter data, the mobile terminal 110 regenerates the screen projection content based on the updated meter data, converts the regenerated screen projection content into screen projection data, and sends the screen projection data to the vehicle system 126, so that the vehicle system 126 refreshes the screen projection interface at the third display screen 123.

In other scenarios, the display screen requiring the screen projection includes a fourth display screen 124, and if the user performs a control operation on the screen projection interface displayed on the fourth display screen 124 to control a component such as an air conditioner, a seat, etc., the fourth display screen 124 first recognizes the coordinate position information of the sensed control operation and then transmits the coordinate position information of the sensed control operation to the mobile terminal 110. After receiving the coordinate position information of the control operation, the mobile terminal 110 determines a control instruction corresponding to the control operation based on the coordinate position information, and then sends the control instruction to the vehicle machine system 126 of the vehicle. The vehicle system 126 of the vehicle receives the control command and then executes the control command through a vehicle floor interface, can line, or other response means that control the vehicle. When the control command is executed, the car system 126 should also send the result of the execution of the control command to the mobile terminal 110. After receiving the execution result of the control instruction, the mobile terminal 110 regenerates the screen-throwing content based on the execution result, converts the regenerated screen-throwing content into screen-throwing data, and sends the screen-throwing data to the vehicle machine system 126 of the vehicle, so that the vehicle machine system 126 refreshes the screen-throwing interface at the fourth display screen 124.

Illustratively, as shown in fig. 3C, the screen-throwing interface of the fourth display screen 124 includes controls such as a touch key for controlling the air conditioner switch, an indicator lamp for indicating the status of the air conditioner switch, and a touch key for adjusting the temperature. Under the default state, an air conditioner switch in the screen throwing interface is in a closed state, and the indicator lamp is not on. When the user touches the touch key for opening the air conditioner in the screen-throwing interface, the fourth display screen 124 first senses the position of the touch key of the user and recognizes the coordinate position information of the position. The car system 126 acquires the coordinate position information and transmits it to the mobile terminal 110. After receiving the coordinate position information on the fourth display screen 124, the mobile terminal 110 determines that the touch operation of the user on the fourth display screen 124 is a control instruction for turning on the air conditioner based on the coordinate position information, and then issues the control instruction for turning on the air conditioner to the on-board system 126 of the vehicle. After receiving the control command for opening the air conditioner, the vehicle system 126 controls the air conditioner to be opened through a vehicle bottom layer interface or can line and the like. After the car system 126 obtains the result of the air conditioner being turned on, the result of the air conditioner being turned on is uploaded to the mobile terminal 110. After receiving the result of turning on the air conditioner, the mobile terminal 110 regenerates the screen-throwing content based on the result, turns on an indicator lamp indicating the on-off state of the air conditioner in the screen-throwing interface, converts the regenerated screen-throwing content into screen-throwing data, and sends the screen-throwing data to the vehicle machine system 126 of the vehicle. The on-board system 126 receives the on-screen data and displays it on the fourth display screen 124, so far the vehicle air conditioner is turned on, and an indicator light in the on-screen interface that characterizes the vehicle air conditioner on is turned on.

In the scheme, the screen projection scheme fuses part of vehicle control functions, so that in the screen projection process, the control of the related functions of the vehicle can be realized by clicking icons or characters related to the control functions in the display screen and based on the interconnection between the mobile terminal and the vehicle, and better use experience is brought to a user.

As an example, after the screen-drop connection is established, the screen-drop content presented in the fourth display screen 124 may include icons or text related to controlling vehicle related components (e.g., air conditioner, seat, etc.). The fourth display screen 124 itself does not need to be provided with touch control keys. In the screen throwing process, the control of the vehicle related functions can be realized by clicking the icons or characters related to the control functions in the fourth display screen 124.

In some embodiments, the method 200 further comprises the steps of: in response to breaking the screen-casting connection, suspending sending screen-casting data to the vehicle; and caching data items related to the screen shot data locally to the mobile terminal 110.

In some embodiments, the method 200 further comprises the steps of: acquiring real-time vehicle data from the vehicle in response to reestablishing the screen-cast connection; updating the screen-casting data based on the acquired real-time vehicle data and the data items locally cached by the mobile terminal 110; and transmitting screen-casting data updated based on the real-time vehicle data and the data items locally cached by the mobile terminal 110 to the vehicle to display screen-casting contents corresponding to each display screen at each display screen.

In the scheme, after the screen projection connection is disconnected, the data items related to the screen projection data in the screen projection process are cached to the local of the mobile terminal, so that the data items are directly fetched after the subsequent screen projection connection, and the screen projection connection speed is improved.

Specifically, as shown in fig. 3D, after the user issues an instruction to close the screen to the mobile terminal 110, the mobile terminal 110 exits the screen connection with the vehicle system 126 and stops generating screen projection data to the vehicle system 126 of the vehicle. However, the mobile terminal 110 caches the data items related to the screen projection data in the screen projection connection process of the present time with the vehicle system 126 to the local of the mobile terminal 110. The data items related to the screen-throwing data include, for example, a screen-throwing data template, the type of a display screen to be thrown, device information, and the like. As shown in fig. 3E, when the mobile terminal 110 establishes the screen-casting connection with the on-board system 126 of the vehicle again, the above data may be directly obtained from the data items cached by the mobile terminal 110, and the screen-casting content may be regenerated based on the vehicle data obtained from the on-board system 126 of the vehicle.

In other words, when the mobile terminal 110 is not first connected to the on-board system 126 of the vehicle, the relevant data items in step S210 and step S220 in the method 200 may be directly obtained from the data cached by the mobile terminal 110.

According to the screen projection method of the exemplary embodiment of the application, simultaneous screen projection of a plurality of display screens of the vehicle can be achieved based on one mobile terminal. The mobile terminal can determine a screen throwing data template matched with the vehicle according to the vehicle information acquired from the vehicle and generate screen throwing content based on the screen throwing data template and other data, wherein the screen throwing data template comprises information such as screen throwing interface layout, color design, control types and the like. The mobile terminal can configure the display content of the display screen according to the function type of the display screen. In the case that the vehicle has a plurality of display screens representing different functions, the screen projection method according to the exemplary embodiment of the present application can realize dynamic configuration and dynamic management of display contents of the plurality of display screens based on one mobile terminal.

In addition, according to the screen projection method of the exemplary embodiment of the application, the screen projection content displayed on the plurality of display screens of the vehicle not only comprises the screen projection content with the entertainment function, but also comprises the screen projection content for displaying the instrument data of the vehicle machine and the screen projection content capable of controlling related components such as an air conditioner and a seat of the vehicle, so that the tight combination of the screen projection content and the vehicle is realized. In the screen throwing process, a user can realize control of the vehicle related functions by clicking icons or characters related to the control functions in the display screen. Through fusing instrument data, vehicle part control functions and the like into the screen throwing content, the association of the screen throwing function and the vehicle is enhanced, so that a user can acquire the instrument data of the vehicle in real time when using the screen throwing function, the part functions of the vehicle can be conveniently controlled, and better use experience is brought to the user.

The exemplary embodiment of the application also provides a screen projection system. The screening system includes, for example, a mobile terminal 110 and a car system 126 as shown in fig. 1. The mobile terminal 110 is configured to perform the method 200 for projecting a screen to a plurality of display screens of the vehicle 120 based on the mobile terminal 110 provided in the above-described exemplary embodiments of the present application. The in-car system 126 establishes a communication connection with the mobile terminal 110 and is configured to transmit in-car information, device information of a plurality of display screens, and vehicle data to the mobile terminal 110, and to receive a plurality of screen-casting data from the mobile terminal 110 and display screen-casting contents corresponding to each display screen at each display screen.

In the process of screen projection, the car machine system 126 decodes the screen projection data after receiving the screen projection data from the mobile terminal 110, and transmits the screen projection data to the corresponding display screen so that the display screen displays the screen projection content corresponding to the display screen.

In addition, the vehicle system 126 may also receive a control instruction from the mobile terminal 110 as a control system for controlling a vehicle-related component, and issue the control instruction to the corresponding component, so that the component executes the control instruction. After the control instruction is executed, the car system 126 sends the execution result of the control instruction to the mobile terminal 110 so that the mobile terminal 110 refreshes the screen contents. The vehicle system 126 also obtains a value corresponding to the meter data to be displayed on the third display screen, and uploads the value of the meter data to the mobile terminal 110.

The above description of the method 200 of the present application is applicable to the screen projection system herein, and the related content is not repeated herein.

Fig. 4 schematically illustrates a block diagram of an electronic device (e.g., a mobile terminal) suitable for use in implementing exemplary embodiments of the present application. Electronic device 400 may be a device for implementing the methods described in fig. 2.

As shown in fig. 4, the electronic device 400 includes a processor 401 that may perform various suitable steps and processes in accordance with computer program instructions stored in a Read Only Memory (ROM) 402 or loaded from a memory 408 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device 400 may also be stored. The processor 401, the ROM 402, and the RAM 403 are connected to each other by a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.

Electronic device 400 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the application described and/or claimed herein.

Various components in electronic device 400 are connected to I/O interface 405, including: an input unit 406 such as a keyboard, a stylus, etc.; an output unit 407 such as various types of displays, speakers, and the like; memory 408, such as a magnetic disk, external hard disk, etc.; and a communication unit 409 such as a network card, modem, wireless communication transceiver, etc. The communication unit 409 allows the electronic device 400 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

Processor 401 may be a variety of general purpose and/or special purpose processing components with processing and computing capabilities. Some examples of processor 401 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. Processor 401 may perform the various methods and processes described above, such as performing method 200. For example, in some embodiments, the method 200 may be implemented as a computer software program stored on a machine-readable medium, such as the memory 408. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 400 via the ROM 402 and/or the communication unit 409. One or more of the steps of the method 200 described above may be performed when a computer program is loaded into RAM 403 and executed by processor 401. Alternatively, in other embodiments, processor 401 may be configured to perform one or more steps of method 200 in any other suitable manner (e.g., by means of firmware).

It is further noted that the present application may include methods, apparatus, systems, and/or computer program products. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for performing the various aspects of the present application.

The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: portable computer disks, hard disks, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static Random Access Memory (SRAM), portable compact disk read-only memory (CD-ROM), digital Versatile Disks (DVD), memory sticks, floppy disks, mechanical coding devices, punch cards or in-groove structures such as punch cards or grooves having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.

The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.

Computer program instructions for performing the operations of the present application may be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, c++ or the like and conventional procedural programming languages, such as the C language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present application are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information for computer readable program instructions, which may execute the computer readable program instructions.

Various aspects of the present application are described herein with reference to flowchart illustrations and/or timing diagrams of methods, apparatus (systems) and computer program products according to exemplary embodiments of the application. It will be understood that each step of the flowchart and/or timing diagram, and combinations of steps in the flowchart and/or timing diagram, can be implemented by computer readable program instructions.

These computer readable program instructions may be provided to a processor in a voice interaction device, a processing unit of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, when executed by the processing unit of the computer or other programmable data processing apparatus, create means for implementing the functions/steps specified in the flowchart and/or sequence diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or sequence diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/steps specified in the flowchart and/or sequence diagram block or blocks.

The flowcharts and time diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices, methods and computer program products according to various embodiments of the present application. In this regard, each step in the flowchart or timing diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the steps may occur out of the order noted in the figures. For example, two consecutive steps may in fact be performed substantially in parallel, they may sometimes also be performed in the opposite order, depending on the function involved. It will also be noted that each step of the timing diagrams and/or flowchart illustration, and combinations of steps in the timing diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The above description is only illustrative of the preferred embodiments of the present application and of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the invention referred to in this application is not limited to the specific combinations of features described above, but also covers other technical solutions which may be formed by any combination of the features described above or their equivalents without departing from the inventive concept. Such as the above-described features and technical features having similar functions (but not limited to) disclosed in the present application are replaced with each other.

Claims (10)

1. A method of projecting a screen onto a vehicle based on a mobile terminal, the vehicle having a plurality of display screens, the method comprising:

in response to receiving a screen-throwing instruction, acquiring vehicle-machine information of the vehicle and equipment information of the plurality of display screens from the vehicle;

determining a screen-throwing data template applicable to the vehicle based on the vehicle-to-machine information;

generating screen throwing content to be thrown on the basis of the equipment information of the display screens, the screen throwing data templates and vehicle data acquired from the vehicles;

converting the screen contents into a plurality of screen data suitable for the plurality of display screens respectively; and

and sending the plurality of screen throwing data to the vehicle so as to display screen throwing content corresponding to each display screen at each display screen.

2. The method of claim 1, wherein determining a screening data template applicable to the vehicle based on the vehicle-to-machine information comprises:

and calling the screen throwing data template from a server in communication connection with the mobile terminal or from the mobile terminal locally based on the vehicle information of the vehicle.

3. The method of claim 1, wherein converting the screen content into a plurality of screen data respectively suitable for the plurality of display screens comprises:

converting the screen throwing content into video stream data;

wherein sending the plurality of screen-casting data to the vehicle to display screen-casting content corresponding to each display screen at the display screen comprises:

and sending the video stream data to the vehicle so as to display screen throwing content corresponding to each display screen at each display screen.

4. The method of claim 1, wherein the method further comprises:

in response to receiving control information from the vehicle, confirming a control instruction corresponding to the control information based on the control information, wherein the control information comprises coordinate position information of a control operation sensed on the display screen; and

and sending the control instruction to the vehicle so as to enable the vehicle to execute corresponding control.

5. The method of any one of claims 1 to 4, wherein the method further comprises:

and in response to determining that the vehicle data acquired from the vehicle changes, updating the screen projection data based on the changed vehicle data, and sending the screen projection data updated based on the changed vehicle data to the vehicle so as to update the screen projection content of the display screen.

6. The method of any one of claims 1 to 4, wherein the method further comprises:

in response to breaking a screen-break connection, ceasing to send the screen-break data to the vehicle; and

and caching the data items related to the screen throwing data to the local of the mobile terminal.

7. The method of claim 6, wherein the method further comprises:

acquiring real-time vehicle data from the vehicle in response to reestablishing the screen-cast connection;

updating screen throwing data based on the acquired real-time vehicle data and the data items locally cached by the mobile terminal; and

and sending the screen throwing data obtained by updating the real-time vehicle data and the data items locally cached by the mobile terminal to the vehicle so as to display the screen throwing content corresponding to each display screen at each display screen.

8. A screen projection system, comprising:

a mobile terminal for performing the method of any one of claims 1 to 7 based on a mobile terminal projecting a screen to a vehicle; and

the vehicle-mounted system establishes communication connection with the mobile terminal, and is configured to send the vehicle-mounted information, the equipment information of the display screens and the vehicle data to the mobile terminal, receive the screen-casting data from the mobile terminal and display screen-casting content corresponding to each display screen at each display screen.

9. An electronic device, comprising:

a processor; and

the memory is in communication connection with the processor;

wherein the memory stores a program executable by a processor, which when executed by the processor is capable of performing the mobile terminal-based method of projecting a screen onto a vehicle according to any one of claims 1 to 7.

10. A readable storage medium, characterized in that the readable storage medium has stored thereon a computer program which, when executed by a processor, implements a method for projecting a screen onto a vehicle based on a mobile terminal according to any one of claims 1 to 7.