WO2022262380A1

WO2022262380A1 - Screen projection method, screen projection apparatus, electronic device, head unit, and screen projection system

Info

Publication number: WO2022262380A1
Application number: PCT/CN2022/085608
Authority: WO
Inventors: 吴俊�
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-06-17
Filing date: 2022-04-07
Publication date: 2022-12-22
Also published as: CN113419697A

Abstract

The present application relates to a screen projection method, a screen projection apparatus, an electronic device, a head unit, and a screen projection system. The screen projection method comprises: receiving original information sent by a head unit; processing the original information to obtain security state information; according to the security state information, determining, from a preset application list, an application for display on the head unit; and sending multimedia information of the application to the head unit, such that the head unit displays the application. By means of the method, screen projection of a head unit can be made to be more convenient and diversified.

Description

Screen projection method, screen projection device, electronic equipment, car machine and screen projection system

technical field

The present application relates to the technical field of vehicle-machine interconnection, and in particular to a screen projection method, a screen projection device, electronic equipment, a vehicle-machine and a screen projection system.

Background technique

With the development of electronic devices and car-machine interconnection technology, users can project the screen of electronic devices to the screen of the car for display. In particular, applications running on electronic devices such as navigation applications, music applications, video applications, etc. Projected to the display on the car, it is convenient for the driver and passengers to operate electronic devices during driving.

However, at present, when the application of electronic equipment is projected on the vehicle for display, it still depends on the driver or passenger to operate the electronic equipment or vehicle, such as requiring the driver or passenger to turn on and switch the electronic device or vehicle , Closing the application interface, etc., there is a problem of a single application projection method.

Contents of the invention

Based on this, it is necessary to provide a screen projection method, a display device, an electronic device, a car machine, and a screen projection system for the above technical problems, so as to overcome the problem of single application interface projection methods at least to a certain extent.

According to the first aspect of the present disclosure, a screen projection method is provided, including: receiving the original information sent by the vehicle; processing the original information to obtain security status information; The application displayed on the machine; the multimedia information of the application is sent to the car machine for the car machine to display the application.

According to the second aspect of the present disclosure, another screen projection method is provided, including: receiving security status information sent by the vehicle; determining the application displayed on the vehicle in the preset application list according to the security status information; The multimedia information is sent to the car machine for the car machine to display the application.

According to a third aspect of the present disclosure, a screen projection device is provided, including: a first receiving module, used to receive the original information sent by the vehicle; an information processing module, used to process the above-mentioned original information to obtain security status information; judge The module is configured to determine the applications displayed on the vehicle in the preset application list according to the above security status information; the transmission module is used to send the multimedia information of the application to the vehicle for the vehicle to display the application.

According to the fourth aspect of the present disclosure, another screen projection device is provided, including: a second receiving module, configured to receive security status information sent by the vehicle; The application displayed on the vehicle is determined in the application list; the transmission module is used to send the multimedia information of the application to the vehicle, so that the vehicle can display the application.

According to a fifth aspect of the present disclosure, there is provided an electronic device, including: a first processor; a first memory for storing one or more programs, when the one or more programs are executed by the first processor, so that The first processor implements the above screen projection method.

According to a sixth aspect of the present disclosure, there is provided a display method, including: acquiring original information; sending original information to an electronic device; receiving multimedia information of an application sent by the electronic device, and the aforementioned application is preset by the electronic device according to the security state information The aforementioned security status information is obtained by processing the original information of the electronic device; the application is displayed on the vehicle.

According to the seventh aspect of the present disclosure, there is provided a display method, including: obtaining original information; processing the original information to obtain security status information; sending the security status information to an electronic device; receiving multimedia information of an application sent by the electronic device, the foregoing The application is determined by the electronic device in the preset application list according to the above security state information.

According to an eighth aspect of the present disclosure, a display device is provided, including: an information acquisition module, configured to acquire original information; a sending module, configured to send the original information or security status information to an electronic device; a third receiving module, configured to The multimedia information of the application sent by the electronic device is received; the display module is used for displaying the application on the vehicle.

According to a ninth aspect of the present disclosure, there is provided a vehicle, including: a second processor; a second memory, configured to store one or more programs, when the one or more programs are executed by the second processor, so that The second processor implements the display method described above.

According to a tenth aspect of the present disclosure, there is provided a screen projection system, including: an electronic device, configured to execute the aforementioned screen projection method; and a vehicle machine, configured to execute the aforementioned display method.

According to an eleventh aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the above screen projection method and display method are implemented.

According to a twelfth aspect of the present disclosure, there is provided a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the above display method is realized.

According to the solution of the present disclosure, the projection screen of the application interface that the user is interested in can be obtained under different road conditions without the need for the user to operate the electronic device, making the projection screen more intelligent, diverse and convenient.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure. Apparently, the drawings in the following description are only some embodiments of the present disclosure, and those skilled in the art can obtain other drawings according to these drawings without creative efforts.

FIG. 1 is a schematic diagram of a screen projection system in an embodiment of the present disclosure;

2 is a schematic diagram of an electronic device according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a car machine according to an embodiment of the present disclosure;

FIG. 4 is a flow chart of a screen projection method in an embodiment of the present disclosure;

FIG. 5 is a flowchart of a screen projection method in another embodiment of the present disclosure;

FIG. 6 is a block diagram of a screen projection device in an embodiment of the present disclosure;

7 is a block diagram of a screen projection device in another embodiment of the present disclosure;

FIG. 8 is a flowchart of a display method in an embodiment of the present disclosure;

FIG. 9A is a schematic diagram of a vehicle-machine display interface in an embodiment of the present disclosure;

FIG. 9B is a schematic diagram of a vehicle-machine display interface in an embodiment of the present disclosure;

FIG. 9C is a schematic diagram of a vehicle-machine display interface in another embodiment of the present disclosure;

FIG. 9D is a schematic diagram of a vehicle-machine display interface in another embodiment of the present disclosure;

FIG. 10 is a block diagram of a display device in an embodiment of the present disclosure;

FIG. 11 is a block diagram of a display device in another embodiment of the present disclosure.

detailed description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different network and/or processor means and/or microcontroller means.

The flowcharts shown in the figures are illustrative only and do not necessarily include all steps. For example, some steps can be decomposed, and some steps can be combined or partly combined, so the actual execution sequence may be changed according to the actual situation. In addition, all the following terms "first", "second", and "third" are for the purpose of distinction only, and should not be taken as limitations of the present disclosure.

Fig. 1 shows a schematic diagram of a screen projection system in an embodiment.

Referring to FIG. 1 , a screen projection system 100 according to an embodiment of the present disclosure may include an electronic device 200 and a vehicle 300 .

The electronic device 200 may be a device performing transmission of multimedia information. The electronic device 200 may be various devices with a display screen and supporting application operation, including but not limited to smart wearable devices such as mobile phones, tablet computers, laptop computers, video players, e-book readers, and smart watches. It should be understood that the number of electronic devices in FIG. 1 is only illustrative, and there may be any number of electronic devices according to actual needs.

The car machine 300 may be a device that has a display screen and supports network connection or communication connection with other electronic devices. The connection between the vehicle machine 300 and the electronic device 200 may be a wired connection or a wireless connection. The car machine 300 can send data such as vehicle speed information, location information, etc. to the electronic device 200 . The car machine 300 can also process the received data, for example, process and display the received multimedia data sent by the electronic device 200 . In addition, the vehicle 300 may include built-in software applications, such as map applications, music applications, video playback applications, radio broadcast applications, web browser applications, search applications, etc., to provide functions such as navigation and entertainment. It should be understood that the number of locomotives in FIG. 1 is only schematic, and there may be any number of locomotives according to actual needs.

The network 500 is used as a medium for providing a communication link between the electronic device 200 and the vehicle 300 . The network 500 may include various connection types, such as Bluetooth, Wireless Fidelity (Wifi), High Definition Multimedia Interface (HDMI), Universal Serial Bus (Universal Serial BUS, USB), etc. A connection is established in a wireless or wired manner to realize functions such as communication connection, data transmission, audio and video synchronization between the electronic device 200 and the car machine 300 .

Figure 2 shows a schematic diagram of an electronic device in one embodiment.

The electronic device 200 described in the present disclosure may be configured as shown in FIG. 2 . It should be noted that the electronic device shown in FIG. 2 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

The electronic device 200 of the present disclosure includes at least a processor and a memory, and the memory is used to store one or more programs. When the one or more programs are executed by the processor, the processor can implement the screen projection method of the present disclosure.

Further, as shown in FIG. 2 , the electronic device 200 may include: a first processor 210, a first memory 221, a Universal Serial Bus (Universal Serial Bus, USB) interface 230, a charging management module 240, a power management module 241, Battery 242, mobile communication module 250, wireless communication module 260, audio module 270, speaker 271, receiver 272, microphone 273, earphone jack 274, sensor module 280, display screen 290, camera module 291, button 294 and user identification module ( Subscriber Identification Module, SIM card interface 295, etc. The sensor module 280 may include a depth sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, an ambient light sensor, and the like.

The first processor 210 may include one or more processing units, for example: the first processor 210 may include an application processor (Application Processor, AP), a modem processor, a graphics processing unit (Graphics Processing Unit, GPU), Image signal processor (Image Signal Processor, ISP), controller, video codec, digital signal processor (Digital Signal Processor, DSP), baseband processor and/or neural network processor (Neural‐network Processing Unit, NPU )Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. In addition, a memory may also be provided in the processor 210 for storing instructions and data.

The first memory 221 may be used to store computer-executable program codes including instructions. The first memory 221 may include an area for storing programs and an area for storing data.

FIG. 3 shows a schematic structural diagram of a car machine 300 in an embodiment.

The car machine described in the present disclosure can be configured as shown in FIG. 3 . It should be noted that the car machine shown in FIG. 3 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

The car machine 300 of the present disclosure includes at least a processor and a memory, the memory is used to store one or more programs, and when the one or more programs are executed by the processor, the processor can realize the display method of the exemplary embodiment of the present disclosure.

Further, as shown in FIG. 3 , the car machine may include: a second processor 310 , a second memory 320 , a display device 330 , a communication module 340 , an input device 350 , a sensor module 360 , and a USB interface module 370 .

The second processor 310 may include one or more processing units, for example: the second processor 310 may include an application processor (Application Processor, AP), a modem processor, a graphics processing unit (Graphics Processing Unit, GPU), Image signal processor (Image Signal Processor, ISP), controller, video codec, digital signal processor (Digital Signal Processor, DSP), baseband processor and/or neural network processor (Neural‐network Processing Unit, NPU )Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. In addition, a memory may also be set in the second processor 310 for storing instructions and data.

The second memory 320 may be used to store computer-executable program codes including instructions. The second memory 320 may include an area for storing programs and an area for storing data.

The display device can be 330 a single display device or multiple display devices. The display device 330 may correspond to a touch screen display device. The display device 330 may correspond to a non-touch screen display device that cannot detect a touch input. Display device 330 may be disposed on a dashboard and/or instrument panel of the vehicle.

The communication module 340 is a module used for communication connection and data transmission with electronic equipment.

Input device 350 may be a single input device or multiple input devices. The input device 350 may be a touch screen device that can detect and process touch input instructions provided by a user. The input device 350 may be a physical input control, such as a knob, a physical button, and the like. The input device 350 can be a single or multiple microphones, and the microphone can receive voice commands input by the user, and the car machine 300 can interpret the voice commands and perform appropriate actions.

The sensor module 360 may be a single or multiple sensors. The sensor module 360 may be a speed sensor for detecting when the vehicle is moving and/or the speed at which the vehicle is moving, an obstacle recognition sensor for detecting whether there are obstacles around the vehicle, a sensor for detecting obstacles in and/or around the vehicle or the machine. One or more of a light sensor for ambient light conditions, a rain sensor for detecting rain, a GPS system for obtaining vehicle location information, and the like.

It can be understood that the structure illustrated in the embodiment of the present disclosure does not constitute a specific limitation on the electronic device 200 and the car machine 300 . In other embodiments of the present application, the electronic device 200 and the car machine 300 may include more or fewer components than shown in the illustrations, or combine certain components, or separate certain components, or arrange different components. The illustrated components may be realized in hardware, software, or a combination of software and hardware.

The present disclosure also provides a computer-readable storage medium. The computer-readable storage medium may be included in the electronic device described in the above embodiments, or may exist independently without being assembled into the electronic device.

A computer-readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

The computer-readable storage medium may send, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wires, optical cables, RF, etc., or any suitable combination of the foregoing.

The computer-readable storage medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device and/or the vehicle, the electronic device and/or the vehicle can realize the display as described in the following embodiments method.

The details of the technical solution will be described below by taking the display method implemented by the above-mentioned electronic device and vehicle machine as an example of the exemplary embodiment of the present disclosure. Wherein, the electronic device 200 may be configured as shown in FIG. 2 , and the car machine 300 may be configured as shown in FIG. 3 .

Fig. 4 shows a flowchart of a screen projection method in an embodiment.

Referring to FIG. 4, it is illustrated by taking the screen projection method applied to the system in FIG. 1 and the electronic device shown in FIG. 2 as an example. The screen projection method may include the following steps:

S42. Receive the original information sent by the vehicle.

The connection between the electronic device 200 and the vehicle 300 can be established through various wireless or wired methods such as Bluetooth, Wifi, HDMI, USB, etc., to realize the communication connection, data transmission, and audio and video synchronization between the electronic device 200 and the vehicle 300 and other functions.

The original information may include information such as speed information, location information, rainfall information, ambient light information, visibility information, road information, etc., and may be one of them, or a combination of more than one information.

Speed information may be used to indicate the speed at which the vehicle is traveling. Vehicles can obtain speed information in various ways. For example, speed information can be obtained through a speed sensor, or can be obtained by obtaining vehicle position changes and corresponding time calculations through a GPS positioning system, or obtained by using data from applications such as map navigation applications after the vehicle is connected to the network.

The location information can be used to indicate where the vehicle is located. The car machine can obtain the location of the vehicle through the GPS positioning system.

The rainfall information can be used to indicate the magnitude of the rainfall, and then indicate the real-time rainy weather conditions. The vehicle can obtain rainfall information through the rain sensor, and can also obtain rainy or sunny weather information after the vehicle is connected to the network.

The ambient light information can be used to indicate the brightness information of the surrounding environment of the vehicle. The vehicle can obtain ambient light information through the ambient light sensor.

The visibility information may be used to indicate the visibility of the area in which the vehicle is located. The vehicle can obtain the visibility information by combining one or more information such as ambient light information and rainfall information, and can also obtain the visibility information of the area where the vehicle is connected to the network.

Road information can be used to indicate road congestion, accident conditions, traffic control conditions, and the like. Vehicles can obtain real-time road information after connecting the vehicle to the network.

In another embodiment, the original information can be acquired by the electronic device 200 . Electronic devices can obtain various original information through GPS positioning function, connection to the network to obtain real-time road information, etc.

S44. Process the original information to obtain security status information.

After receiving one or more types of original information sent by the vehicle, the electronic device 200 may process the original information to obtain security status information.

The safety status information may be information indicating the driving safety status of the vehicle, and the driving safety status of the vehicle may include high-speed driving status, normal driving status, congestion status, waiting for a red light status, parking status, heavy rain status, snow status, etc., safety status Status information can be obtained by processing raw information.

In one embodiment, the high-speed driving state can be preset as a state when the driving speed of the vehicle is greater than a certain speed threshold. For example, a driving state with a vehicle speed >60 km/h may be preset as a high-speed driving state. In addition, the driving state can also be judged in combination with the location information of the vehicle. For example, the location information of the vehicle on the expressway can be used as one of the conditions for judging the high-speed driving state of the vehicle.

In one embodiment, the normal driving state may be preset as a state when the driving speed of the vehicle is within a certain speed threshold range. For example, the driving state of 5km/h≤vehicle speed≤60km/h can be preset as the normal driving state. In addition, the driving status of the vehicle can also be judged in combination with the location information of the vehicle. For example, the location information that the vehicle is traveling on a road with a speed limit of 60 km/h can be used as one of the conditions for judging the normal driving state of the vehicle.

In one embodiment, the congestion state may be preset as a state when the vehicle's driving speed is lower than a certain speed threshold interval. For example, a driving state with a vehicle speed <5 km/h can be preset as a congestion state. In addition, the driving state of the vehicle can also be judged in combination with road condition information. For example, when the road section on which the vehicle travels is a congested road section, the driving state of the vehicle may be determined as a congested state.

In one embodiment, the state of waiting for a red light can be preset as a state of a vehicle stopping and waiting at a traffic light intersection. Whether the vehicle is waiting for a red light can be judged through the vehicle's driving information such as the vehicle's location information, real-time road condition information, and the vehicle's driving speed.

In one embodiment, the parking state can be preset as a state in which the parking time of the vehicle is longer than a certain time threshold. For example, a state in which the parking time is longer than 2 minutes may be preset as the parking state. In addition, the parking state can be distinguished from other vehicle states such as the congestion state and the red light state through the vehicle's location information and road condition information.

S46. According to the security state information, determine the application displayed on the vehicle in the preset application list. The preset application list may refer to a list of various application programs (ie, APPs) on the electronic device 200 that can be displayed on the car machine 300 .

In one embodiment, the preset application list can be set by the user. The user can add the application that he wishes to display on the vehicle 300 to the application list on the electronic device 200 . The applications added to the application list will be available for display on the vehicle 300 according to the security status information. For example, the user may wish to display multiple applications such as music applications, navigation applications, and instant messaging applications through the car machine 300 during the use of the vehicle. At this time, the user can pre-add these applications to the list without having to Before using the vehicle each time, open multiple applications one by one or manually switch applications during the use of the vehicle. The preset application list set by the user allows the user to decide which applications to display on the car machine 300 according to personal preferences and usage habits, so that the screen projection of the car machine 300 can better meet the user's needs.

In another embodiment, the preset application list can be automatically generated according to the user's habit of using applications. For example, the electronic device 200 can select the application with the highest user frequency or the longest use time and place it in the application list, and can dynamically adjust the application list according to changes in the user's usage habits on a regular basis or in real time, so that the application list can better reflect the user's interests and habits. For another example, the electronic device 200 may acquire the user's habit of using applications in different time periods, so as to update the application list at different time periods, so that the applications on the application list are more in line with the user's usage habits and interests, and provide users with better Use experience.

In another embodiment, the preset application list may be a default application list. The default application list may be composed of applications that most users are interested in, applications that are downloaded the most times, applications that are most closely related to driving scenarios, and the like. Default applications can be dynamically adjusted in real time or periodically. The default application list can also be edited by the user, and the user can add, delete, and adjust the priority of applications in the default application list according to his own preferences and usage habits. By presetting the default application list, the user can be provided with a more convenient application projection function, and at the same time, the user is allowed to edit the default application list, which can take into account the personalization of the default application list.

According to the security state information, the application displayed on the vehicle is determined in the preset application list. The electronic device 200 may determine the application displayed on the vehicle according to the security state information and the corresponding relationship between the security state information and the application in the preset application list. Apps displayed.

In an embodiment, the corresponding relationship between the security state information and the applications in the preset application list can be set by the user. The user can set the aforementioned corresponding relationship according to his usage habits, hobbies, needs, and the like. Wherein, one type of security state information may correspond to one or more applications, and one type of security state information may not correspond to any application.

For example, the user can pre-set the applications corresponding to the high-speed driving state as map applications; set the applications corresponding to the normal driving state as map applications, music applications, and listening to books; set the applications corresponding to the congestion state as Instant chat applications, SMS applications, etc.; set the applications corresponding to the red light state as instant chat applications, short video applications, etc.; set the applications corresponding to the parking state as short video applications, web browsing applications, Reading applications, etc. The above are just some examples of the corresponding relationship between the display conditions of the application interface and the application interface. Users can pre-set and change the corresponding relationship between the display conditions of the application interface and the application interface according to their own preferences and usage habits, so as to obtain more Good driving experience.

In another embodiment, the user may only preset the application programs that he wishes to pay attention to while using the vehicle, and the electronic device 200 intelligently determines the correspondence between the security status information and the applications. For example, the user can set instant chat applications, short video applications, and news browsing applications as the applications he wants to pay attention to during the use of the vehicle, and the electronic device 200 can intelligently compare the security status information with the above-mentioned user-desired applications. Correspondence between applications is established. For example, when the vehicle is in the state of waiting for a red light, the electronic device 200 determines to display instant chat applications and short video applications on the car device 300; Video apps and news browsing apps. Since the user only needs to set the application that he wants to focus on, and does not need to set the specific correspondence between the security status information and the application, the operation is simplified and a smarter application screen projection experience is obtained.

In another embodiment, the correspondence between security state information and applications may be configured to facilitate safe use of applications in a vehicle environment. For the sake of vehicle driving safety, you can configure the correspondence between certain security statuses and applications as a relationship that is not allowed to be set, or you can configure the correspondence between certain security status information and applications as mandatory Correspondence. For example, users may not be allowed to preset correspondence between high-speed driving status and applications such as instant chat applications, short video applications, and web browsing applications, thereby preventing users from using such software on the vehicle while driving the vehicle. affect driving safety. For another example, in heavy rain and snow conditions, the corresponding relationship between normal driving status, congestion status, etc. and applications such as instant chat applications and short video applications can be cut off to ensure driving safety.

S48. Send the multimedia information of the application to the vehicle, so that the vehicle can display the application.

After the electronic device 200 determines the application that needs to be displayed on the vehicle device 300 in the preset application list according to the correspondence between the security status information and the application, it can encode the multimedia information of the application and send it to the vehicle device 300, The car device 300 is used to display the application.

In one embodiment, after the electronic device 200 determines the application to be displayed on the car device 300 , it switches the application from the system screen to the virtual screen and encodes the application data. It can be understood that how to encode is well known to those skilled in the art. For example, video is encoded by H.264/265, pictures are encoded by JPG, and audio is encoded by AAC/MP3, which will not be repeated here. After the user data is encoded, the encoded data is sent to the vehicle-device 300 in a wireless or wired manner, and the vehicle-device 300 displays the application according to the encoded data after receiving it. It can be understood that the above multimedia information may be at least one of image information, audio information, video information or a combination thereof. For example, when the screen-casting application is a music application, the transmitted multimedia information may be audio information of music, picture information of covers of songs and albums and audio information of music, or video information of music videos. The type of multimedia information may vary according to the specific type or function of the application, which is not limited here.

In another embodiment, for an application program that has not been started on the electronic device 200, the electronic device 200 may start the above application program and keep the above application program running in the background.

In yet another embodiment, after the electronic device 200 stops projecting the screen to the car device 300, the car device 300 can resume displaying its built-in applications. For example, when the vehicle changes from the state of waiting for a red light to the normal driving state, the car machine 300 can restore the display of its own map application. In this way, the intelligent alternate use of the application program of the electronic device 200 and the application program of the vehicle device 300 can be realized, and while the power consumption of the electronic device is saved, the use of the vehicle device 300 is more flexible and the user experience is better.

To sum up, according to the screen projection method of the exemplary embodiment of the present disclosure, according to the driving information of the vehicle and the application program that the user wants to focus on during the use of the vehicle, the corresponding application is automatically selected and projected to the vehicle based on the driving state of the vehicle. 300 for display. Therefore, it is helpful for the user to obtain the application interface of interest on the display terminal of the vehicle 300 very conveniently without manipulating the electronic device 200 during the use of the vehicle, which greatly improves the efficiency of the user in using related application programs, and makes the Users get a better driving experience, while also increasing the safety of the driving process.

In another embodiment, the car machine 300 may process the original information to obtain the security status information after collecting the original information, and send the security status information to the electronic device 200 . Fig. 5 shows a flow chart of the screen casting method in this embodiment.

Please refer to Figure 5. In this embodiment, the screen projection method includes:

S52. Receive the safety status information sent by the vehicle.

In this embodiment, after the vehicle machine 300 collects the original information, it can process the original information into security status information, and send the security status information to the electronic device 200 . The electronic device 200 may receive the security status information sent by the car device 300, and use the security status information to determine the screen projection application.

S54. According to the security state information, determine the application displayed on the vehicle in the preset application list.

The electronic device 200 may determine the applications displayed on the vehicle in the preset application list according to the received security status information. The method for the electronic device 200 to determine the application displayed on the vehicle has been described above, and will not be repeated here.

S56. Send the multimedia information of the application to the vehicle, so that the vehicle can display the application.

The method for the electronic device 200 to send the multimedia information of the application to the in-vehicle device 300 for the in-vehicle device 300 to display the application has been described above, and will not be repeated here.

It should be understood that, although the steps in the flow charts shown in FIG. 4 and FIG. 5 are shown sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in FIG. 4 and FIG. 5 may include multiple steps or stages, and these steps or stages may not necessarily be executed at the same time, but may be executed at different moments. The order of execution is not necessarily performed sequentially, but may be performed alternately or alternately with other steps or at least a part of steps or stages in other steps.

Further, the present disclosure also provides a screen projection device 60 .

FIG. 6 shows a block diagram of a screen projection device 60 in an embodiment of the present disclosure. The embodiment of the screen projection device 60 may correspond to the embodiment of the screen projection method shown in FIG. 4 , and may implement the above screen projection method shown in FIG. 4 . The screen projection device 60 can be specifically applied to various electronic devices.

Referring to FIG. 6 , according to an exemplary embodiment of the present disclosure, a screen projection device 60 may include a first receiving module 62 , an information processing module 64 , a judgment module 66 , and a transmission module 68 .

The first receiving module 62 is used for receiving the original information sent by the car machine 300 . Wherein, the original information may include at least one or a combination of speed information, location information, rainfall information, ambient light information, visibility information, road information and other information.

The information processing module 64 is used to process the original information to obtain security status information.

The judging module 66 is used for responding to the security state information, and determining the application displayed on the vehicle 300 in the preset application list.

In one embodiment, the judging module 66 may determine the applications displayed on the car machine 300 according to the security status information and the corresponding relationship between the security status and the applications in the preset application list.

In another embodiment, the judging module 66 can judge whether the application is not allowed to be displayed according to the security status information, so as to promote the safe use of the application in the vehicle environment. For example, the judging module 66 may judge that applications such as chatting applications and short video applications are not allowed to be displayed on the car device 300 according to heavy rain or poor visibility, so as to ensure driving safety.

The transmission module 68 is used to send the multimedia information of the application to the in-vehicle device 300 for the in-vehicle device 300 to display the application. The transmission module 68 can encode the multimedia information of the application and transmit it to the vehicle 300 for displaying the application on the vehicle 300. The encoded data can be at least one or more of image data, audio data, and video data. The combination.

In the embodiment of the present disclosure, the specific processing of the first receiving module 62, the information processing module 64, the judgment module 66 and the transmission module 68 of the screen projection device 60 and the technical effects brought about by them can refer to the corresponding implementation in FIG. 4 respectively. Relevant descriptions of S42, S44, S46, and S48 in the example will not be repeated here. Each module in the above-mentioned screen projection device 60 may be realized in whole or in part by software, hardware or a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can call and execute the corresponding operations of the above modules.

The present disclosure also provides another screen projection device 70 . FIG. 7 shows a block diagram of a screen projection device 70 in another embodiment of the present disclosure. The embodiment of the screen projection device 70 may correspond to the embodiment of the screen projection method shown in FIG. 5 , and may implement the above screen projection method shown in FIG. 5 . The screen projection device 70 can be specifically applied to various electronic devices.

Referring to FIG. 7 , according to an exemplary embodiment of the present disclosure, a screen projection device 70 may include: a second receiving module 72 , a judging module 74 and a transmitting module 76 .

The second receiving module 72 is used for receiving the safety status information sent by the vehicle machine 300 .

The judging module 74 is used to determine the applications displayed on the vehicle 300 in the preset application list according to the security state information.

In one embodiment, the judging module 74 may determine the applications displayed on the vehicle 300 according to the security status information and the corresponding relationship between the security status and the applications in the preset application list.

In another embodiment, the judging module 74 can judge whether the application is not allowed to be displayed according to the security state information, so as to promote the safe use of the application in the vehicle environment. For example, the judging module 66 may judge that applications such as chatting applications and short video applications are not allowed to be displayed on the car device 300 according to heavy rain or poor visibility, so as to ensure driving safety.

The transmission module 76 is configured to send the multimedia information of the above application to the vehicle device 300 for the vehicle device 300 to display the above application. The transmission module 76 can encode the multimedia information of the application and transmit it to the vehicle 300 for displaying the application on the vehicle 300. The encoded data can be at least one or more of image data, audio data, and video data. The combination.

The present disclosure also provides a display method.

Fig. 8 shows a flowchart of a display method in an embodiment of the present disclosure. Referring to FIG. 8, the display method may include the following steps:

S802. Obtain original information.

The connection between the car machine 300 and the electronic device 200 can be established through various wireless or wired methods such as Wifi, HDMI, USB, etc., to realize the communication connection, data transmission, audio and video synchronization between the car machine 300 and the electronic device 200, etc. Function.

The original information may include at least one of speed information, location information, rainfall information, ambient light information, visibility information, road information or a combination thereof. In one embodiment, raw information may be collected by the vehicle. The vehicle can obtain the aforementioned raw information through the speed sensor, GPS positioning system, rain sensor, ambient light sensor, etc. installed on the vehicle.

In another embodiment, the original information can be collected by the car machine 300 . The car machine 300 can obtain original information through GPS positioning system, speed sensor, etc., and can also obtain original information by connecting to the network. In addition, by importing map applications and other applications such as vehicle location information, speed information, road condition information, weather information, etc., various types of information can be collected more quickly and comprehensively.

S804. Send the original information to the electronic device 200.

In one embodiment, the car machine 300 can send original information to the electronic device 200 . After the electronic device 200 processes the original information, it generates security status information, which is used to determine the application displayed on the car device 300 in the preset application list.

In another embodiment, the car machine 300 may process the original information into safety status information after collecting the original information, and send the safety status information to the electronic device 200 . The method for the vehicle machine 300 to process the original information into the security state information may be similar to the method for the electronic device 200 to process the original information into the security state information, and will not be repeated here.

S806. Receive the multimedia information of the application sent by the electronic device 200.

In one embodiment, after receiving the original information sent by the car device 300, the electronic device 200 can process the original information to obtain the security status information, and determine the application displayed on the car device 300 in the preset application list according to the security status information. The application sends the multimedia information of the application to the vehicle 300 .

In another embodiment, the car machine 300 may process the original information to obtain the security status information after collecting the original information, and send the security status information to the electronic device 200 . The electronic device 200 determines the applications displayed on the vehicle device 300 in the preset application list according to the security state information, and sends the multimedia information of the applications to the vehicle device 300 .

In one embodiment, the electronic device 200 encodes the applied multimedia information to obtain encoded multimedia data, and sends the encoded multimedia data to the vehicle 300 . The multimedia data may include at least one of image data, audio data, video data, or a combination thereof. After receiving the encoded multimedia data, the in-vehicle 300 can decode the multimedia data for the in-vehicle 300 to display and apply.

S808. Display the aforementioned application on the car machine 300.

In one embodiment, the car machine 300 can display the application projected by the electronic device 200 , the application of the car machine 300 can be displayed, and the application projected by the electronic device 200 and the car machine 300 can be displayed at the same time. For example, the car-machine 300 can simultaneously display the map navigation application of the car-machine 300 and the music playing application and instant chat application casted by the electronic device 200, so as to fully use the application resources of the car-machine end and the electronic device end, Provide users with better functions and experiences.

In another embodiment, the car device 300 can also switch between the application on the car device 300 and the application projected by the electronic device 200 according to the safety status of the vehicle. For example, when the vehicle changes from a congested state to a high-speed driving state, the applications displayed on the car device 300 can be switched from short video applications, instant chat applications, etc. application. In the above case, after the car machine 300 switches the screen-casting application of the electronic device 200 to its own application, the electronic device 200 can put the screen-casting application in the background or close it until the next screen-casting switch is opened. By intelligently switching between the application on the car machine 300 and the application projected on the screen of the electronic device 200, the power consumption of the electronic device 200 can be saved, and at the same time, the applications on the car machine end and the electronic device end can be fully invoked according to different scenarios , so that the use of the car machine 300 is more flexible and diverse, and the user experience is better.

FIG. 9A and FIG. 9B show schematic diagrams of a vehicle-machine display interface in an embodiment of the present disclosure. In this embodiment, the arrangement of the vehicle-machine display interface shown in FIG. 9A will be taken as an example to illustrate the application method of the vehicle-machine display. It can be understood that the display interface shown in the embodiment of the present disclosure does not constitute a specific limitation on the vehicle-machine display interface. In other embodiments of the present application, the on-board device can adjust the display interface according to actual needs, the number of applications, the size of the on-board display screen, and user preferences.

Referring to FIG. 9A, the display interface of the car machine 300 can be divided into three content display areas and a navigation bar 91, wherein the three content display areas are further divided into a main display area 92, a first auxiliary display area 93 and a second auxiliary display area. Display area 94 . Wherein, the navigation bar 91 includes multiple options, and different options correspond to different applications.

Referring to FIG. 9B , in one embodiment, the main display area 92 is used to display the application of the screen projection of the electronic device 200, the navigation bar 91 is used to display the options of multiple applications that can be switched and selected, the first auxiliary display area 93, the second The secondary display area 94 is used for displaying the applications of the in-vehicle device 300 . For example, when the applications that the electronic device 200 projects screens are "short video" applications, "chat" applications, and "webpage" applications, and the built-in applications of the car machine 300 are "navigation" applications and "music" applications, the "short video" application The interface can be displayed on the main display area 92, the switching option buttons of the "short video", "chat", and "webpage" applications are displayed on the navigation bar 91, and the "navigation" application and the "music" application are respectively displayed on the first auxiliary on the display area 93 and the second auxiliary display area 94 . By dividing the display interface of the car machine 300 into multiple content display areas to display the applications projected by the electronic device 200 and the built-in applications of the car machine 300, the display screen of the car machine 300 can be fully utilized to provide users with more diverse content. , More convenient experience.

The main display area 92 displaying the "short video" application can be configured as a horizontal display interface according to the characteristics of the short video application, so as to better adapt to the short video playback interface and provide users with a better experience. In addition, the area of the first auxiliary display area 93 displaying the "Navigation" application interface can be larger than the area of the second auxiliary display area 94 displaying the "Music" application, which is more in line with the usage scenarios of the application and the user's usage habits, and can bring more benefits to the user. For a better user experience.

The car machine 300 may acquire a user's switching instruction for an application, and switch the application according to the switching instruction. The user's switching instruction may be a touch on the display screen of the in-vehicle device 300 , a voice command sent to the in-vehicle device 300 , an instruction input through physical buttons and knobs, and the like. For example, the user can click the "chat" option in the navigation bar 91 to switch the display content of the main display area 92 from the "short video" application to the "chat" application.

FIG. 9C and FIG. 9D show schematic diagrams of the vehicle-machine display interface in another embodiment of the present disclosure. In this embodiment, another car-machine display interface arrangement shown in FIG. 9C and FIG. 9D will be taken as an example to illustrate the method of car-machine display application. It can be understood that the display interface shown in the embodiment of the present disclosure does not constitute a specific limitation on the vehicle-machine display interface. In other embodiments of the present application, the on-board device can adjust the display interface according to actual needs, the size of the on-board display screen, and user preferences.

In another embodiment, the layout of the vehicle-machine display interface can be adjusted according to the type and quantity of applications. Referring to Fig. 9C, the display interface of the car machine can be divided into six content display areas and a navigation bar 91, wherein, the six content display areas are further divided into a main display area 92, and five auxiliary display areas, and five auxiliary display areas. The display areas are respectively a first auxiliary display area 93 , a second auxiliary display area 94 , a third auxiliary display area 95 , a fourth auxiliary display area 96 and a fifth auxiliary display area 97 . Wherein, the navigation bar 91 includes multiple options, and different options correspond to different applications.

Referring to FIG. 9D , in this embodiment, the main display area 92 is used to display the application projected by the electronic device 200, the navigation bar 91 is used to display the options of multiple applications that can be switched and selected, and the auxiliary display area is used to display the car. Machine 300 comes with applications.

For example, when the applications for screen projection of electronic devices are "chat" applications, "short video" applications and "webpage" applications, the built-in applications of the car are "navigation" applications, "music" applications, "vehicle information" applications, "weather " application and "advertising application", the "chat" application is displayed on the main display area 92, and the main display area 92 is adjusted to a vertical display frame according to the interface characteristics of the "chat" application and the user's usage habits; "short video" , "chat", "webpage" application switching option buttons are displayed on the navigation bar 91, and the "navigation" application, "music" application, "vehicle information" application, "weather" application and "advertising" application are displayed on the auxiliary display area. It can be understood that the size and shape of the main display area 92 and each auxiliary display area can be adjusted according to the characteristics of the application and the usage habits of the user. By dividing the display interface of the car machine 300 into multiple content display areas to display the applications projected by the electronic device 200 and the built-in applications of the car machine 300, and adaptively configure different numbers of applications for display according to the arrangement of the display areas , can make full use of the display screen of the car machine 300 to provide users with more diverse and convenient experiences.

In addition, in this embodiment, the main display area 92 can be configured as a vertically placed area according to the characteristics of the "chat" application to display the "chat" application, so as to better meet the user's usage habits and better present the "chat" application. "application.

The car machine 300 may acquire a user's switching instruction for an application, and switch the application according to the switching instruction. The user's switching instruction may be a touch on the display screen of the in-vehicle device 300 , a voice command sent to the in-vehicle device 300 , an instruction input through physical buttons and knobs, and the like. For example, the user can click the "short video" option in the navigation bar 91 to switch the display content of the main display area 92 from the "chat" application interface to the "short video" application interface. Make adaptive adjustments.

It can be understood that, the layout of the display interface of the car-machine 300 as shown in FIG. 9A , FIG. 9B , FIG. 9C , and FIG. 9D does not specifically limit the display interface of the car-machine 300 .

In one embodiment, the main display area 92 can be used to display the applications built in the car machine 300 , and at least part of the auxiliary display area can be used to display the applications projected by the electronic device 200 .

In some implementation methods of the present disclosure, the number, size, and display direction of the main display area 92 and the auxiliary display area can be adjusted according to the number of applications, types of applications, size of the vehicle screen, user preferences, and so on.

In one embodiment, the display interface of the car machine 300 may also include a global function bar for displaying information such as time, signal, volume level, connection status, etc., which will not be described in detail here.

Further, the present disclosure also provides a display device.

FIG. 10 shows a block diagram of a car-machine display device 1000 in an embodiment of the present disclosure. The embodiment of the display device may correspond to the embodiment of the display method shown in FIG. 8 , FIG. 9A , and FIG. 9B , and may implement the above display method shown in FIG. 8 , FIG. 9A , and FIG. 9B . The display device can be specifically applied to various vehicles.

Referring to FIG. 10 , a display device 1000 according to an exemplary embodiment of the present disclosure may include an information acquiring module 1002 , a sending module 1004 , a third receiving module 1006 , and a display module 1008 .

The information acquiring module 1002 can be used to acquire original information.

In one embodiment, the information acquisition module 1002 may include a GPS positioning system, a speed sensor, an ambient light sensor, an obstacle sensing sensor, a rain sensor, and the like. The information obtaining module 1002 may obtain original information through one or more of the aforementioned sensors and positioning systems.

In another embodiment, the information obtaining module 1002 may obtain the original information from applications such as map applications provided by the car machine 300 or applications such as map applications projected by the electronic device 200 . The information acquisition module 1002 directly acquires original information from applications such as map applications, which can increase the speed at which the information acquisition module 1002 acquires original information and shorten the processing time for the display device 1000 to display applications.

The sending module 1004 is used for sending original information or security status information to the electronic device 200 .

The third receiving module 1006 is configured to receive the multimedia information of the application sent by the electronic device 200 .

The display module 1008 is used for displaying the aforementioned applications on the car machine 300 .

Fig. 11 shows a block diagram of an in-vehicle display device in another embodiment of the present disclosure. The embodiment of the display device may correspond to the embodiment of the display method shown in FIG. 8 , FIG. 9A , and FIG. 9B , and may implement the above display method shown in FIG. 8 , FIG. 9A , and FIG. 9B . The display device can be specifically applied to various vehicles.

Referring to FIG. 11 , a display device 1000 according to another embodiment of the present disclosure may further include an information processing module 1010 , a display area division module 1012 , a response module 1014 , and a switching module 1016 .

The information processing module 1010 may use the original information obtained by the information obtaining module 1002 to obtain security status information.

The display area division module 1012 may be used to divide the display interface of the vehicle machine 300 into at least one display area. The display area dividing module 1012 can adjust the division of the display interface of the car-machine 300 according to the number of applications, types of applications, size of the car-machine screen, user's preference and so on.

The response module 1014 can be used for responding to the switching instruction of the application. The response module 1014 can respond to the application switching instruction issued by the user through the touch screen, voice, physical keys and knobs, and other means.

The switching module 1016 can be used to switch applications.

In this embodiment, the details of the information acquisition module 1002, the sending module 1004, the third receiving module 1006, the display module 1008, the information processing module 1010, the display area division module 1012, the response module 1014 and the switching module 1016 of the vehicle display device For the processing and the technical effects brought about by it, reference may be made to the relevant descriptions of the display method embodiments shown in FIG. 8 , FIG. 9A , and FIG. 9B , and details are not repeated here. Each module in the above-mentioned car-machine display device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.

The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.

The above-mentioned embodiments only express several embodiments of the present disclosure, and the description thereof is relatively specific and detailed, but should not be construed as limiting the scope of the patent for the invention. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present disclosure. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims

A screen projection method, characterized in that the method comprises:

Receive the original information sent by the vehicle;

Processing the original information to obtain security status information;

According to the security state information, determine the application displayed on the vehicle in the preset application list;

The multimedia information of the application is sent to the in-vehicle device for the in-vehicle device to display the application.
The screen projection method according to claim 1, wherein the original information includes at least one of speed information, location information, rainfall information, ambient light information, visibility information, road information or a combination thereof.
A screen projection method, characterized in that the method comprises:

Receive the safety status information sent by the vehicle;

According to the security state information, determine the application displayed on the vehicle in the preset application list;

The multimedia information of the application is sent to the in-vehicle device for the in-vehicle device to display the application.
The screen projection method according to any one of claims 1 to 3, wherein the preset application list is set by a user.
The screen projection method according to any one of claims 1 to 3, wherein the preset application list is generated according to the user's habit of using applications.
A screen projection device, characterized in that the screen projection device includes:

The first receiving module is used to receive the original information sent by the vehicle;

An information processing module, configured to process the original information to obtain security status information;

A judging module, configured to determine an application displayed on the vehicle in a preset application list according to the security state information;

The transmission module is configured to send the multimedia information of the application to the vehicle-machine so that the vehicle-machine can display the application.
The device according to claim 6, wherein the original information includes at least one of speed information, location information, rainfall information, ambient light information, visibility information, road information or a combination thereof.
A screen projection device, characterized in that the screen projection device includes:

The second receiving module is used to receive the safety status information sent by the vehicle;

A judging module, configured to determine an application displayed on the vehicle in a preset application list according to the security state information;

The transmission module is configured to send the multimedia information of the application to the vehicle-machine so that the vehicle-machine can display the application.
The device according to claim 8, wherein the preset application list is generated according to the user's habit of using applications.
An electronic device, characterized in that the electronic device comprises:

first processor;

The first memory is used to store one or more programs, and when the one or more programs are executed by the first processor, the first processor implements any one of claims 1 to 5 screen projection method described above.
A display method, characterized in that the display method comprises:

obtain original information;

sending the original information to the electronic device;

receiving multimedia information of an application sent by the electronic device, the application is determined by the electronic device in a preset application list according to security status information, and the security status information is obtained by processing the original information by the electronic device;

The application is displayed on the vehicle.
A display method, characterized in that the display method comprises:

obtain original information;

Processing the original information to obtain security status information;

sending the security status information to the electronic device;

receiving multimedia information of an application sent by the electronic device, the application being determined by the electronic device in a preset application list according to the security state information;

The application is displayed on the vehicle.
A display device, characterized in that the display device comprises:

An information acquisition module, configured to acquire original information;

A sending module, configured to send the original information or security status information to the electronic device;

A third receiving module, configured to receive the multimedia information of the application sent by the electronic device;

The display module is used to display the application on the vehicle.
The display device according to claim 13, further comprising:

An information processing module, configured to process the original information to obtain the security status information.
A locomotive, characterized in that the locomotive comprises:

second processor;

The second memory is used to store one or more programs, and when the one or more programs are executed by the second processor, the second processor implements any one of claims 11 to 12 display method described above.
The vehicle machine according to claim 15, wherein the vehicle machine further comprises a display device, a communication module, an input device, a sensor module and a USB interface module.
A screen projection system, characterized in that the screen projection system includes:

The electronic device of claim 10; and,

The locomotive according to claim 15.
The screen projection system according to claim 16, wherein the screen projection system further comprises a network, and the network is used to provide a communication link medium between the electronic device and the vehicle machine.
A computer-readable storage medium, on which a computer program is stored, wherein, when the program is executed by a processor, the screen projection method according to any one of claims 1 to 5 is implemented.
A computer-readable storage medium, on which a computer program is stored, wherein, when the program is executed by a processor, the display method according to any one of claims 11 to 12 is realized.