WO2024152765A1

WO2024152765A1 - Application management and control method, vehicle-mounted apparatus, vehicle-mounted device, vehicle, and readable medium

Info

Publication number: WO2024152765A1
Application number: PCT/CN2023/135801
Authority: WO
Inventors: 胡晚成; 崔威风; 张亚男
Original assignee: 华为技术有限公司
Priority date: 2023-01-17
Filing date: 2023-12-01
Publication date: 2024-07-25
Also published as: CN118363689A

Abstract

The present application relates to the technical field of intelligent automobiles, and discloses an application management and control method, a vehicle-mounted apparatus, a vehicle-mounted device, a vehicle, a readable medium, and a program product. The method comprises: acquiring a first input, wherein the first input is used for instructing to display a first interface of a first application on a display screen of a vehicle; in response to acquisition of the first input in a vehicle driving process, acquiring a first user inputting the first input; and according to the first user, determining whether to manage and control the interface display of the first application, and if yes, managing and controlling the display of the first interface of the first application. The present application ensures driving safety.

Description

Application control method, vehicle-mounted device, vehicle-mounted equipment, vehicle and readable medium

This application claims the priority of the Chinese patent filed with the China Patent Office on January 7, 2023, with application number 202310089404.1, and invention name “Application management method, vehicle-mounted device, vehicle-mounted equipment, vehicle and readable medium”, all contents of which are incorporated by reference in this application.

Technical Field

The embodiments of the present application relate to the field of intelligent automobile technology, and in particular to an application management and control method, a vehicle-mounted device, a vehicle-mounted equipment, a vehicle, and a readable medium.

Background technique

With the development of smart cockpits, smart cockpits provide various applications for drivers and passengers, thereby providing people with a variety of services, such as navigation services, audio and video services, and multimedia. However, when implementing the present invention, the inventor found that during the driving of the vehicle, there are situations where the interface display of the application is unreasonable, which will bring some safety hazards. For example, during the driving of the vehicle, the main driver operates the video application on the central control screen to play the video. The playback of the video screen will distract the main driver's attention, making it impossible for the main driver to concentrate on driving, affecting driving safety.

Summary of the invention

In view of this, the present application provides an application management method, an in-vehicle device, an in-vehicle equipment, a vehicle, a readable medium and a program product to ensure driving safety.

In a first aspect, the present application provides an application management method, the method comprising: obtaining a first input, wherein the first input is used to indicate that a first interface of a first application is displayed on a display screen of a vehicle. In response to obtaining the first input during vehicle driving, obtaining a first user who inputs the first input. Determining whether to manage the interface display of the first application based on the first user, and when the determination result is yes, managing the display of the first interface of the first application.

The above-mentioned application management and control method can be executed by an on-board device or a cloud server on the vehicle, and the on-board device includes a vehicle computer, etc.

The application control method of the present application is illustrated by using a vehicle computer to execute the first input, and the first input indicates that the first interface of the first application is displayed on the display screen of the vehicle (such as the display screen of the vehicle computer). In response to obtaining the first input during the driving of the vehicle, the vehicle computer first determines whether the interface display of the first application is reasonable based on driving safety. If reasonable, the first interface of the first application is displayed on the display screen in response to the first input. If unreasonable, the interface display of the first application is to be controlled. This avoids the situation where the unreasonable interface display of the application in the vehicle occurs due to a direct response to the first input, reduces the negative impact on the main driver, and ensures driving safety. Furthermore, when judging whether the interface display of the first application is reasonable based on safe driving, the vehicle computer fully considers the role played by the first user who inputs the first input in the smart cockpit, and judges the rationality of displaying the interface of the first application in the smart cockpit during vehicle driving in a more intelligent and humane way. This can not only urge the main driver to comply with the safe driving behavior norms stipulated in the Road Traffic Safety Law to ensure driving safety, but also meet the use requirements of users in the smart cockpit (such as people other than the main driver) for the application while ensuring driving safety, thereby improving the user experience.

In a possible implementation, determining whether to control the interface display of the first application according to the first user includes: when determining that a first condition is met, controlling the interface display of the first application, the first condition includes that the first user is in the main driving seat. By determining whether the first user is in the main driving seat to control, the user in the main driving seat is urged to comply with the safe driving behavior norms stipulated in the Road Traffic Safety Law to ensure driving safety.

In a possible implementation, the first condition also includes: the first application belongs to a preset first list, or the first application does not belong to a preset second list, or the type of the first application belongs to a preset first type list, or the type of the first application does not belong to a preset second type list; the first list is used to record the applications to be controlled, the first type list is used to record the types of applications to be controlled, the second list is used to record the applications not to be controlled, and the second type list is used to record the types of applications not to be controlled. Based on the list corresponding to the safe driving setting, control is performed through the corresponding list to avoid the first application (such as a video application) that affects safe driving from affecting the user in the main driving seat when the interface is displayed on the vehicle, thereby ensuring driving safety.

In a possible implementation, determining whether to control the interface display of the first application according to the first user includes: when determining that the second condition is met, controlling the interface display of the first application, the second condition includes that the first user is not in the main driving seat and the first display area of the first application is close to the main driving seat. Control is performed through the first display area of the first application to avoid the first display area of the first application being close to the main driving seat and distracting the main driver's attention, thereby ensuring driving safety and meeting the needs of the first user who is not in the main driving seat to use the application.

In a possible implementation, the first display area of the first application is close to the main driver's seat includes: the first display area is an area on the display screen close to the main driver's seat; or the vehicle includes N display screens, and the first display area is displayed on a display screen close to the main driver's seat among the N display screens, where N is an integer greater than or equal to 2. Control is performed based on the first display area being close to the main driver's seat to avoid distracting the main driver's attention due to the first display area being close to the main driver's seat, thereby ensuring driving safety and satisfying the need of the first user who is not in the main driver's seat to use the application.

In one possible implementation, after obtaining the first user who inputs the first input and before determining whether to control the interface display of the first application according to the first user, the method further includes: setting the first display area of the first application according to the first user, so that the set first display area is close to the first user. Based on the need of the first user to use the first application, the first display area for displaying the interface of the first application (such as the first interface) is brought close to the first user to improve the first user's experience of using the first application.

In a possible implementation, setting the first display area of the first application according to the first user includes: when the first input triggers the split screen, using the split screen window close to the first user as the first display area of the first application, thereby improving the first user's experience of using the first application.

In a possible implementation, when the vehicle uses a navigation service, the first input triggers a split screen, thereby improving the first user's experience of using the first application and meeting driving needs.

In a possible implementation, controlling the display of the first interface of the first application includes one or more of the following operations: prohibiting the first application from running, prohibiting the display of the first interface, adding a mask to the first interface, outputting a safety instruction, outputting a safety guide, and setting the first display area of the first application so that the set first display area is away from the user in the main driving seat, so as to avoid distracting the main driver's attention, ensure that the main driver concentrates on driving, and ensure driving safety.

In one possible implementation, outputting the safety guidance includes: displaying a control corresponding to the safety guidance on a display screen, and the method further includes: obtaining a second input to the control; in response to the second input, exiting the first application, and/or, when the first display area of the first application is close to the user in the main driving seat, setting the first display area of the first application so that the set first display area is away from the user in the main driving seat. The interface display of the first application is controlled according to the needs of the user.

In one possible implementation, the method further includes: obtaining a third input, wherein the third input is used to instruct to swap the display area of the first interface on the display screen with the display area of the second interface on the display screen, so that the display area of the first interface is close to the user in the main driving seat, wherein the second interface is not the interface of the first application; when the judgment result is yes, in response to the third input, one or more of the following operations are performed: outputting a safety instruction, outputting a safety guide, and prohibiting the swap. During the entire process of the first application running, the interface display of the first application is continuously controlled to ensure driving safety.

In one possible implementation, the method further includes: obtaining a fourth input, wherein the fourth input is used to instruct the first application to play audio at a first volume value; when the first volume value is greater than or equal to a preset threshold, performing one or more of the following operations: outputting a safety instruction, outputting a safety guide, and prohibiting the first application from playing audio at the first volume value. During the entire process of the first application running, the audio of the first application is controlled to avoid excessive volume that distracts the driver's attention, thereby ensuring driving safety.

In a possible implementation, obtaining the first user who inputs the first input includes: obtaining a first time when the first input is input; obtaining first data in the smart cockpit of the vehicle, wherein the acquisition time of the first data is associated with the first time, and the first data includes one or more of the following data: voice data, image data, and sensor data; and obtaining the first user who inputs the first input according to the first data. The first user can be identified based on multiple data sources to ensure the accuracy of the first user identification.

In a second aspect, the present application provides a vehicle-mounted device, which includes: an input acquisition module, used to obtain a first input, wherein the first input is used to indicate that a first interface of a first application is displayed on a display screen of the vehicle; a first user acquisition module, used to obtain a first user who inputs the first input in response to obtaining the first input during driving of the vehicle; a judgment module, used to judge whether to control the interface display of the first application based on the first user; and a control module, used to control the display of the first interface of the first application when the judgment result is yes.

The third aspect provides a vehicle-mounted device, including at least one processor and a memory, wherein the at least one processor is coupled to the memory and is used to read and execute instructions in the memory to execute any of the above application management methods.

A fourth aspect provides a vehicle, comprising the above-mentioned vehicle-mounted device.

A fifth aspect provides a computer storage medium, wherein the computer readable medium stores program code, and when the computer program code runs on a computer, the computer executes any of the above application management and control methods.

A sixth aspect provides a computer program product, which, when executed on a computer, enables the computer to execute the application management and control method as described above.

The technical effects obtained by the above-mentioned second, third, fourth, fifth and sixth aspects are similar to the technical effects obtained by the corresponding technical means in the first aspect, and will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of an application scenario of the application management method disclosed in an embodiment of the present application.

FIG. 2 is a schematic diagram of an interface display of an existing smart cockpit in response to application startup.

FIG3 is a schematic diagram of the structure of a vehicle provided in an embodiment of the present application.

FIG4 is a schematic diagram of the acquisition module provided in an embodiment of the present application being deployed in a smart cockpit.

FIG5 is a flow chart of an application management method provided in an embodiment of the present application.

FIG. 6 is a schematic diagram of obtaining a first user who inputs a first input provided by an embodiment of the present application.

FIG. 7 is a schematic diagram of an interface for application processing provided in an embodiment of the present application.

FIG8 is a flow chart of another application management method provided in an embodiment of the present application.

9A to 9F are schematic diagrams of another interface for application processing provided in an embodiment of the present application.

FIG. 10 is a schematic diagram of an interface in response to a third input provided in an embodiment of the present application.

FIG. 11 is a schematic diagram of the structure of the vehicle-mounted device provided in an embodiment of the present application.

FIG. 12 is a schematic diagram of the structure of the vehicle-mounted device provided in an embodiment of the present application.

Detailed ways

In the present application, the term "plurality" refers to two or more. In addition, it should be understood that in the description of the present application, the terms "first", "second", etc. are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more than two. "And/or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and/or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The terms "first", "second", "third", "fourth", etc. (if any) in the specification, claims and drawings of this application are used to distinguish similar objects, rather than to describe a specific order or sequence.

In order to better understand the application management method and related equipment disclosed in the embodiments of the present application, the application scenario of the application management method of the present application is first described below.

Please refer to FIG. 1 for an exemplary introduction to the application scenario 100 of the present application. The vehicle 10 is traveling on a road 30. The smart cockpit 20 of the vehicle 10 is equipped with a display screen 21, and navigation information is displayed on the display screen 21. The user in the smart cockpit 20 inputs an operation of playing a video to the display screen 21. Please refer to FIG. 2 (a) together. The car machine in the existing smart cockpit responds to the operation of playing a video, and displays the video interface and the navigation interface on the display screen 21 in a split screen. However, the presentation of the video interface will interfere with the main driver's acquisition of navigation information, and the picture and sound of the video playing will distract the main driver, thereby affecting driving safety. Please refer to FIG. 2 (b) together. Another car machine in the existing smart cockpit responds to the operation of playing a video, displays a video interface on the display screen 21, and displays navigation information in a card-like manner. Displaying the navigation interface in a card-like manner will hinder the main driver from obtaining navigation information, and the main driver's operation is also required to fully present the navigation interface, interfering with the main driver's driving. During the driving process of the above-mentioned vehicle, the interface display of the application (video playback interface) will distract the main driver and will bring potential safety hazards, so the interface display of the application is unreasonable.

In view of this, the present application provides an application management and control method, which is applicable to vehicle driving scenarios, reduces the impact on the main driver, avoids distraction of the main driver, and ensures driving safety. The basic principle of the present application: During the driving process of the vehicle, the application that is about to run or is running on the vehicle is managed and controlled to ensure driving safety. Specifically, the vehicle computer obtains a first input, and the first input indicates that the first interface of the first application is displayed on the display screen of the vehicle. In response to obtaining the first input during the driving of the vehicle, the vehicle computer first determines whether the interface display of the first application is reasonable based on driving safety. If reasonable, the first interface of the first application is displayed on the display screen in response to the first input. If unreasonable, the interface display of the first application is to be managed and controlled. This avoids the situation where the unreasonable display of the interface of the application in the vehicle is caused by directly responding to the first input, reduces the negative impact on the main driver, and ensures driving safety. Furthermore, when judging whether the interface display of the first application is reasonable based on safe driving, the vehicle computer fully considers the role played by the first user who inputs the first input in the smart cockpit, and judges the rationality of displaying the interface of the first application in the smart cockpit in a more intelligent and humane way. This can not only urge the main driver to comply with the safe driving behavior norms stipulated in the Road Traffic Safety Law to ensure driving safety, but also meet the application usage needs of users in the smart cockpit (such as people other than the main driver) while ensuring driving safety, thereby improving the user experience.

Please refer to FIG. 3 , which is a schematic diagram of the structure of a vehicle 10 provided in an embodiment of the present application.

The vehicle 10 includes an input module 101 , a collection module 102 , a processing module 103 and an output module 104 .

The input module 101 is used to obtain a first input from a user in a smart cockpit of the vehicle 10 , wherein the first input is used to instruct to display a first interface of a first application on a display screen of the vehicle.

The application (application, app) involved in the embodiments of the present application refers to a software program that can realize one or more specific functions. Generally, multiple applications can be installed in an electronic device (such as a vehicle). For example, an application with a navigation function, an instant messaging application, etc.

The input module 101 includes but is not limited to: a touch screen, a voice acquisition device and a communication module. The touch screen can be used to receive the user's touch input, the voice acquisition device can be used to receive the user's voice input, and the communication module can be used to receive input from other devices, which are not vehicle-mounted devices. Accordingly, the first input includes but is not limited to the above-mentioned touch input, voice input and input from other devices. Among them, the other device may include a terminal, such as a mobile phone, a watch, an IPAD, and a laptop computer. The vehicle 10 and other devices have communication modules, and the vehicle 10 can receive input from other devices based on the communication between the communication modules.

The acquisition module 102 is used to collect relevant data (such as biometric data) of users in the smart cockpit of the vehicle 10. The acquisition module 102 includes but is not limited to: a voice acquisition device, an image acquisition device, and a first sensor. The voice acquisition device can be used to collect voice data of users in the smart cockpit. The image acquisition device can be used to collect image data of users in the smart cockpit. The first sensor can be used to collect sensor data of users in the smart cockpit.

The voice acquisition device includes but is not limited to a microphone, the image acquisition device includes but is not limited to a camera, and the first sensor is used to detect whether there is a living body at its location. The first sensor can be implemented as a pressure sensor, a photoelectric sensor, an infrared sensor, etc., and this application does not make specific restrictions on this. The first sensor can be set close to the user in the smart cockpit, such as being set on a seat in the smart cockpit.

Please refer to FIG. 4 , which illustrates an exemplary deployment of the acquisition module provided in the smart cockpit 20 according to an embodiment of the present application.

Take the acquisition module including a voice acquisition device 41, an image acquisition device 42 and a first sensor 43, wherein the voice acquisition device 41 includes three microphones, the image acquisition device 42 includes three cameras, and the first sensor 41 includes two infrared sensors as an example. The smart cockpit 20 includes a display screen 21, a steering wheel 22, a main driver's seat 23 (main driver's seat), a co-driver's seat 24 (not the main driver's seat) and the above acquisition module, the main driver's seat 23 is located in front of the steering wheel 22, and the position between the main driver's seat 23 and the co-driver's seat 24 is taken as the origin. The first microphone 411 and the first camera 421 are set in the upper left corner of the smart cockpit 20, the second microphone 412 and the second camera 422 are set in the upper front of the smart cockpit 20, and the third microphone 413 and the third camera 423 are set in the upper right corner of the smart cockpit 20. A first infrared sensor 431 is set on the main driver's seat 23, and a second infrared sensor 432 is set on the co-driver's seat 24.

The smart cockpit 20 provided in the present application may also include positions for rear passengers. FIG4 is an illustrative illustration of a display screen 21 and does not constitute a limitation on the present application. The smart cockpit 20 provided in the present application may include N display screens 21, where N is an integer greater than or equal to 2. The device type, quantity, and deployment position of the acquisition module in FIG4 are merely illustrative and do not constitute a limitation on the present application. The device type, deployment position, and quantity of the acquisition module can be set according to actual conditions to ensure accurate collection of relevant data of users in the smart cockpit 20.

The processing module 103 is used to obtain the first input obtained by the input module 101 and/or obtain the biometric data collected by the collection module 102, and then process the obtained first input and/or biometric data.

Part or all of the functions of the vehicle 10 may be controlled by the processing module 103. The processing module 103 may include one or more processors, for example, M processors, where M is an integer greater than or equal to 1. The processor is a circuit having the ability to process signals. In one implementation, the processor may be a circuit having the ability to read and execute instructions, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP); in another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable, such as a hardware circuit implemented by an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the processing module 103 can also include a memory, the memory is used to store instructions, and some or all of the M processors can call the instructions in the memory and execute the instructions to implement the corresponding functions.

The present application provides a safe driving service, which includes determining whether to control the interface display of a first application in response to obtaining a first input during vehicle driving, such as determining whether to control the interface display of the first application based on a first user who inputs the first input. When it is determined that the interface display of the first application is to be controlled, the display of the interface of the first application (such as the first interface) is safely controlled to ensure driving safety.

In the embodiment of the present application, the processing module 103 can be used to provide the above-mentioned safe driving service. The processing module 103 can be used to execute the application management method provided by the present application, and specifically refer to the embodiments shown in the following Figures 5 and 8.

In the embodiment of the present application, the processing module 103 has an operating system (operation system, OS), which can be the Hongmeng operating system, or other possible operating systems. The embodiment of the present application does not specifically limit it. The Hongmeng car machine OS is used as an example for exemplary description. Developers can develop a software program that implements the application control method (safe driving service) provided in the embodiment of the present application based on the system architecture of the operating system, so that the application control method can run based on the operating system. That is, the processing module 103 or the processor can implement the application control method provided in the embodiment of the present application by running the software program in the operating system.

In some embodiments, the processing module 103 may be installed with an operating system program, which includes a computer program that can implement the application management method provided in the embodiments of the present application, so that after the processor reads the operating system program and runs the operating system, the operating system may have the application management method provided in the embodiments of the present application.

The processing module 103 being installed with an operating system program can be realized as follows: the processor on the processing module 103 is installed with the operating system program. Alternatively, the processing module 103 also includes a memory, and other data other than the computer program is stored on the memory. The other data may include data generated after the above-mentioned operating system or application is run, etc. The data includes system data (such as configuration parameters of the operating system) and user data. The memory generally includes internal memory and external memory. The internal memory may be a random access memory (RAM), a read-only memory (ROM), and a cache (CACHE), etc. The external memory may be a hard disk, an optical disk, a USB disk, a floppy disk, or a tape drive, etc. The computer program is usually stored in the external memory, and the processor will load the computer program from the external memory to the internal memory before executing the processing.

In some embodiments, the processing module 103 processes the first input and/or biometric data including preprocessing the first input and/or biometric data. Exemplarily, the processing module 103 preprocesses the collected image data, including but not limited to bad pixel correction processing, time domain noise reduction processing, 3D noise reduction processing, linearization processing, and black level correction processing, and accordingly obtains a preprocessed image.

In some embodiments, the processing module 103 may be implemented as a component on a vehicle or as an onboard device on a vehicle.

Among them, any device placed or installed on a vehicle can be considered as an on-board device. On-board devices can include devices that are factory-installed on the vehicle by the vehicle manufacturer before the vehicle leaves the factory, as well as devices that are installed or placed in the vehicle by the user after the vehicle is sold. For example: a vehicle box (T-BOX), a vehicle computer (for example, Huawei HiCar), a smart rearview mirror, a vehicle microphone, a vehicle speaker, an electronic control unit (ECU), etc. can all be considered as on-board devices.

Among them, the telematics box (T-BOX) is mainly used to communicate with the background system/other device (mobile phone) application (APP) to realize the vehicle information display and control of the mobile phone APP. When the user sends a control command through the mobile phone APP, the background will send a monitoring request instruction to the vehicle-mounted T-BOX. After the vehicle obtains the control command, it sends a control message through the controller area network (CAN) bus and realizes the control of the vehicle. Finally, the operation result is fed back to the user's mobile phone APP. Only this function can help users remotely start the vehicle, turn on the air conditioner, adjust the seat to a suitable position, etc. It should be understood that the background can also be called a server, a background server, etc., which can be used to remotely activate and start the vehicle and perform corresponding authentication. The server can be a cloud server.

The car computer is a device used for information exchange between people and vehicles. It can be installed on the center console of the vehicle. The car computer is the abbreviation of the in-vehicle infotainment product installed in the car. The car computer can realize information communication between people and cars, and between cars and the outside world (cars).

Electronic Control Unit ECU, also known as "driving computer", "on-board computer", etc. It should be understood that a vehicle may include multiple ECUs.

In other embodiments, the vehicle further includes a cloud server, which provides the above-mentioned safe driving service. The cloud server communicates with the processing module 103, and the cloud server executes the application control method provided in this application. For details, please refer to the embodiments shown in the following Figures 5 and 8. The cloud server obtains the first input and/or biometric data received by the processing module 103, or, after the processing module 103 pre-processes the first input and/or biometric data, the cloud server obtains the pre-processed first input and/or biometric data from the processing module 103, and then executes the application control method provided in this application according to the pre-processed first input and/or biometric data.

The output module 104 is used to output the processing result output by the processing module 103 or the cloud server, which is the relevant processing result obtained after the execution subject (the processing module 103 or the cloud server) executes the application management method provided by this application. The output module 104 includes but is not limited to a display device and an audio output device.

Among them, display devices are mainly divided into two categories. The first category is the vehicle display screen; the second category is the projection display screen, such as the head-up display (HUD). The vehicle display screen is a physical display screen and an important part of the vehicle infotainment system. There can be multiple display screens in the smart cockpit, such as the digital instrument display screen, the central control screen, the display screen in front of the passenger on the co-pilot seat (also known as the front passenger), the display screen in front of the left rear passenger, and the display screen in front of the right rear passenger. Even the window can be used as a display screen for display. Head-up display, also known as head-up display system. It is mainly used to display driving information such as speed and navigation on the display device in front of the main driver (such as the windshield). To reduce the time for the main driver to shift his line of sight, avoid pupil changes caused by the main driver's line of sight shift, and improve driving safety and comfort. HUD includes, for example, a combined head-up display (C-HUD) system, a windshield head-up display (W-HUD) system, and an augmented reality head-up display (ARHUD) system. It should be understood that other types of HUD systems may appear as technology evolves, and this application is not limited to this.

Among them, audio output devices include smart speakers, etc.

It can be understood that a certain device on the vehicle 10 can be used to implement different functions. For example, a voice acquisition device can be used to obtain a first input, and it can also be used to collect biometric data of a user.

It is understandable that the vehicle 10 may also include more or fewer modules, which is not specifically limited in this application. For example, the vehicle 10 is connected to the cloud server through the communication module, and the first input obtained by the input module 101 and the biometric data collected by the collection module 102 are transmitted to the cloud server through the communication module for processing.

The following is an introduction to the implementation of the application management method provided in the embodiment of the present application.

In an embodiment of the present application, the execution subject of the application control method provided by the present application may be the above-mentioned processing module or cloud server. In some embodiments, the application control method provided by the present application may be jointly executed by multiple execution subjects. When executed by multiple execution subjects, for example, some steps are executed by the first execution subject, and some steps are executed by the second execution subject. The third execution subject obtains the results output by the first execution subject and/or the second execution subject, and executes another step accordingly.

The execution subject of the present application can be implemented by software and/or hardware, and can be integrated in various general-purpose computer devices, such as the above-mentioned vehicle-mounted device (vehicle computer), cloud server, etc. For the convenience of description, the following takes the vehicle computer as an example of the execution subject. It can be understood that the vehicle computer is the execution subject of the application control method of the present application is only an exemplary description and should not be understood as a limitation on the method.

Please refer to FIG5 , which exemplarily introduces an application management method provided in an embodiment of the present application.

Step S501: the vehicle computer obtains a first input, wherein the first input is used to instruct to run a first application.

The first input is used to indicate that "running the first application" in running the first application includes: starting the first application to run the first application, or running the first application that has been started. In this article, the device that runs the first application is referred to as the first device, and the first device is an on-board device on a vehicle, such as a vehicle computer. The first input is used to instruct the first device to start the first application to run the first application, or to instruct the first device to run the first application that has been started.

The first application may be an application installed on the vehicle, such as an original vehicle application provided by the car manufacturer, that is, the first application is installed on the first device. The first application may also be an application installed on other devices (not the first device), and the other device communicates with the first device. When the first application is an application installed on the vehicle, the first input instructs the first device to run the first application, including: the first input instructs the first device to start the first application installed on its operating system, or the first input instructs the first device to run the first application that has been started (such as the video application has been started, and the first input indicates to open TV series A). When the first application is an application installed on other devices other than the first device, the first input instructs the first device to run the first application means: the first device provides the user with application services from the application of the other device. For example, the car computer obtains the interface of the application from the other device, and the output device of the car computer (such as a display screen) outputs the interface. For example, the car computer receives application A from other devices, and application A is not started. The vehicle computer can display the icon of application A. The vehicle computer receives a first input, such as clicking on the icon of application A. The vehicle computer transmits the first input to other devices, and the other devices start application A. The vehicle computer then receives and displays the interface of application A after the other devices start application A.

Among them, the technical implementation of the application service provided by the first device to the user from the application program of other devices includes: the operating system of other devices and the operating system on the first device constitute a distributed operating system (distributed operating systems). The distributed operating system is a part of the distributed software system (distributed software systems) and needs to be installed in the entire distributed system. It is mainly responsible for managing the resources of the distributed processing system and controlling the operation of distributed programs. The basic functions of the distributed operating system include: providing communication means so that processes running on different computers (such as mobile phones and car computers) can exchange data through communication; providing the function of accessing the resources of other machines so that users can access the resources located on other machines; providing a certain programming language so that users can write distributed programs that can run in parallel on multiple nodes in the system; efficient control and network resource management, which is transparent to users. The first device can provide users with application services from applications of other devices, which can also be achieved through screen projection technology, etc., and this application does not make specific restrictions on this.

Among them, the vehicle computer that executes the method of the present application may include the above-mentioned output device and/or input device. The vehicle computer is in communication connection with the above-mentioned output device and/or input device, and the vehicle computer can obtain the first input through the above-mentioned input device. Correspondingly, the vehicle computer can output relevant information through the above-mentioned output device, including the information received from other devices and the processing results. Please refer to Figure 6. The vehicle computer can obtain the first input input by the first user through the above-mentioned input module. The first input can be voice input, touch input, or input from other devices, etc.

Taking the first input as voice input as an example, illustratively, a voice assistant is installed on the vehicle computer, and the first user inputs a voice "Please open the video application" to the voice assistant, and the sound collection device on the vehicle computer collects the voice input by the first user and transmits the collected voice to the vehicle computer. The vehicle computer obtains the first input (i.e., voice input), and the voice input is used to instruct the vehicle computer to start the video application.

Take the first input as input from other devices, and the other devices are mobile phones as an example. Exemplarily, the mobile phone is connected to the vehicle computer in communication. For example, the first user uses Universal Serial Bus (USB) or Wireless Fidelity (Wi-Fi) to connect the mobile phone to the vehicle computer, and then uses the carplay, carlife and other in-vehicle application desktops on the mobile phone (an application that supports mapping applications installed on other devices to the vehicle computer) to start the projection function on the mobile phone, and project the in-vehicle services (such as video applications) on the mobile phone to the display screen of the vehicle computer for display, so that the user can use the video application on the display screen. The user can project the started or unstarted application to the vehicle computer, and the vehicle computer receives the first input, which is used to instruct the display screen of the vehicle computer to display the interface of the video application.

Taking the first input as a touch input as an example, the vehicle computer is connected to a display device (such as a display screen), and please refer to (a) in FIG. 7 . The display screen 21 displays a main interface 71, and the main interface 71 includes an icon 72 of a map application and an icon 73 of a video application. The first user touches the icon 73 of the video application to start the video application. The display screen 21 detects the touch of the first user and transmits the detected touch to the vehicle computer. The vehicle computer obtains the first input (touch input), and the touch input is used to indicate the start of the video application.

The first input is used to indicate the running of the first application program, specifically including: the first input is used to indicate the display of the first interface of the first application program on the display screen of the vehicle. The display screen on the vehicle may be the above-mentioned vehicle display screen or projection display screen, etc., and the present application does not specifically limit the type of display screen and the number of display screens.

The first interface of the first application may be an interface for launching the first application, such as a startup page or a main interface of the first application. The first interface may also be another interface of the first application after launching the first application, such as a playback interface of a video in a video application, or a playback interface of a video in a comprehensive application after launching the comprehensive application, wherein the comprehensive application is an application that can provide multiple application services (such as video services, news services, etc.), such as a headline application.

The first input indicates that the first interface of the first application is displayed on the display screen of the vehicle, including but not limited to the following situations:

In scenario 1, a video application icon is displayed on a display screen of a first device, and a user clicks the icon of the video application to start the video application, and the display screen receives the user click, which is the first input and is used to instruct the display screen to display a main interface of the video application.

Scenario 2: The display screen of the first device displays the main interface of the comprehensive application, which may include multiple videos. The first user operates video a on the main interface of the comprehensive application, and the display screen obtains the user's operation on video a. The operation on video a is the first input, which is used to instruct the display screen to display the playback interface of video a.

Scenario 3: After the user establishes a communication connection between the other device and the first device, the user projects a video application that is not started on the other device to the display screen of the first device, and the display screen displays the icon of the video application. The user operates the icon of the video application to start the video application. The operation performed on the icon is the first input, which is used to instruct the display screen to display the startup page or main interface of the video application.

Scenario four: after the user establishes a communication connection between the other device and the first device, a video interface is being played on the other device. The user performs a projection operation to project the video interface being played on the other device to the display screen of the first device. The projection operation is the first input, which is used to indicate that the video interface from the other device is displayed on the display screen.

Scenario 5: After the user establishes a communication connection between other devices and the vehicle computer, the user projects the launched comprehensive application to the display screen of the vehicle computer, and the display screen displays the launched interface (such as the main interface) of the comprehensive application. The user operates video A on the comprehensive application, and the operation on video A on the comprehensive application is the first input, which is used to instruct the display screen to display the playback interface of video A on the comprehensive application.

Among them, if the execution entity of the present application (such as a cloud server) and the first device (vehicle computer) are not the same device, the execution entity is communicatively connected to the first device, and the first device can transmit the received first input to the execution entity through the above-mentioned input module.

Step S502: In response to obtaining a first input during vehicle driving, the vehicle computer obtains a first user who inputs the first input.

In an embodiment of the present application, the vehicle computer can determine whether the vehicle is in motion based on the vehicle using navigation services, vehicle computer startup, engine startup, vehicle gear parameters, vehicle geographic location data, vehicle motion data, etc.

Exemplarily, the vehicle may also include a positioning module, and the vehicle computer may obtain geographic location data and motion data based on the positioning module (such as a global positioning system (GPS), assisted GPS (A-GPS), or a similar geographic positioning unit), and then determine whether the vehicle is moving based on the geographic location data and motion data.

In some embodiments, when the vehicle is an automatic transmission vehicle, the gear parameters of the vehicle include: P gear, D gear, N gear, R gear, etc. Correspondingly, when the vehicle is a manual transmission vehicle, the gear parameters of the vehicle include: 1st gear, 2nd gear, 3rd gear, 4th gear, 5th gear, R gear, etc. For example, When the vehicle computer detects that the vehicle is in gear D, gear N, or gear R, it can be considered that the vehicle is in motion. Alternatively, when the vehicle computer detects that the vehicle is in gear D or gear R, it can be considered that the vehicle is in motion.

In an embodiment of the present application, in response to obtaining a first input during driving, the vehicle computer determines a first user according to relevant information when the first input is input, wherein the first user may be a main driver, a co-driver, or a rear passenger. The relevant information when the first input is input includes the relevant data collected by the above-mentioned collection module.

In some embodiments, the acquisition module may be started when the vehicle is detected to be moving. In other embodiments, the acquisition module may be started when the first input is obtained. In other embodiments, the acquisition module may be started after the vehicle computer is started. As long as it can be ensured that the acquisition module can obtain relevant data in the smart cockpit in real time during the vehicle driving process, this application does not specifically limit the timing of starting the acquisition module.

In the embodiment of the present application, the vehicle computer obtains the first time when the first input is input, then obtains the first data related to the first time from the acquisition module, and finally obtains the first user who inputs the first input according to the first data related to the first time. The first data related to the first time can be the collection time of the first data associated with the first time, such as the collection time is the same as the first time, or the collection time covers the first time, that is, the collection time includes the first time and the time adjacent to the first time, etc.

Please refer to FIG. 6 , the first data may include one or more of the following data: voice data, image data, and sensor data. The method of obtaining the first user who inputs the first input according to the first data in the present application includes but is not limited to the following:

Method 1: The voice collection device in the vehicle collects voice data and marks the timestamp when the voice data is collected. The vehicle computer obtains the voice data associated with the collection time and the first time, and then locates the first user who outputs the voice data based on the sound source localization method of the microphone array in the prior art. The sound source localization method based on the microphone array includes but is not limited to the following: controllable beamforming technology based on maximum output power, high-resolution spectrogram estimation technology, and sound source localization technology based on time-delay estimation (TDE).

Exemplarily, the first input input by the user is a voice input, and the vehicle computer obtains the first input at time T1 (first time). The vehicle computer obtains voice data with a timestamp of time adjacent to time T1, such as obtaining voice data at time T1 and after time T1. The voice data is voice data collected by multiple sound collection devices. As shown in Figure 4, the signal strength of the voice data obtained by the three microphones at time T1 and after is combined to determine the location of the sound source. When it is detected that the signal when the first microphone 411 collects the voice data is stronger than that of the second microphone 412 and the third microphone 413, it is determined that the user close to the first microphone 411 in the smart cockpit is the first user, and the first user is determined to be the main driver (in the main driving seat) according to the position of the first microphone 411 in the smart cockpit, or the co-main driver (not in the main driving seat), or the rear passenger (not in the main driving seat). As shown in Figure 4, if the first microphone 411 is set close to the main driver, the first user is determined to be the main driver.

Method 2: The voiceprints of the main driver and/or the co-driver and/or the rear passengers can be pre-stored. When the vehicle computer receives voice input, the vehicle computer obtains the voiceprint corresponding to the voice input and matches it with the pre-stored voiceprint to determine the first user.

Method 3: The camera acquisition device in the vehicle acquires image data and marks the timestamp when the image data is acquired. The vehicle computer acquires the image data associated with the acquisition time and the first time, and then performs image processing to determine the first user.

Exemplarily, the vehicle computer obtains the first input at time T1 (first time), and the vehicle computer obtains image data associated with the acquisition time and the first time, and then determines the first user according to the image data. If it is determined according to the image data that there is only the main driver in the smart cabin, the first user can be determined to be the main driver. If the main driver and the deputy main driver in the smart cabin are determined according to the image data, the actions of the main driver and the deputy main driver can be identified to determine the first user. For example, when the first input is a voice input, the lip shape changes in the main driver or the deputy main driver at the first time are determined according to the image data, and the user whose lip shape changes are determined as the first user. For another example, when the first input is a touch input, the user's hand movement is determined according to the image data, and the user who detects the hand operation of the display screen is determined as the first user. For another example, when the first input is an input from other devices, the user who uses other device terminals in the first time is determined according to the image data as the first user. Finally, the identity of the first user is determined according to his position in the smart cockpit, such as the main driver, the deputy driver or the rear passenger.

In some embodiments, when performing image processing, corresponding image features can be set in advance, such as image features indicating speaking, image features indicating operating the in-vehicle display screen, and image features indicating operating other smart terminals, etc., so that when the image data is subsequently processed and the above-mentioned image features are identified, the user corresponding to the image features can be determined as the first user.

Method 4: Obtain sensor data collected by the first sensor, and determine based on the sensor data that no living body is located at the position of the first sensor at the first time. If it is determined that no living body is located at the position of the co-pilot at the first time, the first user can be excluded as the co-pilot.

Method 5: When the first input is input from another device, the first user can be determined according to the device identification of the other device. For example, when the vehicle computer receives input from the first terminal device, the vehicle computer records the user corresponding to the first terminal device as the vehicle owner, and the vehicle owner is assumed to be the primary driver. Then, when the input from the first terminal device is received, the first user can be determined to be the primary driver.

In some embodiments, the user can set his terminal device according to the actual situation, such as setting the terminal device of the car owner as the main driving device and setting the terminal device of other users as the co-pilot device. When the input from other devices is detected later, the corresponding first user can be determined according to the terminal device.

In an embodiment of the present application, one or more of the above-mentioned methods 1, 2, 3, 4 and 5 can be used to obtain the first user. For example, taking the first input of the user as voice input, the vehicle computer obtains the first input at time T1 (first time). The vehicle computer obtains the voice data associated with the acquisition time and the first time, and then determines the first user based on the signal strength of the voice data. At the same time, the vehicle computer combines the image data collected by the camera acquisition device, such as judging the first user who inputs the voice input by the facial features and mouth shape.

In some embodiments, if the first user determined based on two or three of the voice data, image data, and sensor data conflict with each other, such as the first user is determined to be a co-pilot based on the voice data and image data, and there is no co-pilot in the current smart cockpit based on the sensor data, the first user can be determined based on the preset stored priority. Exemplarily, the priority of image data is greater than that of sensor data, and the priority of sensor data is greater than that of voice data, that is, when the above data conflict, the first user determined by the image data shall prevail, and when the first users determined by the sensor data and the voice data conflict, the first user determined by the sensor data shall prevail.

In some embodiments, the co-driver uses the terminal device of the main driver to communicate with the vehicle computer, and combines one or more of the above-mentioned methods one, two, three, and four to determine that the co-driver inputs the first input, then determines that the first user is the co-driver.

In some embodiments, when it is determined that the first user is a rear passenger, the first input may be determined as an invalid input and the process is terminated. For example, when the voice input indicates to start a video application on the central control screen, and the voice input comes from a rear passenger, the voice input may be determined as an invalid input.

In some embodiments, the vehicle computer may start a safe driving service in response to obtaining a first input during vehicle driving. The safe driving service is implemented by obtaining a first user who inputs the first input.

Step S503: The vehicle computer determines the first attribute of the first application according to the first user, wherein the first attribute of the first application includes a danger attribute and a safety attribute.

In an embodiment of the present application, the vehicle computer determines whether to control the interface display of the first application according to the first user, and outputs the judgment result. When the judgment result is yes, the first attribute of the first application is determined to be a dangerous attribute. When the judgment result is no, the first attribute of the first application is determined to be a safe attribute. That is, when the vehicle computer determines that the interface display of the first application is to be controlled according to the first user, the first attribute of the first application is determined to be a dangerous attribute. When the vehicle computer determines that the interface display of the first application does not need to be controlled according to the first user, the first attribute of the first application is determined to be a safe attribute. In other words, during the driving process of the vehicle, based on driving safety, it is determined whether the interface display of the application on the vehicle is reasonable. If it is reasonable, there is no need to control the interface display of the application, and the first attribute of the first application is determined to be a safe attribute. If it is unreasonable, it is necessary to control the interface display of the application, and the first attribute of the first application is determined to be a dangerous attribute.

Among them, the dangerous attribute (or the need to control the interface display of the first application) indicates: when the above-mentioned first device (vehicle computer) responds to the first input, runs the first application or starts the first application to run the first application, it is easy to cause a traffic accident. That is, in response to the first input, the interface of the first application (including the first interface) is displayed on the display screen of the vehicle, which will have a direct or indirect impact on the main driver, and the impact will cause the main driver to have a negative impact on driving (such as parking distance and lane control), which is easy to cause traffic accidents. For example, the car computer plays a video projected from the screen or the car computer starts a game application to run the game application, which will attract the driver's attention.

Among them, the safety attribute (or no need to control the interface display of the first application) indicates that when the first device responds to the first input, runs the first application or starts the first application to run the first application, it is not easy to cause a traffic accident. That is, in response to the first input, the interface of the first application (including the first interface) is displayed on the display screen of the vehicle, which will not directly or indirectly affect the main driver, or the impact on the main driver is small, and the main driver will not have a negative impact on driving, or the negative impact of the main driver on driving is small.

In other words, the danger attribute indicates that there are safety risks when the first device runs the first application or starts the first application to run the first application, and displays the interface of the first application (including the first interface) on the display screen of the vehicle, such as distracting the main driver, resulting in driving that does not comply with the behavioral norms of safe driving. The safety attribute indicates that the first device runs the first application or starts the first application to run the first application, and displays the interface of the first application (including the first interface) on the display screen of the vehicle, which will not distract the main driver's attention and ensure that the driving complies with the behavioral norms of safe driving.

In an embodiment of the present application, the first attribute of the same application may be different in different situations, and accordingly, the control method of the application is also different. For example, the first user who instructs to run the first application is different, and different first users play different roles in the driving process of the vehicle, and the determined first attributes may be different, thereby ensuring driving safety while meeting the use requirements of users in the smart cockpit (such as people other than the main driver) for the application and improving the user experience. In an embodiment of the present application, the vehicle computer determines whether to control the interface display of the first application based on the first user, including: when it is determined that the first condition is met, the interface display of the first application is controlled, and the first condition includes that the first user is in the main driving seat. The first user is in the main driving seat, that is, the first user is the main driver. In other words, the first user is the user who drives the vehicle (such as operating the steering wheel) in the smart cockpit.

In some embodiments, the first condition further includes: the first application belongs to a preset first list, or the first application does not belong to a preset second list, or the type of the first application belongs to a preset first type list, or the type of the first application does not belong to a preset second type list. The first list is used to record preset applications to be controlled, the first type list is used to record the types of preset applications to be controlled, the second list is used to record preset applications not to be controlled, and the second type list is used to record the types of preset applications not to be controlled.

In an embodiment of the present application, the application to be controlled or the type of application to be controlled can be pre-set according to the function of the application or the actual situation. The pre-set types of applications to be controlled may include games, social, audio and video, etc. Other types may also be included. For example, during driving, a certain type of application displays an interface on the display screen of the vehicle, which will attract the attention of users in the smart cockpit, and then have a negative impact on the driving of the main driver. In this case, the type can also be added to the first type list. Among them, game applications can provide online game services for users, social applications have social network functions, such as dating software, etc. Social applications also include applications for disseminating information to users, such as news applications. Audio and video applications are used to provide audio and video services, such as Huawei Video.

In an embodiment of the present application, after determining the applications to be controlled or the types of applications to be controlled, the remaining applications that are not to be controlled can be added to the second list, or the remaining types of applications that are not to be controlled can be added to the second type list. For example, the types of applications that are not in any of the game, social, and audio and video categories can be added to the second type list.

Specifically, the first list is used to store the pre-set application identifiers (generally referred to as package names) of the applications to be controlled. The second list is used to store the pre-set application identifiers of applications that are not to be controlled. The first type list is used to store the pre-set types of applications to be controlled, such as: games, social, and audio and video. The second type list is used to store the types of applications that are not to be controlled, such as: navigation, music, etc. That is, the first list and the first type list are whitelists, and the second list and the second type list are blacklists.

In some embodiments, the first list may be implemented to store the types to be managed and the identifiers of the applications corresponding to the types, such as storing the application identifiers of applications belonging to the game category, storing the application identifiers of applications belonging to the social category, and storing the application identifiers of applications belonging to the audio and video category.

For example, the first table is as shown in Table 1:

Table 1

Wherein, M, J, and K are all integers greater than or equal to 2, and the number of application identifiers stored in the preset list is not specifically limited. The types of applications to be managed are maintained, and then the identifiers of the applications to be managed are stored in the corresponding types.

Among them, the first application belongs to the preset first list means that the application identifiers stored in the first list include the application identifier of the first application. Correspondingly, the first application does not belong to the preset second list means that the application identifiers stored in the second list do not include the application identifier of the first application. The type of the first application belongs to the preset first type list means that the types stored in the first type list include the types corresponding to the first application. Correspondingly, the type of the first application does not belong to the preset second type list means that the types stored in the second type list do not include the types corresponding to the first application.

When the content stored in the first list includes application types and application identifiers, such as Table 1 above, the first application belongs to the first list including: the first list includes the application identifier of the first application or the types stored in the first list include the types corresponding to the first application, or the types stored in the first list include the types of the interface of the first application. If the types stored in Table 1 include game, social and audio and video, when the first interface of the first application is a game interface, a social interface (such as a chat) or an audio and video interface (video playback interface), the first application belongs to the first list.

For example, taking the first application as Huawei Video and the car machine maintaining the first list as an example, when the application identifier recorded in the first list includes the application identifier of Huawei Video, it is determined that the interface display of Huawei Video needs to be controlled. When the car machine maintains the first type list as an example, the types recorded in the first type list include games, social networking, and audio and video. The car machine obtains the type of Huawei Video and determines that the type of Huawei Video is audio and video, and then determines that the interface display of Huawei Video needs to be controlled. When the list maintained by the car machine includes the type of application and the application identifier corresponding to each type (such as Table 1), taking the first application as Toutiao application as an example, the type of Toutiao application is a comprehensive application. If the first interface indicated by the first input is to open the main interface of Toutiao application, it is determined that the first application does not belong to Table 1, and there is no need to control the interface display of Toutiao application. When the user operates the main interface and inputs the first input to indicate to open the video interface in Toutiao application, the first interface indicated by the first input is the video interface in Toutiao application, and the audio and video category in Table 1 includes the type of the video interface. It is determined that the first application belongs to Table 1, and it is necessary to control the interface display of Toutiao application. There is no limitation on the method of obtaining the type of application. For example, the application name of the application can be identified, a keyword can be identified, and the corresponding application type can be determined based on the keyword. For example, the keyword "video" in the application name "Huawei Video" can be determined to be an audio and video type.

The above list may be pre-stored in a corresponding memory or database, etc. The above list may be updated, such as maintaining the above list in a cloud server, and when the above list is updated, the updated list is transmitted to the vehicle computer. Alternatively, the user's input operation may be received, and the above list may be updated according to the input operation. The user's customized operation may also be received, and the application identifier of the application corresponding to the customized operation may be stored in the above first list or the second list.

In some embodiments, when the first user is not in the main driving seat, it can be directly determined that there is no need to control the interface display of the first application. If the first user is not in the main driving seat, the first user can be a user in the co-pilot seat in the vehicle (co-pilot) or a rear passenger.

In an embodiment of the present application, when there is no need to control the interface display of the first application, the first device responds to the first input, the first device starts the first application or the first device runs the first application, and outputs the result of starting the first application or outputs the result of running the first application through the output device, including outputting sound or presenting an interface, such as displaying the first interface of the first application on a display screen.

In other embodiments, determining whether to control the interface display of the first application based on the first user includes: controlling the interface display of the first application when it is determined that a second condition is met, and the second condition includes that the first user is not in the main driving seat and the first display area of the first application is close to the main driving seat.

The first display area is an area on the display screen of the vehicle for displaying the interface of the first application (such as the first interface), and the interface of the first application can be an interface when the first application is started, or an interface when the first application is running. If the first application is a video application, the first interface can be the main interface or video interface of the video application.

In some embodiments, the first display area of the first application may be set by default on the vehicle computer. For example, in response to a newly started application, the vehicle computer sets the first display area of the application by default on the left side of the central control screen, or by default on the right side of the central control screen, etc. For another example, there is a display screen in front of both the main driver's seat and the co-driver's seat. In response to receiving the first interface of the first application of other devices, the vehicle computer sets the first display area of the first interface by default on the display screen near the co-driver's seat.

In an embodiment of the present application, the vehicle computer obtains the first display area of the first application program, including obtaining the display screen displayed by the first display area and the position area of the first display area on the display screen. For example, the first display area of the first application program is on the left side of the central control screen.

In the embodiment of the present application, when the first display area is close to the main driver's seat, it is determined that the interface display of the first application needs to be controlled. The first display area being close to the main driver's seat includes one or more of the following situations: the first display area is an area on the vehicle's display screen (such as the central control screen) close to the main driver's seat. Or, the vehicle includes N display screens, and the first display area is displayed on the display screen close to the main driver's seat among the N display screens, where N is an integer greater than or equal to 2.

In an embodiment of the present application, the positional relationship between each display area on the vehicle and the user in the smart cockpit can be pre-stored, and then whether the first display area is close to the main driver's seat can be determined based on the pre-stored positional relationship. In other embodiments, the display area close to the main driver's seat on the vehicle can be pre-stored. Exemplarily, the positional relationship includes: the central control screen is set between the main driver's seat and the co-driver's seat, the main driver's seat is on the left side of the central control screen, and the co-driver's seat is on the right side of the central control screen. The left area of the central control screen can be stored close to the main driver's seat. For another example, the vehicle includes a first display screen and a second display screen, and the positional relationship includes: the first display screen is located in front of the main driver's seat, and the second display screen is located in front of the co-driver's seat. The first display screen can be stored close to the main driver's seat.

In an embodiment of the present application, when judging whether the startup or operation of the first application is reasonable during the driving process of the vehicle, the role played by the first user in the smart cockpit is fully considered to achieve a more intelligent and humane judgment of the rationality of the startup or operation of the first application, to ensure that the first attribute of the first application is reasonably and accurately determined, and then corresponding control can be performed according to the first attribute to ensure driving safety. When the first user is in the main driving seat, it is necessary to control the interface display of the first application. Alternatively, when the first user is in the main driving seat, the first attribute of the first application is determined according to the above list to avoid the user in the main driving seat from using the application that needs to be controlled during driving, and to urge the user in the main driving seat to comply with the behavioral norms of the main driver stipulated in the Road Traffic Safety Law to ensure driving safety. When the first user is not in the main driving seat, the first attribute can be directly determined as a safety attribute, and the vehicle computer can directly provide the first user with the service corresponding to the first application to meet the service needs of the non-main driving user in the smart cockpit. Alternatively, when the first user is not in the main driving seat, the vehicle computer determines the first attribute of the first application based on the first display area to prevent the startup or operation of the first application from affecting the main driving, so as to provide the service corresponding to the first application while ensuring driving safety.

In some embodiments, the safe driving service is implemented to determine the first attribute of the first application (i.e., to determine whether to control the interface display of the application). After the vehicle computer starts the safe driving service, the safe driving service can determine the first attribute by referring to the contents of the above-mentioned first and second conditions.

Step S504: When the first attribute is a dangerous attribute, the vehicle computer controls the first application.

In the embodiment of the present application, when the first attribute is a dangerous attribute, that is, it is determined that the interface display of the first application needs to be controlled, then the vehicle computer controls the interface display of the first application. That is, in response to obtaining the first input during vehicle driving, when the interface display of the first application needs to be controlled according to the first user's judgment, the display of the first interface of the first application is controlled to reduce or avoid direct or indirect impact on the main driver, and reduce or avoid the negative impact of the main driver on driving.

In an embodiment of the present application, controlling the display of the first interface of the first application includes one or more of the following operations: prohibiting the running of the first application, prohibiting the display of the first interface, processing the first interface to reduce its appeal to users (such as adding a mask to the first interface), outputting safety prompts, outputting safety guidance, and setting the first display area of the first application so that the set first display area is away from the user in the main driving seat, thereby achieving the presentation of the first application away from the user in the main driving seat.

In an embodiment of the present application, after the above-mentioned management and control are performed, the interface of the first application is not displayed on the display screen (i.e., the first application exits), and/or the first interface is not displayed, and/or the first interface and the mask on the first interface are displayed, and/or the display of safety instructions is controlled, and/or the controls corresponding to the safety instructions are displayed, and/or the first interface is displayed on the set first display area.

Exemplarily, as shown in (a) of FIG. 7 , the vehicle computer obtains a first input during vehicle driving, and the first input indicates starting a video application. As shown in (b) of FIG. 7 , after the vehicle computer determines that the video application is dangerous and controls the video application, the vehicle computer suspends the running of the video application, adds a mask 74 to the interface (first interface) of the video application, and displays a safety instruction 75 “affects safe driving, not recommended to start” on the mask 74, and displays a control 76 “Exit” corresponding to the safety instruction. When the user touches the control 76, the mask, safety prompt and video application are exited, and the display screen can display the main interface 71.

In some embodiments, the vehicle computer executes steps S501 and S502, and the vehicle computer transmits the obtained first input and the determined first user to the cloud server. The cloud server can refer to the relevant content of the above step S503 to determine the first attribute (determine whether to control the interface display of the application). The cloud server can refer to the content of the above step S504 to control the interface display of the first application. Then the processing results that can be output after the cloud server controls may include one or more of the following: a first instruction, a second instruction, a third instruction, a fourth instruction, a fifth instruction, and a sixth instruction, wherein the first instruction is used to instruct to suspend the operation of the first application, the second instruction is used to instruct to add a mask on the first interface, the third instruction is used to instruct to output a safety instruction, the fourth instruction is used to instruct to output a safety guide, the fifth instruction is used to instruct to set the first display area as a display area away from the main driving seat, and the sixth instruction is used to instruct to prohibit the display of the first interface. After receiving the above first instruction, the vehicle computer suspends the operation of the first application and controls the output device to suspend the output of the interface or audio of the first application. After receiving the above second instruction, the vehicle computer controls to add a mask on the first interface, and controls the display screen to display the first interface and the mask. After receiving the third instruction, the vehicle computer controls the display screen to output a safety instruction. After receiving the fourth instruction, the vehicle computer controls the display screen to output a control corresponding to the safety instruction. After receiving the fifth instruction, the vehicle computer sets the first display area away from the main driver's seat. After receiving the sixth instruction, the vehicle computer prohibits displaying the first interface.

In other embodiments, the vehicle computer executes steps S501 and S502, the vehicle computer transmits the obtained first input and the determined first user to the cloud server, the cloud server executes step S503, the cloud server sends the first attribute of the first application to the vehicle computer, and the vehicle computer executes step S504.

In some embodiments, after the vehicle computer obtains the first user who inputs the first input in step S502, the vehicle computer sets the first display area of the first application according to the first user and the proximity display principle, so that the set first display area is close to the first user.

The proximity display principle is used to set the first display area of the first application program close to the first user who inputs the first input. For example, when the first user is the co-driver, the vehicle computer can set the first display area in the area of the central control screen close to the co-driver according to the pre-stored position relationship.

In some embodiments, after step S502 and before step S503, the vehicle computer sets the first display area of the first application according to the first user and the proximity display principle, so that the set first display area is close to the first user.

In some embodiments, the safe driving service is implemented to control the first application when the first attribute is a dangerous attribute. After the vehicle computer starts the safe driving service, the safe driving service can refer to the above step S504 content to control the display of the first interface of the first application.

Now, in the prior art, corresponding application services are provided in direct response to application service requests during vehicle driving. This application will first determine the first attribute of the first application, and then perform corresponding processing according to the first attribute. If the first attribute is a dangerous attribute, the first application is safely processed, that is, the display of the first interface is controlled to reduce or avoid direct or indirect impact on the main driver, thereby ensuring driving safety. If the first attribute is a safe attribute, the application service corresponding to the first application can be provided. Furthermore, the first attribute of the first application is determined according to the first user who inputs the first input, so that services can be provided to the corresponding users in a more intelligent and humane way. If the user is in the main driving seat, driving safety is given priority. If the user is not in the main driving seat, the corresponding application service is provided without affecting driving safety.

Please refer to FIG. 8 for an exemplary introduction to another application management method provided in an embodiment of the present application.

Step S101: the vehicle computer obtains a first input, where the first input is used to instruct to run a first application.

The content of step S101 may refer to the above step S501 and will not be described in detail here.

Step S102: In response to obtaining a first input during vehicle driving, the vehicle computer obtains a first user who inputs the first input.

The content of step S102 may refer to the above step S502 and will not be described in detail here.

Step S103: When the first input triggers the split screen, the vehicle computer sets the first display area of the first application according to the first user and the proximity display principle, so that the first display area is close to the first user.

In an embodiment of the present application, the situation in which the first input triggers the split screen includes, but is not limited to, the following: interface A is being displayed on the display screen, and the interface A is not the interface of the first application. For example, if it is the interface of another application, if the first interface of the first application indicated by the first input will also be displayed on the display screen, then the first input triggers the split screen. Alternatively, the vehicle computer triggers the split screen in response to obtaining the first input when the vehicle uses the navigation service. The vehicle's use of the navigation service includes displaying a navigation interface on the display screen of the vehicle computer, or running an application that provides the navigation service in the background of the vehicle computer, displaying other interfaces on the display screen (central control screen) of the vehicle computer, and the other interfaces may be interfaces or main interfaces of other applications, etc., the audio output device of the vehicle computer broadcasts the navigation audio, and the first input indicates that the interface of the first application is also presented on the central control screen, triggering the split screen.

Wherein, it is detected that the output device of the vehicle outputs navigation information such as broadcasting navigation voice and/or presenting navigation interface, and it is determined that the vehicle uses navigation service. If the navigation interface is being presented on the display screen and/or the navigation voice is broadcast through the audio output device, it is determined that the vehicle uses navigation service. In some embodiments, the vehicle computer can determine whether the running application is in the navigation state, and if so, the vehicle uses the navigation service. Exemplarily, the vehicle computer communicates with the application through an interface, and determines whether the application is in the navigation state through the IsNavigating() function.

For example, a map application is running on the vehicle computer, and a navigation interface is displayed on the display screen. The first user clicks the icon of the first application on the display screen, and the vehicle computer calls startActivity() to start the first application. It is determined whether the map application running on the vehicle computer is in the navigation state by calling the IsNavigating() function. If not, the first application is started in full screen mode. If so, the first application is started in split screen mode.

Among them, launching the first application in full-screen mode means that the first interface of the first application is displayed in full screen on the display screen. Split-screen mode means that the display screen is split and two split-screen windows are presented, such as two left and right split-screen windows. Launching the first application in split-screen mode means that the first interface of the first application is split and displayed in a split-screen window on the display screen, and the other split-screen window on the display screen is used to present the interface displayed on the display screen before the split-screen (i.e., before receiving the first input).

When the first application is started in split-screen mode, the first display area of the first application is set according to the first user and the principle of nearest display. For example, when the central control screen is displaying the navigation interface, the first input of the first user is received, and the first input triggers the split screen. The area on the central control screen close to the first user is the left side of the central control screen, then the central control screen is divided into two split-screen windows on the left and right, and the interface of the first application is displayed in the split-screen window close to the first user, that is, the first display area position of the first application is set to the left side of the central control screen (the split-screen window close to the first user), such as HW_MULTI_WINDOWING_MODE_LEFT. Correspondingly, the navigation interface is displayed in another split-screen window away from the first user, and the window position of the navigation interface of the map application is set to the right side of the central control screen, such as HW_MULTI_WINDOWING_MODE_RIGHT.

For example, after the car computer sets the window positions of the first interface and the navigation interface, the first application and the map application enter the split-screen guidance, and ActivityManagerEx.setStartToSplit() is used to set whether the application supports split-screen, and isStartToSplit is used to determine whether it is in split-screen state, and MainActivity's onMultiWindowModeChanged (boolean isInMultiWindowMode) is used for monitoring. The example of determining whether it is in split-screen state through isStartToSplit is as follows:
public boolean isStartToSplit(){
return mIsStartToSplit;}

The return result mIsStartToSplit indicates that the screen is in split state. If the return result is fault, it indicates that the screen is not in split state.

The specific implementation of launching the first application in full screen mode can refer to the prior art and will not be repeated here. After the vehicle computer sets the first display area of the first application according to the first user and the principle of nearby display, the specific implementation of launching the first application in split screen mode can refer to the prior art and will not be repeated here.

Step S104: The vehicle computer determines a first attribute of the first application.

In the above steps, the first input triggers the split screen, and the first display area of the first application is close to the first user. In step S104, the first attribute can be determined by referring to the above first condition or the second condition.

Specifically, as in the above example, the first interface is set to be displayed on the left side of the central control screen, and the navigation interface is set to be displayed on the right side of the central control screen. The vehicle computer determines the first attribute of the first application according to the first user. When the first user is in the main driving seat, the vehicle computer can refer to the content of the above first condition to determine the first attribute, which will not be repeated here. If the first user is not in the main driving seat, the vehicle computer can refer to the content of the above second condition to determine the first attribute, which will not be repeated here.

Step S105: When the first attribute is a dangerous attribute, the vehicle computer controls the first application.

Step S105 may refer to the content of the above-mentioned step S504, which will not be repeated here.

For example, the display screen 21 is used as the central control screen, the first user is the main driver, and the vehicle computer pre-stores the position relationship including the main driver being located on the left side of the central control screen. As shown in FIG9A , the navigation interface 111 and the main interface icon 112 are displayed on the central control screen. The main driver clicks the main interface icon 112, and the main interface 71 shown in FIG9B is displayed. At this time, the vehicle is still using the navigation service. The icon 73 of the video application is displayed on the main interface 71. The main driver clicks the icon 73 of the video application. The central control screen detects the first input (clicking the icon of the video application) and transmits the first input to the vehicle computer. The vehicle computer triggers the split screen in response to obtaining the first input when the vehicle uses the navigation service. The vehicle computer sets the first display area according to the principle of the main driver and the nearest display, and sets the first display area to the left side of the central control screen based on the position relationship between the main driver and the central control screen, so that the first display area is close to the main driver. The vehicle computer determines that the first attribute of the first application is a dangerous attribute by referring to the content of the first condition or the second condition above, then the vehicle computer suspends the operation of the first application, sets a mask on the first interface, and outputs safety prompts and safety guidance. As shown in FIG9C , the right area of the central control screen displays the interface before the split screen (main interface 71), and the first display area is located in the left area of the central control screen. The first interface and the mask 113 are displayed on the first display area. The safety prompt 114 "Affects safe driving, not recommended to start" and the control 115 "Exit" and control 116 "Interface swap" corresponding to the safety guidance are displayed on the mask 113. The user clicks on the control 116 "Interface swap", and the vehicle computer responds to the user clicking on the interface swap control 116 by swapping the display areas of the first interface and the main interface 71. As shown in FIG9D , the main interface 71 is displayed on the left area of the central control screen, and the first display area is located in the right area of the central control screen. The first interface 117 is displayed on the first display area, and the first interface 117 is unmasked.

For another example, as shown in the above example FIG9A, the navigation interface 111 is displayed on the central control screen, and the vehicle computer receives a first input, and the first input is that the user of the main driver casts the video interface on the mobile phone to the central control screen of the vehicle computer. The vehicle computer triggers the split screen in response to obtaining the first input when the vehicle uses the navigation service. The vehicle computer sets the first display area to be located on the left side of the central control screen according to the positional relationship between the main driver and the central control screen, so that the first display area is close to the main driver. The vehicle computer determines that the first attribute of the first application is a dangerous attribute by referring to the content of the above first condition or the second condition, then the vehicle computer suspends the operation of the first application, sets a mask on the first interface, and outputs safety prompts and safety guidance. As shown in FIG9E, the right area of the central control screen displays the interface before the split screen (navigation interface 111), the first display area is located in the left area of the central control screen, the first interface and the mask 113 are displayed on the first display area, and the safety prompt 114 "affects safe driving, not recommended to start" and the control 115 "exit" and control 116 "interface swap" corresponding to the safety guidance are displayed on the mask 113. The user clicks on the control 116 "Interface Swap", and the vehicle computer responds to the user clicking on the interface swap control 116 by swapping the display areas of the first interface and the navigation interface 111. As shown in FIG9F , the navigation interface 111 is displayed in the left area of the central control screen, and the first display area is located in the right area of the central control screen, and the first interface 117 (video interface) is displayed on the first display area.

As shown in the application management method of FIG. 5 and FIG. 8, the control corresponding to the vehicle computer safety guidance is the control 76 shown in (b) of FIG. 7 or the control 115 and the control 116 shown in FIG. 9C and FIG. 9E. The user inputs the control corresponding to the safety guidance, the vehicle computer obtains a second input to the control, and then exits the first application in response to the second input, and/or, in response to the second input, when the first display area of the first application is close to the user in the main driving seat, the first display area is set away from the user in the main driving seat.

In an embodiment of the present application, after the vehicle computer starts the safe driving service, the present application will also monitor the running process of the application. The application management method shown in Figure 5 or Figure 8 above may also include the following steps: the vehicle computer obtains a third input, wherein the third input is used to indicate that the display area of the first interface on the display screen and the display area of the second interface on the display screen are interchanged, so that the display area of the first interface is close to the user in the main driving seat, wherein the first interface is the interface of the first application, and the second interface is not the interface of the first application. The vehicle computer obtains the first attribute of the first application, and when the first attribute is a dangerous attribute, it is determined that the interface of the first application is to be managed. In response to the third input, the vehicle computer performs one or more of the following operations: outputting a safety indication (used to indicate that the operation of the third input will affect driving safety), outputting a safety guide (used to guide the user to exit the operation of the third input) and prohibiting interchange.

Exemplarily, taking the first application as a video application and the main driver's seat being located on the left side of the display screen as an example, please refer to (a) in FIG. 10 . The navigation interface 121 is displayed on the left area of the display screen 21 (the side close to the main driver's seat). The navigation interface 121 is not the interface of the video application. The first interface 122 of the video application is displayed on the right area of the display screen 21 (the side away from the main driver's seat). The user inputs a third input 123 to the display screen 21, such as swapping three fingers, to indicate that the content of the first interface 122 is displayed on the side close to the main driver's seat. After the vehicle computer detects the third input 123, based on the first attribute of the video application being a dangerous attribute (i.e., it has been determined that the interface display of the video application needs to be controlled), the vehicle computer outputs a safety instruction, as shown in (b) in FIG. 10 , and presents a safety prompt 124 "It affects safe driving, and swapping is not recommended."

In other embodiments, the application management method shown in Figure 5 or Figure 8 above may also include the following steps: the vehicle computer obtains a fourth input, wherein the fourth input is used to instruct the first application to play audio at a first volume value; when the first volume value is greater than or equal to a preset threshold, one or more of the following operations are performed: outputting a safety indication (used to indicate that the operation of the third input will affect driving safety), outputting safety guidance (used to guide the user to exit the operation of the third input), and prohibiting the first application from playing audio at the first volume value.

It can be understood that the prompt form and text corresponding to the safety instructions involved in this application can be set according to actual conditions, such as the safety instruction output by the vehicle computer in response to the third input can be "affects safe driving, swap is not recommended", and the safety instruction output by the vehicle computer in response to the fourth input can be "affects safe driving, it is not recommended to increase the audio". Accordingly, the guidance content and controls corresponding to the safety instructions involved in this application can be set according to actual conditions, and this application does not make specific limitations on this.

Please refer to Figure 11, which exemplifies the vehicle-mounted device 130 of the present application. The vehicle-mounted device 130 can be used to execute the above-mentioned application management method of the present application. The vehicle-mounted device 130 includes an input acquisition module 131, a first user acquisition module 132, a judgment module 133 and a management module 134.

The above-mentioned input acquisition module 131, the first user acquisition module 132, the judgment module 133 and the control module 134 can be deployed in corresponding devices according to actual conditions, such as all the above-mentioned modules are deployed on the vehicle computer or all are deployed on the cloud server, or, the above-mentioned input acquisition module 131 and the first user acquisition module 132 are deployed on the vehicle computer, and the judgment module 133 and the control module 134 are deployed on the cloud server. This application does not make any specific limitations.

The input acquisition module 131 is used to acquire a first input, wherein the first input is used to indicate that a first interface of a first application is displayed on a display screen of the vehicle. The first user acquisition module 132 is used to acquire a first user who inputs the first input in response to obtaining the first input during the driving of the vehicle. The judgment module 133 is used to judge whether to control the interface display of the first application according to the first user. The control module 134 is used to control the display of the first interface of the first application when the judgment result is yes.

In some embodiments, the judgment module includes: a first judgment unit, used to control the interface display of the first application when it is determined that the first condition is met, and the first condition includes that the first user is in the main driving seat.

In some embodiments, the first condition also includes: the first application belongs to a preset first list, or the first application does not belong to a preset second list, or the type of the first application belongs to a preset first type list, or the type of the first application does not belong to a preset second type list; the first list is used to record the applications to be controlled, the first type list is used to record the types of applications to be controlled, the second list is used to record applications that are not to be controlled, and the second type list is used to record the types of applications that are not to be controlled.

In some embodiments, the judgment module includes: a second judgment unit, used to control the interface display of the first application when it is determined that a second condition is met, and the second condition includes that the first user is not in the main driving seat and the first display area of the first application is close to the main driving seat.

In some embodiments, the management and control module performs management and control including one or more of the following operations:

Prohibit the running of the first application, prohibit the display of the first interface, add a mask to the first interface, output safety instructions, output safety guidance, and set the first display area of the first application so that the set first display area is away from the user in the main driving seat.

Please refer to Figure 12, which exemplifies the vehicle-mounted device 140 provided by the present application, and the vehicle-mounted device 140 can be used to execute the application management method of the present application mentioned above. The vehicle-mounted device 140 can be a car computer, etc. The vehicle-mounted device 140 may include: a display screen 1401, one or more processors 1402, one or more memories 1403, one or more computer programs 1404, a communication module 1405, an input device 1407, and an output device 1408; the above-mentioned devices may be connected via one or more communication buses 1406. Among them, the display screen 1401 can be used to display the first interface, or the interface of an application from other devices. The processor 1402 can be used to implement the content of the above-mentioned processing module. The input device 1407 can be used to implement the content of the above-mentioned input module. The output device can be used to implement the content of the above-mentioned output module.

Among them, one or more computer programs 1404 are stored in the above-mentioned memory 1403 and are configured to be executed by the one or more processors 1402. The one or more computer programs 1404 include instructions, and the above-mentioned instructions can be used to execute the various steps in Figures 5 and 8 and the corresponding embodiments.

The embodiments of the present application do not specifically limit the specific structure of the execution subject of the method provided in the embodiments of the present application, as long as it can communicate according to the method provided in the embodiments of the present application by running a program that records the code of the method provided in the embodiments of the present application. For example, the execution subject of the method provided in the embodiments of the present application may be an on-board device, or a functional module in the on-board device that can call and execute a program.

An embodiment of the present application provides a terminal, including a processor, the processor is coupled to a memory, and the processor is used to execute a computer program or instruction stored in the memory, so that the terminal implements the application management method as described above.

An embodiment of the present application provides a cloud platform, including a processor, which is coupled to a memory, and the processor is used to execute a computer program or instruction stored in the memory, so that the cloud platform implements the application management and control method as described above.

The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the application management and control method of the application program in the above-mentioned method embodiments.

An embodiment of the present application also provides a computer storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the application management method as described in the above embodiment.

Among them, the electronic device, computer storage medium, computer program product or chip system provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.

Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and the component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

The above are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application.

Claims

An application management and control method, characterized in that the method comprises:

Obtaining a first input, wherein the first input is used to instruct to display a first interface of a first application on a display screen of the vehicle;

In response to obtaining the first input during the driving of the vehicle, obtaining a first user who inputs the first input;

Determining whether to control the interface display of the first application according to the first user;

When the judgment result is yes, the display of the first interface of the first application is controlled.
The application management method according to claim 1, wherein determining whether to manage the interface display of the first application according to the first user comprises:

When it is determined that a first condition is met, the interface display of the first application is controlled, and the first condition includes that the first user is in the main driving seat.
The application management method according to claim 2, wherein the first condition further comprises:

The first application belongs to a preset first list, or the first application does not belong to a preset second list, or the type of the first application belongs to a preset first type list, or the type of the first application does not belong to a preset second type list; the first list is used to record applications to be controlled, the first type list is used to record types of applications to be controlled, the second list is used to record applications that are not to be controlled, and the second type list is used to record types of applications that are not to be controlled.
The application management method according to claim 1, wherein determining whether to manage the interface display of the first application according to the first user comprises:

When it is determined that the second condition is met, the interface display of the first application is controlled, and the second condition includes that the first user is not in the main driving seat and the first display area of the first application is close to the main driving seat.
The application management method according to claim 4, characterized in that the first display area of the first application program close to the main driving seat includes:

The first display area is an area on the display screen close to the main driving seat; or,

The vehicle includes N display screens, and the first display area is displayed on a display screen close to the main driving seat among the N display screens, where N is an integer greater than or equal to 2.
The application management method according to any one of claims 1 to 5, characterized in that after obtaining the first user who inputs the first input and before determining whether to manage the interface display of the first application according to the first user, the method further includes:

A first display area of the first application is set according to the first user, so that the set first display area is close to the first user.
The application management method according to claim 6, wherein setting the first display area of the first application according to the first user comprises:

When the first input triggers the split screen, the split screen window close to the first user is used as the first display area of the first application.
The application management method as described in claim 7 is characterized in that when the vehicle uses a navigation service, the first input triggers a split screen.
The application management method according to any one of claims 1 to 8, wherein the controlling the display of the first interface of the first application program comprises one or more of the following operations:

Prohibit the running of the first application, prohibit the display of the first interface, add a mask to the first interface, output safety instructions, output safety guidance, and set the first display area of the first application so that the set first display area is away from the user in the main driving seat.
The application management method according to claim 9, wherein the outputting of the safety guidance comprises: displaying a control corresponding to the safety guidance on the display screen, and the method further comprises:

Obtaining a second input to the control;

In response to the second input, the first application is exited, and/or, when the first display area of the first application is close to the user in the main driving seat, the first display area of the first application is set so that the set first display area is away from the user in the main driving seat.
The application management method according to any one of claims 1 to 10, characterized in that the method further comprises:

obtaining a third input, wherein the third input is used to instruct to swap a display area of the first interface on the display screen with a display area of the second interface on the display screen, so that the display area of the first interface is close to the user in the main driving seat, wherein the second The interface is not the interface of the first application;

When the judgment result is yes, in response to the third input, one or more of the following operations are performed:

Output safety instructions, output safety guidance and prohibition of interchange.
The application management method according to any one of claims 1 to 11, characterized in that the method further comprises:

Obtaining a fourth input, wherein the fourth input is used to instruct the first application to play audio at a first volume value;

When the first volume value is greater than or equal to a preset threshold, one or more of the following operations are performed:

Outputting a safety indication, outputting a safety guide, and prohibiting the first application from playing audio at the first volume value.
The application management method according to any one of claims 1 to 12, characterized in that obtaining the first user who inputs the first input comprises:

Obtaining a first time of inputting the first input;

Acquire first data in the smart cockpit of the vehicle, wherein a collection time of the first data is associated with the first time, and the first data includes one or more of the following data: voice data, image data, and sensor data;

A first user who inputs the first input is acquired according to the first data.
A vehicle-mounted device, characterized by comprising:

An input acquisition module, configured to acquire a first input, wherein the first input is used to instruct to display a first interface of a first application on a display screen of the vehicle;

A first user acquisition module, configured to acquire a first user who inputs the first input in response to obtaining the first input during the driving of the vehicle;

A determination module, configured to determine whether to control the interface display of the first application according to the first user;

A management and control module is used to manage and control the display of the first interface of the first application when the judgment result is yes.
The vehicle-mounted device according to claim 14, wherein the determination module comprises:

The first judgment unit is used to control the interface display of the first application when it is determined that a first condition is met, and the first condition includes that the first user is in the main driving seat.
The vehicle-mounted device as described in claim 15 is characterized in that the first condition also includes: the first application belongs to a preset first list, or the first application does not belong to a preset second list, or the type of the first application belongs to a preset first type list, or the type of the first application does not belong to a preset second type list; the first list is used to record applications to be controlled, the first type list is used to record the types of applications to be controlled, the second list is used to record applications that are not to be controlled, and the second type list is used to record the types of applications that are not to be controlled.
The vehicle-mounted device according to claim 14, wherein the determination module comprises:

The second judgment unit is used to control the interface display of the first application when it is determined that a second condition is met, and the second condition includes that the first user is not in the main driving seat and the first display area of the first application is close to the main driving seat.
The vehicle-mounted device according to claim 14, wherein the control module performs control including one or more of the following operations:

Prohibit the running of the first application, prohibit the display of the first interface, add a mask to the first interface, output safety instructions, output safety guidance, and set the first display area of the first application so that the set first display area is away from the user in the main driving seat.
A vehicle-mounted device, characterized in that it includes at least one processor and a memory, wherein the at least one processor is coupled to the memory and is used to read and execute instructions in the memory to execute the application management method as described in any one of claims 1 to 13.
A vehicle, characterized by comprising the vehicle-mounted device as claimed in claim 19.
A computer-readable medium, characterized in that the computer-readable medium stores program code, and when the computer program code runs on a computer, the computer executes the application management method as described in any one of claims 1 to 13.
A computer program product, characterized in that when the computer program product is run on a computer, the computer is caused to execute the application management and control method as described in any one of claims 1 to 13.