WO2023092746A1 - Vehicle control method based on mobile terminal, and device and storage medium - Google Patents

Abstract

A vehicle control method based on a mobile terminal, and an electronic device and a computer-readable storage medium. The vehicle control method based on a mobile terminal comprises: presenting, at a mobile terminal, a stereoscopic virtual model of a vehicle to a user (S210); determining a part on the stereoscopic virtual model that is selected by the user, and then determining a device corresponding to the selected part on the basis of a mapping relationship between the stereoscopic virtual model and the vehicle (S220); and communicating with the vehicle so as to acquire information related to the device or to control same (S230).

Description

Method, device and storage medium for controlling vehicle based on mobile terminal

Cross References to Related Applications

This application claims the priority and benefit of Chinese Patent Application No. 202111462749.4 filed with the China National Intellectual Property Administration (CNIPA) on November 29, 2021, which is hereby incorporated by reference in its entirety.

technical field

The present application relates to the technical field of automobiles, and in particular, relates to a method for controlling a vehicle based on a mobile terminal, an electronic device, and a computer-readable storage medium.

Background technique

In a traditional solution for controlling the vehicle-mounted device, the driver or passenger is required to manually manipulate the buttons on the vehicle-mounted device to realize the control of the vehicle-mounted device. However, with the continuous iterative update of vehicle technology, the functions of the vehicle-mounted equipment are increasingly diversified, which results in an increasing number of buttons for controlling the vehicle-mounted equipment to realize different functions. There are too many buttons on the vehicle-mounted equipment, which directly affects the convenience of the driver or passenger to operate the vehicle-mounted equipment.

With the rapid development of Internet of Vehicles technology, the interaction between users and vehicles is becoming more and more diversified. Users hope to interact with vehicles in more convenient ways such as mobile terminals, so as to control the vehicle or realize information interaction.

Contents of the invention

An object of the present application is to provide a method for controlling a vehicle based on a mobile terminal, an electronic device, and a computer-readable storage medium. By presenting a three-dimensional virtual model of the vehicle to the user on the mobile terminal, the user can intuitively browse and view the vehicle based on the three-dimensional virtual model. Select the corresponding device on the vehicle to obtain relevant information of the corresponding device or control the corresponding device, so that the user can conveniently operate the vehicle device.

Another object of the present application is to provide a vehicle control method, electronic equipment, and computer-readable storage medium, by setting different user levels for mobile terminals and allowing mobile terminals whose user level is the owner level to remotely control vehicle equipment or query Vehicle equipment information, so as to provide convenient and fast vehicle equipment control experience for car owners, for example.

Another object of the present application is to provide a vehicle control method, electronic equipment, and computer-readable storage medium, by setting different user levels for mobile terminals and allowing mobile terminals of a specific level to control vehicle equipment at close range or query vehicle equipment information Information, so as to provide convenient and fast vehicle equipment control experience for car owners and passengers, for example.

According to the first aspect of the present application, there is provided a method for controlling a vehicle based on a mobile terminal, the method comprising: presenting a three-dimensional virtual model of the vehicle to the user on the mobile terminal; Selected parts on the model and determine the equipment corresponding to the selected parts based on the mapping relationship between the three-dimensional virtual model and the vehicle; and communicate with the vehicle to obtain relevant information of the equipment or The above equipment is controlled.

In some implementations, presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal includes: determining that the mobile terminal is within a predetermined distance range of the vehicle and that the mobile terminal is outside the vehicle, providing the user with a user interface to enter an interface displaying the 3D virtual model; and presenting the user with an exterior 3D virtual model of the vehicle in response to the user clicking the user interface.

In some embodiments, presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal further includes: in response to determining that the mobile terminal moves from the exterior of the vehicle to the interior of the vehicle, presenting to the user The presented stereoscopic virtual model is switched from the exterior stereoscopic virtual model to the interior stereoscopic virtual model of the vehicle.

In some implementations, presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal includes: determining that the mobile terminal is within a predetermined distance range of the vehicle and that the mobile terminal is inside the vehicle, providing the user with a user interface to access an interface displaying the 3D virtual model; and presenting the user with an interior 3D virtual model of the vehicle in response to the user clicking the user interface.

In some embodiments, presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal further includes: in response to determining that the mobile terminal moves from the interior of the vehicle to the exterior of the vehicle, presenting to the user The presented stereoscopic virtual model is switched from the interior stereoscopic virtual model to the exterior stereoscopic virtual model of the vehicle.

In some implementations, communicating with the vehicle to obtain information about the device or to control the device includes: communicating with the vehicle through a near-field connection technology to obtain information about the device or The device is controlled, wherein the near-field connection technology includes at least one of Bluetooth connection technology, UWB connection technology and Wi-Fi connection technology.

In some embodiments, presenting the 3D virtual model of the vehicle to the user includes: receiving an instruction from the user, and presenting the 3D virtual model of the vehicle to the user according to the instruction, wherein the 3D virtual The model includes at least one of a three-dimensional virtual model outside the vehicle and a three-dimensional virtual model inside the vehicle.

In some embodiments, communicating with the vehicle to obtain relevant information of the device or to control the device includes: connecting to a cloud server through a wireless network, so as to establish a connection between the mobile terminal and the device through the cloud server. a communication link between the vehicles; and acquiring relevant information of the device or controlling the device via the communication link.

In some embodiments, presenting the 3D virtual model of the vehicle to the user on the mobile terminal further includes: adjusting or changing the presentation angle of the 3D virtual model based on the user's operation on the 3D virtual model, wherein , the operation includes at least one of rotation, sliding, zooming in, and zooming out.

According to the second aspect of the present application, there is also provided an electronic device, including: at least one processor; and a memory connected in communication with the at least one processor; wherein, the memory stores information that can be processed by the at least one processor. Instructions executed by a processor, the instructions are executed by the at least one processor, so that the at least one processor can execute the method of the first aspect of the present application.

According to the third aspect of the present application, there is also provided a non-transitory computer-readable storage medium on which machine-executable instructions are stored, and when executed, the machine-executable instructions cause a machine to perform the first aspect of the present application Methods.

According to the fourth aspect of the present application, there is also provided a vehicle control method, the method comprising: receiving a query instruction or a control instruction from a user mobile terminal via a cloud server; determining the user level of the user mobile terminal; and responding to the Determining that the user level of the user mobile terminal is the vehicle owner level, providing relevant information obtained based on the query instruction to the user mobile terminal or controlling the vehicle to perform corresponding operations according to the control instruction.

According to a fifth aspect of the present application, there is also provided a vehicle control method, the method comprising: detecting a user mobile terminal within a predetermined distance from the vehicle; determining the relative distance between the detected user mobile terminal and the vehicle The location of the user and the user level of the user mobile terminal; and based on the determined location and user level, determine whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface to the user.

In some implementations, detecting a user mobile terminal within a predetermined distance range of the vehicle includes: detecting a user mobile terminal within a predetermined distance range of the vehicle based on near-field connection technology or GNSS high-precision positioning technology, wherein, The near field connection technology includes at least one of Bluetooth connection technology, UWB connection technology and Wi-Fi connection technology.

In some implementations, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is in The exterior of the vehicle and the user level is the owner level, sending a notification message to the user mobile terminal, so that the user mobile terminal provides the user with a user interface for entering an interface displaying the three-dimensional virtual model outside the vehicle.

In some embodiments, the method further includes: receiving a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model outside the vehicle through the user interface; and based on the query instruction or the A control instruction, providing relevant information obtained based on the query instruction to the user mobile terminal, or controlling the vehicle to perform a corresponding operation according to the control instruction.

In some implementations, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is in The exterior of the vehicle and the user level is not the owner level, interrupting communication with the user mobile terminal.

In some implementations, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface to the user includes: in response to determining that the user mobile terminal is in Inside the vehicle and the user level is the owner level or the passenger level, a notification message is sent to the user's mobile terminal, so that the user's mobile terminal provides the user with a user interface for entering an interface displaying a three-dimensional virtual model in the vehicle.

In some embodiments, the method further includes: receiving a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model in the vehicle through the user interface, and based on the query instruction or the A control instruction, providing relevant information acquired based on the query instruction to the user mobile terminal or controlling the vehicle to perform a corresponding operation according to the control instruction.

In some embodiments, the method further includes: providing the user with a vehicle-mounted display user interface through a display device of the vehicle; in response to the user clicking the vehicle-mounted display user interface, displaying the three-dimensional interior of the vehicle virtual model; and based on the query command or control command input by the user on the interface displaying the three-dimensional virtual model in the vehicle, feedback relevant information obtained based on the query command to the user, or execute according to the control command Operate accordingly.

According to the sixth aspect of the present application, there is also provided an electronic device, including: at least one processor; and a memory connected in communication with the at least one processor; wherein, the memory stores information that can be processed by the at least one processor. Instructions executed by a processor, the instructions are executed by the at least one processor, so that the at least one processor can execute the method of the fourth aspect or the fifth aspect of the present application.

According to the seventh aspect of the present application, there is also provided a non-transitory computer-readable storage medium, on which machine-executable instructions are stored, and when executed, the machine-executable instructions cause a machine to perform the fourth aspect of the present application or the method of the fifth aspect.

It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the application, nor is it intended to limit the scope of the application. Other features of the present application will be easily understood from the following description.

Description of drawings

The above and other advantages of embodiments of the present application will become apparent from the detailed description with reference to the following drawings, which are intended to illustrate exemplary embodiments of the present application rather than limit them. In the attached picture:

FIG. 1A and FIG. 1B respectively schematically show an exemplary system architecture suitable for applying a method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application;

2 to 3D schematically show a flow chart of a method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application;

FIG. 4 schematically shows a flowchart of a vehicle control method according to an exemplary embodiment of the present application;

5 to 6D schematically show a flow chart of a vehicle control method according to an exemplary embodiment of the present application;

FIG. 7 schematically shows a block diagram of an electronic device suitable for implementing an exemplary embodiment of the present application; and

8A to 8C schematically illustrate interfaces of a mobile terminal according to an exemplary embodiment of the present application.

Detailed ways

For a better understanding of the application, various aspects of the application will be described in more detail with reference to the accompanying drawings. It should be understood that these detailed descriptions are descriptions of exemplary embodiments of the application only, and are not intended to limit the scope of the application in any way. In addition, descriptions of features that are known in the art may be omitted for increased clarity and conciseness.

Throughout the drawings and detailed description, like reference numerals refer to like elements. The drawings may not be drawn to scale and the relative size, proportion and depiction of elements in the drawings may be exaggerated for purposes of clarity, illustration and convenience.

It should also be understood that the terms "comprises", "comprises", "has", "comprises" and/or "comprising", when used in this specification, means that there are stated features, integers, steps, operations , elements and/or parts, but does not exclude the existence or addition of one or more other features, integers, steps, operations, elements, parts and/or their groups. Furthermore, expressions such as "at least one of," when preceding a list of listed features, modify the entire listed feature and do not modify the individual elements of the list. In addition, when describing the embodiments of the present application, the use of "may" means "one or more embodiments of the present application". Also, the word "exemplary" is intended to mean an example or illustration.

Unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It should also be understood that terms (such as those defined in commonly used dictionaries) should be interpreted to have meanings consistent with their meanings in the context of the relevant technology, and will not be interpreted in an idealized or overly formalized sense, Unless expressly so limited herein.

Various aspects of the application will be described in more detail below with reference to the accompanying drawings.

In some related technologies, there have been examples of using smart phones to control different devices on vehicles, for example, to realize the control of different devices on vehicles through remote control of mobile phones or "one-finger connection" technology of mobile phones. Although the mobile phone remote control solution allows the car owner to control some of the equipment on the vehicle, due to the unintuitive operation interface, the car owner cannot remotely control more equipment on the vehicle. In addition, the remote control solution can only authorize the vehicle owner to control the vehicle, and passengers cannot control different devices on the vehicle or read information through related applications. The mobile phone "one finger link" technical solution can realize the positioning and directivity of the mobile phone to the remote-controlled device by using the mobile phone's own UWB multi-antenna positioning. However, this solution requires the mobile phone to have a special UWB multi-antenna structure, which greatly limits its standard application and popularity. In addition, the "one-finger link" technology of mobile phones can only be used in the near-field range, which makes the usage scenarios more limited.

In order to at least partly solve one or more of the above problems and other potential problems, exemplary embodiments of the present application propose a solution for controlling a vehicle based on a mobile terminal. In this solution, by presenting the three-dimensional virtual model of the vehicle to the user on the mobile terminal, the user can intuitively browse and select the corresponding equipment on the vehicle based on the three-dimensional virtual model, so as to obtain relevant information about the corresponding equipment or control the corresponding equipment , so that the user can conveniently operate the vehicle equipment. According to the solution for controlling a vehicle based on a mobile terminal provided in an exemplary embodiment of the present application, the driver and passengers can be provided with the ability to quickly and conveniently control vehicle equipment. Drivers and passengers do not need to use physical buttons on the vehicle or virtual buttons on the screen, but can directly select the vehicle equipment to be controlled on the three-dimensional virtual model of the vehicle presented on the mobile terminal to control or query the vehicle equipment Information about vehicle equipment.

FIG. 1A and FIG. 1B respectively show exemplary system architectures 100a and 100b suitable for applying the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application.

As shown in FIGS. 1A and 1B , the system architecture may include a mobile terminal 110 and a vehicle 120 . The mobile terminal 110 may include, but is not limited to, a smartphone, a smart watch, a laptop, a personal digital assistant, and the like. Various client applications can be installed on the mobile terminal 110, such as vehicle control applications, news applications, web browser applications, search applications, and so on.

The mobile terminal 110 can communicate with the vehicle 120 through various wired or wireless communication links. The manner in which the mobile terminal 110 communicates with the vehicle 120 may depend to some extent on the distance between the mobile terminal 110 and the vehicle 120 .

In the scenario shown in FIG. 1A , when the distance between the mobile terminal 110 and the vehicle 120 exceeds the available distance of the near-field connection technology, the mobile terminal 110 can communicate with the vehicle 120 via the wireless network 140 . The wireless network 140 may include, but is not limited to, a 2G network, a 3G network, a 4G network, a 5G network, and the like. In some examples, both the mobile terminal 110 and the vehicle 120 can be connected to the cloud server 130 through the wireless network 140 , so that a communication link between the mobile terminal 110 and the vehicle 120 can be established through the cloud server 130 .

The cloud server 130 may be a computing device that provides various services. The cloud server 130 may have one or more processing units, including dedicated processing units such as GPU, FPGA and ASIC (Application Specific Integrated Circuit, Application Specific Integrated Circuit) and general processing units such as CPU. In some examples, the cloud server 130 can be implemented as a distributed server cluster composed of multiple cloud servers 130 , or can be implemented as a single cloud server 130 .

In the scenario shown in FIG. 1B , when the distance between the mobile terminal 110 and the vehicle 120 does not exceed the available distance of the near field connection technology, the mobile terminal 110 can communicate with the vehicle through the near field connection technology. At this time, the mobile terminal 110 can directly perform data interaction with the vehicle-mounted server (for example, a vehicle-mounted T-BOX (Telematics BOX, telematics box)). The near-field connection technology may include wireless near-field connection technologies such as Bluetooth connection technology, UWB (Ultra Wide Band, ultra-wideband) connection technology and Wi-Fi connection technology, and USB (Universal Serial Bus, Universal Serial Bus) connection technology such as etc., but the application is not limited thereto.

It should be noted that when the distance between the mobile terminal 110 and the vehicle 120 is not greater than the available distance of the near-field connection technology, the mobile terminal 110 can communicate with the vehicle 120 through the near-field connection technology, or through the wireless network 140. Communicates with vehicle 120 . In some examples, if the distance between the mobile terminal 110 and the vehicle 120 is not greater than the available distance of the near field connection technology, the mobile terminal 110 can communicate with the vehicle 120 through the near field connection technology and the wireless network 140 at the same time.

In some examples, the available distance of near-field connection technology may be, for example, 10 meters. When the distance between the mobile terminal 110 and the vehicle 120 exceeds 10 meters, the mobile terminal 110 communicates with the vehicle 120 via the cloud server 130 through the wireless network 140; Communication with the vehicle 120 may be via near field connectivity technology and/or via a wireless network 140 . It should be understood that the available distance of the near-field connection technology here is only exemplary, and in practical applications, the available distance of the near-field connection technology depends on the effective distance of the specific near-field connection technology used. As an example, the available distance of the near field connection technology may be, for example, 1 meter, 2 meters, 5 meters, 15 meters, 20 meters, 25 meters or 30 meters and so on.

It should be understood that the numbers of mobile terminals 110 , vehicles 120 and cloud servers 130 in FIG. 1A and FIG. 1B are only illustrative. According to actual needs, the system architecture can have any number of mobile terminals 110 , vehicles 120 and cloud servers 130 .

A method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application will be described below with reference to FIGS. 2 to 3D . 2 to 3D respectively show flowcharts of methods 200, 200-1, 200-2, 200-3 and 200-4 for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application. The methods 200 , 200 - 1 , 200 - 2 , 200 - 3 and 200 - 4 can be executed, for example, at the mobile terminal 110 described in FIG. 1 , and can also be executed, for example, at the electronic device 700 described in FIG. 7 . The mobile terminal 110 is taken as an example for description below. It should be understood that the methods 200, 200-1, 200-2, 200-3, and 200-4 may also include additional steps not shown and/or may omit the steps shown, and the scope of the present application is not limited in this regard. Restricted.

At step S210 , a three-dimensional virtual model of the vehicle 120 is presented to the user on the mobile terminal 110 .

Depending on the distance between the mobile terminal 110 and the vehicle 120 and the relative positional relationship between the mobile terminal 110 and the vehicle 120 , the specific implementation manners in which the mobile terminal 110 presents the three-dimensional virtual model of the vehicle 120 to the user are different. Specifically, it can be divided into two situations: the mobile terminal 110 is within the predetermined distance range of the vehicle and the mobile terminal 110 is outside the predetermined distance range of the vehicle 120, wherein the situation that the mobile terminal 110 is within the predetermined distance range of the vehicle 120 can be refined There are two cases where the mobile terminal 110 is outside the vehicle 120 and the mobile terminal 110 is inside the vehicle 120 . The predetermined distance range of the vehicle may refer to the distance range that allows the use of near-field connection technology between the vehicle and the mobile terminal, that is, the effective distance range for establishing a near-field connection centered on the vehicle. Various implementations of presenting the three-dimensional virtual model of the vehicle 120 to the user by the mobile terminal 110 will be described in detail below.

In some implementation manners, step S210 may specifically include steps S211 and S212, as shown in FIG. 3A . At step S211, when it is determined that the mobile terminal 110 is within a predetermined distance from the vehicle 120 and the mobile terminal 110 is outside the vehicle 120, the mobile terminal 110 may provide the user with a user interface for entering an interface displaying a three-dimensional virtual model of the vehicle 120 (See Figure 8A). As an example, the user interface may be, for example, a pop-up window of an applet or a microservice, but the present application is not limited thereto. At step S212 , in response to the user clicking on the user interface provided by the mobile terminal 110 , the mobile terminal 110 may present to the user the external three-dimensional virtual model of the vehicle 120 (see FIG. 8B ). The three-dimensional virtual model presented by the mobile terminal 110 to the user can change with the relative position of the mobile terminal 110 relative to the vehicle 120, that is, when the mobile terminal 110 is outside the vehicle 120, it can present the external three-dimensional virtual model of the vehicle 110 to the user. model, and when the mobile terminal 110 is inside the vehicle 120, it can present a three-dimensional virtual model of the vehicle 110 to the user. In some examples, step S210 may also include step S213. When it is determined that the mobile terminal 110 moves from the outside of the vehicle 120 to the inside of the vehicle 120, the three-dimensional virtual model presented to the user by the mobile terminal 110 will be replaced by the three-dimensional virtual model outside the vehicle 120. The model is switched to a three-dimensional virtual model of the vehicle 120 .

In some implementation manners, step S210 may specifically include steps S214 and S215, as shown in FIG. 3B . At step S214, when it is determined that the mobile terminal 110 is within a predetermined distance from the vehicle 120 and the mobile terminal 110 is inside the vehicle 120, the mobile terminal 110 may provide the user with a user interface to enter the interface displaying the three-dimensional virtual model of the vehicle 120 (See Figure 8A). At step S215 , in response to the user clicking on the user interface provided by the mobile terminal 110 , the mobile terminal 110 may present to the user a three-dimensional virtual model of the vehicle 120 (see FIG. 8C ). In some examples, step S210 may further include step S216. When it is determined that the mobile terminal 110 moves from the inside of the vehicle 120 to the outside of the vehicle 120, the three-dimensional virtual model presented to the user by the mobile terminal 110 will be replaced by the three-dimensional virtual model inside the vehicle 120. The model is switched to an exterior three-dimensional virtual model of the vehicle 120 .

It should be understood that the 3D virtual model presented by the mobile terminal 110 to the user may include a 3D virtual model outside the vehicle and a 3D virtual model inside the vehicle, and may change as the state of the mobile terminal 110 changes from inside the vehicle to outside the vehicle or from outside the vehicle to inside the vehicle. And change accordingly.

In an exemplary embodiment, whether the mobile terminal 110 is within a predetermined distance from the vehicle 120 can be confirmed by whether the mobile terminal 110 establishes a connection with the vehicle 120 through a near field connection technology. The near-field connection technology may include, for example, at least one of a Bluetooth connection technology, a UWB connection technology, and a Wi-Fi connection technology. In addition, it is also possible to confirm whether the mobile terminal 110 is within the predetermined distance range of the vehicle 120 through GNSS (Global Navigation Satellite System, Global Navigation Satellite System) high-precision positioning technology. Further, the position of the mobile terminal 110 relative to the vehicle 120 can be determined by positioning technologies such as GNSS high-precision positioning, Bluetooth or UWB, for example, the mobile terminal 110 is outside the vehicle 120 or the mobile terminal 110 is inside the vehicle 120 .

In some implementation manners, step S210 may be specifically implemented as step S217, as shown in FIG. 3C. At step S217, the mobile terminal 110 receives an instruction from the user, and presents the three-dimensional virtual model of the vehicle 120 to the user according to the instruction (see FIG. 8B and FIG. 8C ). The user's instruction may include activating the vehicle control application on the mobile terminal 110, and selecting to present the 3D virtual model outside the vehicle or the 3D virtual model inside the vehicle.

As shown in Fig. 3D, step S217 may include sub-step S2171 or sub-step S2172. When the user is outside the predetermined distance range of the vehicle 120, the query or control of the relevant equipment of the vehicle 120 can be realized by actively enabling the vehicle control application on the mobile terminal 110. In some embodiments, the user activates the vehicle control application on the mobile terminal 110 and selects to view the three-dimensional virtual model outside the vehicle, and the mobile terminal 110 receives an instruction from the user to select to view the three-dimensional virtual model outside the vehicle, and presents the three-dimensional virtual model outside the vehicle to the user . In other examples, the user activates the vehicle control application on the mobile terminal 110 and selects to view the three-dimensional virtual model inside the vehicle, and the mobile terminal 110 receives an instruction from the user to select to view the three-dimensional virtual model inside the vehicle, and presents the three-dimensional virtual model inside the vehicle to the user .

In some implementations, based on the user's operation on the three-dimensional virtual model, the display angle of the three-dimensional virtual model can be adjusted or changed, so that the query or control of devices located at various positions of the vehicle can be realized. User operations may include, but are not limited to, rotation, sliding, zooming in, and zooming out.

For an example of the interface where the mobile terminal 110 provides the user with a user interface and presents the three-dimensional virtual model outside the vehicle and the three-dimensional virtual model inside the vehicle, reference may be made to the interface 800a for providing the user interface 820 to the user and the interface 800a for presenting the outside of the vehicle shown in FIG. 8A to FIG. 8C respectively. The interface 800b of the three-dimensional virtual model 830 and the interface 800c presenting the three-dimensional virtual model 840 of the vehicle. The user interface 820 may be a popup window popped up on the display area 810 of the mobile terminal 110 . The presentation form of the pop-up window is not limited to the form shown in FIG. 8A , but may have various shapes and be located at any position of the display area 810 . Users can customize the shape of the pop-up window and its display position in the display area. By clicking the user interface 820 , the user can enter an interface displaying the three-dimensional virtual model of the vehicle, such as an interface 800 b displaying the external three-dimensional virtual model 830 or an interface 800 c displaying the three-dimensional virtual model inside the vehicle 840 . At the interface 800b presenting the 3D virtual model outside the vehicle 830 and the interface 800c presenting the 3D virtual model 840 inside the vehicle, the user can adjust the presentation angle of the 3D virtual model through operations such as rotation, sliding, zooming in and out.

At step S220, the part selected by the user on the three-dimensional virtual model is determined, and the device corresponding to the selected part is determined based on the mapping relationship between the three-dimensional virtual model and the vehicle 120 . The three-dimensional virtual model can be modeled based on the actual situation of the vehicle 120 , and has a preset mapping relationship with the vehicle 120 . When the user makes a selection on the three-dimensional virtual model, the mobile terminal 110 can confirm the vehicle equipment actually corresponding to the part selected by the user based on the preset mapping relationship. According to the vehicle control method provided in the exemplary embodiment of the present application, a three-dimensional virtual model is used to display the vehicle, so that the user can perform intuitive and convenient operations, and can effectively prevent the user from selecting and switching between multiple menus or tabs, for Users are provided with a fast and convenient vehicle equipment control experience.

In some implementations, after the user makes a selection on the three-dimensional virtual model, the mobile terminal 110 may pop up a relevant window for the user to make further choices, such as selecting which specific control to perform on the device or which specific information of the device is requested to be provided.

At step S230, the mobile terminal 110 may communicate with the vehicle 120 to acquire relevant information of the selected device or control the selected device. The mobile terminal 110 can communicate with the vehicle 120 to send the user's request to the vehicle 120. After receiving the relevant request, the vehicle 120 can feed back the relevant information requested by the user to the mobile terminal 110 or operate the corresponding device based on the user's request. In some examples, the vehicle 120 may feed back the operating status information of the corresponding device to the mobile terminal 110 after performing relevant operations, so as to present it to the user.

In some implementations, when the mobile terminal 110 is within a predetermined distance from the vehicle 120, the mobile terminal 110 can directly communicate with the vehicle 120 through a near-field connection technology to obtain information about the selected device or to The device is controlled. Alternatively, when the mobile terminal 110 is within a predetermined distance from the vehicle 120, the mobile terminal 110 may also be connected to the cloud server 130 through the wireless network 140, so as to establish a communication link between the mobile terminal 110 and the vehicle 120 through the cloud server 130 , so as to obtain relevant information of the selected device or control the selected device via the communication link.

In some implementations, when the mobile terminal 110 is outside the predetermined distance from the vehicle 120, the mobile terminal 110 can connect to the cloud server 130 through the wireless network 140, so as to establish a communication between the mobile terminal 110 and the vehicle 120 through the cloud server 130. A communication link, so as to obtain relevant information of the selected device or control the selected device via the communication link.

Through the method for controlling a vehicle based on a mobile terminal according to an exemplary embodiment of the present application, a fast and convenient vehicle control experience can be provided for the user. For example, when the user is located at a position far away from the vehicle (for example, the distance from the vehicle exceeds a predetermined distance from the vehicle), the user can view the three-dimensional virtual model inside and outside the vehicle through the vehicle control application on the mobile terminal, and can For example, by clicking on the corresponding parts of the three-dimensional virtual model to understand the conditions of the equipment inside and outside the vehicle or to control the equipment inside and outside the vehicle. When the user is close to the vehicle (for example, the distance from the vehicle is less than the predetermined distance of the vehicle), the mobile terminal can provide the user with a user interface for viewing the three-dimensional virtual model of the vehicle, and the user can click on the corresponding part of the three-dimensional virtual model to understand the situation of the vehicle equipment Or control the vehicle equipment. As an example, the user can check the tire pressure of the vehicle by clicking on the virtual tire, or check the battery level of the vehicle by clicking on the virtual charging port, and so on. When the user is inside the vehicle, he can control or view the information of the equipment in the vehicle by clicking on the virtual equipment on the three-dimensional virtual model, especially when there is no corresponding button on the vehicle equipment, he can quickly and quickly check the equipment information through this method or control devices.

In order to realize the query or control function of the mobile terminal on the equipment on the specific vehicle, it is necessary to obtain the authentication of the mobile terminal by the specific vehicle in advance. When authenticating the mobile terminal, it is necessary to make the mobile terminal within a predetermined distance of the specific vehicle, and the mobile terminal communicates with the vehicle through a wireless connection such as Bluetooth or UWB or a wired connection through USB to obtain vehicle authentication. In this way, when the mobile terminal communicates with a specific vehicle again, the vehicle can determine whether to continue communicating with the mobile terminal by identifying whether the mobile terminal is an authenticated mobile terminal. If the vehicle recognizes that the mobile terminal is an authenticated mobile terminal, it will authorize to continue the communication with the mobile terminal; otherwise, the vehicle will interrupt the communication with the mobile terminal. It should be noted that the vehicle's authentication of the mobile terminal may include multiple user levels, such as the vehicle owner level or the passenger level. According to different certification levels, the permissions granted by the vehicle to the mobile terminal will be different, which will be explained in detail below.

A vehicle control method according to an exemplary embodiment of the present application will be described below with reference to FIG. 4 . FIG. 4 shows a flowchart of a vehicle control method 400 according to an exemplary embodiment of the present application. The method 400 may be executed, for example, at the vehicle-mounted server of the vehicle 120 described in FIG. 1 , and may also be executed, for example, at the electronic device 700 described in FIG. 7 . Hereinafter, the vehicle-mounted server of the vehicle 120 is taken as an example for description. It should be understood that method 400 may also include additional steps not shown and/or steps shown may be omitted, and the scope of the present application is not limited in this regard.

At step S410 , the vehicle 120 receives an inquiry instruction or a control instruction from the user's mobile terminal 110 via the cloud server 140 . As mentioned above, when the user is outside the predetermined distance range of the vehicle 120 , the user can query or control related equipment of the vehicle 120 by actively activating the vehicle control application on the mobile terminal 110 . After the user activates the vehicle control application on the mobile terminal 110 , he can choose to present the exterior stereoscopic virtual model of the vehicle or the interior stereoscopic virtual model. The user's mobile terminal 110 presents a three-dimensional virtual model inside or outside the vehicle based on the user's selection. The user can realize the query or control of the vehicle equipment by selecting or selecting the three-dimensional virtual model.

At step S420 , the vehicle 120 determines the user level of the user mobile terminal 110 .

As described above, the vehicle's authentication of the mobile terminal may include multiple user levels, such as a vehicle owner level and a passenger level. It should be understood that the vehicle's authentication of the mobile terminal is not limited to the vehicle owner level and the passenger level, and may also include other levels. For mobile terminals with different user levels, the permissions granted by the vehicle are different. For example, a vehicle may grant advanced permissions to a mobile terminal with a vehicle owner level, and grant general permissions to a mobile terminal with a passenger level. Advanced permissions may include, but are not limited to, allowing the mobile terminal to inquire or control equipment inside and outside the vehicle through the vehicle control application outside the predetermined distance range of the vehicle, allowing the mobile terminal to inquire or control through the vehicle control application when within the predetermined distance range of the vehicle and outside the vehicle The internal and external equipment of the vehicle and the mobile terminal are allowed to query or control the internal and external equipment of the vehicle through the vehicle control application when within the predetermined distance range of the vehicle and inside the vehicle. General permissions may include allowing the mobile terminal to inquire or control vehicle interior equipment through the vehicle control application when within a predetermined distance of the vehicle and inside the vehicle, but not allowing the mobile terminal to inquire or control vehicle equipment through the vehicle control application when outside the vehicle.

At step S430, in response to determining that the user level of the user mobile terminal 110 is the vehicle owner level, provide the user mobile terminal 110 with relevant information obtained based on the query instruction or control the vehicle to perform corresponding operations according to the control instruction. Alternatively, at step S430 , in response to determining that the user level of the user mobile terminal 110 is not the vehicle owner level, the vehicle 120 may interrupt communication with the user mobile terminal 110 .

A vehicle control method according to an exemplary embodiment of the present application will be described below with reference to FIGS. 5 to 6D . 5 to 6D respectively show flowcharts of vehicle control methods 500 , 500 - 1 , 500 - 2 , 500 - 3 and 500 - 4 according to exemplary embodiments of the present application. The methods 500 , 500 - 1 , 500 - 2 , 500 - 3 and 500 - 4 may be executed, for example, at the on-board server of the vehicle 120 described in FIG. 1 , or may be executed, for example, at the electronic device 700 described in FIG. 7 . Hereinafter, the vehicle-mounted server of the vehicle 120 is taken as an example for description. It should be understood that the methods 500, 500-1, 500-2, 500-3, and 500-4 may also include additional steps not shown and/or may omit the steps shown, and the scope of the present application is not limited in this regard. Restricted.

At step S510 , the user mobile terminal 110 within a predetermined distance from the vehicle 120 is detected. The onboard server mounted on the vehicle 120 may detect the user mobile terminal 110 within a predetermined distance from the vehicle 120 based on, for example, a near field connection technology. For example, it is determined whether the user mobile terminal 110 is within a predetermined distance from the vehicle 120 according to the connection status between the user mobile terminal 110 and the vehicle 120 . Exemplarily, the near-field connection technology may include at least one of a Bluetooth connection technology, a UWB connection technology, and a Wi-Fi connection technology. In addition, the vehicle-mounted server mounted on the vehicle 120 can also confirm whether the mobile terminal 110 is within a predetermined distance range of the vehicle 120 through GNSS high-precision positioning technology.

At step S520 , the detected position of the user mobile terminal 110 relative to the vehicle 120 and the user level of the user mobile terminal 110 are determined. In an exemplary embodiment, the vehicle-mounted server on the vehicle 120 can determine the position of the mobile terminal 110 relative to the vehicle 120 through positioning technologies such as GNSS high-precision positioning, Bluetooth or UWB. For example, the mobile terminal 110 is outside the vehicle 120 or The mobile terminal 110 is inside the vehicle 120 . For example, through the high-precision positioning of the vehicle 120 and the high-precision positioning of the mobile terminal 110 , it is determined whether the mobile terminal 110 is inside or outside the vehicle within a predetermined distance from the vehicle 120 . In addition, the vehicle-mounted server can confirm the user level of the user mobile terminal 110 by acquiring the authentication information of the user mobile terminal 110 .

At step S530, based on the determined location and user level, it is determined whether to send a notification message to the user mobile terminal 110, so that the user mobile terminal 110 provides a user interface to the user. The vehicle-mounted server mounted on the vehicle 120 may determine whether to continue communication with the user's mobile terminal 110 based on the determined location information and the obtained user level information.

In some implementation manners, step S530 may be specifically implemented as step S531, as shown in FIG. 6A. At step S531, in response to determining that the user mobile terminal 110 is outside the vehicle 120 and the user level of the user mobile terminal 110 is the vehicle owner level, a notification message is sent to the user mobile terminal 110, so that the user mobile terminal 110 provides the user with access to display vehicle information. A user interface of the interface of the external three-dimensional virtual model (for example, shown as 820 in FIG. 8A ). The notification message may include notification information that authorizes the user mobile terminal 110 to provide a user interface to the user. In the case of obtaining pre-authorization from the user, the mobile terminal 110 may automatically pop up a user interface after receiving the notification message from the vehicle 120 for the user to select.

In some implementations, the vehicle control method according to the exemplary embodiment of the present application may further include steps S540 and S550. At step S540, a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model outside the vehicle through the user interface is received. Specifically, after the user's mobile terminal 110 provides the user with a user interface, the user can click on the user interface to view the three-dimensional virtual model outside the vehicle, and select on the three-dimensional virtual model outside the vehicle, that is, input a query command or a control command. The query instruction or control instruction input by the user may be fed back to the vehicle 120 through the communication link between the user mobile terminal 110 and the vehicle 120 , so that the vehicle 120 receives the query instruction or control instruction. At step S550, the vehicle-mounted server on the vehicle 120 provides relevant information obtained based on the query command to the user mobile terminal 110 based on the query command or the control command, or controls the vehicle 110 to perform corresponding operations according to the control command.

In some implementation manners, step S530 may be specifically implemented as step S532, as shown in FIG. 6B. In step S532, in response to determining that the user mobile terminal 110 is outside the vehicle 120 and the user level is not the owner level, the communication with the user mobile terminal 110 is interrupted. For the sake of security, users with different user levels are granted different permissions on mobile terminals, so that users with non-owner levels cannot query related equipment of the vehicle or control the vehicle outside the vehicle.

In some implementation manners, step S530 may be specifically implemented as step S533, as shown in FIG. 6C. At step S533, in response to determining that the user mobile terminal 110 is inside the vehicle 120 and the user level of the user mobile terminal 110 is the owner level or the passenger level, a notification message is sent to the user mobile terminal 110, so that the user mobile terminal 110 provides the user with Enter the user interface of the interface displaying the three-dimensional virtual model in the vehicle (such as shown by 820 in FIG. 8A ). The notification message may include notification information that authorizes the user mobile terminal 110 to provide a user interface to the user. In the case of obtaining pre-authorization from the user, the mobile terminal 110 may automatically pop up a user interface after receiving the notification message from the vehicle 120 for the user to select.

In some implementations, the vehicle control method according to the exemplary embodiment of the present application may further include steps S560 and S570. At step S560, a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model of the vehicle through the user interface is received. Specifically, after the user's mobile terminal 110 provides the user with a user interface, the user can click on the user interface to view the three-dimensional virtual model in the car, and select on the three-dimensional virtual model in the car, that is, input a query command or a control command. The query instruction or control instruction input by the user may be fed back to the vehicle 120 through the communication link between the user mobile terminal 110 and the vehicle 120 , so that the vehicle 120 receives the query instruction or control instruction. At step S550, the vehicle-mounted server on the vehicle 120 provides relevant information obtained based on the query command to the user mobile terminal 110 based on the query command or the control command, or controls the vehicle 110 to perform corresponding operations according to the control command.

In some embodiments, the vehicle control method according to the exemplary embodiment of the present application may further include step S534 parallel to step S533, as shown in Fig. 6D. After determining that the user mobile terminal 110 is inside the vehicle 120 and the user level of the user mobile terminal 110 is the owner level or the passenger level, the vehicle 120 can send a notification message to the user mobile terminal 110, so that the user mobile terminal 110 provides the user with an entry display The user interface of the interface of the three-dimensional virtual model in the vehicle. At the same time, the vehicle 120 may provide the user with an on-board display user interface through its own display device, as shown in step S534. It should be understood that in some cases, for example, when the user does not authorize the automatic pop-up window function of the vehicle control application on the mobile terminal 110, the control method according to the present application can only provide the vehicle display device to the user at the display device of the vehicle 120. user interface.

At step S580 , in response to the user clicking on the vehicle display user interface, the display device of the vehicle 120 may display the vehicle's interior stereoscopic virtual model to the user. At step S590, based on the query command or control command input by the user on the interface displaying the three-dimensional virtual model in the vehicle, the vehicle 120 can feed back the relevant information obtained based on the query command to the user through the display device, or the vehicle 120 can execute according to the control command Operate accordingly. In an example, the query instruction or control instruction input by the user on the interface displaying the three-dimensional virtual model of the vehicle may be embodied as a selection or selection operation performed by the user on the three-dimensional virtual model of the vehicle.

According to the vehicle control method according to the exemplary embodiment of the present application, the mobile terminal of the user who is inside the vehicle and whose user level is the owner level or the passenger level can grant the authority to view the information of the in-vehicle equipment or control the in-vehicle equipment by viewing the three-dimensional virtual model in the vehicle , so as to meet the needs of drivers and passengers to inquire or control in-vehicle equipment. The vehicle control method according to the exemplary embodiment of the present application enables the occupant to click on the vehicle virtual device through the mobile terminal to view the information of the in-vehicle device or control the in-vehicle device, which provides convenience for the occupant to control the vehicle device in the vehicle.

The vehicle control method according to the exemplary embodiment of the present application does not require the user's mobile terminal to have a UWB multi-antenna structure, so the popularity of its application will not be restricted due to the need for the mobile terminal to have a UWB multi-antenna structure.

Fig. 7 schematically shows a block diagram of an electronic device (or computing device) 700 suitable for implementing the exemplary embodiments of the present application. The device 700 may be a device for implementing the various methods described in FIG. 2 to FIG. 6C . As shown in FIG. 7 , device 700 includes a processor 701 that can operate according to computer program instructions stored in read-only memory (ROM) 702 or loaded from storage unit 708 into random-access memory (RAM) 703 , to perform various appropriate steps and processes. In the RAM 703, various programs and data necessary for the operation of the device 700 can also be stored. The processor 701, ROM 702, and RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to the bus 704 .

Multiple components in the device 700 are connected to the I/O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a memory 708, such as a magnetic disk, an optical disk, etc.; And a communication unit 709, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 709 allows the device 700 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.

Processor 701 may be various general and/or special purpose processing components with processing and computing capabilities. Some examples of processor 701 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various processors that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 701 may execute various methods and processes described above, for example, execute methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500- 3, 500-4. For example, in some embodiments, methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500-2, 500-3, 500-4 may be implemented as A computer software program stored on a machine-readable medium, such as the storage unit 708 . In some implementations, part or all of the computer program can be loaded and/or installed on the device 700 via the ROM 702 and/or the communication unit 709. When the computer program is loaded into the RAM 703 and executed by the processor 701, the above-described methods 200, 200-1, 200-2, 200-3, 200-4, 400, 500, 500-1, 500- 2, one or more steps in 500-3, 500-4. Alternatively, in other implementations, the processor 701 may be configured to execute the methods 200, 200-1, 200-2, 200-3, 200-4 in any other suitable manner (for example, by means of firmware) , 400, 500, 500-1, 500-2, 500-3, 500-4 in one or more steps.

It should be further explained that the present application may include methods, devices, systems and/or computer program products. A computer program product may include a computer readable storage medium having computer readable program instructions thereon for carrying out various aspects of the present application.

A computer readable storage medium may be a tangible device that can retain and store instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or flash memory), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanically encoded device, such as a printer with instructions stored thereon A hole card or a raised structure in a groove, and any suitable combination of the above. As used herein, computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., pulses of light through fiber optic cables), or Electrical signals transmitted by wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or downloaded to an external computer or external storage device over a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or a network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .

Computer program instructions for performing the operations of the present application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or Source or object code written in any combination, including object-oriented programming languages—such as Smalltalk, C++, etc., and conventional procedural programming languages—such as C or similar programming languages. Computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as via the Internet using an Internet service provider). connect). In some embodiments, an electronic circuit, such as a programmable logic circuit, field programmable gate array (FPGA), or programmable logic array (PLA), can be customized by utilizing state information of computer-readable program instructions, which can Various aspects of the present application are implemented by executing computer readable program instructions.

Various aspects of the present application are described herein with reference to flowchart illustrations and/or step diagrams of methods, apparatus (systems), and computer program products according to exemplary embodiments of the application. It should be understood that each step in the flowchart and/or step diagram and the combination of steps in the flowchart and/or step diagram can be implemented by computer-readable program instructions.

These computer-readable program instructions can be provided to a processor in a voice interaction device, a general-purpose computer, a special-purpose computer, or a processing unit of other programmable data processing devices, thereby producing a machine that allows these instructions to be processed by a computer or other programmable When executed by the processing unit of the data processing device, a device for realizing the functions/steps specified in one or more steps in the flowchart and/or step diagram is produced. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause computers, programmable data processing devices and/or other devices to work in a specific way, so that the computer-readable medium storing instructions includes An article of manufacture comprising instructions for implementing aspects of the functions/steps specified in one or more steps in flowcharts and/or step diagrams.

It is also possible to load computer-readable program instructions into a computer, other programmable data processing device, or other equipment, so that a series of operational steps are performed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , so that instructions executed on computers, other programmable data processing devices, or other devices implement the functions/steps specified in one or more steps in the flow charts and/or step diagrams.

The flowcharts and step diagrams in the figures show the architecture, functions and operations of possible implementations of devices, methods and computer program products according to various embodiments of the present application. In this regard, each step in a flowchart or step diagram may represent a module, a program segment, or a portion of an instruction that contains one or more programmable components for implementing the specified logical functions. Execute instructions. In some alternative implementations, the functions noted in the step may occur out of the order noted in the figures. For example, two consecutive steps may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each step in the step diagrams and/or flowcharts, and combinations of steps in the step diagrams and/or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or actions , or may be implemented by a combination of dedicated hardware and computer instructions.

The above description is only a preferred embodiment of the present application and an illustration of the applied technical principle. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solution formed by the specific combination of the above-mentioned technical features, and should also cover the technical solution formed by the above-mentioned technical features or other technical features without departing from the inventive concept. Other technical solutions formed by any combination of equivalent features. For example, a technical solution formed by replacing the above-mentioned features with technical features with similar functions disclosed in (but not limited to) this application.

Claims (22)

1. A method for controlling a vehicle based on a mobile terminal, characterized in that the method comprises:

   Presenting a three-dimensional virtual model of the vehicle to the user at the mobile terminal;

   determining a part selected by the user on the 3D virtual model and determining a device corresponding to the selected part based on a mapping relationship between the 3D virtual model and the vehicle; and

   Communicating with the vehicle to obtain relevant information of the device or to control the device.
2. The method according to claim 1, wherein presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal comprises:

   determining that the mobile terminal is within a predetermined distance of the vehicle and that the mobile terminal is outside the vehicle, providing the user with a user interface to enter an interface displaying the three-dimensional virtual model; and

   In response to the user clicking on the user interface, an exterior stereoscopic virtual model of the vehicle is presented to the user.
3. The method according to claim 2, wherein presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal further comprises:

   In response to determining that the mobile terminal moves from the exterior of the vehicle to the interior of the vehicle, the stereoscopic virtual model presented to the user is switched from the exterior stereoscopic virtual model to the interior stereoscopic virtual model of the vehicle .
4. The method according to claim 1, wherein presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal comprises:

   determining that the mobile terminal is within a predetermined distance of the vehicle and that the mobile terminal is inside the vehicle, providing the user with a user interface to enter an interface displaying the three-dimensional virtual model; and

   In response to the user clicking on the user interface, an interior stereoscopic virtual model of the vehicle is presented to the user.
5. The method according to claim 4, wherein presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal further comprises:

   In response to determining that the mobile terminal moves from the interior of the vehicle to the exterior of the vehicle, the stereoscopic virtual model presented to the user is switched from the interior stereoscopic virtual model to the exterior stereoscopic virtual model of the vehicle .
6. The method according to any one of claims 1-5, wherein communicating with the vehicle to obtain information about the device or to control the device comprises:

   Communicate with the vehicle through near-field connection technology to obtain relevant information of the device or control the device, wherein the near-field connection technology includes Bluetooth connection technology, UWB connection technology and Wi-Fi connection technology At least one of the .
7. The method according to claim 1, wherein presenting the stereoscopic virtual model of the vehicle to the user comprises:

   receiving an instruction from the user, and presenting a three-dimensional virtual model of the vehicle to the user according to the instruction,

   Wherein, the three-dimensional virtual model includes at least one of the three-dimensional virtual model outside the vehicle and the three-dimensional virtual model inside the vehicle.
8. The method according to claim 7, wherein communicating with the vehicle to obtain information about the device or to control the device comprises:

   Connecting to a cloud server through a wireless network, so as to establish a communication link between the mobile terminal and the vehicle through the cloud server; and

   Obtain relevant information of the device or control the device via the communication link.
9. The method according to claim 1, wherein presenting the three-dimensional virtual model of the vehicle to the user at the mobile terminal further comprises:

   Adjust or change the presentation angle of the three-dimensional virtual model based on the user's operation on the three-dimensional virtual model, wherein the operation includes at least one of rotation, sliding, zooming in and zooming out.
10. An electronic device comprising:

    at least one processor; and

    a memory communicatively coupled to the at least one processor; wherein,

    The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1-9. Methods.
11. A non-transitory computer-readable storage medium having stored thereon machine-executable instructions which, when executed, cause a machine to perform the method of any one of claims 1-9.
12. A vehicle control method, characterized in that the method comprises:

    Receive query instructions or control instructions from the user's mobile terminal via the cloud server;

    determining the user level of the user's mobile terminal; and

    In response to determining that the user level of the user mobile terminal is the vehicle owner level, provide the user mobile terminal with relevant information acquired based on the query instruction or control the vehicle to perform corresponding operations according to the control instruction.
13. A vehicle control method, characterized in that the method comprises:

    detecting user mobile terminals within a predetermined distance from the vehicle;

    determining the detected location of the user mobile terminal relative to the vehicle and the user class of the user mobile terminal; and

    Based on the determined location and user level, determine whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides a user interface to the user.
14. The method of claim 13, wherein detecting a user mobile terminal within a predetermined distance of the vehicle comprises:

    Detect user mobile terminals within a predetermined distance of the vehicle based on near-field connection technology or GNSS high-precision positioning technology, wherein the near-field connection technology includes Bluetooth connection technology, UWB connection technology and Wi-Fi connection technology at least one.
15. The method according to claim 13, wherein, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides the user with a user interface includes:

    In response to determining that the user mobile terminal is outside the vehicle and the user level is the owner level, sending a notification message to the user mobile terminal, so that the user mobile terminal provides the user with access to display the three-dimensional virtual model outside the vehicle The user interface of the interface.
16. The method according to claim 15, wherein said method further comprises:

    receiving a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model outside the vehicle through the user interface; and

    Based on the query instruction or the control instruction, provide relevant information acquired based on the query instruction to the user mobile terminal, or control the vehicle to perform corresponding operations according to the control instruction.
17. The method according to claim 13, wherein, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides the user with a user interface includes:

    In response to determining that the user mobile terminal is external to the vehicle and the user level is not an owner level, communication with the user mobile terminal is discontinued.
18. The method according to claim 13, wherein, based on the determined location and user level, determining whether to send a notification message to the user mobile terminal, so that the user mobile terminal provides the user with a user interface includes:

    Responsive to determining that the user mobile terminal is inside the vehicle and the user level is the owner level or the passenger level, sending a notification message to the user mobile terminal, so that the user mobile terminal provides the user with access to the display vehicle The user interface of the interface of the stereoscopic virtual model.
19. The method according to claim 18, wherein said method further comprises:

    receiving a query instruction or a control instruction input by the user after entering the interface displaying the three-dimensional virtual model in the vehicle through the user interface, and

    Based on the query instruction or the control instruction, provide relevant information obtained based on the query instruction to the user mobile terminal or control the vehicle to perform corresponding operations according to the control instruction.
20. The method of claim 18, further comprising:

    providing an in-vehicle display user interface to the user via a display device of the vehicle;

    displaying a 3D virtual model of the vehicle in response to the user clicking on the vehicle display user interface; and

    Based on the query instruction or control instruction input by the user on the interface displaying the three-dimensional virtual model in the vehicle, feed back relevant information obtained based on the query instruction to the user, or perform corresponding operations according to the control instruction.
21. An electronic device comprising:

    at least one processor; and

    a memory communicatively coupled to the at least one processor; wherein,

    The memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can perform the method of claim 12 or claim 13 - the method of any one of 20.
22. A non-transitory computer-readable storage medium having stored thereon machine-executable instructions which, when executed, cause a machine to perform the method of claim 12 or any one of claims 13-20 the method described.

Images