CN113442943A - Method, device and system for realizing virtual driving of vehicle, vehicle and storage medium - Google Patents

Method, device and system for realizing virtual driving of vehicle, vehicle and storage medium Download PDF

Info

Publication number
CN113442943A
CN113442943A CN202110310991.3A CN202110310991A CN113442943A CN 113442943 A CN113442943 A CN 113442943A CN 202110310991 A CN202110310991 A CN 202110310991A CN 113442943 A CN113442943 A CN 113442943A
Authority
CN
China
Prior art keywords
ecu
component
virtual
vehicle
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110310991.3A
Other languages
Chinese (zh)
Other versions
CN113442943B (en
Inventor
陈为
邢扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Quarkdata Software Co ltd
Original Assignee
Quarkdata Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Quarkdata Software Co ltd filed Critical Quarkdata Software Co ltd
Priority to CN202110310991.3A priority Critical patent/CN113442943B/en
Publication of CN113442943A publication Critical patent/CN113442943A/en
Application granted granted Critical
Publication of CN113442943B publication Critical patent/CN113442943B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W2050/0001—Details of the control system
    • B60W2050/0043—Signal treatments, identification of variables or parameters, parameter estimation or state estimation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means

Abstract

The embodiment of the application discloses a method, a device, a system, a vehicle and a storage medium for realizing virtual driving of the vehicle, wherein the method comprises the following steps: when the vehicle is in a driving mode, responding to a mode switching instruction, and respectively sending the mode switching instruction to a component ECU and a component execution mechanism ECU so that the component ECU and the component execution mechanism ECU switch the driving mode to a virtual driving mode; receiving a virtual control signal sent by a component ECU, wherein the virtual control signal is obtained by converting the corresponding component ECU when a user operates a mechanical component; generating virtual driving display information according to the virtual control signal; and outputting the virtual driving display information to a display device. According to the embodiment of the application, virtual driving is performed by utilizing various mechanical parts in the vehicle, and the interactivity is improved.

Description

Method, device and system for realizing virtual driving of vehicle, vehicle and storage medium
Technical Field
The embodiment of the application relates to the technical field of vehicles, in particular to a method, a device, a system, a vehicle and a storage medium for realizing virtual driving of the vehicle.
Background
With the development of automobile technology, more and more high-end Vehicle models, especially electric vehicles, are equipped with powerful In-Vehicle Infotainment (IVI) systems. The vehicle-mounted information entertainment system is a vehicle-mounted comprehensive information processing system formed by adopting a vehicle-mounted special central processing unit and based on a vehicle body bus system and internet services.
In the prior art, the vehicle-mounted infotainment system of the electric vehicle can provide better entertainment experience for a vehicle owner during charging, for example, the vehicle owner is allowed to play videos on a control screen of the vehicle, and even a handle is inserted into the vehicle-mounted infotainment system to play games. However, these do not fully utilize the configuration of the vehicle and are less interactive.
Disclosure of Invention
The embodiment of the application provides a method, a device, a system, a vehicle and a storage medium for realizing virtual driving of the vehicle, which are beneficial to improving interactivity.
In order to solve the above problem, in a first aspect, an embodiment of the present application provides a method for implementing virtual driving of a vehicle, including:
when the vehicle is in a driving mode, responding to a mode switching instruction, and respectively sending the mode switching instruction to a component ECU and a component execution mechanism ECU so that the component ECU and the component execution mechanism ECU switch the driving mode to a virtual driving mode;
receiving a virtual control signal sent by a component ECU, wherein the virtual control signal is obtained by converting the corresponding component ECU when a user operates a mechanical component;
generating virtual driving display information according to the virtual control signal;
and outputting the virtual driving display information to a display device.
In a second aspect, an embodiment of the present application provides an apparatus for implementing virtual driving of a vehicle, including:
the device comprises a first mode switching module, a second mode switching module and a control module, wherein the first mode switching module is used for responding to a mode switching instruction when a vehicle is in a driving mode, and sending the mode switching instruction to a component ECU and a component execution mechanism ECU respectively so that the component ECU and the component execution mechanism ECU switch the driving mode into an entertainment mode;
the virtual signal receiving module is used for receiving a virtual control signal sent by the component ECU, wherein the virtual control signal is obtained by converting the corresponding component ECU when a user operates the mechanical component;
the virtual driving information generating module is used for generating virtual driving display information according to the virtual control signal;
and the virtual driving information output module is used for outputting the virtual driving display information to a display device.
In a third aspect, the present application further provides an in-vehicle infotainment system, which includes a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor, when executing the computer program, implements the method for implementing virtual driving of a vehicle according to the present application.
In a fourth aspect, the present application further provides a vehicle, including a mechanical component, a component ECU, a component actuator ECU, and an in-vehicle infotainment system, where the in-vehicle infotainment system is configured to execute the method for implementing virtual driving of the vehicle according to the present application.
In a fifth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor of an in-vehicle infotainment system, implements the steps of the method for implementing virtual driving of a vehicle disclosed in an embodiment of the present application.
According to the method, the device, the system, the vehicle and the storage medium for realizing the virtual driving of the vehicle, when the vehicle is in a driving mode, the mode switching instruction is sent to the component ECU and the component execution mechanism ECU in response to the mode switching instruction, so that the component ECU and the component execution mechanism ECU switch the driving mode to the virtual driving mode, the virtual control signal sent by the component ECU is received, the virtual driving display information is generated, the virtual driving display information is output to the display device, the virtual driving is realized by utilizing various mechanical components in the vehicle, and the interactivity is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a schematic illustration of a vehicle according to an exemplary embodiment of the present application;
FIG. 2 is a schematic illustration of a vehicle according to another exemplary embodiment of the present application;
FIG. 3 is a flow chart of a method for implementing virtual driving of a vehicle provided by an exemplary embodiment of the present application;
fig. 4 is a schematic structural diagram of an apparatus for implementing virtual driving of a vehicle according to an exemplary embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a schematic structural diagram of a vehicle according to an exemplary embodiment of the present application, and as shown in fig. 1, the vehicle includes a mechanical component 10, a component ECU (Electronic Control Unit) 20, a component actuator 30, a component actuator ECU 40, an in-vehicle infotainment system ECU50, an in-vehicle infotainment system 60, and a CAN bus 70, where the in-vehicle infotainment system 60 includes a display device, a memory, a processor, and a computer program stored in the memory and running on the processor, and when the processor executes the computer program, the method for implementing virtual driving of the vehicle according to the embodiment of the present application is implemented.
Among them, the component ECU 20, the component actuator ECU 40, and the in-vehicle infotainment system ECU50 are all connected to the CAN bus 70. The component ECU is used for converting mechanical signals operated on the mechanical components by a user into electronic signals and sending the electronic signals to the component executing mechanism ECU or the vehicle-mounted infotainment system ECU through the CAN bus 70, and the vehicle-mounted infotainment system ECU is used for sending signals in the vehicle-mounted infotainment system to the CAN bus and obtaining signals sent to the vehicle-mounted infotainment system from the CAN bus. And the component executing mechanism ECU is used for driving the corresponding component executing mechanism to complete corresponding operation based on the electronic signal. The vehicle-mounted information entertainment system can realize a series of applications including three-dimensional navigation, real-time road conditions, IPTV, auxiliary driving, fault detection, vehicle information, vehicle body control, mobile office, wireless communication, online-based entertainment functions, TSP (Total suspended particulate) services and the like.
Fig. 2 is a schematic structural diagram of a vehicle according to another exemplary embodiment of the present application, and as shown in fig. 2, the mechanical component 10 may include: a steering wheel 11, a shift lever 12, a brake 13, a clutch 14 and a throttle 15; correspondingly, the component ECU 20 may be one ECU or a plurality of ECUs, for example, one component ECU for all mechanical components or one component ECU for each mechanical component, where when one component ECU for all mechanical components is received, the component ECU converts the mechanical signal of each mechanical component into an electronic control signal, and when one component ECU for each mechanical component is received, the component ECU 20 may include: a steering wheel ECU 21, a shift lever ECU 22, a brake ECU 23, a clutch ECU 24, and a throttle ECU 25; the component actuator 30 may include: a steering wheel actuator 31, a shift lever actuator 32, a brake actuator 33, a clutch actuator 34, and an accelerator actuator 35; correspondingly, the component actuator ECU 40 may be one ECU or a plurality of ECUs, for example, one component actuator ECU corresponds to all component actuators or one component actuator ECU corresponds to each component actuator, when one component actuator ECU corresponds to all component actuators, the component actuator ECU drives the component actuators corresponding to the mechanical components to complete corresponding operations when receiving electronic control signals of the corresponding mechanical components, and when one component actuator ECU corresponds to each component actuator, the component actuator ECU 40 may include: a steering wheel actuator ECU 41, a shift lever actuator ECU 42, a brake actuator ECU 43, a clutch actuator ECU 44, and a throttle actuator ECU 45.
The steering wheel ECU 21 is configured to convert a mechanical signal of a steering wheel operated by a user into an electronic control signal, the shift lever ECU 22 is configured to convert a mechanical signal of a shift lever operated by a user into an electronic control signal, the brake ECU 23 is configured to convert a mechanical signal of a brake operated by a user into an electronic control signal, the clutch ECU 24 is configured to convert a mechanical signal of a clutch operated by a user into an electronic control signal, and the accelerator ECU 25 is configured to convert a mechanical signal of an accelerator operated by a user into an electronic control signal. The steering wheel actuator ECU 41 is used for driving the steering wheel actuator to complete the steering operation according to an electronic control signal from a steering wheel, the gear shift lever actuator ECU 42 is used for driving the gear shift lever actuator to complete the gear shift operation according to an electronic control signal from a gear shift lever, the brake actuator ECU 43 is used for driving the brake actuator to complete the brake or deceleration operation according to an electronic control signal from a brake, the clutch actuator ECU 44 is used for driving the clutch actuator to complete the separation or engagement operation of a transmission system according to an electronic control signal from a clutch, and the throttle actuator ECU 45 is used for driving the throttle actuator to complete the control operation of the engine speed according to an electronic control signal from a throttle.
The vehicle in the embodiment of the application uses an electric control steering technology to replace the traditional mechanical control technology, the electric control steering technology is an application of a wire control technology in an automobile product, and an electronic signal is used as a carrier to transmit an instruction to an execution mechanism by using an electric wire, so that multiple purposes of complicated mechanical transmission, weight reduction, efficiency improvement, more intelligent control functions and the like are avoided. Taking a steering wheel as an example, the traditional mechanical connection between a steering system and the steering wheel is cancelled, the steering angle and the steering speed of wheels are comprehensively calculated by a computer according to the road condition and the intention of a driver to rotate the steering wheel, and the computer controls a steering machine to realize the control purpose. It is more likely that the driver's hand is a remote control or simulated steering wheel in a racing game, and the actual steering command is the vehicle's computer. In the aspect of implementation, a CAN signal sent by the steering wheel CAN be transmitted to an ECU controlling a steering wheel executing mechanism through a CAN bus, and finally the steering wheel executing mechanism is driven to complete steering. Similarly, the brake, the clutch, the accelerator and the gear shift lever are also controlled in a similar way, and the control system is called an electric control system. The embodiment of the application is a method for implementing virtual driving of a vehicle based on an electronic control system in the vehicle.
Fig. 3 is a flowchart of a method for implementing virtual driving of a vehicle according to an exemplary embodiment of the present application, which may be applied to the vehicle described above and executed by an in-vehicle infotainment system in the vehicle. As shown in fig. 3, the method for implementing virtual driving of a vehicle may include:
and step 310, when the vehicle is in a driving mode, responding to a mode switching command, and sending the mode switching command to the component ECU and the component execution mechanism ECU respectively so that the component ECU and the component execution mechanism ECU switch the driving mode to a virtual driving mode.
The driving mode refers to a mode in which a user can normally use the vehicle to run on the road, and the virtual driving mode refers to a mode in which the user stops the vehicle at a certain position and uses mechanical components on the vehicle and an electronic system in the vehicle to perform virtual driving.
When the vehicle is in a static state, a user can virtually drive based on the vehicle, if the vehicle is in a driving mode at present, the user can operate a central control screen in the vehicle to switch the driving mode of the vehicle, if the mode switching instruction of the user is received, the vehicle-mounted infotainment system respectively sends the mode switching instruction to a component ECU and a component execution mechanism ECU in the vehicle, and after the component ECU and the component execution mechanism ECU receive the mode switching instruction, the driving mode is switched to the virtual driving mode, so that the component ECU converts a mechanical signal of the mechanical component operated by the user into a virtual control signal, and the component execution mechanism ECU can distinguish the control signal as the virtual control signal and does not execute the virtual control signal from the component ECU, namely does not drive a corresponding component execution mechanism.
Alternatively, the component ECUs may include a steering wheel ECU, a shift lever ECU, a brake ECU, a clutch ECU, and a throttle ECU, and the component execution structure ECU may include a steering wheel execution mechanism ECU, a shift lever execution mechanism ECU, a brake execution mechanism ECU, a clutch execution mechanism ECU, and a throttle execution mechanism ECU.
And step 320, receiving a virtual control signal sent by the component ECU, wherein the virtual control signal is converted by the corresponding component ECU when the user operates the mechanical component.
Wherein the mechanical component comprises at least one of a steering wheel, a gear shift lever, a brake, a clutch, and a throttle.
When the component ECU and the component actuator ECU switch the driving mode to the virtual driving mode, the vehicle enters the virtual driving mode, and at this time, the user can operate mechanical components on the vehicle to realize virtual driving. In the virtual driving mode, when a user operates at least one mechanical component of a steering wheel, a gear lever, a brake, a clutch and an accelerator, a component ECU converts a mechanical signal of the mechanical component operated by the user into a virtual control signal and sends the virtual control signal to a vehicle-mounted infotainment system, and the vehicle-mounted infotainment system receives the virtual control signal sent by the component ECU.
When the part ECU comprises a steering wheel ECU, a gear shift lever ECU, a brake ECU, a clutch ECU and an accelerator ECU, if a user operates the steering wheel, the steering wheel ECU converts a mechanical signal of the steering wheel operated by the user into a virtual control signal and sends the virtual control signal to a vehicle-mounted infotainment system; if the user operates the gear shift lever, the gear shift lever ECU converts a mechanical signal of the gear shift lever operated by the user into a virtual control signal and sends the virtual control signal to the vehicle-mounted infotainment system; if the user operates the brake, the brake ECU converts a mechanical signal of the user operating the brake into a virtual control signal and sends the virtual control signal to the vehicle-mounted infotainment system; if the user operates the clutch, the clutch ECU converts a mechanical signal of the clutch operated by the user into a virtual control signal and sends the virtual control signal to the vehicle-mounted infotainment system; if the user operates the accelerator, the accelerator ECU converts a mechanical signal of the accelerator operated by the user into a virtual control signal and sends the virtual control signal to the vehicle-mounted infotainment system.
In one exemplary embodiment of the present application, the transmitting the mode switching instruction to the component ECU and the component execution structure ECU, respectively, includes: respectively sending the mode switching instruction to a component ECU and a component execution mechanism ECU through a CAN bus;
the virtual control signal sent by the receiving component ECU comprises: and receiving a virtual control signal sent by the component ECU through the CAN bus.
Various electronic signals on the vehicle CAN be transmitted through a CAN (Controller Area Network) bus in the vehicle. The vehicle-mounted infotainment system sends the mode switching instruction to the vehicle-mounted infotainment system ECU, the vehicle-mounted infotainment system ECU sends the mode switching instruction to the CAN bus, and the mode switching instruction is sent to the component ECU and the component execution mechanism ECU through the CAN bus, so that the component ECU and the component execution mechanism ECU switch the driving mode into the virtual driving mode. After a component ECU converts a mechanical signal of a mechanical component operated by a user into a virtual control signal, the virtual control signal is sent to a CAN bus, a component execution mechanism ECU and a vehicle-mounted infotainment system ECU which are connected to the CAN bus identify whether the virtual control signal is a signal which needs to be received by the vehicle-mounted infotainment system ECU, the virtual control signal and a real control signal CAN be distinguished through a field, through identifying the field, the component execution mechanism ECU determines that the virtual control signal is not the signal which needs to be received by the vehicle-mounted infotainment system ECU, and the vehicle-mounted infotainment system ECU determines that the virtual control signal is the signal which needs to be received by the vehicle-mounted infotainment system ECU, receives the virtual control signal and sends the virtual control signal to the vehicle-mounted infotainment system, so that the vehicle-mounted infotainment system executes an operation related to the virtual control signal.
And 330, generating virtual driving display information according to the virtual control signal.
And after receiving the virtual control signal, the vehicle-mounted infotainment system generates virtual driving display information corresponding to the virtual control signal. For example, when the virtual control signal is a virtual left-turn signal, virtual driving display information for turning left is generated, and when the virtual control signal is a virtual acceleration signal, virtual driving display information for accelerating is generated.
And step 340, outputting the virtual driving display information to a display device.
Wherein the display device may include: at least one of a center control screen, a virtual reality Display, and a HUD (Head Up Display). The HUD is also called a parallel display system, which is a multifunctional instrument panel that is operated blindly and centered on a driver, and projects important driving information such as speed per hour and navigation on a windshield in front of the driver, so that the driver can see the important driving information such as speed per hour and navigation without lowering or turning the head as much as possible.
And outputting the virtual driving display information generated according to the virtual control signal to a display device so as to display the virtual driving display information on the display device, so that a user can know a driving result brought by own driving operation, and the driving operation of the user can be adjusted according to the displayed condition of the virtual vehicle.
The method for achieving virtual driving of the vehicle can be applied to scenes such as driving training, experience before purchase, vehicle safety testing and entertainment.
In the driving training, although a specific virtual driving simulator can be used for virtual driving, in this case, a driving school needs to additionally purchase a virtual driving simulator under the condition that a large number of real vehicles exist, so that the problem of high cost exists, the virtual driving simulator and the real vehicles have certain difference in driving performance, and a method for realizing virtual driving of the vehicles is configured in the existing real vehicles for virtual driving, so that a student can know the conditions of the real vehicles under different road conditions, and the cost of the driving school is reduced.
In the pre-purchase experience, although a user can drive a vehicle to a real road for driving experience, the range of the driven road is limited, for example, the user can drive the vehicle within a certain range of a 4S store, which limits that the user cannot know the performance of the vehicle under different road conditions, and the user can select different virtual driving scenes for virtual driving by configuring the method for realizing the virtual driving of the vehicle in the real vehicle, so that the user can virtually drive under different road conditions, and can comprehensively know the performance of the vehicle under different road conditions.
In the vehicle safety test, the safety test can be performed on the vehicle under different road conditions based on a method for realizing virtual driving of the vehicle configured in the vehicle, for example, under the condition of a fine day, a virtual driving scene can be selected to be a rainy slippery scene, so that the safety condition of the vehicle on a rainy slippery scene can be tested under the condition of a fine day; the safety condition of the vehicle running on the hillside can be tested; alternatively, it is also possible to simulate a safety situation in which the truck is full with cargo in an empty situation. The safety of the vehicle is tested by virtual driving in different virtual driving scenes, so that the safety of the vehicle can be improved based on a safety test result, and accidents are reduced.
Entertainment can also be performed based on the virtual driving function of the real vehicle, for example, during charging of the electric vehicle, a user can perform virtual driving by using the virtual driving function of the vehicle, and the virtual driving in the real vehicle is realized by using mechanical components such as a steering wheel, a gear lever, a brake, a clutch and an accelerator in the vehicle as input components for the virtual driving.
According to the method for achieving virtual driving of the vehicle, when the vehicle is in the driving mode, the mode switching instruction is sent to the component ECU and the component execution mechanism ECU in response to the mode switching instruction, so that the component ECU and the component execution mechanism ECU switch the driving mode into the virtual driving mode, the virtual control signal sent by the component ECU is received, virtual driving display information is generated, the virtual driving display information is output to the display device, virtual driving is achieved by means of various mechanical components in the vehicle, and interactivity is improved.
In addition to the above technical solution, before the receiving of the virtual control signal sent by the component ECU, the method further includes: acquiring a virtual driving scene, and outputting the virtual driving scene to the display device;
generating virtual driving display information according to the virtual control signal comprises the following steps: and generating virtual driving display information of a virtual vehicle in the virtual driving scene according to the virtual control signal.
Wherein the virtual driving scene may include roads, obstacles, traffic lights, and the like.
After the vehicle is switched from the driving mode to the virtual driving mode, a default virtual driving scene may be acquired, or a virtual driving scene selected by a user may be acquired, or a virtual driving scene may be automatically generated. After the virtual driving scene is acquired, the virtual driving scene and the virtual position of the virtual vehicle in the virtual driving scene are output to a display device, the virtual driving scene and the virtual position of the virtual vehicle in the virtual driving scene are displayed through the display device, and a user can operate corresponding mechanical components to perform virtual driving based on the virtual driving scene and the virtual position of the virtual vehicle in the virtual driving scene displayed by the display device. For example, the virtual vehicle is currently at an intersection in the virtual driving scene, the user wants to turn left, the user CAN turn the steering wheel to the left, the steering wheel ECU converts the mechanical signal into a virtual control signal and sends the virtual control signal to the CAN bus, the vehicle-mounted infotainment system ECU receives the virtual control signal from the CAN bus, virtual driving display information of the left turn is generated on the basis of the current virtual speed, and the virtual driving display information of the left turn is displayed on the display device. Virtual driving in the virtual driving scene is realized, and the interactivity is further improved.
In an exemplary embodiment, the acquiring the virtual driving scenario optionally includes:
generating a virtual driving scene according to the current position information of the vehicle; or
And displaying a plurality of virtual driving scenes and acquiring the virtual driving scene selected by the user.
When the virtual driving scene is acquired, the road information associated with the position information and other road information intersecting with the road information can be acquired according to the current position information of the vehicle, a corresponding virtual driving scene is generated based on the acquired road information and the current position information of the vehicle, and the virtual driving scene is displayed on the display device, so that the user can experience virtual driving on a real road. When the virtual driving scene is acquired, a plurality of preset virtual driving scenes can be displayed in the display device, a user selects a virtual driving scene required by the user from the plurality of virtual driving scenes, and after the virtual driving scene selected by the user is acquired, the virtual driving scene is displayed in the display device. By displaying a plurality of virtual driving scenes and acquiring the virtual driving scene selected by the user, the interactivity is further improved.
On the basis of the above technical solution, after the mode switching command is sent to the component ECU and the component actuator ECU, the method may further include: and when the mode switching instruction is received again, the mode switching instruction is sent to the component ECU and the component execution mechanism ECU so that the component ECU and the component execution mechanism ECU switch the virtual driving mode into the driving mode, and the component execution mechanism ECU executes real control signals from the corresponding mechanical components.
The vehicle is switched in the mode through the last mode switching instruction and is currently in a virtual driving mode, if the user does not want to perform virtual driving any more but really wants to use the vehicle in the virtual driving mode, the center control screen in the vehicle can be operated to switch the driving mode of the vehicle, if receiving a mode switching instruction of a user, the vehicle-mounted infotainment system respectively sends the mode switching instruction to a component ECU and a component execution mechanism ECU in the vehicle, the component ECU and the component execution mechanism ECU switch from a virtual driving mode to a driving mode after receiving the mode switching instruction, thus, the unit ECU converts a mechanical signal of a user operating the mechanical unit into a real control signal, the unit actuator ECU can distinguish the control signal as the real control signal, and executing real control signals from the component ECU to drive corresponding component executing mechanisms to complete corresponding operations. By configuring different driving modes in the vehicle, the user can switch the corresponding modes as required.
Fig. 4 is a schematic structural diagram of an apparatus for implementing virtual driving of a vehicle according to an exemplary embodiment of the present application, where, as shown in fig. 4, the apparatus 400 for implementing virtual driving of a vehicle includes:
a first mode switching module 410, configured to send a mode switching instruction to the component ECU and the component actuator ECU, respectively, in response to the mode switching instruction when the vehicle is in a driving mode, so that the component ECU and the component actuator ECU switch the driving mode to an entertainment mode;
a virtual signal receiving module 420, configured to receive a virtual control signal sent by a component ECU, where the virtual control signal is obtained by conversion of a corresponding component ECU when a user operates a mechanical component;
a virtual driving information generating module 430, configured to generate virtual driving display information according to the virtual control signal;
a virtual driving information output module 440, configured to output the virtual driving display information to a display device.
Optionally, the first mode switching module is specifically configured to:
respectively sending the mode switching instruction to a component ECU and a component execution mechanism ECU through a CAN bus;
the virtual signal receiving module is specifically configured to:
and receiving a virtual control signal sent by the component ECU through the CAN bus.
Optionally, the apparatus further comprises:
the virtual scene acquisition module is used for acquiring a virtual driving scene and outputting the virtual driving scene to the display device;
the virtual driving information generation module is specifically configured to:
and generating virtual driving display information of a virtual vehicle in the virtual driving scene according to the virtual control signal.
Optionally, the virtual scene obtaining module is specifically configured to:
generating a virtual driving scene according to the current position information of the vehicle; or
And displaying a plurality of virtual driving scenes and acquiring the virtual driving scene selected by the user.
Optionally, the mechanical component comprises at least one of a steering wheel, a gear shift lever, a brake, a clutch and a throttle.
Optionally, the component ECU includes a steering wheel ECU, a shift lever ECU, a brake ECU, a clutch ECU and a throttle ECU, and the component execution structure ECU includes a steering wheel execution mechanism ECU, a shift lever execution mechanism ECU, a brake execution mechanism ECU, a clutch execution mechanism ECU and a throttle execution mechanism ECU.
Optionally, the apparatus further comprises:
and the second mode switching module is used for sending the mode switching instruction to the component ECU and the component execution mechanism ECU when the mode switching instruction is received again, so that the component ECU and the component execution mechanism ECU switch the virtual driving mode into the driving mode, and the component execution mechanism ECU executes real control signals from corresponding mechanical components.
Optionally, the display device includes: and at least one of a center control screen, a virtual reality display and a head-up display HUD.
The device for implementing virtual driving of a vehicle provided in the embodiment of the present application is used for implementing each step of the method for implementing virtual driving of a vehicle described in the embodiment of the present application, and specific implementation manners of each module of the device refer to the corresponding step, which is not described herein again.
According to the device for realizing the virtual driving of the vehicle, when the vehicle is in the driving mode, the first mode switching module responds to the mode switching instruction to respectively send the mode switching instruction to the component ECU and the component execution mechanism ECU so that the component ECU and the component execution mechanism ECU switch the driving mode to the virtual driving mode, the virtual signal receiving module receives the virtual control signal sent by the component ECU, the virtual driving information generating module generates the virtual driving display information according to the virtual control signal, and the virtual driving information output module outputs the virtual driving display information to the display device, so that the virtual driving is realized by utilizing various mechanical components in the vehicle, and the interactivity is improved.
Correspondingly, the embodiment of the application also provides an in-vehicle infotainment system, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the computer program to realize the method for realizing the virtual driving of the vehicle.
Embodiments of the present application also provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor of an in-vehicle infotainment system, implements the steps of a method of implementing virtual driving of a vehicle as described in embodiments of the present application.
The embodiment of the present application further provides a computer program product, which when executed, implements the method for implementing virtual driving of a vehicle according to the embodiment of the present application.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The method, the device, the system, the vehicle and the storage medium for implementing virtual driving of the vehicle provided by the embodiment of the present application are introduced in detail above, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the above embodiment is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.

Claims (12)

1. A method of implementing virtual driving of a vehicle, comprising:
when the vehicle is in a driving mode, responding to a mode switching instruction, and respectively sending the mode switching instruction to a component ECU and a component execution mechanism ECU so that the component ECU and the component execution mechanism ECU switch the driving mode to a virtual driving mode;
receiving a virtual control signal sent by a component ECU, wherein the virtual control signal is obtained by converting the corresponding component ECU when a user operates a mechanical component;
generating virtual driving display information according to the virtual control signal;
and outputting the virtual driving display information to a display device.
2. The method according to claim 1, wherein said sending mode switching commands to the component ECU and the component execution structure ECU, respectively, comprises:
respectively sending the mode switching instruction to a component ECU and a component execution mechanism ECU through a CAN bus;
the virtual control signal sent by the receiving component ECU comprises:
and receiving a virtual control signal sent by the component ECU through the CAN bus.
3. The method according to claim 1 or 2, characterized in that before receiving the virtual control signal sent by the component ECU, it further comprises:
acquiring a virtual driving scene, and outputting the virtual driving scene to the display device;
generating virtual driving display information according to the virtual control signal comprises the following steps:
and generating virtual driving display information of a virtual vehicle in the virtual driving scene according to the virtual control signal.
4. The method of claim 3, wherein the obtaining a virtual driving scenario comprises:
generating a virtual driving scene according to the current position information of the vehicle; or
And displaying a plurality of virtual driving scenes and acquiring the virtual driving scene selected by the user.
5. The method of claim 1 or 2, wherein the mechanical component comprises at least one of a steering wheel, a shift lever, a brake, a clutch, and a throttle.
6. The method according to claim 1 or 2, wherein the component ECUs include a steering wheel ECU, a shift lever ECU, a brake ECU, a clutch ECU, and a throttle ECU, and the component execution structure ECUs include a steering wheel execution mechanism ECU, a shift lever execution mechanism ECU, a brake execution mechanism ECU, a clutch execution mechanism ECU, and a throttle execution mechanism ECU.
7. The method according to claim 1 or 2, further comprising, after sending the mode switching instruction to the component ECU and the component actuator ECU, respectively:
and when the mode switching instruction is received again, the mode switching instruction is sent to the component ECU and the component execution mechanism ECU so that the component ECU and the component execution mechanism ECU switch the virtual driving mode into the driving mode, and the component execution mechanism ECU executes real control signals from the corresponding mechanical components.
8. The method according to claim 1 or 2, wherein the display device comprises: and at least one of a center control screen, a virtual reality display and a head-up display HUD.
9. An apparatus for implementing virtual driving of a vehicle, comprising:
the device comprises a first mode switching module, a second mode switching module and a control module, wherein the first mode switching module is used for responding to a mode switching instruction when a vehicle is in a driving mode, and sending the mode switching instruction to a component ECU and a component execution mechanism ECU respectively so that the component ECU and the component execution mechanism ECU switch the driving mode into an entertainment mode;
the virtual signal receiving module is used for receiving a virtual control signal sent by the component ECU, wherein the virtual control signal is obtained by converting the corresponding component ECU when a user operates the mechanical component;
the virtual driving information generating module is used for generating virtual driving display information according to the virtual control signal;
and the virtual driving information output module is used for outputting the virtual driving display information to a display device.
10. An in-vehicle infotainment system, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor, when executing the computer program, implements a method for implementing virtual driving of a vehicle as claimed in any one of claims 1 to 8.
11. A vehicle comprising a mechanical component, a component ECU, a component actuator ECU and an in-vehicle infotainment system, characterized in that the in-vehicle infotainment system is adapted to carry out the method of carrying out a virtual driving of a vehicle as claimed in any one of claims 1 to 8.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor of an in-vehicle infotainment system, carries out the steps of the method of carrying out virtual driving of a vehicle of one of claims 1 to 8.
CN202110310991.3A 2021-03-23 2021-03-23 Method, device, system, vehicle and storage medium for realizing virtual driving of vehicle Active CN113442943B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110310991.3A CN113442943B (en) 2021-03-23 2021-03-23 Method, device, system, vehicle and storage medium for realizing virtual driving of vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110310991.3A CN113442943B (en) 2021-03-23 2021-03-23 Method, device, system, vehicle and storage medium for realizing virtual driving of vehicle

Publications (2)

Publication Number Publication Date
CN113442943A true CN113442943A (en) 2021-09-28
CN113442943B CN113442943B (en) 2024-03-19

Family

ID=77809211

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110310991.3A Active CN113442943B (en) 2021-03-23 2021-03-23 Method, device, system, vehicle and storage medium for realizing virtual driving of vehicle

Country Status (1)

Country Link
CN (1) CN113442943B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113859255A (en) * 2021-10-12 2021-12-31 国汽智控(北京)科技有限公司 Control method, device and equipment of vehicle actuator and storage medium
CN115166978A (en) * 2022-07-21 2022-10-11 重庆长安汽车股份有限公司 Display lens, system, method and medium of head-up display system
WO2024041198A1 (en) * 2022-08-26 2024-02-29 惠州市德赛西威汽车电子股份有限公司 Intelligent driving method, apparatus and system, and domain controller, medium and vehicle

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105807922A (en) * 2016-03-07 2016-07-27 湖南大学 Implementation method, device and system for virtual reality entertainment driving
CN106394545A (en) * 2016-10-09 2017-02-15 北京汽车集团有限公司 Driving system, unmanned vehicle and vehicle remote control terminal
CN108182927A (en) * 2017-12-29 2018-06-19 深圳市翠园科技有限公司 System and its implementation with the remote interaction of plant is realized based on mobile terminal
CN208188811U (en) * 2018-02-25 2018-12-04 绿驰汽车科技（上海）有限公司 A kind of virtual cabin multi-screen interactive control system of car steering
WO2018224407A1 (en) * 2017-06-08 2018-12-13 Deutsches Zentrum für Luft- und Raumfahrt e.V. Motor vehicle having a driving mode and a simulation mode
CN109839106A (en) * 2019-02-22 2019-06-04 上海蔚来汽车有限公司 The appraisal procedure and system of driving analog system, vehicle-mounted information and entertainment system
CN110083088A (en) * 2019-03-29 2019-08-02 上海赫千电子科技有限公司 Signal controls conversion equipment and signal controls conversion method
CN111688488A (en) * 2019-03-12 2020-09-22 上海博泰悦臻电子设备制造有限公司 Vehicle, vehicle machine equipment and virtual scene control method thereof
CN111708435A (en) * 2020-06-08 2020-09-25 中国第一汽车股份有限公司 Vehicle-mounted virtual reality equipment control method and device, vehicle and storage medium
CN111768673A (en) * 2020-07-06 2020-10-13 珠海超凡视界科技有限公司 Driving training video generation method and system based on virtual reality

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105807922A (en) * 2016-03-07 2016-07-27 湖南大学 Implementation method, device and system for virtual reality entertainment driving
CN106394545A (en) * 2016-10-09 2017-02-15 北京汽车集团有限公司 Driving system, unmanned vehicle and vehicle remote control terminal
WO2018224407A1 (en) * 2017-06-08 2018-12-13 Deutsches Zentrum für Luft- und Raumfahrt e.V. Motor vehicle having a driving mode and a simulation mode
CN108182927A (en) * 2017-12-29 2018-06-19 深圳市翠园科技有限公司 System and its implementation with the remote interaction of plant is realized based on mobile terminal
CN208188811U (en) * 2018-02-25 2018-12-04 绿驰汽车科技（上海）有限公司 A kind of virtual cabin multi-screen interactive control system of car steering
CN109839106A (en) * 2019-02-22 2019-06-04 上海蔚来汽车有限公司 The appraisal procedure and system of driving analog system, vehicle-mounted information and entertainment system
CN111688488A (en) * 2019-03-12 2020-09-22 上海博泰悦臻电子设备制造有限公司 Vehicle, vehicle machine equipment and virtual scene control method thereof
CN110083088A (en) * 2019-03-29 2019-08-02 上海赫千电子科技有限公司 Signal controls conversion equipment and signal controls conversion method
CN111708435A (en) * 2020-06-08 2020-09-25 中国第一汽车股份有限公司 Vehicle-mounted virtual reality equipment control method and device, vehicle and storage medium
CN111768673A (en) * 2020-07-06 2020-10-13 珠海超凡视界科技有限公司 Driving training video generation method and system based on virtual reality

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113859255A (en) * 2021-10-12 2021-12-31 国汽智控(北京)科技有限公司 Control method, device and equipment of vehicle actuator and storage medium
CN115166978A (en) * 2022-07-21 2022-10-11 重庆长安汽车股份有限公司 Display lens, system, method and medium of head-up display system
CN115166978B (en) * 2022-07-21 2023-06-16 重庆长安汽车股份有限公司 Display lens, system, method and medium of head-up display system
WO2024041198A1 (en) * 2022-08-26 2024-02-29 惠州市德赛西威汽车电子股份有限公司 Intelligent driving method, apparatus and system, and domain controller, medium and vehicle

Also Published As

Publication number Publication date
CN113442943B (en) 2024-03-19

Similar Documents

Publication Publication Date Title
CN113442943B (en) Method, device, system, vehicle and storage medium for realizing virtual driving of vehicle
CN110368682B (en) Interactive system and method for vehicle-mounted game
CN110368679B (en) Vehicle-mounted game method, device, vehicle and machine-readable medium
CN110368681A (en) Vehicle-mounted method for gaming, device, vehicle and machine readable media
WO2018224407A1 (en) Motor vehicle having a driving mode and a simulation mode
KR101403530B1 (en) A simulated driving training device of agricultural tractor
CN112487549B (en) System and method for testing reaction behavior of driver after automatic driving steering failure
CN112221117A (en) Driving simulation platform and method
CN112258925A (en) Automobile driving simulation training system with real road feeling of feedback steering
CN114924649A (en) Vehicle-mounted entertainment method based on virtual driving, vehicle-mounted entertainment system and storage medium
CN110368680B (en) Vehicle-mounted game method and device
CN110728878A (en) Somatosensory interactive VR driving simulation device
CN112519795B (en) Automobile manual function demonstration system, automobile and method
CN210804847U (en) Remote control driving system
WO2023174133A1 (en) Control method and apparatus for vehicle, central control platform, and storage medium
CN111798717B (en) Electric vehicle control system and method supporting VR driving training
CN115626173A (en) Vehicle state display method and device, storage medium and vehicle
WO2022183449A1 (en) Automatic driving testing method and system, vehicle and storage medium
CN116726478A (en) Game hand feeling feedback method, device and medium based on steering wheel
CN113409646A (en) Real-time switching device and system for virtual driving and real driving
CN112758014A (en) Driving signal processing method and vehicle
JP2021017194A (en) Operation part control device and vehicle control system
CN116052504B (en) Method and device for processing brake data of automobile simulated driver and electronic equipment
JP3758744B2 (en) Simulated operation device for both real images and 3D CG images
CN209885211U (en) Third visual angle anti-true operation remote control car

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant