CN116449812A

CN116449812A - Interaction method and device, terminal equipment and storage medium

Info

Publication number: CN116449812A
Application number: CN202210016324.9A
Authority: CN
Inventors: 戴观祺; 饶恒; 吴宇灏; 杨文友; 胡智淼; 王舒烨
Original assignee: Guangzhou Xiaopeng Motors Technology Co Ltd
Current assignee: Guangzhou Xiaopeng Motors Technology Co Ltd
Priority date: 2022-01-07
Filing date: 2022-01-07
Publication date: 2023-07-18

Abstract

The application discloses an interaction method of remote vehicle driving service, comprising the following steps: in response to a call service request initiated by a user, a call service order corresponding to the call service request is presented in a cabin of a remote driving service, the call service request is used for a user to call a vehicle to a designated call position, and meanwhile, in response to the processing of the call service order by a security officer in the cabin, completion process state information of the call service order is presented in the cabin. The calling service order initiated by the user and the completion process state information of the calling service order can be presented in the remote vehicle driving service, so that the security officer processes the calling server order and is helped to complete the calling service better. In addition, the interaction method does not need users to contact the driver, so that the handover is smoother, smoother and faster, and meanwhile, the problem of article safety caused by the driver entering the vehicle does not exist. The application also discloses an interaction device, terminal equipment and a storage medium.

Description

Interaction method and device, terminal equipment and storage medium

Technical Field

The present disclosure relates to the field of traffic, and in particular, to an interaction method, an interaction device, a terminal device, and a computer readable storage medium for remote vehicle driving service.

Background

In daily use of the vehicle, if the user stops the vehicle at a large market supermarket or the like, a parking space may be far from the elevator entrance, and the user needs to walk a long distance to the elevator entrance after stopping the vehicle. Or inconvenient for weather reasons. The travel market has the service of manual driving, but more service is presented in the situation that a user cannot drive when drinking wine, when the user calls driving through a mobile phone, a driver of driving the vehicle needs a period of time to reach the side of the vehicle after frequently calling the driving through the mobile phone, and the driver of driving the vehicle needs a vehicle owner to take a vehicle key to drive the vehicle to the vehicle owner residence, and the driver of driving the vehicle instead can have the risk of generating inconvenience or property loss in entering the vehicle in the driving process.

Disclosure of Invention

In view of this, the embodiment of the present application provides an interaction method for remote vehicle driving service, including:

responding to a call service request initiated by a user, and presenting a call service order corresponding to the call service request in a cabin of the remote driving service, wherein the call service request is used for a user to call a vehicle to a designated call position;

And presenting completion status information of the summoning service order in the cabin in response to processing of the summoning service order by a security officer in the cabin.

Therefore, the calling service order initiated by the user and the completion process state information of the calling service order can be presented in the remote vehicle driving service, so that the security officer processes the calling server order and is helped to complete the calling service better. In addition, the interaction method does not need users to contact the driver, so that the handover is smoother, smoother and faster, and meanwhile, the problem of article safety caused by the driver entering the vehicle does not exist. Meanwhile, through presenting the status information of the order completion process, a security officer can clearly know the condition of each node in the process of servicing the order, so that on one hand, the vehicle can be ensured to smoothly travel to the calling position of the user, and on the other hand, the accident situation possibly occurring under the background that the existing automatic driving technology is not mature is avoided. Furthermore, the vehicle is taken over in a mode of remote control by a safety officer, so that the running safety supervision of the running process of the vehicle can be carried out, and the user is not required to get on the vehicle to operate.

The presenting, in the cabin, completion status information for the summoning service order in response to processing of the summoning service order by a security officer in the cabin includes:

and under the condition that the safety personnel in the cabin takes the call service order, the remote cabin displays the order state as a waiting-for-departure state.

Thus, after the security personnel takes the order of the calling service, the corresponding order state is displayed through the remote cabin, so that the security personnel can know the current order state in the cabin, and the preparation work of the order service is started according to the state of waiting for departure.

After the security personnel in the cabin takes the call service order, the interaction method further comprises the following steps:

presenting a status of a self-test of a vehicle system within the cabin;

under the condition that the vehicle system passes the self-inspection, the remote cabin feeds back a prompt that the safety personnel can perform the manual inspection to the safety personnel, and displays a result confirmation control of the manual inspection;

in response to operation of the result confirmation control by the security officer, the remote cockpit display confirms departure control to cause the security officer to confirm departure for the summoning service order.

Thus, the processing efficiency of calling service orders can be improved by responding to the order receiving operation of the safety officer and automatically transferring to the self-checking state of the vehicle system and the manual checking state of the safety officer. Meanwhile, the flow state of the inspection is displayed to the safety officer, so that the safety officer can clearly know the current self-inspection state of the vehicle system.

The interaction method further comprises the following steps:

and under the condition that the self-check of the vehicle system is abnormal or the manual check is abnormal, the remote cabin feeds back an abnormal prompt to the safety officer and finishes the calling service order.

Therefore, when the abnormality is checked, automatic state circulation can be carried out, and a safety person can confirm and judge whether order service is carried out, so that order processing efficiency is improved.

The presenting in the cabin completion status information for the summoning service order in response to processing of the summoning service order by a security officer in the cabin further comprises:

after the security officer confirms the departure of the calling service order, displaying an automatic driving starting control of the vehicle by the remote cabin under the condition that the area where the vehicle is located belongs to a first area, wherein the first area is an automatic driving available area of the vehicle;

And responding to the operation of the automatic driving start control by the safety personnel, and presenting the process of automatically driving the vehicle to the calling position in the first area in the cabin.

Therefore, the safety officer can prompt the vehicle to automatically drive in the first area in the cabin under the condition that the vehicle is in the first area, so that the safety officer can control the vehicle to enter the automatic driving, and the burden of the safety officer is reduced. Meanwhile, the process that the vehicle automatically drives to the calling position in the first area is presented in the cabin, so that a safety officer can remotely monitor the automatic driving process, and the safety of the automatic driving of the vehicle is guaranteed to a certain extent.

after the security officer confirms the departure of the calling service order, the remote cabin feeds back a prompt that the vehicle can be driven manually to the security officer under the condition that the area where the vehicle is located belongs to a second area, wherein the second area is an automatic driving unavailable area of the vehicle;

And after the safety personnel remotely manually drive the vehicle, presenting the vehicle to enter a manual driving state in the cabin.

Thus, when the vehicle is located in the second area, a safety person in the remote driving service cabin can drive the vehicle remotely and manually in the cabin, so that the vehicle can still continue to move forward in the area where automatic driving cannot be performed, or the safety person can take over the vehicle manually in an emergency, and the driving safety in the calling service is improved. Meanwhile, the limit of automatic driving and safe driving is clearly distinguished, so that the taking over is convenient to carry out more safely, and simultaneous operation of multiple systems is reduced.

and under the condition that the vehicle is in a preset scene, the remote cabin feeds back a first prompt to the safety personnel so as to prompt the safety personnel to supervise the automatic driving of the vehicle.

Therefore, the situation that the automatic driving possibly has running risk can be pre-warned, and the running safety in the calling service is improved.

In response to the operation of the security officer to confirm departure of the summoning service order, the remote cockpit display order status is a summoning status.

Therefore, the real-time circulation display of the state enables a safety person to know the state of the order after the departure is confirmed in the cabin, and the vehicle is remotely controlled to drive to the calling position according to the content of the calling service order.

and displaying the process of automatically parking the vehicle into the calling position parking space by the remote cabin under the condition that the calling position parking space corresponding to the target calling position is available for automatic parking.

Therefore, a safety officer can supervise the safety of the last parking place of the vehicle, and the situation of parking errors is avoided.

The process of displaying the automatic parking of the vehicle into the calling position parking space by the remote cabin further comprises the following steps:

when an abnormal situation occurs in the automatic parking process of the vehicle, the remote cabin displays second prompt information to prompt the safety officer to take over the vehicle;

In response to the security officer remotely taking over operation of the vehicle, the remote cockpit displays the vehicle entering a manual park drive state.

Therefore, various abnormal conditions in automatic parking of the vehicle can be managed, so that the vehicle can smoothly park into a parking space at the calling position.

The presenting in the cabin completion status information for the summoning service order in response to processing of the summoning service order by a security officer in the cabin further comprises: :

when the parking space at the calling position corresponding to the calling position is not available for automatic parking, responding to the operation of stopping automatic driving of the vehicle, and displaying third prompting information by the remote cabin to prompt the safety personnel to remotely take over the vehicle;

Therefore, under the condition that the calling position parking space is unavailable for automatic parking, the safety personnel can be prompted to take over manually through the corresponding prompt information, so that the vehicle can be smoothly parked into the calling position parking space.

And under the condition that the vehicle enters the parking space at the calling position, displaying an order state by the remote cabin as a state waiting for taking the vehicle.

Therefore, the safety officer can know that the current vehicle enters the parking space at the calling position and parks successfully in the cabin, and the safety officer waits for the user to pick up the vehicle.

in the event that the vehicle is detected to be engaged in a park in a manual park drive state, the remote cabin display confirms arrival control;

and responding to the operation of the safety personnel on the confirmation arrival control, wherein the remote cabin display order state is a waiting-for-get state.

Thus, after manual driving parking, the whole person can know that the current vehicle enters the parking space at the calling position in the cabin and successfully parks, so as to wait for the user to fetch the vehicle.

the remote cabin displays a confirmation service end control under the condition that the order state is in a waiting state;

And closing the calling service order in the cabin in response to the operation of confirming the service end by the security personnel.

In this way, a confirmation service end control is displayed so that the security officer can control the end state of the summoning service by manually confirming whether to end.

The interaction method further comprises the following steps:

and closing the calling service order in the cabin after the waiting for taking state lasts for a preset time.

And if the safety personnel does not operate the confirmation service end control after the order state flows to the waiting-for-picking state, automatically closing the calling service order in the cabin to finish the remote driving service.

The interaction method further comprises the following steps:

and under the condition that the order state is in a waiting state, responding to the operation of remotely controlling the vehicle to perform manual driving takeover by the safety personnel, displaying that the vehicle enters the manual driving state by the remote cabin, and redisplaying that the order state is in a calling state.

Therefore, in the process of waiting for the user to pick up the vehicle, the vehicle can be driven by manually taking over the vehicle, so that the vehicle enters the calling state again, and the accident occurring in the process of waiting for the user to pick up the vehicle is processed.

The application also provides an interaction device of remote vehicle driving service, comprising:

the first presentation module is used for responding to a call service request initiated by a user, presenting a call service order corresponding to the call service request in a cabin of the remote driving service, wherein the call service request is used for a user to call a vehicle to a designated call position;

and the second presentation module is used for responding to the processing of the calling service order by the security personnel in the cabin and presenting the completion process state information of the calling service order in the cabin.

The application also provides a terminal device, the vehicle comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, implements the method of any of the above.

The present application also provides a non-transitory computer readable storage medium, which when executed by one or more processors, implements the method described in any of the above embodiments.

The method and the system have the advantages that a calling service order corresponding to the calling service request is presented in a cabin of a remote driving service in response to the calling service request initiated by a user, the calling service request is used for a user to call a vehicle to a designated calling position, and meanwhile, the completion process state information of the calling service order is presented in the cabin in response to the processing of the calling service order by a security officer in the cabin. The calling service order initiated by the user and the completion process state information of the calling service order can be presented in the remote vehicle driving service, so that the security officer processes the calling server order and is helped to complete the calling service better. Meanwhile, the state information of each node can be clearly known in the process of servicing the order by presenting the state information of the order completion process, so that on one hand, the vehicle can be ensured to smoothly travel to the calling position of the user, and on the other hand, the accident situation possibly occurring under the background that the existing automatic driving technology is not mature is avoided. Furthermore, the vehicle is taken over in a mode of remote control by a safety officer, so that the driving safety supervision of the vehicle driving process can be performed, a user is not required to contact with a driver for the purpose of smooth and quick handover, and meanwhile, the problem of article safety caused by the driver entering the vehicle is avoided.

Additional aspects and advantages of embodiments of the application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a flow diagram of an interaction method of the present application;

FIG. 2 is a block diagram of an interactive device of the present application;

FIG. 3 is an exemplary diagram of an interaction method of the present application;

FIG. 4 is a flow chart of an interaction method of the present application;

FIG. 5 is a flow diagram of an interaction method of the present application;

FIG. 6 is a flow diagram of an interaction method of the present application;

FIG. 7 is a flow chart of an interaction method of the present application;

FIG. 8 is a flow chart of an interaction method of the present application;

fig. 9 is a flow chart of an interaction method of the present application.

Detailed Description

Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for explaining the embodiments of the present application and are not to be construed as limiting the embodiments of the present application.

Referring to fig. 1, the application provides an interaction method of remote vehicle driving service, which includes:

01: responding to a calling service request initiated by a user, and presenting a calling service order corresponding to the calling service request in a cabin of a remote driving service, wherein the calling service request is used for a user to call a vehicle to a designated calling position;

02: in response to processing of the summoning service order by a security officer within the cabin, completion status information of the summoning service order is presented within the cabin.

Accordingly, referring to fig. 2, the embodiment of the present application further provides an interaction device 100 for remote vehicle driving service, and the interaction method for remote vehicle driving service in the embodiment of the present application may be implemented by the interaction device 100. The interaction device 100 comprises a first presentation module 110 and a second presentation module 120. Step 01 may be implemented by the first rendering module 110 and step 02 may be implemented by the second rendering module 120. In other words, the first presentation module 110 is configured to respond to a call service request initiated by a user, and present a call service order corresponding to the call service request in a cabin of a remote driving service, where the call service request is used for the user to call a vehicle to a designated call location. The second presentation module 120 is configured to present completion status information of the summoning service order within the cabin in response to processing of the summoning service order by a security officer within the cabin.

The embodiment of the application also provides the terminal equipment. The terminal device includes a memory and a processor. The memory stores computer program, the processor is used for responding to the call service request initiated by the user, and presenting a call service order corresponding to the call service request in the cabin of the remote driving service, wherein the call service request is used for the user to call the vehicle to a designated call position; in response to processing of the summoning service order by a security officer within the cabin, completion status information of the summoning service order is presented within the cabin.

Specifically, the calling service is a remote driving order receiving service, a user remotely places an order through the calling service, and a security personnel remotely controls the vehicle through a remote cabin to drive the vehicle from the current position to a calling position preset by the user.

The cabin of the remote driving service can comprise a safety management platform and a manual safety member, and the safety member can supervise the driving process of the vehicle and manually take over driving when necessary. The security personnel can supervise the auxiliary driving of the vehicle through the remote intelligent cabin, intervene in time to ensure the security if necessary, and can not cover the scene for the auxiliary driving to carry out artificial remote driving. In the cabin of remote driving service, the safety personnel can be assisted to perceive the surrounding environment of the vehicle through image display, so that the safety personnel can be helped to monitor and drive safely. Meanwhile, the terminal equipment can display the calling service order information and the order state information so as to complete the service of a calling service request initiated by a user.

Step 01: and responding to a call service request initiated by the user, and presenting a call service order corresponding to the call service request in a cabin of the remote driving service, wherein the call service request is used for the user to call the vehicle to a designated call position.

The call service request is used for a user to call the vehicle to a designated call position, and the specific call service function is as above. The user initiated summoning service request may be initiated by a terminal device, including a mobile terminal device installed with a specific application. For example, a user's mobile handset is installed with an application providing multiple services such as a calling service, a pilot service, etc., and the user may open the application and access a calling service portal to call the vehicle, where the calling service portal includes multiple forms, one form being a portal displayed in a graphical user interface with a particular user interface design element or control, another form also including a portal that wakes up a calling service with speech, a portal that wakes up with a particular function key in the vehicle cabin, etc. When the call service portal is presented in a graphical user interface, the user clicks the user interface design element or control to enter the service order page, referring to fig. 3, fig. 3 shows a call service portal control on the relevant page, and the user clicks the "call service" control to enter the service order page.

After receiving a call service request sent by a user, a call service order corresponding to the call service request is presented in a cabin of the remote driving service.

And a calling service order can be displayed in the cabin of the remote driving service through the terminal equipment. Wherein the terminal device comprises a display device, which may be a stand-alone computer device or a non-stand-alone computer device. On the display device, a summoning service order may be displayed. The call service order may be displayed on multiple display devices simultaneously or may be displayed on a single display device.

Step 02: in response to processing of the summoning service order by a security officer within the cabin, completion status information of the summoning service order is presented within the cabin.

In the process of the security personnel processing the summoning service order, the completion status information of the summoning service order can be presented in the cabin. Among other things, the security officer's processing of the summoning service order includes, but is not limited to: the safety personnel process the call service order, the safety personnel confirms the departure of the call service order, the safety personnel confirms the arrival of the call service order, etc. Completion status information for a summoning service order includes, but is not limited to: vehicle self-check status, order information, order status, vehicle self-status, vehicle driving status, etc.

Step 02 comprises:

in the case of a security officer in the cabin taking a call to a service order, the remote cabin displays that the order status is a waiting for departure status.

The second presentation module 120 is configured to display, in the case where a security officer in the cabin makes a call to a service order, that the remote cabin displays the order status as a waiting for departure status.

The processor is used for displaying the order state as the waiting departure state by the remote cabin under the condition that the safety personnel in the cabin takes the order of the calling service.

After receiving the call service order, the background server of the remote driving service can dispatch the call service order, dispatch the current call service order to the corresponding security personnel, and then display the order information of the call service order on the terminal equipment of the security personnel. After receiving the order, the security personnel can enter an order service page, and the displayed order state becomes a waiting state. After the security personnel receive the order, the background server of the remote driving service can send the order in a state of waiting for departure to the user side, so that the user knows that the current calling service request is processed.

Thus, after the security personnel takes the order of the calling service, the corresponding order state is displayed in the cabin so that the security personnel can know the current order state in the cabin, and thus, the preparation work of the order service is started according to the state of waiting for departure.

Referring to fig. 4, after the security personnel in the cabin takes the call for the call service order, the interaction method further includes:

03: presenting a state of self-inspection of the vehicle system in the cabin;

04: under the condition that the self-inspection of the vehicle system passes, the remote cabin feeds back a prompt that the safety personnel can perform manual inspection to the safety personnel, and displays a result confirmation control of the manual inspection;

05: in response to the operation of the result confirmation control by the security officer, the remote cockpit display confirms the departure control to cause the security officer to confirm departure for the summoning service order.

Steps 03-05 may be implemented by the second rendering module 120. In other words, the second presenting module 120 is configured to present a status of the vehicle system self-test in the cabin; under the condition that the self-inspection of the vehicle system passes, the remote cabin feeds back a prompt that the safety personnel can perform manual inspection to the safety personnel, and displays a result confirmation control of the manual inspection; in response to the operation of the result confirmation control by the security officer, the remote cockpit display confirms the departure control to cause the security officer to confirm departure for the summoning service order.

The processor is used for presenting the state of self-checking of the vehicle system in the cabin; under the condition that the self-inspection of the vehicle system passes, the remote cabin feeds back a prompt that the safety personnel can perform manual inspection to the safety personnel, and displays a result confirmation control of the manual inspection; in response to the operation of the result confirmation control by the security officer, the remote cockpit display confirms the departure control to cause the security officer to confirm departure for the summoning service order.

After the security officer receives the call service order, the background server of the remote driving service can perform a self-checking flow of the vehicle system before the vehicle corresponding to the call service request starts, for example, a self-checking project of detecting whether the vehicle sensor is normal or not. The cabin of the safety officer can present the self-checking state of the vehicle system to the safety officer through the display device, for example, the current self-checking item and the checking result of the current self-checking item can be dynamically presented in real time, so that the safety officer can clearly know the self-checking item and the result of the current self-checking of the vehicle system.

When the self-checking of the vehicle system passes, the display device in the cabin can display the passing result of the self-checking, and simultaneously, a prompt for the safety personnel to perform manual checking is popped up to prompt the safety personnel to enter the manual checking, and meanwhile, a result confirmation control of the manual checking is displayed on the current display device. The content of the manual inspection includes, but is not limited to: checking telecommunication video quality, checking the surroundings of the vehicle, checking whether the steering wheel of the vehicle can be manually remotely operated, etc. After the manual inspection of the safety officer passes, a confirmation departure control can be displayed in the remote seat cabin, and the safety officer clicks the confirmation control displayed by confirmation to confirm departure of the calling service order.

After the safety personnel in the cabin takes the order of the calling service order, the interaction method further comprises the following steps:

and under the condition that the self-check of the vehicle system is abnormal or the manual check is abnormal, the remote cabin feeds back an abnormal prompt to the safety personnel and finishes calling the service order.

The second presentation module 120 is configured to, in a case where an abnormality occurs in the self-inspection of the vehicle system or in a case where an abnormality occurs in the manual inspection, feed back an abnormality prompt to the security personnel from the remote cabin, and end the summoning of the service order.

The processor is used for feeding back an abnormal prompt to the safety personnel by the remote cabin and ending the calling service order under the condition that the self-checking of the vehicle system is abnormal or the manual checking is abnormal.

When the self-checking of the vehicle system is abnormal, the abnormal conditions such as that a certain self-checking item does not pass or the self-checking of the vehicle system stops processing are included, the remote cabin can feed back an abnormal prompt to a safety officer, and the current calling service order is automatically ended.

For the abnormal condition of manual inspection, a pass control and a fail control can be displayed in the cabin, and the security personnel clicks the fail control, so that the current calling service order can be ended.

Referring to fig. 5, step 02 includes:

021: after a security officer confirms the departure of a calling service order, displaying an automatic driving starting control of the vehicle by a remote cabin under the condition that the area where the vehicle is located belongs to a first area, wherein the first area is an automatic driving available area of the vehicle;

022: in response to a security operator operating the autopilot activation control, a process is presented in the cabin for the vehicle to autopilot in the first zone to a summoned location.

Steps 021 and 022 may be implemented by the second presentation module 120. Or, the second presentation module 120 is configured to display an automatic driving start control of the vehicle in the remote cabin when the area where the vehicle is located belongs to a first area after the security officer confirms that the call service order is to be sent, where the first area is an automatic driving available area of the vehicle; in response to a security operator operating the autopilot activation control, a process is presented in the cabin for the vehicle to autopilot in the first zone to a summoned location.

The processor is used for displaying an automatic driving starting control of the vehicle in a remote cabin under the condition that the area where the vehicle is located belongs to a first area after the safety officer confirms the departure of the calling service order, and the first area is an automatic driving available area of the vehicle; in response to a security operator operating the autopilot activation control, a process is presented in the cabin for the vehicle to autopilot in the first zone to a summoned location.

The user calling the vehicle to the calling position can be applied to various scenes, the user calls the vehicle to the current position at the current moment, the user calls the vehicle to the preset place at the reserved time, and the like.

For example: after the user finishes shopping, the parking place can not be found in the parking lot, a calling service order can be initiated through a terminal such as a mobile phone, and a calling vehicle reaches the position of the user or the position designated by the user. The vehicle can use the memory parking and other automatic driving functions in the parking lot, and in the calling service process, the vehicle can memorize the stored driving route in advance according to the memory parking function and automatically drive to the calling position of the user in the parking lot.

And after the safety officer confirms the departure of the current calling service order, the vehicle receives a signal of the remote driving-generation background server to start driving. In the event that the area in which the vehicle is located belongs to a first area available for autopilot, the remote cabin may display an autopilot opening control for the vehicle. When the vehicle is in the first area, the service management platform of the remote driving service can monitor whether the vehicle reaches the first area in real time, after the vehicle reaches the first area, the cabin can prompt that the vehicle enters the automatic driving available area through text information or voice broadcast, the vehicle is started after stopping, and the remote cabin can display an automatic driving starting control of the vehicle, wherein the display comprises that the automatic driving starting control is recovered from a gray state, or the automatic driving starting control is redisplayed. The safety officer may operate, such as clicking, an autopilot opening control to control the vehicle to open autopilot.

It should be noted that, the autopilot functions of the present application include a road surface unmanned function, a memory parking autopilot function, and/or an autopilot function, where a vehicle is autopilot without a driver, and the use of a specific driving function may be determined according to actual services and restrictions.

Therefore, the safety officer can prompt the vehicle to automatically drive in the first area in the cabin under the condition that the vehicle is in the first area, so that the safety officer can control the vehicle to enter the automatic driving, and the burden of the safety officer is reduced. Meanwhile, the process of automatically driving the vehicle to the calling position in the first area is presented in the cabin, so that a safety officer can remotely monitor the process of automatically driving, and the safety of automatically driving the vehicle is ensured to a certain extent.

Referring to fig. 5, step 02 includes:

023: after the safety officer confirms the departure of the calling service order, the remote cabin feeds back a prompt that the vehicle can be driven manually to the safety officer under the condition that the area where the vehicle is located belongs to a second area, wherein the second area is an automatic driving unavailable area of the vehicle;

024: after the safety officer remotely drives the vehicle manually, the vehicle is presented in the cabin to enter a manual driving state.

Steps 023 and 024 may be implemented by the second rendering module 120. Or, the second presentation module 120 is configured to, after the security officer confirms that the calling service order is to be sent, feed back, by the remote cabin, a prompt that the vehicle can be driven manually to the security officer when the area where the vehicle is located belongs to a second area, where the automatic driving of the vehicle is unavailable; after the safety officer remotely drives the vehicle manually, the vehicle is presented in the cabin to enter a manual driving state.

The processor is used for feeding back a prompt that the vehicle can be driven manually to the safety personnel when the area where the vehicle is located belongs to a second area after the safety personnel confirms the departure of the calling service order, and the second area is an automatic driving unavailable area of the vehicle; after the safety officer remotely drives the vehicle manually, the vehicle is presented in the cabin to enter a manual driving state.

In the calling service process, the vehicle can automatically drive to the calling position of the user in the parking lot according to the driving route memorized in advance in the memorizing and parking function. In this process, there may be a circulation between autopilot functions, requiring manual operation by a security officer, engaging autopilot capability. For example, when the vehicle passes through a floor, the memory parking is used to reach the end point of the memory parking line, the safety personnel manually drive the vehicle, and the memory parking is started after the vehicle reaches the next starting point.

Under the condition that the area where the vehicle is located belongs to a second area where automatic driving is unavailable, the remote cabin can feed back a prompt that the vehicle can be driven manually to a safety officer, the cabin can report the prompt that the automatic driving is temporarily unavailable through text information or voice, please drive manually, and the safety officer can operate a driving suite comprising a simulated steering wheel, a simulated brake and a simulated gear in the remote cabin to take over the vehicle manually so as to control the vehicle to drive. At the same time, the vehicle is presented in the cabin to enter a manual driving state. Meanwhile, the fact that the current automatic driving is temporarily unavailable can be displayed in the corresponding display area, and the automatic driving control can be gray or not displayed.

During the driving process of the safety officer, the remote drive-by-drive background server can monitor whether the automatic drive available area is reached or not at all times. When the available area is reached, the remote driving generation background server controls a display device in the remote cockpit to display an automatic driving starting control, and prompts that the automatic driving is available, but the automatic driving starting control is in a gray temporary unavailable state at the moment, and the automatic driving is started by guiding a safety person to stop and then operating. After the safety officer parks, the automatic driving opening control is changed from a temporarily unavailable gray state to a highlight available state, and after clicking the automatic driving opening control, the safety officer starts to automatically drive the vehicle.

Step 02 comprises:

The second presentation module 120 is configured to, in a case where the vehicle is in a preset scene, feed back the first prompt to the safety personnel by the remote cabin, so as to prompt the safety personnel to supervise the automatic driving of the vehicle.

The processor is used for feeding back a first prompt to the safety personnel by the remote cabin under the condition that the vehicle is in a preset scene so as to prompt the safety personnel to supervise the automatic driving of the vehicle.

The preset scene can be an accident high-speed road section, a turning road section, a narrow road section or a road section with more obstacles needing to be avoided, and the like, so that the remote cabin can feed back a first prompt to the safety personnel to early warn the safety personnel in order to avoid possible driving risks of the vehicle, so that the safety personnel can pay attention to possible errors and take over the vehicle.

Step 02 further comprises:

in response to a confirmation of departure of the summoning service order by the security officer, the remote cockpit displays the order status as a summoning status.

The second presentation module 120 is configured to display the order status as a summons-in-progress status in response to the operation of the security officer confirming the departure of the summoning service order.

The processor is used for responding to the operation of the security personnel to confirm and start the calling service order, and the remote cabin displays the order state as the calling state.

Thus, the safety officer can know the state of the order after the departure through the state displayed by real-time circulation, and remotely control the vehicle to drive to the calling position according to the content of the calling service order.

Referring to fig. 6, step 02 further includes:

025: and displaying the process of automatically parking the vehicle into the calling position parking space by the remote cabin under the condition that the calling position parking space corresponding to the target calling position is available for automatic parking.

Step 025 may be implemented by the second rendering module 120. In other words, the second presentation module 120 is configured to display, in the case where the calling position space corresponding to the target calling position is available for automatic parking, a process of automatically parking the vehicle into the calling position space in the remote cockpit.

The processor is used for displaying the process of automatically parking the vehicle into the calling position parking space when the calling position parking space corresponding to the target calling position is available for automatic parking.

The automatic parking refers to that after a vehicle arrives near a parking space at a calling position, the vehicle automatically detects whether the parking space at the calling position can enter by utilizing an automatic parking function, if the parking space can enter by utilizing the automatic parking function, the vehicle starts the automatic parking function to enter the parking space, and after the vehicle smoothly and automatically enters the parking space, the automatic driving is completed. Meanwhile, the remote cabin can display the process of automatically parking the vehicle into the parking space at the calling position.

The process that the remote cabin can display the automatic parking of the vehicle into the parking space at the calling position further comprises the following steps:

when an abnormal situation occurs in the automatic parking process of the vehicle, the remote cabin displays second prompt information to prompt a safety officer to take over the vehicle;

in response to a security officer remotely taking over the operation of the vehicle, the remote cockpit displays the vehicle into a manual park drive state.

The second presentation module 120 is configured to display a second prompt message in the remote cabin to prompt the security personnel to take over the vehicle when an abnormal situation occurs during automatic parking of the vehicle; in response to a security officer remotely taking over the operation of the vehicle, the remote cockpit displays the vehicle into a manual park drive state.

The processor is used for displaying second prompt information by the remote cabin when an abnormal situation occurs in the automatic parking process of the vehicle so as to prompt a safety officer to take over the vehicle; in response to a security officer remotely taking over the operation of the vehicle, the remote cockpit displays the vehicle into a manual park drive state.

During automatic parking of a vehicle into a target charging space, an abnormal situation may occur, for example, a person behind the vehicle. The remote cabin may display a second prompt to prompt the security officer to take over the vehicle. The safety personnel intervenes (such as stepping on the brake) under the emergency, the remote cabin can display that the vehicle enters a manual parking driving state, the automatic driving enters a suspension state, the safety personnel can click a continue button after confirming the surrounding environment, and the automatic driving can be continued to park in the parking space.

The abnormal situation further comprises that the vehicle is out of automatic driving due to the fault or obstacle avoidance, at the moment, the automatic driving cannot be directly restored to automatic driving due to the accident, the vehicle is stopped, and the remote cabin can display second prompt information. The method has the advantages that the safety officer is prompted to take over the vehicle, meanwhile, the early warning safety officer can be highlighted to take over in time, and the safety officer is informed of the automatic parking and exiting of the vehicle.

Referring again to fig. 6, step 02 further includes:

026: when the parking space at the calling position corresponding to the calling position is unavailable for automatic parking, responding to the operation of stopping automatic driving of the vehicle, and displaying third prompt information by the remote cabin to prompt a safety officer to remotely take over the vehicle;

027: in response to a security officer remotely taking over the operation of the vehicle, the remote cockpit displays the vehicle into a manual park drive state.

Steps 026 and 027 may be implemented by the second rendering module 120. Or, the second presentation module 120 is configured to, in response to an operation of stopping the vehicle to perform automatic driving when the parking space at the calling position corresponding to the calling position is not available for automatic parking, display third prompt information in the remote cockpit to prompt the security personnel to remotely take over the vehicle; in response to a security officer remotely taking over the operation of the vehicle, the remote cockpit displays the vehicle into a manual park drive state.

The processor is used for responding to the operation of stopping the vehicle to automatically drive under the condition that the parking space at the calling position corresponding to the calling position is unavailable for automatic parking, and the remote cabin displays third prompt information to prompt a safety officer to remotely take over the vehicle; in response to a security officer remotely taking over the operation of the vehicle, the remote cockpit displays the vehicle into a manual park drive state.

When the parking space at the calling position corresponding to the calling position is unavailable for automatic parking, the automatic driving function of the vehicle can actively stop the vehicle, and meanwhile, the remote cabin can display third prompt information to prompt a safety person to remotely take over the vehicle, and the third prompt information can be a bright early warning prompt, so that the safety person can take over the vehicle directly. When the security officer takes over the vehicle remotely, the remote cockpit can display that the vehicle enters a manual park driving state.

It should be noted that, in the service of the calling service, the calling position parking space may be specially set for the calling service, and the calling position parking space may be pre-locked in the service starting stage, and meanwhile, there is a corresponding rule to manage, for example, ground lock management may be adopted. Abnormal situations during automatic parking of a vehicle may include: on the one hand, if autopilot is not available, the security officer may manually park into the parking space. On the other hand, if the parking space is unavailable due to other reasons, such as being blocked by an object, etc., the security personnel can be preferentially contacted with the property for solving. Meanwhile, in the flow of the calling service, the next step of the user gets on the car soon, if the time consumption of the contact property solution is long and troublesome, the user can be synchronously notified, and the user can get the car at the side of the calling parking space in time. The safety officer needs to ensure that the vehicle is parked in a parking space, or the user can not stop at the roadside at will to finish the service, so that the vehicle is prevented from occupying the road or potential safety hazard is prevented.

Referring to fig. 7, step 02 further includes:

028: and under the condition that the vehicle enters the parking space at the calling position, the remote cabin displays the order state as a waiting-for-pick-up state.

Step 028 may be implemented by the second rendering module 120. In other words, the second presenting module 120 is configured to display, in the case where it is determined that the vehicle enters the parking space at the calling location, that the remote cabin displays the order status as the waiting-for-pickup status.

The processor is used for displaying an order state to be a state waiting for taking a car in the remote cabin under the condition that the car enters the parking space at the calling position is determined.

When the vehicle detects that the vehicle enters the parking space at the calling position through a GPS, beidou or other positioning modes and the vehicle environment, the remote cabin can display that the order state flow is changed into a state waiting for getting the vehicle, and at the moment, the parking is finished through text information or voice broadcasting prompt, and the user is contacted to get the vehicle.

Referring to fig. 7, step 02 further includes:

029: in the event that a vehicle is detected to be engaged in a park in a manual park drive state, the remote cabin display confirms the arrival control;

0210: in response to the operation of the confirmation arrival control by the security officer, the remote cabin displays the order status as a waiting for pickup status.

Steps 029 and 0210 may be implemented by the second rendering module 120. In other words, the second presentation module 120 is configured to display a confirmation arrival control in the remote cockpit in case that it is detected that the vehicle is engaged in a parking gear in a manual parking driving state; in response to the operation of the confirmation arrival control by the security officer, the remote cabin displays the order status as a waiting for pickup status.

The processor is used for displaying a confirmation reaching control on the remote cabin when the condition that the vehicle is hung in a parking gear in a manual parking driving state is detected; in response to the operation of the confirmation arrival control by the security officer, the remote cabin displays the order status as a waiting for pickup status.

In the manual parking process, the automatic driving function of the vehicle is stopped, whether the vehicle is parked in a target parking space or not cannot be effectively and automatically detected, after the safety personnel manually parks in the parking space, the safety personnel hangs in the P gear, the arriving button appears at the moment, after the safety personnel manually clicks to confirm that the arriving button is arrived, the parking is confirmed to be completed, and the remote cabin can display that the order state is a state waiting for taking the vehicle.

Referring to fig. 8, step 02 further includes:

0211: under the condition that the order state is in a state of waiting for taking a car, the remote cabin displays a confirmation service ending control;

0212: in response to a security operator confirming the end of service, the summoning service order is closed within the cabin.

Steps 0211 and 0212 may be implemented by the second rendering module 120. In other words, the second presenting module 120 is configured to display a confirmation service end control on the remote cabin when the order status is in the waiting state; in response to a security operator confirming the end of service, the summoning service order is closed within the cabin.

The processor is used for displaying a confirmation service end control on the remote cabin when the order state is in a state of waiting for taking a car; in response to a security operator confirming the end of service, the summoning service order is closed within the cabin.

When the order state enters a waiting-for-pick-up state, the remote cabin displays that the calling is completed, and the remote cabin can display a confirmation service end control, so that the safety personnel can be supported to manually confirm and close the order. If the safety officer continues to drive at the moment, the automatic flow returns to the calling state, and the safety officer continues to drive.

The interaction method further comprises the following steps:

after waiting for the pick-up status for a preset time, the summoning service order is closed in the cabin.

The second presentation module 120 is configured to close the summoning service order in the cabin after waiting for the pickup status for a preset time.

The processor is configured to close the summoning service order in the cabin after waiting for the pick-up status for a preset time.

If the safety officer does not close the order for a long time in the state of waiting for taking the car, the order can be automatically closed after a preset time, such as one minute, the safety officer returns to the homepage, and the calling service is finished. And when the state of waiting for getting the car is reached, the security personnel service can be finished, and the background server of the remote driving service starts to count down to remind the user to get on the car as soon as possible. The user side can display the countdown and charging timing conditions, and remind the user to get the car as soon as possible.

The interaction method further comprises the following steps:

and under the condition that the order state is in a waiting state, responding to the operation of remotely controlling the vehicle to perform manual driving takeover by a safety person, displaying that the vehicle enters the manual driving state by the remote cabin, and redisplaying the order state as a calling state.

The second presentation module 120 is configured to respond to the operation of the security personnel for remotely controlling the vehicle to take over manual driving when the order status is in the waiting for pickup status, and the remote cockpit displays that the vehicle enters the manual driving status and redisplays the order status as the calling status.

The processor is used for responding to the operation of the safety personnel for remotely controlling the vehicle to carry out manual driving takeover under the condition that the order state is in the state of waiting for taking the vehicle, and the remote cabin displays that the vehicle enters the manual driving state and redisplays the order state as the calling state.

When the order state is in the waiting state, if the vehicle needs to continue running, the safety personnel can not click the confirmation arrival control, for example, the safety personnel remotely controls the vehicle to perform manual driving takeover operation, the remote control vehicle enters the manual driving state, and the remote cabin can display that the vehicle enters the manual driving state and redisplays the order state as the calling state.

Referring to fig. 9, fig. 9 is an exemplary diagram of an order circulation state, wherein after receiving an order by a security officer, the order state is displayed to be triggered, and after confirming departure by the security officer, the order state is displayed as a calling state; when the automatic parking is completed, or after the control is reached after the manual parking is clicked, the state flow is changed into a state waiting for taking the vehicle; if the running needs to be continued, the security personnel can continue to take over the state flow and return to the calling state.

Embodiments of the present application also provide a computer-readable storage medium. One or more non-transitory computer-readable storage media storing a computer program that, when executed by one or more processors, performs the method of any of the above embodiments. Those skilled in the art will appreciate that implementing all or part of the processes in the methods of the embodiments described above may be accomplished by computer programs to instruct related software. The program may be stored in a non-transitory computer readable storage medium, which when executed may include the flow of embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), etc.

In this way, the calling service order corresponding to the calling service request is presented in the cabin of the remote driving service in response to the calling service request initiated by the user, the calling service request is used for the user to call the vehicle to the appointed calling position, and meanwhile, the completion process state information of the calling service order is presented in the cabin in response to the processing of the calling service order by the security personnel in the cabin. The calling service order initiated by the user and the completion process state information of the calling service order can be presented in the remote vehicle driving service, so that the security officer processes the calling server order and is helped to complete the calling service better. Meanwhile, the state information of each node can be clearly known in the process of servicing the order by presenting the state information of the order completion process, so that on one hand, the vehicle can be ensured to smoothly travel to the calling position of the user, and on the other hand, the accident situation possibly occurring under the background that the existing automatic driving technology is not mature is avoided. Furthermore, the vehicle is taken over in a mode of remote control by a safety officer, so that the driving safety supervision of the vehicle driving process can be performed, a user is not required to contact with a driver for the purpose of smooth and quick handover, and meanwhile, the problem of article safety caused by the driver entering the vehicle is avoided.

In the description of the present specification, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction. Meanwhile, the descriptions of the terms "first," "second," and the like are intended to distinguish similar or analogous operations, and the "first" and "second" have a front-to-back logical relationship in some embodiments, and in some embodiments do not necessarily have a logical or front-to-back relationship, and need to be determined according to actual embodiments, and should not be determined by literal meaning.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.

While embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the present application, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the present application.

Claims

1. An interactive method for remote vehicle driving service, comprising the following steps:

2. The method of interaction of claim 1, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit comprises:

3. The method of interaction of claim 2, wherein after the call service order is ordered by the security personnel within the cabin, the method of interaction further comprises:

presenting a status of a self-test of a vehicle system within the cabin;

4. An interaction method as in claim 3, further comprising:

5. The method of interaction of claim 1, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit further comprises:

6. The method of interaction of claim 5, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit further comprises:

7. The method of interaction of claim 1, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit comprises:

8. The method of interaction of any of claims 3-7, wherein the presenting completion status information of the summoning service order within the cabin in response to processing of the summoning service order by a security officer within the cabin comprises:

9. The method of interaction of claim 1, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit further comprises:

10. The method of interaction of claim 9, wherein the process of the remote cockpit displaying the vehicle for automatic parking into the summoned location space further comprises:

11. The method of interaction of claim 1, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit further comprises: :

12. The method of interaction of any of claims 9-11, wherein the presenting completion status information of the summoning service order within the cabin in response to processing of the summoning service order by a security officer within the cabin further comprises:

13. The method of interaction of claim 12, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit further comprises:

14. The method of interaction of claim 12, wherein said presenting completion status information for said summoning service order within said cockpit in response to processing of said summoning service order by a security officer within said cockpit further comprises:

15. The method of interaction of claim 12, wherein the method of interaction further comprises:

16. The method of interaction of claim 12, wherein the method of interaction further comprises:

17. An interactive apparatus for remote vehicle ride-on services, comprising:

18. A terminal device, characterized in that it comprises a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, implements the method of any of claims 1-16.

19. A non-transitory computer readable storage medium of a computer program, characterized in that the method of any one of claims 1-16 is implemented when the computer program is executed by one or more processors.