CN115472044A

CN115472044A - Teaching method and device for automatic driving vehicle and automatic driving vehicle

Info

Publication number: CN115472044A
Application number: CN202211151831.XA
Authority: CN
Inventors: 卢兰琦; 魏鹏飞
Original assignee: Apollo Zhilian Beijing Technology Co Ltd
Current assignee: Apollo Zhilian Beijing Technology Co Ltd
Priority date: 2022-09-21
Filing date: 2022-09-21
Publication date: 2022-12-13

Abstract

The disclosure provides a teaching method and device for an automatic driving vehicle, an electronic device, a storage medium, a computer program product and the automatic driving vehicle, and relates to the technical field of artificial intelligence, in particular to the technical field of automatic driving. The specific implementation scheme is as follows: playing a teaching video, wherein the teaching video comprises a plurality of teaching sub-videos; responding to the end of the playing of the current teaching sub-video, and outputting operation prompt information corresponding to the current teaching sub-video; receiving a control operation for a vehicle; and judging whether the control operation is matched with the specified operation of the operation prompt information, if so, playing the next teaching sub-video of the current teaching sub-video until the teaching video is played completely. According to the method and the device, whether the control operation is matched with the specified operation of the operation prompt information or not is judged, and the safety of automatic driving is improved.

Description

Teaching method and device for automatic driving vehicle and automatic driving vehicle

Technical Field

The present disclosure relates to the field of artificial intelligence technologies, and in particular, to a teaching method and apparatus for an autonomous driving vehicle, an electronic device, a storage medium, a computer program product, and an autonomous driving vehicle.

Background

With the gradual popularization of artificial intelligence technology and fifth generation mobile communication technology, the automatic driving technology is rapidly developed, and the utilization rate of the automatic driving technology on vehicles is higher and higher. Generally, the automatic driving function is mainly realized by basic technologies such as machine vision, radar positioning, satellite positioning and intelligent control. Novice teaching is the first step of a user trying to drive automatically, the quality of experience directly influences the first impression of the user on automatic driving, and how to optimize the user experience to improve the use of the user on automatic driving products is always one of key problems concerned in the field of automatic driving.

Disclosure of Invention

The present disclosure provides a teaching method, apparatus, electronic device, storage medium, computer program product, and autonomous driving vehicle for autonomous driving, which improve safety of autonomous driving.

According to an aspect of the present disclosure, there is provided a teaching method for automatically driving a vehicle, the method including:

playing a teaching video, wherein the teaching video comprises a plurality of teaching sub-videos;

responding to the end of the playing of the current teaching sub-video, and outputting operation prompt information corresponding to the current teaching sub-video;

receiving a control operation for a vehicle;

and judging whether the control operation is matched with the specified operation of the operation prompt information, if so, playing a next teaching sub-video of the current teaching sub-video until the teaching video is played completely.

According to another aspect of the present disclosure, there is provided a teaching apparatus for an autonomous vehicle, including:

the playing module is used for playing teaching videos, wherein the teaching videos comprise a plurality of teaching sub-videos;

the operation prompting module is used for responding to the end of the playing of the current teaching sub-video and outputting operation prompting information corresponding to the current teaching sub-video;

the receiving module is used for receiving control operation of the vehicle;

and the judging module is used for judging whether the control operation is matched with the specified operation of the operation prompt information, and if so, playing the next teaching sub-video of the current teaching sub-video until the teaching video is played completely.

According to another aspect of the present disclosure, there is provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the aforementioned teaching method for automatically driving a vehicle.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to execute the aforementioned teaching method for automatically driving a vehicle.

According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the aforementioned teaching method for automatically driving a vehicle.

According to another aspect of the present disclosure, there is provided an autonomous vehicle, at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the aforementioned teaching method for automatically driving a vehicle.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

FIG. 1 is an exemplary system architecture diagram in which the present disclosure may be applied;

FIG. 2 is a flow chart of one embodiment of a teaching method for automatically driving a vehicle of the present disclosure;

FIG. 3 illustrates an operational depiction of the adaptive cruise function of one embodiment of the present disclosure;

FIG. 4 illustrates an operational depiction of the intelligent lane following assistance function of one embodiment of the present disclosure;

FIG. 5 is an operational depiction of a steering wheel control guide according to one embodiment of the present disclosure;

FIG. 6 is a flow chart of yet another embodiment of the teaching method for autonomous driving a vehicle of the present disclosure;

7a-b illustrate operational representations of test information for one embodiment of the present disclosure;

FIG. 8 shows a schematic diagram of playing a instructional video of one embodiment of the present disclosure;

FIG. 9 is a flow chart of yet another embodiment of the teaching method for autonomous driving a vehicle of the present disclosure;

FIG. 10 illustrates an interface diagram for initiating an autopilot function according to one embodiment of the present disclosure;

FIG. 11 is a schematic flow chart illustrating the determination of whether the instructional video has been played back according to an embodiment of the present disclosure;

FIG. 12 is a schematic flow chart diagram illustrating the response to not playing out according to an embodiment of the present disclosure;

FIG. 13 shows a schematic view of a teaching confirmation interface of an embodiment of the present disclosure;

FIG. 14 shows a schematic structural view of the teaching apparatus for autonomous driving of a vehicle of the present disclosure;

FIG. 15 is a block diagram of an electronic device for implementing the teaching method for automatically driving a vehicle of an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Fig. 1 illustrates an exemplary system architecture 100 to which embodiments of the teaching methods for autonomous driving a vehicle of the present disclosure may be applied.

As shown in fig. 1, system architecture 100 may include autonomous vehicle 101, network 102, and server 103. Network 103 is the medium used to provide a communication link between autonomous vehicle 101 and server 103. Network 103 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The automatic driving vehicle 101 can interact with the server 103 through the network 102, and a vehicle display screen is installed on the automatic driving vehicle 101 and used for playing teaching videos; the server 103 may provide various teaching services for the autonomous vehicle, for example, the server 103 stores therein a teaching video and operation prompt information corresponding to the teaching sub-video.

The server 103 may be hardware or software. When the server 103 is hardware, it may be implemented as a distributed server cluster composed of a plurality of servers, or may be implemented as a single server. When the server 103 is software, it may be implemented as a plurality of software or software modules (for example, to provide distributed services), or may be implemented as a single software or software module. And is not particularly limited herein.

It should be understood that the number of autonomous vehicles, networks, and servers in fig. 1 is merely illustrative. There may be any number of autonomous vehicles, networks, and servers, as desired for implementation.

It should be noted that the teaching method for the autonomous vehicle provided by the embodiment of the present disclosure is generally performed by the autonomous vehicle 101, and accordingly, a teaching device for the autonomous vehicle is generally provided in the autonomous vehicle 101.

With continued reference to FIG. 2, a flowchart of one embodiment of a teaching method for automatically driving a vehicle according to the present disclosure is shown, the method comprising the steps of:

s201, playing a teaching video, wherein the teaching video comprises a plurality of teaching sub-videos.

In this embodiment, the execution subject plays a teaching video stored in the server side, wherein the teaching video is used to guide the user to learn the automatic driving function of the vehicle. For example, the automatic driving function includes lane departure intervention, automatic merging, automatic parking assistance, and the like, and the teaching video corresponds to a plurality of teaching sub-videos including a lane departure intervention teaching video, an automatic merging teaching video, an automatic parking assistance teaching video, and the like.

It should be noted that the application does not limit the type of the teaching video, and a person skilled in the art can set the corresponding teaching video for the driver to learn according to the automatic driving function, so as to improve the mastering degree of the user on the automatic driving function.

In some optional implementation manners of this embodiment, the teaching video may be further divided into a key control teaching video or a steering wheel control teaching video according to different operations performed on the vehicle by the user when using the automatic driving function, where the key control teaching video is used to guide the user to perform a key operation on the vehicle, so as to start the automatic driving function; the steering wheel control teaching video is used for guiding a user to execute rotating operation or holding operation on the steering wheel in the using process of the automatic driving function, and the like, so that the driving safety is improved.

And S202, responding to the end of the playing of the current teaching sub-video, and outputting operation prompt information corresponding to the current teaching sub-video. In this embodiment, after the current teaching sub-video is played, the execution main body outputs operation prompt information corresponding to the current teaching sub-video. For example, if the current teaching sub-video is an automatic parallel teaching video, the corresponding operation prompt information may indicate that the user toggles a steering switch to trigger the vehicle to perform lane change operation.

In some optional implementation manners of this embodiment, if the current teaching sub-video is a key control teaching video, that is, after the key control teaching video is played, the execution main body may output key operation prompt information corresponding to the key control teaching video, for example, output at least one of a key name, a key position, a pressing strength, and a pressing frequency, where the key name is used to indicate a function of a key pressed by a user; the key position is used for indicating the position of the user to press the key; the number of presses is used to indicate the number of presses of a key by the user.

In some optional implementation manners of this embodiment, if the current teaching sub-video is a steering wheel control teaching video, that is, after the playing of the steering wheel control teaching video is finished, the execution main body may output a steering wheel operation prompt message corresponding to the steering wheel control teaching video, for example, output at least one of a holding force, a turning direction, and a turning range, where the holding force is used to indicate a force required by the user when holding the steering wheel, and the turning force is used to indicate a force required by the user when turning the steering wheel.

And S203, receiving control operation on the vehicle.

In the present embodiment, after step S202, the executing body receives a control operation of the vehicle by the user, for example, a turning operation of a steering wheel, a braking operation of a brake pedal, a switching operation of a shift position, and the like, which is not limited in the present application.

And S204, judging whether the control operation is matched with the specified operation of the operation prompt information, if so, playing the next teaching sub-video of the current teaching sub-video until the teaching video is played.

In this embodiment, the teaching video including the key control teaching video, the steering wheel control teaching video, and the brake pedal control teaching video is taken as an example, for example, the teaching sub-video that is currently played is the key control teaching video, the execution main body outputs key operation prompting information of key positions and pressing force degrees, receives the pressing operation of the user on the keys, determines whether the key positions and the pressing force degrees corresponding to the pressing operation are matched with the key positions and the pressing force degrees corresponding to the key operation prompting information output by the execution main body, if so, indicates that the user correctly executes the pressing operation, that is, learning of the function corresponding to the key control teaching video is completed, at this time, learning of the next teaching sub-video is entered, for example, the steering wheel control teaching video, and after the playing of the steering wheel control teaching video is completed, the steering wheel operation prompting information of the rotating force is output, receives the rotating operation of the steering wheel by the user, determines whether the rotating force corresponding to the rotating operation of the steering wheel is matched with the rotating force corresponding to the output steering wheel operation prompting information, if so, learning of the next teaching sub-video is entered, the process is repeated until all the teaching sub-pedal is played, and the teaching video operation prompting information corresponding to the final stepping operation of the teaching sub-video is received, and the teaching sub-video corresponding to the final teaching video is output, and the teaching sub-operation prompting information corresponding to the teaching video is received.

It should be noted that, in this embodiment, after each teaching sub-video is played, operation prompt information corresponding to the teaching sub-video may be output according to actual needs. For example, if the teaching content of the teaching sub-video is relatively complex, in order to improve the learning effect of the teaching sub-video, the execution main body can output corresponding operation prompt information for the user to perform the practical exercise drill corresponding to the teaching sub-video; if the teaching content of the teaching sub-video is relatively simple, the execution main body does not output corresponding operation prompt information for improving the teaching progress and the teaching efficiency, namely, the actual practice drilling can be omitted.

In this embodiment, the operation prompt information corresponding to the teaching sub-video is output, the real practice drilling scene corresponding to the teaching sub-video is provided, and the effect of teaching by the novice automatic driving is improved based on the control operation of the user on the vehicle in the real practice drilling scene, so that the safety of automatic driving is improved.

In some optional implementations of this embodiment, the key control teaching video may include an adaptive cruise teaching video and a smart lane following assistance teaching video, and the corresponding key prompt information includes a cruise key first press count corresponding to the adaptive cruise teaching video and a cruise key second press count corresponding to the smart lane following assistance teaching video.

For example, if the current teaching sub-video is the adaptive cruise teaching video, the corresponding key prompt information is the first pressing times of the cruise key corresponding to the adaptive cruise teaching video, as shown in fig. 3, the first pressing times may be set to 1, the key prompt information is "please click the cruise key to start the adaptive cruise function", the pressing operation of the user on the cruise key 301 is received, and it is determined whether the pressing times of the pressing operation are matched with the first pressing times of the cruise key, for example, as shown in fig. 3, after the user clicks the cruise key, the icon 302 displays an on state, for example, the icon 302 is observed to be lit in the display interface, which indicates that the adaptive cruise function is started; if the current teaching sub-video is the intelligent lane following auxiliary teaching video, the corresponding key prompt information is the second pressing number of the cruise key corresponding to the intelligent lane following auxiliary teaching video, as shown in fig. 4, the second pressing number may be set to 2, and it should be understood by those skilled in the art that the user needs to complete 2 pressing operations within the preset time, for example, the key prompt information is "please start the intelligent lane following auxiliary function by double-clicking the cruise key within 2 s", receive the pressing operation of the cruise key 401 by the user, and determine whether the pressing number of the pressing operation within the preset time matches the second pressing number of the cruise key, for example, as shown in fig. 4, after the user quickly double-clicks the cruise key, the icon 402 and the icon 403 display an on state, for example, the icon 402 and the icon 403 are observed to be lit in the display interface, indicating that the intelligent lane following auxiliary function is turned on. In actual driving, a reset button is further arranged on the steering wheel, and a user can close the self-adaptive cruise function or the intelligent lane following auxiliary function in a mode of stepping on a brake or pressing the reset button.

It should be noted that the cruise control method and device do not limit the first pressing times of the cruise key and the second pressing times of the cruise key, and the first pressing times of the cruise key and the second pressing times of the cruise key are different, so that the self-adaptive cruise function or the intelligent lane following auxiliary function can be started through different pressing times of the cruise key.

In this embodiment, divide into self-adaptation teaching video and the supplementary teaching video of intelligent lane following of cruising of key control teaching video, to different teaching videos, exported different keying operation tip information, richened the teaching content of autopilot, improved the comprehensiveness of autopilot teaching to improve autopilot's security.

In some optional implementation manners of this embodiment, the key control teaching video further includes a pilot driving assistance teaching video, and the corresponding key operation prompt information includes the number of times of pressing the auxiliary driving key corresponding to the pilot driving assistance teaching video.

For example, if the current teaching sub-video is a pilot driving assistant teaching video, the pressing operation of the assistant driving key by the user is received, and whether the pressing frequency of the pressing operation is matched with the pressing frequency of the assistant driving key is judged. The pressing times of the auxiliary driving key are not limited, the corresponding pressing times can be set according to design requirements, and finally opening of the piloting auxiliary driving function can be achieved when the user presses the auxiliary driving key to match the set pressing times.

In this embodiment, key control teaching video is pilot driving auxiliary teaching video, has richened autopilot's teaching content to improve autopilot's security.

In some optional implementations of this embodiment, the steering wheel control teaching video may include a hands-off detection teaching video and a steering wheel take-over teaching video, and the corresponding steering wheel operation prompt information includes: the steering wheel rotation force detection method comprises a first steering wheel rotation force corresponding to a departure detection teaching video and a second steering wheel rotation force corresponding to a steering wheel takeover teaching video.

For example, if the current teaching sub-video is the hands-off detection teaching video, receiving a rotation operation on the steering wheel, and judging whether the rotation force of the rotation operation is matched with the rotation force of the first steering wheel; and if the current teaching sub-video is the teaching video taken over by the steering wheel, receiving the rotation operation of the steering wheel, and judging whether the rotation force of the rotation operation is matched with the rotation force of the second steering wheel.

It should be noted that, in order to ensure driving safety, in the process of using the automatic driving function, the user still needs to hold the steering wheel all the way, and is ready to take over the vehicle at any time. Therefore, it should be understood that the second steering wheel rotation force is greater than the first steering wheel rotation force in this embodiment, so as to improve the safety of the automatic driving of the vehicle.

In this embodiment, through setting up the control teaching to the steering wheel, standardize the user and detect or the required rotation dynamics of steering wheel takeover when leaving the hand to in the use of autopilot function, improve autopilot's security.

In some optional implementation manners of this embodiment, when the current teaching sub-video is a steering wheel control teaching video, the method further includes:

and outputting steering wheel control guide information in response to the control operation not being matched with the specified operation of the operation prompt information, wherein the steering wheel control guide information is used for guiding the control operation to be adjusted until the control operation is matched with the specified operation of the operation prompt information.

For example, as shown in fig. 5, when the teaching sub-video is a steering wheel control teaching video, the output steering wheel operation prompting message is "please hold the steering wheel and turn left or right slightly to feel the appropriate holding strength", the execution main body receives the turning operation of the steering wheel by the user, and when it is determined that the turning strength corresponding to the control operation does not match the turning strength specified by the steering wheel operation prompting message, the steering wheel control guidance message is output.

In some optional implementation manners of this embodiment, the rotation dynamics in response to the rotation operation is not matched with the preset steering wheel rotation dynamics, and the dynamics indicating information is output, wherein the dynamics indicating information includes at least one of dynamics progress bar, voice dynamics indicating information and character dynamics indicating information.

The force progress bar is a 'force indication' mark as shown in fig. 5, and is used for providing a 'force indication' effect when a user rotates a steering wheel so as to guide the user to determine the required rotation force when the steering wheel takes over or the required rotation force when the user leaves the hand for detection, thereby ensuring that the force just falls in a corresponding standard force reaching interval when the rotation force reaches a hand leaving detection standard or a hand taking over standard. Further, referring to fig. 5, when the user force is lower than the required rotation force, the text force indicating information of "the force is smaller and the rotation force is slightly increased" is output to guide the user to increase the rotation force; when the user's dynamics is greater than required rotation dynamics, output "the dynamics is too big, reduce the characters dynamics indicating information of rotation dynamics a little", guide the user to reduce the rotation dynamics. In this embodiment, can also guide the user through voice broadcast's mode and increase the rotation dynamics or reduce the rotation dynamics, rotate the rotation dynamics and predetermine steering wheel rotation dynamics phase-match up to the rotation operation.

It should be noted that the operation prompt information corresponding to the departure detection teaching video or the steering wheel takeover teaching video in this embodiment includes the verification of the rotation strength twice. In the process of rotating the dynamics for the second time, need the user at first to loosen the steering wheel, need hand moment to return to zero promptly, rotate the steering wheel once more, until the rotation dynamics in the dynamics instruction sign just in time falls between the dynamics of reaching standard, the check-up is accomplished, gets into next teaching flow.

In this embodiment, the guidance control operation is adjusted by outputting the steering wheel control guidance information, so that the control operation matches with the specified operation of the operation prompt information, and under the guidance of the steering wheel control guidance information, the efficiency and effect of the automatic driving teaching can be improved, thereby improving the safety of the automatic driving.

With continued reference to fig. 6, there is shown a schematic diagram of a teaching method for autonomous driving of a vehicle provided by yet another embodiment of the present disclosure, the method including the steps of:

s601, playing a teaching video, wherein the teaching video comprises a plurality of teaching sub-videos.

In the present embodiment, the description of S601 refers to S201, and the present application is not described in detail herein.

And S602, responding to the end of the playing of the current teaching sub-video, and outputting operation prompt information corresponding to the current teaching sub-video.

In this embodiment, the description of S602 refers to S202, and the present application is not described in detail herein.

And S603, receiving control operation on the vehicle.

In this embodiment, S603 is described with reference to S603, and the application is not described in detail here.

S604, judging whether the control operation is matched with the specified operation of the operation prompt information, if so, playing the next teaching sub-video of the current teaching sub-video until the teaching video is played.

In this embodiment, the description of S604 refers to S204, and the application is not described in detail here.

S605, outputting test information related to the teaching video, wherein the test information comprises a plurality of questions and a plurality of answer options corresponding to the questions.

In this embodiment, after the teaching video is played, the execution main body outputs test information related to the teaching video for checking the learning result of the user. The test information comprises a plurality of topics and a plurality of answer options corresponding to the topics. In addition, the test information may further include a question sequence, as shown in fig. 7, which is described by taking a presentation interface of a certain question and corresponding answer options as an example, where each question includes a question text and a corresponding plurality of answer options to be selected.

S606, receiving the selection operation of the answer options of the current question.

In this embodiment, the execution subject receives a selection operation of the user for an answer option of the current topic. For example, the user touch-selects an answer choice on a touch screen interface as shown in FIG. 7 a. It should be noted that, the form of the selection operation is not limited in the present application, and the selection operation of the answer choice of the current question may also be realized based on the function key for switching the selected answer choice; or the selection operation of the answer option of the current question is realized based on the voice control of the voice input answer option.

S607, responding the selected answer option to match with the preset answer option of the current question, and receiving the selection operation of the answer option of the next question.

In this embodiment, the preset answer options may be multiple, if the answer option selected by the user matches with the preset answer option of the current question, it indicates that the user selects a correct answer, and adds a correct identifier to the correct answer option selected by the user, where the answer option marked with the correct identifier does not respond to any click of the user any more until all the preset answer options are selected, and performs the selection operation of the next question.

Taking fig. 7a as an example, when the title is "which scenes cannot be handled by the automatic driving function", the preset answer option is "short-brushing video", in response to the user's selection operation on the answer option of "short-brushing video", the correct mark "√" is added at the lower left corner of the answer option, and the answer option marked with "√" no longer responds to any click.

And S608, responding to the fact that the selected answer option is not matched with the preset answer option, and outputting an answer prompt interface corresponding to the current question until the preset answer option is selected.

Taking the aforementioned fig. 7a as an example, in response to the click of the "doze-off answer option with both hands off the steering wheel" by the user, determining that the answer option selected by the user does not match the preset answer option of the current question, indicating that the user selects the wrong answer, and outputting an answer prompt interface corresponding to the current question, where as shown in fig. 7b, the answer prompt interface includes an answer text for deepening the understanding of the user on the correct answer. The answer prompting interface disappears within a preset time, for example, 1s, the user performs the selection operation on the answer option again, it should be noted that the answer option with the wrong selection still responds to the click of the user until the preset answer option, that is, "brush short video" is selected, and the selection operation of the next question is performed.

In this embodiment, by outputting test information related to a teaching video and outputting an answer prompt interface with an answer text in response to clicking of an incorrect option, on one hand, teaching effects of automatic driving are improved, for example, recognition of a user on a correct answer option corresponding to a question and screening capability of the user on the incorrect answer option can be enhanced, and on the other hand, safety of automatic driving is improved.

In this embodiment, a progress bar is included in a display area in which a teaching sub-video is played, and this embodiment can implement a fast-forward operation or a fast-rewind operation on a played area in the teaching sub-video by dragging the progress bar. It should be noted that when fast-forwarding to the unplayed area in the teaching sub-video, the prompt information for watching the complete video is output. As shown in fig. 8, the duration of the teaching sub-video is 1 minute and 40 seconds in total, and the teaching sub-video has been played to 59 seconds, that is, the played area is the content of the first 59 seconds, in this embodiment, a fast forward or fast backward operation can be performed in the interval of the 59 seconds video, and referring to fig. 8, the playing progress is fast backward to 42 seconds.

In some optional implementations of this embodiment, before step S602, the method further includes: responding to the received skip operation of a part of video frames in the current teaching sub-video, and judging whether the part of video frames are played; if yes, executing skip operation, otherwise outputting prompt information of operation failure.

Taking fig. 8 as an example, that is, when a video frame that is desired to be skipped is within the first 59 seconds, indicating that the video frame has already been played, a skip operation for the video frame may be performed; when the video frame to be skipped is not in the first 59 seconds, which indicates that the video frame is not played yet, the skip information of the video frame cannot be executed, and a prompt message of operation failure, such as "skip failure please watch the complete video", is output.

In the application, when the video frame that the user skips is not played, the prompt message that the main part output operation fails is executed, namely the user is not supported to skip the video frame that is not played, the teaching video that can ensure the autopilot is watched completely, the teaching effect of autopilot is improved, and therefore the safety of autopilot is improved.

With continued reference to fig. 9, there is shown a schematic diagram of a teaching method for autonomous driving a vehicle provided by yet another embodiment of the present disclosure, the method comprising the steps of:

and S901, responding to the pre-starting of the automatic driving function, and acquiring a historical playing record of the teaching video.

In this embodiment, if the user tries to start the automatic driving function, the execution main body needs to obtain a history playing record of the teaching video from the server, and the history playing record is used for representing the playing progress of the teaching video. In step S901, the user performs an operation of turning on the automatic driving function to a pre-on operation for the purpose of using the automatic driving function. For example, when the user starts the automatic driving function by clicking the intelligent lane following assist or the pilot driving assist in the functional interface shown in fig. 10, the execution main body first needs to acquire a history play record of the teaching video, and determines whether the automatic driving function can be started according to the history play record, and if the automatic driving function can be started, the user can directly use the automatic driving function to control the vehicle; if the automatic driving function can not be started, the user needs to perform automatic driving teaching, and after the novice teaching is completed, the automatic driving function can be started, so that the safety of automatic driving is improved.

S902, judging whether the teaching video is played completely based on the historical playing record; if so, starting an automatic driving function, and otherwise, executing the playing of the teaching video.

In this embodiment, whether the teaching video has been played completely is determined according to the playing progress of the teaching video recorded in the history playing record obtained in S902, where the playing progress may be represented by a percentage, and if the playing progress is 100%, it represents that the teaching video has been played completely, and the vehicle has completed novice teaching, the automatic driving function may be started; if the playing progress is less than 100%, the fact that the playing video is not played completely means that the operation of playing the teaching video is required to be executed, the teaching video can be played again, and the teaching video can be played continuously from the current playing progress, so that the teaching efficiency of the automatic driving function is improved, and the user experience is optimized.

In an optional implementation manner of this embodiment, the historical play record includes historical user information and a corresponding video play record; as shown in fig. 11, determining whether the teaching video has been played includes:

and S9020, acquiring the current user information.

In this embodiment, the current user is a user who pre-activates the automatic driving function, wherein a face recognition device is installed on the execution main body, the face recognition device performs face recognition on the current user, and recognized face information is used as current user information, or an identity recognition device is installed on the execution main body, and the identity recognition device can recognize an identity document of the user and recognize recognized identity information as current user information, and the like. It should be noted that, in this embodiment, the type and the obtaining manner of the current user information are not limited, and the current user information may also be a fingerprint or a voiceprint.

It should be noted that, in the technical solution of the present disclosure, the acquisition, storage, application, and the like of the personal information of the related user all meet the regulations of the relevant laws and regulations, and do not violate the common customs of the public order.

And S9021, matching the current user information with the historical user information.

In this embodiment, the execution main body acquires the stored historical user information from the server, and matches the current user information with the historical user information, that is, if the current user information is the fingerprint information a, it is determined whether the fingerprint information a also exists in the historical user information.

And S9022, responding to the successful matching, and judging whether the teaching video is played completely according to the video playing record corresponding to the successfully matched historical user information.

In this embodiment, the fingerprint information a is still used as an example for explanation, if there is fingerprint information a in the historical user information, the current user information is matched with the historical user information, which indicates that the current user is a non-new user, that is, an old user, and whether the teaching video has been played completely is judged according to a video playing record corresponding to the old user, for example, if the playing progress of the video playing record is 100%, it is judged that the teaching video has been played completely; and if the playing progress of the video playing record is less than 100%, judging that the teaching video is not played completely.

And S9023, in response to the matching failure, determining that the teaching video is not played completely.

In this embodiment, the fingerprint information a is still used as an example for explanation, if the fingerprint information a does not exist in the historical user information, the current user information is not matched with the historical user information, which indicates that the current user is a new user, and it is obvious that the teaching video has not been played yet, that is, it can be determined that the teaching video has not been played completely, and then an operation of playing the teaching video is performed, for example, a jump is directly made to a playing page of a first teaching sub-video.

In the embodiment, whether the current user is a new user or not is judged by acquiring historical user information and a corresponding video playing record, and if the current user is the new user, a teaching video is played, namely, novice teaching is carried out; if the user is an old user, whether the teaching video corresponding to the old user is played completely needs to be further judged, and if the teaching video is not played completely, the teaching video is continuously played so as to ensure that the old user needs to finish the learning of the novice teaching. The method and the device execute different judgment strategies for different users, so that the users who should perform novice teaching can complete learning of the novice teaching, the coverage degree of the autopilot teaching on the user plane is improved, and finally the safety of autopilot is improved.

In an optional implementation manner of this embodiment, as shown in fig. 12, executing playing the teaching video specifically includes:

and S9024, displaying a teaching confirmation interface, wherein the teaching confirmation interface comprises a confirmation option and a cancel option.

After the teaching video is determined not to be played completely, the user is indicated to need to perform novice teaching, and the execution main body displays a teaching confirmation interface, wherein the teaching confirmation interface comprises a confirmation option and a cancel option, the confirmation option is used for indicating the user to enter the novice teaching, and the cancel option is used for indicating the user to quit the novice teaching. For example, as shown in fig. 13, when the teaching video is finished playing or the current user is a new user, a teaching confirmation interface is displayed, including a confirmation option of "start teaching" and a cancel option of "cancel". Responding to the click of the user on 'start teaching', executing the main body to play the teaching video and starting to perform novice teaching with reference to the previous embodiment until the teaching video is played completely; and in response to the click of the user on 'cancel', quitting the novice teaching.

And S9025, receiving selection operation of the confirmation option or the cancel option.

In this embodiment, the user performs a selection operation of a confirmation option or a cancel option on the teaching confirmation interface, and the execution main body receives the selection operation. For example, the user makes touch selections for "start teaching" and "cancel" on the touch screen interface as shown in FIG. 13. It should be noted that, the form of the selection operation is not limited in the present application, and the selection operation on the teaching confirmation interface may also be executed based on a function key or voice control based on voice input.

And S9026, responding to the selected confirmation option, and playing the teaching video.

In this embodiment, when the confirmation option is selected, which indicates that the user wants to perform novice teaching, the operation of playing the teaching video is executed, that is, the operation jumps to the video playing page of the first teaching sub-video, or jumps to the playing progress recorded in the history playing record corresponding to the teaching video, and continues to play from the video frame corresponding to the playing progress.

And S9027, responding to the fact that the cancel option is selected, displaying the teaching confirmation interface again until the confirmation option is selected.

In this embodiment, when the cancel option is selected, it indicates that the user wants to skip the novice teaching, however, according to the foregoing embodiment, the user at this time is a new user or an old user who does not watch the teaching video, and cannot skip the novice teaching, and the execution main body displays the teaching confirmation interface again until the confirmation option is selected, so that the user enters the novice teaching.

In this embodiment, when the user who needs to perform novice teaching selects the cancel option on the teaching confirmation interface, the main body is executed to continuously display the teaching confirmation interface, so that the user can be assured that the learning of the automatic driving function is completed before the automatic driving function of the vehicle is used, and the safety of automatic driving is improved.

In an optional implementation manner of this embodiment, the teaching method further includes: and displaying the teaching confirmation interface in response to the preset teaching trigger condition being met.

For example, as shown in fig. 10, a "beginner teaching" entry is provided on the operation interface for pre-starting the automatic driving function as a teaching trigger condition configured in advance. When the user clicks the 'novice teaching' entry, a novice teaching confirmation interface is displayed, and referring to the embodiment, the novice teaching confirmation interface comprises a confirmation option and a cancel option, and in response to the confirmation option being selected, novice teaching is started, and a teaching video is played; and exiting the novice teaching confirmation interface in response to the cancel option being selected.

In this embodiment, the preconfigured teaching trigger condition is not limited, and gesture recognition, voice recognition, teaching key and the like can be used as the preconfigured teaching trigger condition, for example, a gesture capable of triggering the novice teaching is preset, for example, an "S" gesture is drawn on the display screen, and a teaching confirmation interface is displayed; or a voice library capable of triggering the novice teaching is preset, and a teaching confirmation interface is displayed in response to the fact that the voice output by the user can be matched with the voice in the voice library; or a key for starting the novice teaching is arranged on the steering wheel in advance, and a teaching confirmation interface is displayed in response to the pressing operation of the user on the key.

It should be noted that the execution main body does not determine the attribute of the user clicking the novice teaching entry, and the user may be a new user, an old user who has finished playing the teaching video, or an old user who has not finished playing the teaching video. When the user is a new user or an old user who does not finish playing the teaching video, responding to the selection of the confirmation option, and starting novice teaching; in response to selection of the cancel option, the novice teaching confirmation interface is exited. When the user is an old user who finishes teaching video playing, the new hand teaching entry can be freely accessed, so that the learning of the automatic driving function is deepened, the teaching effect of automatic driving is improved, and the safety of automatic driving is improved.

S903, playing a teaching video, wherein the teaching video comprises a plurality of teaching sub-videos.

In this embodiment, the description of step S903 refers to S201, and the present application is not described in detail herein.

And S904, responding to the end of the playing of the current teaching sub-video, and outputting operation prompt information corresponding to the current teaching sub-video.

In this embodiment, the description of step S904 refers to step S202, and the application is not described in detail here.

And S905, receiving a control operation on the vehicle.

In this embodiment, the description of step S905 refers to S203, and the present application is not described in detail herein.

And S906, judging whether the control operation is matched with the specified operation of the operation prompt information, if so, playing the next teaching sub-video of the current teaching sub-video until the teaching video is played.

In this embodiment, the description of step S906 refers to step S204, and the present application is not described in detail herein.

S907, outputting test information related to the teaching video, wherein the test information includes a plurality of questions and a plurality of answer options corresponding to the questions.

In the present embodiment, the description of step S907 refers to step S605, and the present application is not described in detail herein.

S908, receiving the selection operation of the answer option of the current question.

In this embodiment, the description of step S908 refers to step S606, and the present application is not described in detail herein.

And S909, responding to the selected answer option matching with the preset answer option of the current question, receiving the selection operation of the answer option of the next question.

In this embodiment, the description of step S909 refers to S607, and the application is not described in detail here.

S910, responding to the fact that the selected answer option is not matched with the preset answer option, and outputting an answer prompt interface corresponding to the current question until the preset answer option is selected.

In this embodiment, the description of step S910 refers to step S608, and the application is not described in detail here.

As an implementation of the above methods, the embodiment of the present disclosure further provides a teaching apparatus 1400 for an autonomous driving vehicle, as shown in fig. 14, the apparatus including:

a playing module 1401, configured to play a teaching video, where the teaching video includes a plurality of teaching sub-videos;

an operation prompt module 1402, configured to respond to that the playing of the current teaching sub-video is finished, and output operation prompt information corresponding to the current teaching sub-video;

a receiving module 1403 for receiving a control operation for the vehicle;

the judging module 1404 is configured to judge whether the control operation matches with the specified operation of the operation prompt information, and if yes, play a next teaching sub-video of the current teaching sub-video until the teaching video is played.

In some optional implementations of this embodiment, the plurality of tutorial sub-videos includes a key-controlled tutorial video or a steering wheel-controlled tutorial video.

In some optional implementations of this embodiment, the operation prompting module includes:

the key operation prompting unit is used for responding to the end of playing of the key control teaching video and outputting key operation prompting information corresponding to the key control teaching video, wherein the key operation prompting information comprises at least one of key name, key position, pressing intensity and pressing frequency;

and the steering wheel operation prompt unit is used for responding to the end of the playing of the steering wheel control teaching video and outputting steering wheel operation prompt information corresponding to the steering wheel control teaching video, wherein the steering wheel operation prompt information comprises at least one of holding force, rotating direction and rotating range.

In some optional implementation manners of this embodiment, the key control teaching video includes an adaptive cruise teaching video and an intelligent lane following auxiliary teaching video, and the key operation prompt information includes: the method comprises the steps that a cruise key corresponding to an adaptive cruise teaching video is pressed for a first time, and a cruise key corresponding to an intelligent lane following auxiliary teaching video is pressed for a second time;

the receiving module is configured to: receiving the pressing operation of a cruise key;

the judging module comprises:

the self-adaptive cruise judging unit is used for responding to the situation that the current teaching sub-video is the self-adaptive cruise teaching video and judging whether the pressing times of pressing operation are matched with the first pressing times of the cruise key;

and the intelligent lane following auxiliary judgment unit is used for responding to the current teaching sub-video as an intelligent lane following auxiliary teaching video and judging whether the pressing times of the pressing operation are matched with the second pressing times of the cruise key.

In some optional implementations of this embodiment, the key control teaching video includes a pilot driving assistance teaching video, and the key operation prompt information includes: the auxiliary driving key pressing times correspond to the pilot driving auxiliary teaching video;

the receiving module is configured to: receiving a pressing operation of an auxiliary driving key;

the judging module comprises:

and the pilot driving auxiliary judging unit is used for judging whether the pressing times of the pressing operation are matched with the pressing times of the auxiliary driving key.

In some optional implementations of this embodiment, the steering wheel control teaching video includes a hands-off detection teaching video and a steering wheel take-over teaching video, and the steering wheel operation prompt information includes: the first steering wheel rotation force corresponding to the departure detection teaching video and the second steering wheel rotation force corresponding to the steering wheel takeover teaching video;

the receiving module is configured to: receiving a turning operation of a steering wheel;

the judging module comprises:

the hands-off detection judging unit is used for responding to the fact that the current teaching sub-video is the hands-off detection teaching video and judging whether the rotating force of the rotating operation is matched with the rotating force of the first steering wheel or not;

and the steering wheel takeover judging unit is used for responding to the current teaching sub-video as the steering wheel takeover teaching video and judging whether the rotation force of the rotation operation is matched with the rotation force of the second steering wheel.

In some optional implementations of this embodiment, the current teaching sub-video is a steering wheel control teaching video, and the apparatus further includes:

and the steering wheel control guide module is used for responding to the mismatching of the control operation and the specified operation of the operation prompt message and outputting the steering wheel control guide message, and the steering wheel control guide message is used for guiding the control operation to adjust until the control operation is matched with the specified operation of the operation prompt message.

In some optional implementations of this embodiment, the steering wheel control guidance module is configured to: the rotation dynamics and the preset steering wheel rotation dynamics that are in response to the rotation operation do not match, output dynamics indicating information, wherein, dynamics indicating information includes at least one in dynamics progress bar, pronunciation dynamics indicating information and the characters dynamics indicating information.

In some optional implementations of this embodiment, the apparatus further comprises:

the test module is used for outputting test information related to the teaching video after the teaching video is played, wherein the test information comprises a plurality of questions and a plurality of answer options corresponding to the questions;

the selection module is used for receiving selection operation of answer options of the current question;

and the answer option judging module is used for responding to the matching of the selected answer option and the preset answer option of the current question, receiving the selection operation of the answer option of the next question, responding to the non-matching of the selected answer option and the preset answer option, and outputting an answer prompting interface corresponding to the current question until the preset answer option is selected.

the skip judging module is used for responding to the skip operation of receiving part of video frames in the current teaching sub-video and judging whether the part of video frames are played; if yes, executing skip operation, otherwise outputting prompt information of operation failure.

the acquisition module is used for responding to the pre-starting of the automatic driving function and acquiring the historical playing record of the teaching video;

the automatic driving function starting judging module is used for judging whether the teaching video is played completely or not based on the historical playing record; if so, starting an automatic driving function, and otherwise, executing the playing of the teaching video.

In some optional implementations of this embodiment, the historical play record includes historical user information and a corresponding video play record; the automatic driving function starting judging module comprises:

the acquisition unit is used for acquiring current user information;

the matching unit is used for matching the current user information with the historical user information;

the playing completion determining unit is used for responding to the successful matching and judging whether the teaching video is played completely or not according to the video playing record corresponding to the successful matching historical user information;

and the unplayed finish determining unit is used for responding to the matching failure and determining that the teaching video is not completely played.

In some optional implementations of this embodiment, the autopilot function initiation determination module is configured to:

displaying a teaching confirmation interface, wherein the teaching confirmation interface comprises a confirmation option and a cancellation option;

receiving selection operation of a confirmation option or a cancellation option;

in response to the confirmation option being selected, performing the playing of the teaching video;

and responding to the selection of the cancel option, and displaying the teaching confirmation interface again until the confirmation option is selected.

and the display module is used for responding to the satisfaction of the preset teaching trigger condition and displaying the teaching confirmation interface.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

FIG. 15 shows a schematic block diagram of an example electronic device 1500 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 15, the apparatus 1500 includes a computing unit 1501 which can perform various appropriate actions and processes in accordance with a computer program stored in a Read Only Memory (ROM) 1502 or a computer program loaded from a storage unit 1508 into a Random Access Memory (RAM) 1503. In the RAM 1503, various programs and data necessary for the operation of the device 1500 can also be stored. The computing unit 1501, the ROM 1502, and the RAM 1503 are connected to each other by a bus 1504. An input/output (I/O) interface 1505 is also connected to bus 1504.

A number of components in the device 1500 are connected to the I/O interface 1505, including: an input unit 1506 such as a keyboard, a mouse, and the like; an output unit 1507 such as various types of displays, speakers, and the like; a storage unit 1508, such as a magnetic disk, optical disk, or the like; and a communication unit 1509 such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 1509 allows the device 1500 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The computing unit 1501 may be various general and/or special purpose processing components having processing and computing capabilities. Some examples of the computation unit 1501 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computation chips, various computation units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 1501 executes the respective methods and processes described above, for example, a teaching method for automatically driving a vehicle. For example, in some embodiments, a teaching method for autonomous driving of a vehicle may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 1508. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 1500 via the ROM 1502 and/or the communication unit 1509. When the computer program is loaded into the RAM 1503 and executed by the computing unit 1501, one or more steps of a teaching method for an autonomous vehicle described above may be performed. Alternatively, in other embodiments, the computing unit 1501 may be configured to perform a teaching method for an autonomous vehicle in any other suitable manner (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A tutorial method for an autonomous vehicle comprising:

receiving a control operation for a vehicle;

2. The method of claim 1, wherein the plurality of tutorial videos comprises a key control tutorial video or a steering wheel control tutorial video.

3. The method of claim 2, wherein said outputting, in response to the end of the playing of the current teaching sub-video, the operation prompt information corresponding to the current teaching sub-video comprises:

responding to the end of playing of the key control teaching video, and outputting key operation prompt information corresponding to the key control teaching video, wherein the key operation prompt information comprises at least one of key name, key position, pressing pressure and pressing frequency;

responding to the end of the steering wheel control teaching video, and outputting steering wheel operation prompt information corresponding to the steering wheel control teaching video, wherein the steering wheel operation prompt information comprises at least one of holding force, rotating direction and rotating range.

4. The method of claim 3, wherein the key control tutorial video comprises an adaptive cruise tutorial video and a smart lane follow assist tutorial video, and the key operation prompt information comprises: the method comprises the steps that a cruise key corresponding to an adaptive cruise teaching video is pressed for a first time, and a cruise key corresponding to an intelligent lane following auxiliary teaching video is pressed for a second time;

the receiving a control operation of the vehicle includes: receiving the pressing operation of a cruise key;

the judging whether the control operation is matched with the specified operation of the operation prompt message comprises the following steps:

responding to the fact that the current teaching sub-video is an adaptive cruise teaching video, and judging whether the pressing times of the pressing operation are matched with the first pressing times of the cruise key;

responding to the fact that the current teaching sub-video is an intelligent lane following auxiliary teaching video, and judging whether the pressing times of the pressing operation are matched with the second pressing times of the cruise key;

or, the key control teaching video includes a pilot driving auxiliary teaching video, and the key operation prompt information includes: the auxiliary driving key pressing times correspond to the pilot driving auxiliary teaching video;

the receiving a control operation of the vehicle includes: receiving a pressing operation of an auxiliary driving key;

the judging that the control operation is matched with the specified operation of the operation prompt message comprises the following steps:

and judging whether the pressing times of the pressing operation are matched with the pressing times of the auxiliary driving key.

5. The method of claim 3, wherein the steering wheel control instructional video comprises a hands-off detection instructional video and a steering wheel take-over instructional video, and the steering wheel operation prompt information comprises: the first steering wheel rotation force corresponding to the departure detection teaching video and the second steering wheel rotation force corresponding to the steering wheel takeover teaching video;

the receiving a control operation of the vehicle includes: receiving a turning operation of a steering wheel;

responding to the fact that the current teaching sub-video is a hands-off detection teaching video, and judging whether the rotation force of the rotation operation is matched with the rotation force of the first steering wheel or not;

and responding to the fact that the current teaching sub-video is a steering wheel takeover teaching video, and judging whether the rotation force of the rotation operation is matched with the rotation force of the second steering wheel.

6. The method of claim 2 or 3, wherein the current tutorial video is the steering wheel control tutorial video, the method further comprising:

7. The method of claim 6, wherein the outputting steering wheel control guidance information in response to the control operation not matching the specified operation of the operation prompt information comprises:

and responding to the rotation force of the rotation operation is not matched with the preset steering wheel rotation force, and outputting force indication information, wherein the force indication information comprises at least one of a force progress bar, voice force indication information and character force indication information.

8. The method of any of claims 1-7, further comprising, after the instructional video is played,:

outputting test information related to the teaching video, wherein the test information comprises a plurality of questions and a plurality of answer options corresponding to the questions;

receiving a selection operation of an answer option of a current question;

responding to the selected answer option matching with the preset answer option of the current question, and receiving the selection operation of the answer option of the next question;

and responding to the fact that the selected answer option is not matched with the preset answer option, and outputting an answer prompt interface corresponding to the current question until the preset answer option is selected.

9. The method of any of claims 1-8, further comprising:

in response to receiving a skip operation of a part of video frames in the current teaching sub-video, judging whether the part of video frames are played;

and if so, executing the skipping operation, otherwise, outputting prompt information of operation failure.

10. The method according to any one of claims 1-9, further comprising:

responding to the pre-starting of an automatic driving function, and acquiring a historical playing record of the teaching video;

judging whether the teaching video is played completely or not based on the historical playing record;

and if so, starting the automatic driving function, otherwise, executing the playing teaching video.

11. The method of claim 10, wherein the historical play records include historical user information and corresponding video play records;

the judging whether the teaching video is played completely comprises the following steps:

acquiring current user information;

matching the current user information with the historical user information;

responding to the successful matching, and judging whether the teaching video is played completely according to the video playing record corresponding to the successful matching historical user information;

and responding to the matching failure, and determining that the teaching video is not played completely.

12. The method of claim 10 or 11, the executing the playing the instructional video comprising:

receiving a selection operation of the confirmation option or the cancel option;

in response to the confirmation option being selected, executing the playing teaching video;

13. The method of claim 12, further comprising:

and displaying the teaching confirmation interface in response to the preset teaching trigger condition being met.

14. A teaching device for an autonomous vehicle, comprising:

the receiving module is used for receiving control operation of the vehicle;

15. The apparatus of claim 14, wherein the plurality of tutorial sub-videos comprises a key-controlled tutorial video or a steering wheel-controlled tutorial video.

16. The apparatus of claim 15, wherein the operation prompting module comprises:

the key operation prompting unit is used for responding to the end of playing of the key control teaching video and outputting key operation prompting information corresponding to the key control teaching video, wherein the key operation prompting information comprises at least one of key name, key position, pressing strength and pressing frequency;

17. The apparatus of claim 16, wherein the key control tutorial video comprises an adaptive cruise tutorial video and a smart lane follow assist tutorial video, the key operation prompt information comprising: the method comprises the steps that a cruise key first pressing frequency corresponding to an adaptive cruise teaching video and a cruise key second pressing frequency corresponding to an intelligent lane following auxiliary teaching video are obtained;

the judging module comprises:

the self-adaptive cruise judgment unit is used for responding to the situation that the current teaching sub-video is the self-adaptive cruise teaching video and judging whether the pressing times of the pressing operation are matched with the first pressing times of the cruise key;

the intelligent lane following auxiliary judgment unit is used for responding to the fact that the current teaching sub-video is an intelligent lane following auxiliary teaching video, and judging whether the pressing times of the pressing operation are matched with the second pressing times of the cruise key;

the judging module comprises:

18. The apparatus of claim 16, wherein the steering wheel control tutorial video comprises a hands-off detection tutorial video and a steering wheel take-over tutorial video, the steering wheel operation prompt information comprising: the first steering wheel rotation force corresponding to the departure detection teaching video and the second steering wheel rotation force corresponding to the steering wheel takeover teaching video;

the judging module comprises:

the hands-off detection judging unit is used for responding to the fact that the current teaching sub-video is a hands-off detection teaching video and judging whether the rotating force of the rotating operation is matched with the rotating force of the first steering wheel or not;

and the steering wheel takeover judgment unit is used for responding to the fact that the current teaching sub-video is the steering wheel takeover teaching video and judging whether the rotation force of the rotation operation is matched with the rotation force of the second steering wheel.

19. The apparatus of claim 15 or 16, wherein the current tutorial video is the steering wheel control tutorial video, the apparatus further comprising:

and the steering wheel control guide module is used for responding to the mismatching of the control operation and the specified operation of the operation prompt message and outputting steering wheel control guide information, and the steering wheel control guide information is used for guiding the control operation to be adjusted until the control operation is matched with the specified operation of the operation prompt message.

20. The apparatus of claim 15, wherein the steering wheel control guidance module is configured to: respond to the rotation dynamics of rotation operation does not match with the steering wheel rotation dynamics of predetermineeing, output dynamics indicating information, wherein, dynamics indicating information includes at least one in dynamics progress bar, pronunciation dynamics indicating information and the characters dynamics indicating information.

21. The apparatus of any of claims 14-20, further comprising:

the selection module is used for receiving the selection operation of the answer options of the current question;

22. The apparatus of any of claims 14-21, further comprising:

the skip judging module is used for responding to the received skip operation of a part of video frames in the current teaching sub-video and judging whether the part of video frames are played; and if so, executing the skipping operation, otherwise, outputting prompt information of operation failure.

23. The apparatus of any of claims 14-22, further comprising:

the automatic driving function starting judging module is used for judging whether the teaching video is played completely or not based on the historical playing record; and if so, starting the automatic driving function, otherwise, executing the playing teaching video.

24. The apparatus of claim 23, wherein the historical play record comprises historical user information and a corresponding video play record; the automatic driving function starting and judging module comprises:

the acquisition unit is used for acquiring current user information;

and the unplayed determination unit is used for responding to the matching failure and determining that the teaching video is not played completely.

25. The apparatus of claim 23 or 24, the autopilot function launch determination module configured to:

responding to the selected confirmation option, and executing the playing teaching video;

26. The apparatus of claim 25, further comprising:

27. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-13.

28. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-13.

29. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-13.

30. An autonomous vehicle comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of claims 1-13.