CN117459746A - Monitoring method and monitoring device for autonomous learning parking - Google Patents

Abstract

The invention discloses a monitoring method and a monitoring device for autonomous learning parking. The monitoring method comprises the following steps: responding to a video opening request sent by a user terminal in the autonomous learning parking process, acquiring an external image video, and sending a request for opening a live broadcasting room to a cloud; receiving a corresponding live broadcasting room number generated after the cloud opens a live broadcasting room, and pushing the out-of-vehicle image video to the live broadcasting room according to the live broadcasting room number; and the user terminal synchronously receives the live broadcasting room number, and according to the live broadcasting room number, the video of the outside of the vehicle in the live broadcasting room is pulled to be displayed on the user terminal interface. By executing the steps, the monitoring method can realize remote real-time video monitoring of the autonomous parking process, and can realize 1-to-1 complete detailed monitoring for the automatic parking of each vehicle.

Description

Monitoring method and monitoring device for autonomous learning parking

Technical Field

The invention relates to the field of autonomous learning parking monitoring, in particular to a method for monitoring autonomous learning parking, a device for monitoring autonomous learning parking and a computer readable storage medium.

Background

At present, low-speed parking in the automatic driving technology is divided into automatic parking and passenger parking, and the passenger parking is divided into two stages, namely autonomous learning parking and autonomous passenger parking.

Based on the current automatic driving technology, the autonomous learning parking can realize mass production landing. The autonomous learning parking (Home Automated Valet Parking, HAVP) function needs to set a starting point, the driver personally drives into a target parking space from the starting point, the parking space is set as a learning end point, the vehicle performs analysis learning through data acquired by sensors arranged on the vehicle body, a semantic map is automatically formed, and the learning completion track. The HAVP function can be started to be used when the user runs to the starting point position next time, and the vehicle can automatically drive to the end point position from the starting point position without manual intervention.

However, in the prior art, the process monitoring of the HAVP function is mainly realized by checking and monitoring through a vehicle-mounted display screen in the vehicle, and remote monitoring and automatic parking after a user is far away from the vehicle cannot be realized. When a vehicle is in an autonomous learning parking process, emergency situations which cannot be handled by the system occur in the surrounding environment, such as short obstacles nearby, sudden emergence of animals or children, and the like, and if the user does not have real-time monitoring, the safety risk of collision can occur. Moreover, the current parking monitoring system needs to monitor by means of a third-party monitoring platform, such as a vehicle management service platform or a parking lot monitoring system, and cannot achieve complete and detailed monitoring in all aspects for the parking process of each vehicle.

In order to solve the above problems in the prior art, a monitoring technology for autonomous learning parking is needed in the art, which can realize remote real-time video monitoring of the autonomous parking process, and can realize 1-to-1 complete detailed monitoring for the automatic parking of each vehicle, thereby improving the safety of the autonomous learning parking process and the overall intellectualization of the vehicle.

Disclosure of Invention

The following presents a simplified summary of one or more aspects in order to provide a basic understanding of such aspects. This summary is not an extensive overview of all contemplated aspects, and is intended to neither identify key or critical elements of all aspects nor delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.

In order to solve the technical problems in the prior art, one aspect of the present invention provides a method for monitoring autonomous learning parking, comprising the following steps: responding to a video opening request sent by a user terminal in the autonomous learning parking process, acquiring an external image video, and sending a request for opening a live broadcasting room to a cloud; receiving a corresponding live broadcasting room number generated after the cloud opens a live broadcasting room, and pushing the out-of-vehicle image video to the live broadcasting room according to the live broadcasting room number; and synchronously receiving the live broadcasting room number by the user terminal, and pulling the video of the vehicle exterior image in the live broadcasting room to the user terminal interface for display according to the live broadcasting room number. By implementing the monitoring method, remote real-time video monitoring of the autonomous parking process can be realized, 1-to-1 complete detailed monitoring can be realized for the automatic parking of each vehicle, the safety of the autonomous learning parking process is improved, and the overall intellectualization of the vehicle is improved.

In some embodiments of the invention, the monitoring method further comprises: and responding to the display of the video of the outside of the vehicle on the interface of the user terminal, and receiving the parking heartbeat sent by the user terminal so as to continuously send the video of the outside of the vehicle in the next time period.

Further, in some embodiments, the monitoring method further comprises: responding to the completion of the autonomous learning parking, stopping pushing the out-vehicle image video to the live broadcasting room, and sending a request for closing the live broadcasting room to the cloud; and closing the live broadcasting room by the cloud and failing to acquire the number of the live broadcasting room so as to finish monitoring the autonomous learning parking process.

In some embodiments of the present invention, the step of binding the virtual account of the user terminal with the vehicle machine account of the vehicle, obtaining the video of the external image in response to receiving the video opening request sent by the user terminal in the autonomous learning parking process, and sending the request for opening the live broadcasting room to the cloud comprises: and responding to the user terminal to finish the login authentication of the vehicle account, receiving a video opening request sent by the user terminal in the autonomous learning parking process, obtaining the video of the outside of the vehicle, and sending a request for opening a live broadcasting room to the cloud.

In some embodiments of the present invention, the step of receiving a corresponding live broadcasting room number generated after the cloud opens the live broadcasting room, and pushing the video of the vehicle exterior to the live broadcasting room according to the live broadcasting room number includes: responding to the cloud end receiving the request for opening the live broadcasting room, opening the live broadcasting room by the cloud end, and generating a corresponding live broadcasting room number; and based on the received live broadcasting room number, calling a live broadcasting interface in the vehicle to establish communication connection with the cloud end so as to push the video of the vehicle exterior to the live broadcasting room of the cloud end.

Further, in some embodiments, the step of the user terminal synchronously receiving the live broadcast room number and streaming the video of the outside of the vehicle in the live broadcast room to the user terminal interface according to the live broadcast room number includes: the user terminal synchronously receives the live broadcasting room number; and calling a live broadcast interface of the user terminal to establish communication connection with the cloud based on the received live broadcast room number so as to pull the video of the outside image in the live broadcast room to the user terminal interface for display.

In some embodiments of the invention, the types of off-board video include DVR video and around-the-road video.

Further, in some embodiments, the monitoring method further comprises: and issuing a video signal switching instruction through the user terminal so as to switch the type of the push video of the vehicle exterior image.

The invention further provides a monitoring device for autonomous learning parking. The monitoring device comprises a memory and a processor. The processor is connected to the memory and configured to implement the above-described autonomous learning parking monitoring method provided by an aspect of the present invention. By implementing the monitoring method, the monitoring device can realize remote real-time video monitoring of the autonomous parking process, and can realize 1-to-1 complete detailed monitoring for the automatic parking of each vehicle, thereby improving the safety of the autonomous learning parking process and improving the overall intellectualization of the vehicle.

Still another aspect of the present invention provides a computer-readable storage medium having stored thereon computer instructions. The computer instructions, when executed by a processor, implement the above-described method for monitoring autonomous learning parking provided in an aspect of the present invention. By implementing the monitoring method, the computer-readable storage medium can realize remote real-time video monitoring of the autonomous parking process, and can realize 1-to-1 complete detailed monitoring for the automatic parking of each vehicle, thereby improving the safety of the autonomous learning parking process and improving the overall intelligentization of the vehicle.

Drawings

The above features and advantages of the present invention will be better understood after reading the detailed description of embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily to scale and components having similar related features or characteristics may have the same or similar reference numerals.

FIG. 1 illustrates an autonomous learning parking system provided in accordance with some embodiments of the present invention;

FIG. 2 illustrates an exterior schematic view of a vehicle including the autonomous learning parking system shown in FIG. 1;

FIG. 3 illustrates a flow chart of a method of monitoring autonomous learning parking provided in accordance with an aspect of the present invention;

FIG. 4 illustrates a flow chart of a signal transmission link of a method of monitoring autonomous learning parking provided in accordance with some embodiments of the present invention;

FIG. 5 illustrates a flow chart of a method of monitoring autonomous learning parking provided in accordance with some embodiments of the present invention; and

fig. 6 is a schematic structural view of a monitoring device for autonomous learning parking according to another aspect of the present invention.

Reference numerals:

100. an autonomous learning parking system;

101. a park switch function;

102. parking cloud;

103. a body stabilization system;

104. electronic parking;

105. electric power steering;

106. a vehicle controller;

107. a central control system;

108. and (3) cloud end.

109. A remote monitoring module;

110. a mobile phone;

111 TSP；

112. a host for parking a host for a host bus;

S1-S12 ultrasonic probes;

C1-C4 looking around the camera;

c5 A front camera;

200. a vehicle;

400. a signal transmission link;

401 TBOX-MPU；

402 TBOX-MCU；

403 DVR video;

600. a monitoring device for autonomous learning parking;

610. a memory; and

620. a processor.

Detailed Description

Further advantages and effects of the present invention will become apparent to those skilled in the art from the disclosure of the present specification, by describing the embodiments of the present invention with specific examples. While the description of the invention will be presented in connection with a preferred embodiment, it is not intended to limit the inventive features to that embodiment. Rather, the purpose of the invention described in connection with the embodiments is to cover other alternatives or modifications, which may be extended by the claims based on the invention. The following description contains many specific details for the purpose of providing a thorough understanding of the present invention. The invention may be practiced without these specific details. Furthermore, some specific details are omitted from the description in order to avoid obscuring the invention.

In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.

In addition, the terms "upper", "lower", "left", "right", "top", "bottom", "horizontal", "vertical" as used in the following description should be understood as referring to the orientation depicted in this paragraph and the associated drawings. This relative terminology is for convenience only and is not intended to be limiting of the invention as it is described in terms of the apparatus being manufactured or operated in a particular orientation.

It will be understood that, although the terms "first," "second," "third," etc. may be used herein to describe various elements, regions, layers and/or sections, these elements, regions, layers and/or sections should not be limited by these terms and these terms are merely used to distinguish between different elements, regions, layers and/or sections. Accordingly, a first component, region, layer, and/or section discussed below could be termed a second component, region, layer, and/or section without departing from some embodiments of the present invention.

As described above, in the prior art, the process monitoring of the HAVP function is mainly to check and monitor through the vehicle-mounted display screen in the vehicle, and remote monitoring and automatic parking after the user is far away from the vehicle cannot be achieved. When a vehicle is in an autonomous learning parking process, emergency situations which cannot be handled by the system occur in the surrounding environment, such as short obstacles nearby, sudden emergence of animals or children, and the like, and if the user does not have real-time monitoring, the safety risk of collision can occur. Moreover, the current parking monitoring system needs to monitor by means of a third-party monitoring platform, such as a vehicle management service platform or a parking lot monitoring system, and cannot achieve complete and detailed monitoring in all aspects for the parking process of each vehicle.

In order to solve the problems in the prior art, the invention provides a monitoring method for autonomous learning parking, a monitoring device for autonomous learning parking and a computer readable storage medium, which can realize remote real-time video monitoring of an autonomous parking process, realize 1-to-1 complete detailed monitoring for automatic parking of each vehicle, improve the safety of the autonomous learning parking process and improve the overall intellectualization of the vehicle.

For a clear description of the method for monitoring autonomous learning parking to be protected by the present invention, reference is made to fig. 1, where fig. 1 illustrates an autonomous learning parking system provided according to some embodiments of the present invention, and fig. 2 illustrates an external schematic view of a vehicle including the autonomous learning parking system illustrated in fig. 1.

As shown in fig. 1, in some non-limiting embodiments, the autonomous learning parking system 100 basically includes two functional modules: the system comprises an autonomous parking module and a parking monitoring module. The autonomous parking module mainly comprises a parking function switch 101, a parking cloud 102, a vehicle body stabilizing system (Electronic Stability Control, ESC for short) 103, an electronic parking 104, an electric power steering 105 and a whole vehicle controller 106. The parking monitoring module mainly comprises ultrasonic probes S1-S12, looking-around cameras C1-C4, a front camera C5 and other external sensor units, a Head Unit (HU) 107, a cloud end 108, a remote monitoring module 109, a vehicle information service provider (Telematics Service Provider, TSP) 111 and a user terminal, such as a mobile phone 110, which are related to signal transmission in a monitoring process.

Each unit of the autonomous parking module and the parking monitoring module in the autonomous learning parking system 100 is communicatively connected to a host computer (Automated Valet Parking, AVP module for short) 112. The proxy parking host 112 is responsible for transmitting the route information of the vehicle 200 to the parking cloud 102 for route storage.

Preferably, private communication, such as hard wire, LIN, UART, PSI, etc., may be employed between the external sensor units (including the ultrasonic probes S1-S12, the looking-around cameras C1-C4, and the front camera C5) and the host computer 112 to increase the communication speed. Other devices or units in the autonomous learning park system 100 may communicate with the valet park host 112 via the CAN bus.

As shown in fig. 2, the distribution of the devices in the sensor module outside the vehicle may be that the ultrasonic probes S1 to S6 are distributed on the head of the vehicle 200, the ultrasonic probes S7 to S12 are distributed on the tail of the vehicle 200, and the ultrasonic probes S1, S6, S7, S12 mounted on the left and right sides of the front and rear bumpers of the vehicle 200 may be ultrasonic remote probes, the detection distance of which is up to 4.5m. The remaining ultrasonic probes S2, S3, S4, S5, S8, S9, S10, S11 are mounted at front and rear bumpers of the vehicle 200 with a detection distance of 2.2m. The ultrasonic probes S1-S12 of different types are distributed on the whole body of the vehicle 200 to detect parking spaces and obstacles at different distances from far to near.

The front, rear, left and right directions of the looking-around cameras C1, C2, C3 and C4 respectively installed outside the vehicle 200 body can be 190-degree fish-eye cameras with 130 ten thousand pixels, the effective output 720P of the cameras can detect at least 8m of distance, and the cameras are used for capturing parking space information and surrounding environment information of the vehicle 100 in real time. The near-end obstacles (such as short objects, moving objects and the like) which cannot be detected by the ultrasonic probes S1-S12 are detected and identified, and the looking-around cameras C1-C4 can accurately identify the length, depth, lane lines, the types of obstacles around the parking space and the like.

A front camera C5 is also included at the top of the vehicle 200. The front camera C5 can be a 100-degree wide-angle camera with 130 ten thousand pixels, effectively outputs 720P, and can detect about 70m of distance for capturing parking space information and surrounding environment information in real time. The ultrasonic probes S1-S12 and the looking-around cameras C1-C4 can not detect remote obstacles (such as short objects, moving objects and the like) for detection and identification, so that the functions of route map construction, vehicle positioning and the like are realized. Alternatively, the front camera C5 may be replaced with a vehicle recorder inside the vehicle 200 for cost saving.

The central control system (HU) 107 is responsible for acquiring an external video of the vehicle, and comprises a panoramic video formed by combining and splicing the plurality of panoramic cameras C1 to C4 and a DVR video collected by the front camera C5. The HU system 107 is communicatively connected to the cloud 108 to request a request from the cloud 108 for a live room and perform video streaming.

Cloud 108 may be a cloud server provided by different operators, such as Tencent cloud, arian cloud, cinna, etc., for receiving request for live room from HU system 107 and creating a live room.

The user terminal, for example, the mobile phone 110, can remotely start the HAVP function after the user connects the mobile phone 110 with the vehicle 200 outside the vehicle through bluetooth or 4G network, and control text interaction, interface display and the like during parking, including parking route display, a parking start trigger button, parking process interrupt reminding, parking process dynamic effect and the like.

The remote monitoring module 109 may be communicatively coupled to the cell phone 110 and the TSP111 for communicating with the cell phone 110 and the vehicle 200 in its entirety.

The virtual account of the handset 110 may be bound to the car account number of the vehicle 200 in the TSP 111. After the user completes the login authentication of the vehicle machine account of the vehicle 200 through the APP virtual account in the mobile phone 110, one-to-one information interaction between the vehicle 200 and the mobile phone 110 can be realized.

The following describes a method for monitoring autonomous learning parking provided by the present invention in connection with each unit included in the monitoring module in the autonomous learning parking system 100 described above. It will be appreciated by those skilled in the art that the monitoring module in the autonomous learning parking system 100 is only one non-limiting embodiment provided by the present invention, and is intended to clearly illustrate the main concept of the present invention and to provide some embodiments for public implementation, without limiting the implementation subject of each step in the monitoring method for autonomous learning parking.

Referring to fig. 3, fig. 3 illustrates a flow chart of a method for monitoring autonomous learning parking according to an aspect of the present invention.

In some non-limiting embodiments of the present invention, a method of monitoring autonomous learning parking may include the steps of:

s310: responding to a video opening request sent by a user terminal in the autonomous learning parking process, acquiring an external image video, and sending a request for opening a live broadcasting room to a cloud;

s320: receiving a corresponding live broadcasting room number generated after the cloud opens the live broadcasting room, and pushing the video of the vehicle exterior to the live broadcasting room according to the live broadcasting room number; and

s330: and the user terminal synchronously receives the live broadcasting room number, and according to the live broadcasting room number, the video of the outside automobile image in the live broadcasting room is pulled to be displayed on a user terminal interface.

According to the invention, the live broadcast interface in the car and the live broadcast interface in the mobile phone are used for transmitting the video stream of the in-car module to the mobile phone APP end in a push flow way through the cooperation of the modules and the units of all parties, so that the situation that a user can monitor the periphery of the car in real time at the mobile phone APP end in the car parking process is realized, and the switching of 360-degree panoramic video and DVR video is supported, so that better user experience is brought.

In order to more clearly explain the steps S310 to S330 in the above-described monitoring method of autonomous learning parking, the following description will be made with reference to the specific embodiments in fig. 4 and 5.

Referring initially to fig. 4, fig. 4 illustrates a flow chart of a signal transmission link of a monitoring method of autonomous learning parking according to some embodiments of the present invention.

In the embodiment of fig. 4, the signal transmission link 400 of the monitoring method of autonomous learning parking includes a host for parking (AVP module) 112, DVR video 403, HU system 107, cloud 108, parking cloud 102, APP of mobile phone 110, and microprocessor in TBOX (TBOX-MPU) 401 and microcontroller in TBOX (TBOX-MCU) 402.

The host computer (AVP module) 112 mainly realizes the parking function and is responsible for transmitting the video information of the looking-around cameras C1 to C4 to the HU system 107 through the LVDS harness, and after receiving the looking-around partition videos at a plurality of different positions, the HU system 107 splices the video information to be used for displaying the looking-around video completely, and pushes the complete looking-around video to the mobile phone 110 to be used for displaying the surrounding environment of the vehicle 200 during parking.

DVR video 403 includes the image that preceding camera C5 or vehicle event data recorder camera gathered, stores through hardware transmission to HU system 107 to can carry out vehicle environment through the APP on cell-phone 110 of live interface transmission in the car when parking and show.

The TBOX-MPU 401 is used to provide an internet interface, which corresponds to a router that provides an in-vehicle local area network for the vehicle 200 as a whole. The HU system 107 applies for live broadcasting room and video switching push to the cloud 108 in a network-borrowing manner, and is used for signal transmission in the parking process.

The TBOX-MCU 402 is configured to connect each module unit in the vehicle, including the AVP module 112, the ESC module 103, and the like, and obtain information of each module unit in the vehicle through a CAN communication manner, for example, obtain a parking control signal from the AVP module 112, obtain vehicle running information from the ESC module 103, and the like. The TBOX-MCU 402 may also provide a Bluetooth interface to connect with the handset 110, and may also communicate with the TBOX-MPU 401 via a serial port.

TSP111 is a docking system for connecting an in-vehicle unit module to an external cloud. As shown in fig. 4, TSP111 communicates with HU system 107 inside the vehicle and external cloud 108. The TSP111 may be configured to transmit an instruction from the HU system 107 to the cloud 108 after applying for a live room, and route a signal sent by the APP on the mobile phone 110 to open or close during parking.

Cloud 108 may be used to create a live room and interface for real-time video push and pull.

The APP on the handset 110 may be used to remotely turn on HAVP functionality of the vehicle 200, and a user may turn on, off, and switch videos through the handset 110 interface during parking of the vehicle 200.

The operation of the signal transmission link 400 of fig. 4 will be described in detail below in connection with the embodiment of fig. 5. Fig. 5 illustrates a flow chart of a method of monitoring autonomous learning parking provided in accordance with some embodiments of the present invention.

Before the HAVP process of the vehicle 200 is monitored, a user can bind the APP account on the mobile phone 110 with the car machine account of the vehicle 200 and complete login authentication, so that the mobile phone 110 can mutually transmit information with the vehicle 200, car machine information including the vehicle 200 can be transmitted to the mobile phone 110 in real time, and the mobile phone 110 can remotely control the vehicle 200.

After the login authentication of the vehicle 200 and the machine account is completed on the mobile phone 110, the HAVP function of the vehicle 200 is remotely started before the monitoring process of autonomous learning parking is started.

In the embodiment shown in fig. 5, the user may turn on smart park via the APP of the phone 110 to remotely control the HAVP function of the vehicle 200 while the vehicle 200 is in the powered down state.

Before this, the user may preferably check whether the handset 110 is networked, for example, to detect whether the handset 110 has a 4G signal. If it is detected that the mobile phone 110 is connected to the network, it means that the mobile phone 110 can remotely control the vehicle 200 to perform HAVP function, and the monitoring video of the vehicle 200 in the HAVP process can also be transmitted to the mobile phone 110 through the 4G network.

If it is detected that the mobile phone 110 cannot connect to the 4G network, it may be further detected whether the mobile phone 110 and the vehicle 200 are bluetooth-capable. If the two can be connected through bluetooth, the user can still remotely control the vehicle 200 through the mobile phone 110 to execute HAVP function, but the monitoring video of the vehicle 200 in the HAVP process cannot be transmitted to the mobile phone 110, that is, the user cannot view the real-time video of the vehicle 200 in the parking process through the mobile phone 110.

If it is detected that the mobile phone 110 cannot connect to the 4G network and bluetooth connection with the vehicle 200 is also impossible, in this case, the user cannot remotely control the vehicle 200 to perform HAVP function through the mobile phone 110, and further cannot remotely monitor the HAVP process of the vehicle.

With continued reference to fig. 5, upon detecting that the handset 110 has 4G network coverage, the user clicks on the HAVP usage route in the APP on the handset 110, and the valet parking host 112 automatically matches whether the current location of the vehicle 200 is at the start of the learned route stored in the parking cloud 102. If the current position of the vehicle 200 and the starting point of the learning route are matched, parking is finished, and if the two positions are matched successfully, the user can be prompted to start parking by pressing a parking key for a long time, and the vehicle 200 enters the HAVP process.

After the user remotely controls the vehicle 200 to start automatic parking through the cell phone 110, monitoring of the autonomous learning parking process of the vehicle 200 may be selected.

At this time, the APP of the mobile phone 110 may request to the TSP111 to open the video interface, so as to ensure that the process video of the HAVP of the vehicle 200 is only displayed on the account of the mobile phone 110 requesting to open the video, thereby ensuring information security. TSP111 transmits the information requesting to open the video to HU system 107 to enter the flow of video push and live room number applications.

Specifically, after receiving the video opening request, (step S310) the HU system 107 obtains an off-vehicle video, including a DVR video and a surround-view video. The HU system 107 requests the TSP111 to open the live room, and the TSP111 applies the cloud 108 for the live room number after receiving the request.

(step S320) the cloud 108 creates a live broadcast room according to the request transmitted from the TSP111, and generates a unique corresponding live broadcast room number after the live broadcast room is created successfully. If the live room application fails, the user cannot view the video on the APP of the cell phone 110.

After the live broadcast room is successfully created, the cloud 108 feeds back the live broadcast room number to the HU system 107 and the APP on the unique user terminal mobile phone 110. HU system 107 establishes communication connection with cloud 108 through the live broadcast interface in the vehicle according to the received live broadcast room number to push the video of the vehicle exterior to the live broadcast room of cloud 108.

The in-vehicle live interface is a software development kit (Software Development Kit, SDK) on the in-vehicle HU system 107 in communication with the cloud 108, for example, the cloud 108 is a messenger cloud, and the corresponding live interface is a messenger SDK. In this embodiment, the SDK in the in-vehicle HU system 107 enables the vehicle machine side of the vehicle 200 to have a live broadcast function, and by calling the SDK live broadcast interface, the vehicle 200 can establish communication connection with the cloud 108 to perform operations including application of a live broadcast room number, video plug flow, and the like. The mobile phone 110 of the user also has the same SDK live broadcast interface, and can establish communication connection with the cloud 108, so as to pull the video of the external video of the vehicle from the live broadcast room of the cloud 108 to the mobile phone 110 for displaying on the APP.

Specifically, the HU system 107 pushes the acquired video of the vehicle exterior in the HAVP process of the vehicle 200 to the live broadcasting room of the cloud 108 through the SDK live broadcasting interface in the vehicle according to the live broadcasting room number. After the HU system 107 completes the video push (step S330), the APP on the mobile phone 110 performs video streaming from the live broadcasting room of the cloud 108 to obtain the video according to the received live broadcasting room number through the SDK integrated in the APP (for example, the cloud 108 is a messenger cloud and the corresponding live broadcasting interface is a messenger SDK), and displays the video on the interface of the mobile phone 110. Only the mobile phone end that receives the live broadcast room number sent by the cloud 108 can display the video of the vehicle exterior in the HAVP process of the vehicle 200.

At the same time, the handset 110 synchronously and continuously sends a video display status signal to the HU system 107. After receiving the parking heartbeat continuously sent by the mobile phone 110, the HU system 107 continuously sends the vehicle exterior image video in the HAVP process of the vehicle 200 in the next time period to the corresponding mobile phone 110, so as to realize real-time continuous video transmission of the HAVP process of the vehicle 200.

The monitoring video of the parking process of the vehicle 200 received by the APP on the user's mobile phone 110 may default to a panoramic video display. Preferably, if the user wants to view DVR video, the video type can be switched to DVR video by a switch DVR video button on the interface of the handset 110. After the user selects to switch the video type, the APP of the mobile phone 110 sends a video type switching signal instruction to the TSP111, the TSP111 transmits the video type switching information to the HU system 107, the HU system 107 immediately switches and pushes the DVR video 403 to the cloud 108, and the user can view the DVR video of the HAVP process of the vehicle 200 through the APP of the mobile phone 110.

That is, during the HAVP process of the vehicle 200, the user can freely switch the type of video (the surround view video or the front DVR video) that the user wants to view. If the user turns off the video display on the APP of the handset 110, the handset 110 no longer displays the video. And after the monitoring video is turned off, the parking process of the vehicle 200 is not affected, and the vehicle 200 can continue to park until the parking process is finished. If the user turns on the video surveillance again during this period, the HAVP process video of the vehicle 200 may also be reviewed again.

When the parking of the vehicle 200 is completed, APP video status display on the mobile phone 110 is completed, meanwhile, the HU system 107 also stops pushing when detecting the parking completion, requests the TSP111 to close the live broadcasting room, and the cloud 108 closes the live broadcasting room after receiving the live broadcasting room request transmitted by the TSP111, and does not effectively use the live broadcasting room number to end live broadcasting display of the parking video.

While, for purposes of simplicity of explanation, the methodologies are shown and described as a series of acts, it is to be understood and appreciated that the methodologies are not limited by the order of acts, as some acts may, in accordance with one or more embodiments, occur in different orders and/or concurrently with other acts from that shown and described herein or not shown and described herein, as would be understood and appreciated by those skilled in the art.

The invention further provides a monitoring device for autonomous learning parking. Referring specifically to fig. 6, fig. 6 is a schematic structural diagram of a monitoring device for autonomous learning parking according to another aspect of the present invention.

As shown in fig. 6, in some non-limiting embodiments, the above-described method for monitoring autonomous learning parking provided by one aspect of the present invention may be implemented by the apparatus 600 for monitoring autonomous learning parking provided by another aspect of the present invention.

The autonomous learning parking monitoring device 600 is provided with a memory 610 and a processor 620. The memory 610 includes, but is not limited to, a computer-readable storage medium having stored thereon computer instructions provided by yet another aspect of the present invention. The processor 620 is coupled to the memory 610 and configured to execute computer instructions stored on the memory 610 to implement the autonomous learning parking monitoring method provided in an aspect of the present invention.

In summary, the invention provides a monitoring method and a monitoring device for autonomous learning parking, by implementing the monitoring method, remote real-time video monitoring of the autonomous parking process of vehicles can be realized, 1-to-1 complete detailed monitoring can be realized for the automatic parking of each vehicle, the safety of the autonomous learning parking process is improved, and the overall intellectualization of the vehicle is improved.

Although the autonomous learning parking monitoring device 600 described in the above embodiment may be implemented by a combination of software and hardware. It is understood that the autonomous learning parking monitoring device 600 may also be implemented in software, hardware. For hardware implementation, the autonomous learning park monitoring device 600 may be implemented in one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital signal processing devices (DAPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), processors, controllers, micro-controllers (MCUs), microprocessors (MPUs), other electronic devices configured to perform the above functions, or a selected combination thereof. For software implementations, the autonomous learning parking monitoring device 600 may be implemented by separate software modules, such as program modules (procedures) and function modules (functions), running on a common chip, each of which performs one or more of the functions and operations described herein.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The various illustrative logical modules, and circuits described in connection with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.

The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. The monitoring method for autonomous learning parking is characterized by comprising the following steps:

responding to a video opening request sent by a user terminal in the autonomous learning parking process, acquiring an external image video, and sending a request for opening a live broadcasting room to a cloud;

receiving a corresponding live broadcasting room number generated after the cloud opens a live broadcasting room, and pushing the off-vehicle image video to the live broadcasting room according to the live broadcasting room number; and

and the user terminal synchronously receives the live broadcasting room number, and according to the live broadcasting room number, the video of the outside image in the live broadcasting room is pulled to be displayed on the user terminal interface.

2. The monitoring method of claim 1, further comprising: and responding to the display of the off-board video on the user terminal interface, and receiving a parking heartbeat sent by the user terminal so as to continuously send the off-board video in the next time period.

3. The monitoring method of claim 2, further comprising:

responding to the completion of the autonomous learning parking, stopping pushing the video of the vehicle exterior image to the live broadcasting room, and sending a request for closing the live broadcasting room to the cloud; and

and closing the live broadcasting room by the cloud, and failing to respond to the live broadcasting room number so as to finish monitoring the autonomous learning parking process.

4. The method for monitoring as claimed in claim 1, wherein the virtual account of the user terminal is bound to a car machine account of the vehicle, and the steps of obtaining an off-car video and sending a request for opening a live broadcasting room to the cloud in response to receiving a video opening request sent by the user terminal during autonomous learning parking include:

and responding to the user terminal to finish login authentication of the vehicle-mounted account, receiving a video opening request sent by the user terminal in the autonomous learning parking process, obtaining the video of the outside of the vehicle, and sending a request for opening a live broadcasting room to a cloud.

5. The method of monitoring as claimed in claim 1, wherein the step of receiving the corresponding live room number generated after the cloud opens the live room, and pushing the off-board video to the live room according to the live room number includes:

responding to the cloud end receiving the request for starting the live broadcasting room, starting the live broadcasting room by the cloud end, and generating a corresponding live broadcasting room number; and

based on the received live broadcasting room number, a live broadcasting interface in the vehicle is adjusted to establish communication connection with the cloud end so as to push the video of the vehicle exterior to the live broadcasting room of the cloud end.

6. The method of claim 5, wherein the step of the user terminal receiving the live broadcast room number synchronously and streaming the video of the outside of the live broadcast room to the user terminal interface for display according to the live broadcast room number comprises:

the user terminal synchronously receives the live broadcasting room number; and

and calling a live broadcast interface of the user terminal to establish communication connection with the cloud based on the received live broadcast room number so as to pull the video of the outside image in the live broadcast room to the user terminal interface for display.

7. The method of monitoring as recited in claim 1, wherein the types of the off-board video include DVR video and surround-view video.

8. The monitoring method of claim 7, further comprising: and issuing a video signal switching instruction through the user terminal so as to switch the type of the push-stream video of the vehicle exterior image.

9. A monitoring device for autonomous learning parking, comprising:

a memory; and

a processor connected to the memory and configured to implement a method of monitoring autonomous learning parking as claimed in any one of claims 1 to 8.

10. A computer-readable storage medium having stored thereon computer instructions, which, when executed by a processor, implement the autonomous learning parking monitoring method of any of claims 1-8.