JP2022551243A - Driving support device, method, vehicle and storage medium - Google Patents

Abstract

A driving assistance device, method, vehicle and storage medium are disclosed, the device includes a camera, a processor, a drive recorder, and a driving assistance device, and when the driving assistance device is attached to the vehicle, the camera The lens is installed facing the front of the vehicle and is used to collect an image of the environment in which the vehicle is located, and the processor performs a first resolution conversion process and a second resolution conversion process on the image, respectively. , used to obtain a first resolution image and a second resolution image, wherein the first resolution and the second resolution are different, the drive recorder is used to store the first resolution image, and the driving assistance The device is used to generate intelligent driving control information for the vehicle based on the second resolution image. [Selection drawing] Fig. 1

Description

TECHNICAL FIELD The present disclosure relates to the technical field of computers, and specifically relates to a driving support device, method, vehicle, and storage medium.

With the development of automotive electronics, more and more vehicles are equipped with ADAS (Advanced Driving Assistance System, advanced driving assistance system) and DVR (Digital video recorder, drive recorder), and many of the ADAS and DVR in current vehicles are , which are two independent modules.

One or more embodiments of the present disclosure aim to provide a driving support device, method, vehicle, and storage medium.

According to one aspect of the present disclosure, a driving assistance device is provided, the device includes a camera, a processor, a driving recording module, and a driving assistance module, wherein the camera, the driving recording module, and the driving assistance module are respectively connected to the processor, and the driving assistance device is mounted on a vehicle, the lens of the camera is installed toward the front of the vehicle and used to collect images of the environment in which the vehicle is located. wherein the image comprises an image and/or video, and the processor is used to perform a first resolution conversion process and a second resolution conversion process on the image, respectively, to obtain a first resolution image and a second resolution image. , the first resolution and the second resolution are different, the drive recorder is used to store the first resolution image, and the driving assistance device performs intelligent driving of the vehicle based on the second resolution image. Used to generate control information.

Referring to any one of the embodiments provided by the present disclosure, the driving support device further includes a display device connected to the processor, the processor further performs third resolution conversion processing on the video, and A resolution image is obtained and used to output the third resolution image for display on the display device, the third resolution being different from at least one of the first resolution and the second resolution.

Referring to any embodiment provided by the present disclosure, the apparatus further includes a gravity sensor connected to a processor, the processor further obtaining detection information of the gravity sensor when the vehicle is in parking mode. and is used to trigger the camera to capture an image of the environment in response to the detected information meeting a first set condition.

Referring to any of the embodiments provided by this disclosure, the processor is further used to store the image and/or transmit the image to a set target address.

Referring to any of the embodiments provided by the present disclosure, the apparatus further includes a gravity sensor connected to the processor, and the processor further detects information detected by the gravity sensor when the vehicle is in a running mode. and used to trigger the camera to capture an image of the environment in response to the detected information meeting a second set condition.

Referring to any embodiment provided by the present disclosure, the processor further stores the image, transmits the image to a set target address, and/or retrieves the image for the corresponding period of time of the detection information. is used to send the video to the set target address.

Referring to any embodiment provided by the present disclosure, the apparatus further includes a yaw sensor connected to the processor, and the processor further obtains detection information of the yaw sensor when the vehicle is in a running mode. , for triggering the camera to capture images of the environment in response to the detected information meeting a third set condition.

Referring to any embodiment provided by the present disclosure, the processor further stores the image, transmits the image to a set target address, and/or retrieves the image for the corresponding period of time of the detection information. is used to send the video to the set target address.

Referring to any embodiment provided by the present disclosure, the processor is further used to obtain vehicle driving information, and the driving assistance device specifically includes the second resolution image and the vehicle driving information. Based on, output the driving warning information of the vehicle, output the control information of the in-vehicle device installed in the vehicle, output the control information for switching the driving mode of the vehicle, and output the automatic driving control command of the vehicle used to do at least one of the following:

With reference to any embodiment provided by the present disclosure, the processor may further comprise video transmitted by at least one of a vehicle central control panel, a vehicle trigger device, and an external device communicatively connected to the vehicle. In response to receiving an acquisition trigger signal, the camera acquires an image of the environment, stores the image and/or transmits the image to a set target address and acquires a video of the environment. for triggering to perform at least one of storing and retrieving an image and/or video of a corresponding period of said video acquisition trigger signal and transmitting said image and/or said video to a set target address; Used.

According to one aspect of the present disclosure, there is provided a driving assistance method, the method collecting images of an environment in which the vehicle is located by a camera installed in the vehicle, the images including images and/or videos. performing a first resolution conversion process and a second resolution conversion process on the images respectively to obtain a first resolution image and a second resolution image, wherein the first resolution and the second resolution are different; storing an image; and generating intelligent driving control information for the vehicle based on the second resolution image.

Referring to any embodiment provided by the present disclosure, the method includes performing a third resolution conversion process on the image to obtain a third resolution image, and outputting the third resolution image to the display device. wherein the third resolution is different than at least one of the first resolution and the second resolution.

Referring to any embodiment provided by the present disclosure, the method obtains detection information of a gravity sensor installed in the vehicle when the vehicle is in parking mode, and the detection information meets a first set condition. Further comprising, in response to satisfying, triggering the camera to acquire a video of the environment, storing the video and/or transmitting the video to a set target address.

Referring to any embodiment provided by the present disclosure, the method obtains detection information of a gravity sensor installed in the vehicle when the vehicle is in a driving mode, and the detection information meets a second set condition. In response to meeting the conditions, the camera may be triggered to collect an image of the environment, store the image and/or transmit the image to a set target address, and/or the detection information may be sent to a second Further comprising retrieving an image of a period corresponding to the detection information and transmitting the image to a set target address in response to meeting the set condition.

Referring to any embodiment provided by the present disclosure, the method obtains detection information of a yaw sensor installed in the vehicle when the vehicle is in a driving mode, and the detection information satisfies a third setting condition. in response to triggering the camera to collect an image of the environment, storing the image and/or transmitting the image to a configured target address; Further comprising retrieving an image of a period corresponding to the detection information and transmitting the image to a set target address in response to satisfying the condition.

Referring to any embodiment provided by the present disclosure, the method includes obtaining vehicle driving information, and outputting driving warning information of the vehicle based on the second resolution video and the vehicle driving information. , outputting control information for an in-vehicle device installed in a vehicle, outputting control information for switching the driving mode of the vehicle, and outputting an automatic operation control command for the vehicle. performing intelligent driving control on the vehicle based on the second resolution image.

Referring to any embodiment provided by the present disclosure, the method includes collecting video transmitted by at least one of a vehicle central control panel, a vehicle trigger device, and an external device communicatively connected to the vehicle. In response to receiving a trigger signal, the camera acquires an image of the environment, stores the image and/or transmits the image to a set target address, and acquires and stores a video of the environment. and retrieving an image and/or video of a corresponding period of said video acquisition trigger signal and transmitting said image and/or said video to a set target address. include.

According to one aspect of the present disclosure, a vehicle is provided, the vehicle including a driving assistance device according to any embodiment of the present disclosure.

According to one aspect of the present disclosure, there is provided a computer-readable recording medium, on which a computer program is stored, the driving assistance according to any embodiment of the present disclosure when the program is executed by a processor. implement the method.

The driving support device, method, vehicle, and storage medium of one or more embodiments of the present disclosure, when the driving support device is attached to the vehicle, collects images of the environment in which the vehicle is located using a camera, and performing different resolution conversion on the image, storing the first resolution image obtained by the conversion on the one hand, and generating intelligent driving control information for the vehicle based on the second resolution obtained by the conversion on the other hand. At the same time, the same camera can realize the function of driving record and intelligent driving, improve the hardware utilization rate, reduce the hardware cost, and save the space occupied by the electronic module in the whole vehicle.

In order to more clearly describe one or more embodiments of the present specification or the technical solutions in the prior art, the following briefly introduces the drawings required for the description of the embodiments or the prior art. In addition, the drawings described below are only some embodiments described in one or more embodiments of this specification, and those skilled in the art will be able to reproduce these drawings without creative effort. Other drawings can be obtained based on
1 is a structural diagram of a driving assistance device provided by at least one embodiment of the present disclosure; FIG. FIG. 4 is a schematic diagram of image processing of a driving assistance device provided by at least one embodiment of the present disclosure; 4 is a method flow chart of a driving assistance method provided by at least one embodiment of the present disclosure;

For those skilled in the art to better understand the technical solutions in one or more embodiments of the present specification, hereinafter refer to the drawings in one or more embodiments of the present specification, clearly and completely describe the technical solutions in one or more embodiments of do not have. All other embodiments obtained by persons skilled in the art based on one or more embodiments of the present specification without creative labor should fall within the protection scope of the present disclosure.

At least one embodiment of the present disclosure provides a driving assistance device, which can be attached to a vehicle, which can be any type of vehicle, for passenger, cargo or other applications. any vehicle. As shown in FIG. 1 , the driving assistance device can include a camera 101 , a processor 102 , a drive recorder 103 and a driving assistance device 104 . Camera 101 , drive recorder 103 and driving support device 104 are each connected to processor 102 .

When the driving support device is installed in a vehicle, the lens of the camera 101 is installed toward the front of the vehicle, for example, toward the head of the vehicle, to collect images of the environment in which the vehicle is located. It is used to capture images of the environment, record video of the environment, and so on. The camera 101 can collect video of the environment in which it is located and audio of the environment in which it is located.

The camera 101 may be a camera integrated into the main body of the driving assistance device, ie integrated with other components in one case. When installed integrally, the driving assistance device is installed in the rearview mirror of the vehicle, and the camera is directed forward of the vehicle, so that the camera can collect the environment image at a preferred viewing angle. The camera 101 may be a camera that is installed separately, ie installed outside the main case of the driving assistance device in order to facilitate the placement of said driving assistance device in the vehicle. For example, when installed separately, the main body of the driving assistance device can be installed in the instrument panel, and the camera can be installed inside the rearview mirror to collect images of the environment at a favorable viewing angle, and at the same time, occupy the space. It is aesthetically pleasing and reduces the space. When installed separately, the camera 101 can be connected to the main case in a wired or wireless manner, and the present disclosure does not limit the specific connection method.

The processor 102 is connected to the camera 101 to obtain an image collected by the camera, perform a first resolution conversion process and a second resolution conversion process on the image, respectively, and convert the first resolution image and the second resolution image into a second resolution image. A resolution image is obtained, wherein the first resolution and the second resolution are different.

In embodiments of the present disclosure, the processor may be built-in RAM (Random Access Memory), ROM (Read-Only Memory), and SOC (System On Chip). or other processors with similar processing power, such as FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit), DSP It has a (Digital Signal Processing) chip, a CPU (Central Processing Unit), and the like.

The images collected by the camera may include videos and/or images, and the processor can split the images according to different needs to perform different resolution conversion processes. Said diverting means subjecting multiple copies of said video to different transformations. For example, videos or images stored for driving records generally require high resolution. Videos or images for intelligent driving do not require particularly high resolution. Therefore, the original video stream collected by the camera is split, and a part of the split video stream is subjected to the first resolution conversion process to obtain the first resolution video for driving recording, which is then split. A second resolution conversion process is performed on the other part of the video stream obtained by the above to obtain a second resolution image for intelligent driving which is lower than the first resolution.

The drive recorder 103 is connected to the processor 102 and is used for driving recording by obtaining a first resolution video and storing said first resolution video.

A driving assistance device 104 is connected to the processor 102 and is used to obtain a second resolution image and generate intelligent driving control information for the vehicle based on the second resolution image.

Here, in order to assist the driver in driving safely, the intelligent driving control information includes warning information that presents the driver that the distance to the preceding vehicle is too close, and warning information that the driver does not exceed the safe vehicle speed. can include driving warning information of the vehicle, such as driving information that presents the information of the in-vehicle device installed in the vehicle, such as information for controlling the on or off of the high beam of the vehicle, in order to realize the function of assisted driving It may further include control information, and may further include automatic driving control information for controlling the speed and driving direction of the vehicle in order to realize automatic driving of the vehicle. As will be appreciated by those skilled in the art, other types of intelligent driving control information may also be included and are not limited to the above.

In an embodiment of the present disclosure, when the driving assistance device is installed in a vehicle, a camera is used to collect images of the environment in which the vehicle is located, and the images undergo different resolution conversion. storing the obtained first resolution image; on the other hand, generating intelligent driving control information of the vehicle according to the second resolution obtained by conversion; It realizes functions, improves hardware utilization, reduces hardware costs, and saves the space occupied by electronic modules in the entire vehicle.

In addition, by converting the resolution of the image collected by the camera, it generates a resolution image suitable for storage and a resolution image suitable for image detection, respectively, reducing hardware costs and guaranteeing the quality of driving records and support operations. do.

In some embodiments, the driving assistance device further includes a display device, the processor further performs a third resolution conversion process on the video to obtain a third resolution video, and converts the third resolution video to output for display on the display device, the third resolution being different from at least one of the first resolution and the second resolution, the third resolution being based on the display resolution of the display device can be identified by

FIG. 2 shows a schematic diagram of processing the original video stream collected by the camera. As shown in FIG. 2, on the one hand, the processor converts the original video stream into a first resolution video, and the drive recorder stores the first resolution video, thereby realizing the driving recording function. The first resolution is, for example, 920*1080 or 1280*720, and the drive recorder may be an external storage module of the processor, such as SD card (Secure Digital Memory Card), TF card. (T-Flash, flash memory card), etc., thereby realizing the function of driving record.

On the other hand, a processor can convert the original video stream into a second resolution image, and a driving assistance device can generate intelligent driving control information for the vehicle based on the second resolution image.

Taking driving assistance implementation as an example, a resolution conversion can be performed on the original video based on a second resolution required by an algorithm related to driving assistance. For example, for video used to provide early warning of forward collisions, the second resolution is typically 1024*576, performing a second resolution conversion on the original video stream at 1024*576; Intelligent driving control information can be generated by obtaining the second resolution image and inputting it to the driving support device.

In addition, the processor may further perform a third resolution conversion process on the image to obtain a third resolution image, and output the third resolution image for display on the display module.

For example, the display device is a vehicle central control panel or a mobile phone APP (application program), in which case the required resolution is generally low, such as 720*480, and the third resolution is 720*. It can be set to 480 and the video collected by the camera can be converted. The acquired 3rd resolution video is transmitted to the central control system of the vehicle via a wireless network such as WIFI or Bluetooth (registered trademark), or transmitted to the cloud or mobile phone terminal, so that the central control panel Or the mobile phone APP can be used to view, delete, move, play back and download video information or image information, and display the video stream collected by the camera in real time.

In one example, the display device and the processor can also be connected in a wired manner, such as HDMI (Registered Trademark/High Definition Multimedia Interface)/LVDS (Low-Voltage Differential Signaling) method. By outputting the third resolution image in , it can be displayed on an external display device, and in this case, the third resolution can be set to 1280*720.

The above setting of the first resolution, the second resolution, and the third resolution are merely examples, and as will be understood by those skilled in the art, the first resolution, the second resolution, and the third resolution may be set according to the needs of storage, calculation, and display. The values of the second resolution and the third resolution can be set, and the present disclosure does not limit this.

In the embodiments of the present disclosure, resolution conversion is performed on the video collected by the camera according to the resolution requirements of the display module to ensure the display effect and improve the processing efficiency.

The driving support device may further include a gravity sensor for detecting acceleration information of the vehicle. The gravity sensor may be integrated into the main body of the driving support device, that is, integrated with other members into one case, or may be installed separately from the driving support device, that is, the driving In order to facilitate the placement of the support device in the vehicle, it may be installed outside the main case of the driving support device.

In some embodiments, when the vehicle is in a parking mode, obtaining the detection information of the gravity sensor, and in response to the detection information meeting a first set condition, the camera captures an image of the environment and/or or trigger to acquire a video, store said image and/or video and/or send said image and/or video to a set target address.

The parking mode of the vehicle includes, but is not limited to, at least one of a parking stop state and a state in which the shift position of the vehicle is in the parking position or the neutral position. When the vehicle is in parking mode, the first setting condition includes that the acceleration of the vehicle detected by the gravity sensor changes significantly within a short time, for example, the rate of change of the acceleration is greater than a first setting threshold. . In that case, there is a high probability that the vehicle will experience an abnormal situation, for example, the vehicle body may be in a collision or the vehicle may be towed. and/or triggered to record a video of the environment, thereby automatically and timely recording abnormal conditions of the vehicle. The processor acquires and stores the image and/or the video for use in subsequent processing, such as for abnormal condition analysis or traceability, or for transmission to a set target address, such as Intelligent in-vehicle terminal (T-BOX) transmits to the mobile phone terminal of the vehicle owner to timely alert the owner of the abnormal condition of the vehicle, and send the image and/or video to a third party/cloud By transmitting, the abnormal situation of the vehicle can be processed in a timely manner.

triggering the camera to capture an image of the environment, storing the image and/or capturing the image in response to the detected information meeting a second set condition when the vehicle is in a driving mode; transmitting to a set target address and/or in response to said detection information meeting a second set condition, retrieving a video of a time period corresponding to said detection information and sending said video to a set target address.

In the process of running the vehicle, the second set condition includes that the acceleration detected by the gravity sensor changes significantly within a short period of time. For example, the rate of change of the acceleration is greater than the second set threshold. In this case, there is a high probability that an abnormal situation will occur in the vehicle. For example, an abnormal change in vehicle speed may occur. It can be triggered to take pictures and/or record videos of the environment, thereby automatically and timely recording abnormal driving conditions of the vehicle. and the processor acquires and stores the image and/or the video for use in subsequent processing, such as analyzing abnormal conditions or for traceability, or transmitting to a set target address. , for example, by transmitting to the mobile phone terminal of the vehicle owner by an intelligent in-vehicle terminal (T-BOX), timely alerting the owner of the abnormal state of the vehicle, and transmitting the image and/or video to a third party/ By transmitting to the cloud, the abnormal situation of the vehicle can be processed in a timely manner.

The driving support device may further include a yaw sensor for detecting yaw information of the vehicle. The yaw sensor may be integrated into the main body of the driving assistance device, that is, integrated with other members into one case, or may be installed separately from the driving assistance device, that is, the driving assistance device. In order to facilitate the arrangement of the device in the vehicle, it may be installed outside the main case of the driving assistance device. For example, when they are installed separately, the yaw sensor can be installed under the shift lever, and the main body of the driving support device can be installed in the instrument panel.

triggering the camera to capture an image of the environment, storing the image and/or capturing the image in response to the detected information meeting a third set condition when the vehicle is in a driving mode; transmitting to a set target address and/or in response to said detection information meeting a third set condition, retrieving a video of a period corresponding to said detection information and sending said video to a set target address;

When the vehicle is running, the third set condition indicates that the yaw information detected by the yaw sensor greatly offsets the running direction of the vehicle in a short period of time. Including big. In this case, there is a high probability that an abnormal situation will occur in the vehicle, and the camera will be triggered to take an image of the environment and/or record a video of the environment in response to the occurrence of an anomaly in the direction of travel of the vehicle. so that the abnormal driving conditions of the vehicle can be automatically and timely recorded. and the processor acquires and stores the image and/or the video for use in subsequent processing, such as analyzing abnormal conditions or for traceability, or transmitting to a set target address. , for example, by transmitting to the mobile phone terminal of the vehicle owner by an intelligent in-vehicle terminal (T-BOX), timely alerting the owner of the abnormal state of the vehicle, and transmitting the image and/or video to a third party/ By transmitting to the cloud, the abnormal situation of the vehicle can be processed in a timely manner.

Illustratively, the first set threshold, the second set threshold, and the third set threshold may be numerical values that are summarized based on various abnormal situations. The first set threshold, the second set threshold and the third set threshold may be the same, partially the same, or completely different.

Since the space occupied by images and/or videos taken at each of the above settings may be small, storing such images and/or videos may be helpful in storing said images and/or videos in a processor. or the processor directing the drive recorder to store the images and/or videos, which the present application is not limited to.

In some embodiments, the processor further triggers operation of the camera upon receiving an image acquisition trigger signal. The image acquisition trigger signal may be sent by at least one of a vehicle central control panel, a vehicle trigger device, and an external device in communication with the vehicle, wherein the vehicle trigger The device may be a button installed at an appropriate position inside the vehicle, and the external device communicating with the vehicle includes a mobile phone terminal or the like. Triggered camera operations include collecting an image of the environment, storing the image and/or sending the image to a configured target address, recording a video of the environment, and/or transmitting said video to a set target address; and transmitting the video, for example, the intelligent in-vehicle terminal may transmit the image, the video to the mobile phone terminal of the vehicle owner, or may be transmitted to a third party/cloud or the like.

In the embodiments of the present disclosure, the video acquisition trigger signal is sent to trigger the camera to perform operations such as shooting, storing, and transmitting, and the video that needs to be recorded and stored is actively triggered. It can independently identify and actively transmit the image, meeting the diversified needs of users of the driving assistance device. Compared to the drive recorder that is always recorded and stored when it is turned on in the related art, the driving support device provided by the present disclosure realizes more effective storage of images collected by the camera, and saves storage space. Improve utilization.

In some embodiments, the processor is further used to obtain vehicle driving information, and the driving assistance device generates driving warning information for the vehicle based on the second resolution image and the vehicle driving information. Output.

In one example, a forward lane and a vehicle motion trajectory can be monitored in real time based on the second resolution image, and if the offset between the lane and the vehicle motion trajectory is greater than a If it determines that the vehicle has offset from the lane, it outputs warning information to alert the driver.

In one example, the driving support device detects a forward vehicle and a distance between the forward vehicle and the host vehicle in real time based on the second resolution image, and detects the host vehicle based on vehicle speed information in the vehicle travel information. calculates the potential collision time between the vehicle and the vehicle in front, and if the potential collision time is less than a set threshold, it determines that there is a risk of collision between the vehicle and the vehicle in front, outputs warning information, and drives call attention to

In one example, the driving support device detects a forward pedestrian and the distance between the forward pedestrian and the vehicle in real time based on the second resolution image, and based on the vehicle speed information in the vehicle travel information, Calculates the potential collision time between the vehicle and pedestrians ahead. If the potential collision time is less than a set threshold, it determines that there is a risk of collision between the vehicle and pedestrians ahead and outputs warning information. to alert the driver.

In one example, when the vehicle is in parking mode, the driving assistance device can detect in real time a change in the distance between the vehicle in front and the own vehicle based on the second resolution image, and set the distance to change. If it is greater than the threshold, it determines that the preceding vehicle starts moving, and outputs warning information to alert the driver.

In one example, the driving assistance device can detect traffic signs such as speed limit and prohibition signs based on the second resolution image, and remind the driver to drive according to the detected traffic signs. .

In one example, the driving assistance device can detect a traffic light based on the second resolution image and remind the driver to drive safely according to the detected traffic light.

In some embodiments, the driving support device outputs control information for an in-vehicle device installed in the vehicle based on the second resolution image and the vehicle travel information.

The vehicle running information includes state information in the vehicle running mode and the vehicle parking mode, such as the vehicle turn lamp state, seat belt state, vehicle speed, and the like. As will be appreciated by those skilled in the art, the vehicle travel information may further include other information, and the present disclosure is not so limited.

In one example, when a light switch, such as a high beam switch, is in AUTO mode, a parameter judgment is made on the second resolution image, and based on the judgment result, the lights are automatically turned on or off to match the driving environment. Realize the function of automatically controlling lights based on
[0069]
In some embodiments, the driving support device outputs an automatic driving control command for the vehicle based on the second resolution image and the vehicle travel information, for example, by outputting a command for controlling vehicle speed , realizing automatic driving of the vehicle, and outputting a control command for switching the driving mode of the vehicle, for example, in the automatic driving mode, confirming that the vehicle is running abnormally according to the second resolution image and the vehicle information. In this case, the vehicle can be switched from the automatic driving state mode to the manual driving mode by outputting a control command for switching the driving mode of the vehicle.

In the disclosed embodiment, the driving support device detects a safety situation of vehicle travel based on a second resolution image obtained by converting an image collected by a camera and the vehicle travel information, and measures vehicle safety. It can predict the driving conditions and thereby realize the intelligent driving function of the vehicle.

In some embodiments, the vehicle system can further include at least one co-processor connected to the processor. When the processor is an SOC, the co-processor is, for example, an MCU (Micro Controller Unit, one-chip microcomputer) or other processors with corresponding processing power.

The MCU can be connected to at least one in-vehicle device of the vehicle, such as CAN (Controller Area Network)/CANFD (CAN with Flexible Data-Rate), a control area network with flexible data rate. )/Ethernet to communicate with the at least one in-vehicle device to obtain information output from the device, and the SOC obtains information output from the in-vehicle device via the MCU. .

In one example, control information of an in-vehicle device installed in a vehicle can be transmitted to an MCU by an SPI (Serial Peripheral Interface) communication method by an SOC, whereby the MCU controls the in-vehicle device based on the control information. can be controlled.

In some embodiments, the same power supply can be used to power the processor, the coprocessor, and the coprocessor can be used to power manage the power supply.

At least one embodiment of the present disclosure further provides a driving assistance method, and the method can be implemented based on the driving assistance device described in any one embodiment of the present disclosure.

FIG. 3 shows a flowchart of a driving assistance method provided by at least one embodiment of the present disclosure, which can include steps 301-304. The method can be used in a driving assistance device, and the driving assistance device can include a camera, a processor, a drive recorder and a driving assistance device.

In step 301, a camera installed in the vehicle collects images of the environment in which the vehicle is located.

In step 302, the images are respectively subjected to a first resolution conversion process and a second resolution conversion process to obtain a first resolution image and a second resolution image, wherein the first resolution is different from the second resolution.

At step 303, the first resolution image is stored.

In step 304, intelligent driving control information for the vehicle is generated based on the second resolution image.

In an embodiment of the present disclosure, a camera is used to collect an image of the environment in which the vehicle is located, and the image is subjected to different resolution conversion, while storing the first resolution image obtained by the conversion; On the other hand, the intelligent driving control information of the vehicle is generated according to the second resolution obtained by the conversion, and the same camera realizes the function of driving recording and intelligent driving, so as to improve the utilization rate of the hardware. It reduces costs and saves the space occupied by electronic modules throughout the vehicle.

In some embodiments, the method further includes performing a third resolution conversion process on the image to obtain a third resolution image, and outputting the third resolution image for display on the display device. , the third resolution is different from at least one of the first resolution and the second resolution.

In some embodiments, the method includes obtaining sensing information of a gravity sensor installed in the vehicle when the vehicle is in a parking mode; and responsive to the sensing information meeting a first set condition. , triggering the camera to acquire an image of the environment and/or a video of the environment; storing the image and/or video and/or sending the image and/or video to a set target address; and further including.

In some embodiments, the method includes obtaining detection information of the gravity sensor when the vehicle is in a running mode, and in response to the detection information satisfying a second set condition, the camera Triggering to acquire an image of the environment, storing the image and/or sending the image to a set target address; and/or in response to the detected information meeting a second set condition. retrieving a video of a time period corresponding to the detected information and transmitting the video to a set target address.

In some embodiments, the method includes obtaining detection information of a yaw sensor installed in the vehicle when the vehicle is in a driving mode; triggering the camera to collect an image of the environment, storing the image and/or transmitting the image to a set target address; and/or that the detected information satisfies a third set condition. retrieving a video of a time period corresponding to the detected information and transmitting the video to a set target address in response to.

In some embodiments, the method includes obtaining vehicle driving information, outputting driving warning information of the vehicle based on the second resolution image and the vehicle driving information, and outputting control information for a device, outputting control information for switching the driving mode of the vehicle, and outputting an automatic driving control command for the vehicle, based on the second resolution image. and performing intelligent driving control on the vehicle.

In some embodiments, the method comprises receiving a video acquisition trigger signal transmitted by at least one of a vehicle central control panel, a vehicle trigger device, and an external device communicatively coupled to the vehicle. In response, the camera collects an image of the environment, stores the image and/or transmits the image to a configured target address, collects and stores a video of the environment, and collects video of the environment. Further comprising triggering to perform at least one of retrieving an image and/or video of the corresponding duration of the trigger signal and transmitting said video to a set target address.

At least one embodiment of the disclosure further provides a vehicle including the driving assistance device according to any one embodiment of the disclosure.

In some embodiments, a rearview mirror is further installed in the interior of the vehicle, and the driving support device is installed in the rearview mirror and the camera can face forward of the vehicle.

By installing the driving assistance device on the rearview mirror of the vehicle and pointing the camera forward of the vehicle, the camera can collect images at a favorable viewing angle and save the interior space of the vehicle.

In some embodiments, a central control panel is installed on the vehicle, and the central control panel is communicatively connected to the camera or the processor and is used to trigger the camera to collect video.

In some embodiments, a triggering device in communication with the camera or processor is installed in the vehicle interior and used to trigger the camera to perform image acquisition.

In some embodiments, a terminal device in communication with the camera or processor is installed in the vehicle and used to trigger the camera to perform image acquisition.

The vehicle's central control panel triggers the camera to collect video, and the vehicle driver or passenger can independently identify the video that needs to be recorded in an active triggering manner, using the vehicle's device. Improve flexibility.

In some embodiments, the vehicle is equipped with a gravity sensor connected to the processor, the gravity sensor outputs a gravity sensing detection signal to the processor, and the processor outputs the gravity sensing detection signal to the gravity sensing detection signal. Based on this, the camera is controlled to collect images.

By controlling the camera to collect images based on the gravity sensing detection signal, the abnormal driving conditions of the vehicle can be automatically and timely recorded.

In some embodiments, the vehicle is equipped with a yaw sensor connected to the processor, the yaw sensor outputs a yaw sensing detection signal to the processor, and the processor outputs a yaw sensing detection signal based on the yaw sensing detection signal. controlling the camera to collect images;

By controlling the camera to collect images based on the yaw sensing detection signal, the abnormal running state of the vehicle can be automatically and timely recorded.

As will be appreciated by those skilled in the art, one or more of the embodiments herein can be provided as a method, system or computer program product. Accordingly, one or more embodiments herein may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. And one or more embodiments of the present specification may be implemented on one or more computer-usable storage media (including, but not limited to, magnetic disk memories, CD-ROMs, optical memories, etc.) containing computer-usable program code. can take the form of a computer program product embodied in, but not limited to,

Embodiments of the present specification further provide a computer-readable recording medium, on which a computer program may be stored, which, when executed by a processor, is a computer program according to any of the embodiments of the present specification. The steps of the driving support method described in 1. are realized. Here, "and/or" indicates having at least one of both, e.g., "A and/or B" means three situations: A, B, "A and B". include.

The same and similar parts of each embodiment in this specification can be referred to each other, and each embodiment will be described with emphasis on the differences from other embodiments. In particular, for the method embodiments, each step is basically similar to the function implemented by each module of the driving assistance device, so it will be briefly described, and the relevant parts are part of the device embodiments. Please refer to the explanation of

Specific examples of the present specification have been described above. Other implementations are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than the example and still achieve desirable results. Also, the processes depicted in the figures do not necessarily require the particular order or sequential order shown to achieve desired results. In some embodiments, multitasking and parallel processing may be possible or advantageous.

Embodiments of the subject matter and functional operations described herein include digital electronic circuits, tangibly embodied computer software or firmware, computer hardware including the structures disclosed herein and their structural equivalents. hardware, or a combination of one or more thereof. Embodiments of the subject matter described herein can be implemented as one or more computer programs, i.e. coded on a tangible, non-transitory program carrier and executed by a data processing apparatus or data. One or more modules of computer program instructions that control the operation of a processing unit. Program instructions may also be encoded in a propagated signal, such as an artificially generated or mechanically generated electrical, optical or electromagnetic signal, which is generated to encode information and be properly received. machine and executed by the data processing device. A computer storage medium may be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more thereof.

The processes and logic flows described herein may be performed by one or more programmable computers executing one or more computer programs, thereby operating on input data, and Perform the corresponding function by generating output. The processing and logic flows may also be performed by dedicated logic circuits, such as FPGAs (Field Programmable Gate Arrays) or ASICs (Special Purpose Integrated Circuits), and the device may be implemented as dedicated logic circuits.

Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memories, media and memory devices such as semiconductor memory devices (e.g. EPROM, EEPROM and flash memory devices), magnetic disks (eg internal hard disk or removable disk), magneto-optical disks and CDROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, dedicated logic circuitry.

While this specification contains many specific implementation details, these should not be construed as limiting the scope of any invention or claims, but primarily specific used to describe features of certain embodiments. Certain features that are described in multiple embodiments in this specification may be implemented in combination in a single embodiment. On the other hand, various features that are described in a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Also, while the features may act in some combination as described above and may be claimed in this way first, one or more of the features from the combination for which protection is sought may in some cases The combination that can be removed from the combination and for which protection is sought may refer to a subcombination or a variation of a subcombination.

Similarly, although the figures describe operations in a particular order, this does not imply that these operations are performed in the specific order shown, or that all illustrated operations be performed sequentially. is not required to be executed to achieve the desired result. In some cases, multitasking and parallel processing can be advantageous. Also, the separation of various system modules and components in the above embodiments should not be understood to require such separation in all embodiments, and it should be understood that the described program components and systems , may generally be integrated into a single software product, or may be packaged into multiple software products.

This described a specific example of the theme. Other implementations are within the scope of the following claims. In some cases, the actions recited in the claims can still be performed in a different order to achieve desired results. Also, the operations illustrated in the figures should not necessarily be understood to achieve the desired result in the particular order or sequence illustrated. In some implementations, multitasking and parallel processing can be advantageous.

The foregoing descriptions are merely preferred examples of one or more embodiments herein and are not intended to limit the one or more embodiments herein. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments should fall within the protection scope of one or more embodiments herein.

This application claims priority to Chinese patent applications numbered 202021001117.9 and 202010495894.1 filed on Jun. 03, 2020, the entire contents of which are incorporated herein by reference.

Claims (19)

A driving assistance device comprising a camera, a processor, a driving recording module, and a driving assistance module, wherein the camera, the driving recording module, and the driving assistance module are each connected to the processor,
When the driving support device is mounted on a vehicle, the lens of the camera is installed toward the front of the vehicle and used to collect an image of the environment in which the vehicle is located, and the image is an image and/or or including video,
the processor is used to perform a first resolution conversion process and a second resolution conversion process on the image respectively to obtain a first resolution image and a second resolution image, wherein the first resolution and the second resolution are different;
A drive recorder is used to store the first resolution video,
A driving support device, wherein the driving support device is used to generate intelligent driving control information for the vehicle based on the second resolution image. The driving support device further includes a display device connected to the processor,
The processor is further used to perform a third resolution conversion process on the image to obtain a third resolution image and output the third resolution image for display on the display device, wherein the third resolution is 2. The apparatus of claim 1, wherein at least one of said first resolution and said second resolution is different. the device further comprising a gravity sensor connected to the processor;
The processor further obtains detection information of the gravity sensor when the vehicle is in parking mode, and causes the camera to collect an image of the environment in response to the detection information meeting a first set condition. 3. A device according to claim 1 or 2, characterized in that it is used for triggering on. 4. The device of claim 3, wherein the processor is further used to store the image and/or send the image to a set target address. the device further comprising a gravity sensor connected to the processor;
The processor further acquires detection information of the gravity sensor when the vehicle is in a driving mode, and causes the camera to collect an image of the environment in response to the detection information meeting a second set condition. 3. A device according to claim 1 or 2, characterized in that it is used for triggering on. The processor further stores the video,
6. The method according to claim 5, characterized in that it is used to send the image to a set target address and/or search for an image of a period corresponding to the detection information and send the image to the set target address. Device. the apparatus further includes a yaw sensor connected to the processor;
The processor further obtains detection information of the yaw sensor when the vehicle is in a driving mode, and causes the camera to collect an image of the environment in response to the detection information meeting a third set condition. Device according to any one of the preceding claims, characterized in that it is used for triggering. The processor further stores the video,
The method according to claim 7, characterized in that it is used to transmit the image to a set target address and/or search for an image of a period corresponding to the detection information and transmit the image to the set target address. Device. The processor is further used to obtain vehicle travel information,
Specifically, the driving support device outputs driving warning information of the vehicle, outputs control information of an in-vehicle device installed in the vehicle, and Outputting control information for switching the driving mode, and outputting an automatic operation control command for the vehicle. equipment. The processor is further responsive to receiving a video capture trigger signal transmitted by at least one of a vehicle central control panel, a vehicle triggering device, and an external device in communication with the vehicle, the camera but,
collect an image of the environment, store the image and/or send the image to a set target address;
collecting and storing a video of said environment;
used for triggering to perform at least one of retrieving images and/or videos of corresponding periods of said video acquisition trigger signal and transmitting said images and/or said videos to a set target address; A device according to any one of the preceding claims, characterized in that collecting a video of the environment in which the vehicle is located by a camera mounted on the vehicle, said video comprising images and/or videos;
performing a first resolution conversion process and a second resolution conversion process on the video respectively to obtain a first resolution video and a second resolution video, wherein the first resolution and the second resolution are different;
storing the first resolution video;
generating intelligent driving control information for the vehicle based on the second resolution image. The method further includes performing a third resolution conversion process on the image to obtain a third resolution image, and outputting the third resolution image for display on a display device, wherein the third resolution is the third resolution image. 12. The method of claim 11, different from at least one of the first resolution and the second resolution. The method includes:
when the vehicle is in parking mode, obtaining detection information from a gravity sensor installed in the vehicle;
Triggering the camera to collect an image of the environment, storing the image and/or transmitting the image to a set target address in response to the detected information meeting a first set condition. 13. The method of claim 11 or 12, further comprising: The method includes:
when the vehicle is in a driving mode, obtaining detection information from a gravity sensor installed in the vehicle;
Trigger the camera to collect an image of the environment, store the image and/or send the image to a set target address in response to the detected information satisfying a second set condition; and / Or, in response to the detection information satisfying a second setting condition, searching for an image of a period corresponding to the detection information and transmitting the image to a set target address. The method according to any one of claims 11-13. The method includes:
when the vehicle is in a running mode, acquiring detection information from a yaw sensor installed in the vehicle;
Trigger the camera to collect an image of the environment, store the image and/or send the image to a set target address in response to the detected information meeting a third set condition; and / Or, in response to the detection information satisfying a third setting condition, searching for an image of a period corresponding to the detection information and transmitting the image to a set target address. The method according to any one of claims 11-14. The method includes:
obtaining vehicle travel information;
Based on the second resolution image and the vehicle driving information, outputting driving warning information for the vehicle, outputting control information for an in-vehicle device installed in the vehicle, and outputting control information for switching the driving mode of the vehicle. , including executing at least one of outputting an automatic driving control command for the vehicle,
16. The method of any one of claims 11-15, further comprising performing intelligent driving control on the vehicle based on the second resolution image. The method includes:
In response to receiving a video capture trigger signal transmitted by at least one of a vehicle central control panel, a vehicle trigger device, and an external device communicatively connected to the vehicle, the camera:
collect an image of the environment, store the image and/or send the image to a set target address;
collecting and storing a video of said environment;
further comprising triggering to perform at least one of retrieving an image and/or video of a corresponding period of said video acquisition trigger signal and transmitting said image and/or said video to a set target address. A method according to any one of claims 11 to 16, characterized in that A vehicle comprising the driving support device according to any one of claims 1 to 10. A computer-readable recording medium,
computer program stored
A computer-readable recording medium characterized by realizing the method according to any one of claims 11 to 17 when said program is executed by a processor.

Images