WO2023216395A1 - Image acquisition device control method, and apparatus, vehicle and medium - Google Patents

Abstract

Disclosed in the present application are an image acquisition device control method, and an apparatus, a vehicle and a medium. At least one image acquisition device is arranged on the vehicle, and each image acquisition device is connected to a vehicle-mounted power supply according to a set connection mode. The method comprises: acquiring driving behavior data of a vehicle; determining the current driving intention of the vehicle according to the driving behavior data; and if the current driving intention meets an image acquisition device control condition, controlling a vehicle-mounted power supply to switch on and off the power supply of an image acquisition device associated with the current driving intention, so as to control the start and stop of the corresponding image acquisition device.

Description

Control methods, devices, vehicles and media for image acquisition equipment

This application claims priority to the Chinese patent application with application number 202210524594.0, which was submitted to the China Patent Office on May 13, 2022. The entire content of this application is incorporated into this application by reference.

Technical field

This application relates to the field of image control technology, and in particular to control methods, devices, vehicles and media for image acquisition equipment.

Background technique

In order to provide driver-assisted driving imaging functions, vehicles are usually equipped with multiple image acquisition devices. The image acquisition devices include front-view image cameras, reversing image cameras, 360-degree panoramic parking image cameras, etc., which can provide the driver with a more comprehensive view of the surroundings of the vehicle. Image effects.

In related technical solutions, when the car is powered on, multiple image acquisition devices will be turned on at the same time. Some image acquisition devices will enter a standby state after being started, consuming power and occupying the resources of the image processing unit.

Contents of the invention

This application provides a control method, device, vehicle and medium for image acquisition equipment, enabling flexible start and stop of the image acquisition equipment, reducing waste of power consumption and reducing the occupation of image processing unit resources.

According to the first aspect of the present application, a method for controlling an image collection device is provided. At least one image collection device is arranged on the vehicle, and each of the image collection devices is connected to the vehicle power supply according to a set connection method. The method includes:

Obtain vehicle driving behavior data;

Determine the current driving intention of the vehicle based on the driving behavior data;

If the current driving intention satisfies the image acquisition device control conditions, the vehicle power supply is controlled to switch on and off the power supply of the image acquisition device associated with the current driving intention to control the start and stop of the corresponding image acquisition device.

According to the second aspect of the present application, an image collection device is provided, including:

The acquisition module is used to obtain the driving behavior data of the vehicle;

A determination module, configured to determine the current driving intention of the vehicle based on the driving behavior data;

The power control module is used to control the vehicle power supply to switch on and off the power supply of the image collection device associated with the current driving intention to control the start and stop of the corresponding image collection device if the current driving intention satisfies the image collection device control conditions.

According to a third aspect of the present application, a vehicle is provided, including:

Car Power;

At least one image collection device, each image collection device is connected to the vehicle power supply according to the set connection method;

Also includes:

one or more controllers;

A memory communicatively connected to the at least one controller; wherein,

The memory stores a computer program that can be executed by the at least one controller, and the computer program is executed by the at least one controller, so that the at least one controller can execute the method described in any embodiment of the present application. Control method of image acquisition equipment.

According to a fourth aspect of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores computer instructions, and the computer instructions are used to implement any of the embodiments of the present application when executed by the controller. Control method of image acquisition equipment.

According to the fifth aspect of the present application, a computer program product is provided. The computer program product includes a computer program. When the controller executes, the computer program implements the control method of the image acquisition device described in any embodiment of the present application. .

The technical solution of the embodiment of the present application uses the controller to analyze the driver's driving behavior data, determine the driving intention expressed by it, and control the vehicle power supply to power and cut off the corresponding image collection equipment according to the driving intention, so as to realize the imaging The flexible start and stop of the acquisition equipment reduces waste of power consumption and reduces the occupation of image processing unit resources.

Description of the drawings

Figure 1 is a flow chart of a control method for an image collection device provided in Embodiment 1 of the present application;

Figure 2 is an example structural diagram of power supply connections in a method for controlling an image collection device provided in Embodiment 1 of the present application;

Figure 3 is a flow chart of a control method for an image collection device provided in Embodiment 2 of the present application;

Figure 4 is an example flow chart for determining behavioral intention in a control method for an image collection device provided in Embodiment 2 of the present application;

Figure 5 is an example flowchart of a fault detection method for an image acquisition device in a method for controlling an image acquisition device provided in Embodiment 2 of the present application;

Figure 6 is an example flow chart of image processing unit control in a method for controlling an image acquisition device provided in Embodiment 2 of the present application;

Figure 7 is a schematic structural diagram of a control device for image collection equipment provided in Embodiment 3 of the present application;

Figure 8 is a schematic structural diagram of a vehicle provided in Embodiment 4 of the present application.

Detailed ways

In order to enable those in the technical field to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only These are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts should fall within the scope of protection of this application.

It should be noted that the terms "first", "second", etc. in the description and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the application described herein can be practiced in sequences other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, e.g., a process, method, system, product, or apparatus that encompasses a series of steps or units and need not be limited to those explicitly listed. Those steps or elements may instead include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.

Embodiment 1

Figure 1 is a flow chart of a method for controlling image acquisition equipment provided in Embodiment 1 of the present application. This embodiment can be applied to the situation of controlling the flexible start and stop of the image acquisition equipment. This method can be executed by the control device of the image acquisition equipment. , the control device of the image acquisition device can be implemented in the form of hardware and/or software, and the control device of the image acquisition device can be configured in the vehicle. As shown in Figure 1, the method includes:

S110. Obtain the driving behavior data of the vehicle.

In this embodiment, the driving behavior data can be understood as the driver's driving behavior according to the driving intention, and the driving behavior is converted into data. For example, if the driver wants to reverse, the driver will make a decision to put the gear in the reverse gear. When turning on behaviors such as reversing images, the corresponding driving behavior data can include driving demand data triggered by the driving user, the current speed of the vehicle, the current gear and the current driving direction, etc.

Specifically, the parts in the vehicle associated with the controller include devices related to providing driving behavior data, and the controller obtains driving behavior data from these devices.

S120. Determine the vehicle's current driving intention based on the driving behavior data.

In this embodiment, the driving intention can be understood as the driver's behavior based on his actual driving situation. For example, if the driver places the gear in the reverse gear, turns on the reversing image, etc., then the current driving intention is to reverse.

Specifically, the controller receives the driving behavior data of the device and analyzes the driving behavior data according to the set standards to determine the vehicle's current driving intention.

S130. If the current driving intention satisfies the image acquisition device control conditions, control the vehicle power supply to switch off the power supply of the image acquisition device associated with the current driving intention to control the start and stop of the corresponding image acquisition device.

In this embodiment, the part associated with the controller also includes a power management unit, which is used to receive control instructions from the controller and control the vehicle power supply to supply power to the corresponding image collection device. The image acquisition device control conditions can be understood as the conditions for turning on or off the image acquisition device. Among them, the image acquisition equipment can be understood as the image acquisition equipment required when the vehicle is moving forward, backward, parking, etc. For example, the front-view camera needs to be turned on when the vehicle is moving forward, the surround-view camera needs to be turned on when parking, etc.

For example, the image collection device may include: a front-view camera, a rear-view camera, a surround-view camera, a left-view camera, a right-view camera, etc.

Specifically, the current driving intention satisfies the control conditions of the camera acquisition equipment, and the controller sends the control instructions of the relevant acquisition equipment to the power management unit, and controls the vehicle power supply to supply power to the corresponding camera acquisition equipment through the power management unit, and power off irrelevant equipment. , to control the start and stop of the corresponding image collection equipment.

Further, each image collection device is grouped according to the functional application scenarios of the collected images, and the imaging devices in the same device group are connected to the vehicle power supply using the same power supply line.

For example, functional application scenarios can be divided according to different driving intentions, and the required imaging devices are grouped into a group according to different driving intentions and connected to the vehicle power supply using the same power supply line. For example, when the driving intention is to park, the front, rear, left, and right surround cameras can be divided into a group and connected to the vehicle power supply using the same power supply line. That is, when the driving intention is to park, the vehicle power supply directly connects the front, rear, and rear cameras to the vehicle power supply. The left and right surround cameras are powered by this line.

Figure 2 is an example structural diagram of power supply connection in a method for controlling an image collection device provided in Embodiment 1 of the present application. Figure 2 shows the following equipment: power management unit 210, vehicle power supply 220, front-view camera 230, rear-view camera 240, surround view camera 250, left view camera 260, right view camera 270.

In this embodiment, the front-view camera can be understood as a camera that integrates a front-view narrow-angle camera, a front-view wide-angle camera, and other cameras that can realize the front-view function. The rear view camera can be understood as a camera that integrates rear view narrow angle and other functions to achieve rear view functions. A surround-view camera can be understood as a camera that integrates a front surround-view camera, a rear surround-view camera, a left surround-view camera, a right surround-view camera, and other cameras that can realize the surround-view function. The left-view camera can be understood as a camera that integrates the left-view function. The right-side view camera can be understood as a camera that integrates the right-side view function.

The first embodiment provides a control method for an image collection device. The controller analyzes the driver's driving behavior data, determines the driving intention represented by the controller, and controls the vehicle power supply for the corresponding image collection device according to the driving intention. Power supply, powering off irrelevant image collection equipment can effectively reduce the resource occupation of image processing units and waste of power consumption caused by turning on the power of irrelevant cameras.

Embodiment 2

Figure 3 is a flow chart of a control method for an image collection device provided in Embodiment 2 of the present application. The technical solution of this embodiment is further refined based on the above technical solution. As shown in Figure 3, the method includes:

S300. Obtain the driving behavior data of the vehicle.

S310. If the obtained driving behavior data is driving demand data triggered by the driving user, determine the driving user's current driving intention with respect to the vehicle through analysis of the driving demand data.

In this embodiment, the driving behavior data can be divided into driving demand data actively triggered by the driving user or behavioral data such as vehicle speed, gear position, and driving direction. Driving demand data can be understood as the driving user who wants to turn on a certain image collection device according to his own needs. He can turn it on by touching the corresponding image collection device switch. The image collection device switch component forms corresponding driving behavior data and transmits it to the controller. .

For example, the driver touches the reversing image switch to turn on the reversing image, and the reversing image turning on instruction data is sent to the controller. The controller obtains the reversing image turning on instruction data and determines that the driving user's current driving intention is to turn on the reversing image.

S320. If the obtained driving behavior data is the vehicle's current speed, current gear, and current driving direction, determine the vehicle's speed by analyzing at least two of the current speed, current gear, and current driving direction. Current driving intention.

In this embodiment, the current vehicle speed can be understood as the driving speed of the car at this moment. The current gear can include forward gear, reverse gear, neutral gear, etc. The current driving direction can include forward, backward, left turn, right turn, etc.

Figure 4 is an example flow chart for determining behavioral intention in a method for controlling an image collection device provided in Embodiment 2 of the present application. As shown in Figure 4, Embodiment 2 uses the following steps to achieve the determination of behavioral intention:

S3200, obtain the current vehicle speed, current gear, and current driving direction;

S3201. Determine whether the current vehicle speed is greater than the set first vehicle speed threshold. If yes, jump to S3202; if not, jump to S3204;

In this embodiment, the first vehicle speed threshold can be understood as the set speed when the vehicle is traveling normally, such as 30 KPH, and is used to determine whether the vehicle is in a driving state based on the first vehicle speed threshold.

Specifically, the controller receives the current vehicle speed data sent by the vehicle speed device related to the driving behavior data, and compares it with the preset first vehicle speed threshold.

S3202. Determine whether the current driving direction is opposite to the direction of the vehicle front. If yes, jump to S3203; if not, jump to S3205;

Specifically, when the current vehicle speed is greater than the first vehicle speed threshold, the controller receives the current driving direction data sent by the vehicle speed device related to the driving behavior data, and compares it with the vehicle head direction.

S3203. Determine that the current driving intention is to drive the vehicle backward;

Specifically, when the controller receives the current driving direction data sent by the vehicle speed device related to the driving behavior data and is opposite to the front of the vehicle, it determines that the current driving intention is for the vehicle to drive backwards.

S3204. Determine whether the current vehicle speed is greater than the set second vehicle speed threshold. If yes, jump to S3206; if not, jump to S3207;

In this embodiment, the second vehicle speed threshold can be understood as the speed when the vehicle is parking, such as 3KPH, and is used to determine whether the vehicle is in a parking state based on the second vehicle speed threshold.

S3205. Determine that the current driving intention is to drive the vehicle forward;

Specifically, if the current driving direction data sent by the vehicle speed device related to the driving behavior data received by the controller is the same as that of the front of the vehicle, it is determined that the current driving intention is for the vehicle to move forward.

S3206. Determine whether the current gear of the vehicle is in neutral. If yes, jump to S3202; if not, jump to S3207;

Specifically, the controller receives the current gear data sent by the vehicle speed device related to the driving behavior data, and determines whether the vehicle's current gear is in neutral.

S3207. Determine whether the current gear of the vehicle is in reverse gear. If yes, jump to S3208; if not, jump to S3209;

Specifically, the controller receives the current gear data sent by the vehicle speed device related to the driving behavior data. If it is not in neutral at this time, it continues to determine whether the current gear of the vehicle is in reverse gear.

S3208. Determine the current driving intention is to park the vehicle;

Specifically, the controller receives the gear data sent by the vehicle speed device related to the driving behavior data and determines that the current driving intention is to park the vehicle.

S3209. Determine whether the current gear of the vehicle is in forward gear. If yes, jump to S3210; if not, jump to S3211;

Specifically, the controller receives the current gear data sent by the vehicle speed device related to the driving behavior data, and determines whether the current gear of the vehicle is in the forward gear.

S3210. Confirm that the current driving intention is parking search;

Specifically, the controller receives the gear data sent by the vehicle speed device related to the driving behavior data and determines that the current driving intention is to seek parking.

S3211. Determine that the current driving intention is that the vehicle is stationary.

Specifically, if the gear data sent by the vehicle speed device related to the driving behavior data received by the controller is not a forward gear, then it is determined that the current driving intention is that the vehicle is stationary.

S330. If the driver's current driving intention with respect to the vehicle includes a display requirement for the collected images, then the image acquisition device control conditions are met and the first image acquisition device corresponding to the display requirement is obtained; the vehicle power supply is controlled to maintain power supply to the first image device. Turn off the power supply of other image acquisition devices except the first image acquisition device.

In this embodiment, the display requirement can be understood as that if the driver wants to view the direction corresponding to a certain image collection device, the image collection device needs to be turned on. If the driver wants to view the situation behind the vehicle, the reversing image must be turned on. The first imaging device can be understood as the imaging device that is turned on in order to meet the display requirements. If the driver turns on the reversing image, he needs to turn on the rearview camera corresponding to the reversing image.

Specifically, the controller obtains the display requirements transmitted by the driving user by controlling the switch of the corresponding image collection device. For example, the driver wants to turn on the reversing image. At this time, the image collection device control conditions are met, and the controller obtains the first image collection device according to the display requirements. Then the reversing image acquisition equipment required to obtain the reversing image is obtained. The controller determines that the reversing image acquisition equipment, such as the rear view camera, should be turned on. The controller sends the instruction to turn on the rear view camera to the power management unit. The power management unit controls the vehicle power supply to maintain the direction of the reversing image. Power supply for the first image acquisition device. If there is no other driving behavior data at this time, the controller sends an instruction to turn off other image collection equipment except the first image collection equipment, and controls the vehicle power supply to turn off the corresponding image collection equipment; if there is other driving behavior data at this time, according to The driving behavior data determines which corresponding image collection devices should be turned on in addition to the first image collection device, controls the vehicle power supply to turn them on, and turns off unnecessary image collection devices.

S340. If it is determined that the current driving intention is in the set driving state, the image acquisition device control conditions are met.

In this embodiment, the set driving state can be understood as the set vehicle driving state used to indicate the switch of the corresponding image collection device.

Further, setting the driving state may include vehicle traveling backward, vehicle traveling forward, vehicle parking, vehicle parking search, and vehicle stationary.

Specifically, the controller determines that the current driving intention is the set driving state, and then sends instructions to turn on the corresponding image collection equipment and turn off irrelevant image collection equipment instructions to the power manager according to the driving state, and then controls the vehicle power supply to turn on the corresponding image. Collection equipment, close irrelevant image collection equipment.

S350. When the driving state is set to the vehicle traveling backward, control the vehicle power supply to keep supplying power to the second image collection device corresponding to the vehicle traveling backward, and turn off the power supply to other image collection devices except the second image collection device.

In this embodiment, the second image collection device can be understood as an image collection device that needs to be turned on when driving backwards, such as a rearview camera.

Specifically, when the driving state is that the vehicle is traveling backwards, the controller determines that the second image acquisition device corresponding to the reverse driving should be turned on, and sends an instruction to turn on the second image collection device and an instruction to close the irrelevant image collection device to the power management unit, such as sending Turn on the rear view camera command, turn off the front view camera, surround view camera, left view camera, right view camera command, etc., the power management unit controls the vehicle power supply to maintain power supply to the second image acquisition device corresponding to the vehicle's backward driving, and turns off Cut off the power supply of other image collection devices except the second image collection device.

S360. When the driving state is set to the vehicle moving forward, control the vehicle power supply to keep supplying power to the third image collection device corresponding to the vehicle moving forward, and turn off the power supply to other image collection devices except the third image collection device.

In this embodiment, the third image collection device can be understood as an image collection device that needs to be turned on when driving forward, such as a forward-looking camera.

Specifically, when the driving state is that the vehicle is driving forward, the controller determines that the third image collection device corresponding to forward driving should be turned on, and sends an instruction to turn on the third image collection device and an instruction to close the irrelevant image collection device to the power management unit, such as sending Turn on the front-view camera command, turn off the rear-view camera, surround-view camera, left-view camera, right-view camera command, etc., the power management unit controls the vehicle power supply to maintain power supply to the third image collection device corresponding to the vehicle's backward driving, and shut down Cut off the power supply to other image collection devices except the third image collection device.

S370. When the driving state is set to the vehicle parking, control the vehicle power supply to keep supplying power to the corresponding fourth image acquisition device when the vehicle is parked, and turn off the power supply to other image acquisition devices except the fourth image acquisition device.

In this embodiment, the fourth image collection device can be understood as an image collection device that needs to be turned on when the vehicle is parked, such as a surround-view camera, etc.

Specifically, when the driving state is that the vehicle is parked, the controller determines that the fourth image acquisition device corresponding to the vehicle parking should be turned on, and sends an instruction to turn on the fourth image collection device and an instruction to close the irrelevant image collection device to the power management unit, such as Send instructions to turn on the surround view camera, turn off the front view camera, rear view camera, left view camera, right view camera instructions, etc., the power management unit controls the vehicle power supply to maintain power supply to the fourth image acquisition device corresponding to the vehicle's backward driving, and Turn off the power supply of other image acquisition devices except the fourth image acquisition device.

S380. When the driving state is set to the vehicle parking search, control the vehicle power supply to keep supplying power to the fifth image acquisition device corresponding to the vehicle parking search, and turn off the power supply to other image acquisition devices except the fifth image acquisition device.

In this embodiment, the fifth image collection device can be understood as an image collection device that needs to be turned on when the vehicle is parking and searching, such as turning on a driving direction camera.

Specifically, when the driving state is vehicle parking and searching, the controller determines that the fifth image acquisition device corresponding to the vehicle parking and searching should be enabled, and sends an instruction to enable the fifth image acquisition device and an instruction to close irrelevant image acquisition devices to the power management unit. , if it is necessary to turn right at this time, an instruction to turn on the right-view camera is sent, and an instruction to turn off the front-view camera, surround-view camera, left-view camera, etc. is sent. The power management unit controls the vehicle power supply to maintain the fifth image acquisition device corresponding to the vehicle driving backward. power supply, and turn off the power supply of other image acquisition devices except the fifth image acquisition device.

S390. When the driving state is set to the vehicle being stationary, control the vehicle power supply to turn off the power supply of all image collection devices.

Specifically, when the driving state of the vehicle is stationary, the controller sends a command to turn off all image collection equipment to the power management unit, and the power management unit controls the vehicle power supply to turn off the power supply except for all image collection equipment.

The second embodiment provides a control method for an image collection device, by classifying driving behavior data such as the driving user's driving demand data, the vehicle's current gear data, the vehicle's current speed data, the vehicle's current driving direction data, etc. Determine the driving intention represented by it, associate the driving intention with its corresponding image collection device, and determine which image collection device should be turned on under a certain driving intention. The controller automatically determines the current driving intention and sends corresponding instructions to turn on and off the image collection equipment. It controls the on-board power supply to supply power to the corresponding image collection equipment and cuts off power to irrelevant image collection equipment, which can effectively reduce the number of irrelevant cameras. The resource occupation of the image processing unit and the waste of power consumption caused by turning on the power.

As a first optional embodiment of the second embodiment, based on the above embodiment, further optimization includes: before obtaining the driving behavior data of the vehicle, it also includes:

When it is detected that the vehicle is initially powered on, the vehicle power supply is controlled to supply power to each image acquisition device.

Specifically, when it is detected that the vehicle starts to be powered on, the controller sends an instruction to turn on all image collection equipment to the power management unit, and the power management unit controls the vehicle power supply to turn on all image collection equipment, such as front-view cameras, rear-view cameras, surround-view cameras, Left-view camera, right-view camera, etc.

As a second optional embodiment of the second embodiment, based on the above embodiment, further optimization includes: before obtaining the driving behavior data of the vehicle, it also includes:

Perform fault detection on each image acquisition device in a powered-on state, and when there is a faulty image acquisition device, control the vehicle power supply to shut off power supply to the faulty image acquisition device.

Figure 5 is an example flow chart of an image collection equipment fault detection method in a method for controlling an image collection equipment provided in Embodiment 2 of the present application. As shown in Figure 5, this Embodiment 2 uses the following steps to implement failure of the image collection equipment. detection.

For example, the image collection device may include: a camera in the forward direction, a camera in the backward direction, a left-view camera, and a right-view camera. For convenience of description, each camera is used instead of the image collection device below.

Specifically, the fault detection method provided in this embodiment may include:

S400, obtain camera data;

S401. Determine whether the camera data in the forward direction is normal. If yes, execute S402; if not, execute S407;

S402. Determine whether the camera data in the backward direction is normal. If yes, execute S403; if not, execute S408;

S403. Determine whether the left-view camera data is normal. If yes, execute S404; if not, execute S409;

S404. Determine whether the right-view camera data is normal. If yes, execute S405; if not, execute S411;

S405. Determine whether the surround camera data is normal. If yes, execute S406; if not, execute S412;

S406, normal function;

S407, forward direction camera failure alarm;

S408, back direction camera failure alarm;

S409, left side view camera failure alarm;

S410, right side view camera failure alarm;

S411. Surround camera failure alarm.

Specifically, the controller is also associated with an image processing unit, and the image processing unit is associated with the power management unit. When the vehicle starts to power on, the controller controls the vehicle power supply to supply power to each image acquisition device. Each image acquisition device transmits the corresponding acquisition data to the image processing unit. The controller determines whether the data transmitted by each camera is normal. If it is normal, it means The camera function is normal; if the data transmitted by a certain camera is empty or abnormal, it means that the camera is faulty, and the controller will send the fault alarm command to the corresponding alarm device, such as the corresponding instrument panel and other alarm devices, so that it can issue a fault alarm.

Through such a setting, this solution can power all related image collection equipment when the vehicle is initially powered on, and then check whether there are any faults. This method of checking in advance before use avoids inability to do so due to faults. The problem of turning on the corresponding camera while driving.

As a third optional embodiment of the second embodiment, based on the above embodiment, further optimization includes:

For each image acquisition device in the power-on state, the collected image data signal is received through the corresponding signal transmission channel, and the corresponding image information is displayed through the image player; when it is monitored that the image acquisition device is in the off state, the corresponding signal is turned off The transmission channel transmits image data signals.

In this embodiment, the controller is associated with an image processing unit for receiving image data signals and sending them to the corresponding image player. The signal transmission channel can be understood as connecting the image player and the controller through the image processing unit for transmitting corresponding image data signals. The video player can be understood as a playback device that is connected to various image collection devices and displayed to users in the vehicle, such as central control and other video players.

Specifically, the image acquisition device in the powered-on state transmits the image data signal to the controller through the corresponding signal transmission channel, and transmits it to the corresponding image player for display. For example, the image data of the rear view camera is processed by the rear view image. unit is sent to the rear view screen of the central control; for image collection equipment that does not need to be turned on, the controller sends the shutdown command of the imaging device to the power management unit. When the shutdown command sent by the controller is monitored, the corresponding signal transmission is turned off. The transmission of image data signals by the channel releases the corresponding image processing unit resources, that is, the image processing unit no longer performs data processing corresponding to the image acquisition device.

Through this setting, when the controller controls the vehicle power supply to turn off unnecessary image acquisition equipment, there is no need to open its corresponding signal transmission channel. Then, the corresponding signal transmission channel is controlled to be closed, and the image processing unit no longer responds to the request. The data corresponding to the image acquisition device is processed, releasing the resources of the image processing unit, and only opening the image acquisition device and signal transmission channel that are needed at this time, solving the problem of useless resource occupation of the image processing unit, and also saving the power of the vehicle power supply. .

As a fourth optional embodiment of the second embodiment, based on the above embodiment, further optimization includes:

If a bad image data signal transmitted by any turned-off image acquisition device in a power-off state is received, the bad image data signal is ignored;

Correspondingly, the method also includes:

If the resource usage corresponding to the processing of each received image data signal is greater than or equal to at least one set threshold, any target secondary image acquisition device is selected from the turned on secondary image acquisition devices and turned off. Power-up of target secondary image acquisition equipment.

In this embodiment, a bad image data signal can be understood to mean that the image capture device that should be in a shutdown state still has image data signals to transmit. Resource occupancy can be understood as the memory usage of the image processing unit, that is, how many image data signals are processed at the same time. The set at least one threshold can be understood as the set maximum resource occupancy, that is, the number of data that can be processed simultaneously by the current image processing unit is divided by the maximum number of data that can be processed simultaneously. For example, the maximum number of data that the image processing unit can process at the same time. Process 5 data at the same time. When the image processing unit processes the image data signals transmitted by 4 image acquisition devices at the same time, the resource occupancy rate is 80%. Set a threshold to 80%, which allows the resource occupancy rate to reach a maximum of 80%. . Among them, two thresholds can be set. The first set threshold is used to make a judgment after receiving a bad image data signal, such as set to 90%. The second set threshold is used to make a judgment after turning off any secondary camera. , if set to 80%, if the second set threshold is not met, any secondary camera will be turned off again. The secondary image collection device can be understood as an image collection device that does not have to be turned on under the current driving intention. For example, when the vehicle's current driving intention is to drive forward, the image collection device that must be turned on is the front-view camera. If the left side camera is also turned on at this time, The left and right view cameras are secondary cameras.

For example, when the image capture device that should be turned off is still on and the image capture device is still transmitting the corresponding image data signal, the controller marks the image capture device as a fault state that cannot be turned off and locks its occupation. Image processing unit resources, for all turned on devices, determine whether the resource occupancy rate of the image processing unit is greater than the set first threshold. For example, the set first threshold is 90%. If the resource occupancy rate is greater than or equal to 90%, then choose to close any secondary camera, release the corresponding image processing unit resources, and perform a secondary judgment on it. The second threshold is set to 80% to determine whether the resource occupancy rate of the image processing unit is greater than or Equal to 80%. If it is greater, continue to turn off any secondary camera until the resource usage is less than 80%. If the resource usage is less than 90% at this time, the image processing unit continues to process bad image data signals. .

Through such settings, this solution determines the current status of the image acquisition equipment in the power-off state, and determines the occupancy rate of the image processing unit of all turned-on cameras. When the set threshold is not met, resources are released, so that the image The processing unit will not be in an overloaded state, ensuring the normal operation of the image processing unit.

In order to better understand the technical solutions of the third and fourth optional embodiments of this embodiment, an exemplary image acquisition device control implementation description is given below:

Figure 6 is an example flow chart of image processing unit control in a method for controlling an image collection device provided in Embodiment 2 of the present application. As shown in Figure 6, Embodiment 2 uses the following steps to control image playback.

For example, the image collection device may include: a camera in the driving direction, a test camera, and a right-side view camera. For convenience of description, each camera is used instead of the image collection device below.

Specifically, an exemplary implementation of the control method of the image collection device provided in this embodiment may include:

S500, obtain camera fault data;

S501. Determine whether the camera is faulty. If yes, execute S507; if not, execute S502;

S502. Whether all camera closing instructions are received. If yes, execute S508; if not, execute S503;

S503. Whether the surround view camera closing command is received. If yes, execute S509; if not, execute S504;

S504. Whether the front-view camera closing command is received. If yes, execute S510; if not, execute S505;

S505. Whether the rearview camera closing command is received. If yes, execute S511; if not, execute S506;

S506. Whether the side view camera closing instruction is received. If yes, execute S512; if not, execute S515;

S507. Close and disable the faulty camera and release the corresponding image processing unit resources;

S508. Close all cameras and release the image processing unit;

S509. Close the surround view camera and release its corresponding image processing unit resources;

S510. Close the forward direction camera and release its corresponding image processing unit resources;

S511. Close the backward direction camera and release its corresponding image processing unit resources;

S512. Turn off the side-view camera and release its corresponding image processing unit resources;

S513. Determine whether the image processor that should be shut down has data transmission. If yes, execute S514; if not, execute S515;

S514, fault camera mark;

S515. Determine whether the resource occupancy rate of the image processing unit is greater than or equal to 90% at this time. If yes, execute S516; if no, end;

S516. Close any secondary camera and release the corresponding image processing unit resources.

S517. Determine whether the resource occupancy rate of the image processing unit is greater than or equal to 80% at this time. If yes, execute S516; if no, end.

Embodiment 3

FIG. 7 is a schematic structural diagram of a control device for an image collection device provided in Embodiment 3 of the present application. As shown in FIG. 7 , the device includes: an acquisition module 61 , a determination module 62 , and a power control module 63 .

Among them, the acquisition module 61 is used to acquire the driving behavior data of the vehicle.

The determination module 62 is used to determine the current driving intention of the vehicle based on the driving behavior data.

The power control module 63 is used to control the vehicle power supply to switch on and off the power supply of the image collection device associated with the current driving intention to control the start and stop of the corresponding image collection device if the current driving intention satisfies the image collection device control conditions.

The third embodiment provides a control device of an image collection device by classifying driving behavior data such as the driving user's driving demand data, the vehicle's current gear data, the vehicle's current speed data, the vehicle's current driving direction data, etc., to determine The driving intention represented by it associates the driving intention with its corresponding image collection device, and determines which image collection device should be turned on under a certain driving intention. The controller automatically determines the current driving intention and sends corresponding instructions to turn on and off the image collection equipment. It controls the on-board power supply to supply power to the corresponding image collection equipment and cuts off power to irrelevant image collection equipment, which can effectively reduce the number of irrelevant cameras. The resource occupation of the image processing unit and the waste of power consumption caused by turning on the power.

Further, the determining module 62 may include:

The first determination unit is configured to determine the current driving intention of the driving user relative to the vehicle by analyzing the driving demand data if the acquired driving behavior data is driving demand data triggered by the driving user.

The second determination unit is configured to, if the acquired driving behavior data is the current speed, current gear and current driving direction of the vehicle, analyze at least two of the current speed, current gear and current driving direction. , determine the current driving intention of the vehicle.

Optionally, the step for the second determination unit to determine the vehicle's current driving intention based on the driving behavior data may include:

When the current vehicle speed is greater than the first vehicle speed threshold, or the current vehicle speed is less than or equal to the first vehicle speed threshold and greater than the second vehicle speed threshold, and the current gear is neutral, if the current driving direction is opposite to the front direction of the vehicle, then It is determined that the current driving intention is for the vehicle to drive backwards, otherwise, it is determined that the current driving intention is for the vehicle to drive forward; when the current vehicle speed is less than or equal to the first vehicle speed threshold, or the current vehicle speed is less than or equal to the first vehicle speed threshold and greater than the second vehicle speed threshold , and when the current gear is non-neutral, the vehicle's current driving intention is determined based on the current gear; correspondingly, the vehicle's current driving intention is determined based on the current gear, including: if the current gear is If the current gear is reverse gear, it is determined that the current driving intention is to park the vehicle; otherwise, it is determined whether the current gear is forward gear; if so, it is determined that the current driving intention is to park the vehicle; if not, it is determined The current driving intention is that the vehicle is stationary.

Optionally, the second determination unit is configured to control the vehicle power supply to switch off the power supply of the image collection device associated with the current driving intention if the current driving intention satisfies the image collection device control conditions, including:

If the driving user's current driving intention with respect to the vehicle includes a display requirement for the collected images, the image acquisition device control conditions are met, and the first image acquisition device corresponding to the display requirement is obtained; and the vehicle power supply is controlled to keep supplying the first image The power supply of the device is turned off, and the power supply of other image acquisition devices except the first image acquisition device is turned off.

Optionally, the image capture device control conditions in the second determination unit also include: the current driving intention is in a set driving state, where the set driving state includes vehicle backward driving, vehicle forward driving, vehicle parking, vehicle parking Search and the vehicle is stationary; correspondingly, if the current driving intention satisfies the image collection device control conditions, the vehicle power supply is controlled to switch off the power supply of the image collection device associated with the current driving intention, including: if it is determined that the current driving intention is in the set driving state , then when the driving state is set to the vehicle driving backwards, the vehicle power supply is controlled to keep supplying power to the second image collection device corresponding to the vehicle driving backwards, and to turn off the power supply to other image collection devices except the second image collection device; or, when When the driving state is set to the vehicle driving forward, the vehicle power supply is controlled to keep supplying power to the third image acquisition device corresponding to the vehicle driving forward, and to turn off the power supply to other image acquisition devices except the third image acquisition device; when the driving state is set When the vehicle is parked, the vehicle power supply is controlled to keep supplying power to the corresponding fourth image acquisition device when the vehicle is parked, and the power supply to other image acquisition devices except the fourth image acquisition device is turned off; or, when the driving state is set to When the vehicle is parking and searching, the vehicle power supply is controlled to keep supplying power to the fifth image acquisition device corresponding to the vehicle parking and searching, and to turn off the power supply to other image acquisition devices except the fifth image acquisition device; when the driving state is set to the vehicle being stationary , control the vehicle power supply to turn off the power supply of all image collection equipment.

Further, the device also includes:

The power supply module is used to control the vehicle power supply to supply power to each image collection device when the vehicle starts to be powered on.

Further, the device also includes:

The fault detection module is used to detect faults on each image collection equipment in a powered-on state, and when there is a faulty image collection equipment, control the vehicle power supply to shut off the power supply to the faulty image collection equipment.

Further, the device also includes:

A power supply shut-off module, configured to ignore the bad image data signal if it receives a bad image data signal transmitted by any shut-down image collection device in a power supply shut-off state;

Correspondingly, the module is also used to:

If the resource usage corresponding to the processing of each received image data signal is greater than or equal to at least one set threshold, any target secondary image acquisition device is selected from the turned on secondary image acquisition devices and turned off. Power-up of target secondary image acquisition equipment.

The control device for image acquisition equipment provided by the embodiments of this application can execute the control method of the image acquisition equipment provided by any embodiment of this application, and has corresponding functional modules and effects for executing the method.

Embodiment 4

Figure 8 is a schematic structural diagram of a vehicle provided in Embodiment 4 of the present application. As shown in Figure 8, the vehicle includes a vehicle power supply 70, an image acquisition device 71, a controller 72, and a memory 73; the number and control of the image acquisition devices 71 The number of devices 72 and memory 73 can be one or more. In Figure 7, an image acquisition device 71, a controller 72 and a memory 73 are taken as an example; the image acquisition device 71, the controller 72 and the memory 73 can be The controller is connected through a bus or other means. The controller also includes an image processing unit and a power management unit. In Figure 7, connection through a bus is taken as an example.

The vehicle power supply 70 is used to power the image collection equipment.

Image collection device 71 is used to collect corresponding images.

As a computer-readable storage medium, the memory 73 can be used to store software programs, computer-executable programs and modules, such as program instructions/modules corresponding to the status monitoring method of vehicle-mounted equipment in the embodiments of the present application (for example, image acquisition equipment The acquisition module 61, the determination module 62, and the power control module 63 in the control device. The controller 72 executes various functional applications and data processing of the vehicle by running software programs, instructions and modules stored in the memory 73 , that is, implementing the above control method of the image acquisition device.

The memory 73 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system and an application program required for at least one function; the stored data area may store data created according to the use of the terminal, etc. In addition, the memory 73 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 73 may further include memory located remotely relative to controller 72 , and these remote memories may be connected to the vehicle via a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.

Embodiment 5

Embodiment 5 of the present application also provides a storage medium containing computer-executable instructions. When executed by a computer controller, the computer-executable instructions are used to execute a control method of an image acquisition device. The method includes:

Obtain vehicle driving behavior data;

Determine the current driving intention of the vehicle based on the driving behavior data;

If the current driving intention satisfies the image acquisition device control conditions, the vehicle power supply is controlled to switch on and off the power supply of the image acquisition device associated with the current driving intention to control the start and stop of the corresponding image acquisition device.

Of course, the embodiments of the present application provide a storage medium containing computer-executable instructions. The computer-executable instructions are not limited to the method operations described above, and can also perform the control of the image acquisition device provided by any embodiment of the application. Related operations in the method.

Through the above description of the implementation manner, those skilled in the art can clearly understand that the present application can be implemented with the help of software and necessary general hardware, or can also be implemented by hardware. The technical solution of this application can essentially be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as a computer's floppy disk, read-only memory (Read-Only Memory, ROM), random access Memory (Random Access Memory, RAM), flash memory (FLASH), hard disk or optical disk, etc., includes a number of instructions to cause a computer device (which can be a personal computer, server, or network device, etc.) to execute the various embodiments of this application. Methods.

It is worth noting that in the above embodiments of the control device for image acquisition equipment, the various units and modules included are only divided according to functional logic, but are not limited to the above divisions, as long as the corresponding functions can be realized; In addition, the specific names of each functional unit are only for the convenience of distinguishing each other and are not used to limit the protection scope of the present application.

It should be understood that various forms of the process shown above may be used, with steps reordered, added or deleted. For example, each step described in this application can be executed in parallel, sequentially, or in a different order. As long as the desired results of the technical solution of this application can be achieved, there is no limitation here.

Claims (11)

1. A method of controlling an image collection device. At least one image collection device is installed on the vehicle. Each of the image collection devices is connected to the vehicle power supply according to a set connection method. The method includes:

   Obtain vehicle driving behavior data;

   Determine the current driving intention of the vehicle based on the driving behavior data;

   If the current driving intention satisfies the image acquisition device control conditions, the vehicle power supply is controlled to switch on and off the power supply of the image acquisition device associated with the current driving intention to control the start and stop of the corresponding image acquisition device.
2. The method according to claim 1, wherein each of the image collection devices is grouped according to the functional application scenarios of the collected images, and the image collection devices in the same device group are connected to the vehicle power supply using the same power supply line.
3. The method according to claim 1, wherein determining the current driving intention of the vehicle based on the driving behavior data includes:

   If the acquired driving behavior data is driving demand data triggered by the driving user, then by analyzing the driving demand data, determine the driving user's current driving intention with respect to the vehicle;

   If the acquired driving behavior data is the current speed, current gear and current driving direction of the vehicle, then by analyzing at least two of the current speed, current gear and current driving direction, the vehicle is determined current driving intention.
4. The method of claim 3, wherein determining the vehicle's current driving intention by analyzing at least two of the current vehicle speed, current gear and current driving direction includes:

   When the current vehicle speed is greater than the first vehicle speed threshold, or when the current vehicle speed is less than or equal to the first vehicle speed threshold and greater than the second vehicle speed threshold, and the current gear is neutral, if the current driving The direction is opposite to the direction of the front of the vehicle, then it is determined that the current driving intention is for the vehicle to drive backwards, otherwise, it is determined that the current driving intention is for the vehicle to drive forward;

   When the current vehicle speed is less than or equal to the first vehicle speed threshold, or when the current vehicle speed is less than or equal to the first vehicle speed threshold and greater than the second vehicle speed threshold, and the current gear is non-neutral, according to the The current gear is used to determine the current driving intention of the vehicle;

   Correspondingly, determining the current driving intention of the vehicle based on the current gear position includes:

   If the current gear is reverse gear, determine that the current driving intention is to park the vehicle, otherwise, determine whether the current gear is forward gear;

   If so, it is determined that the current driving intention is vehicle parking and search;

   If not, it is determined that the current driving intention is that the vehicle is stationary.
5. The method according to claim 3, wherein if the current driving intention satisfies the image collection device control condition, controlling the vehicle power supply to disconnect the power supply of the image collection device associated with the current driving intention, including:

   If the driving user's current driving intention with respect to the vehicle includes a display requirement for the collected images, then the image acquisition device control conditions are met and the first image acquisition device corresponding to the display requirement is obtained;

   Control the vehicle power supply to maintain power supply to the first imaging device, and turn off power supply to other image acquisition devices except the first image acquisition device.
6. The method according to claim 3, wherein the image collection device control conditions further include: the current driving intention is in a set driving state, wherein the set driving state includes a vehicle traveling backward, a vehicle traveling forward, and a vehicle parking. , vehicle parking search and vehicle stationary;

   Correspondingly, if the current driving intention satisfies the image collection device control condition, controlling the vehicle power supply to disconnect the power supply of the image collection device associated with the current driving intention includes:

   If it is determined that the current driving intention is in a set driving state, then

   When the set driving state is the vehicle traveling backward, the vehicle power supply is controlled to keep supplying power to the second image collection device corresponding to the vehicle traveling backward, and to turn off the power supply to other image collection devices except the second image collection device. ;or,

   When the set driving state is that the vehicle is moving forward, the vehicle power supply is controlled to keep supplying power to the third image collection device corresponding to the vehicle's forward movement, and to turn off other image collection devices except the third image collection device. power supply;

   When the set driving state is that the vehicle is parked, the vehicle power supply is controlled to keep supplying power to the corresponding fourth image acquisition device when the vehicle is parked, and to turn off other image acquisition devices except the fourth image acquisition device. power supply; or,

   When the set driving state is the vehicle parking and searching, the vehicle power supply is controlled to keep supplying power to the fifth image acquisition device corresponding to the vehicle parking and searching, and to turn off other image acquisition devices except the fifth image acquisition device. power supply;

   When the set driving state is that the vehicle is stationary, the vehicle power supply is controlled to turn off the power supply of all image collection devices.
7. The method according to any one of claims 1-6, further comprising:

   Perform fault detection on each image collection equipment in the powered-on state, and when there is a faulty image collection equipment, control the vehicle power supply to shut off the power supply to the faulty image collection equipment;

   The method also includes:

   For each image collection device in the power-on state, the collected image data signals are received through the corresponding signal transmission channel, and the corresponding image information is displayed through the image player;

   When monitoring that the image acquisition device is in a shutdown state, close the corresponding signal transmission channel for the transmission of image data signals;

   Before obtaining the driving behavior data of the vehicle, it also includes:

   When it is detected that the vehicle starts to be powered on, the vehicle power supply is controlled to supply power to each of the image collection devices.
8. The method according to any one of claims 1-6, further comprising:

   If a bad image data signal transmitted by any turned-off image acquisition device in a power-off state is received, the bad image data signal is ignored;

   Correspondingly, the method also includes:

   If the resource usage corresponding to the processing of each received image data signal is greater than or equal to at least one set threshold, any target secondary image acquisition device is selected from the turned on secondary image acquisition devices and turned off. Powering on the target secondary image acquisition device.
9. A control device for image acquisition equipment, including:

   The acquisition module is used to obtain the driving behavior data of the vehicle;

   A determination module, configured to determine the current driving intention of the vehicle based on the driving behavior data;

   The power control module is used to control the vehicle power supply to switch on and off the power supply of the image collection device associated with the current driving intention to control the start and stop of the corresponding image collection device if the current driving intention satisfies the image collection device control conditions.
10. A vehicle including:

    Car Power;

    At least one image collection device, each image collection device is connected to the vehicle power supply according to the set connection method;

    Also includes:

    one or more controllers;

    A memory communicatively connected to the at least one controller; wherein,

    The memory stores a computer program executable by the at least one controller, and the computer program is executed by the at least one controller to enable the at least one controller to perform the method of claims 1-8.
11. A computer-readable storage medium on which a computer program is stored. When the program is executed by a controller, the method according to any one of claims 1-8 is implemented.

Images