CN115471811A

CN115471811A - Information acquisition method and device, electronic equipment, storage medium and vehicle

Info

Publication number: CN115471811A
Application number: CN202210822093.0A
Authority: CN
Inventors: 李邵荀
Original assignee: Beijing Co Wheels Technology Co Ltd
Current assignee: Beijing Co Wheels Technology Co Ltd
Priority date: 2022-04-14
Filing date: 2022-07-13
Publication date: 2022-12-13

Abstract

The present disclosure relates to the field of automobile driving technologies, and in particular, to an information acquisition method and apparatus, an electronic device, a storage medium, and an automobile. The information acquisition method comprises the following steps: acquiring a first image set transmitted by an advanced driving assistance system; acquiring a second image set acquired by the all-round-looking camera system; acquiring vehicle driving information; and performing image processing on the first image set, the second image set and the vehicle driving information based on the first timestamp information to generate driving video information. By adopting the method and the device, the cost can be reduced while more vehicle driving information is acquired, and the use experience of a user can be improved.

Description

Information acquisition method and device, electronic equipment, storage medium and vehicle

Cross-referencing of related files

The present disclosure is based on and claims priority from chinese patent application No. 202210395076.3, bearing the application date of 2022, 4-month, 14-month, the entire contents of which are incorporated herein by reference.

Technical Field

The present disclosure relates to the field of vehicle driving technologies, and in particular, to an information obtaining method and apparatus, an electronic device, a storage medium, and a vehicle.

Background

With the development of scientific technology, vehicles are developing more and more rapidly, and the requirements of people on the vehicles are increasing day by day. For example, the vehicle may collect external image information while driving through a tachograph. However, in the related art, the driving recorder needs to use an independent Electronic Control Unit (ECU) and an independent camera to acquire and record image information during driving. If the driving information in multiple directions needs to be acquired, multiple independent cameras need to be arranged in the multiple directions. Therefore, when the vehicle driving information is acquired, the required cost is high, and the use experience of a user is influenced.

Disclosure of Invention

The disclosure provides an information acquisition method and device, electronic equipment, a storage medium and a vehicle, and mainly aims to reduce cost while acquiring more vehicle driving information.

According to an aspect of the present disclosure, there is provided an information acquisition method including:

acquiring a first image set transmitted by an advanced driving assistance system, wherein the first image set is an external image set acquired by the advanced driving assistance system;

acquiring a second image set acquired by a panoramic camera system, wherein the second image set is an outside vehicle image set acquired by the panoramic camera system and the visual angle of which is different from that of the first image set;

acquiring vehicle driving information;

and based on the first timestamp information, performing image processing on the first image set, the second image set and the vehicle driving information to generate driving video information.

Optionally, the performing image processing on the first image set, the second image set, and the vehicle driving information based on the first timestamp information to generate driving video information includes:

performing image correction on a target second image in the second image set to obtain a corrected second image set, wherein the target second image is a second image of which the image quality does not meet a preset quality evaluation condition;

and performing image processing on the first image set, the processed second image set and the vehicle driving information based on first timestamp information to generate driving video information.

Optionally, the image processing is performed on the first image set, the second image set and the vehicle driving information based on the first timestamp information, so as to generate driving video information, and the image processing includes:

carrying out format conversion processing on the first image set in the first image format to obtain a first image set in a second image format;

carrying out format conversion processing on the second image set in a third image format to obtain a second image set in the second image format;

based on first timestamp information, performing watermark superposition processing on the first image set in the second image format, the second image set in the second image format and the vehicle driving information to obtain driving video information;

and carrying out coding and packaging processing on the driving video information to generate processed driving video information.

Optionally, the acquiring the first image set transmitted by the advanced driving assistance system includes:

acquiring state information transmitted by the advanced driving assistance system;

and if the state information indicates that the advanced driving assistance system is in a working state, acquiring a first image set transmitted by the advanced driving assistance system.

Optionally, the method further includes:

obtaining status information of at least one vehicle component;

adding the state information of the at least one vehicle component to the driving video information based on second timestamp information corresponding to the state information to obtain added driving video information;

and storing the added driving video information into an external memory.

According to another aspect of the present disclosure, there is provided an information acquisition method for an advanced driving assistance system, including:

controlling any camera to acquire a third image set, wherein the third image set is an external image set;

performing image preprocessing on at least one third image in the third image set to obtain a first image set;

and sending the first image set to a vehicle-mounted machine system so that the vehicle-mounted machine system performs image processing on the first image set, a second image set and vehicle driving information based on first timestamp information to generate driving video information, wherein the second image set is a vehicle-mounted image set of which the view angle acquired by the panoramic camera system is different from that of the first image set.

Optionally, the sending the third image set to the vehicle-mounted device system includes:

carrying out format conversion processing on the third image set to obtain a format-converted third image set;

transmitting the format-converted third image set to the vehicle-mounted computer system;

or alternatively

And transmitting the third image set to the car machine system through a bypass module.

According to another aspect of the present disclosure, there is provided an information acquisition apparatus including:

the system comprises a set acquisition unit, a first image acquisition unit and a second image acquisition unit, wherein the set acquisition unit is used for acquiring a first image set transmitted by an advanced driving assistance system, and the first image set is an automobile exterior image set acquired by the advanced driving assistance system;

the set acquisition unit is further used for acquiring a second image set acquired by a panoramic camera system, wherein the second image set is an outside vehicle image set acquired by the panoramic camera system and has a different visual angle from the first image set;

the information acquisition unit is used for acquiring vehicle running information;

and the information storage unit is used for carrying out image processing on the first image set, the second image set and the vehicle driving information based on first timestamp information to generate driving video information.

Optionally, the information storage unit includes an image processing subunit and an information storage subunit, and the information storage unit is configured to perform image processing on the first image set, the second image set, and the vehicle driving information based on first timestamp information, and when the driving video information is generated:

the image processing subunit is configured to perform image processing on at least one second image in the second image set to obtain a processed second image set;

and the video acquiring subunit is configured to perform image processing on the first image set, the processed second image set, and the vehicle driving information based on first timestamp information, so as to generate driving video information.

Optionally, the first image set is an image set obtained by performing image preprocessing on at least one third image in a third image set by the advanced driving assistance system.

Optionally, the information storage unit includes a format conversion subunit, a watermark superposition subunit, and an encoding and packaging subunit, and the information storage unit is configured to perform image processing on the first image set, the second image set, and the vehicle driving information based on first timestamp information, and when driving video information is generated:

the format conversion unit is used for carrying out format conversion processing on the first image set in the first image format to obtain a first image set in a second image format;

the format conversion unit is further configured to perform format conversion processing on the second image set in a third image format to obtain a second image set in the second image format;

the watermark superposition subunit is configured to perform watermark superposition processing on the first image set in the second image format, the second image set in the second image format, and the vehicle driving information based on first timestamp information to obtain driving video information;

and the coding and packaging subunit is used for coding and packaging the driving video information to generate the processed driving video information.

Optionally, the set acquiring unit includes a state acquiring subunit and a set acquiring subunit, and when acquiring the first image set transmitted by the advanced driving assistance system, the set acquiring unit is configured to:

the state acquisition subunit is used for acquiring the state information transmitted by the advanced driving assistance system;

the set acquiring subunit is configured to acquire the first image set transmitted by the advanced driving assistance system if the state information indicates that the advanced driving assistance system is in an operating state.

Optionally, the apparatus further comprises:

a state acquisition unit for acquiring state information of at least one vehicle component;

the information adding unit is used for adding the state information of the at least one vehicle component to the driving video information based on second timestamp information corresponding to the state information to obtain the added driving video information;

and the external storage unit is used for storing the added driving video information into an external memory.

the image acquisition unit is used for controlling any camera to acquire a third image set, and the third image set is an external image set;

the image preprocessing unit is used for performing image preprocessing on at least one third image in the third image set to obtain a first image set;

and the set sending unit is used for sending the first image set to a vehicle-mounted machine system so that the vehicle-mounted machine system performs image processing on the first image set, a second image set and vehicle driving information based on first timestamp information to generate driving video information, wherein the second image set is a vehicle-mounted image set which is acquired by a panoramic camera system and has a different visual angle from that of the first image set.

Optionally, the set sending unit is configured to, when sending the first image set to the car-mounted device system, specifically:

carrying out format conversion processing on the first image set to obtain a format-converted first image set;

transmitting the format-converted first image set to the vehicle-mounted machine system;

or

And transmitting the first image set to the car machine system through a bypass module.

Optionally, the set sending unit is configured to, when sending the third image set to the car-mounted device system, specifically:

and sending the first image set to a vehicle-mounted machine system so that the vehicle-mounted machine system performs image processing on the first image set, the second image set and the vehicle driving information based on first timestamp information to generate driving video information.

According to another aspect of the present disclosure, an information acquisition system is provided, which includes the in-vehicle machine system of the foregoing aspect, the advanced driving assistance system of the foregoing aspect, and the around-looking camera system.

According to another aspect of the present disclosure, there is provided an electronic device including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the preceding aspects.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of the preceding aspects.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method of any one of the preceding aspects.

According to another aspect of the present disclosure, an automobile is provided, which includes the information acquisition apparatus according to any one of the preceding aspects, or the electronic device according to any one of the preceding aspects.

In one or more embodiments of the present disclosure, a first image set transmitted by the advanced driving assistance system is obtained, where the first image set is a set of images outside a vehicle collected by the advanced driving assistance system, a second image set collected by the all-around camera system is obtained, and the second image set is a set of images outside the vehicle, where a viewing angle collected by the all-around camera system is different from that of the first image set, vehicle driving information is obtained, and based on the first timestamp information, the first image set, the second image set, and the vehicle driving information are subjected to image processing to generate driving video information. Therefore, the cameras in the advanced driving assistance system and the all-round looking camera system can be multiplexed to acquire the image sets transmitted by the advanced driving assistance system and the all-round looking camera system, an independent electronic control unit and the independent cameras are not needed to acquire and record video information during driving, more vehicle driving information can be acquired, and meanwhile, the cost is reduced.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 is a background schematic diagram illustrating an information acquisition method provided in an embodiment of the present disclosure;

fig. 2 is a system architecture diagram illustrating an information acquisition method provided by an embodiment of the present disclosure;

fig. 3 is a schematic flowchart illustrating a first information obtaining method provided by an embodiment of the present disclosure;

fig. 4 is a schematic flowchart illustrating a second information obtaining method provided by an embodiment of the present disclosure;

fig. 5 is a schematic flowchart illustrating a third information obtaining method provided by the embodiment of the present disclosure;

fig. 6 is a schematic flowchart illustrating a fourth information obtaining method provided in the embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of a first information acquisition apparatus provided in an embodiment of the present disclosure;

fig. 8 is a schematic structural diagram of a second information acquisition apparatus provided in an embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of a third information acquisition device provided in an embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of a fourth information acquisition apparatus provided in the embodiment of the present disclosure;

fig. 11 is a schematic structural diagram of a fifth information acquisition device provided in an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of a sixth information acquisition device provided in an embodiment of the present disclosure;

fig. 13 is a schematic structural diagram illustrating an information acquisition system according to an embodiment of the present disclosure;

fig. 14 is a block diagram of an electronic device for implementing an information acquisition method according to an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

With the development of science and technology, the living standard of people is continuously improved, the proportion of vehicles owned by individuals is continuously increased, and the vehicles become more and more popular household goods. However, in the related art, the cost required for recording the vehicle driving information is high.

According to some embodiments, fig. 1 illustrates a background diagram of an information acquisition method provided by an embodiment of the present disclosure. As shown in fig. 1, when the driving information of the vehicle is obtained through the driving recorder, the vehicle may obtain video information during driving through a front-view camera arranged in the driving recorder, and transmit and store the video information in an independent Electronic Control Unit (ECU) arranged in the driving recorder, and when the driving information of multiple directions is obtained, multiple independent cameras need to be arranged in multiple directions, and then the vehicle may transmit the video information collected by the multiple cameras to the vehicle-mounted device system for the driver to check.

In some embodiments, fig. 2 illustrates a system architecture diagram of an information acquisition method provided by an embodiment of the present disclosure. As shown in fig. 2, when the driver needs to view video information while driving, the driver can send a viewing instruction to the vehicle 13 through the network 12 using the terminal 11. When the vehicle 13 receives a viewing instruction for video information during driving, the vehicle 13 may send the video information stored in the drive recorder to the in-vehicle system for viewing by the driver.

It is easy to understand that the video information stored in the electronic control unit only contains the video information acquired by the forward-looking camera arranged in the automobile data recorder, so that the video information provided for the driver to view contains less vehicle driving information. If a plurality of cameras are provided to provide more vehicle driving information, higher cost is generated.

The present disclosure is described in detail below with reference to specific examples.

In a first embodiment, as shown in fig. 3, fig. 3 is a schematic flow chart of a first information acquisition method provided by the embodiment of the present disclosure, which may be implemented by relying on a computer program and may be run on a device for information acquisition. The computer program may be integrated into the application or may run as a separate tool-like application.

The information acquiring device may be a Head Unit (HU) having an information acquiring function.

Specifically, the information acquisition method includes:

s101, acquiring a first image set transmitted by an advanced driving assistance system;

according to some embodiments, an Advanced driver-assistance systems (ADAS) refers to a system that senses the surrounding environment during the driving of an automobile by using various sensors, millimeter-wave radars, laser radars, monocular/binocular cameras, satellite navigation, and the like mounted on the automobile, collects data, identifies, detects, and tracks static and dynamic objects, and performs operation and analysis of the system in combination with navigation map data, thereby allowing drivers to detect possible dangers in advance and effectively increasing the comfort and safety of automobile driving. The advanced driving assistance system is not particularly specified to a certain fixed system. For example, the advanced driving assistance system may be changed when a car is changed. The advanced driving assistance system may also change when the vehicle acquires system modification instructions for the advanced driving assistance system.

According to some embodiments, the vehicle includes, but is not limited to, a truck, a tractor-trailer, a passenger vehicle, a passenger car, and the like, wherein the truck includes, but is not limited to, a light truck, a minivan, a medium truck, and a heavy truck, and the passenger vehicle includes, but is not limited to, a minibus, a light bus, a heavy bus, a large bus, and the like.

According to some embodiments, the first image set is a set of off-board images captured by the advanced driving assistance system, for example, the first image may be an image captured by the advanced driving assistance system through any camera, preferably an image corresponding to a driving perspective captured by a forward-looking camera. The first image does not refer to a fixed image. For example, the first image may change when the driving perspective changes. When the front-looking camera changes, the first image may also change.

In some embodiments, the first set of images refers to a set of at least one first image aggregated. The first set of images does not refer specifically to a fixed set. For example, when a first image changes, the first set of images may change. When the car changes, the first set of images may also change.

In some embodiments, a forward looking camera refers to a vehicle-mounted camera mounted in front of the vehicle. The forward looking camera may be an integral part of an advanced driving assistance system. The front-view camera is not specific to a fixed camera. For example, the forward looking camera may change when the vehicle changes. The forward looking camera may also change when advanced driving assistance systems change.

In some embodiments, the driving perspective refers to the perspective of the driver while driving the vehicle. The driving angle is not particularly limited to a fixed angle. For example, the driving perspective may change when the driver changes. When the automobile changes, the driving visual angle can also change.

It is readily understood that when the in-vehicle system performs the information acquisition, the in-vehicle system may acquire the first set of images transmitted by the advanced driving assistance system.

S102, acquiring a second image set acquired by the all-round-looking camera system;

according to some embodiments, the all-round camera system refers to a system for collecting images corresponding to other visual angles except a driving visual angle through at least one camera. The panoramic camera system is not particularly limited to a certain fixed system. The cameras adopted when the all-round camera system collects images include but are not limited to a left-view camera, a right-view camera, a rear-view camera and the like.

According to some embodiments, the second set of images is a set of off-board images acquired by the surround view camera system from a different perspective than the first set of images. When the first image is an image corresponding to a driving view angle acquired by the advanced driving assistance system through the front-view camera, the second image may be an image corresponding to a view angle other than the driving view angle. The second image does not refer to a fixed image. For example, the second image may change when the car changes. When the panoramic camera system changes, the second image may also change.

In some embodiments, the second set of images refers to a set of at least one second image aggregated. The second set of images does not refer specifically to a fixed set. For example, when the second image changes, the second set of images may change. The second set of images may also change when the surround camera system changes.

It is easy to understand that, when the in-vehicle system performs information acquisition, the in-vehicle system may acquire the second image set acquired by the all-round camera system.

S103, acquiring vehicle running information;

according to some embodiments, the vehicle driving information refers to information generated by the vehicle during driving. The vehicle driving information does not refer to a fixed information. The vehicle driving information includes, but is not limited to, vehicle speed, temperature, wheel speed, engine torque, throttle, brake pedal, gear lever position, and the like.

It is easy to understand that, when the vehicle-mounted machine system obtains information, the vehicle-mounted machine system can obtain vehicle driving information.

And S104, performing image processing on the first image set, the second image set and the vehicle driving information based on the first timestamp information to generate driving video information.

According to some embodiments, the first timestamp information comprises image capture timestamp information corresponding to the first set of images, image capture timestamp information corresponding to the second set of images, and information acquisition timestamp information corresponding to vehicle driving information. The first time stamp information does not refer to a certain fixed time stamp information. For example, the first timestamp information may be 8 a.m.: 00, the first timestamp information may also be 3:00. the first timestamp information may be 8 a.m.: 00, for example, the image capturing timestamp information corresponding to the first image set may be 8 a.m.: 00. the image acquisition timestamp information corresponding to the second image set is 8 a.m.: 00, obtaining information of the information acquisition timestamp corresponding to the vehicle driving information is 8 in the morning: 00.

in some embodiments, image processing (image processing) refers to a technique for analyzing an image with a computer to achieve a desired result. Also known as image processing. Image processing generally refers to digital image processing. Digital images are large two-dimensional arrays of elements called pixels and values called gray-scale values, which are captured by industrial cameras, video cameras, scanners, etc. The image processing includes, but is not limited to, image stitching, image fusion, and the like.

In some embodiments, the driving video information refers to video information provided by the vehicle machine system to the driver for viewing. The driving video information does not refer to a fixed information. For example, the driving video information may change when the first set of images changes. When the second image set changes, the driving video information can also change.

It is easy to understand that when the in-vehicle system acquires the first image set, the second image set and the vehicle driving information, the in-vehicle system may perform image processing on the first image set, the second image set and the vehicle driving information based on the first timestamp information to generate the driving video information.

In one or more embodiments of the present disclosure, a first image set transmitted by the advanced driving assistance system is obtained, where the first image set is an external image set collected by the advanced driving assistance system, a second image set collected by the all-round camera system is obtained, and the second image set is an external image set collected by the all-round camera system with a different visual angle from that of the first image set, so as to obtain vehicle driving information, and based on the first timestamp information, the first image set, the second image set, and the vehicle driving information are subjected to image processing, so as to generate driving video information. Therefore, the cameras in the advanced driving assistance system and the all-round looking camera system can be multiplexed to acquire the image sets transmitted by the advanced driving assistance system and the all-round looking camera system, an independent electronic control unit and the independent cameras are not needed to acquire and record video information during driving, more vehicle driving information can be acquired, and meanwhile, the cost is reduced.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a second information obtaining method according to an embodiment of the present disclosure. Specifically, the information acquisition method includes:

s201, acquiring a first image set transmitted by an advanced driving assistance system;

the specific process is as above, and is not described herein again.

In some embodiments, the execution subject of the embodiments of the present disclosure may be, for example, a car machine system. The vehicle-mounted machine system refers to a program system for managing and controlling vehicle-mounted hardware and vehicle-mounted software resources. The functions that the car machine System can realize include but are not limited to Global Positioning System (GPS) navigation function, multimedia entertainment function, communication function, and the like. The car machine system does not refer to a certain fixing system. For example, the car machine system may be a system that uses a single-core ARM as a processor and matches an android operating system or a distributed real-time operating system. The car machine system also can comprise a plurality of processors and can simultaneously run two operating systems, namely a distributed real-time operating system and an android operating system.

According to some embodiments, when the in-vehicle system acquires information, the automobile data recorder needs to set an image acquired by the front-view camera to make a video recorded during driving, and transmit the recorded video to the in-vehicle system. Meanwhile, the advanced driving assistance system needs to set an image collected by a forward-looking camera to sense the surrounding environment. Therefore, the vehicle-mounted system can directly transmit the images acquired by the advanced driving assistance system through the front-view camera to the vehicle-mounted system, so that the calculation force can be reduced, and the number of the front-view cameras can be reduced.

It is readily understood that when the in-vehicle system performs the information acquisition, the in-vehicle system may acquire the first set of images transmitted by the advanced driving assistance system. The first image set is an image set obtained by performing image preprocessing on at least one third image in the third image set by the advanced driving assistance system.

According to some embodiments, the advanced driver assistance system may, for example, perform a string operation on the first image set through the string adder to obtain a first image set after the string operation, and transmit the first image set after the string operation to the vehicle-mounted device system. When the in-vehicle system acquires the strung first image set, the in-vehicle system can perform deserialization on the strung first image set through the deserializer to obtain the first image set. The video output streams supported by different chips in the advanced assistant driving system are different, namely the formats of the first image sets are different, so that the configuration information corresponding to the advanced assistant driving system can be acquired when the vehicle-mounted computer system is initialized. The in-vehicle system can obtain a format corresponding to the strung first image set based on the configuration information, and the in-vehicle system can adjust an image input format of the deserializer, so that the in-vehicle system can receive the strung first image set and perform deserializing processing on the strung first image set. Therefore, the vehicle-mounted computer system has a compatible function, the convenience of processing the first image set is improved, and the situation that the first image set cannot be deserialized is reduced.

S202, acquiring a second image set acquired by the all-round-looking camera system;

the specific process is as above, and is not described herein again.

According to some embodiments, when the surround-view camera system collects a second image set corresponding to other visual angles except the driving visual angle through at least one camera, the camera can generate image information corresponding to other visual angles except the driving visual angle into an optical image through the lens and project the optical image to the surface of the image sensor. The image sensor may then convert the optical image into an electrical signal, which is then converted into a digital image signal via analog-to-digital conversion and sent to a digital signal processing chip for processing. And finally, generating the processed digital image signal to a panoramic camera system.

It is easy to understand that, when the in-vehicle system acquires information, the in-vehicle system can acquire the second image set acquired by the panoramic camera system.

S203, acquiring vehicle running information;

the specific process is as above, and is not described herein again.

According to some embodiments, the vehicle-mounted machine system may acquire vehicle driving information through a bus. A bus refers to a common line or path in a computer used to connect and transfer data between various functional units. Including but not limited to an on-chip bus, an internal bus, an external bus, etc. Including but not limited to some fixed bus. For example, the bus may change when the vehicle system changes.

According to some embodiments, when the vehicle-mounted device system performs information acquisition, the vehicle-mounted device system may acquire vehicle driving information through the advanced driving assistance system. Furthermore, the advanced driving assistance system can transmit the vehicle driving information to the vehicle-mounted machine system by using the gateway through the bus.

According to some embodiments, when the in-vehicle system performs information acquisition, the in-vehicle system may acquire vehicle driving information through a Controller Area Network (CAN) bus, a Local Interconnect Network (LIN) bus, a FlexRay bus, a MOST bus, or other types of buses.

In some embodiments, the CAN bus, also referred to as an automotive bus, is a serial communication network that CAN efficiently support distributed control and real-time control. It is possible to connect the individual control units in some form, for example star-shaped, to form a complete system. The vehicle-mounted machine system CAN realize the data communication of the vehicle internal control system through the CAN bus. For example, the vehicle-mounted system CAN acquire the state information of components such as an air conditioner, electronic indication, fault detection and the like through the CAN bus.

In some embodiments, the LIN bus refers to a low-cost serial communication network defined for an automotive distributed electronic system, is a supplement to other buses such as a CAN bus, and CAN be used for an automotive distributed electronic control system, namely, a digital communication occasion facing an intelligent sensor or an actuator. For example, the vehicle system may obtain status information of components such as headlights, locks, power seats, etc. of the vehicle through the LIN bus.

In some embodiments, the FlexRay bus is a high-speed, deterministic, fault tolerant bus for automotive applications. The FlexRay bus can combine an event trigger mode and a time trigger mode, and has the characteristics of high-efficiency network utilization rate and system flexibility. The vehicle machine system can apply the FlexRay bus to a line control system and a power system with safe affairs. For example, the vehicle machine system can acquire the state information of components such as an engine, a steering system, an anti-lock brake system (ABS) and the like through a FlexRay bus.

In some embodiments, the MOST bus is a data bus developed specifically for in-vehicle use, serving multimedia applications. By adopting the MOST bus, the quality of a wire harness for connecting each part can be reduced, the noise can be reduced, the burden of system development technicians can be reduced, and finally, the centralized control of various devices can be realized at a user. For example, the car machine system can acquire the state information of the microphone, the sound box and other components through the MOST bus.

It is easy to understand that, when the vehicle-mounted machine system performs information acquisition, the vehicle-mounted machine system may acquire vehicle driving information through the bus.

S204, carrying out image correction on a target second image in the second image set to obtain a corrected second image set;

the specific process is as above, and is not described herein again.

According to some embodiments, the second image refers to an image included in the second set of images. The target second image is a second image whose image quality does not meet the preset quality evaluation condition, and the number of images corresponding to the target second image does not refer to a certain fixed number.

According to some embodiments, the quality evaluation condition may be a condition for evaluating whether the quality of the image satisfies the user's demand, which is set in advance as needed. For example, the quality evaluation condition may include that the degree of distortion of the image is less than or equal to a specified degree, and may also include that the degree of white balance of the image falls within a specified white balance threshold.

According to some embodiments, when the in-vehicle system determines that the target second image exists in the second image set, image correction corresponding to the quality evaluation condition that is not satisfied by the target second image needs to be performed on the target second image. If the unsatisfactory quality evaluation condition of the target second image is that the distortion degree of the image is less than or equal to the specified degree, performing distortion processing on the target second image; and if the quality evaluation condition that the target second image does not satisfy is that the white balance degree of the image falls into a specified white balance threshold, performing white balance processing on the target second image so that all the second images in the corrected second image set satisfy the quality evaluation condition.

As will be readily understood, the vehicle-mounted system may perform modification processing on at least one target second image in the second image set through the control chip SOC.

S205, based on the first timestamp information, performing image processing on the first image set, the corrected second image set and the vehicle driving information to generate driving video information;

the specific process is as above, and is not described herein again.

According to some embodiments, when the first image set is a format-converted image set, the in-vehicle system acquires the first image set and the processed second image set, and the in-vehicle system may perform deserialization on the first image set and the processed second image set to obtain the first image set and the second image set.

In some embodiments, deserialization refers to the process of converting a formatted image to an unprocessed image. The deserializing process is not specific to a fixed process. For example, the deserialization process may change when the number of images of the first set of images changes. When the image content of the first image set changes, the deserialization process may also change.

According to some embodiments, when the in-vehicle system performs image processing on the first image set, the processed second image set and the vehicle driving information based on the first timestamp information, the image processing manner includes, but is not limited to, image stitching and image fusion.

In some embodiments, image stitching refers to a technique of stitching several overlapping images (possibly obtained at different times, different perspectives, or different sensors) of the same time stamp information into a seamless panorama or high resolution image.

In some embodiments, image fusion refers to a technology of subjecting image data about the same target collected by multiple source channels of the same timestamp information to image processing, computer technology and the like, extracting favorable information in respective channels to the maximum extent, and finally integrating the favorable information into a high-quality image.

For example, when the first timestamp information is, for example, 8 a.m.: 00 hours, the car machine system can acquire the image acquisition timestamp information as 8 in the morning: 00, the first image set A1 and the image acquisition timestamp information are 8 in the morning: the processed second image set A2 and information acquisition timestamp information of 00 is 8 a.m.: 00, vehicle driving information A3. Furthermore, the vehicle may perform image stitching based on the first image set A1, the processed second image set A2, and the vehicle driving information A3, to obtain 8 a: 00, driving video information a.

For example, when the first timestamp information is 5 pm: when 00 hours, the car machine system can acquire image acquisition timestamp information as 5 in the afternoon: 00, the first image set B1 and the image acquisition timestamp information are 5:00 the processed second image set B2 and the information acquisition timestamp information are 5:00, and vehicle driving information B3. Furthermore, the vehicle may perform image fusion based on the first image set B1, the processed second image set B2, and the vehicle driving information B3, to obtain 5 pm: 00, and driving video information B.

It is easy to understand that, when the in-vehicle system acquires the first image set, the processed second image set and the vehicle driving information, the in-vehicle system may perform image processing on the first image set, the processed second image set and the vehicle driving information to generate driving video information.

S206, acquiring state information of at least one vehicle component;

according to some embodiments, a vehicle component refers to a combination of parts for performing any function of an automobile. Such components include, but are not limited to, a microphone, a turn signal, a low beam, a fog light, a throttle, a brake, a safety belt, etc.

In some embodiments, the status information refers to status information corresponding to components in the vehicle. The state information does not refer to a fixed state information. For example, the status information corresponding to the turn signal may be on. The state information corresponding to the microphone may be off.

According to some embodiments, the in-vehicle system may obtain status information of at least one vehicle component via the bus. Specifically, the vehicle-mounted machine system can acquire the state information of at least one vehicle component in the vehicle through the advanced driving assistance system. The advanced driver assistance system may then transmit the status information of the at least one vehicle component in the vehicle to the in-vehicle system via the bus using the gateway.

It is easy to understand that when the in-vehicle system acquires the driving video information, the in-vehicle system may acquire the state information of at least one vehicle component.

S207, adding the state information of at least one vehicle component to the driving video information based on the second timestamp information corresponding to the state information to obtain the added driving video information;

according to some embodiments, the second time stamp information refers to time stamp information corresponding to the status information of the vehicle component. The second time stamp information does not refer to a fixed information. The second time stamp information may be time period information, and the second time stamp information may also be time point information. For example, when the status information corresponding to the turn signal is on, the second timestamp information corresponding to the status information may be 8 a.m.: 00-8 in the morning: 30. for example, when the state information corresponding to the brake is off, the second timestamp information corresponding to the state information may be 9 a.m.: 00.

in some embodiments, when the in-vehicle system acquires the state information of the at least one vehicle component, the in-vehicle system may add the state information of the at least one vehicle component to the driving video information corresponding to the second timestamp information in a form of text based on the second timestamp information corresponding to the state information, so as to obtain the added driving video information.

In some embodiments, the added driving video information refers to driving video information obtained by adding state information of at least one vehicle component to the driving video information. The added driving video information does not refer to a fixed information. For example, when a vehicle component changes, the added driving video information may change. When the state information changes, the added driving video information can also change.

It is easy to understand that, when the in-vehicle system acquires the state information of the at least one vehicle component, the in-vehicle system may add the state information of the at least one vehicle component to the driving video information based on the second timestamp information corresponding to the state information, so as to obtain the added driving video information. For example, the information acquisition time stamp may be set to 8 a.m. based on the second time stamp information: 00 to 8 am: 00 in driving video information.

And S208, storing the added driving video information into an external memory.

According to some embodiments, when the in-vehicle system stores the added driving video information, the in-vehicle system may store the added driving video information into the external memory. Therefore, the occupied space of the internal storage of the car machine system can be reduced, the situation that the storage life of the car machine system is shortened due to repeated writing and erasing of files can be reduced, and the service life of the car machine system can be prolonged.

In some embodiments, external memory refers to storage other than storage internal to the in-vehicle system. The external memory is not specific to a fixed memory. Including but not limited to hard disks, floppy disks, optical disks, usb disks, and the like.

It is easy to understand that, when the vehicle-mounted device system acquires the added driving video information, the vehicle-mounted device system can store the added driving video information into the external memory.

In the embodiment of the disclosure, first, the first image set transmitted by the advanced driving assistance system is acquired, and the second image set acquired by the all-round camera system is acquired, so that the cameras in the advanced driving assistance system and the all-round camera system can be multiplexed to acquire the image sets transmitted by the advanced driving assistance system and the all-round camera system, video information during driving can be acquired and recorded without using an independent electronic control unit and a camera, and cost can be reduced while acquiring more vehicle driving information. Then, the vehicle driving information is acquired, at least one second image in the second image set is subjected to image processing to obtain a processed second image set, and the first image set, the processed second image set and the vehicle driving information are subjected to image processing based on the first timestamp information to generate driving video information. Finally, the state information of at least one vehicle component is added to the driving video information based on the second timestamp information corresponding to the state information by acquiring the state information of at least one vehicle component, the added driving video information is obtained, and the added driving video information is stored in the external memory.

Referring to fig. 5, fig. 5 is a schematic flow chart diagram illustrating a third information obtaining method according to an embodiment of the present disclosure. Specifically, the information acquisition method includes:

s301, acquiring state information transmitted by the advanced driving assistance system;

according to some embodiments, the state information transmitted by the advanced driving assistance system refers to information indicating a state in which the advanced driving assistance system is located. The state information does not refer to a fixed information. For example, the status information may indicate that the advanced driving assistance system is in an active state. The status information may also indicate that the advanced driving assistance system is in a failed state. The status information may indicate that the advanced driving assistance system is in an initialized state.

In some embodiments, when the advanced driving assistance system ends the initialization state and enters the working state, for example, the duration of the initialization state may be lower than a preset initial duration, the in-vehicle system may acquire the state information transmitted by the advanced driving assistance system and indicate that the advanced driving assistance system is in the working state.

In some embodiments, when the advanced driving assistance system is in the initialization state for a time period not longer than a preset initial time period, the state information may be sent to the vehicle-mounted machine system when the advanced driving assistance system detects a fault. The vehicle-mounted machine system can acquire the state information transmitted by the advanced driving assistance system. Wherein the status information is used to indicate that the advanced driving assistance system is in a failure state.

In some embodiments, the preset initial duration refers to a duration that the in-vehicle system employs to acquire state information of the advanced driving assistance system. The preset initial time is not particularly limited to a certain fixed time. For example, when a duration modification instruction for a preset initial duration is acquired, the preset initial duration may be changed.

It is easy to understand that when the in-vehicle system performs information acquisition, the in-vehicle system can acquire the state information transmitted by the advanced driving assistance system.

S302, if the state information indicates that the advanced driving assistance system is in a working state, acquiring a first image set transmitted by the advanced driving assistance system;

it is easy to understand that, when the in-vehicle system acquires the state information transmitted by the advanced driving assistance system, if the in-vehicle system determines that the state information indicates that the advanced driving assistance system is in the working state, the in-vehicle system may acquire the first image set transmitted by the advanced driving assistance system.

S303, acquiring a second image set acquired by the all-round camera system;

the specific process is as above, and is not described herein again.

S304, obtaining vehicle driving information;

the specific process is as above, and is not described herein again.

S305, carrying out format conversion processing on the first image set in the first image format to obtain a first image set in a second image format;

according to some embodiments, the image format refers to a package format of the image. The image formats include, but are not limited to, moving Picture Experts Group (MPEG), audio Video Interleaved (AVI), advanced Streaming Format (ASF), streaming Media Format (Windows Media Video, WMV), video Streaming Media Format (Flash Video, FLV), and the like.

In some embodiments, the first image format refers to an image format corresponding to the first set of images transmitted by the advanced driving assistance system. The first image format does not refer to a fixed format. For example, when the advanced driving assistance system is changed, the first image format may be changed.

In some embodiments, the second image format refers to an image format corresponding to the first image set after the first image set format is converted. The second image format is different from the first image format. The second image format does not refer to a fixed format. For example, when a format modification instruction for the second image format is acquired, the second image format may be changed.

In some embodiments, when the in-vehicle system determines that the image format corresponding to the first image set transmitted by the advanced driving assistance system is the second image format, the in-vehicle system does not need to perform format conversion processing on the first image set in the second image format.

It is easy to understand that, when the in-vehicle system acquires the first image set transmitted by the advanced driving assistance system, if the in-vehicle system determines that the image format corresponding to the first image set is not the second image format, the in-vehicle system may perform format conversion processing on the first image set in the first image format to obtain the first image set in the second image format.

S306, carrying out format conversion processing on the second image set in the third image format to obtain a second image set in the second image format;

according to some embodiments, the third image format refers to an image format corresponding to the second set of images captured by the panoramic camera system. The third image format does not refer to a fixed format. For example, the third image format may change when the surround view camera system changes.

It is easy to understand that, when the in-vehicle system acquires the second image set acquired by the panoramic camera system, if the in-vehicle system determines that the image format corresponding to the second image set is not the second image format, the in-vehicle system may perform format conversion processing on the second image set in the third image format to obtain the second image set in the second image format.

S307, based on the first timestamp information, performing watermark superposition processing on the first image set in the second image format, the second image set in the second image format and the vehicle driving information to obtain driving video information;

in some embodiments, when the in-vehicle system acquires the first image set in the second image format and the second image set in the second image format, the in-vehicle system may convert at least one image in the first image set and at least one second image in the second image set into the overhead image set by looking up the mapping transformation parameters. Wherein the first image set is a forward-looking aerial image set. The second set of images includes a set of rear-view overhead images, a set of left-view overhead images, and a set of right-view overhead images.

In some embodiments, when the in-vehicle system acquires the front-view overhead image set, the rear-view overhead image set, the left-view overhead image set, and the right-view overhead image set, the in-vehicle system may perform FAST feature point extraction (ORB) on the front-view overhead image set, the rear-view overhead image set, the left-view overhead image set, and the right-view overhead image set, perform coarse matching on the features, and reject mismatching points using a Random Sample Consensus (RANSAC) algorithm. And then fitting an initial value of a homography matrix, refining by using a nonlinear iterative minimum approximation Levenberg-Marquardt method, and generating a 360-degree aerial view panoramic video after image registration, fusion and splicing.

In some embodiments, when the in-vehicle system performs the watermark overlaying processing on the first image set in the second image format, the second image set in the second image format, and the vehicle driving information, the in-vehicle system may overlay the vehicle driving information as a watermark into the first image set in the second image format and the second image set in the second image format based on the first timestamp information.

For example, the in-vehicle system may superimpose the time information, the accelerator information, the brake information, the driving assistance state, the vehicle lights, and other information as watermarks on the panoramic video so as to acquire the driving video information, according to the first image set in the second image format and the second image set in the second image format.

It is easy to understand that when the in-vehicle system acquires the first image set in the second image format, the second image set in the second image format, and the vehicle driving information, the in-vehicle system may perform watermark superposition processing on the first image set in the second image format, the second image set in the second image format, and the vehicle driving information based on the first timestamp information to obtain the driving video information.

And S308, coding and packaging the driving video information to generate the processed driving video information.

According to some embodiments, the encoding encapsulation process refers to video encoding and video encapsulation. Video encoding refers to a process of converting a file of an original video format into a file of another video format by a compression technique. Video encapsulation refers to the process of packaging all relevant information (video, audio, subtitles, media information, etc.) into one file.

In some embodiments, when the in-vehicle system stores the processed driving video information, the in-vehicle system may also store the processed driving video information into the external memory. Therefore, the occupied space of the internal storage of the vehicle machine system can be reduced, the situation that the service life of the internal storage of the vehicle machine system is shortened due to the fact that files are written in and erased for many times can be reduced, and the service life of the vehicle machine system can be prolonged.

It is easy to understand that, when the car machine system acquires the driving video information, the car machine system can perform encoding and packaging processing on the driving video information, and store the processed driving video information.

In the embodiment of the present disclosure, first, by acquiring the state information transmitted by the advanced driving assistance system, if the state information indicates that the advanced driving assistance system is in an operating state, the first image set transmitted by the advanced driving assistance system is acquired, and therefore, the accuracy of acquiring the first image set may be improved. Then, the second image set acquired by the all-round-looking camera system is acquired, so that the cameras in the advanced driving assistance system and the all-round-looking camera system can be multiplexed to acquire the image sets transmitted by the advanced driving assistance system and the all-round-looking camera system, video information during driving can be acquired and recorded without adopting an independent electronic control unit and an independent camera, and cost can be reduced while more vehicle driving information is acquired. Then, vehicle driving information is acquired, format conversion processing is carried out on a first image set in a first image format to obtain a first image set in a second image format, format conversion processing is carried out on a second image set in a third image format to obtain a second image set in a second image format, and watermark superposition processing is carried out on the first image set in the second image format, the second image set in the second image format and the vehicle driving information based on first timestamp information to obtain driving video information, the driving video information is encoded and packaged to generate processed driving video information.

In the technical scheme of the disclosure, the collection, storage, use, processing, transmission, provision, disclosure and other processing of the personal information of the related user are all in accordance with the regulations of related laws and regulations and do not violate the good customs of the public order.

Referring to fig. 6, fig. 6 is a schematic flow chart diagram illustrating a fourth information obtaining method according to an embodiment of the present disclosure. Specifically, the information acquisition method includes:

s401, controlling any camera to collect a third image set;

according to some embodiments, the execution subject of the embodiments of the present disclosure is an advanced driving assistance system. The advanced driving assistance system is a system which utilizes various sensors, millimeter wave radars, laser radars, monocular/binocular cameras, satellite navigation and other components arranged on an automobile to sense surrounding environments in the driving process of the automobile, collects data, identifies, detects and tracks static and dynamic objects, combines navigation map data, and performs systematic operation and analysis, so that drivers can perceive possible dangers in advance, and the comfort and the safety of automobile driving are effectively improved. The advanced driving assistance system is not particularly specified to a certain fixed system. For example, the advanced driving assistance system may be changed when a car is changed. The advanced driving assistance system may also change when the vehicle acquires system modification instructions for the advanced driving assistance system.

In some embodiments, the third set of images is a set of off-board images acquired by an advanced driving assistance system. The third image set does not refer to a fixed set. For example, when the number of images included in the third image set changes, the third image set may also change correspondingly, for example, when the image acquisition time point corresponding to the third image set changes, the third image set may also change correspondingly.

According to some embodiments, a camera refers to any camera provided in an advanced driving assistance system, preferably a forward looking camera.

It is easily understood that when the advanced driving assistance system performs the information acquisition method, the advanced driving assistance system may control the forward-looking camera to acquire the third image set.

S402, performing image preprocessing on at least one third image in the third image set to obtain a first image set;

according to some embodiments, the third image is a frame of image captured by a forward looking camera. The third image set includes at least one third image. When the advanced driving assistance system acquires the third image set, image preprocessing may be performed on at least one third image in the third image set to obtain the first image set.

According to some embodiments, when the advanced driving assistance System performs image preprocessing on at least one third image in the first image set, the advanced driving assistance System may control the advanced driving assistance System to perform image preprocessing on at least one third image in the third image set by controlling a System On Chip (SOC).

In some embodiments, image pre-processing refers to techniques for analyzing images with a computer to achieve a desired result. The image preprocessing does not refer to a fixed processing procedure. The image pre-processing includes, but is not limited to, image enhancement, image restoration, image adjustment tuning, and the like. The image preprocessing is processing performed on an image by the advanced driving support system before transmitting an image set.

In some embodiments, when the vehicle control advanced driving assistance system performs image enhancement on at least one third image in the third image set, the quality of the image can be enhanced by increasing contrast, removing blur and noise, correcting geometric distortion, and the like.

In some embodiments, when the vehicle control advanced driving assistance system performs image restoration on at least one third image in the third image set, the influence of the degradation source can be removed or reduced by establishing a mathematical model of the degradation source and then performing a restoration algorithm. When there is a priori knowledge about the image itself, it is also possible to restore the image by modeling the original image and then detecting the original image in the observed degraded image.

And S403, sending the first image set to the vehicle-mounted device system, so that the vehicle-mounted device system performs image processing on the first image set, the second image set and vehicle driving information based on the first timestamp information, and generating driving video information.

In some embodiments, the advanced driving assistance system may send the first set of images to the on-board vehicle system. When the vehicle-mounted device system acquires the first image set, the second image set acquired by the all-around camera system and the vehicle driving information, the vehicle-mounted device system can perform image processing based on the first image set, the second image set acquired by the all-around camera system and the vehicle driving information to generate driving video information, wherein the second image set is an external image set of which the view angle acquired by the all-around camera system is different from that of the first image set. Therefore, the image quality of the first image set can be improved, the images of the first image set can be directly identified and adopted by the vehicle-mounted machine system, and the reliability of the images identified and adopted by the vehicle-mounted machine system is improved.

According to some embodiments, when the advanced driving assistance system sends the first image set to the vehicle-mounted device system, format conversion processing may be performed on the first image set to obtain a format-converted first image set. Furthermore, the advanced driving assistance system can transmit the first image set after format conversion to the vehicle-mounted computer system, and can improve the transmission rate of transmitting the first image set to the vehicle-mounted computer system.

According to some embodiments, when the advanced driving assistance system sends the first image set to the vehicle-mounted device system, the advanced driving assistance system may perform format conversion processing on the first image set to obtain a format-converted first image set. Furthermore, the advanced driving assistance system can transmit the first image set after format conversion to the vehicle-mounted device system, and can improve the transmission rate of the first image set to the vehicle-mounted device system.

In some embodiments, the format conversion process refers to a process of converting an image signal into a signal that can be quickly transmitted in a bus. The format conversion process is not particularly limited to a fixed process. For example, the format conversion process may change when the first set of images changes. When the advanced driving assistance system is changed, the format conversion process may also be changed.

In some embodiments, when the advanced driving assistance system transmits the format-converted first image set to the in-vehicle system, the advanced driving assistance system may perform a packing process on the format-converted first image set to obtain a packed first image set. The network security device arranged in the advanced driving assistance system can analyze the first image set after the packet processing to judge whether a threat exists, and after the analysis is completed, the first image set after the packet processing is forwarded to the vehicle-mounted device system according to a preset routing rule, so that the transmission security of the first image set can be improved.

In some embodiments, when the advanced driving assistance system transmits the format-converted first image set to the vehicle-mounted device system, if the network security device fails, for example, power failure, crash, or the like, the advanced driving assistance system may transmit the format-converted first image set to the vehicle-mounted device system through the bypass module.

It is easy to understand that the advanced driving assistance system can directly and physically conduct the advanced driving assistance system and the vehicle-mounted machine system through the Bypass module Bypass. In this case, the advanced driving assistance system does not need to perform the packet processing on the format-converted first image set for the packet processing, and the format-converted first image set is directly transmitted to the vehicle-mounted device system through the advanced driving assistance system. Therefore, the convenience of the transmission of the first image set can be improved, and the use experience of a user can be further improved.

In the embodiment of the disclosure, a forward-looking camera is controlled to collect a first image set, at least one third image in the third image set is subjected to image preprocessing to obtain the first image set, and the first image set is sent to a vehicle-mounted machine system, so that the vehicle-mounted machine system performs image processing on the first image set, a second image set and vehicle driving information based on first timestamp information to generate driving video information, wherein the second image set is an external vehicle image set with a view angle different from that of the first image set, so that the cameras in the advanced driving auxiliary system and the all-around camera system can be multiplexed to obtain the image sets transmitted by the advanced driving auxiliary system and the all-around camera system, an independent electronic control unit and the cameras are not required to obtain and record video information during driving, and cost can be reduced while more vehicle driving information is obtained.

The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods. For details not disclosed in the embodiments of the apparatus of the present disclosure, refer to the embodiments of the method of the present disclosure.

Referring to fig. 7, a schematic structural diagram of a first information acquisition device according to an exemplary embodiment of the present disclosure is shown. The information acquisition device may be implemented as all or part of a device by software, hardware, or a combination of both. The information acquisition apparatus 700 includes a set acquisition unit 701, an information acquisition unit 702, and an information storage unit 703, in which:

the set acquisition unit 701 is used for acquiring a first image set transmitted by the advanced driving assistance system, wherein the first image set is an automobile exterior image set acquired by the advanced driving assistance system;

the set acquiring unit 701 is further configured to acquire a second image set acquired by the all-round-looking camera system, where the second image set is an external vehicle image set acquired by the all-round-looking camera system and having a different viewing angle from the first image set;

an information obtaining unit 702 configured to obtain vehicle driving information;

an information generating unit 703 is configured to perform image processing on the first image set, the second image set, and the vehicle driving information based on the first timestamp information, and generate driving video information.

Optionally, fig. 8 shows a schematic structural diagram of a second information acquiring apparatus provided in the embodiment of the present disclosure, as shown in fig. 8, the information storage unit 703 includes an image processing subunit 713 and a video acquiring subunit 723, and the information storage unit 703 is configured to perform image processing on the first image set, the second image set, and the vehicle driving information based on the first timestamp information, and when the driving video information is generated:

the image processing subunit 713, performing image correction on a target second image in the second image set to obtain a corrected second image set, where the target second image is a second image whose image quality does not meet a preset quality evaluation condition;

and the video acquiring subunit 723 is configured to perform image processing on the first image set, the corrected second image set and the vehicle driving information based on the first timestamp information, and generate driving video information.

Optionally, the first image set is an image set obtained by performing image preprocessing on at least one third image in the third image set by the advanced driving assistance system.

Optionally, fig. 9 shows a schematic structural diagram of a third information obtaining apparatus provided in the embodiment of the present disclosure, as shown in fig. 9, the information storage unit 703 includes a format conversion subunit 733, a watermark superimposing subunit 743 and an encoding encapsulation subunit 753, and the information storage unit 703 is configured to perform image processing on the first image set, the second image set and the vehicle driving information based on the first timestamp information, and when the driving video information is generated:

a format conversion unit 733, configured to perform format conversion processing on the first image set in the first image format to obtain a first image set in a second image format;

the format conversion unit 733, configured to perform format conversion processing on the second image set in the third image format to obtain a second image set in the second image format;

the watermark superposition sub-unit 743 is configured to perform watermark superposition processing on the first image set, the second image set, the vehicle driving information, and the state information of the at least one vehicle component to obtain driving video information;

and the coding and packaging subunit 753 is configured to perform coding and packaging processing on the driving video information to generate processed driving video information.

Alternatively, fig. 10 shows a schematic structural diagram of a fourth information acquiring apparatus provided in the embodiment of the present disclosure, and as shown in fig. 10, the set acquiring unit 701 includes a state acquiring subunit 711 and a set acquiring subunit 721, and when the set acquiring unit 701 is used to acquire the first image set transmitted by the advanced driving assistance system:

a status acquisition subunit 711 configured to acquire status information transmitted by the advanced driving assistance system;

a set acquiring subunit 721 configured to acquire the first set of images transmitted by the advanced driving assistance system if the state information indicates that the advanced driving assistance system is in an operating state.

Optionally, fig. 11 shows a schematic structural diagram of a fifth information acquisition device provided in an embodiment of the present disclosure, and as shown in fig. 11, the information acquisition device 700 further includes

A state acquisition unit 704 for acquiring state information of at least one vehicle component;

the information adding unit 705 is configured to add the state information of the at least one vehicle component to the driving video information based on the second timestamp information corresponding to the state information, so as to obtain the added driving video information;

and the external storage unit 706 is configured to store the added driving video information into an external memory.

It should be noted that, when the information acquiring apparatus provided in the foregoing embodiment executes the information acquiring method, only the division of each functional module is illustrated, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the information acquisition apparatus and the information acquisition method provided by the above embodiments belong to the same concept, and details of implementation processes thereof are referred to in the method embodiments and are not described herein again.

The above-mentioned serial numbers of the embodiments of the present disclosure are merely for description and do not represent the merits of the embodiments.

In the embodiment of the disclosure, a first image set transmitted by the advanced driving assistance system is acquired through a set acquisition unit, and the first image set is an automobile exterior image set acquired by the advanced driving assistance system; the set acquisition unit acquires a second image set acquired by the all-round camera system, wherein the second image set is an automobile exterior image set which is acquired by the all-round camera system and is different from the first image set; the information acquisition unit acquires vehicle driving information, and the information storage unit can perform image processing on the first image set, the second image set and the vehicle driving information based on the first timestamp information to generate driving video information. Therefore, the cameras in the advanced driving assistance system and the all-round looking camera system can be multiplexed to acquire the image sets transmitted by the advanced driving assistance system and the all-round looking camera system, an independent electronic control unit and the independent cameras are not needed to acquire and record video information during driving, more vehicle driving information can be acquired, and meanwhile, the cost is reduced.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the personal information of the related user all accord with the regulations of related laws and regulations, and do not violate the customs of public sequences.

Referring to fig. 12, a schematic structural diagram of a sixth information acquisition apparatus according to an exemplary embodiment of the present disclosure is shown. The information acquisition device may be implemented as all or part of a device by software, hardware, or a combination of both. The information acquisition apparatus 1200 includes an image acquisition unit 1201 and a set transmission unit 1202, in which:

the image acquisition unit 1201 is used for controlling any camera to acquire a third image set, wherein the third image set is an external image set;

an image preprocessing unit 1202, configured to perform image preprocessing on at least one third image in the third image set to obtain a first image set;

a set sending unit 1203, configured to send the first image set to the in-vehicle system, so that the in-vehicle system performs image processing on the first image set, the second image set, and the vehicle driving information based on the first timestamp information, and generates driving video information, where the second image set is an external vehicle image set in which an angle of view acquired by the panoramic camera system is different from that of the first image set.

Optionally, the set sending unit 1203 is configured to, when sending the first image set to the car machine system, specifically:

transmitting the first image set with the converted format to a vehicle-mounted machine system;

or alternatively

And transmitting the first image set to the vehicle-mounted machine system through the bypass module.

Optionally, the set sending unit 1203 is configured to, when sending the first image set to the car-mounted device system, specifically:

and sending the first image set to a vehicle-mounted machine system so that the vehicle-mounted machine system performs image processing on the first image set, the second image set and vehicle driving information based on the first timestamp information to generate driving video information.

In the embodiment of the disclosure, an image acquisition unit controls any camera to acquire a third image set, wherein the third image set is an image set outside a vehicle; the image preprocessing unit is used for preprocessing at least one third image in the third image set to obtain a first image set; the set sending unit sends the first image set to the vehicle-mounted machine system so that the vehicle-mounted machine system can perform image processing on the first image set, the second image set and vehicle running information based on the first timestamp information to generate running video information, wherein the second image set is a vehicle-mounted image set, and the viewing angle of the second image set is different from that of the first image set. Therefore, the cameras in the advanced driving assistance system and the all-round looking camera system can be multiplexed to acquire the image sets transmitted by the advanced driving assistance system and the all-round looking camera system, an independent electronic control unit and the independent cameras are not needed to acquire and record video information during driving, more vehicle driving information can be acquired, and meanwhile, the cost is reduced.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the personal information of the related user all accord with the regulations of related laws and regulations, and do not violate the good customs of the public order.

The following are embodiments of the disclosed system that may be used to perform embodiments of the disclosed method. For details not disclosed in the embodiments of the system of the present disclosure, refer to the embodiments of the method of the present disclosure.

According to another aspect of the present disclosure, there is provided an information acquisition system including the in-vehicle machine system shown in any one of fig. 3 to 5, the advanced driving assistance system shown in fig. 6, and the all-round camera system.

Referring to fig. 13, a schematic structural diagram of an information acquisition system according to an exemplary embodiment of the present disclosure is shown. The information acquisition system may be implemented as all or part of a system, in software, hardware, or a combination of both. The information acquisition system comprises an advanced driving assistance system 1301, a panoramic camera system 1302 and a vehicle-mounted machine system 1303, wherein:

the advanced driving assistance system 1301 comprises a front-view camera 1311, the front-view camera 1311 is arranged in the advanced driving assistance system 1301, the front-view camera 1301 collects a first image set corresponding to a driving visual angle, and transmits the first image set to the advanced driving assistance system 1301;

the all-around camera system 1302 is connected with the vehicle-mounted system 1303, the all-around camera system 1302 is used for collecting a second image set, and transmitting the second first image set to the vehicle-mounted system 1303, and the second image set comprises at least one second image corresponding to other visual angles except the driving visual angle;

the advanced driving assistance system 1301 is connected with the vehicle-mounted machine system 1303, and the advanced driving assistance system 1301 is used for transmitting the first image set to the vehicle-mounted machine system 1303;

the advanced driving assistance system 1301 is further configured to obtain vehicle driving information and state information of at least one vehicle component in the vehicle, and send the vehicle driving information and the state information of the at least one vehicle component to the in-vehicle system 1303 through the bus, so that the in-vehicle system 1303 stores the first image set, the second image set, the vehicle driving information, and the state information of the at least one vehicle component.

In the embodiment of the disclosure, the front-view camera is connected with the advanced driving assistance system, collects a first image set corresponding to a driving visual angle and transmits the first image set to the advanced driving assistance system; the all-round camera system is connected with the vehicle-mounted system and is used for collecting a second image set and transmitting the second first image set to the vehicle-mounted system, and the second image set comprises at least one second image corresponding to other visual angles except the driving visual angle; the advanced driving assistance system is connected with the vehicle-mounted machine system and is used for transmitting the first image set to the vehicle-mounted machine system; the advanced driving assistance system is further used for acquiring vehicle driving information and sending the vehicle driving information to the vehicle machine system through the bus, so that the vehicle machine system performs image processing on the first image set, the second image set and the vehicle driving information based on the first timestamp information to obtain driving video information and stores the driving video information. Therefore, the cameras in the advanced driving assistance system and the all-round looking camera system can be multiplexed to acquire the image sets transmitted by the advanced driving assistance system and the all-round looking camera system, an independent electronic control unit and the independent cameras are not needed to acquire and record video information during driving, more vehicle driving information can be acquired, and meanwhile, the cost is reduced.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

Fig. 14 shows a schematic block diagram of an example electronic device 1400 that may be used to implement embodiments of the present disclosure. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 14, the electronic device 1400 includes a computing unit 1401 that can perform various appropriate actions and processes in accordance with a computer program stored in a Read Only Memory (ROM) 1402 or a computer program loaded from a storage unit 1408 into a Random Access Memory (RAM) 1403. In the RAM 1403, various programs and data required for the operation of the electronic device 1400 can also be stored. The calculation unit 1401, the ROM 1402, and the RAM 1403 are connected to each other via a bus 1404. An input/output (I/O) interface 1405 is also connected to bus 1404.

A number of components in the electronic device 1400 are connected to the I/O interface 1405, including: an input unit 1406 such as a keyboard, a mouse, or the like; an output unit 1407 such as various types of displays, speakers, and the like; a storage unit 1408 such as a magnetic disk, optical disk, or the like; and a communication unit 1409 such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 1409 allows the electronic device 1400 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The computing unit 1401 may be a variety of general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of the computing unit 1401 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and the like. The calculation unit 1401 executes the respective methods and processes described above, such as the information acquisition method. For example, in some embodiments, the information acquisition method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 1408. In some embodiments, part or all of the computer program can be loaded and/or installed onto the electronic device 1400 via the ROM 1402 and/or the communication unit 1409. When the computer program is loaded into the RAM 1403 and executed by the computing unit 1401, one or more steps of the information acquisition method described above may be performed. Alternatively, in other embodiments, the computing unit 1401 may be configured to perform the information obtaining method by any other suitable means (e.g. by means of firmware).

According to an embodiment of the present disclosure, there is also provided an automobile including the information acquisition apparatus shown in any one of fig. 7 to 11, or the information acquisition apparatus shown in fig. 12, or the electronic device shown in fig. 14.

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user may provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), the internet, and blockchain networks.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The Server can be a cloud Server, also called a cloud computing Server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service ("Virtual Private Server", or simply "VPS"). The server may also be a server of a distributed system, or a server incorporating a blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and the present disclosure is not limited herein.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. An information acquisition method, comprising:

acquiring a first image set transmitted by an advanced driving assistance system, wherein the first image set is an image set outside a vehicle collected by the advanced driving assistance system;

acquiring a second image set acquired by a looking-around camera system, wherein the second image set is an outside vehicle image set acquired by the looking-around camera system, and the visual angle of the outside vehicle image set is different from that of the first image set;

acquiring vehicle driving information;

and performing image processing on the first image set, the second image set and the vehicle driving information based on first timestamp information to generate driving video information.

2. The method of claim 1, wherein the image processing the first set of images, the second set of images, and the vehicle driving information based on the first timestamp information to generate driving video information comprises:

and performing image processing on the first image set, the corrected second image set and the vehicle driving information based on first timestamp information to generate driving video information.

3. The method of claim 1, wherein the image processing the first set of images, the second set of images and the vehicle driving information based on the first timestamp information to generate driving video information comprises:

4. The method of claim 1, wherein the obtaining a first set of images transmitted by an advanced driving assistance system comprises:

5. The method of claim 1, further comprising:

obtaining status information of at least one vehicle component;

and storing the added driving video information into an external memory.

6. An information acquisition method for an advanced driving assistance system, characterized by comprising:

and sending the first image set to a vehicle-mounted machine system so that the vehicle-mounted machine system performs image processing on the first image set, a second image set and vehicle driving information based on first timestamp information to generate driving video information, wherein the second image set is a vehicle-mounted image set with a view angle acquired by a panoramic camera system different from that of the first image set.

7. The method of claim 6, wherein sending the first set of images to a vehicle-mounted machine system comprises:

or

8. An information acquisition apparatus characterized by comprising:

the set acquisition unit is further used for acquiring a second image set acquired by the all-round-view camera system, wherein the second image set is an automobile exterior image set acquired by the all-round-view camera system, and the visual angle of the automobile exterior image set is different from that of the first image set;

the information acquisition unit is used for acquiring vehicle driving information;

9. An information acquisition apparatus characterized by comprising:

the image preprocessing unit is used for preprocessing at least one third image in the third image set to obtain a first image set;

10. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; it is characterized in that the preparation method is characterized in that,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5 or 6-7.

11. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-5 or 6-7.

12. A vehicle comprising the information acquisition apparatus according to claim 8 or 9, or the electronic device according to claim 10.