TWI758717B - Vehicle-mounted display device based on automobile a-pillar, method, system and storage medium - Google Patents

Abstract

The invention provides a vehicle-mounted display device based on an A-pillar of an automobile, which includes: a first display screen and a second display screen, a first camera and a second camera, a third camera and a fourth camera, and data processing equipment, and a third camera and a second The four cameras are used to collect the driver's face image; the data processing equipment is used to calculate the driver's head twisting data and human visual field data based on the face image, and adjust the first shooting angle of the third camera and the fourth camera, And adjusting the second shooting angle of the first camera and the second camera; the first camera and the second camera are used to collect the exterior scene of the vehicle; the first display screen and the second display screen are used to display the exterior scene of the vehicle. The invention also provides a vehicle-mounted display method based on the automobile A-pillar, system and storage medium. With the present invention, the on-board display capability can be improved.

Description

Vehicle-mounted display device, method, system and storage medium based on automobile A-pillar

The invention relates to the technical field of automobile safety, and in particular, to an in-vehicle display device, method, system and storage medium based on an automobile A-pillar.

Due to the limitations of the car structure, the car has many blind spots. Due to the existence of blind spots, drivers cannot see pedestrians, other vehicles, obstacles or other animals in the blind spots, resulting in numerous accidents and dangers. Especially the A-pillar of the car, on the one hand, it is in front of the vehicle, and there are relatively more accidents and dangers caused by the blind spot formed by the A-pillar of the car; The volume is also larger, and the blocking of the line of sight is even more serious, which will seriously affect the driving safety.

The existing perspective A-pillar technology mainly uses the method of embedding a screen in the A-pillar of the car and combining with the outside camera. However, due to the different situations of the driver's head twisting during the actual driving process, the blind spots of vision caused by the A-pillar of the car are different. If a fixed-angle camera is used, it cannot meet the shooting of the outside scene in the blind spots of different fields of view, thus reducing the vehicle display capability.

In view of this, it is necessary to propose an in-vehicle display device based on an automobile A-pillar, an in-vehicle display method based on an automobile A-pillar, an in-vehicle display system and a storage medium based on an automobile A-pillar, aiming at solving the problem of the low on-board display capability based on the automobile A-pillar technical issues.

A first aspect of the embodiments of the present invention provides an in-vehicle display device based on an A-pillar of an automobile, including: data processing equipment, a first display screen and a second display screen installed on the inclined surfaces of the A-pillars on both sides of the vehicle, The first camera and the second camera on the A-pillars on both sides outside the vehicle, the first camera and the second camera are used to capture the scene outside the vehicle, and the first display screen and the second display screen are used to display all the images. For the scene outside the vehicle, the vehicle display device further includes a third camera and a fourth camera, the third camera and the fourth camera are arranged on the A-pillar slopes on both sides of the vehicle and are located on the first display screen and the On top of the second display screen, the first display screen and the second display screen, the first camera and the second camera, the third camera and the fourth camera are all related to the data processing The device is electrically connected, and the third camera and the fourth camera are used to collect the driver's face image; the data processing device is used to calculate the driver's head twist data and the human eye field of view according to the face image data, and adjust the first shooting angle of the third camera and the fourth camera according to the head twist data, and adjust the first camera and the second camera according to the human eye field of view data. Second shooting angle.

Further, in the above-mentioned vehicle-mounted display device based on the A-pillar of the automobile provided by the embodiment of the present invention, the first camera collects the first scene outside the vehicle according to the visual field data of the human eye corresponding to the third camera, and displays the first scene. The outside scene is displayed on the first display screen; the second camera collects the second outside scene according to the visual field data corresponding to the fourth camera, and displays the second outside scene on the second display on the screen.

A second aspect of the embodiments of the present invention provides a method for performing vehicle display based on the vehicle A-pillar-based vehicle display device described in any of the foregoing, the vehicle-mounted display method based on the vehicle A-pillar includes: When the data processing device receives the opening instruction, it controls the third camera and the fourth camera to collect the driver's face image; calculates the driver's head twist data according to the face image; Adjust the first shooting angle of the third camera and the fourth camera according to the head twist data to collect the target face image of the driver; determine the position of the human eye in the target face image , and calculate the driver's human eye field data according to the human eye position; adjust the second shooting angle of the first camera and the second camera according to the human eye field data to collect the first scene outside the vehicle and a second outside scene; displaying the first outside scene and the second outside scene on the first display screen and the second display screen respectively.

Further, in the above-mentioned vehicle-mounted display method based on the A-pillar of an automobile provided by the embodiment of the present invention, the position of the human eye in the target face image is determined, and the position of the driver is calculated according to the position of the human eye. The eye field data includes: calling a preset face detection algorithm to detect the face position of each frame image in the target face image to obtain a face area image; locating the human eyes in the face area image obtain the pupil position of the human eye according to the position of the human eye, and calculate the eye movement trajectory parameter corresponding to the pupil position in each frame; calculate the driver's visual field data according to the eye movement trajectory parameter.

Further, in the above-mentioned vehicle-mounted display method based on the A-pillar of an automobile provided by the embodiment of the present invention, after the obtaining of the face area image, the method further includes: traversing a preset human face area image according to the face area image. Face image database to determine target driving data; Adjust the display angle of the A-pillar of the vehicle according to the target driving data.

Further, in the above-mentioned vehicle-mounted display method based on the A-pillar of the automobile provided by the embodiment of the present invention, the first shooting angle of the third camera and the fourth camera is adjusted according to the head twist data, so as to Collecting the target face image of the driver includes: acquiring the current shooting angle of the third camera and the fourth camera; determining the current shooting angle according to the mapping relationship between the preset shooting angle and the head twist data The preset head twist data corresponding to the angle; detect whether the head twist data exceeds the preset head twist data; when the detection result is that the head twist data exceeds the preset head twist data, Calculate the head twist difference between the head twist data and the preset head twist data; adjust the first difference between the third camera and the fourth camera according to the head twist difference Filming angle.

Further, in the above-mentioned vehicle-mounted display method based on the A-pillar of an automobile provided by the embodiment of the present invention, in the step of displaying the first exterior scene and the second exterior scene on the first display screen and the Before displaying on the second display screen, the method further includes: acquiring the human visual field data; determining the blind spot data outside the vehicle caused by the A-pillar in the vehicle according to the human visual field data; determining a third shooting angle according to the blind spot data outside the vehicle Obtain the first target outside scene and the second target outside scene corresponding to the third shooting angle in the first outside scene and the second outside scene respectively; The first target outside scene and the second outside scene The outside scene of the target vehicle is displayed on the first display screen and the second display screen respectively.

Further, in the above-mentioned vehicle-mounted display method based on the A-pillar of the vehicle provided by the embodiment of the present invention, after the third camera and the fourth camera are controlled to collect the driver's face image, the method further includes: : call a preset face detection algorithm to detect whether the face image has a face region image; when the detection result is that the face image has a face region image, acquire the face region image; detect Whether the position of the human eye is included in the image of the face area; when the detection result is that the position of the human eye is not included in the image of the face area, determine the target camera group corresponding to the face image that does not include the position of the human eye; call The target camera group collects the scene at the current shooting angle.

The third party side of the embodiment of the present invention also provides an in-vehicle display system based on the A-pillar of an automobile. The in-vehicle display system based on the A-pillar of the automobile includes: a face image acquisition module, which is used when the data processing device receives an opening instruction , control the third camera and the fourth camera to collect the driver's face image; the head data calculation module is used to calculate the driver's head twist data according to the face image; the target face a collection module, configured to adjust the first shooting angle of the third camera and the fourth camera according to the head twist data, so as to collect the target face image of the driver; a visual field data calculation module, used for Determining the position of the human eye in the target face image, and calculating the driver's eye field data according to the human eye position; a scene acquisition module outside the vehicle is used to adjust the first field of view data according to the human eye field data. a second shooting angle of the camera and the second camera to capture the first scene outside the vehicle and the second scene outside the vehicle; The exterior scene display module is used for displaying the first exterior scene and the second exterior scene on the first display screen and the second display screen respectively.

A fourth aspect of the embodiments of the present invention further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the steps of any one of the above-mentioned vehicle A-pillar-based vehicle display methods .

Embodiments of the present invention provide an in-vehicle display device based on an automobile A-pillar, an in-vehicle display method based on an automobile A-pillar, an in-vehicle display system based on the automobile A-pillar, and a computer-readable storage medium. Adjust the shooting angle of the camera in the car according to the head twisting situation, which can improve the accuracy of face image collection; determine the position of the human eye according to the face image, which can improve the accuracy of identifying the position of the human eye, thereby improving the accuracy of calculating the visual field data of the human eye. Accuracy; in addition, the present invention adjusts the shooting angle of the camera outside the vehicle according to the visual field data of the human eye, and can select the most suitable shooting angle for different blind areas of the human eye, thereby improving the vehicle display capability.

200: On-board display device based on car A-pillar

201: First camera

202: The first display

203: Third camera

204: Car A-pillar

1: Computer equipment

10: Memory

20: Display

30: Processor

100: On-board display system based on car A-pillar

101: face image acquisition module

102: Header data calculation module

103: Target face acquisition module

104: Visual field data calculation module

105: Exterior scene acquisition module

106: Vehicle exterior scene display module

FIG. 1 is a schematic diagram of an in-vehicle display device based on an A-pillar of an automobile provided by an embodiment of the present invention.

FIG. 2 is a flowchart of an on-board display method based on an A-pillar of an automobile provided by an embodiment of the present invention.

FIG. 3 is a schematic structural diagram of a computer device according to an embodiment of the present invention.

FIG. 4 is an exemplary functional block diagram of the computer device shown in FIG. 3 .

Referring to FIG. 1 , an embodiment of the present invention provides an in-vehicle display device based on an automobile A-pillar, including: a data processing device (not shown in the figure), and inclined surfaces of the automobile A-pillar 204 installed on both sides of the vehicle. The first display screen 202 and the second display screen (not shown in the figure), and the first camera 201 and the second camera (not shown in the figure) installed on the A-pillars 204 on both sides of the vehicle. The vehicle-mounted display device 200 based on the automobile A-pillar further includes a third camera 203 and a fourth camera (not shown in the figure), and the third camera 203 and the fourth camera are arranged on the slopes of the A-pillars on both sides of the vehicle and on top of the first display screen and the second display screen. The first display screen 202 and the second display screen, the first camera 201 and the second camera, the third camera 203 and the fourth camera are all electrically connected to the data processing device, The data processing device stores an algorithm corresponding to the device, and the data processing device executes data processing through an algorithm program. Wherein, the first camera 201 and the second camera may also be arranged on the rearview mirrors on both sides of the vehicle, and their positions are not specifically limited.

Specifically, the data processing device is configured to calculate the driver's head twist data, human eye field data and driving data according to the face images collected by the third camera 203 and the fourth camera; the data processing device can be used to adjust the first shooting angle of the third camera 203 and the fourth camera according to the head twist data; the data processing device can be used to adjust the first camera 201 according to the human eye field of view data and the second shooting angle of the second camera; the data processing device can also be used to adjust the display angle of the A-pillar 204 of the car according to the driving data. The first camera 201, the second camera, the third camera 203, the fourth camera, the first display screen 202 and the second display screen can all be rotated at any angle in space, and this design can ensure that different drivers can observe Clear images to any angle enhance the applicability of this set of devices.

In at least one embodiment of the present invention, the third camera 203 and the fourth camera are used to collect the driver's face image, and the first camera 201 and the second camera are used to collect the scene outside the vehicle; The first display screen 202 and the second display screen are used to display the scene outside the vehicle. Specifically, the first camera 201 acquires a first scene outside the vehicle according to the visual field data corresponding to the third camera 203, and displays the first scene outside the vehicle on the first display screen 202; the first scene The second camera acquires a second outside scene according to the visual field data corresponding to the fourth camera, and displays the second outside scene on the second display screen.

The embodiment of the present invention provides an in-vehicle display device 200 based on the A-pillar of an automobile, which adjusts the shooting angle of the in-vehicle camera according to the driver's head twisting situation during driving, which can improve the accuracy of collecting face images; The image determines the position of the human eye, which can improve the accuracy of recognizing the position of the human eye, thereby improving the accuracy of calculating the visual field data of the human eye; in addition, the present invention adjusts the shooting angle of the camera outside the vehicle according to the visual field data of the human eye, and can target different blind areas of the human eye. The most suitable shooting angle is selected, thereby improving the vehicle display capability; finally, the display angle of the A-pillar 204 of the car is adjusted according to the driving data, which can be adjusted according to the height, body shape of different drivers and the position of the human eye during normal driving to ensure The driver can observe a clear picture and grasp the road conditions at any time, which improves the universality of the device.

FIG. 2 is a flowchart of an on-board display method based on an A-pillar of an automobile provided by an embodiment of the present invention. The vehicle A-pillar-based vehicle display method is based on the vehicle A-pillar-based vehicle-mounted display device 200 for vehicle-mounted display, and the vehicle A-pillar-based vehicle display method is applied to a data processing device, as shown in FIG. 2 , the The vehicle-mounted display method based on the automobile A-pillar includes the following steps:

S21. When the data processing device receives an opening instruction, control the third camera and the fourth camera to collect the driver's face image.

In at least one embodiment of the present invention, the start-up instruction may include an instruction output by a driver (eg, voice input, touch input, etc.), a car driving instruction (ie, an instruction to start the car), etc., which are not limited here. . When the data processing device receives the start instruction, it can control the third camera 203 and the fourth camera to collect the driver's face image at the same time.

In at least one embodiment of the present invention, after the third camera 203 and the fourth camera are controlled to collect the driver's face image, the method further includes: calling a preset face detection algorithm to detect Whether the face image has a face area image; when the detection result is that the face image has a face area image, obtain the face area image; detect whether the face area image contains The position of the human eye; when the detection result is that the image of the face area does not contain the position of the human eye, determine the target camera group corresponding to the face image that does not include the position of the human eye; call the target camera group to collect the current shooting angle. scene. It can be understood that when the detection result is that the image of the face area does not contain the position of the human eye, that is, the driver's observation line of sight cannot be detected, that is, the driver's line of sight is not blocked by obstacles. At this time, the corresponding target camera group can capture a fixed-angle image, and the corresponding display screen can also display the fixed-angle outside environment information.

In at least one embodiment of the present invention, calling a preset face detection algorithm can detect a face region image in the face image and detect the position of the human eye in the face region image. The preset face detection algorithm is pre-trained by the terminal, and the preset face detection algorithm can include the SeetaFace detection algorithm, and the SeetaFace detection algorithm is an automatic face recognition algorithm based on the C++ language, and the SeetaFace detection algorithm The algorithm may include: FaceDetection face detection module and FaceAlignment feature point location module. Specifically, face detection is performed first with FaceDetection, and a rectangular frame including the entire face is obtained, that is, the face region of interest of each frame described above. Then use FaceAlignment to locate the two feature points of the center of the eyes of the face, and obtain the coordinates of the center of the eyes of each frame.

In at least one embodiment of the present invention, after obtaining the face area image, the method further includes: traversing a preset face image database according to the face area image to determine target driving data; The target driving data adjusts the display angle of the A-pillar 204 of the vehicle. Wherein, the preset face image database includes a face area image and driving data corresponding to the face image, and the driving data may be data such as the driver's height, body shape, and the position of the human eyes when driving normally. . The display angle of the A-pillar 204 of the car is adjusted according to the driving data, and can be adjusted according to the height, body shape of different drivers, and the position of the human eyes during normal driving, so as to ensure that the driver can observe a clear picture and grasp the road conditions at any time. universality.

S22. Calculate the head twist data of the driver according to the face image.

In at least one embodiment of the present invention, the calculating the driver's head twist data according to the face image includes: obtaining first coordinate information of preset face key points in the current video frame; obtaining the upper The second coordinate information of the same preset face key point of a video frame; the head twist data of the driver is calculated according to the first coordinate information and the second coordinate information.

The preset face key points may include one or a combination of the following: eyebrow key points, nose key points, eye key points, and mouth key points. In one embodiment, the There are a total of 10 eyebrow key points, and the corresponding numbers are 1-10; the nose key points are 9, and the corresponding numbers are 11-19; there are 12 eye key points, and the corresponding numbers are 20-31; There are 20 key points in the mouth, and the corresponding numbers are 32-51. The coordinate information includes 2D coordinate information and 3D coordinate information, the 2D coordinate information may be the 2D coordinate information of a preset face key point in the video frame coordinate system, and the 3D coordinate information may be a preset face key point. 3D coordinate information in the camera coordinate system.

S23. Adjust the first shooting angle of the third camera and the fourth camera according to the head twist data, so as to collect the target face image of the driver.

In the actual driving process, the driver's head may twist according to the driving habits, current road conditions and other information, so as to grasp the road condition information at any time. During the process of the driver's head twisting, if the third camera 203 and the fourth camera keep a fixed shooting angle (each shooting angle corresponds to the best acquisition range of the camera) to collect the face image, it may cause The collected face images are not clear and other problems, so that the field of view of the human eye cannot be confirmed normally, which reduces the vehicle display capability. Therefore, the vehicle-mounted display method based on the A-pillar of the vehicle provided by the embodiment of the present invention can adjust the shooting angle according to the head twist data, thereby ensuring that the camera for shooting the face image is in the best acquisition range.

In at least one embodiment of the present invention, the first shooting angle of the third camera 203 and the fourth camera is adjusted according to the head twist data, so as to collect the target face image of the driver The method includes: acquiring the current shooting angles of the third camera 203 and the fourth camera; and determining a preset head twist corresponding to the current shooting angle according to the mapping relationship between the preset shooting angle and the head twist data Detect whether the head twist data exceeds the preset head twist data; when the detection result is that the head twist data exceeds the preset head twist data, calculate the head twist data and The head twist difference of the preset head twist data; the first shooting angle of the third camera 203 and the fourth camera is adjusted according to the head twist difference.

The mapping relationship between the shooting angle and the head twist data is preset, and when the detection result is that the head twist data exceeds the preset head twist data, the camera at the current shooting angle cannot shoot clearly If the face image exceeds the preset head twist data part, it is necessary to adjust the shooting angle of the camera to improve the clarity of the face image.

S24. Determine the position of the human eye in the target face image, and calculate the field of vision data of the driver's eyes according to the position of the human eye.

In at least one embodiment of the present invention, the determining the human eye position in the target face image, and calculating the driver's eye field data according to the human eye position includes: calling a preset face The detection algorithm detects the face position of each frame image in the target face image, and obtains the face area image; locates the position of the human eye in the face area image; obtains the human eye position according to the human eye position and calculate the eye movement trajectory parameter corresponding to the pupil position in each frame; calculate the driver's visual field data according to the eye movement trajectory parameter.

In at least one embodiment of the present invention, the method for locating the position of the human eye in the face region image may include: determining the position of the human eye using a grayscale integral projection or determining the position of the human eye using a template matching method. Among them, the position of the human eye is determined by using grayscale integral projection. After accurately locating the face region, according to the distribution of facial organs of the human face, the human eye is in the upper half of the face, and the upper half of the face region is first intercepted for processing; The gray value of the eye part in the face image is usually smaller than the gray value of the surrounding area. Using this feature, the method of integral projection is often used to locate the eyes. A template matching method is used to determine the position of the human eye. The template matching method defines the size of the image S to be searched as width W and height H, the size of template T is defined as width M and height N, and calculates through template matching. The method searches the image S to be searched for a sub-image with a similar size, square and image to the template T, and determines its coordinate position.

S25. Adjust the second shooting angle of the first camera and the second camera according to the human eye field of view data, so as to capture the first scene outside the vehicle and the second scene outside the vehicle.

In at least one embodiment of the present invention, the first outside scene and the second outside scene include the outside scene in the blind area of sight caused by the A-pillar 204 of the vehicle to the driver and other scenes. It is understandable that by adjusting the shooting angle of the outside camera according to the visual field data of the human eye, the most suitable shooting angle can be selected for different blind areas of the human eye, thereby improving the vehicle display capability.

S26. Display the first exterior scene and the second exterior scene on the first display screen and the second display screen, respectively.

In at least one embodiment of the present invention, the first display screen 202 and the second display screen are respectively used to display the scene outside the vehicle captured by the first camera 201 and the second camera. Preferably, the first display screen 202 and the second display screen only display the outside scene corresponding to the blind spot of sight caused by the A-pillar 204 of the car to the driver, so as to ensure that the road condition information viewed by the driver through the front windshield is consistent with the first display screen 202 and the first display screen 202. The road condition information displayed by the two display screens is continuous and has no overlapping parts, thereby ensuring that the images observed by the driver through the front windshield, the first display screen 202 and the second display screen are real road condition information.

Specifically, before displaying the first outside scene and the second outside scene on the first display screen 202 and the second display screen respectively, the method further includes: acquiring the person eye field data; determine the blind spot data outside the vehicle caused by the A-pillar 204 in the car according to the human eye field data; determine the third shooting angle according to the blind spot data outside the vehicle; obtain the first outside scene and the second outside scene respectively The first target vehicle exterior scene and the second target vehicle exterior scene corresponding to the third shooting angle; the first target vehicle exterior scene and the second target vehicle exterior scene are respectively displayed on the first display screen 202 and the on the second display. Wherein, the third shooting angle is a shooting angle corresponding to the outside blind spot data.

An embodiment of the present invention provides an in-vehicle display method based on an A-pillar of an automobile, including: when the data processing device receives an opening instruction, controlling the third camera 203 and the fourth camera to collect a driver's face image; Calculate the driver's head twist data according to the face image; adjust the first shooting angle of the third camera 203 and the fourth camera according to the head twist data to capture the driving the target face image of the driver; determine the position of the human eye in the target face image, and calculate the driver's eye field data according to the human eye position; adjust the first field of vision data according to the human eye field data The second shooting angle of the camera 201 and the second camera to capture the first scene outside the vehicle and the second scene outside the vehicle; the first scene outside the vehicle and the second scene outside the vehicle are displayed on the first display screen 202 respectively. with the second display screen. By using the present invention, the shooting angle of the in-vehicle camera can be adjusted according to the driver's head twisting situation during driving, which can improve the acquisition accuracy of the collected face image; accuracy, Therefore, the accuracy of calculating the visual field data of the human eye is improved; in addition, the present invention adjusts the shooting angle of the outside camera according to the visual field data of the human eye, and can select the most suitable shooting angle for different blind areas of the human eye, thereby improving the vehicle display capability.

The above is a detailed description of the methods provided by the embodiments of the present invention. According to different requirements, the execution order of the blocks in the shown flowcharts can be changed, and some blocks can be omitted. The computer device 1 provided by the embodiment of the present invention is described below.

FIG. 3 is a schematic structural diagram of a computer device according to an embodiment of the present invention. As shown in FIG. 3 , the computer device 1 includes a memory 10 , and the memory 10 stores the vehicle A-pillar-based vehicle display system 100 . The computer device 1 may be an electronic device such as a computer, a tablet computer, a personal digital assistant, etc., which has functions such as data processing, analysis, program execution, and display. The vehicle-mounted display system 100 based on the A-pillar of the vehicle can control the third camera 203 and the fourth camera to collect the driver's face image when the data processing device receives an opening instruction; Image calculation of the driver's head twist data; adjust the first shooting angle of the third camera 203 and the fourth camera according to the head twist data to capture the driver's target face image; determine the position of the human eye in the target face image, and calculate the driver's eye field data according to the human eye position; adjust the first camera 201 and the The second shooting angle of the second camera is used to capture the first scene outside the vehicle and the second scene outside the vehicle; the first scene outside the vehicle and the second scene outside the vehicle are displayed on the first display screen 202 and the second scene respectively. on the display. By using the present invention, the shooting angle of the in-vehicle camera can be adjusted according to the driver's head twisting situation during driving, which can improve the acquisition accuracy of the collected face image; Therefore, the accuracy of calculating the visual field data of the human eye is improved; in addition, the present invention adjusts the shooting angle of the camera outside the vehicle according to the visual field data of the human eye, and can select the most suitable shooting angle for different blind areas of the human eye, thereby improving the vehicle display. ability.

In this embodiment, the computer device 1 may further include a display screen 20 and a processor 30 . The memory 10 and the display screen 20 may be electrically connected to the processor 30, respectively.

The memory 10 can be different types of storage devices for storing various types of data. For example, it can be the memory or internal memory of the computer device 1, or it can be a memory card that can be externally connected to the computer device 1, such as flash memory, SM card (Smart Media Card), SD card (Secure Digital Card, secure digital card) card) etc. In addition, the memory 10 may include non-volatile memory such as hard disk, internal memory, plug-in hard disk, smart memory card (Smrtt Media Card, SMC), secure digital (Secure Digital, SD) card, flash memory card (Flash Card), At least one disk storage device, flash memory device, or other non-volatile solid state storage device. The memory 10 is used to store various types of data, for example, various applications installed in the computer device 1 , data set and acquired by applying the above-mentioned on-board display method based on the A-pillar of an automobile.

The display screen 20 is installed in the computer device 1 for displaying information.

The processor 30 is configured to execute the vehicle A-pillar-based vehicle display method and various software installed in the computer device 1, such as an operating system and application display software. The processor 30 includes, but is not limited to, a processor (Central Processing Unit, CPU), a Micro Controller Unit (Micro Controller Unit, MCU) and other devices for interpreting computer instructions and processing data in computer software.

The vehicle A-pillar-based vehicle display system 100 may include one or more modules stored in the memory 10 of the computer device 1 and configured to be executed by one or more processors ( This embodiment is executed by a processor 30) to complete the embodiments of the present invention. For example, referring to FIG. 4 , the vehicle A-pillar-based vehicle display system 100 may include a face image acquisition module 101 , a head data calculation module 102 , a target face acquisition module 103 , a visual field data calculation module 104 , and a vehicle exterior scene. A collection module 105 and a vehicle exterior scene display module 106 . A module referred to in this embodiment of the present invention may be a program segment that performs a specific function, and is more suitable for describing the execution process of software in the processor 30 than a program.

It can be understood that, corresponding to the various embodiments in the above-mentioned vehicle A-pillar-based vehicle display method, the vehicle A-pillar-based vehicle display system 100 may include some or all of the functional modules shown in FIG. 4 . The function will be described in detail below. It should be noted that, in the above embodiments of the vehicle-mounted display method based on the A-pillar of an automobile, the same nouns and related nouns and their specific solutions are described. The explanations can also be applied to the following descriptions of the functions of each module. For the sake of saving space and avoiding repetition, details are not repeated here.

The face image collection module 101 may be configured to control the third camera 203 and the fourth camera to collect the driver's face image when the data processing device receives an opening instruction.

The head data calculation module 102 may be configured to calculate the head twist data of the driver according to the face image.

The target face collection module 103 may be configured to adjust the first shooting angle of the third camera 203 and the fourth camera according to the head twist data, so as to collect the target face image of the driver.

The visual field data calculation module 104 may be configured to determine the position of the human eye in the target face image, and calculate the visual field data of the driver's eyes according to the position of the human eye.

The outside scene collection module 105 may be configured to adjust the second shooting angles of the first camera 201 and the second camera according to the human eye field data, so as to collect the first outside scene and the second outside scene.

The exterior scene display module 106 may be configured to display the first exterior scene and the second exterior scene on the first display screen 202 and the second display screen, respectively.

Embodiments of the present invention further provide a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by the processor 30, implements the steps of the vehicle-mounted display method based on the A-pillar of an automobile in any of the foregoing embodiments.

If the on-board display system 100/computer equipment 1/computer equipment integrated module/unit based on the automobile A-pillar is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage. in the medium. Based on this understanding, the present invention can implement all or part of the processes in the methods of the above embodiments, and can also be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer When the program is executed by the processor 30, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code can be in the form of source code, object Code form, executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read-Only Memory) Wait.

The so-called processor 30 may be a central processing unit (Central Processing Unit, CPU), and may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The processor 30 is the control center of the vehicle A-pillar-based vehicle display system 100/computer device 1, using various interfaces And lines connect the entire vehicle A-pillar based on-board display system 100 / various parts of the computer equipment 1 .

The memory 10 is used to store the computer programs and/or modules, and the processor 30 executes or executes the computer programs and/or modules stored in the memory 10 and calls the data stored in the memory 10, Various functions of the in-vehicle display system 100/computer device 1 based on the automobile A-pillar are realized. The memory 10 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the storage data area Data created according to the use of the computer device 1 (such as audio data) and the like may be stored.

200: On-board display device based on car A-pillar

201: First camera

202: The first display

203: Third camera

204: Car A-pillar

Claims (10)

A vehicle-mounted display device based on an A-pillar of a car, comprising: data processing equipment, a first display screen and a second display screen installed on the inclined surfaces of the A-pillars on both sides of the vehicle, and a display screen installed on the A-pillars on both sides of the vehicle. A first camera and a second camera, the first camera and the second camera are used to capture the scene outside the vehicle, and the first display screen and the second display screen are used to display the scene outside the vehicle, characterized in that: The vehicle-mounted display device further includes a third camera and a fourth camera, and the third camera and the fourth camera are arranged on the inclined surfaces of the A-pillars on both sides of the vehicle and are located on the first display screen and the second display screen the top of the , the first display screen and the second display screen, the first camera and the second camera, the third camera and the fourth camera are all electrically connected to the data processing device, The third camera and the fourth camera are used to collect the driver's face image; the data processing device is used to calculate the driver's head twist data and the human eye field of view data according to the face image, and according to the The head twist data adjusts the first shooting angle of the third camera and the fourth camera, and adjusts the second shooting angle of the first camera and the second camera according to the human eye field of view data . The vehicle-mounted display device based on the A-pillar of the automobile according to claim 1, wherein the first camera collects a first scene outside the vehicle according to the visual field data of the human eye corresponding to the third camera, and displays the first scene outside the vehicle. The scene is displayed on the first display screen; the second camera collects a second outside scene according to the human eye field of view data corresponding to the fourth camera, and displays the second outside scene on the second display screen superior. A method for on-board display based on any one of the above claims 1 to 2, wherein the on-board display method based on the A-pillar of an automobile comprises: when the data processing device When receiving the opening instruction, control the third camera and the fourth camera to collect the driver's face image; calculate the driver's head twist data according to the face image; Adjusting the first shooting angle of the third camera and the fourth camera with dynamic data to collect the target face image of the driver; Determine the human eye position in the target face image, and calculate the driver's eye field data according to the human eye position; adjust the first camera and the second camera according to the human eye field data The second shooting angle is used to capture the first outside scene and the second outside scene; the first outside scene and the second outside scene are displayed on the first display screen and the second display screen respectively. The in-vehicle display method based on the A-pillar of an automobile according to claim 3, wherein the position of the human eye in the target face image is determined, and the human eye of the driver is calculated according to the position of the human eye. The field of view data includes: calling a preset face detection algorithm to detect the face position of each frame of the target face image to obtain a face area image; locating the position of the human eye in the face area image ; Acquire the pupil position of the human eye according to the position of the human eye, and calculate the eye movement track parameter corresponding to the pupil position of each frame; calculate the driver's visual field data according to the eye movement track parameter. The vehicle-mounted display method based on the A-pillar of an automobile according to claim 4, characterized in that, after obtaining the face area image, the method further comprises: traversing preset faces according to the face area image The image database determines target driving data; adjusts the display angle of the A-pillar of the car according to the target driving data. The vehicle-mounted display method based on the A-pillar of an automobile according to claim 3, wherein the first shooting angle of the third camera and the fourth camera is adjusted according to the head twist data to capture the The target face image of the driver includes: acquiring the current shooting angle of the third camera and the fourth camera; determining the current shooting angle according to the mapping relationship between the preset shooting angle and the head twist data corresponding preset head twist data; detecting whether the head twist data exceeds the preset head twist data; When the detection result is that the head twist data exceeds the preset head twist data, calculate the head twist difference between the head twist data and the preset head twist data; according to the The head twist difference adjusts the first shooting angle of the third camera and the fourth camera. The vehicle-mounted display method based on the A-pillar of an automobile according to claim 3, characterized in that, in said displaying the first outside scene and the second outside scene on the first display screen and the second outside scene, respectively Before displaying on the second display screen, the method further includes: acquiring the human visual field data; determining the blind spot data outside the vehicle caused by the A-pillar in the vehicle according to the human visual field data; determining a third shooting angle according to the blind spot data outside the vehicle; respectively acquiring a first target outside scene and a second target outside scene corresponding to the third shooting angle in the first outside scene and the second outside scene; comparing the first target outside scene with the second target The scene outside the vehicle is displayed on the first display screen and the second display screen respectively. The vehicle-mounted display method based on the A-pillar of an automobile according to claim 3, characterized in that, after the third camera and the fourth camera are controlled to collect the driver's face image, the method further includes: Invoke a preset face detection algorithm to detect whether the face image has a face area image; when the detection result is that the face image has a face area image, acquire the face area image; whether the position of the human eye is included in the image of the face region; when the detection result is that the position of the human eye is not included in the image of the face region, determine the target camera group corresponding to the face image that does not include the position of the human eye; The described target camera group captures the scene at the current shooting angle. An on-board display system based on the on-board display device based on any one of the above-mentioned claim items 1 to 2, wherein the on-board display system based on the automobile A-pillar comprises: A face image acquisition module is used for controlling the third camera and the fourth camera to collect the driver's face image when the data processing device receives an opening instruction; a head data calculation module is used for according to the The face image is used to calculate the head twist data of the driver; the target face acquisition module is used to adjust the first shooting angle of the third camera and the fourth camera according to the head twist data, to collect the target face image of the driver; a visual field data calculation module is used to determine the position of the human eye in the target face image, and calculate the driver's visual field data according to the position of the human eye; The outside scene collection module is configured to adjust the second shooting angle of the first camera and the second camera according to the human eye field of view data, so as to collect the first outside scene and the second outside scene; the outside scene display module, with The first outside scene and the second outside scene are displayed on the first display screen and the second display screen respectively. A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the on-board display method based on the A-pillar of an automobile as described in any one of claim items 3 to 8 are realized. .

Images