TW201930113A - Video display control method and system capable of actively adjusting and displaying expected blind spot area according to driving status - Google Patents

Abstract

The present invention provides a video display control method and system for actively monitoring the blind spot out of vehicle body, wherein an image processing device receives the wide-angle images captured by a wide-angle camera mounted on a vehicle body; selecting a partial area position in the wide-angle image as the displaying range; capturing the corresponding real-time image to be displayed on a display device; adjusting the displaying range to be at the area position in the wide-angle image based on the received trigger signal; and, capturing the corresponding real-time image after adjustment to be displayed on the display device.

Description

Photographic imaging control method and system

The present invention relates to a driving monitoring device, in particular to a photographic imaging control method and system with a simple structure, wide applicability, and capable of actively adjusting and displaying the expected visual dead angle area according to the driving state.

Driving safety has always been the top priority of traffic safety. For drivers, it is inevitable that there are hard-to-see visual dead-end areas when driving, especially large vehicles such as buses, large trucks, gravel cars, and even containers. Large vehicles such as cars and connected cars have high dead seats and long bodies, and there are many dead angles in the side and rear fields of view.Because of their heavy weight, long wheelbase, and large turning radius, it is difficult to get the car in the driving process. The body responds immediately, so traffic accidents caused by visual dead ends are endless and often cause irreparable injuries.

There are currently known various surveillance systems that use side or rear cameras to assist drivers in observing blind spots. However, due to the changing conditions during travel, there are different needs, and conventional products are difficult to meet the needs of use; for example, The relative angle of the car body changes when the connected vehicle turns, causing the side cameras to not capture the dead-end areas that need to be observed when turning, or the cameras located behind the car body. Observe the vehicle conditions or obstacles behind the vehicle body, but due to the limited shooting angle, it is difficult to provide the driver with the information to determine the distance when reversing; although the above situation can use multiple photography lenses or wide-angle photography lenses with sufficient shooting angles Improvement, but multiple lenses will inevitably increase the cost of equipment and installation, and excessive display screens are not conducive to observation while driving. Furthermore, if a wide-angle image with an excessively wide range is displayed on the display screen, To make the proportion of the dead angle area required for important observation in the screen too small is also unfavorable for the driver to observe while driving.

In addition, these known auxiliary photographic devices are limited by the original car body or other factors. The installation must be considered to avoid damage to the car body. Therefore, the photographic lens is mostly installed outside the car body such as the rearview mirror. ; Although there is another way to track the dead-end area with a rotating photographic lens to respond to changes in driving conditions, practically based on the design of the rotating lens mechanism, waterproofing, control, etc., as well as the consideration of the installation and wiring of the car body structure, etc. , It will cost a lot of money, and it is difficult to be widely applicable to various types of cars.

In view of this, how to find a monitoring device or mode that can be widely applied to drivers under the circumstances of meeting installation and cost considerations is a subject that has been in the art for improvement.

The present invention provides a method and system for controlling photographic imaging. Its main purpose is to save costs and meet installation requirements with a small amount of equipment. It can be widely applied to various vehicle carriers and actively adopts simple control mechanisms. According to the driving conditions, the imaging range of the key dead corner areas to be observed is adjusted to meet the needs of immediateness and visibility during driving, and to improve the shortcomings of existing products and applications.

The invention is suitable for being applied to the architecture of a vehicle body, and is capable of actively adjusting and monitoring the visual dead angle outside the vehicle body according to the driving conditions. The technical measures adopted by the invention mainly use a wide-angle photography device to shoot a wide-angle image with a sufficient viewing angle. The image processing device is used to capture the bureau according to actual needs The display range of the part is displayed on the display device, and the display range can be actively adjusted according to the trigger signal during driving, so as to adapt to changes in various driving conditions.

The photographic imaging control method provided by the present invention includes the following steps: providing a wide-angle photographing device installed on the vehicle body; the wide-angle photographing device taking instant wide-angle images outside the vehicle body; and an image processing device. Receiving the wide-angle image, and selecting a local area position in the wide-angle image as a display range, and capturing the real-time image of the corresponding position in the wide-angle image using the display range, and displaying the real-time image on a display device; the image processing device receiving A trigger signal; the image processing device adjusts the position of the imaging range in the wide-angle image according to the trigger signal, and uses the adjusted imaging range to capture a real-time image of the corresponding position in the wide-angle image and display it on the display Device.

As for the photographic imaging control system provided by the present invention, according to the technical means of the present invention, the main structure includes a wide-angle photographing device, an image processing device, and a display device; wherein the wide-angle photographing device is installed on a vehicle body and is used for The wide-angle image outside the vehicle is captured in real time; the image processing device is a telecommunication connected to the wide-angle photography device to receive the wide-angle image captured by the wide-angle photography device, and a selected local area position in the wide-angle image is a display. Range, which captures the real-time image of the corresponding position in the wide-angle image with the display range and provides it to the display device for real-time display; and when the image processing device receives a trigger signal, the display is adjusted according to the trigger signal Position the area in the wide-angle image, and use the adjusted imaging range to capture a real-time image of the corresponding position in the wide-angle image for real-time display by the display device.

Preferably, the trigger signal can be one of a left turn signal, a right turn signal, a reversing signal, a speed signal, a steering wheel motion signal, or a user control signal; and the image processing device can shift, Expand or shrink the way to adjust the development range The position of the area in the wide-angle image can be shifted horizontally, vertically, or obliquely. In addition, in the process of image processing performed by the image processing device, The wide-angle image is modified into a flat image by a curved surface before the capturing action of the developing range, or the image is modified into a flat image by a curved surface after capturing the image of the developing range, and then provided to the display device as a plane. Image display.

In practice, the present invention is mostly applied to large vehicles, but it is not limited only to the application of large vehicles, and the invention can also be applied to transportation vehicles such as ships and unmanned vehicles that meet the driving elements; when installed, the wide-angle photography The device is usually installed on the side or rear side of the vehicle body, and is used to photograph the visual dead angle area on the side or rear side of the vehicle body.

In a feasible embodiment, the wide-angle photographing device can be installed at the side rear-view mirror of the connected vehicle body to shoot wide-angle images from the vehicle body to the wide area outside, and the image processing device can According to the application requirements, the local area position selected from the wide-angle image (that is, the dead angle area adjacent to the main body to be observed) is the imaging range. The real-time image of this range is displayed on the display device, and when the connected vehicle body is turning Can adjust the display range in the wide-angle image to the right or left according to the left turn signal, right turn signal, or the action signal of steering wheel rotation (still maintain the angle of view that can observe the side of the vehicle), and offset The real-time image in the rear range is displayed on the display device, so that the angle of the connected car body is changed in response to the turn.

In another feasible embodiment, the wide-angle photographing device can be installed on the side mirror of a general vehicle body or a non-connected vehicle body, for shooting wide-angle images from the vehicle body to the wide area outside, and the image The processing device can select a local area position from the wide-angle image (that is, the dead angle area adjacent to the main body to be observed) as the imaging range according to the usual use requirements. The real-time image of this range is displayed on the display device; and when When the car is turning, it can Turn right signal or action signal of steering wheel rotation, adjust the widening range of the wide-angle image (enlarge the angle of view of the side of the car body), and display the real-time image in the enlarged range on the display device, thereby reducing the You can better observe the condition of the side of the car body when cornering.

In another feasible embodiment, the wide-angle photography device can be installed at a relatively high position behind the body of the vehicle (usually the upper edge of the rear end), for shooting wide-angle images of the wide area from the rear edge of the lower edge to the rear. , And the image processing device can select a local area position (that is, a dead angle area mainly to be observed directly behind) from the wide-angle image as an imaging range according to the usual use requirements, and display the real-time image of this range on the display device for display ; When reversing, the display range in the wide-angle image can be adjusted downward according to the reversing signal of the shift gear (the angle of view of the rear and rear obstacles can be viewed from the top), and the range after the shift can be adjusted. The real-time image is displayed on the display device, so that the driver can determine the distance between the rear and the rear of the vehicle when the driver reverses.

In addition, when applied to any vehicle body, the image processing device can also expand or reduce the display range in the wide-angle image according to the speed signal (vehicle speed exceeds or falls below the preset standard value) while driving, and will expand or reduce The real-time image in the reduced range is displayed on the display device, so that the display ratio of the real-time image in the display device can be adjusted relatively, so that the driver can easily observe the dead angle situation of the focus enlargement at high speed, and can observe the more Wide dead angle range, improve the convenience of use.

In order to obtain a more specific understanding of the above-mentioned objects, features, and effects of the present invention, the preferred embodiments of the present invention are described in detail with the accompanying drawings as follows:

10‧‧‧wide-angle camera

20‧‧‧Image processing device

30‧‧‧ display device

40‧‧‧Trigger signal

50‧‧‧ body

A, C, E, G‧‧‧ Wide-angle photography area

A0, C0, E0, G0‧‧‧ Wide-angle image

B, D, F, H‧‧‧Image capture area

B1, D1, F1, H1‧‧‧ imaging range

B2, D2, F2, H2‧‧‧ imaging range

S01 ~ S05‧‧‧step

Figure 1 is a schematic diagram of the system infrastructure.

Figure 2 is a schematic diagram of the steps of the method.

Figures 3a and 4a are schematic diagrams of the photographed area of a preferred embodiment; Figures 3b and 4b are schematic diagrams of the imaging range capture of this embodiment.

Figures 5a and 6a are schematic diagrams of the photographing area of another preferred embodiment; Figures 5b and 6b are schematic diagrams of capturing the imaging range of this embodiment.

Figures 7a and 8a are schematic diagrams of the photographing area of yet another preferred embodiment; Figures 7b and 8b are schematic diagrams of capturing the imaging range of this embodiment.

Figures 9a and 10a are schematic diagrams of the photographing area of yet another preferred embodiment; Figures 9b and 10b are schematic diagrams of capturing the imaging range of this embodiment.

Please refer to FIG. 1 and FIG. 2. The basic composition of the system of the present invention includes a wide-angle photographing device 10, an image processing device 20, and a display device 30. The wide-angle photographing device 10 is installed on a vehicle body for Real-time shooting of wide-angle images outside the car; the image processing device 20 is a telecommunication connected to the wide-angle photography device 10 for receiving wide-angle images taken by the wide-angle photography device 10 for real-time image capture, adjustment of capture position, and surface correction The display device 30 is a telecommunication connected to the image processing device 20, and is used to receive the real-time image processed by the image processing device 20 and display it on the display screen for the driver to observe the desired visual dead angle condition.

In the embodiment of the present invention, for the technical method adopted in the photographic development process, the main operation flow includes: Step S01, providing a wide-angle photographing device 10 mounted on a vehicle body; and step S02, the wide-angle photographing device 10 Instantly capture a wide-angle image outside the vehicle; step S03, an image processing device 20 receives the wide-angle image, selects a local area position in the wide-angle image as an imaging range, and captures the imaging range using the imaging range. The corresponding position in the wide-angle image is The time image is displayed on a display device 30; in step S04, the image processing device 20 receives a trigger signal 40; in step S05, the image processing device 20 adjusts the position of the display range in the wide-angle image according to the trigger signal 40 The real-time image of the corresponding position in the wide-angle image is captured with the adjusted display range and displayed on the display device 30.

The trigger signal 40 may be a left-turn signal, a right-turn signal, a reversing signal, a speed signal, or an action signal for steering wheel rotation that is automatically generated by driving conditions, or may be a manual control signal generated by a user operation; generally speaking Although this embodiment takes the vehicle architecture as an example, it can actually be applied to vehicles with the same driving state. The trigger signal 40 may be generated along with the driving state of the vehicle and triggered according to preset conditions. For example, the trigger signal 40 is generated according to different driving conditions such as the speed when moving forward, or steering, or reverse; and the image processing device 20 can actively and synchronously adjust the imaging range to the wide-angle image according to the trigger signals 40 described above. The position of the area can be adjusted to offset or zoom according to actual needs. The offset includes moving in any direction up, down, left, and right, or even obliquely. The zoom is based on one side. Basic, expanding or shrinking to the other side; in addition, the image processing device 20 includes a surface modification process Process, which can be real-time video-based composition or a surface of the wide-angle image correction developing capture range, and a display device 30 for display to the image plane.

In the following, according to the actual application of the present invention, it is divided into several embodiments for more detailed introduction. Please refer to Figs. 3a to 4b, which are the application forms of the first embodiment of the present invention, which are mainly applied to similarly-connected car bodies. 50 structure (such as a large connected truck). In this example, the wide-angle photographing device 10 is installed in the rear-view mirror on the side of the vehicle body 50, and is used to photograph from the body to the outside. A wide-angle photographing area A with a wide area on the side; as shown in Figs. 3a and 3b, in a normal straight state, after the image processing device 20 receives the wide-angle image A0 captured by the wide-angle photographing device 10, the image processing device 20 can Set the conditions, select the local area position from the wide-angle image A0 (that is, the image capture area B adjacent to the vehicle body) as the imaging range B1, and use this imaging range B1 to capture the real-time image of the corresponding position in the wide-angle image A0. It is displayed on the screen of the display device 30 at a better ratio; and when the driving state changes, as shown in Figs. 4a and 4b, the angle of the head and the body changes when the connected vehicle body 50 turns. As shown in the image range B1, most of them will show the appearance of the car body, which is not good for observing the dead corner area outside the car body. Therefore, the image processing device 20 of this embodiment can receive signals such as a left turn signal, a right turn signal, or a steering wheel when the vehicle body 50 turns. The trigger signal 40 of the action signal, and according to these trigger signals 40, the imaging range B2 in the wide-angle image A0 is shifted to the right or left (as shown in FIG. 4b), and the shifted imaging range is captured Corresponding instant movie in B2 , Displayed on the display device 30, so that the image capturing area B (as shown in FIG. 4a) is still maintained at the viewing angle of the side of the vehicle body, so as to respond to the change in the angle of the connected vehicle body 50 when turning to achieve the optimal dead angle for tracking display Area effect.

Please refer to Figs. 5a to 6b, which are application forms of the second embodiment of the present invention, which can be mainly applied to any type of vehicle body 50 structure (such as medium and large trucks that cannot be directly rear-viewed directly). In this example, the wide-angle photographing device 10 is installed at the upper edge of the rear of the vehicle body 50, and is used to photograph the wide-angle photographing area C in the wide area from the rear of the lower edge to the rear; as shown in Figures 5a and 5b When the general vehicle body 50 is moving forward, after receiving the wide-angle image C0 shot by the wide-angle photography device 10, the image processing device 20 can select a local area position from the wide-angle image C0 according to requirements or system preset conditions (i.e. The image capture area D) to be observed directly behind is the imaging range D1, and the real-time image of the corresponding position in the wide-angle image C0 is captured with this imaging range D1 to compare A good ratio is displayed on the screen of the display device 30, so that the driver can observe the rear vehicle condition. When the vehicle body 50 is reversing, if the original display range D1 of the rear viewing angle is used for display, the driver will not be able to identify the rear and the The distance of the obstacles in the rear, so as shown in Figures 6a and 6b, when the image processing device 20 of this embodiment reverses the vehicle body 50, it can receive a trigger signal 40 such as a reverse signal, and adjust the wide-angle image based on the trigger signal 40. The development range D2 in C0 is shifted downward (as shown in FIG. 6b), and the corresponding real-time image in the shifted development range D2 is captured and displayed on the display device 30, so that the image acquisition area D (As shown in Figure 6a) can form an angle of view observing the rear of the vehicle and the rear obstacles, so that the driver can determine the distance when reversing the vehicle, to avoid the impact of obstacles or pedestrians.

Please refer to Figs. 7a to 8b, which are the application forms of the third embodiment of the present invention, which are mainly used in a non-connected body 50 structure (such as a bus). In this example, a wide-angle photography device 10 is installed in The rear-view mirror on the side of the vehicle body 50 is used to shoot a wide-angle photographing area E from the vehicle body to the wide area outside. As shown in Figs. 7a and 7b, the image processing device 20 is receiving After the wide-angle image E0 captured by the wide-angle camera 10 is selected, the local area position (that is, the image capture area F adjacent to the vehicle body) from the wide-angle image E0 can be selected as the imaging range F1 according to requirements or system preset conditions. And use this display range F1 to capture the real-time image of the corresponding position in the wide-angle image E0, and display it on the screen of the display device 30 at a better ratio; while the vehicle body 50 is turning, although it does not have a body like a connected car The problem of angle change, but because the vehicle body 50 has a long wheelbase and a large turning radius, if the original imaging range F1 is still displayed, it will be difficult to observe the situation of the original side and rear after turning, so as shown in Figure 8a and 8b As shown, the image processing apparatus 20 of this embodiment is mounted on the vehicle body 50 The bending can receive the trigger signal when the left signal, right turn signal or operation signals steering wheel 40, and F2 in accordance with the left or right to expand the scope of such imaging trigger signal 40 adjusted in the wide-angle video E0 (As shown in FIG. 8b), and capture the corresponding real-time image in the enlarged imaging range F2 and display it on the display device 30, so that the image capture area F (as shown in FIG. 8a) can still be observed The original rear angle of view can provide the driver with a better view of the rear of the vehicle body 50 when turning at a reduced speed.

In addition, in other feasible embodiments (applicable to any vehicle body 50), the image processing device 20 may also use the speed signal during driving as the trigger signal 40. For example, when the vehicle speed exceeds a preset value or falls below a preset value, Adjust the area of the imaging range in the wide-angle image by expanding or reducing, and display the real-time image captured by the adjusted imaging range on the display device 30. In practice, when the vehicle speed is high, the imaging range can be Adopting a narrowing method, the real-time image captured at the narrowed imaging range can be displayed on the display device 30 at a larger ratio, and vice versa. When the vehicle speed is low, the imaging range can be expanded. , So that the real-time image captured by the expanded imaging range can be displayed on the display device 30 in a small proportion; thereby, the driver can easily observe the dead angle situation of the focus enlargement at high speed, and at low speed can Observe a wider range of dead angles to improve the convenience of use.

According to the foregoing description, the photographic image display control technology of the present invention is mainly applicable to large vehicles, and the dead angle conditions in response to changes in the car body in a timely manner can also be fully applied to small and medium-sized vehicles. When driving, you can automatically adjust the zoom of the imaging range according to high or low speed (that is, the size of the imaging range of the horizontal direction photographic screen), so that the driver can observe more easily when driving; and in practice, there can be more control mechanisms As shown in Figs. 9a to 10b, it is the application form of the fourth embodiment of the present invention, and is applied to the structure of the body 50 of a small vehicle. The wide-angle photographing device 10 is installed in the backside of the side of the body 50. A wide-angle photographing area G (horizontal front) For example, the horizontal direction is taken as an example, and this fourth implementation is taken as an example for the vertical direction); as shown in Figures 9a and 9b, in a state of normal forward and a certain speed (it can be assumed that the previous embodiment is driving at a low speed) State), after receiving the wide-angle image G0 captured by the wide-angle camera 10, the image processing device 20 can select a local area position (i.e., adjacent to the vehicle body and having a proper height) from the wide-angle image G0 according to requirements or system preset conditions. The image capture area H) is the display range H1, and the real-time image of the corresponding position in the wide-angle image G0 is captured with the display range H1, and displayed on the screen of the display device 30 at a better ratio for the driver Observe the driving situation on the rear side; and when the vehicle body 50 is at a slow speed (ie, a lower speed, such as when parking or reversing), in order to avoid collision with low obstacles on the side when stopping, as shown in Section 10a As shown in Fig. 10b, the image processing device 20 of this embodiment can receive a trigger signal 40 generated by a vehicle speed signal when the vehicle body 50 is slowing down, and adjust the imaging range H2 in the wide-angle image G0 to face downward according to the trigger signal 40. Offset (as shown in Figure 10b) The corresponding real-time image in the shifted imaging range H2 is captured and displayed on the display device 30, so that the image capture area H (as shown in FIG. 10a) can form a perspective from which the vehicle is viewed from below and below. Allows the driver to determine the distance to side obstacles (such as the distance to low-profile obstacles such as sidewalks, pot plants, and gutters) when stopping, to prevent side collisions.

As described above, the present invention can capture real-time images at appropriate positions as the development range according to the requirements of use, and present them on the display device at a better ratio. In addition, it can automatically adjust the development range according to the trigger signal generated by the driving conditions. The position of the area is automatically adjusted according to the trigger signal generated by the user's operation, so as to achieve the purpose of displaying the best visual dead angle area according to the needs.

However, the above is only a description of the preferred embodiments of the present invention and is not intended to limit the scope of protection of the present invention. The specific scope of protection shall be based on the scope of patent application. For example, any simple extension or change made according to the technical means of the present invention or Equivalent replacements should fall into the patent of the invention Within range.

Claims (10)

A photographic imaging control method is applied to a vehicle body for actively monitoring the visual dead angle outside the vehicle body, and includes the following steps: providing a wide-angle camera device installed on the vehicle body; Shooting a wide-angle image outside the vehicle; receiving the wide-angle image by an image processing device, selecting a local area position in the wide-angle image as an imaging range, and using the imaging range to capture a corresponding position in the wide-angle image The real-time image is displayed on a display device; the image processing device receives a trigger signal; the image processing device adjusts the position of the imaging range in the wide-angle image according to the trigger signal, and captures the adjusted imaging range A real-time image at a corresponding position in the wide-angle image is displayed on the display device. According to the photographic imaging control method described in item 1 of the scope of patent application, the trigger signal may be one of a left turn signal, a right turn signal, a reversing signal, a speed signal, a steering wheel motion signal, or a user control signal. According to the photographic development control method described in item 1 of the scope of the patent application, the position of the area of the adjusted development range may be a shift, expansion, or reduction of the position of the area before adjustment. The photographic imaging control method according to item 1 of the scope of the patent application, wherein the wide-angle photographing device is installed at a side or rear side of the vehicle body for photographing the visual dead angle of the outside or rear side of the vehicle body region. According to the photographic development control method described in item 1 of the scope of the patent application, wherein the image processing device is capable of correcting the wide-angle image or the image captured by the development range into a planar image through a curved surface. A photographic imaging control system is applied to a vehicle body for actively monitoring the body of the vehicle The visual dead angle includes: a wide-angle photographing device, which is installed on the vehicle body to take a wide-angle image outside the car in real time; an image processing device, which is connected to the wide-angle photography device by telecommunications, to receive the wide-angle The wide-angle image captured by the photographing device, and a selected area of the wide-angle image as a display range, and the real-time image of the corresponding position in the wide-angle image is captured with the display range and provided to a display device for real-time display; Wherein, when the image processing device receives a trigger signal, it adjusts the position of the imaging range in the wide-angle image according to the trigger signal, and captures the real-time of the corresponding position in the wide-angle image with the adjusted imaging range. An image for the display device to display in real time. According to the photographic imaging control system described in item 6 of the scope of patent application, the trigger signal may be one of a left turn signal, a right turn signal, a reversing signal, a speed signal, a steering wheel motion signal, or a user control signal. According to the photographic development control system described in item 6 of the scope of the patent application, the position of the area of the adjusted development range may be a shift, expansion, or reduction of the position of the area before adjustment. The photographic imaging control system according to item 6 of the scope of the patent application, wherein the wide-angle photographing device is installed at the side or rear side of the vehicle body for shooting the visual dead angle of the outside or rear side of the vehicle body region. According to the photographic imaging control system described in item 6 of the patent application scope, wherein the image processing device is capable of correcting the wide-angle image or the image captured by the imaging range into a planar image through a curved surface.