WO2023006832A1 - Camera monitor system, vehicle therewith and method for adjusting the same - Google Patents

Camera monitor system, vehicle therewith and method for adjusting the same Download PDF

Info

Publication number
WO2023006832A1
WO2023006832A1 PCT/EP2022/071114 EP2022071114W WO2023006832A1 WO 2023006832 A1 WO2023006832 A1 WO 2023006832A1 EP 2022071114 W EP2022071114 W EP 2022071114W WO 2023006832 A1 WO2023006832 A1 WO 2023006832A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
imager
active
controller
imager area
Prior art date
Application number
PCT/EP2022/071114
Other languages
French (fr)
Inventor
Alexander SLAMA
Original Assignee
Motherson Innovations Company Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motherson Innovations Company Ltd. filed Critical Motherson Innovations Company Ltd.
Priority to EP22760875.9A priority Critical patent/EP4377153A1/en
Publication of WO2023006832A1 publication Critical patent/WO2023006832A1/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/69Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/306Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using a re-scaling of images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/70Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by an event-triggered choice to display a specific image among a selection of captured images
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8046Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for replacing a rear-view mirror system
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/443Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming

Definitions

  • the present disclosure relates to a camera monitor system for a motor vehicle, in particular in the form of a truck, preferably with a trailer, comprising: a camera adapted to be attached to a motor vehicle and having at least one field of view (FOV), and a controller, wherein the camera comprises a lens with a lens center axis and an imager, and wherein the imager has an imaging center aligned with the lens center axis and an array of pixels which is divided into a first imager area and a second imager area, wherein the first imager area has a first imager area center which is offset from the lens center axis. Further, the disclosure relates to a vehicle comprising such camera monitor system as well as a method for adjusting said camera monitor system.
  • FOV field of view
  • Mirror systems may consist of two or more mirrors of different sizes and with different mirror curvatures to detect areas of importance of the surroundings of the vehicle.
  • Mirror systems consisting of several mirrors have the disadvantage that the system has to be adjusted carefully not to generate non- visible zones between the provided rear views of each mirror leading to an inadequately fulfilled mirror purpose.
  • exterior mirrors with remotely controlled adjusting devices for position adjustment are complex, cost-intensive and large-volume components that project far from the vehicle.
  • mirror systems consisting of several individual mirrors spaced apart may cause unwanted glare to the driver if the sun or other bright light sources are unfavorable to the vehicle.
  • mirror replacement systems are already generally known as camera monitor systems.
  • a mirror replacement system comprises at least one camera which captures and records the surrounding of the vehicle, a control unit to which image data from the camera are fed for processing, and at least one monitor as a screen in the field of vision of a driver which is connected to the control unit to display a monitor image of the current camera image captured by the camera.
  • EP 3 138 736 A1 discloses such a camera monitor system, where the monitor screen displays a static camera view, which is overlaid by additional information also displayed on the monitor screen by the control unit. Depending on the amount and content of information, such information may help the driver while driving and can thus contribute to safety and/or relieve the driver of his driving tasks.
  • information displayed on the monitor screen may reduce the rear view area being visible to the driver or distracts the driver's attention from the rear-view mirror image.
  • EP 3 256 345 B1 discusses a driver assistance system for a motor vehicle, having an environment camera with an image sensor and an optical system which jointly form a digital exterior mirror.
  • the digital exterior mirror is configured such that at least two visual field areas, having different image scales, are mapped.
  • displayed information on the digital mirror is predefined. Improved safety may require flexibility in altering the defined field of views (FOV) based on input from the imager and vehicle.
  • FOV field of views
  • EP 3 010 761 B1 discusses a vision system of a vehicle includes a camera having a lens and a two dimensional imaging array sensor.
  • the camera captures image data and the imaging array sensor has a center region with a lens having a center axis.
  • the lens is disposed at the imaging array sensor with the center axis of the lens laterally offset from the center region of the imaging array sensor. This arrangement offers a single camera viewing setup for all vehicle conditions and does not allow the flexibility of defining an active area of the imaging sensor dynamically based on vehicle and camera inputs.
  • US 2020/0357139 A1 discloses a method for determining blockage of a vehicular camera includes providing a camera and mounting the camera at a vehicle so as to view exterior of the vehicle.
  • the control determines at least one selected from the group consisting of (i) that the imaging sensor is totally blocked by determining that the count of bright photosensor pixels of the camera's imaging sensor remains below a threshold, and (ii) that the imaging sensor is partially blocked by determining continuity of intensity variations in different regions of the imaging sensor.
  • the control responsive to determination of either total blockage or partial blockage of the imaging sensor of the camera, adapts image processing by the image processor of frames of image data captured by the camera to accommodate (i) the determined total blockage of the imaging sensor of the camera or (ii) the determined partial blockage of the imaging sensor of the camera. It would be desirable to have a dynamically adaptable display providing all situational necessary information to the driver in order to provide a more complete view to the areas of importance to the driver of a motor vehicle in order to support the driver.
  • the first imager area is an active imager area defined by an array subset of activated pixels
  • the second imager area is an inactive imager area defined by an array subset of deactivated pixels
  • the controller only receives image data from the activated pixels in the active imager area and not from the deactivated pixels in the inactive imager area.
  • a camera monitor system for a motor vehicle which comprises a camera attached to a motor vehicle having at least one field of view (FOV) directed at least rearward of the vehicle, wherein the camera comprises a lens with a lens center axis and an imager having an array of pixels and an imaging area center aligned with the lens center axis, with the alignment being within common tolerances.
  • the array of pixels is divided into an active imager area defined by an array subset of activated pixels and an inactive imager area defined by an array subset of deactivated pixels; wherein the active imaging area has an active imager area center which is offset from the lens center axis.
  • an active imager area By defining an active imager area with pixels, which are activated, allows for the desired frame rate or image resolution to be achieved by changing the amount of image data that is sent from the imager. This creates an adjustable active imager area which can be optimized to improve driver viewing quality and safety.
  • the controller defines the dimensions of at least the active imager area.
  • the dimensions of the active imager area may be determined by frame rate, image resolution and/or by at least one vehicle parameter of the group of vehicle velocity, steering angle, engine on/off, blinker settings on/off right/1 eft, traffic situation around the motor vehicle, driving direction forwards/backwards, glare, recognized traffic signals and lane marks, and hazard detection.
  • the at least one FOV is located within the lens and the active imager area.
  • Another embodiment includes a display viewable by a driver of the motor vehicle, wherein the display is operable to display images derived from the active imager area.
  • the images displayed from the active imager area may correspond to selected FOV, and/or the images displayed from the active imager area may include at least one supplemental area outside a defined FOV, and/or the images displayed from the active imager area may include two or more FOVs.
  • a display may be needed to simulate a rear view mirror
  • the present disclosure also provides the possibility to oversee expanded regions of interest, that are not needed to be shown on a display, but rather are needed for machine vision in particular for object and/or hazard detection and classification.
  • An image next to a trailer end may be presented on the display to the driver of a truck by adapting the FOV and/or active image area to the area next to the trailer end even when turning the truck by surveilling the trailer end and taking the respective date into account.
  • the active imager area may be used for object detection. It is also possible that the active imager area and/or the inactive imager area is/are used for machine vision.
  • the present disclosure also provides a motor vehicle, in particular in the form of a truck, preferably with a trailer, comprising a camera monitor system as in one of the preceding embodiments.
  • the disclosure further relates to a method for adjusting a motor vehicle camera monitor system of the present disclosure.
  • Said method comprises a first step of verifying that the imager and the lens are calibrated to system requirements by aligning the imager center of the imager with the lens center axis of the lens. Said alignment might not be 100% due to usual production tolerances.
  • This first step may further comprise selecting at least one initial FOV and/or mirror class(es) by the controller for defining an initial active imager area with an upper boundary and a lower boundary, which includes the selected FOV and/or mirror class(es), wherein the controller may only receive image data from the active pixels in the active imager area.
  • This first step may still further comprise determining the center of the imager, the center of the lens and the center of the active imager area, wherein the offset between the active imager area and the center of the lens may be calculated and used by the controller.
  • the initial setting of the active imager area may be done at the time of assembly to the motor vehicle and/or the setting of the active imager area may be adjustable, preferably dynamically and/or during driving the motor vehicle.
  • the setting adjusting may be based on data received from a driver, the vehicle, another road user and/or a remote device, in particular via a satellite.
  • the display may receive and display the selected FOV image data received from controller and/or is displaying the at least one FOV image.
  • Said method may comprise a second step of monitoring inputs, selected from a group comprising image data frame rate, image resolution, and/or vehicle setttings, while the vehicle is operational, wherein preferably the inputs are sent to the controller.
  • Vehicle settings received by the controller may comprise vehicle velocity, steering angle, engine on/off, blinker settings on/off right/left, traffic situation around the motor vehicle, driving direction forwards/backwards, glare, recognized traffic signals and lane marks and/or hazard warnings.
  • the controller may determine in the second step the array subset of activated pixels used to define the active imager area based on the inputs, wherein, if the inputs received by the controller are determined to match a different FOV requirement for mirror class or supplemental area, the array subset of activated pixels of the active imager area may be dynamical adjusted to expand or restrict the number of active pixels sending data to the controller.
  • Said method may comprise a third step of showing the images displayed on the display with the new FOV and/or mirror class(es) based on the determination of the controller.
  • the desired FOV and the active imager area may be continuously monitored in loops during the operation of the vehicle, and the controller may dynamically adjusts the array subset of activated pixels used to define the active imager area based on the monitored inputs.
  • the above listed embodiments can be used individually or in any combination to provide the device and the process in accordance with the disclosure.
  • Fig.1 a block diagram illustrating a configuration of a camera monitor system according to the present disclosure
  • Fig. 2 a top view of a motor vehicle, specifically a truck, illustrating exemplary field of view regions for a vehicle camera monitor system according to the present disclosure
  • Fig.3 a schematic view of a camera with a first exemplary active imager area for the camera monitor system according to the present disclosure
  • Fig.4 a schematic view of the camera with a second exemplary active imager area for the camera monitor system according to the present disclosure
  • Fig. 5 a schematic view of the camera with a third exemplary active imager area for the camera monitor system according to the present disclosure
  • Fig.6 a method of the designation of the imaging area for the camera monitor system according to the present disclosure.
  • Fig. 1 shows a block diagram illustrating a configuration of a camera monitor system 10.
  • the camera monitor system 10 includes a camera 12 with an imager 14 and a lensl6, a controller 18 and a display 20.
  • the imager 14 may be a high resolution imaging array sensor having an array of pixels with a defined center or other image sensor capable of having an array of pixels with a defined center.
  • the controller 18 receives the image data from the camera 12 and may control settings for the imager 14.
  • the controller 18 may also be connected to Controller Area Network (CAN) bus of the motor vehicle 22 (Fig. 2) to send or receive inputs from the motor vehicle.
  • the imager control settings may be based on inputs such as data frame rate desired, data resolution and/or on certain vehicle settings received by the controller 18.
  • CAN Controller Area Network
  • Vehicle settings which may be received by the controller 18 and utilize for imager control may be chosen from vehicle velocity, steering angle, engine on/off, blinker settings on/off right/left, traffic situation around the motor vehicle 22, driving direction forwards/backwards, glare, recognized traffic signals and lane marks, hazard warnings and/or other vehicle settings.
  • the display 20 receives the image data from the controller 18 and displays the information to a vehicle operator.
  • the display 20 may be located inside the vehicle 22, external to the vehicle 22 or be a mobile device, which is capable of receiving image data from the controller 18.
  • the display 20 illustrates exemplary images for two different field of view (FOV) representing two defined mirror class areas. Shown is a mirror class II area 24 and a mirror class IV area 26. A single mirror class area, other selected mirror class areas, or images outside the defined mirror class area may also be shown in the display 20 as determined by the controller 18.
  • FOV field of view
  • Fig.2 a top view of a motor vehicle 22, specifically a truck in this example, illustrates two exemplary field of view (FOV) regions for a camera monitor system 10.
  • a FOV defined as mirror class II area 24 and a FOV defined as mirror class IV area 26 are illustrated in relation to the motor vehicle 22.
  • the camera monitor system 10 includes a camera 12 (Fig. 1) mounted to the motor vehicle 22 preferably on the side of the vehicle 22, with a field of view (FOV) that is illustrated in this view to be rearward and downward (Class II and Class IV).
  • FOV areas which may be utilized by the camera monitor system 10 including as a non-limiting FOV examples of a forward view and/or an interior view (such as a mirror Class V area a mirror Class VI area, and/or a mirror class III area).
  • the camera monitor system 10 may supplement an existing rear view mirror system (not shown) typically found on a motor vehicle 22 or may replace the existing rear view mirror system.
  • FOV representing mirror classes for the vehicle are legally required to be displayed which may include the Class II, Class III, Class IV, Class V and/or Class VI described above.
  • Fig. 2 illustrates the camera monitor system 10 utilizing the imager 14 with a partially defined active area (Fig.
  • a camera monitor system 10 in more than one location on the motor vehicle 22, such as the right side, left side, front or rear of the vehicle.
  • Fig. 3 illustrates a schematic view of a camera 12 having an imager 14 with a first exemplary active imager area 32 and an exemplary geometry for the lens 16.
  • the lens 16 is illustrated as an example to have a circular geometry with a defined lens center axis 36.
  • the lens may also have a different geometry such as an oval shape with a defined center within the scope of this disclosure.
  • the imager 14 is defined as the full sensor with all available pixels in the array activated to send image data to the controller 18 (as seen in Fig. 1).
  • the imager 14 is sized to be at least as large as the lens 16 geometry but may be larger than the lens 16 as shown in Fig. 3.
  • Using a larger imager 14 provides flexibility for defining and viewing the desired FOV mirror class(es) and surrounding areas as requested by the controller 18 (Fig. 1).
  • the imager 14 has a defined imager center 34 aligned with the lens center axis 36.
  • the exemplary lens 16 orientation illustrated in Fig. 3 is horizontal.
  • the imager 14 may also be orientated at other angles including vertical within the scope of this disclosure as long as the imager 14 center aligns with lens center axis and contains the desired FOV.
  • Use of the entire available pixels from the imager 14 may produce more data than may be transferred to the controller 18 at a desired frame rate.
  • the amount of image data transferable to meet a desired frame rate may be addressed by defining an array subset of activated pixels for active imager area 32 illustrated In Fig. 3 as a grey zone.
  • the active imager area 32 is defined by the controller 18 utilizing inputs from the image resolution desired, the desired image frame rate, and/or vehicle settings such as vehicle speed.
  • Some pixels of the imager 14 are designated as an inactive imager area 33 defined by an array subset of deactivated pixels (illustrated as a white zone).
  • the inactive imager area 33 occurs where pixels are inactivated by the controller 18 and do not transmit image data to the controller 18.
  • the imager 14 is sized such that at the highest image resolution for the camera monitor system 10 (Fig. 1), the active imager area 32 still contains the required mirror class(es) for the motor vehicle 22 (Fig. 2) which can be transferred at the desired frame rate.
  • the first exemplary active imager area 32 includes a FOV mirror class II area 24 and a FOV mirror class IV area 26 at a high resolution.
  • the active imager area 32 also defines an active imager area center 38. As illustrated, the active imager area center 38 is offset from the imager center 34 and the lens center axis 36. This offset may vary depending on the defined active imager area 32 being utilized by the controller 18.
  • the image data received by the controller 18 from the active imager area 32 may also be used for object detection.
  • the active imager area 32 is defined by selecting the pixel lines from the entire imager 14 area. These selected pixel lines are activated by the controller 18 (Fig. 1) to send image data.
  • the imager 14 starts reading from a lower boundary 40 of the selected active imager area 32 to an upper boundary 42.
  • the imager 14 may also start by reading data from the upper boundary 42 to the lower boundary 40.
  • the controller 18 defines the lower boundary 40 and the upper boundary 42 for the imager 14 based on inputs including which mirror class images are to be displayed on the display 20 (Fig. 1).
  • the active image area 32 has been defined as illustrated in Fig. 3 to include the mirror class II area 24 and the mirror class IV area 26.
  • the imager 14 then starts to read image data horizontally from the upper boundary 42 to the lower boundary 40 for the mirror class IV area 26 and for the mirror class II area 24.
  • This method requires much less data storage than transferring data from all imager pixels and processing the image at the controller 18.
  • the display 20 shown in Fig. 1 in a vertical orientation. In this orientation, the imager reads the image data in row format as shown in Fig. 3. As soon as a row of image data has been read for the mirror class II area 24 and the mirror class IV area 26, that image data is used to produce a single image column for the display 20 as illustrated in Fig. 1.
  • the controller 18 determines which pixels are used for the mirror class II area 24 and which are used for the mirror class IV area 26 area and the images are displayed on the display 20.
  • the controller 18 transmits the images received from the active imager area 32 to the display 20. These images from the active imager area 32 are viewable by the operator of the vehicle on the display 20. In another example, the image data may also be read vertically and displayed horizontally on the display 20 as determined by the orientation of the camera monitor system 10 and the display 20.
  • Fig. 4 illustrates a schematic view of a camera 12 having an imager 14 with a second exemplary active imager area 32a and an exemplary geometry for the lens 16.
  • the active imager area 32a has been enlarged to cover additional mirror class viewing areas.
  • a FOV for mirror Class V area 44 and a FOV for mirror Class VI area can be imaged and displayed within a new defined lower boundary 48a and an upper boundary 50a.
  • the active imager area 32a has a new defined active imager center 38a offset from the imager center 34 and the lens center axis 36.
  • the larger active imager area 32a is offset by smaller inactive imager areas 33a allowing more pixels to transmit image data to the controller 18.
  • the function of the second exemplary active imager area 32a is the same as the first exemplary active imager area 32 describe in Fig. 3.
  • the image data is read from the upper boundary 50a to the lower boundary 48a producing an image frame rate from this second exemplary active imager area 32a.
  • the new image frame rate still conforms to the desired frame rate requirements for image data transfer.
  • the image resolution may be decreased over the image resolution of the first exemplary imager area from Fig. 3 in order to achieve the desired frame rate.
  • this second exemplary active imager area 32a may be used when the motor vehicle 22 is performing a back- up maneuver at a lower speed allowing for a reduction in the image resolution and the expansion of the active imager area 32a.
  • Fig. 5 illustrates a schematic view of the camera 12 with a third exemplary active imager area 32b for the camera monitor system.
  • a single mirror class such as a FOV for mirror Class III area 52 with a third upper boundary 50b, a third lower boundary 48b, and an active imager area center 38b is shown.
  • the imager 14 in this exemplary illustration of Fig. 5 has a third active imager area 32b which includes the mirror class III area 52.
  • the function of a third exemplary active imager area 32b is the same as the first exemplary active imager area 32 describe in Fig. 3.
  • the controller 18 receives the image data from the active imager area 32b with no data received from the defined inactive imager areas 33b.
  • the controller 18 may only utilize the image data which contains the mirror class III area 52 for displaying on the display 20 or the display may include image data from a determined supplemental area 54 on the display 20.
  • the image data displayed on the display 20 is fluid and determined by the controller 18.
  • Fig. 6 illustrates a method 100 of the designation of the active imaging area for the camera monitor system. Said method comprising the following steps:
  • a first step 110 it is verified that the imager 14 and the lens 16 are calibrated to system requirements.
  • the imager center 34 of the imager 14 is aligned with the lens center axis 36 of the lens 16.
  • an initial FOV and/or mirror class(es) are selected by the controller 18. This initial selection is used to define an initial active imager area 32 with an upper boundary 50 and a lower boundary 48 (Fig. 3) which includes the selected FOV and/or mirror class(es).
  • the controller 18 will only receive image data from the active pixels in the active imager area 32,
  • the center of the imager 14, the center of the lens 16 and the center of the active imager area 32 are determined.
  • the offset between the active imager area 32 and the center of the lens 16 may be calculated and used by the controller 18.
  • the initial setting of the active imager area 32 may be done at the time of assembly to the motor vehicle 22.
  • the display 20 receives and displays the selected FOV image data received from controller 18.
  • step 120 while the vehicle is operational, inputs such as image data frame rate, image resolution, and/or vehicle setttings are monitored and may be sent to the controller 18.
  • Vehicle settings received by the controller 18 may be vehicle velocity, steering angle, engine on/off, blinker settings on/off right/1 eft, traffic situation around the motor vehicle (22), driving direction forwards/backwards, glare, recognized traffic signals and lane marks, hazard warnings and/or other vehicle settings. These inputs may be utilized by the controller 18 to determine the array subset of activated pixels used to define the active imager area (32, 32a, 32b).
  • the array subset of activated pixels of the active imager area 32 may be dynamical adjusted to expand or restrict the number of active pixels sending data to the controller 18. For example, a motor vehicle 22 in a back-up maneuver may have a reduction in vehicle speed. This decrease in vehicle speed allows the resolution of the imager to be reduced and the active imager area to be increased including additional mirror class viewing areas or the supplemental area 54.
  • Step 130 the images displayed on the display 20 are shown with the new FOV and/or mirror class(es) determined in Step 120.
  • the method 100 continuously monitors the desired FOV and the active imager area 32 by looping back to step 120 during the operation of the vehicle. This allows the controller 18 to dynamically adjusts the array subset of activated pixels used to define the active imager area (32, 32a, 32b) for different inputs from image resolution, frame rate, and/or vehicle settings.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)

Abstract

The disclosure relates to a camera monitor system (10) for a motor vehicle (22), in particular in the form of a truck, preferably with a trailer, comprising: a camera (12) adapted to be attached to a motor vehicle (22) and having at least one field of view (FOV) (24, 26, 44, 46, 52, 54), and a controller (18), wherein the camera (12) comprises a lens (16) with a lens center axis (36) and an imager (14), and wherein the imager (14) has an imaging center (34) aligned with the lens center axis (36) and an array of pixels which is divided into a first imager area (32, 32a, 32b) and a second imager area (33, 33a, 33b), wherein the first imager area (32, 32a, 32b) has a first imager area center (38, 38a, 38b) which is offset from the lens center axis (36). The first imager area (32, 32a, 32b) is an active imager area (32, 32a, 32b) defined by an array subset of activated pixels, the second imager area (33, 33a, 33b) is an inactive imager area (33, 33a, 33b) defined by an array subset of deactivated pixels, and the controller (18) only receives image data from the activated pixels in the active imager area (32, 32a, 32b) and not from the deactivated pixels in the inactive imager area (33, 33a, 33b). Further, the disclosure relates to a vehicle (22) with such a to a camera monitor system (10) as well as a method (100) for adjusting such a motor vehicle camera monitor system (10).

Description

Camera Monitor System, Vehicle therewith and Method for Adjusting the same
The present disclosure relates to a camera monitor system for a motor vehicle, in particular in the form of a truck, preferably with a trailer, comprising: a camera adapted to be attached to a motor vehicle and having at least one field of view (FOV), and a controller, wherein the camera comprises a lens with a lens center axis and an imager, and wherein the imager has an imaging center aligned with the lens center axis and an array of pixels which is divided into a first imager area and a second imager area, wherein the first imager area has a first imager area center which is offset from the lens center axis. Further, the disclosure relates to a vehicle comprising such camera monitor system as well as a method for adjusting said camera monitor system.
Motor vehicles are usually equipped with exterior mirrors on both sides in the driver's field of view, which detect the surrounding of the motor vehicle at least in a rear view direction. For some types of motor vehicles, mirror systems may consist of two or more mirrors of different sizes and with different mirror curvatures to detect areas of importance of the surroundings of the vehicle. Mirror systems consisting of several mirrors have the disadvantage that the system has to be adjusted carefully not to generate non- visible zones between the provided rear views of each mirror leading to an inadequately fulfilled mirror purpose. In addition, exterior mirrors with remotely controlled adjusting devices for position adjustment are complex, cost-intensive and large-volume components that project far from the vehicle. Furthermore, mirror systems consisting of several individual mirrors spaced apart may cause unwanted glare to the driver if the sun or other bright light sources are unfavorable to the vehicle.
Due to the above circumstances, mirror replacement systems are already generally known as camera monitor systems. Such a mirror replacement system comprises at least one camera which captures and records the surrounding of the vehicle, a control unit to which image data from the camera are fed for processing, and at least one monitor as a screen in the field of vision of a driver which is connected to the control unit to display a monitor image of the current camera image captured by the camera. EP 3 138 736 A1 discloses such a camera monitor system, where the monitor screen displays a static camera view, which is overlaid by additional information also displayed on the monitor screen by the control unit. Depending on the amount and content of information, such information may help the driver while driving and can thus contribute to safety and/or relieve the driver of his driving tasks. However, in case of rear view mirrors being replaced by camera monitor systems, information displayed on the monitor screen may reduce the rear view area being visible to the driver or distracts the driver's attention from the rear-view mirror image.
EP 3 256 345 B1 discusses a driver assistance system for a motor vehicle, having an environment camera with an image sensor and an optical system which jointly form a digital exterior mirror. The digital exterior mirror is configured such that at least two visual field areas, having different image scales, are mapped. However, displayed information on the digital mirror is predefined. Improved safety may require flexibility in altering the defined field of views (FOV) based on input from the imager and vehicle.
EP 3 010 761 B1 discusses a vision system of a vehicle includes a camera having a lens and a two dimensional imaging array sensor. The camera captures image data and the imaging array sensor has a center region with a lens having a center axis. The lens is disposed at the imaging array sensor with the center axis of the lens laterally offset from the center region of the imaging array sensor. This arrangement offers a single camera viewing setup for all vehicle conditions and does not allow the flexibility of defining an active area of the imaging sensor dynamically based on vehicle and camera inputs.
US 2020/0357139 A1 discloses a method for determining blockage of a vehicular camera includes providing a camera and mounting the camera at a vehicle so as to view exterior of the vehicle. The control determines at least one selected from the group consisting of (i) that the imaging sensor is totally blocked by determining that the count of bright photosensor pixels of the camera's imaging sensor remains below a threshold, and (ii) that the imaging sensor is partially blocked by determining continuity of intensity variations in different regions of the imaging sensor. The control, responsive to determination of either total blockage or partial blockage of the imaging sensor of the camera, adapts image processing by the image processor of frames of image data captured by the camera to accommodate (i) the determined total blockage of the imaging sensor of the camera or (ii) the determined partial blockage of the imaging sensor of the camera. It would be desirable to have a dynamically adaptable display providing all situational necessary information to the driver in order to provide a more complete view to the areas of importance to the driver of a motor vehicle in order to support the driver.
It is an object of the disclosure to further develop the know camera monitor system to overcome the drawbacks of the prior art, in particular to support the driver of a motor vehicle for safety driving by providing the areas of importance for the driver of a motor vehicle and displaying all necessary information to the driver in a simple and easily understandable manner.
This problem is solved in that the first imager area is an active imager area defined by an array subset of activated pixels, the second imager area is an inactive imager area defined by an array subset of deactivated pixels, and the controller only receives image data from the activated pixels in the active imager area and not from the deactivated pixels in the inactive imager area.
Thus, a camera monitor system for a motor vehicle is provided, which comprises a camera attached to a motor vehicle having at least one field of view (FOV) directed at least rearward of the vehicle, wherein the camera comprises a lens with a lens center axis and an imager having an array of pixels and an imaging area center aligned with the lens center axis, with the alignment being within common tolerances. The array of pixels is divided into an active imager area defined by an array subset of activated pixels and an inactive imager area defined by an array subset of deactivated pixels; wherein the active imaging area has an active imager area center which is offset from the lens center axis. By defining an active imager area with pixels, which are activated, allows for the desired frame rate or image resolution to be achieved by changing the amount of image data that is sent from the imager. This creates an adjustable active imager area which can be optimized to improve driver viewing quality and safety.
In an embodiment, the controller defines the dimensions of at least the active imager area. The dimensions of the active imager area may be determined by frame rate, image resolution and/or by at least one vehicle parameter of the group of vehicle velocity, steering angle, engine on/off, blinker settings on/off right/1 eft, traffic situation around the motor vehicle, driving direction forwards/backwards, glare, recognized traffic signals and lane marks, and hazard detection.
In another embodiment, the at least one FOV is located within the lens and the active imager area. Another embodiment includes a display viewable by a driver of the motor vehicle, wherein the display is operable to display images derived from the active imager area. The images displayed from the active imager area may correspond to selected FOV, and/or the images displayed from the active imager area may include at least one supplemental area outside a defined FOV, and/or the images displayed from the active imager area may include two or more FOVs.
While a display may be needed to simulate a rear view mirror, the present disclosure also provides the possibility to oversee expanded regions of interest, that are not needed to be shown on a display, but rather are needed for machine vision in particular for object and/or hazard detection and classification. An image next to a trailer end may be presented on the display to the driver of a truck by adapting the FOV and/or active image area to the area next to the trailer end even when turning the truck by surveilling the trailer end and taking the respective date into account.
Thus, the active imager area may be used for object detection. It is also possible that the active imager area and/or the inactive imager area is/are used for machine vision.
The present disclosure also provides a motor vehicle, in particular in the form of a truck, preferably with a trailer, comprising a camera monitor system as in one of the preceding embodiments.
The disclosure further relates to a method for adjusting a motor vehicle camera monitor system of the present disclosure. Said method comprises a first step of verifying that the imager and the lens are calibrated to system requirements by aligning the imager center of the imager with the lens center axis of the lens. Said alignment might not be 100% due to usual production tolerances.
This first step may further comprise selecting at least one initial FOV and/or mirror class(es) by the controller for defining an initial active imager area with an upper boundary and a lower boundary, which includes the selected FOV and/or mirror class(es), wherein the controller may only receive image data from the active pixels in the active imager area. This first step may still further comprise determining the center of the imager, the center of the lens and the center of the active imager area, wherein the offset between the active imager area and the center of the lens may be calculated and used by the controller.
The initial setting of the active imager area may be done at the time of assembly to the motor vehicle and/or the setting of the active imager area may be adjustable, preferably dynamically and/or during driving the motor vehicle. The setting adjusting may be based on data received from a driver, the vehicle, another road user and/or a remote device, in particular via a satellite.
The display may receive and display the selected FOV image data received from controller and/or is displaying the at least one FOV image.
Said method may comprise a second step of monitoring inputs, selected from a group comprising image data frame rate, image resolution, and/or vehicle setttings, while the vehicle is operational, wherein preferably the inputs are sent to the controller.
Vehicle settings received by the controller may comprise vehicle velocity, steering angle, engine on/off, blinker settings on/off right/left, traffic situation around the motor vehicle, driving direction forwards/backwards, glare, recognized traffic signals and lane marks and/or hazard warnings.
The controller may determine in the second step the array subset of activated pixels used to define the active imager area based on the inputs, wherein, if the inputs received by the controller are determined to match a different FOV requirement for mirror class or supplemental area, the array subset of activated pixels of the active imager area may be dynamical adjusted to expand or restrict the number of active pixels sending data to the controller.
Said method may comprise a third step of showing the images displayed on the display with the new FOV and/or mirror class(es) based on the determination of the controller.
The desired FOV and the active imager area may be continuously monitored in loops during the operation of the vehicle, and the controller may dynamically adjusts the array subset of activated pixels used to define the active imager area based on the monitored inputs. The above listed embodiments can be used individually or in any combination to provide the device and the process in accordance with the disclosure.
Brief description of the drawings
These and other aspects of the disclosure are shown in detail in the illustrations as follows.
Fig.1 : a block diagram illustrating a configuration of a camera monitor system according to the present disclosure;
Fig. 2: a top view of a motor vehicle, specifically a truck, illustrating exemplary field of view regions for a vehicle camera monitor system according to the present disclosure;
Fig.3: a schematic view of a camera with a first exemplary active imager area for the camera monitor system according to the present disclosure;
Fig.4: a schematic view of the camera with a second exemplary active imager area for the camera monitor system according to the present disclosure;
Fig. 5: a schematic view of the camera with a third exemplary active imager area for the camera monitor system according to the present disclosure; and Fig.6: a method of the designation of the imaging area for the camera monitor system according to the present disclosure.
Detailed description of embodiments
Fig. 1 shows a block diagram illustrating a configuration of a camera monitor system 10. The camera monitor system 10 includes a camera 12 with an imager 14 and a lensl6, a controller 18 and a display 20. The imager 14 may be a high resolution imaging array sensor having an array of pixels with a defined center or other image sensor capable of having an array of pixels with a defined center. The controller 18 receives the image data from the camera 12 and may control settings for the imager 14. The controller 18 may also be connected to Controller Area Network (CAN) bus of the motor vehicle 22 (Fig. 2) to send or receive inputs from the motor vehicle. The imager control settings may be based on inputs such as data frame rate desired, data resolution and/or on certain vehicle settings received by the controller 18. Vehicle settings which may be received by the controller 18 and utilize for imager control may be chosen from vehicle velocity, steering angle, engine on/off, blinker settings on/off right/left, traffic situation around the motor vehicle 22, driving direction forwards/backwards, glare, recognized traffic signals and lane marks, hazard warnings and/or other vehicle settings. The display 20 receives the image data from the controller 18 and displays the information to a vehicle operator. The display 20 may be located inside the vehicle 22, external to the vehicle 22 or be a mobile device, which is capable of receiving image data from the controller 18. The display 20 illustrates exemplary images for two different field of view (FOV) representing two defined mirror class areas. Shown is a mirror class II area 24 and a mirror class IV area 26. A single mirror class area, other selected mirror class areas, or images outside the defined mirror class area may also be shown in the display 20 as determined by the controller 18.
Fig.2 a top view of a motor vehicle 22, specifically a truck in this example, illustrates two exemplary field of view (FOV) regions for a camera monitor system 10. A FOV defined as mirror class II area 24 and a FOV defined as mirror class IV area 26 are illustrated in relation to the motor vehicle 22. The camera monitor system 10 includes a camera 12 (Fig. 1) mounted to the motor vehicle 22 preferably on the side of the vehicle 22, with a field of view (FOV) that is illustrated in this view to be rearward and downward (Class II and Class IV). There may be other FOV areas which may be utilized by the camera monitor system 10 including as a non-limiting FOV examples of a forward view and/or an interior view (such as a mirror Class V area a mirror Class VI area, and/or a mirror class III area). The camera monitor system 10 may supplement an existing rear view mirror system (not shown) typically found on a motor vehicle 22 or may replace the existing rear view mirror system. For the camera monitor system 10 to replace a rear view mirror system on a motor vehicle 22, FOV representing mirror classes for the vehicle are legally required to be displayed which may include the Class II, Class III, Class IV, Class V and/or Class VI described above. Fig. 2 illustrates the camera monitor system 10 utilizing the imager 14 with a partially defined active area (Fig. 3) for an exemplary legally required image section of a rear view device simulating a FOV mirror class II area 24, and FOV mirror class IV area 26. There may be a camera monitor system 10 in more than one location on the motor vehicle 22, such as the right side, left side, front or rear of the vehicle.
Fig. 3 illustrates a schematic view of a camera 12 having an imager 14 with a first exemplary active imager area 32 and an exemplary geometry for the lens 16. The lens 16 is illustrated as an example to have a circular geometry with a defined lens center axis 36. The lens may also have a different geometry such as an oval shape with a defined center within the scope of this disclosure. The imager 14 is defined as the full sensor with all available pixels in the array activated to send image data to the controller 18 (as seen in Fig. 1). The imager 14 is sized to be at least as large as the lens 16 geometry but may be larger than the lens 16 as shown in Fig. 3. Using a larger imager 14 provides flexibility for defining and viewing the desired FOV mirror class(es) and surrounding areas as requested by the controller 18 (Fig. 1). The imager 14 has a defined imager center 34 aligned with the lens center axis 36. The exemplary lens 16 orientation illustrated in Fig. 3 is horizontal. The imager 14 may also be orientated at other angles including vertical within the scope of this disclosure as long as the imager 14 center aligns with lens center axis and contains the desired FOV.
Use of the entire available pixels from the imager 14 may produce more data than may be transferred to the controller 18 at a desired frame rate. The amount of image data transferable to meet a desired frame rate may be addressed by defining an array subset of activated pixels for active imager area 32 illustrated In Fig. 3 as a grey zone. The active imager area 32 is defined by the controller 18 utilizing inputs from the image resolution desired, the desired image frame rate, and/or vehicle settings such as vehicle speed. Some pixels of the imager 14 are designated as an inactive imager area 33 defined by an array subset of deactivated pixels (illustrated as a white zone). The inactive imager area 33 occurs where pixels are inactivated by the controller 18 and do not transmit image data to the controller 18. The higher the image resolution, the smaller the active imager area 32 may become to meet the desired frame rate. The imager 14 is sized such that at the highest image resolution for the camera monitor system 10 (Fig. 1), the active imager area 32 still contains the required mirror class(es) for the motor vehicle 22 (Fig. 2) which can be transferred at the desired frame rate. As shown in Fig. 3, the first exemplary active imager area 32 includes a FOV mirror class II area 24 and a FOV mirror class IV area 26 at a high resolution. The active imager area 32 also defines an active imager area center 38. As illustrated, the active imager area center 38 is offset from the imager center 34 and the lens center axis 36. This offset may vary depending on the defined active imager area 32 being utilized by the controller 18.
The image data received by the controller 18 from the active imager area 32 may also be used for object detection.
The active imager area 32 is defined by selecting the pixel lines from the entire imager 14 area. These selected pixel lines are activated by the controller 18 (Fig. 1) to send image data. The imager 14 starts reading from a lower boundary 40 of the selected active imager area 32 to an upper boundary 42. The imager 14 may also start by reading data from the upper boundary 42 to the lower boundary 40. The controller 18 defines the lower boundary 40 and the upper boundary 42 for the imager 14 based on inputs including which mirror class images are to be displayed on the display 20 (Fig. 1). As an example, the active image area 32 has been defined as illustrated in Fig. 3 to include the mirror class II area 24 and the mirror class IV area 26. The imager 14 then starts to read image data horizontally from the upper boundary 42 to the lower boundary 40 for the mirror class IV area 26 and for the mirror class II area 24. This method requires much less data storage than transferring data from all imager pixels and processing the image at the controller 18. As an example, the display 20 shown in Fig. 1 in a vertical orientation. In this orientation, the imager reads the image data in row format as shown in Fig. 3. As soon as a row of image data has been read for the mirror class II area 24 and the mirror class IV area 26, that image data is used to produce a single image column for the display 20 as illustrated in Fig. 1. In the controller 18 determines which pixels are used for the mirror class II area 24 and which are used for the mirror class IV area 26 area and the images are displayed on the display 20. The controller 18 transmits the images received from the active imager area 32 to the display 20. These images from the active imager area 32 are viewable by the operator of the vehicle on the display 20. In another example, the image data may also be read vertically and displayed horizontally on the display 20 as determined by the orientation of the camera monitor system 10 and the display 20.
Fig. 4 illustrates a schematic view of a camera 12 having an imager 14 with a second exemplary active imager area 32a and an exemplary geometry for the lens 16. In Fig. 4, the active imager area 32a has been enlarged to cover additional mirror class viewing areas. Within the enlarged active imager areas 32a as compared to the Fig. 3, a FOV for mirror Class V area 44 and a FOV for mirror Class VI area can be imaged and displayed within a new defined lower boundary 48a and an upper boundary 50a. The active imager area 32a has a new defined active imager center 38a offset from the imager center 34 and the lens center axis 36. The larger active imager area 32a is offset by smaller inactive imager areas 33a allowing more pixels to transmit image data to the controller 18. The function of the second exemplary active imager area 32a is the same as the first exemplary active imager area 32 describe in Fig. 3. The image data is read from the upper boundary 50a to the lower boundary 48a producing an image frame rate from this second exemplary active imager area 32a. The new image frame rate still conforms to the desired frame rate requirements for image data transfer. In this second exemplary active imager area 32a, the image resolution may be decreased over the image resolution of the first exemplary imager area from Fig. 3 in order to achieve the desired frame rate. As a non-limiting example, this second exemplary active imager area 32a may be used when the motor vehicle 22 is performing a back- up maneuver at a lower speed allowing for a reduction in the image resolution and the expansion of the active imager area 32a.
Fig. 5 illustrates a schematic view of the camera 12 with a third exemplary active imager area 32b for the camera monitor system. In this example, a single mirror class such as a FOV for mirror Class III area 52 with a third upper boundary 50b, a third lower boundary 48b, and an active imager area center 38b is shown. The imager 14 in this exemplary illustration of Fig. 5 has a third active imager area 32b which includes the mirror class III area 52. The function of a third exemplary active imager area 32b is the same as the first exemplary active imager area 32 describe in Fig. 3. The controller 18 receives the image data from the active imager area 32b with no data received from the defined inactive imager areas 33b. The controller 18 may only utilize the image data which contains the mirror class III area 52 for displaying on the display 20 or the display may include image data from a determined supplemental area 54 on the display 20. The image data displayed on the display 20 is fluid and determined by the controller 18.
Fig. 6 illustrates a method 100 of the designation of the active imaging area for the camera monitor system. Said method comprising the following steps:
In a first step 110, it is verified that the imager 14 and the lens 16 are calibrated to system requirements. The imager center 34 of the imager 14 is aligned with the lens center axis 36 of the lens 16. At step 110, an initial FOV and/or mirror class(es) are selected by the controller 18. This initial selection is used to define an initial active imager area 32 with an upper boundary 50 and a lower boundary 48 (Fig. 3) which includes the selected FOV and/or mirror class(es). The controller 18 will only receive image data from the active pixels in the active imager area 32,
32a, 32b. The center of the imager 14, the center of the lens 16 and the center of the active imager area 32 are determined. The offset between the active imager area 32 and the center of the lens 16 may be calculated and used by the controller 18. The initial setting of the active imager area 32 may be done at the time of assembly to the motor vehicle 22. The display 20 receives and displays the selected FOV image data received from controller 18.
In step 120, while the vehicle is operational, inputs such as image data frame rate, image resolution, and/or vehicle setttings are monitored and may be sent to the controller 18. Vehicle settings received by the controller 18 may be vehicle velocity, steering angle, engine on/off, blinker settings on/off right/1 eft, traffic situation around the motor vehicle (22), driving direction forwards/backwards, glare, recognized traffic signals and lane marks, hazard warnings and/or other vehicle settings. These inputs may be utilized by the controller 18 to determine the array subset of activated pixels used to define the active imager area (32, 32a, 32b). If the inputs received by the controller 18 are determined to match a different FOV requirement for mirror class or supplemental area 54, the array subset of activated pixels of the active imager area 32 may be dynamical adjusted to expand or restrict the number of active pixels sending data to the controller 18. For example, a motor vehicle 22 in a back-up maneuver may have a reduction in vehicle speed. This decrease in vehicle speed allows the resolution of the imager to be reduced and the active imager area to be increased including additional mirror class viewing areas or the supplemental area 54.
In Step 130, the images displayed on the display 20 are shown with the new FOV and/or mirror class(es) determined in Step 120. The method 100 continuously monitors the desired FOV and the active imager area 32 by looping back to step 120 during the operation of the vehicle. This allows the controller 18 to dynamically adjusts the array subset of activated pixels used to define the active imager area (32, 32a, 32b) for different inputs from image resolution, frame rate, and/or vehicle settings.
The embodiments shown here are only examples of the present disclosure and must therefore not be understood as restrictive. Alternative embodiments considered by the skilled person are equally covered by the scope of protection of the present disclosure.
Reference Sign List Camera Monitor System Camera Imager Lens Controller Display Motor Vehicle Class II Area Class IV Area Active Imager Area a Active Imager Area b Active Imager Area Inactive Imager Area Imager Center Lens Center Axis Active Imager Area Center a Active Imager Area Center b Active Imager Area Center Lower Boundary Upper Boundary Class V Area Class VI Area Lower Boundary a Lower Boundary b Lower Boundary Upper Boundary a Upper Boundary b Upper Boundary Class III Area Supplemental Area 0 Method to operate a camera monitor system according to the present disclosure0 Determine initial imager setings 120 Selectively defining an active imager area
130 Display defined images

Claims

Claims
1. A camera monitor system (10) for a motor vehicle (22), in particular in the form of a truck, preferably with a trailer, comprising: a camera (12) adapted to be attached to a motor vehicle (22) and having at least one field of view (FOV) (24, 26, 44, 46, 52, 54), and a controller (18), wherein the camera (12) comprises a lens (16) with a lens center axis (36) and an imager (14), and wherein the imager (14) has
• an imaging center (34) aligned with the lens center axis (36) and
• an array of pixels which is divided into a first imager area (32, 32a, 32b) and a second imager area (33, 33a, 33b), wherein the first imager area (32, 32a, 32b) has a first imager area center (38, 38a, 38b) which is offset from the lens center axis (36), characterized in that the first imager area (32, 32a, 32b) is an active imager area (32, 32a, 32b) defined by an array subset of activated pixels, the second imager area (33, 33a, 33b) is an inactive imager area (33, 33a, 33b) defined by an array subset of deactivated pixels, and the controller (18) only receives image data from the activated pixels in the active imager area (32, 32a, 32b) and not from the deactivated pixels in the inactive imager area (33, 33a, 33b).
2. The camera monitor system of claim 1, wherein the controller (18) defines one or more dimensions at least for the active imager area (32, 32a, 32b).
3. The camera monitor system of claim 2, wherein the one or more dimensions of the active imager area (32, 32a, 32b) is/are determined by frame rate, image resolution and/or by at least one vehicle parameter of a group of vehicle velocity, steering angle, engine on/off, blinker settings on/off right/left, traffic situation around the motor vehicle (22), driving direction forwards/backwards, glare, recognized traffic signals and lane marks, and hazard detection.
4. The camera monitor system of any one of the preceding claims, wherein the at least one FOV (24, 26, 44, 46, 52) is within the lens (16) and the active imager area (32, 32a, 32b).
5. The camera monitoring system of any one of the preceding claims, further comprising a display (20) viewable by a driver of the motor vehicle (22), wherein the display (20) is operable to display images derived from the active imager area (32, 32a, 32b).
6. The camera monitor system of claim 5, wherein images displayed from the active imager area (32, 32a, 32b) include the selected FOV (24, 26, 44, 46, 52), and/or images displayed from the active imager area (32, 32a, 32b) include at least one supplemental area (54) outside a defined FOV (24, 26, 44, 46, 52), and/or images displayed from the active imager area (32, 32a, 32b) include two or more FOVs 24, 26, 44, 46, 52).
7. The camera monitor system of any one of the proceeding claims, wherein the active imager area (32, 32a, 32b) is used for object detection, and/or the active imager area (32, 32a, 32b) and/or the inactive imager area (33, 33a, 33b) is used for machine vision.
8. A motor vehicle (22), in particular in the form of a truck, preferably with a trailer, comprising a camera monitor system (10) as claimed in one of the preceding claims.
9. A method (100) for adjusting a camera monitor system (10) of any one of the claims 1 to 7, with the camera monitor system (10) providing an active imager area, the method comprising verifying that the imager (14) and the lens (16) are calibrated to system requirements by aligning the imager center (34) of the imager (14) with the lens center axis (36) of the lens (16).
10. The method of claim 9, further comprising selecting at least one initial FOV and/or mirror class(es) by the controller (18) for defining an initial active imager area (32) with an upper boundary (50, 50a, 50b) and a lower boundary (48, 48a, 48b), which includes the selected FOV and/or mirror class(es).
11. The method of claim 9 or 10, further comprising determining the center of the imager (14), the center of the lens (16) and the center of the active imager area (32), wherein preferably the offset between the active imager area (32) and the center of the lens (16) is calculated and used by the controller (18).
12. The method of any one of claims 9 to 11, wherein the initial setting of the active imager area (32) is done at the time of assembly to the motor vehicle (22), and/or the setting of the active imager area (32) is adjustable, preferably dynamically and/or during driving the motor vehicle.
13. The method of claim 12, wherein adjusting the setting is based on data received from a driver, the vehicle, another road user and/or a remote device, in particular via a satellite.
14. The method of any one of claims 9 to 13, wherein the display (20) receives and displays the selected FOV image data received from controller (18), and/or the display (20) is displaying the at least one FOV (24, 26, 44, 46, 52, 54) image.
15. The method of any one of claims 9 to 14, further comprising monitoring inputs, selected from a group comprising image data frame rate, image resolution, and/or vehicle settings, while the vehicle is operational, wherein preferably the inputs are sent to the controller (18).
16. The method of claim 15, wherein vehicle settings received by the controller (18) comprise vehicle velocity, steering angle, engine on/off, blinker settings on/off right/left, traffic situation around the motor vehicle (22), driving direction forwards/backwards, glare, recognized traffic signals and lane marks and/or hazard warnings.
17. The method of claim 15 or 16, wherein the controller (18) determines the array subset of activated pixels used to define the active imager area (32, 32a, 32b) based on the inputs, wherein preferably, if the inputs received by the controller (18) are determined to match a different FOV requirement for mirror class or supplemental area (54), the array subset of activated pixels of the active imager area (32) is dynamical adjusted to expand or restrict the number of active pixels sending data to the controller (18).
18. The method of claim 17, further comprising showing the images displayed on the display (20) with the new FOV and/or mirror class(es) based on the determination of the controller (18).
19. The method of any one of claims 9 to 18, wherein the desired FOV and the active imager area (32) are continuously monitored in loops during the operation of the vehicle, and the controller (18) dynamically adjusts the array subset of activated pixels used to define the active imager area (32, 32a, 32b) based on the monitored inputs.
PCT/EP2022/071114 2021-07-28 2022-07-27 Camera monitor system, vehicle therewith and method for adjusting the same WO2023006832A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22760875.9A EP4377153A1 (en) 2021-07-28 2022-07-27 Camera monitor system, vehicle therewith and method for adjusting the same

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102021119669 2021-07-28
DE102021119669.8 2021-07-28

Publications (1)

Publication Number Publication Date
WO2023006832A1 true WO2023006832A1 (en) 2023-02-02

Family

ID=83113023

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2022/071114 WO2023006832A1 (en) 2021-07-28 2022-07-27 Camera monitor system, vehicle therewith and method for adjusting the same

Country Status (2)

Country Link
EP (1) EP4377153A1 (en)
WO (1) WO2023006832A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140226008A1 (en) * 2013-02-08 2014-08-14 Mekra Lang Gmbh & Co. Kg Viewing system for vehicles, in particular commercial vehicles
EP3138736A1 (en) 2015-09-02 2017-03-08 MAN Truck & Bus AG Mirror replacement system as camera display system of a motor vehicle, in particular a commercial vehicle
EP3256345B1 (en) 2015-02-10 2019-01-23 Conti Temic microelectronic GmbH Driver assistance system
US20190191107A1 (en) * 2016-06-28 2019-06-20 Scania Cv Ab Method and control unit for a digital rear view mirror
EP3010761B1 (en) 2013-06-21 2019-07-24 Magna Electronics Inc. Vehicle vision system
WO2020090511A1 (en) * 2018-10-31 2020-05-07 ソニー株式会社 Photographing device, image processing method, and program
WO2020090512A1 (en) * 2018-10-31 2020-05-07 ソニー株式会社 Imaging device, control method, and program
US20200357139A1 (en) 2007-08-17 2020-11-12 Magna Electronics, Inc. Method of blockage determination and misalignment correction for vehicular vision system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200357139A1 (en) 2007-08-17 2020-11-12 Magna Electronics, Inc. Method of blockage determination and misalignment correction for vehicular vision system
US20140226008A1 (en) * 2013-02-08 2014-08-14 Mekra Lang Gmbh & Co. Kg Viewing system for vehicles, in particular commercial vehicles
EP3010761B1 (en) 2013-06-21 2019-07-24 Magna Electronics Inc. Vehicle vision system
EP3256345B1 (en) 2015-02-10 2019-01-23 Conti Temic microelectronic GmbH Driver assistance system
EP3138736A1 (en) 2015-09-02 2017-03-08 MAN Truck & Bus AG Mirror replacement system as camera display system of a motor vehicle, in particular a commercial vehicle
US20190191107A1 (en) * 2016-06-28 2019-06-20 Scania Cv Ab Method and control unit for a digital rear view mirror
WO2020090511A1 (en) * 2018-10-31 2020-05-07 ソニー株式会社 Photographing device, image processing method, and program
WO2020090512A1 (en) * 2018-10-31 2020-05-07 ソニー株式会社 Imaging device, control method, and program
US20210400241A1 (en) * 2018-10-31 2021-12-23 Sony Corporation Image-capturing apparatus, image processing method, and program
US20210400209A1 (en) * 2018-10-31 2021-12-23 Sony Corporation Image-capturing apparatus, control method, and program

Also Published As

Publication number Publication date
EP4377153A1 (en) 2024-06-05

Similar Documents

Publication Publication Date Title
US11975659B2 (en) Vehicular camera monitoring system
US11679719B2 (en) Vehicular vision system with console video display and mirror video display for exterior viewing cameras
US11958414B2 (en) Full mirror display utilizing a trailer camera
US20220254132A1 (en) Vehicular driver monitoring system with camera view optimization
CN110509851B (en) Multi-curvature electronic rearview mirror with follow-up display
JP5816311B2 (en) Vehicle vision system
US20130096820A1 (en) Virtual display system for a vehicle
WO2013022581A1 (en) Transparent video screen and alternate reverse camera monitor
EP1527606B1 (en) Viewing system
KR101552444B1 (en) Visual system
KR20160051321A (en) Active side view system of vehicle
JP2005534246A5 (en)
GB2402013A (en) Automatic focal length control
EP4377153A1 (en) Camera monitor system, vehicle therewith and method for adjusting the same
KR20210100431A (en) Camera system for vehicle
EP3184364A1 (en) Rear view device for a vehicle
JP2006264574A (en) Car-mounted camera and car-mounted camera system
KR102284128B1 (en) Camera for vehicle
JP4007274B2 (en) Vehicle night vision system
EP3708428A2 (en) Image presentation for vehicles with multiple cameras
CN110576796A (en) Standard-definition 360-panorama system UI layout method
CN113056391A (en) Method for adapting an image displayed on a monitor in the cab of a vehicle to the vehicle configuration
EP4306363A1 (en) System and method for providing a composite image of a vehicle and its surroundings
KR20240054062A (en) Image correction system and method based on vehicle inclination information
KR19980056273A (en) Square guard

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22760875

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022760875

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022760875

Country of ref document: EP

Effective date: 20240228