KR20240070908A - Apparutus and system for controlling digital side mirror function in vehicle - Google Patents

Abstract

The present invention relates to an apparatus and system for controlling digital side mirror functions for vehicles. A control device according to an embodiment of the present invention includes an input interface through which first image data about the sides and rear of the vehicle captured by a camera installed on the vehicle is input; an output interface through which second image data displayed on a display device inside the vehicle is output; a memory storing the first and second image data; and a processor that controls, through a hardware structure, the function of a digital side mirror that processes the first image data received through the input interface and outputs the second image data through the output interface.

Description

Device and system for controlling digital side mirror functions for vehicles {APPARUTUS AND SYSTEM FOR CONTROLLING DIGITAL SIDE MIRROR FUNCTION IN VEHICLE}

The present invention relates to digital side mirror (DSM) technology for vehicles, and more specifically, to display real-time images through high-speed image processing in digital side mirrors for vehicles that use cameras and display devices to replace conventional optical side mirrors. It is about hardware structure technology that implements.

Side mirrors are located on the left and right sides of the vehicle outside the driver's seat and passenger seat, and provide the driver with a view to the rear and sides of the vehicle. In relation to these side mirrors, optical side mirrors that use actual mirrors have been conventionally used. These optical side mirrors have a simple structure, do not require separate power for the display device, and have the advantages of excellent environmental reliability, less failure, and low price.

However, recently, as user convenience and design features have become more important, digital side mirror technology is being developed to replace optical side mirrors that protrude greatly from the outside. In other words, the digital side mirror is a technology that uses a camera outside the vehicle and a display device inside the vehicle, and corresponds to a technology that outputs the rear and side view of the vehicle captured by the camera to the corresponding display device.

These digital side mirrors make it possible to design various types of concept vehicles while eliminating restrictions on the exterior design of the vehicle. Additionally, they can reduce the forward looking gap that occurs when the driver checks the conventional optical side mirror, and can reduce the gap in the forward gaze that occurs when the driver checks the conventional optical side mirror. It has the advantage of providing a wider angle of view than a side mirror. In addition, because optical side mirrors receive images from a camera and process them digitally, they have the advantage of being able to provide various information needed to the driver using the latest image processing technology.

However, the conventional digital side mirror has a problem of low image processing speed because the control unit that processes image data captured by the camera and controls it to be output to the display device is implemented based on a general-purpose operating system (OS). In other words, since the operating system is software designed to perform a wide variety of functions, it intensively includes not only functions for digital side mirrors but also various other functions for other platforms. Accordingly, in the case of a conventional digital side mirror, not only is the internal structure of the operating system complex, but the data processing process is also complex within the operating system before being finally output to the display device, resulting in a significant time delay.

In particular, the conventional digital side mirror has the problem that the image output speed (frame/s) decreases when driving at high speeds, using high-resolution cameras, connecting multiple cameras, or applying complex image processing technology, making it difficult to actually function as a side mirror. there is. For example, the camera input frequency is high f1 (e.g., 60Hz), but the image frequency output to the display device is low f2 (e.g., 30Hz), and the refresh rate of the display device may be set to f1. This is a case that occurs due to the low image processing speed of the conventional digital side mirror, and to replace it, the same frame must be displayed twice in succession. As a result, the realism conveyed by the rear and side images of the vehicle displayed on the display device cannot be reduced, and therefore, it is practically difficult to replace the optical side mirror with such a conventional digital side mirror.

However, the above-described content merely provides background information on the present invention and does not correspond to previously disclosed technology.

In order to solve the problems of the prior art as described above, the purpose of the present invention is to provide a hardware structure technology that implements real-time image display through high-speed image processing in a digital side mirror for a vehicle.

In addition, the present invention is a digital side mirror for a vehicle that can output to a display device at the same speed (frame/s) as the video input from the camera even when driving at high speeds, using high-resolution cameras, increasing the number of cameras, or applying various image processing technologies. There is another purpose in providing technology.

However, the problem to be solved by the present invention is not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below. There will be.

A control device according to an embodiment of the present invention for solving the above problems includes an input interface through which first image data about the sides and rear of the vehicle captured by a camera installed on the vehicle is input; an output interface through which second image data displayed on a display device inside the vehicle is output; a memory storing the first and second image data; and a processor that controls, through a hardware structure, the function of a digital side mirror that processes the first image data received through the input interface and outputs the second image data through the output interface.

The hardware structure of the processor includes: a first cache memory control unit that performs write control on the first cache memory so that the first image data is temporarily stored in the first cache memory of the memory; a main memory control unit that performs write control on the main memory to store the temporarily stored first image data in the main memory of the memory and performs read control on the main memory to read the first image data stored in the main memory; an RGB conversion unit that converts the read first image data into RGB raw data for each pixel of an image to be displayed on the display device; and a second cache memory control unit that performs write control on the second cache memory so that the second image data according to the raw data is temporarily stored in the second cache memory of the memory.

The hardware structure of the processor further includes an additional processing unit that performs additional image processing on the converted raw data, and the second image data may include data processed by the additional processing unit.

The first image data will be stored in the main memory to compensate for the difference in frequency value between the input frequency of the first image data and the display frequency of the display device, or the difference in phase between the input frequency and the display frequency. You can.

The processor may output control data for adjusting screen brightness of the display device to the display device according to sensor data from the illuminance sensor.

A system according to an embodiment of the present invention includes a camera installed in a vehicle to capture first image data about the sides and rear of the vehicle; A display device installed inside the vehicle to display a screen according to second image data; and a control device that receives and processes the first image data and controls the second image data to be output, wherein the control device includes: an input interface through which the first image data is input; an output interface through which the second image data is output; a memory storing the first and second image data; and a processor that controls, through a hardware structure, the function of a digital side mirror that processes the first image data received through the input interface and outputs the second image data through the output interface.

The present invention configured as described above has the advantage of being able to implement real-time image display with a high sense of realism for rear and side images of a vehicle by providing hardware structural technology for high-speed image processing in a digital side mirror for a vehicle.

In other words, the present invention merges the HAL Level, OS level, and Application Level, which cause image processing speed delays in the prior art, removes and merges unnecessary Kernel/OS API/File System, etc. of the operating system, and software-centered signal processing method. By changing from focus to hardware, there is an advantage in being able to implement a hardware structure of a digital side mirror for vehicles capable of high-speed image processing.

In addition, the present invention provides output to the display device at the same speed (frame/s) as the video input from the camera even when driving at high speeds, using high-resolution cameras, increasing the number of cameras, or applying various image processing technologies in a digital side mirror for a vehicle. There are possible benefits.

In other words, the present invention provides a digital side mirror for a vehicle that is capable of transmitting images in real time even when multi-channel or high-resolution cameras are connected, and even when the latest image processing technologies such as lane detection, recording function, and proximity warning are applied. There are benefits that can be implemented.

The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

Figure 1 shows a schematic block diagram of a system 10 according to an embodiment of the present invention.
Figure 2 shows an example in which the system 10 according to an embodiment of the present invention is applied to a vehicle V.
Figure 3 shows a block diagram of a control device 400 according to an embodiment of the present invention.
Figure 4 shows a block diagram of the hardware structure of the processor 440 according to an embodiment of the present invention.
Figure 5 shows a flowchart of operations performed by the processor 440 according to an embodiment of the present invention.

The above purpose and means of the present invention and the resulting effects will become clearer through the following detailed description in conjunction with the accompanying drawings, and thus the technical idea of the present invention will be easily understood by those skilled in the art. It will be possible to implement it. Additionally, in describing the present invention, if it is determined that a detailed description of known technologies related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted.

The terminology used herein is for describing embodiments and is not intended to limit the invention. In this specification, the singular also includes the plural, unless specifically stated otherwise in the context. In this specification, terms such as “comprise,” “provide,” “provide,” or “have” do not exclude the presence or addition of one or more other components other than the mentioned components.

In this specification, terms such as “or” and “at least one” may represent one of words listed together, or a combination of two or more. For example, “A or B” and “at least one of A and B” may include only A or B, or both A and B.

In this specification, descriptions under "for example" and the like may not exactly match the information presented, such as the cited characteristics, variables, or values, and may be subject to tolerances, measurement errors, limits of measurement accuracy and other commonly known factors. Effects such as modifications, including, should not limit the embodiments of the invention according to various embodiments of the present invention.

In this specification, when a component is described as being 'connected' or 'connected' to another component, it may be directly connected or connected to the other component, but other components may exist in between. It must be understood that it may be possible. On the other hand, when a component is mentioned as being 'directly connected' or 'directly connected' to another component, it should be understood that there are no other components in between.

In this specification, when a component is described as being ‘on’ or ‘in contact with’ another component, it may be in direct contact with or connected to the other component, but there may be another component in between. It must be understood that it can be done. On the other hand, if a component is described as being 'right above' or 'in direct contact' with another component, it can be understood that there is no other component in the middle. Other expressions that describe the relationship between components, such as 'between' and 'directly between', can be interpreted similarly.

In this specification, terms such as 'first' and 'second' may be used to describe various components, but the components should not be limited by the above terms. Additionally, the above term should not be interpreted as limiting the order of each component, but may be used for the purpose of distinguishing one component from another component. For example, a 'first component' may be named a 'second component', and similarly, a 'second component' may also be named a 'first component'.

Unless otherwise defined, all terms used in this specification may be used with meanings that can be commonly understood by those skilled in the art to which the present invention pertains. Additionally, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless clearly specifically defined.

Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the attached drawings.

Figure 1 shows a rough block diagram of the system 10 according to an embodiment of the present invention, and Figure 2 shows an example of the system 10 according to an embodiment of the present invention applied to a vehicle V. indicates.

System 10 (hereinafter referred to as “this system”) according to an embodiment of the present invention is a system that implements a digital side mirror (DSM) function for a vehicle. This system 10 may include a camera 100, a sensor 200, a display device 300, and a control device 400, as shown in FIGS. 1 and 2. However, the sensor 200 is not a required component and may be optionally included.

The cameras 100 are installed on both sides of the vehicle V, capture images of the rear and side views of the vehicle V, and the corresponding first image data vd1 is transmitted to the control device 400. Of course, the camera 100 may be additionally installed in various areas such as the rear or roof in addition to both sides of the vehicle V, and the first image data vd1 for the peripheral vision of the vehicle V is transmitted to the control device 400. ) can also be transmitted.

It may be desirable for the camera 100 to be an optical camera that captures optical images according to the visible light band of incident light. For example, the camera 100 may be an optical camera using an image sensor such as a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), but is not limited thereto.

The sensor 200 may be added to detect information about various conditions around the vehicle (V) that are not detected by the camera 100, and sensor data about information around the vehicle (V) detected by such sensor 200. (sd) is transmitted to the control device 400. For example, the sensor 200 may include a temperature sensor, a proximity sensor, an illumination sensor, etc., but is not limited thereto.

The display device 300 displays various image data on a screen and may be composed of a non-emissive panel or an emissive panel. That is, the display device 300 receives the second image data vd2 that is processed and output from the control device 400 and displays an image according to the second image data vd2 on the screen.

For example, the display device 300 may include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, and a micro electromechanical system (MEMS). It may include, but is not limited to, an electro mechanical systems (electro mechanical systems) display, an electronic paper display, etc. Additionally, the display device 300 may be combined with an input unit (not shown) and implemented as a touch screen.

Figure 3 shows a block diagram of a control device 400 according to an embodiment of the present invention.

The control device 400 may control the screen displayed on the display device 300 by processing the image data and sensor data (vd1, sd) received from the camera 100 and the sensor 200. That is, the control device 400 may receive first image data vd1 captured by the camera 100, perform image processing on the first image data vd1, and process the second image data (vd1). vd2) may be output to the display device 300.

To this end, the control device 400 includes an input interface 410, an output interface 420, a memory 430, and a processor 440, as shown in FIG. 3.

The input interface 410 corresponds to hardware that is connected to the camera 100 and the sensor 200, respectively, and receives image data and sensor data (vd1, sd) input from the camera 100 and the sensor 200. That is, the input interface 410 includes a high-speed first input interface into which the first image data (vd1) of the camera 100 is input, and a second input interface into which the sensor data (sd) of the sensor 200 is input. It can be included. The first and second input interfaces may be implemented as interfaces for different types of communication, and the first input interface may perform communication at a higher speed than the second input interface. For example, the first input interface may be MIPI (Mobile Industry Processor Interface), and the second input interface may be an interface for serial communication such as I2C (Inter-Integrated Circut).

The output interface 420 corresponds to hardware that is connected to the display device 300 and transmits the second image data vd2 that is processed and output by the processor 440 to the display device 300. That is, the output interface 420 corresponds to an interface for transmitting various types of image data. For example, the output interface 420 may be a High-Definition Multimedia Interface (HDMI).

The memory 430 stores various information necessary for the control operation of the control device 400. Information stored in the memory 430 may include, but is not limited to, image data (vd1, vd2), sensor data (sd), RGB converted raw data, additionally processed data, etc. For example, the memory 430 includes main memory (main memory) implemented with first and second cache memories and double data rate synchronous dynamic random access memory (DDR SDRAM), etc., depending on its purpose/location. It can be included.

At this time, the first and second cache memories correspond to memories that temporarily store input/output data of the processor 440 to compensate for different processing speeds between the main memory and the input/output interfaces 410 and 420. That is, the first cache memory compensates for the different processing speeds between the main memory and the first input interface, and is stored in a memory that temporarily stores the first image data (vd1) received in the first input interface before storing it in the main memory. It applies. In addition, the second cache memory corresponds to a memory that temporarily stores the second image data (vd2) output to the output interface by compensating for the different processing speeds between the main memory and the output interface.

The processor 440 may perform various control operations of the control device 400. That is, the processor 440 may process the image data and sensor data (vd1, sd) input to the input interface 410 and control the second image data (vd2) to be output to the output interface 420. Additionally, the processor 440 may control the operations of the remaining components of the control device 400, that is, the input interface 410, the output interface 420, and the memory 430.

For example, the processor 440 may include, but is not limited to, a microprocessor, an application-specific integrated circuit (ASIC), or a field programmable gate array (FPGA).

In particular, the sensor 200 may include an illuminance sensor. In this case, sensor data (sd) about the illuminance state around the vehicle V detected by the illuminance sensor is transmitted to the control device 400, and the processor 440 can control the screen brightness of the display device 300 to be adjusted according to the received sensor data (sd). Data on the screen brightness of the display device 300 may be included in the second image data vd2 or may be separately transmitted to the display device 300.

For example, when the illuminance information according to the sensor data (sd) of the illuminance sensor is greater than or equal to the first value, the processor 440 may control the screen brightness of the display device 300 to decrease. In addition, when the illuminance information according to the sensor data (sd) of the illuminance sensor is less than or equal to the second value (however, the first value > the second value), the processor 440 controls the screen brightness of the display device 300 to become brighter. You can.

Meanwhile, a conventional control device for a digital side mirror for a vehicle (hereinafter referred to as “prior art”) includes a processor that receives image data from a camera and sends it to a display device. At this time, the processor includes an operating system (OS), and camera images can be easily acquired and sent to the display device through the API of the operating system.

However, in the case of a method using an operating system according to the prior art, it was not developed only for digital side mirrors for vehicles, and is a platform used for signal processing using cameras in various fields other than automobiles (hereinafter referred to as the “conventional platform”). It's just a matter of using . In other words, the prior art shares the same conventional platform as existing vehicle rear camera technology, CCTV, webcam, etc.

To describe this prior art and platform in more detail, the input interface of the control device connected to the camera directly receives the digital signal from the camera. At this time, although video data is received through the input interface, the developer cannot recognize the video data. This is because the received video data is not divided into frames, but is simply data in which 0 and 1 change continuously. Because it is visible. Additionally, in the Hardware Abstraction Layer (HAL) of the prior art, there are various functions that can process image data received through an input interface. For example, functions can be used to store image data in frames. Accordingly, the developer programs using the OS API, and the OS compiles the user's program and uses related functions in the HAL to transmit the camera's video data to the display device. The biggest advantage of this conventional platform is that it includes an operating system, so all functions needed by developers, from image acquisition to display devices, can be easily handled by calling the operating system's API.

However, the conventional technology has a problem in that the image processing speed is low because the control device that processes the image data captured by the camera and controls it to be output to the display device is implemented based on a general-purpose operating system (OS). In other words, since the operating system is software designed to perform a wide variety of functions, it intensively includes not only functions for digital side mirrors but also various other functions for other platforms. Accordingly, in the case of the prior art, not only is the internal structure of the operating system complex, but the data processing process is also complex within the operating system before being finally output to the display device, resulting in a significant time delay.

In particular, the conventional technology has a problem in that it is difficult to actually function as a side mirror because the image output speed (frame/s) decreases as high-speed driving and high-resolution cameras are used, multiple cameras are connected, or complex image processing technology is applied. For example, the camera input frequency is high f1 (e.g., 60Hz), but the image frequency output to the display device is low f2 (e.g., 30Hz), and the refresh rate of the display device may be set to f1. This is a case that occurs due to the low image processing speed of the prior art, and to replace this, the same frame must be displayed twice in succession. As a result, the realism conveyed by the rear and side images of the vehicle displayed on the display device cannot be reduced, and therefore, it is practically difficult to replace the optical side mirror with such conventional technology.

Hereinafter, the hardware structure and operation of the processor 440 according to an embodiment of the present invention will be described in more detail.

FIG. 4 shows a block diagram of the hardware structure of the processor 440 according to an embodiment of the present invention, and FIG. 5 shows a flowchart of operations performed by the processor 440 according to an embodiment of the present invention.

In order to solve the problems of the prior art described above, the processor 440 has a hardware structure that implements real-time image display through high-speed image processing in a digital side mirror for a vehicle. That is, the processor 440 has a hardware structure to increase image processing and output speed (frame/s) in a vehicle digital side mirror.

To this end, as shown in FIG. 4, the processor 440 includes a first cache memory control unit 441, a main memory control unit 442, an RGB conversion unit 443, an additional processing unit 444, and a second cache memory control unit. It may include a hardware structure of (445). Of course, the additional processing unit 444 may be optionally included. For example, the hardware structure of the processor 440 can be implemented at the transistor level by applying a digital logic gate (MOSFET), and can be implemented through an FPGA/ASIC.

Hereinafter, with reference to FIGS. 4 and 5, the operation of the processor 440 through the above-described hardware structure will be described in detail.

First, the first cache memory control unit 441 performs write control on the first cache memory so that the first image data vd1 received through the input interface 410 is temporarily stored in the first cache memory of the memory 430. Do it (S501).

Next, the main memory control unit 442 performs write control on the main memory so that the first image data vd1 temporarily stored in the first cache memory is stored in the main memory of the memory 430 (S502). At this time, the reason for storing the first image data (vd1) in the main memory is that the frequency value between the input frequency for the first image data (vd1) from the camera 100 and the display frequency of the display device 300 is different ( (or the phase is different even if the frequency is the same), the first image data (vd1) of the camera 100 cannot be output immediately, so this is to compensate (buffering) for this, and also the corresponding first image data (vd1) This is to perform additional image processing for vd1). If this process is processed with software according to the operating system, the processing speed is inevitably slowed down, so in the present invention, a hardware structure responsible for this process is implemented in the processor 400.

Meanwhile, sensor data (sd) received through the input interface 410 may be stored in the main memory of the memory 430 under the control of the main memory control unit 442.

Next, the main memory control unit 442 performs read control on the main memory to read the first image data vd1 stored in the main memory (S503). At this time, the read first image data vd1 may be stored in a register within the processor 440.

Next, the RGB conversion unit 443 converts the read first image data (vd1) into RGB (Red, Green, Blue) raw data for each pixel of the image to be displayed on the display device 300. Do it (S504).

Next, the additional processing unit 444 performs additional processing, such as image processing, on the converted raw data (S505). For example, the additional processing unit 444 processes the converted raw data into data that can be displayed on the display device 300, or provides additional information according to the sensor data (sd) to the display device 300. The image can be processed so that it can be included in the image to be displayed. In addition, the additional processing unit 444 can be controlled to generate control data for adjusting the screen brightness of the display device 300 according to sensor data (sd) about the illumination condition around the vehicle V detected by the illuminance sensor. there is. However, S505 may be performed selectively.

Next, the second cache memory control unit 445 configures the second cache memory to temporarily store the second image data vd2 including raw data or additionally processed data in the second cache memory of the memory 430. Perform write control (S506). Accordingly, the second image data (vd2) stored in the second cache memory is output and transmitted to the display device 300 through the output interface 420, so that an image according to the second image data (vd2) is displayed on the display device 300. ) can be displayed.

Since the processor 440 according to the present invention described above processes the image data input from the camera 100 through a hardware structure until it is output, only a delay of several tens of microseconds (us) occurs, and the input frequency of the camera 100 can be output as is to the display device 200. In addition, the hardware structure of the proposed processor 440 according to the present invention depends on the number of cameras 100, the resolution of the cameras 100, and the frequency of the cameras 100, and the size (number of Flip-Flops) of the Custom Designed Hardware. ) may change, but since the image processing speed is not related to the size of the input first image data vd1, the image processing speed may remain the same regardless of whether the size of the first image data vd1 is large or small. For reference, in the case of conventional technology using an operating system, as the size of input image data increases, the image processing speed decreases.

The present invention, constructed as described above, has the advantage of being able to implement a real-time image display with a high sense of realism for rear and side images of a vehicle by providing hardware structural technology for high-speed image processing in a digital side mirror for a vehicle. In other words, the present invention merges the HAL Level, OS level, and Application Level, which cause image processing speed delays in the prior art, removes and merges unnecessary Kernel/OS API/File System, etc. of the operating system, and software-centered signal processing method. By changing from focus to hardware, there is an advantage in being able to implement a hardware structure of a digital side mirror for vehicles capable of high-speed image processing.

For reference, in the case of the prior art, the OS level and application level are implemented as software, so there is a problem that they cannot be directly connected to the hardware level without the HAL level. Accordingly, the present invention implements the minimum functions required for implementing a digital side mirror at the OS level and application level as hardware and connects them directly to the hardware level, enabling high-speed image processing.

In addition, the present invention provides output to the display device at the same speed (frame/s) as the video input from the camera even when driving at high speeds, using high-resolution cameras, increasing the number of cameras, or applying various image processing technologies in a digital side mirror for a vehicle. There are possible benefits. In other words, the present invention provides a digital side mirror for a vehicle that is capable of transmitting images in real time even when multi-channel or high-resolution cameras are connected, and even when the latest image processing technologies such as lane detection, recording function, and proximity warning are applied. There are benefits that can be implemented.

In the detailed description of the present invention, specific embodiments have been described, but of course, various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention is not limited to the described embodiments, but should be defined by the claims described below and equivalents to these claims.

10: System 100: Camera
200: sensor 300: display device
400: Control device 410: Input interface
420: output interface 430: memory
440: Processor 441: First cache memory control unit
442: Main memory control unit 443: RGB conversion unit
444: Additional processing unit 445: Second cache memory control unit

Claims (10)

an input interface through which first image data about the sides and rear of the vehicle captured by a camera installed in the vehicle is input;
an output interface through which second image data displayed on a display device inside the vehicle is output;
a memory storing the first and second image data; and
A processor that controls the function of a digital side mirror that processes the first image data received through the input interface and outputs the second image data through the output interface through a hardware structure;
A control device comprising a.
According to paragraph 1,
The hardware structure of the processor is,
a first cache memory control unit that performs write control on the first cache memory so that the first image data is temporarily stored in the first cache memory of the memory;
a main memory control unit that performs write control on the main memory to store the temporarily stored first image data in the main memory of the memory and performs read control on the main memory to read the first image data stored in the main memory;
an RGB conversion unit that converts the read first image data into RGB raw data for each pixel of an image to be displayed on the display device; and
a second cache memory control unit that performs write control on the second cache memory so that second image data according to the raw data is temporarily stored in the second cache memory of the memory;
A control device comprising a.
According to paragraph 2,
The hardware structure of the processor further includes an additional processing unit that performs additional image processing on the converted raw data,
The control device wherein the second image data includes data processed by the additional processing unit.
According to paragraph 2,
The first image data is stored in the main memory to compensate for the difference in frequency value between the input frequency of the first image data and the display frequency of the display device, or the difference in phase between the input frequency and the display frequency. controller.
According to paragraph 2,
The processor is a control device that outputs control data for adjusting screen brightness of the display device to the display device according to sensor data from an illuminance sensor.
A camera installed in the vehicle to capture first image data about the sides and rear of the vehicle;
A display device installed inside the vehicle to display a screen according to second image data; and
It includes a control device that receives and processes the first image data and controls it to output the second image data,
The control device is,
an input interface through which the first image data is input;
an output interface through which the second image data is output;
a memory storing the first and second image data; and
A processor that controls the function of a digital side mirror that processes the first image data received through the input interface and outputs the second image data through the output interface through a hardware structure;
A system containing .
According to clause 6,
The hardware structure of the processor is,
a first cache memory control unit that performs write control on the first cache memory so that the first image data is temporarily stored in the first cache memory of the memory;
a main memory control unit that performs write control on the main memory to store the temporarily stored first image data in the main memory of the memory and performs read control on the main memory to read the first image data stored in the main memory;
an RGB conversion unit that converts the read first image data into RGB raw data for each pixel of an image to be displayed on the display device; and
a second cache memory control unit that performs write control on the second cache memory so that second image data according to the raw data is temporarily stored in the second cache memory of the memory;
A system containing .
In clause 7,
The hardware structure of the processor further includes an additional processing unit that performs additional image processing on the converted raw data,
The system wherein the second image data includes data processed by the additional processing unit.
In clause 7,
The first image data is stored in the main memory to compensate for the difference in frequency value between the input frequency of the first image data and the display frequency of the display device, or the difference in phase between the input frequency and the display frequency. system.
In clause 7,
A system in which the processor outputs control data for adjusting screen brightness of the display device to the display device according to sensor data from an illuminance sensor.