JP2005184397A - Display method, display system, display apparatus and photographing equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display method, a display system, a display apparatus and photographing equipment which are excellent in expandability by selecting processing for image data for each transmission channel. <P>SOLUTION: The display apparatus 20 receives image data outputted from a camera connected to a system, extracts processing information correlated to a transmission channel number of the received image data referring to a table 50 in which transmission channel numbers are correlated to processing information for specifying processing to be executed by an image processor 27, and selects an LUT matching the extracted processing information from LUT 24a, 24b and so on. The display apparatus 20 converts image data of video stream format received by a communication section 26 into image data of digital format such as YUV format etc., and processes the image data of this camera (image processing) on the basis of the selected LUT. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display method, a display system, a display device, and a photographing device, and more specifically, performs processing for image data captured and output by a photographing device such as a camera connected to the system for each transmission channel. The present invention relates to a display method, a display system, a display device, and a photographing device that can be selected from among a plurality of processes.

  2. Description of the Related Art In recent years, systems that process various types of information by mounting various in-vehicle devices on vehicles such as automobiles have become widespread. For example, an information output device such as a TV tuner, a video device, or a navigation device, and a display device such as a liquid crystal display or a CRT display are mounted on a vehicle, and a video related to image data generated by the information output device is displayed on the display device. A system with a configuration is widespread. In addition to the above-mentioned in-vehicle devices, mobile phones that can be connected to the Internet, information terminal devices such as PDAs, AV devices such as DVD devices and game devices have been installed in cars. In the future, it is expected that more in-vehicle devices will be installed. However, when the above-described various in-vehicle devices are installed in a vehicle, there is a problem in that an increase in wiring is caused because it is necessary to perform wiring for each in-vehicle device.

  Therefore, in order to reduce the number of wirings and speed up large-capacity data communication even in vehicles such as automobiles, various types of signals such as control signals, image data, and audio signals are communicated (transmitted / received) via the LAN. ) Has been proposed.

In addition, a plurality of cameras are appropriately arranged in the vehicle, a LAN is constructed between the arranged cameras and the display device, and image data captured and generated by each camera is converted into a stream format signal (video stream), There has been proposed a display system having excellent expandability for sending converted image data to a display device via a communication line (see, for example, Patent Document 1).
JP 2003-163926 A

  By the way, each camera arranged in a vehicle generally has different purposes depending on the installation location, such as a camera installed for the purpose of photographing the front and a camera installed for the purpose of photographing the rear. However, in the display system described above, image data corresponding to a resolution and a frame rate determined in advance by each camera is transmitted to the display device via a communication line. The image data sent via the network is sequentially received and video is displayed.

  If the system configuration is such that a predetermined camera is connected, it is possible to execute processing according to the camera. However, such a form is rare, and it is common for a user to install a camera as appropriate after purchasing a vehicle. Accordingly, when the connected camera is different from a predetermined model, it is necessary to change or add control software (software for processing each photographing apparatus) for processing image data for each connected photographing apparatus. there were.

  In a display system in which image data is transmitted and received by communication using a plurality of transmission channels, a display device that functions as a controller uses a transmission channel that is not used for communication for transmission and reception of the image data before transmission and reception of image data. Generally, it is set to the transmission channel. In other words, in the conventional display system, the transmission channel used for transmission / reception of image data changes depending on the situation of the system. Therefore, which transmission channel image data is captured by which camera. I couldn't recognize it.

  The present invention has been made in view of such circumstances, and the imaging apparatus outputs image data to a predetermined transmission channel among a plurality of transmission channels, and performs processing on the image data for each transmission channel. An object of the present invention is to provide a display method, a display system, a display device, and an imaging device that can display on the display device a video related to the image data processed for each transmission channel by selecting from among them.

  A display method according to a first aspect of the present invention performs communication using a plurality of transmission channels between a photographing device mounted on a vehicle for photographing the periphery of the vehicle and a display device for displaying an image. In the display method of performing any one of a plurality of processes on the image data photographed by the photographing device and displaying a video related to the processed image data, the photographing device includes the plurality of transmission channels. Image data is output to a predetermined transmission channel, and the display device selects a process for the image data from the plurality of processes for each transmission channel.

  In the first invention, the image data photographed by the photographing device is output to a predetermined transmission channel among the plurality of transmission channels, and the display device performs processing on the transmitted image data for each transmission channel. Select from multiple processes. Since there is no possibility that the image data output from the imaging device is output to a transmission channel other than the transmission channel determined by the imaging device, the image data transmitted through each transmission channel is transmitted from any imaging device. It can be recognized whether it is output. Therefore, a transmission channel for outputting image data by the imaging device is specified in advance, and on the other hand, processing on the image data of each transmission channel is required for the image data output from the imaging device on the display device. By setting the processing, the display device can automatically select the processing of the image data and perform the processing according to the photographing device.

  The display method according to a second aspect of the present invention is the display method according to the first aspect, wherein the display device transmits image data from a table in which each transmission channel is associated with processing information specifying processing for image data of the transmission channel. Processing information associated with a transmission channel is extracted, and processing for image data is selected based on the extracted processing information.

  In the second invention, the display device performs processing associated with the transmission channel to which the image data is transmitted, from a table in which each transmission channel is associated with processing information for specifying processing for the image data of the transmission channel. Information is extracted, and processing for image data is selected from a plurality of processes based on the extracted processing information. Therefore, since the display device can easily extract the processing for the image data of the transmission channel by searching the table, the processing of the image data is automatically selected and the processing corresponding to the photographing device is performed. Can do.

  A display method according to a third invention is the display method according to the second invention, wherein the display device obtains each transmission channel and processing information specifying processing for image data of the transmission channel from the outside and updates the table. Features.

  In the third invention, the display device obtains each transmission channel and processing information for specifying processing for image data of the transmission channel from the outside, and updates the table. Even when image data of a transmission channel that does not exist in the table is transmitted to the display device or when processing for the image data of the transmission channel is changed, each transmission channel is externally (for example, a communication network such as the Internet). And the processing information for specifying the processing for the image data of the transmission channel are acquired, it is possible to reliably execute the processing of the image data.

  In a display method according to a fourth invention, in the second invention, the imaging device stores in advance a transmission channel for outputting image data and processing information for specifying a process for the image data of the transmission channel. The apparatus acquires the transmission channel and the processing information from the imaging apparatus and updates the table.

  In the fourth invention, the imaging device stores in advance a transmission channel for outputting image data and processing information for specifying processing for the image data of the transmission channel, and the display device transmits the transmission channel to the transmission channel. And processing information are acquired and the table is updated. Even when image data of a transmission channel that does not exist in the table is transmitted to the display device, or even when processing for the image data of the transmission channel is changed, each transmission channel and the image data of the transmission channel are received from the imaging device. Therefore, it is possible to reliably execute image data processing.

  The display method according to a fifth aspect of the present invention is the display method according to any one of the first to fourth aspects, wherein the plurality of processes include a process of changing a display position of each pixel of a video frame constituted by image data. And

  In the fifth invention, the display device performs a process of changing the display position of each pixel of the video frame constituted by the image data, thereby enlarging, reducing, rotating and rotating the video frame constituted by the image data. Viewpoint conversion can be performed, and a desired video can be displayed.

  The display method according to a sixth aspect of the present invention is the display method according to any one of the first to fifth aspects, wherein the plurality of processes include a process of changing a resolution or a frame rate of a video frame constituted by image data. To do.

  In the sixth aspect of the invention, the display device can change the amount of data suitable for the video associated with the image data by performing a process of changing the resolution or frame rate of the video frame constituted by the image data. . Therefore, since the processing load of the processing on the image data can be reduced, the influence on the processing for displaying the video can be reduced, the occurrence of video frame loss can be suppressed, and the deterioration of the video quality can be suppressed.

  According to a seventh aspect of the present invention, there is provided a display system in which a photographing device for photographing the periphery of a vehicle and a display device for displaying an image are mounted on the vehicle, and communication using a plurality of transmission channels is performed between the photographing device and the display device. In the display system that performs any one of a plurality of processes on the image data captured by the imaging device, and displays a video related to the processed image data on the display device, the imaging device includes: The image processing apparatus includes means for designating a transmission channel for outputting the image data, and selection means for selecting a process for the image data of each transmission channel from the plurality of processes for each transmission channel.

  In the seventh invention, the image data photographed by the photographing device is output to a predetermined transmission channel among the plurality of transmission channels, and the selection means performs processing on the transmitted image data for each transmission channel. Select from multiple processes. Then, the video relating to the processed image data is displayed on the display device. Since there is no possibility that the image data output from the imaging device is output to a transmission channel other than the transmission channel determined by the imaging device, the image data transmitted through each transmission channel is transmitted from any imaging device. It can be recognized whether it is output. Therefore, a transmission channel through which the image capturing apparatus outputs image data is defined in advance, and on the other hand, processing on the image data of each transmission channel is required for the image data output from the image capturing apparatus by the selection unit. By setting the process, the selection unit can automatically select the process of the image data and perform the process according to the photographing apparatus.

  In a display system according to an eighth aspect based on the seventh aspect, the selection means transmits a table in which each transmission channel is associated with processing information for specifying processing for image data of the transmission channel, and the image data is transmitted. Means for extracting processing information associated with a transmission channel from the table, and selecting processing for image data based on the extracted processing information.

  In the eighth aspect of the invention, the selecting means performs processing associated with the transmission channel to which the image data is transmitted from a table in which each transmission channel is associated with processing information for specifying processing for the image data of the transmission channel. Information is extracted, and processing for image data is selected from a plurality of processes based on the extracted processing information. Therefore, since the selection means can easily extract the processing for the image data of the transmission channel by searching the table, the processing of the image data is automatically selected and the processing according to the photographing apparatus is performed. Can do.

  A display system according to a ninth aspect is the means according to the seventh or eighth aspect, wherein the transmission channel and the processing information for specifying the processing for the image data of the transmission channel are acquired from a communication network inside or outside the vehicle. Is further provided.

  In the ninth aspect of the invention, the table is updated by acquiring each transmission channel and processing information for specifying processing for image data of the transmission channel from a communication network inside or outside the vehicle. Even when image data of a transmission channel that does not exist in the table is transmitted or when processing for image data of the transmission channel is changed, for example, each transmission channel and the image of the transmission channel are transmitted from a communication network such as the Internet. Since the processing information for specifying the processing for the data is acquired, the processing of the image data can be surely executed.

  A display device according to a tenth aspect of the present invention inputs image data multiplexed into a plurality of transmission channels, applies any one of a plurality of processes to the input image data, and applies the processed image data to the processed image data The display device for displaying the video includes a unit that selects, for each transmission channel, processing for image data of each transmission channel from among the plurality of processing.

  In the tenth aspect, the display device selects a process for the transmitted image data from a plurality of processes for each transmission channel. Therefore, since the display device uniquely determines the processing for the image data of each transmission channel, the display device automatically selects the processing of the image data and performs processing other than the processing for each transmission channel. Not at all.

  An imaging apparatus according to an eleventh aspect of the invention is an imaging apparatus for outputting image data obtained by imaging the periphery to any one of a plurality of transmission channels, and means for storing in advance a transmission channel for outputting the image data; And a means for designating the stored transmission channel as a transmission channel for outputting the image data.

  In the eleventh aspect, the image data photographed by the photographing device is output to a predetermined transmission channel among the plurality of transmission channels. There is no possibility that the image data output from the imaging apparatus is output to a transmission channel other than the transmission channel defined by the imaging apparatus.

  According to the present invention, there is no possibility that the image data output from the image capturing apparatus is output to a transmission channel other than the transmission channel defined by the image capturing apparatus. It is possible to recognize from which imaging device the image is output. Therefore, the transmission channel from which the imaging device outputs image data is defined in advance, while the processing for the image data of each transmission channel is requested by the display device for the image data output from the imaging device. By setting to, the display device can automatically select the processing of the image data and perform the processing according to the photographing device. As a result, for example, it is not necessary to change or add control software for selecting processing of image data (software for performing processing for each imaging device) for each connected imaging device, so that extensibility is improved. Has an effect.

  Hereinafter, the present invention will be described in detail with reference to the drawings illustrating embodiments thereof.

  FIG. 1 is a block diagram showing a configuration of a display system according to the present invention. In the figure, reference numeral 1 denotes a vehicle such as an automobile, and the vehicle 1 includes in-vehicle devices such as a display device 20, a front monitoring camera 31, which is a photographing device, side monitoring cameras 32a and 32b, and a rear monitoring camera 33. These in-vehicle devices are distributed and connected to repeaters 40a and 40b corresponding to two relay devices (for example, hub units), and the repeaters 40a and 40b are connected by a communication line 2 that complies with the IEEE 1394 communication standard. By doing so, the display system according to the present invention is constructed. The relay devices 40a and 40b can be integrated with a J / B (junction block) to perform on / off control of the power of each connected device. Moreover, the relay devices 40a and 40b may have a function of detecting a disconnection by incorporating a relay / fuse of a power source of each device.

  One repeater 40a is installed, for example, in the vicinity of the place where the front J / B of the vehicle 1 is installed, and the front monitoring camera 31, the side monitoring cameras 32a and 32b, and the display device 20 are connected. . The other repeater 40b is installed, for example, in the rear trunk of the vehicle 1 and is connected to the rear monitoring camera 33.

  The front monitoring camera 31 is installed, for example, in the vicinity of a windshield (for example, in the vicinity of a rearview mirror) in the passenger compartment of the vehicle 1, and images the front of the vehicle 1 to generate and output image data. The side monitoring cameras 32a and 32b are installed, for example, on the left and right side fenders of the vehicle 1, and shoot the side of the vehicle 1 to generate and output image data. The rear monitoring camera 33 is installed, for example, in the vicinity of the rear glass in the passenger compartment of the vehicle 1, captures the rear of the vehicle 1, generates image data, and outputs it.

  The display device 20 is a liquid crystal display, a HUD (head-up display), or the like, and is installed in the vicinity of the dashboard. The display device 20 is connected to the repeater 40a and displays a video related to image data sent from the repeater 40a.

  The repeater 40 b receives the image data output from the rear monitoring camera 33 and transmits it to the repeater 40 a via the signal line 2. The repeater 40a receives image data output from the front monitoring camera 31 or the side monitoring cameras 32a and 32b and transmits the image data to the display device 20. Further, the repeater 40 a receives the image data sent from the repeater 40 b via the signal line 2 and transmits it to the display device 20. In this way, a plurality of image data can be multiplexed and transmitted through the network.

  Note that, even with the same type (front, side, or rear) surveillance cameras, the purpose of shooting differs depending on the model, and the output image data is different. For example, as the rear monitoring camera 33, (1) a normal VGA wide-angle back camera with an angle of view of 100 ° and (2) two VGA wide-angle back cameras with an angle of view of 100 ° are used to cover an image with an angle of view of 180 °. There are (3) a SXGA super wide-angle back camera combined with a cylindrical lens having an angle of view of 150 to 180 °, (4) a back camera using an omnidirectional camera (fisheye camera), and the like. In this way, surveillance cameras differ in cost, viewing angle, image quality, display method (eg, bird's-eye view display, enlarged display), etc. depending on the model, and it is up to the user to choose which camera to use. The rear monitoring camera 33 is appropriately selected by the person.

  FIG. 2 is a block diagram showing the configuration of the rear monitoring camera. The configurations of the front monitoring camera 31 and the side monitoring cameras 32a and 32b are the same as the configuration of the rear monitoring camera 33. The rear monitoring camera 33 includes a control unit 34, an imaging unit 35, a signal processing unit 36, an image memory 37, a communication unit 38, and a flash memory 39. Specifically, the control unit 34 is constituted by a CPU, and is connected to each hardware unit as described above via a bus, and controls them and executes various software functions.

  The imaging unit 35 is, for example, a semiconductor element such as an area-type CCD or CMOS in which pixels are arranged in a matrix. Each pixel has a built-in photodiode, and receives light incident from the outside via a lens (not shown). The image data is converted into analog image data (hereinafter referred to as analog image data) having a voltage corresponding to the intensity of the incident light, and the analog image data is output to the signal processing unit 36.

  The signal processing unit 36 includes a clamp circuit 36a, a gamma correction circuit 36b, a white clip circuit 36c, a contour correction circuit 36d, a mirror image inversion circuit 36e, and a video format conversion circuit 36f. The clamp circuit 36a is a circuit that reproduces the low-frequency component of the analog image data input from the imaging unit 35 and removes low-frequency noise. The white clip circuit 36c is used when the input level of the imaging unit 35 is high. This circuit attenuates the input level to optimize (limit) the signal amplitude.

  The gamma correction circuit 36b is a circuit that corrects the gamma characteristic of the analog image data, and the contour correction circuit 36d is a circuit that enhances the sharpness of the entire video by enhancing the vertical and horizontal contours. The mirror image inversion circuit 36e is a circuit for appropriately inverting the image, and by turning on the function, the image can be inverted to output analog image data having the same image as the image displayed on the rearview mirror. The front monitoring camera 31 and the side monitoring cameras 32a and 32b do not need to be turned on, and therefore the mirror image inversion circuit 36e may not be provided.

  The video format conversion circuit 36f is a circuit that converts the analog image data adjusted by the various circuits described above into digital image data (for example, digital YUV, ITU-R BT.601 format, etc.). Data is output to the communication unit 38. Here, Y, U, and V are a luminance component Y, a color difference component RY, and a color difference component BY.

  The image memory 37 has a function of temporarily storing data generated during execution of processing by the signal processing unit 36 and data input and output through the communication unit 38. The image memory 37 may be a general DRAM, but it is preferable to speed up the processing using an SDRAM or the like that can read one data per clock in synchronization with the bus clock.

  The communication unit 38 has a physical layer function, a data link layer function, and a transaction layer function for performing protocol processing, and converts digital image data input from the video format conversion circuit 36f into a video stream such as an IEEE 1394 bus stream. And transmitted to the repeater 40a. Note that the communication unit 38 performs processing such as resolution, frame rate conversion, and packet generation in accordance with the control command transmitted from the display device 20. Of course, the communication unit 38 may be provided with a function for turning on / off transmission of image data. The communication protocol between the display device 20 and each of the monitoring cameras 31, 32a, 32b, and 33 is, for example, “1394-based IIDC Digital Camera Specification Ver.1.30” (hereinafter referred to as IIDC protocol). The case will be described.

  The flash memory 39 is a rewritable device, is connected to the communication unit 38, and stores a transmission channel (isochronous channel) number of image data output from the camera (communication unit 38). Accordingly, the communication unit 38 can output image data to a channel specified by the isochronous channel number stored in the flash memory 39.

  In the IIDC protocol, the isochronous channel used by each camera for transmission is generally set by the display device 20 functioning as a controller before transmission / reception of image data. However, in the present invention, the isochronous channel is used from the display device 20. Instead of setting a channel, image data is transmitted and received using a channel specified by an isochronous channel number preset for each camera. If this isochronous channel number is uniquely assigned for each purpose, the purpose of the image data transmitted to each channel can be identified. Needless to say, the flash memory 39 may be built in the communication unit 38.

  Since an isochronous channel number must be set for each purpose of the camera, for example, writing to the flash memory 39 is performed at the time of factory shipment. Further, if the camera inspection apparatus performs the writing of the isochronous channel number, the inspection process and the isochronous channel number writing process can be performed in a lump, and the productivity is improved.

  FIG. 3 is a block diagram showing the configuration of the display device according to the present invention. The display device 20 according to the present invention includes a system bus 21 to which a control unit 23 that is a control center is directly connected and a local bus 22 to which the control unit 23 is not directly connected. The control unit 23 is connected to the flash memory 24, the operation unit 25, the communication unit 26, and the image processing unit 27 via the system bus 21. On the other hand, a communication unit 26 and an image processing unit 27 are connected to the local bus 22, and output to the image processing unit 27 via the local bus 22 when processing image data received by the communication unit 26. By doing so, the processing speed can be increased. Of course, the bus connection form of each part is not limited to this.

  Specifically, the control unit 23 is configured by a CPU and has a function of accessing the flash memory 24 and selecting a process from a plurality of processes according to the system configuration. System state transition management is performed based on 25 inputs. More specifically, the control unit 23 performs switching control of image processing in the image processing unit 27 by outputting a control command to the image processing unit 27. The control unit 23 also performs IIDC protocol processing and has a function of transmitting a control command to each camera in accordance with system state transition.

  The operation unit 25 includes character keys, numeric keys, various function keys, and the like necessary for operating the display device 20. The operation unit 25 has a display selection key 25a for selecting which of the connected cameras is to be displayed as a function key. In addition, it is also possible to substitute a part or all of the various keys of the operation unit 25 by using a touch panel system for the display unit 28 described later.

  The communication unit 26 has a physical layer function, a data link layer, and a transaction layer function for performing protocol processing, and converts video stream format image data received via a communication line into digital format image data such as YUV format. The data is converted and output to the image processing unit 27 via the local bus 22. The image data is multiplexed by a plurality of transmission channels (63 channels in IEEE 1394), but the communication unit 26 sorts the packets for each transmission channel and converts the image data in the video stream format for each camera into a digital format image. Convert to data.

  The flash memory 24 is a rewritable device, and stores a table 50 in which transmission channel numbers and processing information for specifying processing executed by the image processing unit 27 are associated with each other. In the table 50, camera information indicating the type of the camera, for example, a front monitoring camera, a side monitoring camera, or a rear monitoring camera, is stored in association with the transmission channel number from the transmission channel number. ing. Further, the flash memory 24 has a lookup table (for example, a coordinate relationship) that directly defines the relationship between input image data (image data output from each camera) and output image data for each processing information. LUT) 24a, 24b,... Are stored. Needless to say, the flash memory 24 may be built in the control unit 23.

  Here, the processing information is information on how to process image data captured and output by the camera. Specifically, for example, display of each pixel of a video frame configured by the image data, for example. The position is changed, and the resolution or frame rate of the video frame constituted by the image data is changed. The control unit 23 compares the transmission channel number of the image data received by the communication unit 26 with the table 50 to extract the processing information of the image data, and selects the LUT that matches the extracted processing information as the LUT 24a, 24b, Choose from…

  The LUTs 24a, 24b,... Are used when the image processing unit 27 performs image processing on image data captured and output by the camera, and a plurality of LUTs corresponding to the number of pieces of processing information stored in the table 50. Exists. As shown in FIG. 4, for example, the LUTs 24a, 24b,... Represent the relationship between the two-dimensional coordinates Xin, Yin of the input image data and the two-dimensional coordinates Xout, Yout of the output image data (Xin = FX (Xout, Yout), Yin). = FY (Xout, Yout)) is directly defined. Basic types of LUTs include a display LUT that displays the original image data as it is, an enlargement / reduction LUT that enlarges or reduces the original image data, a viewpoint change LUT that changes the viewpoint direction of the original image data, and the original image. There are a figure addition LUT for adding a prepared figure to the data, a lens distortion correction LUT, and the like.

  There are a plurality of types of enlargement / reduction LUTs depending on the form such as enlargement / reduction. Also, there are a plurality of types of viewpoint change LUTs depending on the mounting status of each camera on the vehicle and the position of the viewpoint, and the figure addition LUT also has a plurality of types of LUTs depending on the type of figure to be added. . Further, there is a composite LUT in which the basic types of LUTs described above are combined. For example, when performing two types of image processing of enlargement / reduction and viewpoint change for image data, a composite LUT in which the enlargement / reduction LUT and the viewpoint change LUT are combined is created in advance and stored in the flash memory 24. Therefore, by performing image processing on the image data in the image processing unit 27 based on the composite LUT, it is possible to perform a plurality of types of image processing in a single process and realize high-speed image processing.

  The control unit 23 compares the transmission channel number of the received image data with the table 50 to extract the processing information of the image data, and selects the LUT that matches the extracted processing information from the LUTs 24a, 24b,. Therefore, the processing of the image data can be selected for each camera installed in the vehicle, that is, depending on the purpose of installation. Hereinafter, as processing, enlargement display processing, which is an example of processing using an enlargement / reduction LUT, bird's eye display processing, which is an example of processing using a viewpoint change LUT, and graphic mask processing, which is an example of processing using a figure addition LUT, It will be described as either. Of course, it may be a combination of a plurality of processes.

  The enlargement display process is a process in which a part of the original video frame is converted into a new video frame, and each pixel in the area is linearly mapped using the above-described enlargement / reduction LUT. Change (convert) the display position of the pixel. The bird's-eye display process is a process of mapping each image of the image data using the above-described viewpoint change LUT so that the original video frame becomes a new video frame whose viewpoint has been changed. Since each camera is mounted on the vehicle, its viewpoint is fixed, but by performing the bird's-eye view display process 17a, it is possible to display an image as if looking down from the sky, for example. The graphic mask process is a process of adding a mask frame prepared in advance to the original video frame using the above-described figure addition LUT to make a new video frame.

  In the table 50, as shown in the table diagram of FIG. 5, for example, for the transmission channel A, the camera that transmitted the image data to the transmission channel is a rear monitoring camera, and the image output from the camera is displayed. For transmission channel B, the camera that transmitted the image data to the transmission channel is a front monitoring camera, and the image data output from the camera should be subjected to bird's-eye display processing. The fact that the camera that transmitted the image data to the transmission channel is a side monitoring camera and that the image data output from the camera should be subjected to graphic mask processing is associated with the transmission channel C, respectively. Is remembered. This makes it possible to select processing in the image processing unit 7 to be described later for each transmission channel. That is, since the channel through which the camera transmits image data is defined in advance by the camera, it is possible to select processing for each camera.

  Based on the LUT selected by the control unit 23 according to the transmission channel based on the control command from the control unit 23, the image processing unit 27 performs image display such as an enlarged display process 27a, a bird's eye display process 27b, and a graphic mask process 27c. It has a function to perform processing. That is, each process executed by the image processing unit 27 is predetermined based on a transmission channel, and the content of the image processing is uniquely determined for each transmission channel through which image data is transmitted. Then, the image processing unit 27 processes image data output from the camera. Thereby, the image processing according to the connected camera can be automatically selected. Then, the camera image that has undergone image processing is converted into a format such as an RGB analog signal and output to the display unit 28, and the image related to the image data is displayed on the screen.

  Note that an image memory 29 is connected to the image processing unit 27 and temporarily stores data generated during execution of processing by the image processing unit 27. Of course, the image memory 29 may be a general DRAM, but since the display system is required to display without delay, it is preferable to speed up the processing using an SDRAM or the like.

  FIG. 6 is a flowchart showing an outline of an operation flow of the display device according to the present invention. The operation flow is an example, and the present invention is not limited to this. Such an operation flow can be performed by incorporating a computer program in advance in a ROM (not shown) built in the control unit 23.

  First, after the power is turned on or a bus reset occurs, the display device 20 determines the number of devices (cameras 31, 32a, 32b, 33) connected to the system and the node ID of its own node based on the broadcast self ID packet. Is checked (step S1).

  The display device 20 makes an inquiry to each device (camera 31, 32a, 32b, 33) connected to the system based on the checked node ID, and each device is IIDC based on the contents of the ConfigROM of each device. It is determined whether or not it is a camera (a camera corresponding to the IIDC protocol) (step S2). The ConfigROM stores various types of information for identifying a node, and can determine whether the camera is an IIDC camera.

  When it is determined that each device is an IIDC camera (S2: YES), the display device 20 transmits an image data transmission command to each device (cameras 31, 32a, 32b, and 33), thereby transmitting the image data to the isochronous channel. Image data is received (step S3). In addition, the display apparatus 20 complete | finishes a process, when it determines with not all apparatuses being IIDC cameras (S2: NO).

  The display device 20 refers to the table 50 stored in the flash memory 24 and extracts camera information and processing information of the camera that matches the isochronous channel number of the image data received by the communication unit 26 (step S4). . Thereby, the display device 20 can determine (identify) the type of the connected camera from the camera information, and can uniquely set the processing of the camera from the processing information. Then, in order to notify the user of the connected camera, the connection status of the camera is displayed on the screen of the display unit 28 (step S5). An example of the display screen is a screen as shown in FIG. 7, and the name and number of the connected camera are displayed on the screen of the display unit 28. Thereby, the user can grasp | ascertain the present connection condition reliably.

  Then, the user selects the camera to be displayed on the display unit 8 with reference to the connection status screen by using the display selection key 25a (step S6). The display device 20 sorts the video stream format image data received by the communication unit 6 for each isochronous channel and converts the image data into digital format image data such as YUV format (step S7).

  Then, the display device 20 selects an LUT that matches the processing information extracted in S4 from the LUTs 24a, 24b,... (Step S8), and processes the image data related to the camera selected in S6 (image). Process) (step S9). That is, based on the isochronous channel number, processing for the image data of the isochronous channel number is selected. Then, the processed image data is output to the display unit 28, and the video related to the image data is displayed on the screen (step S10). In this way, by incorporating a computer program in advance so as to select image processing according to the connected camera, even if the connection configuration of the camera changes, there is no need to change or add the computer program, A system with excellent extensibility can be constructed.

  Note that image data is multiplexed into a plurality of transmission channels, such as frequency division multiplexing (FDM), time division multiplexing (TDM), and code division multiplexing (CDM). .

  Further, the camera's flash memory 39 stores the transmission channel number of the camera in association with the processing information related to the transmission channel number, and the display device 20 stores the transmission channel number and the processing information related to the transmission channel number. And the table 50 may be updated.

  Further, the display device 20 may include an external communication unit having a function of communicating with the outside of the vehicle 1. The external communication means is a communication device capable of bidirectional communication such as a mobile phone, DSRC (Dedicated Short Range Communications), and an optical beacon, for example, connected to a communication network such as the Internet, and the transmission channel number of the camera and the transmission channel The table 50 may be updated by acquiring the processing information related to the number.

It is a block diagram which shows the structure of the display system which concerns on this invention. It is a block diagram which shows the structure of a rear monitoring camera. It is a block diagram which shows the structure of the display apparatus which concerns on this invention. It is a figure which shows the content of LUT. It is a table figure which shows the content memorize | stored in the table. It is a flowchart which shows the outline | summary of the operation | movement flow of the display apparatus which concerns on this invention. It is a schematic diagram which shows an example of the display screen of a camera connection condition.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Vehicle 2 Communication line 20 Display apparatus 23 Control part 24 Flash memory 24a, 24b, ... Look-up table (LUT)
50 Table 25 Operation unit 26 Communication unit 27 Image processing unit 28 Display unit 31 Front monitoring camera 32a, 32b Side monitoring camera 33 Rear monitoring camera 38 Communication unit 40a, 40b Repeater

Claims (11)

Communication using a plurality of transmission channels is performed between a photographing device mounted on a vehicle for photographing the periphery of the vehicle and a display device for displaying video, and the display device captures image data photographed by the photographing device. In the display method of performing any one of the plurality of processes on the display and displaying the video related to the processed image data,
The imaging device outputs image data to a predetermined transmission channel among the plurality of transmission channels,
The display method, wherein the display device selects a process for image data from the plurality of processes for each transmission channel. The display device extracts processing information associated with a transmission channel to which image data is transmitted from a table in which each transmission channel is associated with processing information for specifying processing for image data of the transmission channel,
The display method according to claim 1, wherein a process for image data is selected based on the extracted process information. The display method according to claim 2, wherein the display device updates the table by acquiring each transmission channel and processing information for specifying processing for image data of the transmission channel from the outside. The photographing apparatus stores in advance a transmission channel for outputting image data and processing information for specifying processing for the image data of the transmission channel,
The display method according to claim 2, wherein the display device updates the table by acquiring the transmission channel and the processing information from the imaging device. The display method according to any one of claims 1 to 4, wherein the plurality of processes include a process of changing a display position of each pixel of a video frame configured by image data. The display method according to claim 1, wherein the plurality of processes include a process of changing a resolution or a frame rate of a video frame configured by image data. A photographing device for photographing the periphery of the vehicle and a display device for displaying an image are mounted on the vehicle, and communication using a plurality of transmission channels is performed between the photographing device and the display device. In a display system that performs any one of a plurality of processes on image data and displays a video related to the processed image data on the display device,
The photographing apparatus includes means for designating a transmission channel for outputting the image data,
A display system, comprising: a selection unit that selects, for each transmission channel, processing for image data of each transmission channel from the plurality of processings. The selection means includes a table in which each transmission channel is associated with processing information for specifying processing for image data of the transmission channel;
Means for extracting processing information associated with a transmission channel through which image data has been transmitted from the table;
The display system according to claim 7, wherein processing for image data is selected based on the extracted processing information. The method according to claim 7 or 8, further comprising means for acquiring each transmission channel and processing information for specifying processing for image data of the transmission channel from a communication network inside or outside the vehicle. Display system. In a display device that inputs image data multiplexed into a plurality of transmission channels, performs any one of a plurality of processes on the input image data, and displays a video related to the processed image data.
A display device comprising means for selecting a process for image data of each transmission channel from among the plurality of processes for each transmission channel. In a photographing device that outputs image data obtained by photographing the periphery to one of a plurality of transmission channels,
Means for preliminarily storing a transmission channel for outputting the image data;
An apparatus for designating a stored transmission channel as a transmission channel for outputting the image data.

Images