WO2015133702A1 - Synchronization synthesis system and synchronization synthesis method for multiple images - Google Patents

Synchronization synthesis system and synchronization synthesis method for multiple images Download PDF

Info

Publication number
WO2015133702A1
WO2015133702A1 PCT/KR2014/010719 KR2014010719W WO2015133702A1 WO 2015133702 A1 WO2015133702 A1 WO 2015133702A1 KR 2014010719 W KR2014010719 W KR 2014010719W WO 2015133702 A1 WO2015133702 A1 WO 2015133702A1
Authority
WO
WIPO (PCT)
Prior art keywords
image sensor
signal
image
sensor unit
remote
Prior art date
Application number
PCT/KR2014/010719
Other languages
French (fr)
Korean (ko)
Inventor
이준석
전선
박흥열
하상욱
Original Assignee
㈜베이다스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ㈜베이다스 filed Critical ㈜베이다스
Publication of WO2015133702A1 publication Critical patent/WO2015133702A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/7795—Circuitry for generating timing or clock signals

Definitions

  • the present invention relates to a synchronization synthesizing system and a method of synthesizing a plurality of images, and more particularly, to send a video signal (including a synchronization signal) of a remote image sensor to a SerDes, and regenerate a reference clock with a frequency converter.
  • the present invention relates to a synchronization synthesizing system and a synchronization synthesizing method of a plurality of images for synchronizing and synthesizing video data of remote and local locations.
  • the rear sensing system As the vehicle becomes larger and the road becomes more complicated, various rear sensing systems have been applied to solve the difficulties experienced by the drivers when the vehicle reverses. That is, the rear camera is adopted so that the driver can check the rear of the vehicle through the rear camera when reversing.
  • the camera is mounted on the front, left and right of the car as well as the rear to help the driver to drive safely while checking both front and rear, left and right when parking or driving.
  • a system for providing a video signal to a driver using cameras mounted on the front, rear, left, and right sides of a vehicle is called an around view system.
  • the main technology of the around view system is to display images captured by multiple cameras on a single screen, which is one of the technologies requiring synchronization of images.
  • the remote site 100 when synthesizing images by synchronizing images, includes a remote image sensor unit 110 and a serial converter 120, and the local area 200 includes a local image sensor.
  • the unit 210, a serial-to-parallel converter 220, and an image combiner 240 are provided.
  • the video signal generated by the remote image sensor unit 110 is serial converted
  • the image 120 is transmitted to the image synthesizer 240 through the unit 120 and the serial-to-parallel converter 220, and a separate connection is required for the communication between the image synthesizer 240 and the remote image sensor unit 110.
  • the image synthesizer 240 In order to synchronize the remote image sensor unit of 200, the image synthesizer 240 generates a reference clock and directly transmits it to the local image sensor unit 210, and the remote image sensor unit 110 uses a differential driver 300.
  • the reference clock is transmitted to achieve synchronization of the images.
  • the Differential Dvriver 300 is a device that changes to a differential signal for differential transmission because the signal quality cannot be guaranteed when a high frequency signal (mainly 50 Mhz or more signal) is sent in single ended.
  • a high frequency signal mainly 50 Mhz or more signal
  • the prior art has an image data line for transmitting an image signal, a communication line for communication between a remote location and a local location, and a synchronization reference clock line for transmitting a synchronization signal, respectively.
  • I2C communication is a single-ended communication sharing the ground rather than the differential method, so the quality of the communication signal decreases as the length of the cable increases, so that the cable is restricted, and it is vulnerable to external noise.
  • An object of the present invention is to provide a synchronization synthesis system and a synchronization synthesis method of a plurality of images for synchronizing and synthesizing images of two or more local image sensor units.
  • the present invention is to provide a system for synthesizing a plurality of images and a method for synthesizing a synchronizing multiple lines to minimize the lines connected to the local and remote.
  • a synchronized image synthesizing system comprising: a remote image sensor unit and a local image sensor unit generating and outputting light as an image signal; A serial converter converting the video signal output from the remote image sensor unit into a serial signal; A serial-to-parallel converter for restoring the signal converted by the serial converter to the same image signal as the signal output from the remote image sensor unit; A frequency converter converting a frequency of a pixel clock of the restored image signal into a synchronization reference clock required by the image sensor unit and transferring the frequency to the local image sensor unit; And an image synthesizing unit synthesizing an image by synchronizing the image signal of the remote image sensor unit restored by the serial / parallel converter with the image signal of the local image sensor unit receiving the reference clock based on the synchronization reference clock converted by the frequency converter.
  • the remote image sensor unit and the serial converter are provided at a remote location, the serial-parallel converter, a frequency converter, a local image sensor unit, and an image synthesis unit are provided at a local location, and the remote location and the local location are only two lines for transmitting a video signal. Can be connected.
  • the remote image sensor unit, the local image sensor unit and the image synthesizer communication unit for initializing the communication signal may further include a.
  • the image signal output from the remote image sensor unit may include all of the image data signal, HSYNC (horizontal synchronizer), VSYNC (vertical synchronizer), and pixel clock in the form of a parallel signal.
  • the image signal output from the remote image sensor unit may include both an image data signal, an embedded synchronization signal (embedded sync), and a pixel clock in a parallel signal form.
  • embedded sync embedded synchronization signal
  • Another synchronization synthesis method of the present invention for achieving the above object is a first step of initiating communication between the remote and local; Generating a video signal by using a remote image sensor unit at a remote location and a local image sensor unit at a local location; Serializing the video signal; A fourth step of restoring the serialized serial signal back to the image signal of the remote image sensor unit and transmitting the same to the image synthesizer and the frequency converter; A fifth step of converting the restored image signal transmitted to the frequency converter into a reference clock required by a remote and local image sensor unit and transferring the converted image signal to a local image sensor unit and an image synthesizer; A sixth step of transmitting the image signal synchronized with the reference clock to the image synthesizer; And a seventh step of combining the image signal of the remote image sensor unit and the image signal of the local image sensor unit corresponding to the received reference clock and combining the image signal into a single image.
  • the first step of initializing the communication between the remote and the local may include a first-first step of generating a clock through a signal generator and transmitting the clock to the remote image sensor; A first clock transmitted to the remote image sensor unit through a serial converter, a serial / parallel converter, a frequency converter, a local image sensor unit, and an image synthesizer; The communication control unit receiving the clock transfers an initialization signal to an image synthesis unit; And (1-4) transmitting the communication initialization command to the local image sensor unit and the remote image sensor unit, and receiving a response and transmitting the response to the communication control unit.
  • the image synthesizing unit may transmit an initialization command to the remote image sensor through a serial and serial converter and a serial converter, and may receive a response from the remote image sensor through a serial converter and a serial and parallel converter.
  • the present invention has an effect of reducing the cable length restriction due to signal quality because the communication line is transmitted in a differential manner rather than a single-ended communication sharing the ground.
  • the present invention regenerates the reference clock using the pixel clock, it reduces the installation cost by reducing the thickness of the cable by reducing the synchronization reference clock line for transmitting the reference clock.
  • FIG. 1 is a view showing a conventional image synthesis system.
  • FIG. 2 is a diagram illustrating a system for synchronizing multiple images according to an embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating an example of a synchronization synthesis method and a signal change according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating signal movement for initialization in a synchronization synthesis method according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating a system for synthesizing a plurality of images according to an exemplary embodiment of the present invention, wherein a remote image sensor unit 110, a local image sensor unit 210, a serial converter 120, a serial / parallel converter 220, And a frequency converter 230, an image synthesizer 240, and a communication controller 250.
  • the remote image sensor unit 110 and the serial converter 120 corresponds to the remote location 100
  • the local image sensor unit 210, the serial-to-parallel converter 220, the frequency converter 230, the image synthesizer 240 And the communication control unit 250 correspond to the local area 200.
  • the remote location 100 further includes a signal generator 130, and the signal generator 130 generates a synchronization reference clock.
  • the remote image sensor unit 110 and the local image sensor unit 210 generate and output light as an image signal, and a synchronization signal is also output when the image signal is output.
  • the image signal output from the remote image sensor unit 110 includes all of the image data signal, HSYNC (horizontal synchronizer), VSYNC (vertical synchronizer), and pixel clock in the form of a parallel signal, or the image data signal, built-in synchronization. It can include both a signal (embedded sync) and a pixel clock.
  • the built-in synchronization signal refers to a synchronization signal transmitted together with the image data signal.
  • the remote image sensor 110 receives a reference clock generated by the signal generator 130 and is used to synchronize the local image sensor 210 with the reference clock.
  • the serial converter 120 serializes an image signal output from the remote image sensor unit 110 and converts the image signal into a serial signal. At this time, the serial converter 120 converts the pixel clock 10 to 20 times faster, and transmits the image signal of the remote image sensor unit to the serial / parallel converter 220 provided in the local area 200 in accordance with the pixel clock.
  • USB Universal Serial Bus
  • two wires means one cable consisting of two wires.
  • the serial / parallel converter 220 restores the signal converted by the serial converter 120 back to the same image signal as the signal output from the remote image sensor unit 110.
  • the frequency converter 230 converts a frequency of a pixel clock of the restored image signal into a synchronization reference clock required by the image sensors 110 and 210, and then converts the frequency into a local image sensor unit. And to the image synthesizer 240. Synchronization is performed based on the reference clock transmitted to the image synthesizing unit 240.
  • the frequency converter 230 regenerates the reference clock using the pixel clock, it is possible to reduce the thickness of the cable by reducing the synchronization reference clock line for transmitting the reference clock, thereby reducing the installation cost.
  • the image synthesizing unit 240 receives the image signal and the reference clock of the remote image sensor unit 110 restored by the serial-to-parallel converter 220 based on the synchronization reference clock converted by the frequency converter 230. Images are synthesized by synchronizing image signals of the image sensor units 210.
  • the communication control unit 250 may control the remote image sensor unit 110, the local image sensor unit 210, and the image sensor unit 110 and 210 to synchronize the image signal before transmitting the image signal to the image synthesizing unit 240. Initialize the communication signal of the image synthesizing unit 240.
  • the communication of the remote image sensor unit 110, the local image sensor unit 210, and the image synthesizing unit 240 must be initialized to achieve synchronization of the image signals.
  • FIG. 3 is a diagram illustrating a synthesizing method according to an embodiment of the present invention. Also, a change in a signal is illustrated, and the resolution, the number of bits, and a clock are different for each system. It is only.
  • the clock signal generation unit 130 generates a clock signal and transmits the clock signal to the remote image sensor unit 110. (1).
  • the clock signal has a garbage value.
  • the clock signal transmitted to the remote image sensor unit 110 is transmitted to the serial converter 120, and sequentially, the serial and parallel converter 220, the frequency converter 230, the local image sensor 210, And it is transmitted to the communication control unit 250 via the image synthesizing unit 240 (2 ⁇ 7).
  • the communication control unit 250 receiving the clock signal transmits an initialization signal to the image synthesizing unit 240 (8).
  • the image synthesizing unit 240 transmits a communication initialization command to the local image sensor unit 210 and the remote image sensor unit 110 (9 ⁇ 11), and receives the initialization approval response of each configuration to the communication control unit 250 (Not shown).
  • the communication initialization command is transmitted to the remote image sensor unit 110
  • the communication initialization command is transmitted to the remote image sensor unit 110 via the serial / parallel conversion unit 120 and the serial conversion unit 220.
  • the communication signal may be initialized to start synchronization of the remote image sensor unit 110 and the local image sensor units 210.
  • an image signal is generated using the remote image sensor 110 of the remote location 100 and the local image sensor 210 of the local location 200 (S20).
  • the image signal includes all of the image data signal, HSYNC (horizontal synchronizer), VSYNC (vertical synchronizer), and pixel clock in the form of a parallel signal, or the image data signal, the built-in synchronization signal (embedded sync), and the pixel. It can include all of the clocks. This is a difference of items included in the video signal depending on the system.
  • the remote image sensor unit 110 receives the reference clock generated from the signal generator 130.
  • the reference clock generated by the signal generator 130 is determined by the resolution and frame rate of the image sensor.
  • the image signal generated by the remote image sensor unit 110 is serialized (S30).
  • the pixel clock of the serialized video signal is converted 10 times to 20 times faster to raise the received pixel clock 74.25Mhz to 1.5Ghz.
  • the signal may be transmitted to the local area 200 that is safely spaced apart.
  • the serialized serial signal is restored to the same as the image signal of the remote image sensor unit 110 and transferred to the image synthesizing unit 240 and the frequency converter 230 (S40).
  • the pixel clock is the same as the pixel clock of the image signal generated by the remote image sensor unit.
  • the restored image signal transmitted to the frequency converter 230 is converted into a reference clock required by the remote and local image sensor units, and then transferred to the local image sensor unit 210 and the image synthesizer 240 ( S50).
  • the local image sensor unit 210 receiving the reference clock transmits an image signal synchronized with the reference clock to the image synthesizing unit 240 (S60).
  • the image synthesizing unit 240 combines the image signal of the remote image sensor unit 110 and the image signal of the local image sensor unit 210 corresponding to the received reference clock to synthesize one image (S70). ).
  • the synthesized image is output through the display (not shown) (S80).
  • the image synthesizer 240 may output at 3840 * 1080 pixels (S8).
  • the image synthesizing unit 240 divides the pixel clock 74.25Mhz into 1 / N to regenerate the reference clock (37.125Mhz) to synchronize the image signals of the remote image sensor unit 110 and the local image sensor unit 210.
  • N means the number of local image sensors.
  • Such a synthesizing system and a synthesizing method of a plurality of images are not limited to the configuration and operation of the embodiments described above.
  • the above embodiments may be configured such that various modifications may be made by selectively combining all or part of the embodiments.
  • remote location 110 remote image sensor unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)

Abstract

The present invention relates to and provides a synchronization synthesis system and a synchronization synthesis method for multiple images, which send an image signal (including a synchronization signal) of an image sensor at a remote place to SerDes, regenerate a reference clock by a frequency converter, and synchronize and synthesize image data at the remote place and a local place, wherein a remote image sensor unit and a serializer are arranged at the remote place, a serial-to-parallel converter, a frequency converter, a local image sensor unit, and an image synthesis unit are arranged at the local place, and the remote place and the local place are connected by only two lines for transmission of the image signal.

Description

복수 이미지의 동기화 합성 시스템 및 동기화 합성 방법Synthesis Synthesis System and Synthesis Method of Multiple Images
본 발명은 복수 이미지의 동기화 합성 시스템 및 동기화 합성 방법에 관한 것으로, 더욱 상세하게는 원격지의 이미지 센서의 영상신호(동기신호 포함)를 SerDes로 보내고, 주파수 변환기로 레퍼런스 클럭(Reference Clock)을 재생성하여 원격지 및 로컬지의 영상 데이터를 동기화하여 합성시키는 복수 이미지의 동기화 합성 시스템 및 동기화 합성 방법에 관한 것이다.The present invention relates to a synchronization synthesizing system and a method of synthesizing a plurality of images, and more particularly, to send a video signal (including a synchronization signal) of a remote image sensor to a SerDes, and regenerate a reference clock with a frequency converter. The present invention relates to a synchronization synthesizing system and a synchronization synthesizing method of a plurality of images for synchronizing and synthesizing video data of remote and local locations.
자동차 제조사들은 자동차의 운전 성능 개선 뿐 만 아니라, 안전에 필요한 다양한 장치들을 자동차에 채용함으로써, 운전자의 편의 및 안전운전을 도모하고 있다.In addition to improving the driving performance of automobiles, automakers are adopting various devices necessary for safety in their cars to promote driver convenience and safe driving.
이중 하나가 후방감지시스템으로서, 차량이 대형화되고, 갈수록 도로가 복잡해짐에 따라, 차량의 후진시 운전자들이 겪는 어려움을 해소하기 위하여 다양한 후방감지 시스템이 적용되고 있다. 즉, 후방 카메라가 채용됨으로써 운전자는 후진시 후방 카메라를 통해 차량의 후방부를 확인할 수 있게 되었다.One of them is the rear sensing system, and as the vehicle becomes larger and the road becomes more complicated, various rear sensing systems have been applied to solve the difficulties experienced by the drivers when the vehicle reverses. That is, the rear camera is adopted so that the driver can check the rear of the vehicle through the rear camera when reversing.
한편, 최근에는 후방 뿐만 아니라, 자동차의 전방, 좌측 및 우측에 카메라가 장착되어 운전자가 주차 또는 주행 시에 전후좌우를 모두 확인하며 안전 운행을 할 수 있도록 도와주고 있다. 일반적으로, 자동차의 전후좌우에 장착된 카메라를 이용하여 운전자에게 영상신호를 제공해주는 시스템은 어라운드 뷰 시스템(Around View System)이라 한다.On the other hand, recently, the camera is mounted on the front, left and right of the car as well as the rear to help the driver to drive safely while checking both front and rear, left and right when parking or driving. In general, a system for providing a video signal to a driver using cameras mounted on the front, rear, left, and right sides of a vehicle is called an around view system.
어라운드 뷰 시스템의 주 기술은 여러 대의 카메라가 촬영한 영상을 한 화면에 매칭하여 표시해주는 것으로 영상들의 동기화가 요구되는 기술 중 하나이다.The main technology of the around view system is to display images captured by multiple cameras on a single screen, which is one of the technologies requiring synchronization of images.
일반적으로 영상을 동기화하여 영상을 합성하는 경우는 도 1과 같은 구성으로 원격지(100)는 원격 이미지 센서부(110) 및 직렬 변환부(120)를 구비하고, 로컬지(200)는 로컬 이미지 센서부(210), 직병렬 변환부(220), 및 이미지 합성부(240)를 구비한다.In general, when synthesizing images by synchronizing images, the remote site 100 includes a remote image sensor unit 110 and a serial converter 120, and the local area 200 includes a local image sensor. The unit 210, a serial-to-parallel converter 220, and an image combiner 240 are provided.
여기서, 원격 이미지 센서부(110)에서 생성된 영상신호는 직렬 변환Here, the video signal generated by the remote image sensor unit 110 is serial converted
부(120) 및 직병렬 변환부(220)를 통해 이미지 합성부(240)에 전달되며, 이미지 합성부(240)와 원격 이미지 센서부(110)의 통신을 위해 별도의 연결이 필요하며, 원격지(200)의 원격 이미지 센서부의 동기화를 위해 이미지 합성부(240)에서 레퍼런스 클럭을 생성하여 로컬 이미지 센서부(210)에는 직접 전달하고, 원격 이미지 센서부(110)에는 Differential Driver(300)를 통해 레퍼런스 클럭을 전달하여 영상의 동기화를 이룬다.The image 120 is transmitted to the image synthesizer 240 through the unit 120 and the serial-to-parallel converter 220, and a separate connection is required for the communication between the image synthesizer 240 and the remote image sensor unit 110. In order to synchronize the remote image sensor unit of 200, the image synthesizer 240 generates a reference clock and directly transmits it to the local image sensor unit 210, and the remote image sensor unit 110 uses a differential driver 300. The reference clock is transmitted to achieve synchronization of the images.
여기서, Differential Dvriver(300)는 고주파 신호(주로 50Mhz 이상신호)를 Single ended로 보낼 경우 신호의 품질을 보장할 수 없기 때문에 차동전송을 위해 차동신호로 변화해 주는 장치이다.Here, the Differential Dvriver 300 is a device that changes to a differential signal for differential transmission because the signal quality cannot be guaranteed when a high frequency signal (mainly 50 Mhz or more signal) is sent in single ended.
이로써, 종래기술은 영상을 신호를 전달하는 영상 데이터 선(Line), 원격지와 로컬지의 통신을 위한 통신 선(Line), 및 동기화 신호를 전달하기 위한 동기화 레퍼런스 클럭 선(Line)을 각각 구비하였다.As a result, the prior art has an image data line for transmitting an image signal, a communication line for communication between a remote location and a local location, and a synchronization reference clock line for transmitting a synchronization signal, respectively.
그러나, 종래에서는 I2C 통신 데이터와, REF CLOCK를 따로 원격 이미지 센서부에 전달하기 때문에 영상 데이터 선을 포함하여 각각 2개씩 총 6개의 선(Line)이 필요하였다. 이로 인해 선이 굵어 인스톨이 불편하고 케이블 가격이 비싸다는 문제가 발생하였다.However, in the related art, since the I2C communication data and the REF CLOCK are separately transmitted to the remote image sensor unit, a total of six lines including two video data lines are required. This caused a problem that the installation is inconvenient and expensive cable because of the thick wire.
또한, I2C 통신은 Differential 방식이 아닌 ground를 공유하는 single-ended 통신을 하기 때문에 케이블 길이가 늘어남에 따라 통신 신호의 품질이 떨어져 케이블의 제약을 많이 받으며, 외부 노이즈에 취약하다는 문제가 있다.In addition, I2C communication is a single-ended communication sharing the ground rather than the differential method, so the quality of the communication signal decreases as the length of the cable increases, so that the cable is restricted, and it is vulnerable to external noise.
관련 선행기술로는 한국공개특허 제2011-38773호(공개일:2011.04.15., 발명의 명칭: 영상 합성장치 및 방법)가 있다.Related prior arts include Korean Patent Publication No. 2011-38773 (published date: April 15, 2011, title of the invention: an image synthesizing apparatus and method).
본 발명은 2개 이상의 로컬 이미지 센서부의 영상을 동기화하여 합성하는 복수 이미지의 동기화 합성 시스템 및 동기화 합성 방법을 제공하기 위한 것이다.An object of the present invention is to provide a synchronization synthesis system and a synchronization synthesis method of a plurality of images for synchronizing and synthesizing images of two or more local image sensor units.
또한, 본 발명은 로컬지와 원격지로 연결되는 선을 최소화하는 복수 이미지의 동기화 합성 시스템 및 동기화 합성 방법을 제공하기 위한 것이다.In addition, the present invention is to provide a system for synthesizing a plurality of images and a method for synthesizing a synchronizing multiple lines to minimize the lines connected to the local and remote.
본 발명이 이루고자 하는 기술적 과제들은 이상에서 언급한 기술적 과제들로 제한되지 않는다.The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above.
상기 과제를 달성하기 위한 본 발명에 따른 복수 이미지의 동기화 합성 시스템은, 빛을 영상 신호로 생성하여 출력하는 원격 이미지 센서부 및 로컬 이미지 센서부; 상기 원격 이미지 센서부에서 출력하는 영상 신호를 직렬화하여 직렬신호로 변환시키는 직렬변환기; 상기 직렬변환기에서 변환된 신호를 다시 상기 원격 이미지 센서부에서 출력한 신호와 동일한 영상 신호로 복원하는 직병렬 변환기; 상기에서 복원된 영상 신호의 픽셀 클럭(Pixel Clock)을 이미지 센서부들이 필요로 하는 동기화 레퍼런스 클럭(Reference Clock)으로 주파수를 변환하여 상기 로컬 이미지 센서부에 전달하는 주파수 변환기; 및 상기 주파수 변환기에서 변환한동기화 레퍼런스 클럭을 기준으로, 상기 직병렬 변환기에서 복원한 원격 이미지 센서부의 영상 신호와 레퍼런스 클럭을 전달받은 로컬 이미지 센서부의 영상 신호를 동기화시켜 이미지를 합성하는 이미지 합성부;를 포함하고,According to an aspect of the present invention, there is provided a synchronized image synthesizing system comprising: a remote image sensor unit and a local image sensor unit generating and outputting light as an image signal; A serial converter converting the video signal output from the remote image sensor unit into a serial signal; A serial-to-parallel converter for restoring the signal converted by the serial converter to the same image signal as the signal output from the remote image sensor unit; A frequency converter converting a frequency of a pixel clock of the restored image signal into a synchronization reference clock required by the image sensor unit and transferring the frequency to the local image sensor unit; And an image synthesizing unit synthesizing an image by synchronizing the image signal of the remote image sensor unit restored by the serial / parallel converter with the image signal of the local image sensor unit receiving the reference clock based on the synchronization reference clock converted by the frequency converter. Including,
상기 원격 이미지 센서부 및 직렬 변환기는 원격지에 구비되고, 직병렬 변환기, 주파수 변환기, 로컬 이미지 센서부, 및 이미지 합성부는 로컬지에 구비되며, 원격지와 로컬지는 영상 신호의 전송을 위한 두 개의 선으로만 연결될 수 있다.The remote image sensor unit and the serial converter are provided at a remote location, the serial-parallel converter, a frequency converter, a local image sensor unit, and an image synthesis unit are provided at a local location, and the remote location and the local location are only two lines for transmitting a video signal. Can be connected.
구체적으로, 상기 원격 이미지 센서부, 로컬 이미지 센서부 및 이미지 합성부의 통신신호를 초기화시키는 통신 제어부;를 더 포함 할 수 있다.Specifically, the remote image sensor unit, the local image sensor unit and the image synthesizer communication unit for initializing the communication signal; may further include a.
또한, 상기 원격 이미지 센서부에서 출력하는 영상 신호는 병렬신호 형태로 영상 데이터신호, HSYNC(수평동기), VSYNC(수직동기), 및 Pixel Clock를 모두 포함할 수 있다.In addition, the image signal output from the remote image sensor unit may include all of the image data signal, HSYNC (horizontal synchronizer), VSYNC (vertical synchronizer), and pixel clock in the form of a parallel signal.
또한, 상기 원격 이미지 센서부에서 출력하는 영상 신호는 병렬신호 형태로 영상 데이터신호, 내장 동기신호(임베디드 싱크), 및 Pixel Clock를 모두 포함할 수 있다.In addition, the image signal output from the remote image sensor unit may include both an image data signal, an embedded synchronization signal (embedded sync), and a pixel clock in a parallel signal form.
상기 과제를 달성하기 위한 다른 본 발명의 동기화 합성 방법은 원격지 및 로컬지의 통신을 초기화시키는 제1 단계; 원격지의 원격 이미지 센서부 및 로컬지의 로컬 이미지 센서부를 이용하여 영상 신호를 생성시키는 제2 단계; 상기 영상 신호를 직렬화시키는 제3 단계; 상기 직렬화된 직렬신호를 상기 원격 이미지 센서부의 영상 신호와 동일하게 다시 복원시켜 영상합성부 및 주파수 변환기에 전달하는 제4 단계; 상기 주파수 변환기에 전달된 복원된 영상 신호를 원격 및 로컬 이미지 센서부가 필요한 레퍼런스 클럭(Reference Clock)으로 변환시켜 로컬 이미지 센서부 및 영상합성부에 전달되는 제5 단계; 상기 레퍼런스 클럭을 전달받은 로컬 이미지 센서부는 레퍼런스 클럭에 동기화된 영상 신호를 이미지 합성부에 전달하는 제6 단계; 및 상기 이미지 합성부는 전달받은 레퍼런스 클럭에 해당되는 원격 이미지 센서부의 영상 신호 및 로컬 이미지 센서부의 영상 신호를 결합하여 한 개의 영상으로 합성하는 제7 단계;로 이루어질 수 있다.Another synchronization synthesis method of the present invention for achieving the above object is a first step of initiating communication between the remote and local; Generating a video signal by using a remote image sensor unit at a remote location and a local image sensor unit at a local location; Serializing the video signal; A fourth step of restoring the serialized serial signal back to the image signal of the remote image sensor unit and transmitting the same to the image synthesizer and the frequency converter; A fifth step of converting the restored image signal transmitted to the frequency converter into a reference clock required by a remote and local image sensor unit and transferring the converted image signal to a local image sensor unit and an image synthesizer; A sixth step of transmitting the image signal synchronized with the reference clock to the image synthesizer; And a seventh step of combining the image signal of the remote image sensor unit and the image signal of the local image sensor unit corresponding to the received reference clock and combining the image signal into a single image.
구체적으로, 상기 원격지 및 로컬지의 통신을 초기화하는 제1 단계는, 신호 발생부를 통해 클럭을 생성하여 원격 이미지 센서부에 전달하는 제1-1단계; 상기 원격 이미지 센서부에 전달된 클럭은 직렬 변환부, 직병렬 변환부, 주파수 변환기, 로컬 이미지 센서부, 및 이미지 합성부를 거쳐 통신 제어부에 전달되는 제1-2 단계; 상기 클럭을 전달받은 통신 제어부는 이미지 합성부에 초기화 신호를 전달시키는 1-3단계; 및 상기 이미지 합성부는 로컬 이미지 센서부 및 원격 이미지 센서부에 통신 초기화 명령을 전달하고, 응답을 받아 통신제어부에 전달하는 제1-4단계;로 이루어질 수 있다.Specifically, the first step of initializing the communication between the remote and the local may include a first-first step of generating a clock through a signal generator and transmitting the clock to the remote image sensor; A first clock transmitted to the remote image sensor unit through a serial converter, a serial / parallel converter, a frequency converter, a local image sensor unit, and an image synthesizer; The communication control unit receiving the clock transfers an initialization signal to an image synthesis unit; And (1-4) transmitting the communication initialization command to the local image sensor unit and the remote image sensor unit, and receiving a response and transmitting the response to the communication control unit.
또한, 상기 이미지 합성부는 직병렬 변환기 및 직렬 변환기를 거쳐원격 이미지 센서에 초기화 명령을 전달하고, 원격 이미지 센서로부터 직렬변환기 및 직병렬 변환기를 거쳐 응답을 전달받을 수 있다.In addition, the image synthesizing unit may transmit an initialization command to the remote image sensor through a serial and serial converter and a serial converter, and may receive a response from the remote image sensor through a serial converter and a serial and parallel converter.
이상에서 설명한 바와 같이 본 발명은 통신선이 Ground를 공유하는 single-ended 통신이 아닌 differential 방식으로 전송되기 때문에 신호 품질에 따른 케이블 길이의 제약을 줄이는 효과가 있다.As described above, the present invention has an effect of reducing the cable length restriction due to signal quality because the communication line is transmitted in a differential manner rather than a single-ended communication sharing the ground.
또한, 본 발명은 Pixel clock를 이용하여 Reference clock을 재생성하기 때문에 Reference clock를 전송하는 동기화 레퍼런스 클럭 선을 줄여 케이블의 두께를 감소 시켜 설치비용을 절감하는 효과가 있다.In addition, since the present invention regenerates the reference clock using the pixel clock, it reduces the installation cost by reducing the thickness of the cable by reducing the synchronization reference clock line for transmitting the reference clock.
도 1은 종래의 이미지 합성시스템을 나타낸 도면이다.1 is a view showing a conventional image synthesis system.
도 2는 본 발명의 실시예에 따른 복수 이미지의 동기화 합성 시스템을 나타낸 도면이다.2 is a diagram illustrating a system for synchronizing multiple images according to an embodiment of the present invention.
도 3은 본 발명의 실시예에 따른 동기화 합성 방법 및 신호 변화의 예시를 나타낸 흐름도이다.3 is a flowchart illustrating an example of a synchronization synthesis method and a signal change according to an embodiment of the present invention.
도 4는 본 발명의 실시예에 따른 동기화 합성 방법 중 초기화를 위한 신호이동을 나타낸 도면이다.4 is a diagram illustrating signal movement for initialization in a synchronization synthesis method according to an embodiment of the present invention.
이하, 첨부된 도면을 참조하여 본 발명의 바람직한 실시예를 상세하게 설명한다. 도면들 중 동일한 구성요소들은 가능한 어느 곳에서든지 동일한 부호로 표시한다. 또한 본 발명의 요지를 불필요하게 흐릴 수 있는 공지 기능 및 구성에 대한 상세한 설명은 생략한다.Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention. Like elements in the figures are denoted by the same reference numerals wherever possible. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.
도 2는 본 발명의 실시예에 따른 복수 이미지의 동기화 합성 시스템을 나타낸 도면으로, 원격 이미지 센서부(110), 로컬 이미지 센서부(210), 직렬 변환기(120), 직병렬 변환기(220), 주파수 변환기(230), 이미지 합성부(240), 및 통신 제어부(250)를 포함한다.2 is a diagram illustrating a system for synthesizing a plurality of images according to an exemplary embodiment of the present invention, wherein a remote image sensor unit 110, a local image sensor unit 210, a serial converter 120, a serial / parallel converter 220, And a frequency converter 230, an image synthesizer 240, and a communication controller 250.
여기서, 원격 이미지 센서부(110) 및 직렬 변환기(120)은 원격지(100)에 해당되고, 로컬 이미지 센서부(210), 직병렬 변환기(220), 주파수 변환기(230), 이미지 합성부(240), 및 통신 제어부(250)은 로컬지(200)에 해당된다.Here, the remote image sensor unit 110 and the serial converter 120 corresponds to the remote location 100, the local image sensor unit 210, the serial-to-parallel converter 220, the frequency converter 230, the image synthesizer 240 And the communication control unit 250 correspond to the local area 200.
또한, 상기 원격지(100)는 신호 발생기(130)를 더 포함하고, 신호발생기(130)는 동기화 레퍼런스 클럭을 발생시킨다.In addition, the remote location 100 further includes a signal generator 130, and the signal generator 130 generates a synchronization reference clock.
원격 이미지 센서부(110) 및 로컬 이미지 센서부(210)는 빛을 영상 신호로 생성하여 출력하는 것으로, 영상 신호를 출력할 때 동기 신호도 함께 출력된다.The remote image sensor unit 110 and the local image sensor unit 210 generate and output light as an image signal, and a synchronization signal is also output when the image signal is output.
이때, 상기 원격 이미지 센서부(110)에서 출력하는 영상 신호는 병렬신호 형태로 영상 데이터 신호, HSYNC(수평동기), VSYNC(수직동기), 및 Pixel Clock를 모두 포함하거나, 영상 데이터 신호, 내장 동기신호(임베디드 싱크), 및 Pixel Clock를 모두 포함할 수 있다.In this case, the image signal output from the remote image sensor unit 110 includes all of the image data signal, HSYNC (horizontal synchronizer), VSYNC (vertical synchronizer), and pixel clock in the form of a parallel signal, or the image data signal, built-in synchronization. It can include both a signal (embedded sync) and a pixel clock.
여기서, 내장 동기신호는 영상 데이터 신호에 함께 전달되는 동기신호를 의미한다.Here, the built-in synchronization signal refers to a synchronization signal transmitted together with the image data signal.
또한, 원격 이미지 센서부(110)는 신호 발생부(130)에서 생성한 레퍼런스 클럭을 전달받아 이를 기준으로 로컬 이미지 센서부(210)와 동기화할 때 사용된다.In addition, the remote image sensor 110 receives a reference clock generated by the signal generator 130 and is used to synchronize the local image sensor 210 with the reference clock.
직렬 변환기(120)는 상기 원격 이미지 센서부(110)에서 출력하는 영상 신호를 직렬화하여 직렬신호로 변환시킨다. 이때, 직렬 변환기(120)는 Pixel Clock을 10 내지 20배로 빠르게 변환하고, Pixel Clock에 맞추어 원격 이미지 센서부의 영상 신호를 로컬지(200)에 구비된 직병렬 변환기(220)로 전달한다.The serial converter 120 serializes an image signal output from the remote image sensor unit 110 and converts the image signal into a serial signal. At this time, the serial converter 120 converts the pixel clock 10 to 20 times faster, and transmits the image signal of the remote image sensor unit to the serial / parallel converter 220 provided in the local area 200 in accordance with the pixel clock.
이때, 직렬 변화기(120)와 직병렬 변환기(220)를 서로 연결하기 위해 2개의 선이 연결된다. 이때, 2개의 선은 USB(Universal Serial Bus)와 같은 differential 방식의 케이블을 채택함이 바람직하다.At this time, two lines are connected to connect the series transducer 120 and the serial-to-parallel converter 220 with each other. In this case, it is preferable that the two wires adopt a differential type cable such as USB (Universal Serial Bus).
여기서, 2개의 선이란 2개의 선으로 이루어진 하나의 케이블을 의미한다.Here, two wires means one cable consisting of two wires.
이처럼, 통신선이 Ground를 공유하는 single-ended 통신이 아닌 differential 방식으로 전송되기 때문에 신호 품질에 따른 케이블 길이의 제약을 줄이는 효과가 있다.As such, since the communication lines are transmitted in a differential manner rather than in a single-ended communication sharing ground, there is an effect of reducing the cable length limitation due to signal quality.
직병렬 변환기(220)는 상기 직렬 변환기(120)에서 변환된 신호를 다시 상기 원격 이미지 센서부(110)에서 출력한 신호와 동일한 영상 신호로 복원한다.The serial / parallel converter 220 restores the signal converted by the serial converter 120 back to the same image signal as the signal output from the remote image sensor unit 110.
주파수 변환기(230)는 상기에서 복원된 영상 신호의 픽셀 클럭(Pixel Clock)을 이미지 센서부(110, 210)들이 필요로 하는 동기화 레퍼런스 클럭(Reference Clock)으로 주파수를 변환하여, 상기 로컬 이미지 센서부(210) 및 이미지 합성부(240)에 전달한다. 이미지 합성부(240)에 전달된 레퍼런스 클럭을 기준으로 동기화가 이루어진다.The frequency converter 230 converts a frequency of a pixel clock of the restored image signal into a synchronization reference clock required by the image sensors 110 and 210, and then converts the frequency into a local image sensor unit. And to the image synthesizer 240. Synchronization is performed based on the reference clock transmitted to the image synthesizing unit 240.
이와 같이, 주파수 변환기(230)가 픽셀 클럭을 이용하여 레퍼런스 클럭을 재생성 하기 때문에 레퍼런스 클럭을 전송하는 동기화 레퍼런스 클럭 선을 줄여 케이블의 두께를 감소 시켜 설치비용을 절감하는 효과가 있다.As such, since the frequency converter 230 regenerates the reference clock using the pixel clock, it is possible to reduce the thickness of the cable by reducing the synchronization reference clock line for transmitting the reference clock, thereby reducing the installation cost.
이미지 합성부(240)는 상기 주파수 변환기(230)에서 변환한 동기화 레퍼런스 클럭을 기준으로, 상기 직병렬 변환기(220)에서 복원한 원격 이미지 센서부(110)의 영상 신호와 레퍼런스 클럭을 전달받은 로컬 이미지 센서부들(210)의 영상 신호를 동기화시켜 이미지를 합성한다.The image synthesizing unit 240 receives the image signal and the reference clock of the remote image sensor unit 110 restored by the serial-to-parallel converter 220 based on the synchronization reference clock converted by the frequency converter 230. Images are synthesized by synchronizing image signals of the image sensor units 210.
통신 제어부(250)는 이미지 센서부들(110, 210)가 이미지 합성부(240)부에 영상 신호를 전달하기 전에 동기화를 맞추기 위해 상기 원격 이미지 센서부(110), 로컬 이미지 센서부(210) 및 이미지 합성부(240)의 통신신호를 초기화시킨다.The communication control unit 250 may control the remote image sensor unit 110, the local image sensor unit 210, and the image sensor unit 110 and 210 to synchronize the image signal before transmitting the image signal to the image synthesizing unit 240. Initialize the communication signal of the image synthesizing unit 240.
이와 같이, 상기 원격 이미지 센서부(110), 로컬 이미지 센서부(210) 및 이미지 합성부(240)의 통신 초기화가 이루어져야 영상 신호들의 동기화를 이룰 수 있다.As such, the communication of the remote image sensor unit 110, the local image sensor unit 210, and the image synthesizing unit 240 must be initialized to achieve synchronization of the image signals.
도 3은 본 발명의 실시예에 따른 동기화 합성 방법을 나타낸 도면으로 예시된 신호의 변화도 함께 도시되었으며, 해상도, 비트 수, 클럭은 시스템마다 다르면 도 3에서는 신호의 흐름을 명확하게 하기 위한 예시에 불과하다.3 is a diagram illustrating a synthesizing method according to an embodiment of the present invention. Also, a change in a signal is illustrated, and the resolution, the number of bits, and a clock are different for each system. It is only.
복수 이미지의 동기화 합성 방법은 먼저, 원격지(100) 및 로컬지(200)의 통신을 초기화시킨다(S10).In the method of synthesizing a plurality of images, first, communication between the remote location 100 and the local location 200 is initialized (S10).
여기서, 원격지(100) 및 로컬지(200)의 통신을 초기화시키는 방법은 도 4에 나타낸 바와 같이, 신호 발생부(130)를 통해 클럭 신호를 생성하여 그 클럭 신호를 원격 이미지 센서부(110)에 전달한다(①).Here, in the method of initializing the communication between the remote location 100 and the local location 200, as shown in FIG. 4, the clock signal generation unit 130 generates a clock signal and transmits the clock signal to the remote image sensor unit 110. (①).
이때의 클럭 신호는 가비지(Garbage) 값을 갖는다.At this time, the clock signal has a garbage value.
그리고, 상기 원격 이미지 센서부(110)에 전달된 클럭 신호는 직렬변환부(120)에 전달되고, 순차적으로 직병렬 변환부(220), 주파수 변환기(230), 로컬 이미지 센서부(210), 및 이미지 합성부(240)를 거쳐 통신 제어부(250)에 전달된다(②~⑦).In addition, the clock signal transmitted to the remote image sensor unit 110 is transmitted to the serial converter 120, and sequentially, the serial and parallel converter 220, the frequency converter 230, the local image sensor 210, And it is transmitted to the communication control unit 250 via the image synthesizing unit 240 (② ~ ⑦).
상기 클럭 신호를 전달받은 통신 제어부(250)는 이미지 합성부(240)에 초기화 신호를 전달시킨다(⑧).The communication control unit 250 receiving the clock signal transmits an initialization signal to the image synthesizing unit 240 (⑧).
상기 이미지 합성부(240)는 로컬 이미지 센서부(210) 및 원격 이미지 센서부(110)에 통신 초기화 명령을 전달하고(⑨~⑪), 각 구성의 초기화 승인응답을 받아 통신 제어부(250)에 전달한다(미도시).The image synthesizing unit 240 transmits a communication initialization command to the local image sensor unit 210 and the remote image sensor unit 110 (⑨ ~ ⑪), and receives the initialization approval response of each configuration to the communication control unit 250 (Not shown).
여기서, 원격 이미지 센서부(110)에 통신 초기화 명령이 전달될 때에는 직병렬 변환부(120) 및 직렬 변환부(220)를 경유하여 원격 이미지 센서부(110)에 전달된다.In this case, when the communication initialization command is transmitted to the remote image sensor unit 110, the communication initialization command is transmitted to the remote image sensor unit 110 via the serial / parallel conversion unit 120 and the serial conversion unit 220.
이와 같은 방법으로 통신 신호를 초기화하여 원격 이미지 센서부(110)와 로컬 이미지 센서부들(210)의 동기화를 시작할 수 있도록 한다.In this way, the communication signal may be initialized to start synchronization of the remote image sensor unit 110 and the local image sensor units 210.
이어, 원격지(100)의 원격 이미지 센서부(110) 및 로컬지(200)의 로컬 이미지 센서부(210)를 이용하여 영상 신호를 생성시킨다(S20). 이때 영상 신호는 병렬신호 형태로 영상 데이터 신호, HSYNC(수평동기), VSYNC(수직동기), 및 픽셀 클럭(Pixel Clock)을 모두 포함하거나, 영상 데이터 신호, 내장 동기신호(임베디드 싱크), 및 픽셀 클럭(Pixel Clock)을 모두 포함할 수 있다. 이는 시스템에 따라 영상 신호에 포함되는 항목의 차이이다.Subsequently, an image signal is generated using the remote image sensor 110 of the remote location 100 and the local image sensor 210 of the local location 200 (S20). In this case, the image signal includes all of the image data signal, HSYNC (horizontal synchronizer), VSYNC (vertical synchronizer), and pixel clock in the form of a parallel signal, or the image data signal, the built-in synchronization signal (embedded sync), and the pixel. It can include all of the clocks. This is a difference of items included in the video signal depending on the system.
또한, 원격 이미지 센서부(110)는 신호 발생부(130)로부터 생성한 레퍼런스 클럭을 전달 받는다.In addition, the remote image sensor unit 110 receives the reference clock generated from the signal generator 130.
이때, 신호 발생부(130)에서 생성하는 레퍼런스 클럭은 이미지 센서의 해상도 및 프레임 레이트(frame rate)에 의해 결정된다.In this case, the reference clock generated by the signal generator 130 is determined by the resolution and frame rate of the image sensor.
이어, 원격 이미지 센서부(110)에서 생성한 상기 영상 신호를 직렬화시킨다(S30). 이때, 직렬화된 영상 신호 중 픽셀 클럭(Pixel Clock)은 10배 내지 20배 빠르게 변환하여 전달 받은 Pixel clock 74.25Mhz를 1.5Ghz까지 올린다.Subsequently, the image signal generated by the remote image sensor unit 110 is serialized (S30). At this time, the pixel clock of the serialized video signal is converted 10 times to 20 times faster to raise the received pixel clock 74.25Mhz to 1.5Ghz.
이와 같이, 영상 신호를 직렬화 함으로써 안전하게 이격된 로컬지(200)로 신호가 전달될 수 있다.As such, by serializing the image signal, the signal may be transmitted to the local area 200 that is safely spaced apart.
이어, 상기 직렬화된 직렬신호를 상기 원격 이미지 센서부(110)의 영상 신호와 동일하게 다시 복원시켜 이미지 합성부(240) 및 주파수 변환기(230)에 전달한다(S40). 이때의 픽셀 클럭은 원격 이미지 센서부에서 생성한 영상 신호의 픽셀 클럭와 동일하다. Subsequently, the serialized serial signal is restored to the same as the image signal of the remote image sensor unit 110 and transferred to the image synthesizing unit 240 and the frequency converter 230 (S40). At this time, the pixel clock is the same as the pixel clock of the image signal generated by the remote image sensor unit.
이어, 상기 주파수 변환기(230)에 전달된 복원된 영상 신호를 원격 및 로컬 이미지 센서부가 필요한 레퍼런스 클럭(Reference Clock)으로 변환시켜 로컬 이미지 센서부(210) 및 이미지 합성부(240)에 전달한다(S50).Subsequently, the restored image signal transmitted to the frequency converter 230 is converted into a reference clock required by the remote and local image sensor units, and then transferred to the local image sensor unit 210 and the image synthesizer 240 ( S50).
이어, 상기 레퍼런스 클럭을 전달받은 로컬 이미지 센서부(210)는 레퍼런스 클럭에 동기화된 영상 신호를 이미지 합성부(240)에 전달한다(S60).Subsequently, the local image sensor unit 210 receiving the reference clock transmits an image signal synchronized with the reference clock to the image synthesizing unit 240 (S60).
마지막으로, 상기 이미지 합성부(240)는 전달받은 레퍼런스 클럭에 해당되는 원격 이미지 센서부(110)의 영상 신호 및 로컬 이미지 센서부(210)의 영상 신호를 결합하여 한 개의 영상으로 합성한다(S70).Lastly, the image synthesizing unit 240 combines the image signal of the remote image sensor unit 110 and the image signal of the local image sensor unit 210 corresponding to the received reference clock to synthesize one image (S70). ).
이와같이 합성된 영상을 디스플레이(미도시)를 통해 출력한다(S80).The synthesized image is output through the display (not shown) (S80).
즉, 1920*1080pixel로 생성한 원격 이미지 및 로컬 이미지를 합성하여 영상합성부(240)는 3840*1080pixel로 출력할 수 있다(S8).That is, by synthesizing the remote image and the local image generated by 1920 * 1080 pixels, the image synthesizer 240 may output at 3840 * 1080 pixels (S8).
또한, 이미지 합성부(240)는 픽셀 클럭 74.25Mhz를 1/N으로 분배하여 레퍼런스 클럭(37.125Mhz)을 재생성하여 원격 이미지 센서부(110)와 로컬 이미지 센서부(210)의 영상 신호를 동기화한다. 여기서, N은 로컬 이미지 센서의 수를 의미한다.In addition, the image synthesizing unit 240 divides the pixel clock 74.25Mhz into 1 / N to regenerate the reference clock (37.125Mhz) to synchronize the image signals of the remote image sensor unit 110 and the local image sensor unit 210. . Here, N means the number of local image sensors.
상기와 같은 복수 이미지의 동기화 합성 시스템 및 동기화 합성 방법은 위에서 설명된 실시예들의 구성과 작동 방식에 한정되는 것이 아니다. 상기 실시예들은 각 실시예들의 전부 또는 일부가 선택적으로 조합되어 다양한 변형이 이루어질 수 있도록 구성될 수도 있다.Such a synthesizing system and a synthesizing method of a plurality of images are not limited to the configuration and operation of the embodiments described above. The above embodiments may be configured such that various modifications may be made by selectively combining all or part of the embodiments.
100: 원격지 110: 원격 이미지 센서부100: remote location 110: remote image sensor unit
120: 직렬변환부 130: 신호 발생부120: serial converter 130: signal generator
200: 로컬지 210: 로컬 이미지 센서부들200: local 210: local image sensor units
220: 직병렬 변환부 230: 주파수 변환기220: serial and parallel converter 230: frequency converter
240: 이미지 합성부 250: 통신 제어부240: image synthesizing unit 250: communication control unit

Claims (7)

  1. 복수 이미지의 동기화 합성 시스템에 있어서,In the synchronous synthesis system of a plurality of images,
    빛을 영상 신호로 생성하여 출력하는 원격 이미지 센서부 및 로컬 이미지 센서부;A remote image sensor unit and a local image sensor unit generating and outputting light as an image signal;
    상기 원격 이미지 센서부에서 출력하는 영상 신호를 직렬화하여 직렬신호로 변환시키는 직렬변환기;A serial converter converting the video signal output from the remote image sensor unit into a serial signal;
    상기 직렬변환기에서 변환된 신호를 다시 상기 원격 이미지 센서부에서 출력한 신호와 동일한 영상 신호로 복원하는 직병렬 변환기;A serial-to-parallel converter for restoring the signal converted by the serial converter to the same image signal as the signal output from the remote image sensor unit;
    상기에서 복원된 영상 신호의 픽셀 클럭(Pixel Clock)을 이미지 센서부들이 필요로 하는 동기화 레퍼런스 클럭(Reference Clock)으로 주파수를 변환하여 상기 로컬 이미지 센서부에 전달하는 주파수 변환기; 및A frequency converter converting a frequency of a pixel clock of the restored image signal into a synchronization reference clock required by the image sensor unit and transferring the frequency to the local image sensor unit; And
    상기 주파수 변환기에서 변환한 동기화 레퍼런스 클럭을 기준으로, 상기 직병렬 변환기에서 복원한 원격 이미지 센서부의 영상 신호와 레퍼런스 클럭을 전달받은 로컬 이미지 센서부의 영상 신호를 동기화시켜 이미지를 합성하는 이미지 합성부;를 포함하고,An image synthesizing unit synthesizing an image by synchronizing the image signal of the remote image sensor unit restored by the serial / parallel converter with the image signal received from the local image sensor unit based on the synchronization reference clock converted by the frequency converter; Including,
    상기 원격 이미지 센서부 및 직렬변환기는 원격지에 구비되고, 직병렬 변환기, 주파수 변환기, 로컬 이미지 센서부, 및 이미지 합성부는 로컬지에 구비되며, 원격지와 로컬지는 영상 신호의 전송을 위한 두 개의 선으로만 연결되는 복수 이미지의 동기화 합성 시스템.The remote image sensor unit and the serial converter are provided at a remote location, the serial-parallel converter, the frequency converter, the local image sensor unit, and the image synthesis unit are provided at a local location, and the remote location and the local location are only two lines for transmitting a video signal. Synchronous compositing system of connected multiple images.
  2. 청구항 1에 있어서,The method according to claim 1,
    상기 원격 이미지 센서부, 로컬 이미지 센서부 및 이미지 합성부의 통신신호를 초기화시키는 통신 제어부;를 더 포함하는 복수 이미지의 동기화 합성 시스템.And a communication control unit for initializing communication signals of the remote image sensor unit, the local image sensor unit, and the image synthesizing unit.
  3. 청구항 1에 있어서,The method according to claim 1,
    상기 원격 이미지 센서부에서 출력하는 영상 신호는 병렬신호 형태로 영상데이터신호, HSYNC(수평동기), VSYNC(수직동기), 및 픽셀 클럭을 모두 포함하는 복수 이미지의 동기화 합성 시스템.And a video signal output from the remote image sensor unit includes a video data signal, a HSYNC (horizontal synchronizer), a VSYNC (vertical synchronizer), and a pixel clock in a parallel signal form.
  4. 청구항 1에 있어서,The method according to claim 1,
    상기 원격 이미지 센서부에서 출력하는 영상 신호는 병렬신호 형태로 영상 데이터신호, 내장 동기신호(임베디드 싱크), 및 픽셀 클럭을 모두 포함하는 복수 이미지의 동기화 합성 시스템.The video signal output from the remote image sensor unit includes a video data signal, a built-in synchronization signal (embedded sync), and a pixel clock in a parallel signal form.
  5. 원격지 및 로컬지의 통신을 초기화시키는 제1 단계;Initiating communication between a remote location and a local location;
    원격지의 원격 이미지 센서부 및 로컬지의 로컬 이미지 센서부를 이용하여 영상 신호를 생성시키는 제2 단계;Generating a video signal by using a remote image sensor unit at a remote location and a local image sensor unit at a local location;
    상기 영상 신호를 직렬화시키는 제3 단계;Serializing the video signal;
    상기 직렬화된 직렬신호를 상기 원격 이미지 센서부의 영상 신호와 동일하게 다시 복원시켜 이미지 합성부 및 주파수 변환기에 전달하는 제4 단계;A fourth step of restoring the serialized serial signal back to the image signal of the remote image sensor unit and transferring the serialized serial signal to an image synthesizing unit and a frequency converter;
    상기 주파수 변환기에 전달된 복원된 영상 신호를 원격 및 로컬 이미지 센서부가 필요한 레퍼런스 클럭(Reference Clock)으로 변환시켜 로컬 이미지 센서부 및 이미지 합성부에 전달되는 제5 단계;A fifth step of converting the reconstructed image signal transmitted to the frequency converter into a reference clock required by a remote and local image sensor unit and transferring the converted image signal to a local image sensor unit and an image synthesizer;
    상기 레퍼런스 클럭을 전달받은 로컬 이미지 센서부(210)는 레퍼런스 클럭에 동기화된 영상 신호를 이미지 합성부에 전달하는 제6 단계; 및The local image sensor unit 210 receiving the reference clock transmits an image signal synchronized with the reference clock to the image synthesizer; And
    상기 이미지 합성부는 전달받은 레퍼런스 클럭에 해당되는 원격 이미지 센서부의 영상 신호 및 로컬 이미지 센서부의 영상 신호를 결합하여 한 개의 영상으로 합성하는 제7 단계;로 이루어질 수 있는 복수 이미지의 동기화 합성 방법.And a seventh step of combining the image signal of the remote image sensor unit corresponding to the received reference clock and the image signal of the local image sensor unit to combine the image signal into a single image.
  6. 청구항 5에 있어서,The method according to claim 5,
    상기 원격지 및 로컬지의 통신을 초기화하는 제1 단계는,The first step of initializing the communication between the remote and local,
    신호 발생부를 통해 클럭을 생성하여 원격 이미지 센서부에 전달하는 제1-1단계;Generating a clock through a signal generator and transferring the clock to a remote image sensor;
    상기 원격 이미지 센서부에 전달된 클럭은 직렬 변환부, 직병렬 변환부, 주파수 변환기, 로컬 이미지 센서부, 및 이미지 합성부를 거쳐 통신 제어부에 전달되는 제1-2 단계;A first clock transmitted to the remote image sensor unit through a serial converter, a serial / parallel converter, a frequency converter, a local image sensor unit, and an image synthesizer;
    상기 클럭을 전달받은 통신 제어부는 이미지 합성부에 초기화 신호를 전달시키는 1-3단계; 및The communication control unit receiving the clock transfers an initialization signal to an image synthesis unit; And
    상기 이미지 합성부는 로컬 이미지 센서부 및 원격 이미지 센서부에 통신 초기화 명령을 전달하고, 응답을 받아 통신제어부에 전달하는 제1-4 단계;로 이루어질 수 있는 복수 이미지의 동기화 합성 방법.The image synthesizing unit transmits a communication initialization command to a local image sensor unit and a remote image sensor unit, and steps 1-4 of receiving a response and transmitting the response to the communication control unit.
  7. 청구항 6에 있어서,The method according to claim 6,
    상기 이미지 합성부는 직병렬 변환기 및 직렬 변환기를 거쳐 원격 이미지 센서에 초기화 명령을 전달하고, 원격 이미지 센서로부터 직렬변환기 및 직병렬 변환기를 거쳐 응답을 전달 받는 복수 이미지의 동기화 합성 방법.The image synthesizing unit transmits an initialization command to a remote image sensor through a serial and serial converter and a serial converter, and receives a response from the remote image sensor through a serial converter and a serial and parallel converter.
PCT/KR2014/010719 2014-03-04 2014-11-10 Synchronization synthesis system and synchronization synthesis method for multiple images WO2015133702A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020140025325A KR101469446B1 (en) 2014-03-04 2014-03-04 Synchronization composite system and method for the plural image
KR10-2014-0025325 2014-03-04

Publications (1)

Publication Number Publication Date
WO2015133702A1 true WO2015133702A1 (en) 2015-09-11

Family

ID=52677748

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2014/010719 WO2015133702A1 (en) 2014-03-04 2014-11-10 Synchronization synthesis system and synchronization synthesis method for multiple images

Country Status (2)

Country Link
KR (1) KR101469446B1 (en)
WO (1) WO2015133702A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022114284A1 (en) * 2020-11-25 2022-06-02 지앨에스 주식회사 Electronic device and method for transmitting wireless data

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101664714B1 (en) * 2015-06-23 2016-10-10 현대자동차주식회사 Image branch circuit

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100874671B1 (en) * 2007-04-27 2008-12-18 엠텍비젼 주식회사 Apparatus and method for data transmission
KR20130013383A (en) * 2011-07-28 2013-02-06 (주)성우이넥스 Data processing system for surveillance camera
KR101306244B1 (en) * 2007-06-29 2013-09-09 엠텍비젼 주식회사 Method and apparatus for generating image sensing signal
KR101316179B1 (en) * 2007-02-05 2013-10-08 엘지이노텍 주식회사 Duel camera

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101316179B1 (en) * 2007-02-05 2013-10-08 엘지이노텍 주식회사 Duel camera
KR100874671B1 (en) * 2007-04-27 2008-12-18 엠텍비젼 주식회사 Apparatus and method for data transmission
KR101306244B1 (en) * 2007-06-29 2013-09-09 엠텍비젼 주식회사 Method and apparatus for generating image sensing signal
KR20130013383A (en) * 2011-07-28 2013-02-06 (주)성우이넥스 Data processing system for surveillance camera

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022114284A1 (en) * 2020-11-25 2022-06-02 지앨에스 주식회사 Electronic device and method for transmitting wireless data

Also Published As

Publication number Publication date
KR101469446B1 (en) 2014-12-08

Similar Documents

Publication Publication Date Title
CN1205776C (en) Signal transmission device and signal transmission method
WO2010047484A2 (en) Display driving system using transmission of single-level signal embedded with clock signal
CN112088527B (en) Camera system, controller thereof, automobile, and deserializer circuit
WO2015133702A1 (en) Synchronization synthesis system and synchronization synthesis method for multiple images
CN103491337B (en) The transmission system and method for single channel multiplexing transmission multichannel multi-format audio-video signal
CN101489075B (en) Display signal extending apparatus and method for transmitting display signal therefor
US20210136276A1 (en) Multi-camera synchronization through receiver hub back channel
US10343606B2 (en) Using parallel data lines for GPIO purposes
KR101489272B1 (en) Synchronization composition system for the plural image including backup function of signal generation
TW200929919A (en) Display signal extender and a method of transmitting display signal by using the same
WO2018062599A1 (en) Svm system, and image inputting and processing method therefor
WO2009113800A1 (en) Image-signal processor capable of supporting a plurality of ccd image sensors and method for processing image signals using the image-signal processor
KR20060122483A (en) Camera link transmitting/receiving apparatus using optical fiber cable
JP2003163926A (en) In-car communication system, data processor, and car- mounted apparatus
KR20160139757A (en) Apparatus for transmitting and receiving multimedia over single optical fiber
JP2004208162A (en) System and device for transmitting camera video
KR101524745B1 (en) Apparatus for video/audio/control signals bi-direction transmission over single optical fiber
WO2015182083A1 (en) Video signal transmission system and display device
JP2014050079A (en) Television camera system
JP2004191454A (en) Image transmission system, host device, monitoring device, and picture transmission method
JP4725033B2 (en) Surveillance camera system, camera, and surveillance camera control method
CN214070031U (en) Video processing platform
KR20130013383A (en) Data processing system for surveillance camera
US11249712B2 (en) Display system, transmission device and relay device
JP3717810B2 (en) Image signal transmission system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14884988

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05.01.2017)

122 Ep: pct application non-entry in european phase

Ref document number: 14884988

Country of ref document: EP

Kind code of ref document: A1