WO2011068380A2 - 영상신호와 센서신호의 동기화 시스템 및 방법 - Google Patents
영상신호와 센서신호의 동기화 시스템 및 방법 Download PDFInfo
- Publication number
- WO2011068380A2 WO2011068380A2 PCT/KR2010/008622 KR2010008622W WO2011068380A2 WO 2011068380 A2 WO2011068380 A2 WO 2011068380A2 KR 2010008622 W KR2010008622 W KR 2010008622W WO 2011068380 A2 WO2011068380 A2 WO 2011068380A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sensor
- synchronization
- signal
- time information
- clock
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004891 communication Methods 0.000 claims abstract description 13
- 230000005540 biological transmission Effects 0.000 claims description 7
- 238000005259 measurement Methods 0.000 claims description 3
- 230000001186 cumulative effect Effects 0.000 abstract 1
- 238000009429 electrical wiring Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 10
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000012546 transfer Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/7795—Circuitry for generating timing or clock signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
- H04N25/745—Circuitry for generating timing or clock signals
Definitions
- the present invention relates to a system and method for synchronizing a video signal and a sensor signal when analyzing a multi-channel video signal and a sensor signal in a wired or wireless environment, and more particularly, to a video signal input from a camera and a sensor corresponding to each video signal.
- a synchronization clock is built in the sensor device and the central controller, respectively, and the acquisition time is obtained from the sensor signal obtained from the sensor device after the synchronization device transmits a synchronization signal to each device to synchronize the synchronization clock.
- the central control device transfers the acquisition time to the computer device via the central control device, and adds the acquisition time to the computer device by adding the acquisition time to the number of acquisitions of the video signals transmitted from the camera to the computer device, thereby obtaining the information based on the acquisition time information.
- the video signal and the sensor signal can be synchronized.
- the game device or the like is provided with a sensor that senses the surrounding situation, for example, a wind direction or a wind speed, or a sensor that senses tension, tilt, temperature, pressure, and the like.
- An object of the present invention for solving the above-mentioned problems is that a synchronization clock is built in a sensor device and a central controller, respectively, for a video signal input from a camera and a sensor signal corresponding to each video signal.
- the device After synchronizing the clock for synchronization by transmitting the synchronization signal to each device, the device sends the acquisition time to the sensor signal obtained from the sensor device and transmits it to the computer device via the central control device.
- the synchronization of the video signal and the sensor signal is enabled so that the computer device can synchronize the video signal and the sensor signal based on the acquisition time information.
- System and method, synchronization device and method for synchronizing image signal and sensor signal thereof, computer device and its zero It is a method of synchronizing signal and sensor signal to provide.
- a synchronization system of an image signal and a sensor signal including: a camera apparatus photographing a subject to obtain an image signal, and outputting the obtained image signal; A sensor device having a built-in first clock for synchronizing, generating a sensor signal corresponding to the video signal according to a sensing operation, and adding and acquiring acquisition time information of the first synchronizing clock to the generated sensor signal. ; A second synchronization clock is built in, and the sensor signal to which the acquisition time information is added is received from the sensor device and controlled to be transmitted to the computer device, and the number of acquisitions of the video signal transmitted from the camera device to the computer device is controlled.
- a central control device which continuously accumulates and calculates, adds acquisition time information by the second synchronization clock to the acquisition number, transmits or stores the information to a computer device, and utilizes the analysis time to verify synchronization;
- a synchronization device having a built-in reference clock and simultaneously transmitting a reference time for synchronization of the first synchronization clock and the second synchronization clock to the sensor device and the central controller at a predetermined interval; And receiving a sensor signal to which the acquisition time information is added from the central controller, receiving a video signal from the camera device, checking time information for each signal, and reconstructing each signal in the same time zone.
- a computer device for synchronizing the sensor signal.
- the sensor device synchronizes the first synchronization clock based on the reference time received from the synchronization device, and then acquires the time acquired by the first synchronization clock to the sensor signal generated according to the sensing operation.
- the information is added and transmitted to the central controller.
- the sensor device corrects the reference time received from the synchronization device by an error compared to the time of the second synchronization clock, and adds acquisition time information to the sensor signal based on the corrected time. Transfer to central controller.
- the sensor device obtains a time error by comparing the reference time received from the synchronization device with the time of the first synchronization clock, and transmits the obtained time error to the computer device, respectively.
- the sensor signal received from the sensor device is corrected on the time axis by the time error.
- the synchronization device obtains the current time information from the sensor device, obtains the current time information, compares the acquired current time information with the reference time information, and checks an error range. Is transmitted to the sensor device.
- the sensor device When the sensor device receives the time calibration command, the sensor device performs calibration based on the calibration time information, synchronizes a clock received from the synchronization device at a second clock, and sends a calibration completion command to the synchronization device. To send.
- the synchronization device for achieving the above object, the communication unit for communicating with the sensor device, the central control unit and a computer device; A frequency generator for generating a frequency signal to transmit reference time information for synchronization to the sensor device, the central control device, and the computer device; A synchronization clock unit generating the generated frequency signal as a clock signal; A reference time module unit (FPGA) for generating the generated clock signal as the reference time information; A real time clock unit providing a real time clock to the reference time module unit; And a control unit for generating the reference time information by controlling the frequency generator, the synchronization clock unit, and the reference time module unit, and controlling the generated reference time information to be transmitted to the sensor device, the central controller, and the computer device.
- a frequency generator for generating a frequency signal to transmit reference time information for synchronization to the sensor device, the central control device, and the computer device
- a synchronization clock unit generating the generated frequency signal as a clock signal
- a reference time module unit FPGA
- a real time clock unit providing a real
- control unit obtains the current time information from the sensor device, obtains the current time information, compares the acquired current time information with the reference time information, and checks an error range. To the sensor device.
- a / D conversion unit for converting the analog signal input from the sensor device, the central control unit and the computer device into a digital signal;
- a display unit for displaying the generation operation of the reference time information, the transmission time related to the current time information and the time correction command, and the like.
- the sensor device for achieving the above object, the sensor for generating a sensor signal for sensing the tilt, tension, weight, etc .;
- a signal converter converting the sensor signal in an analog form into sensor data in a digital form;
- Communication unit for transmitting the sensor data to the synchronization device and the central control unit;
- a synchronization clock unit for synchronizing with a reference time provided by the synchronization device;
- a memory unit for storing the sensor data;
- a control unit for controlling the sensor data to be transmitted to the central control unit, receiving and synchronizing the reference time from the synchronization unit, and transmitting the measurement time information obtained from the sensor data together with the sensor data to the central control unit.
- a frequency generator for generating a frequency signal and providing the frequency signal to the controller;
- a real time (RTC) module unit for providing a real time clock to the controller.
- the method for synchronizing the image signal and the sensor signal for achieving the above object, the synchronization of the image signal and the sensor signal of a system including a camera device, a sensor device, a central control device, a synchronization device and a computer device
- a method comprising: (a) the synchronization device transmitting synchronization time information to the sensor device and the central control device; (b) synchronizing each of the built-in synchronization clocks based on the synchronization time information by the sensor device and the central controller; (c) the camera device acquiring and transmitting an image signal to the computer device; (d) the sensor device obtains a sensor signal, adds acquisition time information by the built-in synchronization clock, and transmits the acquired signal to the central controller, and the central controller transmits an image signal to which the acquisition time information is added. Transmitting to the computer device; And (e) synchronizing the image signal with the sensor signal based on the embedded synchronization clock and the acquisition time information.
- the computer apparatus compares the time information of the built-in synchronization clock with the acquisition time information to calculate a time error, and corrects the time signal on the time axis with respect to the image signal and the sensor signal. By synchronizing the video signal with the sensor signal.
- a synchronization device for communicating by wire or wirelessly with a specific device, including a sensor device, a central control device and a computer device.
- a method of synchronizing an image signal and a sensor signal comprising: (a) requesting current time information from the specific device to receive current time information; (b) obtaining error information by comparing the current time information with reference time information; (c) generating time information for correcting the error information, and transmitting the time information and a time calibration command to the specific device; And (d) receiving a synchronization completion command from the specific device informing that the synchronization is completed by time calibration according to the time information.
- the method for synchronizing the image signal and the sensor signal of the computer device for achieving the above object, the image of the computer device to communicate with the camera device, the sensor device, the central control unit and the synchronization device by wire or wirelessly.
- a method of synchronizing a signal with a sensor signal comprising: (a) receiving reference time information from the synchronization device to synchronize an embedded synchronization clock; (b) receiving an image signal from the camera apparatus, and receiving a sensor signal including acquisition time information obtained by the sensor apparatus from the central controller; And (c) synchronizing the video signal and the sensor signal based on the embedded synchronization clock and the acquisition time information.
- a time error is calculated by comparing the time information of the built-in synchronization clock and the acquisition time information, and corrected by the time error on the time axis with respect to the video signal and the sensor signal. Synchronize a signal with the sensor signal.
- the video signal and the sensor signal are corrected by the time error information on the time axis with respect to the video signal and the sensor signal based on the time error information received from the sensor device and the central controller. Synchronize.
- the present invention it is possible to secure the synchronization of the image signal and the sensor signal collected according to the surrounding environment.
- an improved service may be provided to a user through synchronization of a multi-channel, high-speed video signal and a sensor signal corresponding thereto.
- the synchronization of the two signals can be easily implemented, and accordingly, the image signal and the sensor signal can be analyzed accurately and conveniently.
- FIG. 1 is a configuration diagram schematically showing a configuration of a synchronization system of an image signal and a sensor signal according to an embodiment of the present invention.
- FIG. 2 is a configuration diagram schematically showing an internal configuration of a synchronization device according to an embodiment of the present invention.
- FIG. 3 is a configuration diagram schematically showing an internal configuration of a sensor device according to an embodiment of the present invention.
- FIG. 4 is a flowchart illustrating a method for synchronizing an image signal and a sensor signal according to an exemplary embodiment of the present invention.
- FIG. 5 is a flowchart illustrating a method of synchronizing an image signal and a sensor signal of a synchronization device according to an embodiment of the present invention.
- FIG. 6 is a diagram illustrating a synchronization procedure and a timing diagram according to an embodiment of the present invention.
- FIG. 7 is a flowchart illustrating a method of synchronizing an image signal and a sensor signal of a computer device according to an exemplary embodiment of the present invention.
- FIG. 1 is a configuration diagram schematically showing a configuration of a synchronization system of an image signal and a sensor signal according to an embodiment of the present invention.
- the system 100 for synchronizing an image signal and a sensor signal includes a camera device 110, a synchronization device 120, a plurality of sensor devices 130 to 134, and a central controller 140. And computer device 150.
- the camera device 110 acquires an image signal by photographing a subject, and outputs and transmits the obtained image signal to the computer device 150.
- the synchronization device 120 has a built-in reference clock, and the sensor devices 130 to 134 and the central controller 140 at a predetermined interval for the reference time for synchronization between the sensor devices 130 to 134 and the central controller 140. To transmit simultaneously.
- the plurality of sensor devices 130 to 134 have a built-in first synchronization clock, generate a sensor signal corresponding to an image signal according to a sensing operation, and acquire the time information obtained by the first synchronization clock on the generated sensor signal. Add and transmit the output to the central control unit 140.
- the plurality of sensor devices 130 to 134 may include, for example, an archery analyzer that senses the inclination and tension of an arrow, a foot movement analyzer that senses the user's foot movement back and forth, and the left and right, and the wind direction of the surroundings. Or a climate analyzer that senses wind speed.
- the sensor signal in the case of the archery analyzer, the sensor signal may be a tension or inclination, and in the case of the foot movement analyzer, the sensor signal may be a front, rear, left, right, etc. Can be.
- temperature, pressure, etc. can be used as the sensor signal.
- the central controller 140 includes a second clock for synchronization, and receives the sensor signal to which the acquisition time information is added from the sensor devices 130 to 134 and transmits the sensor signal to the computer device 150.
- the central controller 140 continuously accumulates and calculates the number of acquisitions for the image signal transmitted from the camera device 110 to the computer device 150, and calculates the number of acquisitions together with the time information of the second synchronization clock. Save and use for analysis to verify synchronization.
- the computer device 150 receives a sensor signal added with acquisition time information from the central control unit 140, receives a video signal from the camera device 110, checks time information for each signal, and sets each signal in the same time zone. By reconstructing, the video signal and the sensor signal are synchronized.
- the computer device may be a PC in the form of a desktop, or a PC in the form of a notebook.
- the sensor devices 130 to 134 synchronize the first synchronization clock based on the reference time received from the synchronization device 120, and then use the first synchronization clock on the sensor signal generated according to the sensing operation.
- the acquisition time information is added and transmitted to the central control unit 140.
- the sensor devices 130 to 134 correct the reference time received from the synchronization device 120 with the time of the first synchronization clock by an error, and correct the acquisition time information in the sensor signal based on the corrected time. In addition, it transmits to the central control unit 140.
- the sensor devices 130 to 134 obtain a time error by comparing the reference time received from the synchronization device 120 with the time of the first synchronization clock, and transmit the obtained time error to the computer device 150, respectively.
- the computer device 150 corrects the sensor signals received from the sensor devices 130 to 134 on the time axis by a time error.
- the synchronization device 120 obtains by requesting the current time information to the sensor device (130 ⁇ 134), and checks the error range by comparing the obtained current time information with the reference time information, calibration time information if calibration is required And time calibration command to the sensor device (130 ⁇ 134).
- the sensor devices 130 to 134 When receiving the time calibration command, the sensor devices 130 to 134 perform the calibration based on the received calibration time information, perform synchronization with the clock received from the synchronization device 120 at the second clock, and synchronize. (Calibration) Completion command is sent to the synchronization device 120.
- FIG. 2 is a configuration diagram schematically showing an internal configuration of a synchronization device according to an embodiment of the present invention.
- the synchronization device 120 according to the present invention, the communication unit 210, the frequency generator (Oscillator) 220, the synchronization clock unit 230, the reference time module unit 240, the real time clock unit A control unit 260, an A / D converter 270, an output unit 280, and a display unit 290 are included.
- the communication unit 210 communicates with the sensor devices 130 to 134, the central controller 140, and the computer device 150.
- the frequency generator 220 generates a frequency signal to transmit reference time information for synchronization to the sensor devices 130 to 134, the central controller 140, and the computer device 150.
- the synchronization clock unit 230 generates a frequency signal generated by the frequency generator 220 as a clock signal.
- the reference time module unit 240 generates the generated clock signal as reference time information.
- the real time clock unit 250 provides a real time clock (RTC) to the reference time module unit 240.
- RTC real time clock
- the controller 260 controls the frequency generator 220, the synchronization clock unit 230, and the reference time module unit 240 to generate reference time information, and the generated reference time information includes the sensor devices 130 to 134. Control to be transmitted to the central controller 140 and the computer device 150.
- the controller 260 requests the sensor devices 130 to 134 to obtain current time information, checks the error range by comparing the obtained current time information with reference time information, and, if calibration is required, the calibration time information and the like.
- the time calibration command is transmitted to the sensor devices 130 to 134.
- the A / D converter 270 converts analog signals input from the sensor devices 130 to 134, the central controller 140, and the computer device 150 into digital signals.
- the output unit 280 outputs a digital signal to the outside through a port.
- the display unit 290 displays a generation operation of reference time information, a transmission operation related to current time information, and a time calibration command.
- FIG. 3 is a configuration diagram schematically showing an internal configuration of a sensor device according to an embodiment of the present invention.
- the sensor device 130 includes a communication unit 310, a sensor 320, a signal converter 330, a synchronization clock unit 340, a memory unit 350, and a controller ( 360, a frequency generator 370, and a real time clock unit 380.
- the communicator 310 transmits sensor data to the synchronization device 120 and the central controller 140.
- the sensor 320 generates a sensor signal that senses tilt, tension, weight, and the like.
- the signal converter 330 converts an analog sensor signal into digital sensor data.
- the synchronization clock unit 340 synchronizes with the reference time provided by the synchronization device 120.
- the memory unit 350 stores sensor data.
- the controller 360 controls the sensor data to be transmitted to the central controller 140, receives and synchronizes the reference time from the synchronization device 120, and then collects the measurement time information obtained from the sensor data together with the sensor data. Control to transmit to 140.
- the frequency generator 370 generates a frequency signal and provides the generated frequency signal to the controller 460.
- the real time clock unit 380 provides a real time clock to the control unit 460.
- FIG. 4 is a flowchart illustrating a method for synchronizing an image signal and a sensor signal according to an exemplary embodiment of the present invention.
- the synchronization device 120 transmits synchronization time information to the sensor devices 130 to 134 and the central controller 140 (S410).
- the sensor devices 130 to 134 and the central controller 140 synchronize the built-in synchronization clocks based on the synchronization time information (S420).
- the camera device 110 transmits an image signal obtained by photographing a subject to the computer device 150 (S430).
- the central control unit 140 continuously accumulates and calculates the number of acquisitions for the image signal transmitted from the camera device 110 to the computer device 150, and calculates the calculated number of acquisitions by the second synchronization clock. Stored with and used for analysis to verify synchronization.
- the sensor device 130 to 134 acquires a sensor signal through the sensor 320 and adds acquisition time information to the central control unit 140, and the central control unit 140 is provided with acquisition time information.
- the sensor signal is transmitted to the computer device 150 (S440).
- the video signal is generally large and is transmitted directly to the computer device 150 with the acquisition time information added without passing through the central control unit 140.
- the computer device 150 synchronizes the image signal and the sensor signal based on the time information and the acquisition time information of the second synchronization clock (S450).
- the computer device 150 corrects the error time of each signal based on the error time information received from the central control unit 140 and the sensor devices 130 to 134, and then synchronizes the image signal with the sensor signal.
- the computer device 150 calculates a time error by comparing the acquisition time information added to the sensor signal with the time information of the second synchronization clock, and corrects the sensor signal by the time error on the time axis to obtain an image signal and a sensor signal. Can be synchronized.
- FIG. 5 is a flowchart illustrating a method of synchronizing an image signal and a sensor signal of a synchronization device according to an embodiment of the present invention.
- the synchronization device 120 obtains reference time information through the reference time module unit 240 in a state where the system is initialized (S502).
- the synchronization device 120 receives current time information by requesting current time information from a specific device including the sensor devices 130 to 134 and the central controller 140 as shown in FIG. 6 (S504). ).
- 6 is a diagram illustrating a synchronization procedure and a timing diagram according to an embodiment of the present invention.
- ⁇ T1 represents an error time between the synchronization device 120 and the sensor devices 130 to 134 before calibration
- ⁇ t1 represents a time information transmission delay time by serial communication
- ⁇ t2 represents a sensor device 130.
- ⁇ t3 indicates a time at which the current time information is transmitted
- ⁇ t3 indicates an error time in the synchronization device 120 and indicates a setting time and a command transmission delay time
- ⁇ t4 indicates time information from the synchronization device 120. Indicates the time to receive and wait for calibration.
- the synchronization device 120 obtains error information by comparing the received current time information with reference time information (S506).
- the synchronization device 120 generates calibration time information for correcting the error information (S508).
- the synchronization device 120 transmits the generated calibration time information and the time calibration command to a specific device including the sensor devices 130 to 134, the central controller 140, and the like (S510).
- specific devices including the sensor devices 130 to 134, the central control unit 140, and the like, may use the built-in synchronization clock based on the calibration time information received from the synchronization device 120 and the time calibration command. Calibrate and synchronize, and transmits a synchronization completion command to the synchronization device 120 informing that the synchronization is completed.
- the synchronization device 120 receives a synchronization completion command indicating that the synchronization is completed by time calibration according to the calibration time information from a specific device including the sensor devices 130 to 134 and the central controller 140 (S512). ).
- FIG. 7 is a flowchart illustrating a method of synchronizing an image signal and a sensor signal of a computer device according to an exemplary embodiment of the present invention.
- the computer device 150 receives reference time information from the synchronization device 120 and synchronizes a built-in synchronization clock (S710).
- the computer device 150 receives an image signal from the camera device 110 and receives a sensor signal obtained by the sensor devices 130 to 134 from the central controller 140 and including acquisition time information (see FIG. S720).
- the computer device 150 synchronizes the image signal and the sensor signal based on the time information and acquisition time information of the built-in second synchronization clock (S730).
- the computer device 150 calculates a time error by comparing the time information of the second synchronization clock with the acquisition time information of the sensor devices 130 to 134, corrects the sensor signal by the time error on the time axis, and then corrects the image signal. And sensor signal are synchronized.
- the computer device 150 may be synchronized even while acquiring the image signal and the sensor signal from the camera device 110 and the sensor device (130 ⁇ 134), so the verification after the acquisition is completed. Accordingly, the central controller 140 calculates the image signal acquisition time information and the sensor signal acquisition time error of the sensor devices 130 to 134 from the camera device 110, and transfers the calculated signal error to the computer device 150. The information may be corrected on the time axis by the time error received by 150). Of course, without calculating the time error in the central controller 140, the computer device 150 may calculate the time error directly and accordingly correct the image signal and the sensor signal by the time error.
- a synchronous clock is built into the sensor device and the central control device, respectively. After synchronizing the clock for synchronization by transmitting the synchronization signal to the device, the sensor signal obtained from the sensor device is pasted to the computer device via the central controller, and the central controller is transmitted from the camera to the computer device.
- the present invention can be applied to a system and a service that must simultaneously provide an image signal obtained from a camera device and a sensor signal obtained from a sensor device with a screen and sound.
- the present invention may be applied to a device for generating an image signal and a sensor signal and transmitting the same through wireless communication and wired communication.
- the present invention can be applied to an apparatus or system for analyzing a multi-channel video signal and a sensor signal.
- Wired wireless, camera, video signal, sensor, sensor signal, synchronization, error
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Electric Clocks (AREA)
- Studio Devices (AREA)
- Arrangements For Transmission Of Measured Signals (AREA)
- Synchronisation In Digital Transmission Systems (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Description
Claims (16)
- 피사체를 촬영하여 영상신호를 획득하고, 상기 획득된 영상신호를 출력하는 카메라 장치;제1 동기용 시계가 내장되어 있으며, 상기 영상신호에 대응된 센서신호를 센싱 동작에 따라 생성하고, 상기 생성된 센서신호에 상기 제1 동기용 시계에 의한 취득시간정보를 부가하여 출력하는 센서 장치;제2 동기용 시계가 내장되어 있으며, 상기 센서 장치로부터 상기 취득시간정보가 부가된 센서신호를 수신하여 컴퓨터 장치로 전송하도록 제어하고, 상기 카메라 장치로부터 컴퓨터 장치로 전송되는 영상 신호에 대한 취득 수를 계속 누적하여 계산하며, 상기 취득 수에 상기 제2 동기용 시계에 의한 취득시간정보를 부가하여 컴퓨터 장치로 전송하거나 저장한 후 분석 시에 활용하여 동기화를 검증하는 중앙제어장치;기준 시계를 내장하고, 상기 제1 동기용 시계와 상기 제2 동기용 시계의 동기를 위한 기준시간을 일정 간격으로 상기 센서 장치 및 상기 중앙제어장치에 동시에 전송하는 동기화 장치; 및상기 중앙제어장치로부터 상기 취득시간정보가 부가된 센서신호를 전송받고, 상기 카메라 장치로부터 영상신호를 전송받아 각각의 신호별로 시간정보를 확인하고 각각의 신호를 동일한 시간대로 재구성하여, 상기 영상신호와 상기 센서신호를 동기화하는 컴퓨터 장치;를 포함하는 영상신호와 센서신호의 동기화 시스템.
- 제 1 항에 있어서,상기 센서 장치는, 상기 동기화 장치로부터 수신된 기준시간을 근거로 상기 제1 동기용 시계를 동기화 한 후, 상기 센싱 동작에 따라 생성된 상기 센서신호에 상기 제1 동기용 시계에 의한 취득시간정보를 부가하여 상기 중앙제어장치로 전송하는 것을 특징으로 하는 영상신호와 센서신호의 동기화 시스템.
- 제 2 항에 있어서,상기 센서 장치는, 상기 동기화 장치로부터 수신된 상기 기준시간을 상기 제2 동기용 시계의 시간과 비교하여 오차만큼 보정하고, 보정된 시간을 기준으로 상기 센서신호에 취득시간정보를 부가하여 상기 중앙제어장치로 전송하는 것을 특징으로 하는 영상신호와 센서신호의 동기화 시스템.
- 제 1 항에 있어서,상기 센서 장치는, 상기 동기화 장치로부터 수신된 상기 기준시간을 상기 제1 동기용 시계의 시간과 비교하여 시간 오차를 얻고 상기 얻은 시간 오차를 각각 상기 컴퓨터 장치로 전송하며, 상기 컴퓨터 장치는 상기 센서 장치로부터 전송받은 상기 센서신호에 대해 상기 시간 오차만큼 시간축에서 보정하는 것을 특징으로 하는 영상신호와 센서신호의 동기화 시스템.
- 제 1 항에 있어서,상기 동기화 장치는 상기 센서 장치에 현재시간 정보를 요청하여 획득하고, 상기 획득한 현재시간 정보를 상기 기준시간 정보와 비교하여 오차범위를 확인하며, 교정이 필요한 경우 교정시간 정보와 시간교정 명령을 상기 센서 장치로 전송하는 것을 특징으로 하는 영상신호와 센서신호의 동기화 시스템.
- 제 5 항에 있어서,상기 센서 장치는 상기 시간교정 명령을 수신하면, 상기 교정시간 정보를 기준으로 교정을 수행하고, 두 번째 클럭에서 상기 동기화 장치로부터 수신된 클럭으로 동기화를 수행하며, 교정 완료 명령을 상기 동기화 장치로 전송하는 것을 특징으로 하는 영상신호와 센서신호의 동기화 시스템.
- 센서 장치, 중앙제어장치 및 컴퓨터 장치와 통신하기 위한 통신부;상기 센서 장치, 중앙제어장치 및 컴퓨터 장치로 동기화를 위한 기준시간 정보를 전송하기 위해 주파수 신호를 생성하는 주파수 생성부(Oscillator);상기 생성된 주파수 신호를 클럭 신호로 생성하는 동기화 클럭부;상기 생성된 클럭 신호를 상기 기준시간 정보로 생성하는 기준시간 모듈부(FPGA);상기 기준시간 모듈부에 실시간 클럭(Real Time Clock)을 제공하는 실시간(RTC) 클럭부; 및상기 주파수 생성부와 상기 동기화 클럭부 및 상기 기준시간 모듈부를 제어하여 상기 기준시간 정보를 생성하고, 상기 생성된 기준시간 정보가 상기 센서 장치, 중앙제어장치 및 컴퓨터 장치로 전송되도록 제어하는 제어부;를 포함하는 동기화 장치.
- 제 7 항에 있어서,상기 제어부는 상기 센서 장치에 현재시간 정보를 요청하여 획득하고, 상기 획득한 현재시간 정보를 상기 기준시간 정보와 비교하여 오차범위를 확인하며, 교정이 필요한 경우 현재시간 정보와 시간교정 명령을 상기 센서 장치로 전송하는 것을 특징으로 하는 동기화 장치.
- 제 7 항에 있어서,상기 센서 장치, 중앙제어장치 및 컴퓨터 장치로부터 입력된 아날로그 신호를 디지털 신호로 변환하는 A/D 변환부;상기 디지털 신호를 출력하기 위한 출력부; 및상기 기준시간 정보의 생성 동작, 상기 현재시간 정보 및 상기 시간교정 명령에 관한 전송 동작 등을 표시하기 위한 디스플레이부;를 더 포함하는 것을 특징으로 하는 동기화 장치.
- 기울기, 장력, 무게 등을 센싱한 센서 신호를 생성하는 센서;아날로그 형태의 상기 센서 신호를 디지털 형태의 센서 데이터로 변환하는 신호 변환부;상기 센서 데이터를 동기화 장치 및 중앙제어장치로 전송하기 위한 통신부;상기 동기화 장치에서 제공된 기준시간으로 동기화하기 위한 동기용 시계부;상기 센서 데이터를 저장하기 위한 메모리부;상기 센서 데이터가 상기 중앙제어장치로 전송되도록 제어하고, 상기 동기화 장치로부터 상기 기준시간을 수신하여 동기화한 후, 상기 센서 데이터를 취득한 취측시간 정보를 상기 센서 데이터와 함께 상기 중앙제어장치로 전송하는 제어부;주파수 신호를 생성하여 상기 제어부에 제공하는 주파수 생성부; 및상기 제어부에 실시간 클럭(Real Time Clock)을 제공하는 실시간(RTC) 모듈부;를 포함하는 센서 장치.
- 카메라 장치, 센서 장치, 중앙제어장치, 동기화 장치 및 컴퓨터 장치를 포함하는 시스템의 영상신호와 센서신호의 동기화 방법으로서,(a) 상기 동기화 장치가 동기화 시간 정보를 상기 센서 장치 및 상기 중앙제어장치로 전송하는 단계;(b) 상기 센서 장치 및 상기 중앙제어장치가 상기 동기화 시간 정보에 근거해 각각 내장된 동기용 시계를 동기시키는 단계;(c) 상기 카메라 장치가 영상 신호를 획득하여 상기 컴퓨터 장치로 전송하는 단계;(d) 상기 센서 장치가 센서 신호를 획득하여 상기 내장된 동기용 시계에 의한 취득시간 정보를 부가하여 상기 중앙제어장치로 전송하고, 상기 중앙제어장치가 상기 취득시간 정보가 부가된 영상 신호를 상기 컴퓨터 장치로 전송하는 단계; 및(e) 상기 컴퓨터 장치가 상기 내장된 동기용 시계와 상기 취득시간 정보를 근거로 상기 영상 신호와 상기 센서 신호의 동기화를 수행하는 단계;를 포함하는 영상신호와 센서신호의 동기화 방법.
- 제 11 항에 있어서,상기 (e) 단계는 상기 컴퓨터 장치가 상기 내장된 동기용 시계의 시간 정보와 상기 취득시간 정보를 비교하여 시간 오차를 계산하고, 상기 영상신호와 상기 센서신호에 대해 시간축에서 시간 오차만큼 보정하여 상기 영상신호와 상기 센서신호를 동기화하는 것을 특징으로 하는 영상신호와 센서신호의 동기화 방법.
- 센서 장치, 중앙제어장치 및 컴퓨터 장치를 포함하는 특정 장치와 유선 또는 무선으로 통신하는 동기화 장치의 영상신호와 센서신호를 동기화하는 방법으로서,(a) 상기 특정 장치에 현재시간 정보를 요청하여 현재시간 정보를 수신하는 단계;(b) 상기 현재시간 정보를 기준시간 정보와 비교하여 오차 정보를 획득하는 단계;(c) 상기 오차 정보를 보정하는 시간 정보를 생성하고, 상기 특정 장치로 상기 시간 정보와 시간교정 명령을 전송하는 단계; 및(d) 상기 특정 장치로부터 상기 시간 정보에 따른 시간 교정으로 동기화가 완료되었음을 알리는 동기 완료 명령을 수신하는 단계;를 포함하는 동기화 장치의 영상신호와 센서신호를 동기화하는 방법.
- 카메라 장치, 센서 장치, 중앙제어장치 및 동기화 장치와 유선 또는 무선으로 통신하는 컴퓨터 장치의 영상신호와 센서신호를 동기화하는 방법으로서,(a) 상기 동기화 장치로부터 기준시간 정보를 수신하여 내장된 동기용 시계를 동기시키는 단계;(b) 상기 카메라 장치로부터 영상신호를 수신하고, 상기 중앙제어장치로부터 상기 센서장치에 의해 획득된 취득시간 정보가 포함된 센서신호를 수신하는 단계; 및(c) 상기 내장된 동기용 시계와 상기 취득시간 정보를 근거로 상기 영상신호와 상기 센서신호를 동기화하는 단계;를 포함하는 컴퓨터 장치의 영상신호와 센서신호를 동기화하는 방법.
- 제 14 항에 있어서,상기 (c) 단계는 상기 내장된 동기용 시계의 시간 정보와 상기 취득시간 정보를 비교하여 시간오차를 계산하고, 상기 영상신호와 상기 센서신호에 대해 시간축에서 상기 시간오차만큼 보정하여 상기 영상신호와 상기 센서신호를 동기화하는 것을 특징으로 하는 컴퓨터 장치의 영상신호와 센서신호를 동기화하는 방법.
- 제 14 항에 있어서,상기 (c) 단계는 상기 센서 장치 및 상기 중앙제어장치로부터 전송받은 시간오차 정보에 근거해 상기 영상신호와 상기 센서신호에 대해 시간축에서 상기 시간오차 정보만큼 보정하여 상기 영상신호와 상기 센서신호를 동기화하는 것을 특징으로 하는 컴퓨터 장치의 영상신호와 센서신호를 동기화하는 방법.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201080054868XA CN102713891A (zh) | 2009-12-04 | 2010-12-03 | 视频信号和传感器信号的同步化系统及方法 |
JP2012541950A JP2013513283A (ja) | 2009-12-04 | 2010-12-03 | 映像信号とセンサー信号の同期化システム及び方法 |
US13/513,581 US20120287341A1 (en) | 2009-12-04 | 2010-12-03 | System and method for synchronizing a video signal and a sensor signal |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2009-0120102 | 2009-12-04 | ||
KR1020090120102A KR101067768B1 (ko) | 2009-12-04 | 2009-12-04 | 영상신호와 센서신호의 동기화 시스템 및 방법 |
Publications (3)
Publication Number | Publication Date |
---|---|
WO2011068380A2 true WO2011068380A2 (ko) | 2011-06-09 |
WO2011068380A3 WO2011068380A3 (ko) | 2011-11-10 |
WO2011068380A4 WO2011068380A4 (ko) | 2011-12-29 |
Family
ID=44115433
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2010/008622 WO2011068380A2 (ko) | 2009-12-04 | 2010-12-03 | 영상신호와 센서신호의 동기화 시스템 및 방법 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20120287341A1 (ko) |
JP (1) | JP2013513283A (ko) |
KR (1) | KR101067768B1 (ko) |
CN (1) | CN102713891A (ko) |
WO (1) | WO2011068380A2 (ko) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020107527A1 (zh) * | 2018-11-29 | 2020-06-04 | 惠州市德赛西威智能交通技术研究院有限公司 | 多传感器数据同步系统以及图像数据同步方法 |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101121153B1 (ko) * | 2009-12-08 | 2012-03-19 | (주) 알디텍 | 영상신호와 센서신호의 동기화 시스템 및 방법 |
JP2015046708A (ja) * | 2013-08-27 | 2015-03-12 | 日本電信電話株式会社 | 通信システム、通信方法、送信側同期信号配信装置、送信側同期制御装置、受信側同期信号配信装置、受信側同期制御装置及びプログラム |
KR101515372B1 (ko) * | 2014-02-25 | 2015-04-29 | (주) 알디텍 | 영상 신호와 무선 센서 신호의 동기화 시스템 및 방법 |
CN104394358A (zh) * | 2014-11-12 | 2015-03-04 | 深圳市理邦精密仪器股份有限公司 | 一种能够实时查看病人视频图像的监护方法及系统 |
US10075623B2 (en) * | 2015-03-30 | 2018-09-11 | Myriad Sensors, Inc. | Synchronizing wireless sensor data and video |
KR101639163B1 (ko) | 2015-07-08 | 2016-07-22 | 울산대학교 산학협력단 | 저전송 영상 정보 및 센싱 정보 송수신 장치 및 이의 동작 방법 |
DE102017217719A1 (de) * | 2017-10-05 | 2019-04-11 | Robert Bosch Gmbh | Vorrichtung und Verfahren zur Überwachung eines Sensortaktsignals in einer Sensoreinheit |
KR102435614B1 (ko) * | 2017-11-17 | 2022-08-24 | 삼성전자주식회사 | 카메라 모듈 내에서 이미지 센서를 위한 클럭 신호를 생성하기 위한 전자 장치 및 방법 |
JP6952339B2 (ja) * | 2018-01-12 | 2021-10-20 | ザインエレクトロニクス株式会社 | 映像信号受信装置および映像信号送受信システム |
CN111107248B (zh) * | 2018-10-25 | 2022-02-08 | 北京图森智途科技有限公司 | 一种多路视频采集的同步系统、方法和采集控制器 |
US11287530B2 (en) * | 2019-09-05 | 2022-03-29 | ThorDrive Co., Ltd | Data processing system and method for fusion of multiple heterogeneous sensors |
CN112601132A (zh) * | 2020-12-07 | 2021-04-02 | 北京奇艺世纪科技有限公司 | 音视频文件生成、采集时刻确定方法、装置及电子设备 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR200212557Y1 (ko) * | 2000-08-31 | 2001-02-15 | 엘지전자주식회사 | 피씨 표준시간 보정장치 |
US20050151852A1 (en) * | 2003-11-14 | 2005-07-14 | Nokia Corporation | Wireless multi-recorder system |
JP2007081686A (ja) * | 2005-09-13 | 2007-03-29 | Sony Corp | ワイヤレス収録システム及び基地局装置 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7450117B2 (en) * | 2002-09-16 | 2008-11-11 | Lg Electronics Inc. | Apparatus and method for restoring active signal and synchronous signal |
JP2005006037A (ja) * | 2003-06-12 | 2005-01-06 | Nec Corp | メディア同期システム及びそれに用いるサービス提供方法 |
JP2005317151A (ja) * | 2004-04-30 | 2005-11-10 | Nippon Telegr & Teleph Corp <Ntt> | マルチメディアデータ同期再生方法、マルチメディアデータ同期再生装置およびマルチメディアデータ同期再生プログラム |
JP2007028344A (ja) * | 2005-07-19 | 2007-02-01 | Teac Corp | データ記録装置及びデータ記録システム |
-
2009
- 2009-12-04 KR KR1020090120102A patent/KR101067768B1/ko active IP Right Grant
-
2010
- 2010-12-03 CN CN201080054868XA patent/CN102713891A/zh active Pending
- 2010-12-03 JP JP2012541950A patent/JP2013513283A/ja active Pending
- 2010-12-03 WO PCT/KR2010/008622 patent/WO2011068380A2/ko active Application Filing
- 2010-12-03 US US13/513,581 patent/US20120287341A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR200212557Y1 (ko) * | 2000-08-31 | 2001-02-15 | 엘지전자주식회사 | 피씨 표준시간 보정장치 |
US20050151852A1 (en) * | 2003-11-14 | 2005-07-14 | Nokia Corporation | Wireless multi-recorder system |
JP2007081686A (ja) * | 2005-09-13 | 2007-03-29 | Sony Corp | ワイヤレス収録システム及び基地局装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020107527A1 (zh) * | 2018-11-29 | 2020-06-04 | 惠州市德赛西威智能交通技术研究院有限公司 | 多传感器数据同步系统以及图像数据同步方法 |
Also Published As
Publication number | Publication date |
---|---|
CN102713891A (zh) | 2012-10-03 |
KR101067768B1 (ko) | 2011-09-28 |
US20120287341A1 (en) | 2012-11-15 |
WO2011068380A4 (ko) | 2011-12-29 |
WO2011068380A3 (ko) | 2011-11-10 |
JP2013513283A (ja) | 2013-04-18 |
KR20110063152A (ko) | 2011-06-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2011068380A2 (ko) | 영상신호와 센서신호의 동기화 시스템 및 방법 | |
WO2011071277A2 (ko) | 영상신호와 센서신호의 동기화 시스템 및 방법 | |
WO2010123182A1 (ko) | 다채널 신호의 데이터 획득 시스템 | |
WO2012026752A2 (en) | Terminal and server for integratedly managing phd standard and phd non-standard data | |
WO2013015603A1 (en) | Wireless communication method of probe for ultrasound diagnosis and apparatus therefor | |
WO2018117427A1 (ko) | 3d 영상을 재생을 위한 캡슐 내시경 장치, 상기 캡슐 내시경의 동작 방법, 캡슐 내시경과 연동하여 3d 영상을 재생하는 수신기, 캡슐 내시경과 연동하여 수신기의 3d 영상을 재생하는 방법, 및 캡슐 내시경 시스템 | |
WO2013032222A1 (ko) | 장치간 통신 방법 및 장치간 통신 시스템 | |
WO2018199630A1 (ko) | 이미지 캡처를 이용한 통합 모니터링 시스템 및 방법 | |
WO2014046319A1 (ko) | 배전기기의 전압 및 전류의 전송 오차에 대한 자동 보정 장치 및 방법 | |
CN112351251A (zh) | 图像处理系统和终端设备 | |
WO2016064115A1 (en) | Method of controlling device and device thereof | |
WO2017028590A1 (zh) | 显示设备白平衡调试的方法、装置和系统 | |
WO2018070557A1 (ko) | 영상획득장치 및 그의 구동 방법 | |
WO2019083068A1 (ko) | 투구 연습을 통한 3차원 정보 획득 시스템 및 카메라 파라미터 산출 방법 | |
KR101022228B1 (ko) | Pc 기반의 가상 영상 제공 장치 및 제공 방법 | |
WO2023042931A1 (ko) | 디스플레이 장치 및 그의 동작 방법 | |
WO2020075989A1 (en) | Wireless charging coil and electronic device including the same | |
WO2022164286A1 (ko) | 수신한 데이터 기록의 시간을 동기화하는 전자 장치 및 그 방법 | |
WO2024075961A1 (ko) | 영상에 포함된 객체에 대한 추론을 수행하는 방법 및 디바이스 | |
WO2017142209A1 (ko) | 초음파 영상 분배 장치 및 스마트 단말기 | |
WO2024075962A1 (ko) | 음성 입력을 이용한 어노테이션을 제공하는 방법 및 디바이스 | |
WO2023121140A1 (ko) | 주파수 발생기 및 주파수 발생기의 주파수 보정 방법 | |
KR101022229B1 (ko) | Pc 기반 가상 영상의 영상 포맷 변환 장치 및 방법 | |
JP4292838B2 (ja) | 多点データ収集装置 | |
WO2018131916A1 (ko) | 보청기의 비용을 절감하기 위해 외부 프로세서를 사용하는 스마트 히어링 디바이스 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080054868.X Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10834795 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13513581 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012541950 Country of ref document: JP |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10834795 Country of ref document: EP Kind code of ref document: A2 |