WO2010137166A1 - Delay detection device and delay detection method - Google Patents

Delay detection device and delay detection method Download PDF

Info

Publication number
WO2010137166A1
WO2010137166A1 PCT/JP2009/059883 JP2009059883W WO2010137166A1 WO 2010137166 A1 WO2010137166 A1 WO 2010137166A1 JP 2009059883 W JP2009059883 W JP 2009059883W WO 2010137166 A1 WO2010137166 A1 WO 2010137166A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
video
output
audio
sensor
Prior art date
Application number
PCT/JP2009/059883
Other languages
French (fr)
Japanese (ja)
Inventor
悟士 神田
Original Assignee
Ｎｅｃディスプレイソリューションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ｎｅｃディスプレイソリューションズ株式会社 filed Critical Ｎｅｃディスプレイソリューションズ株式会社
Priority to JP2011515821A priority Critical patent/JP5305488B2/en
Priority to PCT/JP2009/059883 priority patent/WO2010137166A1/en
Publication of WO2010137166A1 publication Critical patent/WO2010137166A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/654—Transmission by server directed to the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/633—Control signals issued by server directed to the network components or client
    • H04N21/6332—Control signals issued by server directed to the network components or client directed to client

Definitions

  • the present invention relates to a delay detection apparatus and a delay detection method for detecting a difference in reproduction timing between a video signal and an audio signal.
  • Patent Document 1 discloses correcting the delay, but does not specifically disclose how to grasp the delay time. In this case, there is no way to grasp the accurate delay time in the output of each device (panel for displaying video and speaker for audio output). In addition, there is a problem that it is difficult to perform synchronization management of video / audio signals for inspection. As described above, the means for recognizing the difference between video and audio in the above-described image display apparatus largely depends on human senses, and depending on the person who performs this adjustment, there is a difference in the recognition result of the deviation. There was a problem.
  • the present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a delay detection device and a delay detection method capable of grasping the delay time of the video and audio signals.
  • the present invention receives an input of a video signal, separates a part of the video signal and outputs it as a first signal, and outputs the remaining separated video signal as a second signal.
  • a signal branching / distributing unit that outputs the first signal output from the signal branching / distributing unit by a display device, and an output unit that outputs the second signal output from the signal branching / distributing unit by an audio output device; Based on a video sensor that detects video displayed by the display device, a sound sensor that detects audio output from the audio output device, a detection result of the video sensor, and a detection result of the sound sensor
  • a delay detection unit that detects a difference in reproduction timing between a signal obtained by the video sensor and a signal obtained by the sound sensor.
  • a part of a video signal is branched to generate a video signal and an audio signal, which are supplied to an image display device having an audio output function, and after being subjected to video processing and audio processing in the image display device Since the output is measured by a sensor, the delay time of video / audio can be grasped.
  • FIG. 1 is a schematic block diagram showing a configuration of a multi-installation monitor system using a delay detection device.
  • the signal branching / distributing means 10 receives an input of a video signal output from the PC 50, separates a part of this video signal, outputs it as a first signal (for example, a video signal), and separates it. The remaining video signal is output as a second signal (for example, an audio signal).
  • the video signal output from the PC 50 includes three types of color signals (red, green, blue) and two types of synchronization signals (horizontal signal, vertical signal), and these signals are synchronized. Yes.
  • the term “synchronization” here means that the reproduction timings of the video to be reproduced and the audio match.
  • the signal branching / distributing unit 10 separates a blue signal from among a red signal, a green signal, and a blue signal included in the video signal and supplies the separated signal as an audio signal to the audio processing unit 23 of the image display device 20.
  • Red signal, Green signal, Horizontal signal, Vertical signal are branched into video signals and supplied to the video processing unit 21 of the image display device 20.
  • synchronizing one of the color signals and outputting it as an audio signal synchronization between the video signal and the audio signal supplied to the image display device 20 is ensured.
  • the image display device 20 displays the first signal (video signal) output from the signal branching / distribution unit 10 as video, and outputs the second signal (audio signal) as audio.
  • the image display device 20 includes a video processing unit 21, a display device 22, an audio processing unit 23, and an audio device 24.
  • the video processing unit 21 performs signal processing on the video signal output from the signal branching / distribution unit 10 and displays the video signal on the display device 22.
  • the display device 22 is a liquid crystal panel, for example, and displays an image on a screen.
  • the audio processing unit 23 performs signal processing on the audio signal output from the signal branching / distribution unit 10, and outputs audio by the audio device 24.
  • the audio device 24 is a speaker, for example, and outputs an audio signal as audio.
  • the video sensor 30 detects the light of the video output by the display device 22 of the image display device 20.
  • the video sensor 30 is, for example, a photodiode.
  • the sound sensor 40 is, for example, a microphone, and detects sound output from the sound device 24 of the image display apparatus 20.
  • the measuring device 50 is controlled by the PC 60 and has a function of acquiring the measurement results of the video sensor 30 and the sound sensor 40 and outputting them to the PC 60 in real time.
  • the measuring device 50 is, for example, an oscilloscope, and digitizes the detection results obtained by the video sensor 30 and the sound sensor 40 by performing AD conversion.
  • the PC 60 is installed with an application 70 for controlling the measuring instrument 20, data analysis, and changing a video signal.
  • the application 70 detects a difference in reproduction timing between the signal obtained by the video sensor 30 and the signal obtained by the sound sensor 40 based on the detection result of the video sensor 30 and the detection result of the sound sensor 40 (delay detection). Equivalent to part).
  • the application 70 changes the video signal supplied to the signal branching / distributing means from the first color (for example, white) to the second color (for example, black), and the video generated in accordance with the change in the color.
  • a difference in reproduction timing between the signal obtained by the sensor 30 and the signal obtained by the sound sensor 40 is detected.
  • the PC 60 executes the application 70, generates a test video signal, and outputs it to the signal branching / distributing unit 10.
  • the PC 60 changes the video signal from white to black and from black to white and outputs the video signal.
  • the signal branching / distribution means 10 separates the blue signal from the video signal, supplies it to the image display device 20 as an audio signal, and supplies the other signals to the image display device 20 as video signals. At this time, the synchronization of the input signals (video signal and audio signal) input to the image display device 20 is ensured.
  • the image display device 20 outputs a video signal by the display device 22 and outputs a blue signal input as an audio signal by the audio device 24.
  • the video sensor 30 detects the light of the video output by the display device 22.
  • the sound sensor 40 detects sound output by the sound device 24.
  • the measuring device 20 AD converts the detection results obtained from the video sensor 30 and the sound sensor 40 to generate numerical data, and outputs the numerical data to the PC 60.
  • the PC 60 detects the timing at which the numerical data of the video signal and the audio signal obtained from the measuring instrument 20 changes by changing the video signal from white to black and from black to white, and the timing of the change is detected. By obtaining the difference, the delay time is detected by calculating the delay time of the video and audio signals.
  • an acceleration sensor may be used instead of the voice sensor 40.
  • the acceleration sensor By installing the acceleration sensor in the housing of the image display device 20 around the sound device, it is possible to measure a change in sound output without being affected by environmental sound.
  • the video signal controlled by the PC 60 is used as the video and audio input signal of the image display device 20, thereby omitting synchronization management of the input signal, and each device output of the image display device 20 is detected by the sensor
  • the change in video and audio is quantified by measuring at, and the delay time (temporal deviation) is calculated by the application 70 of the PC 60 to obtain an accurate delay time and provide information representing the delay time. Is possible.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Television Receiver Circuits (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A delay detection device comprises a signal branch/distribution section (10) which receives input of an image signal, separates a part of the image signal, outputs the part as a first signal, and outputs the remaining part as a second signal; an output section (20) which allows the first signal outputted from the signal branch/distribution section (10) to be displayed by a display device (22) and allows the second signal outputted from the signal branch/distribution section (10) to be outputted by a voice output device (24); an image sensor (30) which detects an image displayed by the display device (22); a sound sensor (40) which detects the voice outputted from the voice output device (24); and a delay detection section (60) which detects, on the basis of the detected result of the image sensor (30) and that of the sound sensor (40), the difference between reproduction timings of a signal obtained by the image sensor (30) and that obtained by the sound sensor (40).

Description

遅延検出装置、遅延検出方法Delay detection apparatus and delay detection method
　本発明は、映像信号と音声信号との再生タイミングの差を検出する遅延検出装置、遅延検出方法に関する。 The present invention relates to a delay detection apparatus and a delay detection method for detecting a difference in reproduction timing between a video signal and an audio signal.
　画像表示装置内の映像や音声の処理が複雑化したことにより、映像出力と音声出力とに時間的ずれが生じるようになって来ている。一般的には、情報量の関係から、時間的に音声が映像よりも先に出力される。映像と音声との間に遅延が生じると、再生された映像と音声とに違和感が生じる。
　例えば、このような映像と音声との遅延を補正するには、ピアノ演奏等のシーンが撮影された映像を用いて、その撮像された信号を入力して映像と音声のずれを感覚的に捉えて、人手によってフィードバックを行い、映像と音声との遅延について補正を行っていた。
　一方、この補正を行なうためにリップシンク機能（Lip Synchronization）が使われている。このようなリップシンク機能については、例えば、以下に示す特許文献１に記載されている。ここでは、装置の機能別に映像と音声の遅延時間を何らからの方法で予め把握しておき、機能のON/OFFによって映像と音声それぞれの遅延時間を決定し、その差分時間だけ遅延処理を行なうものである。 Due to the complicated processing of video and audio in the image display device, there is a time lag between video output and audio output. In general, due to the amount of information, audio is temporally output before video. When a delay occurs between video and audio, the reproduced video and audio are uncomfortable.
For example, in order to correct such a delay between video and audio, a video obtained by shooting a scene such as a piano performance is input, and the captured signal is input to sensuously grasp the difference between the video and audio. Therefore, feedback was performed manually, and the delay between video and audio was corrected.
On the other hand, a lip sync function (Lip Synchronization) is used to perform this correction. Such a lip sync function is described in, for example, Patent Document 1 shown below. Here, the video and audio delay times for each function of the device are grasped in advance by some method, the delay times of the video and audio are determined by the function ON / OFF, and the delay processing is performed for the difference time. Is.
特開２００８－３０１０８７号公報JP 2008-301087 A
　しかしながら、上述した特許文献１においては、遅延を補正することについて開示されているが、遅延時間を如何にして把握するかについては、具体的には開示されていない。そうすると、やはり、各デバイス（映像を表示するパネルと音声出力用のスピーカ）の出力における正確な遅延時間を把握する術がない。また、検査用の映像・音声信号の同期管理をすることが困難であるという問題が生じる。このように、上述の画像表示装置における映像と音声のずれ認識の手段は、人間の感覚に頼るところが大きく、その時々において、この調整を行う人によっては、ずれの認識結果に差が生じてしまうという問題があった。 However, the above-described Patent Document 1 discloses correcting the delay, but does not specifically disclose how to grasp the delay time. In this case, there is no way to grasp the accurate delay time in the output of each device (panel for displaying video and speaker for audio output). In addition, there is a problem that it is difficult to perform synchronization management of video / audio signals for inspection. As described above, the means for recognizing the difference between video and audio in the above-described image display apparatus largely depends on human senses, and depending on the person who performs this adjustment, there is a difference in the recognition result of the deviation. There was a problem.
　本発明は、上記の事情を考慮してなされたものであり、その目的は、映像と音声との信号の遅延時間を把握することができる遅延検出装置、遅延検出方法を提供することにある。 The present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a delay detection device and a delay detection method capable of grasping the delay time of the video and audio signals.
　上記課題を解決するため、本発明は、映像信号の入力を受け付け、この映像信号の一部を分離して第１の信号として出力するとともに、分離した残りの映像信号を第２の信号として出力する信号分岐分配部と、前記信号分岐分配部から出力される第１の信号を表示装置によって表示させ、前記信号分岐分配部から出力される第２の信号を音声出力装置によって出力する出力部と、前記表示装置によって表示される映像を検出する映像センサーと、前記音声出力装置から出力される音声を検出する音センサーと、前記映像センサーの検出結果と、前記音センサーの検出結果とに基づいて、前記映像センサーによって得られる信号と前記音センサーによって得られる信号との再生タイミングの差を検出する遅延検出部と、を有する。 In order to solve the above problems, the present invention receives an input of a video signal, separates a part of the video signal and outputs it as a first signal, and outputs the remaining separated video signal as a second signal. A signal branching / distributing unit that outputs the first signal output from the signal branching / distributing unit by a display device, and an output unit that outputs the second signal output from the signal branching / distributing unit by an audio output device; Based on a video sensor that detects video displayed by the display device, a sound sensor that detects audio output from the audio output device, a detection result of the video sensor, and a detection result of the sound sensor A delay detection unit that detects a difference in reproduction timing between a signal obtained by the video sensor and a signal obtained by the sound sensor.
　本発明によれば、映像信号の一部を分岐して映像信号と音声信号とを生成して音声出力機能を備えた画像表示装置に供給し、画像表示装置において映像処理、音声処理された後の出力を、センサーにて測定するようにしたので、映像・音声の遅延時間を把握することができる。 According to the present invention, a part of a video signal is branched to generate a video signal and an audio signal, which are supplied to an image display device having an audio output function, and after being subjected to video processing and audio processing in the image display device Since the output is measured by a sensor, the delay time of video / audio can be grasped.
マルチ設置モニターシステムの構成を表す概略ブロック図である。It is a schematic block diagram showing the structure of a multi-installation monitor system.
　以下、本発明について図面を用いて説明する。図１は、遅延検出装置を用いたマルチ設置モニターシステムの構成を表す概略ブロック図である。
　この図において、信号分岐・分配手段１０は、ＰＣ５０から出力される映像信号の入力を受け付け、この映像信号の一部を分離して第１の信号（例えば、映像信号）として出力するとともに、分離した残りの映像信号を第２の信号（例えば、音声信号）として出力する。
　ここで、ＰＣ５０から出力される映像信号は、３種の色信号（赤、緑、青）と２種の同期信号（水平信号、垂直信号）が含まれており、それぞれの信号は同期している。ここでいう同期とは、再生する対象の映像と音声との再生タイミングが一致していることを表す。
　信号分岐・分配部１０は、例えば、映像信号に含まれる赤色信号、緑色信号、青色信号のうち、青色信号を分離して音声信号として画像表示装置２０の音声処理部２３に供給し、その他信号（赤色信号、緑色信号、水平信号、垂直信号）を映像信号に分岐して画像表示装置２０の映像処理部２１に供給する。ここでは、色信号のいずれかを分離して音声信号として出力することにより、画像表示装置２０に供給される映像信号と音声信号との同期を確保している。 The present invention will be described below with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of a multi-installation monitor system using a delay detection device.
In this figure, the signal branching / distributing means 10 receives an input of a video signal output from the PC 50, separates a part of this video signal, outputs it as a first signal (for example, a video signal), and separates it. The remaining video signal is output as a second signal (for example, an audio signal).
Here, the video signal output from the PC 50 includes three types of color signals (red, green, blue) and two types of synchronization signals (horizontal signal, vertical signal), and these signals are synchronized. Yes. The term “synchronization” here means that the reproduction timings of the video to be reproduced and the audio match.
For example, the signal branching / distributing unit 10 separates a blue signal from among a red signal, a green signal, and a blue signal included in the video signal and supplies the separated signal as an audio signal to the audio processing unit 23 of the image display device 20. (Red signal, Green signal, Horizontal signal, Vertical signal) are branched into video signals and supplied to the video processing unit 21 of the image display device 20. Here, by synchronizing one of the color signals and outputting it as an audio signal, synchronization between the video signal and the audio signal supplied to the image display device 20 is ensured.
　画像表示装置２０は、信号分岐・分配部１０から出力される第１の信号（映像信号）を映像として表示し、第２の信号（音声信号）を音声として出力する。
　この画像表示装置２０は、映像処理部２１と、表示デバイス２２と、音声処理部２３と、音声デバイス２４とを含んで構成される。映像処理部２１は、信号分岐・分配部１０から出力される映像信号を信号処理し、表示デバイス２２によって表示する。表示デバイス２２は、例えば、液晶パネルであり、映像を画面上に表示する。
　音声処理部２３は、信号分岐・分配部１０から出力される音声信号を信号処理し、音声デバイス２４によって、音声を出力する。音声デバイス２４は、例えばスピーカであり、音声信号を音声として出力する。 The image display device 20 displays the first signal (video signal) output from the signal branching / distribution unit 10 as video, and outputs the second signal (audio signal) as audio.
The image display device 20 includes a video processing unit 21, a display device 22, an audio processing unit 23, and an audio device 24. The video processing unit 21 performs signal processing on the video signal output from the signal branching / distribution unit 10 and displays the video signal on the display device 22. The display device 22 is a liquid crystal panel, for example, and displays an image on a screen.
The audio processing unit 23 performs signal processing on the audio signal output from the signal branching / distribution unit 10, and outputs audio by the audio device 24. The audio device 24 is a speaker, for example, and outputs an audio signal as audio.
　映像センサー３０は、画像表示装置２０の表示デバイス２２によって出力される映像の光を検出する。この映像センサー３０は、例えば、フォトダイオードである。
　音センサー４０は、例えば、マイクロフォンであり、画像表示装置２０の音声デバイス２４から出力される音声を検出する。
　測定器５０は、ＰＣ６０によって制御され、映像センサー３０と音センサー４０の測定結果を取得して、ＰＣ６０にリアルタイムに出力する機能を有している。この測定器５０は、例えば、オシロスコープであり、映像センサー３０、音センサー４０によって得られた検出結果をＡＤ変換を行って数値化する。 The video sensor 30 detects the light of the video output by the display device 22 of the image display device 20. The video sensor 30 is, for example, a photodiode.
The sound sensor 40 is, for example, a microphone, and detects sound output from the sound device 24 of the image display apparatus 20.
The measuring device 50 is controlled by the PC 60 and has a function of acquiring the measurement results of the video sensor 30 and the sound sensor 40 and outputting them to the PC 60 in real time. The measuring device 50 is, for example, an oscilloscope, and digitizes the detection results obtained by the video sensor 30 and the sound sensor 40 by performing AD conversion.
　ＰＣ６０は、測定器２０の制御とデータ解析、映像信号を変化させるためのアプリケーション７０がインストールされている。アプリケーション７０は、映像センサー３０の検出結果と、音センサー４０の検出結果とに基づいて、映像センサー３０によって得られる信号と音センサー４０によって得られる信号との再生タイミングの差を検出する（遅延検出部に相当）。
　ここでは、アプリケーション７０は、信号分岐分配手段に供給する映像信号を、第１の色（例えば、白）から第２の色（例えば、黒）に変化させ、この色の変化に応じて生じる映像センサー３０によって得られる信号と音センサー４０によって得られる信号との再生タイミングの差を検出する。 The PC 60 is installed with an application 70 for controlling the measuring instrument 20, data analysis, and changing a video signal. The application 70 detects a difference in reproduction timing between the signal obtained by the video sensor 30 and the signal obtained by the sound sensor 40 based on the detection result of the video sensor 30 and the detection result of the sound sensor 40 (delay detection). Equivalent to part).
Here, the application 70 changes the video signal supplied to the signal branching / distributing means from the first color (for example, white) to the second color (for example, black), and the video generated in accordance with the change in the color. A difference in reproduction timing between the signal obtained by the sensor 30 and the signal obtained by the sound sensor 40 is detected.
　次に本発明の実施例の動作について図１を用いて説明する。
　ＰＣ６０は、アプリケーション７０を実行し、テスト用の映像信号を生成し、信号分岐・分配部１０に出力する。ここでは、ＰＣ６０は、映像信号を白から黒、黒から白へと変化させて映像信号を出力する。信号分岐・分配手段１０は、映像信号のうち、青色信号を分離して、画像表示装置２０に音声信号として供給し、その他の信号を映像信号として画像表示装置２０に供給する。この時点においては、画像表示装置２０に入力される入力信号（映像信号と音声信号）の同期が確保されている。 Next, the operation of the embodiment of the present invention will be described with reference to FIG.
The PC 60 executes the application 70, generates a test video signal, and outputs it to the signal branching / distributing unit 10. Here, the PC 60 changes the video signal from white to black and from black to white and outputs the video signal. The signal branching / distribution means 10 separates the blue signal from the video signal, supplies it to the image display device 20 as an audio signal, and supplies the other signals to the image display device 20 as video signals. At this time, the synchronization of the input signals (video signal and audio signal) input to the image display device 20 is ensured.
　次に、画像表示装置２０は、映像信号を表示デバイス２２によって映像を出力するとともに、音声信号として入力された青色信号を音声デバイス２４によって音声を出力する。
　映像信号、音声信号が出力されると、映像センサー３０は、表示デバイス２２によって出力される映像の光を検出する。音センサー４０は、音声デバイス２４によって出力される音声を検出する。 Next, the image display device 20 outputs a video signal by the display device 22 and outputs a blue signal input as an audio signal by the audio device 24.
When the video signal and the audio signal are output, the video sensor 30 detects the light of the video output by the display device 22. The sound sensor 40 detects sound output by the sound device 24.
　測定器２０は、映像センサー３０、音センサー４０から得られる検出結果をそれぞれＡＤ変換して数値データを生成し、ＰＣ６０に出力する。
　ＰＣ６０は、映像信号を白から黒、黒から白へと変化させることによって、測定器２０から得られる映像信号および音声信号の数値データがどのタイミングで変化するかを検出し、その変化のタイミングの差を求めることで、映像及び音声信号の遅延時間を算出することにより、遅延時間を検出する。 The measuring device 20 AD converts the detection results obtained from the video sensor 30 and the sound sensor 40 to generate numerical data, and outputs the numerical data to the PC 60.
The PC 60 detects the timing at which the numerical data of the video signal and the audio signal obtained from the measuring instrument 20 changes by changing the video signal from white to black and from black to white, and the timing of the change is detected. By obtaining the difference, the delay time is detected by calculating the delay time of the video and audio signals.
　なお、上述した実施形態において、音声センサー４０に換えて、加速度センサーを用いるように構成してもよい。加速度センサーを音声デバイス周辺の画像表示装置２０の筐体に設置することで、環境音に影響されることなく音声出力の変化を測定することができる。 In the embodiment described above, an acceleration sensor may be used instead of the voice sensor 40. By installing the acceleration sensor in the housing of the image display device 20 around the sound device, it is possible to measure a change in sound output without being affected by environmental sound.
　以上説明したように、上述の実施形態によれば、映像および音声出力の変化をセンサーを用いて数値化しているので、遅延時間を定量的に把握することができ、その精度も正確であることからフレーム単位での遅延時間補正や検査を行なうことも可能となる。
　また、ＰＣ６０の映像信号を分岐して画像表示装置２０の入力信号としているので、入力信号の同期管理が不要となることである。 As described above, according to the above-described embodiment, changes in video and audio output are quantified using sensors, so that the delay time can be quantitatively grasped and the accuracy thereof is accurate. Therefore, it is possible to perform delay time correction and inspection in units of frames.
Further, since the video signal of the PC 60 is branched and used as the input signal of the image display device 20, the synchronization management of the input signal becomes unnecessary.
　また、上述した実施形態によれば、ＰＣ６０が制御する映像信号を画像表示装置２０の映像と音声の入力信号とすることで入力信号の同期管理を省き、画像表示装置２０の各デバイス出力をセンサーにて測定することで映像と音声の変化を数値化し、その遅延時間（時間的ずれ）をＰＣ６０のアプリケーション７０によって演算することで正確な遅延時間を得て、遅延時間を表す情報を提供することが可能となる。 In addition, according to the above-described embodiment, the video signal controlled by the PC 60 is used as the video and audio input signal of the image display device 20, thereby omitting synchronization management of the input signal, and each device output of the image display device 20 is detected by the sensor The change in video and audio is quantified by measuring at, and the delay time (temporal deviation) is calculated by the application 70 of the PC 60 to obtain an accurate delay time and provide information representing the delay time. Is possible.
１０　信号分岐・分配部
２０　画像表示装置
２１　映像処理部
２２　表示デバイス
２３　音声処理部
２４　音声デバイス
３０　映像センサー
４０　音センサー
５０　測定器
６０　ＰＣ
７０　アプリケーション DESCRIPTION OF SYMBOLS 10 Signal branching / distribution part 20 Image display apparatus 21 Video processing part 22 Display device 23 Audio | voice processing part 24 Audio | voice device 30 Video sensor 40 Sound sensor 50 Measuring instrument 60 PC
70 applications

Claims (3)

  1. 　映像信号の入力を受け付け、この映像信号の一部を分離して第１の信号として出力するとともに、分離した残りの映像信号を第２の信号として出力する信号分岐分配部と、
    　前記信号分岐分配部から出力される第１の信号を表示装置によって表示させ、前記信号分岐分配部から出力される第２の信号を音声出力装置によって出力する出力部と、
    　前記表示装置によって表示される映像を検出する映像センサーと、
    　前記音声出力装置から出力される音声を検出する音センサーと、
    　前記映像センサーの検出結果と、前記音センサーの検出結果とに基づいて、前記映像センサーによって得られる信号と前記音センサーによって得られる信号との再生タイミングの差を検出する遅延検出部と、
    　を有することを特徴とする遅延検出装置。     A signal branching / distributing unit that receives an input of the video signal, separates a part of the video signal and outputs the first signal as a first signal, and outputs the remaining separated video signal as a second signal;
    An output unit for displaying a first signal output from the signal branching / distributing unit by a display device, and outputting a second signal output from the signal branching / distributing unit by an audio output device;
    A video sensor for detecting video displayed by the display device;
    A sound sensor for detecting sound output from the sound output device;
    A delay detection unit that detects a difference in reproduction timing between a signal obtained by the video sensor and a signal obtained by the sound sensor based on the detection result of the video sensor and the detection result of the sound sensor;
    A delay detection apparatus comprising:
  2. 　前記遅延検出部は、信号分岐分配手段に供給する映像信号を、第１の色から第２の色に変化させ、この色の変化に応じて生じる前記映像センサーによって得られる信号と前記音センサーによって得られる信号との再生タイミングの差を検出する
    　ことを特徴とする請求項１記載の遅延検出装置。     The delay detection unit changes a video signal supplied to the signal branching / distributing unit from a first color to a second color, and a signal obtained by the video sensor generated according to the change of the color and the sound sensor. The delay detection apparatus according to claim 1, wherein a difference in reproduction timing from an obtained signal is detected.
  3. 　　映像信号の入力を受け付け、この映像信号の一部を分離して第１の信号として出力するとともに、分離した残りの映像信号を第２の信号として出力し、
    　前記出力される第１の信号を表示装置によって表示させ、前記信号分岐分配手段から出力される第２の信号を音声出力装置によって出力し、
    　前記表示される映像を検出し、
    　前記出力される音声を検出し、
    　前記映像の検出結果と、前記音声の検出結果とに基づいて、前記映像の検出結果と前記音声の検出結果との再生タイミングの差を検出する
    　ことを特徴とする遅延検出方法。     Accepting input of a video signal, separating a part of this video signal and outputting it as a first signal, and outputting the remaining separated video signal as a second signal,
    The output first signal is displayed by a display device, the second signal output from the signal branching and distributing means is output by an audio output device,
    Detecting the displayed video,
    Detecting the output voice;
    A delay detection method, comprising: detecting a reproduction timing difference between the video detection result and the audio detection result based on the video detection result and the audio detection result.
PCT/JP2009/059883 2009-05-29 2009-05-29 Delay detection device and delay detection method WO2010137166A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2011515821A JP5305488B2 (en) 2009-05-29 2009-05-29 Delay detection apparatus and delay detection method
PCT/JP2009/059883 WO2010137166A1 (en) 2009-05-29 2009-05-29 Delay detection device and delay detection method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2009/059883 WO2010137166A1 (en) 2009-05-29 2009-05-29 Delay detection device and delay detection method

Publications (1)

Publication Number Publication Date
WO2010137166A1 true WO2010137166A1 (en) 2010-12-02

Family

ID=43222307

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2009/059883 WO2010137166A1 (en) 2009-05-29 2009-05-29 Delay detection device and delay detection method

Country Status (2)

Country Link
JP (1) JP5305488B2 (en)
WO (1) WO2010137166A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016001967A1 (en) * 2014-06-30 2016-01-07 Ｎｅｃディスプレイソリューションズ株式会社 Display device, display method, and display program

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10784024B2 (en) 2017-08-30 2020-09-22 Ultra Conductive Copper Company, Inc. Wire-drawing method and system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007221421A (en) * 2006-02-16 2007-08-30 Onkyo Corp Video audio reproducing system, av center constituting same, and monitor
JP2008148084A (en) * 2006-12-12 2008-06-26 Funai Electric Co Ltd Lip-sync measurement method and circuit

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3727736B2 (en) * 1996-11-08 2005-12-14 日本放送協会 Video / audio signal generator for time difference detection between video and audio
JP3548502B2 (en) * 2000-05-15 2004-07-28 株式会社シグマシステムエンジニアリング Line time difference measuring device and signal generator for line time difference measuring device
JP4336879B2 (en) * 2003-09-24 2009-09-30 日本電気株式会社 Video / audio delay confirmation circuit and video / audio delay confirmation method used therefor
JP2006186990A (en) * 2004-12-03 2006-07-13 Shinano Kenshi Co Ltd Lip sync measuring method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007221421A (en) * 2006-02-16 2007-08-30 Onkyo Corp Video audio reproducing system, av center constituting same, and monitor
JP2008148084A (en) * 2006-12-12 2008-06-26 Funai Electric Co Ltd Lip-sync measurement method and circuit

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016001967A1 (en) * 2014-06-30 2016-01-07 Ｎｅｃディスプレイソリューションズ株式会社 Display device, display method, and display program
JPWO2016001967A1 (en) * 2014-06-30 2017-05-25 Ｎｅｃディスプレイソリューションズ株式会社 Display device, display method, and display program

Also Published As

Publication number Publication date
JP5305488B2 (en) 2013-10-02
JPWO2010137166A1 (en) 2012-11-12

Similar Documents

Publication Publication Date Title
US7970222B2 (en) Determining a delay
US9807384B1 (en) Method, apparatus and computer program product for testing a display
US9888232B2 (en) 3D motion picture processing device
JP2003339056A5 (en)
JP2008524904A (en) Delayed video and audio synchronization
EP3425896A1 (en) Signal processing device, signal processing method, and camera system
WO2017200300A3 (en) Method for cumulatively displaying noise source visualization data, and sound camera system
WO2009045068A3 (en) Image display apparatus and method of compensating for white balance
US20110013085A1 (en) Method and Apparatus for Measuring Audio-Video Time skew and End-to-End Delay
JP2017103542A (en) Synchronization device, synchronization method and synchronization program
US20190037188A1 (en) Unevenness correction system, unevenness correction apparatus and panel drive circuit
JP5305488B2 (en) Delay detection apparatus and delay detection method
CN110798682B (en) Time delay test system
JP6429291B2 (en) Display device, display method, and display program
JP2011071686A (en) Video sound processor, and video sound processing method, and program
JP2011169842A (en) Flicker measuring method and device thereof
ATE470920T1 (en) IMPROVEMENTS IN EVENT DETECTION
US20190394421A1 (en) Method for synchronising a first audio signal and a second audio signal
JP5082137B2 (en) Projection-type image display device, image display system, and color unevenness correction method
WO2020044644A1 (en) Video image signal output device, control method, and program
JP2006180212A (en) Measurement data/image data recording device and remote monitoring system using the same
JP7058946B2 (en) Information processing equipment, information processing system, information processing method and program
JPH11127379A (en) Image pickup device
JP2007329603A (en) Inspection apparatus for lip-sync
JPH10108222A (en) Check method for image processing unit

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09845233

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2011515821

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09845233

Country of ref document: EP

Kind code of ref document: A1