JP2007081780A - Reproduction controller, display, and reproduction system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reliably synchronize the output timing of sounds based on sound data output to an sound output unit over a network with the display timing of a picture on a display. <P>SOLUTION: The reproduction controller comprises a data generator for generating a pair of reproducing picture data and reproducing sound data to be synchronously reproducing, based on picture-sound data, a data output unit for outputting reproduced sound data to a sound output unit over a network, a control unit for controlling the data output unit to output reproducing sound data together with outputting reproducing picture data for displaying pictures, and a sound collector for collecting sounds. The control unit controls the data output unit to change the display timing of the picture, based on the reproducing picture data according to the time length from a time point of outputting specified sound data from a sound unit (step 73) to a time point of collecting sounds by the sound collector, based on the specified sound data (steps 79, 81). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention generates reproduction video data and reproduction audio data based on video / audio data, outputs the reproduction video data to a display unit, displays a video based on the reproduction video data, and reproduces the reproduction audio data. Is output to the audio output device to output sound based on the reproduction audio data, a display device including the reproduction control device and a display unit, and the reproduction control device, the display unit, and the audio output device, It is related with the reproduction | regeneration system provided with.

  As a technology related to this type of playback control device, a video / audio transmission / reception device (hereinafter also referred to as “transmission device”) and a video / audio transmission / reception device (hereinafter also referred to as “reception device”) are provided. A transmission system (hereinafter also referred to as “transmission system”) is disclosed in Japanese Patent Application Laid-Open No. 2004-104554. When using this transmission system, first, a playback device such as a video tape recorder is connected to the video input terminal and audio input terminal of the transmission device, and an audio output device (audio amplifier) is connected to the audio output terminal of the transmission device. In addition, a display device such as a liquid crystal video projector is connected to the video output terminal of the receiving device. Next, the playback process of the video tape by the playback device is started to output an analog video signal and an analog audio signal. At this time, in this transmission system, the transmission device generates a digital video signal based on the analog video signal output from the reproduction device and transmits the digital video signal to the reception device, and the reception device based on the transmitted digital video signal. An analog video signal is generated and output to a display device. Thereby, the video based on the analog video signal output from the receiving device is displayed by the display device. In the transmission device, the A / D conversion circuit converts the analog audio signal output from the reproduction device into a digital audio signal, and the D / A conversion circuit converts the converted digital audio signal into an analog audio signal. Output to the audio output device. Thereby, the sound based on the analog sound signal output from the transmission device is output by the sound output device.

In this case, this transmission system employs a configuration in which a digital video signal is transmitted and received by wireless communication between the transmission device and the reception device. For this reason, in order to reduce the transmission / reception amount (data amount) of the digital video signal between both devices, the transmission device compresses the digital video signal, and the receiving device expands the compressed digital video signal. It has been adopted. As a result, in this transmission device, the analog video signal output from the playback device is subjected to digital video data compression processing and decompression processing until the corresponding video is displayed on the display device. As for the analog audio signal output from the playback device, the corresponding audio is output from the audio output device (audio amplifier and speaker) without executing the compression processing and decompression processing of the digital audio data. Therefore, in this transmission system, a delay circuit is provided between the A / D conversion circuit and the D / A conversion circuit of the transmission device, and a predetermined delay time (digital) is output until the analog audio signal is output to the audio output device. The delay time of the time length required for the compression processing and decompression processing of the video data is generated. As a result, the timing at which the video is displayed on the screen and the timing at which the audio is output from the speaker become asynchronous due to the presence or absence of the compression processing and the decompression processing (the video is displayed with a delay with respect to the audio) ) Avoiding the situation.
JP 2004-104554 A (page 7-8, FIG. 1)

  However, the conventional transmission system has the following problems. That is, in this transmission system, by delaying the timing of outputting an analog audio signal to the audio output device in accordance with the time length required for the compression processing and decompression processing of digital video data, the video display timing and audio output timing are The structure which synchronizes is employ | adopted. On the other hand, today, for example, by DLNA (Digital Living Network Alliance), a playback device, a display device, an audio output device, and the like are connected to each other via a network, and digital video data and digital audio data are transmitted and received between the devices for playback. A form has been proposed. In this case, in the configuration in which digital data is transmitted and received between the devices via the network, the time required for transmitting and receiving the digital data between the devices differs depending on the network environment (device installation environment). In addition, network traffic changes depending on the network usage state, etc., and due to this point, the time required for transmission / reception of digital data between devices may change.

  Accordingly, the configuration of the conventional transmission system in which the delay time is defined as one time length according to the time required for the compression processing and the decompression processing is used to transmit digital audio data to the audio output device via the network. If the time required for digital audio data transmission / reception changes due to differences in network environment or changes in network traffic, the video display timing and audio output timing may become asynchronous. . Specifically, for example, when the network traffic deteriorates, it takes a longer time to complete the reception of the digital audio data by the audio output device than when the network traffic is good. This causes a situation where the audio output timing is delayed. In this way, when video / audio data is reproduced by adopting the configuration of a conventional transmission system in an environment where each device is connected to a network, it is difficult to synchronize the video display timing and the audio output timing. There is a problem.

  The present invention has been made in view of such problems, and reproduction that can reliably synchronize the audio output timing based on the audio data output to the audio output device via the network and the video display timing of the display unit. A main object is to provide a control device, a display device, and a playback system.

  In order to achieve the above object, a playback control device according to the present invention includes a data generation unit that generates a pair of playback video data and playback audio data to be played back synchronously based on video and audio data, and a network. A data output unit for outputting the reproduction audio data to an audio output device; and outputting the reproduction video data to the display unit to display a video based on the reproduction video data and controlling the data output unit. A control unit that outputs the reproduction audio data; and a sound collection unit that collects audio, and the control unit controls the data output unit to output predetermined audio data to the audio output device. The display unit of the video based on the video data for reproduction according to the time length from the time point to the time when the sound based on the predetermined audio data is collected by the sound collecting unit. Changing at least one of the output timing of the reproduced audio data by the data output unit and the display timing. Note that the “speech” in this specification includes not only sounds emitted from the generated trachea in the human body but also various “sounds” such as bird calls, wind sounds and music.

  According to this playback control device, the control unit controls the video display timing and the playback audio data according to the length of time from when the predetermined audio data is output to when the audio based on the predetermined audio data is collected. Unlike conventional transmission systems in which the delay time for outputting digital audio data is defined as one time length by changing at least one of the output timings of, for example, due to differences in network environments Even when the time length from the time when the audio data for playback is output to the time when the audio corresponding to the audio data for playback is output differs, depending on the delay time of the audio output under the network environment Change video display timing and playback audio data output timing to change video display timing and audio output timing It is possible to reliably synchronize and. In addition, since it is possible to communicate with a very general protocol such as http or ftp without communicating with a reproduction control device and an audio output device using a special protocol having a time control function, for example, it is extremely common. A general-purpose network adapter can be used to configure the data output unit, and the playback control device and the audio output device can be configured at low cost.

  Further, in the reproduction control apparatus according to the present invention, the control unit controls the data output unit to output the reproduction audio data as the predetermined audio data, and the sound collected by the sound collection unit Corresponding to the audio data for comparison from the time when the audio data for reproduction corresponding to the audio data for comparison is output based on the result of comparing the audio data for comparison and the audio data for reproduction generated based on A first specifying process for specifying a time length until the time when the sound to be collected is collected, and at least one of the display timing of the video and the output timing of the playback audio data according to the specified time length To change.

  According to this reproduction control apparatus, the time length from the time when the control unit outputs the reproduction audio data corresponding to the comparison audio data to the time when the audio corresponding to the comparison audio data is collected is specified. When the digital audio data is output by executing one specific process and changing at least one of the video display timing and the reproduction audio data output timing in accordance with the time length specified by the first specific process Unlike the conventional transmission system in which the delay time is defined as one time length, when the audio / video data is reproduced, the network traffic is changed and the reproduction audio data is output from the time when the reproduction audio data is output. Even if the time length until the audio is output changes, the video display timing and audio data for playback are output according to the change in the time length. And an output timing of the display timing and the audio of the video can be reliably synchronized by changing at least one of the timing.

  Furthermore, the playback control device according to the present invention includes a first storage unit that stores time difference specifying audio data, and the control unit controls the data output unit to specify the time difference specifying data as the predetermined audio data. Based on the result of outputting the audio data and comparing the audio data for time difference identification and the audio data for comparison, the audio for comparison is output from the time when the audio data for time difference identification corresponding to the audio data for comparison is output. Prior to the first specifying process, a second specifying process for specifying a length of time until the sound corresponding to the data is collected is executed prior to the first specifying process. The comparison audio data generated at the time when the time length specified by the second specifying process has elapsed from the time when the output is output is compared with the reproduction audio data.

  In this reproduction control apparatus, the control unit specifies the time length from the time when the time difference specifying sound data corresponding to the comparison sound data is output to the time when the sound corresponding to the comparison sound data is collected. Is generated prior to the first specific process, and at the time when the time length specified by the second specific process elapses from the time when the reproduction audio data is output in the first specific process. The comparison audio data and the reproduction audio data are compared. Therefore, according to this playback control apparatus, from the time when the playback audio data is output during playback of the video / audio data without executing the second specific processing, the time from when the audio corresponding to the playback audio data is output. Unlike the configuration in which the video display timing and the audio output timing are synchronized according to the time length, the video display timing and the audio output timing can be synchronized immediately after the start of reproduction of the video / audio data. Further, by executing the first specific process in parallel with the reproduction process of the video / audio data, the network traffic changes during the reproduction of the video / audio data and the time required for outputting the audio based on the reproduction audio data Is changed, at least one of the video display timing and the playback audio data output timing is changed based on the specified time length specified by the first specifying process to change the video display timing and the audio A state in which the output timing is synchronized can be maintained.

  The reproduction control apparatus according to the present invention further includes a second storage unit that stores the reproduction audio data, and the control unit controls and outputs the data output unit during the first specific processing. The reproduction audio data for a predetermined time of the reproduced audio data that has been played is stored in the second storage unit, and the reproduction audio data stored in the second storage unit is stored in the second storage unit. The audio data for reproduction output from the time point 1 to the second time point is compared with the audio data for comparison, and the audio data for reproduction corresponding to the audio data for comparison is the first time point. When there is no reproduction audio data output from the first time to the second time point, at least one of the first time point and the second time point is different by a predetermined time. Change to change to Run the physical, comparing the audio for the comparison with the output said reproduced audio data between the first time after the change process until the second time after the changing process data.

  In this playback control device, during the first specific processing, the playback audio data for a predetermined time of the output playback audio data is stored in the second storage unit, and the first of the playback audio data is stored. The reproduction audio data output from the time point 1 to the second time point is compared with the comparison audio data, and the reproduction audio data corresponding to the comparison audio data is obtained from the first time point to the second time point. Change processing for changing at least one of the first time point and the second time point to a time point that differs by a predetermined time when it does not exist in the playback audio data output until Then, the reproduction audio data output from the first time after the change processing to the second time after the change processing is compared with the comparison audio data. Therefore, according to this reproduction control apparatus, the reproduction audio data output from the data output unit is all stored in the second storage unit, and all of the audio data is compared with the comparison audio data for comparison. The second storage unit can be configured with a storage element having a small storage capacity, and the first time point and the second time point can be automatically changed to ensure reproduction sound data corresponding to the comparison sound data. Can be detected. Further, when the reproduction audio data corresponding to the comparison audio data does not exist in the reproduction audio data output from the first time point to the second time point, the first time is changed during the change process. By changing both the time point and the second time point to different time points by a predetermined time, the data size (number of data blocks) of the reproduction audio data to be compared in the first specific process is reduced. And can be processed in a short time.

  Furthermore, the playback control device according to the present invention includes a first storage unit that stores time difference specifying audio data, and the control unit controls the data output unit to specify the time difference specifying data as the predetermined audio data. Corresponding to the comparison voice data based on a result of outputting the voice data and comparing the comparison voice data generated based on the voice collected by the sound collection unit and the time difference specifying voice data A second specifying process for specifying the time length from the time when the time difference specifying sound data is output to the time when the sound corresponding to the comparison sound data is collected is executed, and according to the specified time length Then, at least one of the display timing of the video and the output timing of the reproduction audio data is changed.

  According to this reproduction control apparatus, the time length from the time when the control unit outputs the time difference specifying sound data corresponding to the comparison sound data to the time when the sound corresponding to the comparison sound data is collected is specified. By executing the second specific process and changing at least one of the video display timing and the reproduction audio data output timing in accordance with the time length specified by the second specific process, the video / audio data can be reproduced. Based on the delay time (time length) specified by the second specifying process in advance, the video display timing and the audio output timing are determined without executing the first specifying process or the like during the playback process of the video / audio data. Can be synchronized.

  In the playback control apparatus according to the present invention, the control unit changes only the display timing of the video display timing and the playback audio data output timing according to the specified time length.

  According to this playback control apparatus, the control unit changes only the video display timing based on the video data for playback, thereby changing the output timing of the audio data for playback to change the video display timing and the audio output timing. Unlike the synchronized configuration, the video display timing and the audio output timing can be synchronized without interrupting the audio output from the audio output device. Therefore, it is possible to reproduce the video / audio data without recognizing the uncomfortable feeling that the sound is interrupted.

  A display device according to the present invention includes any one of the reproduction control devices described above and the display unit.

  According to this display device, since the playback control device and the display unit are provided, for example, unlike a configuration in which video data for playback is output and displayed on a display unit as an external device, The time length from the time when the video data is output to the display unit to the time when the video based on the playback video data is displayed by the display unit can be sufficiently shortened. Therefore, the time length specified by the first specifying process ( The video can be accurately displayed at the changed display timing without delaying the display of the video based on the playback video data.

  The playback system according to the present invention includes any one of the playback control devices described above, the display unit, and the audio output device.

  According to this playback system, since the playback control device, the display unit, and the audio output device are provided, the video display timing based on the playback video data and the playback video data should be played back in synchronization. The audio / video data D can be reproduced in synchronization with the audio output timing based on the audio data for reproduction.

  Hereinafter, the best mode of a playback control device, a display device, and a playback system according to the present invention will be described with reference to the accompanying drawings. A projector 1 shown in FIG. 1 is an example of a display device in which a playback control device according to the present invention and a display unit according to the present invention are integrated, and includes a content distribution server 2, an audio amplifier 3, and the like via a network N. It is connected to the. Note that illustration and description of various servers such as a DHCP server existing between the projector 1, the content distribution server 2 and the audio amplifier 3 are omitted in order to facilitate understanding of the present invention. Further, as an example, the projector 1 and the audio amplifier 3 are installed in the same room together with a screen for displaying an image by the projector 1. In this case, in this example, the reproduction system according to the present invention is configured by the projector 1, the audio amplifier 3, and the speaker 4 connected to the audio amplifier 3.

  The projector 1 is an example of a display device according to the present invention, and includes a network adapter 11, a video / audio processing unit 12, and a reproduction processing unit 13 in addition to a video display unit 14 corresponding to a normal projector, and a content distribution server. The video based on the video / audio data D output from 2 can be displayed on a screen (not shown). In this case, the video / audio data D is composed of moving image data compliant with MPEG-2 as an example. Further, as will be described later, the projector 1 is configured to be able to output audio data Da1 generated based on the video / audio data D to the audio amplifier 3 via the network N. The network adapter 11 is a device that is connected to the network N and transmits / receives various digital data, and receives video / audio data D, audio data Dc, and the like from the content distribution server 2. The network adapter 11 corresponds to a data output unit in the present invention, and outputs audio data Da1 and the like to the audio amplifier 3 via the network N according to the control of the control unit 28 described later. The video / audio processing unit 12 corresponds to the data generation unit in the present invention, and is based on the video / audio data D (received via the network N) output from the content distribution server 2 and should be reproduced simultaneously in a synchronized manner. Video data Dv and audio data Da are generated and output to the reproduction processing unit 13.

  The reproduction processing unit 13 includes a video data storage unit 21, an audio data storage unit 22, an audio processing unit 23, a buffer 24, a timer 25, a microphone 26, an A / D converter 27, a control unit 28, and a timing data storage unit 29. It has a function of synchronizing the video display timing by the video display unit 14 and the audio output timing by the audio amplifier 3 when reproducing video and audio based on the video / audio data D. The video data storage unit 21 stores video data Dv (an example of playback video data in the present invention) generated by the video / audio processing unit 12 under the control of the control unit 28. The audio data storage unit 22 stores the audio data Da (an example of reproduction audio data in the present invention) generated by the video / audio processing unit 12 according to the control of the control unit 28, and the first storage unit in the present invention. Is stored, and voice data Dc received via the network N (an example of time difference specifying voice data in the present invention) is stored. The audio processing unit 23 generates audio data Da1 based on the audio data Da or the audio data Dc under the control of the control unit 28. In this case, the audio data Da1 is configured based on MP3 (MPEG-1 Audio Layer-III) as an example. Further, instead of the audio data Da1, for example, a configuration in which LPCM audio data Da2 is generated and output may be employed.

  The buffer 24 corresponds to the second storage unit in the present invention, and the audio data (audio data Da1) for a predetermined time out of the audio data Da1 output from the network adapter 11 to the audio amplifier 3 according to the control of the control unit 28. (Hereinafter also referred to as “audio data Da11”). In this case, the projector 1 is set to store the audio data Da11 for 500 ms in the buffer 24 as an example at the start of a timing specifying process 90 (see FIG. 4) described later. The timer 25 measures the time until a predetermined timing comes according to the control of the control unit 28. The microphone 26 corresponds to a sound collecting unit in the present invention, collects sound around the projector 1, generates an audio signal Sa <b> 2, and outputs it to the A / D converter 27. In this case, the microphone 26 is configured as an omnidirectional microphone, for example. The A / D converter 27 performs A / D conversion processing on the audio signal Sa2 output from the microphone 26 to generate audio data Da3 (an example of comparison audio data in the present invention). A configuration in which various filters and amplifiers are disposed between the microphone 26 and the A / D converter 27, and a configuration in which various filters are disposed between the A / D converter 27 and the control unit 28. It can also be adopted. The control unit 28 comprehensively controls each unit of the projector 1. In addition, the control unit 28 constitutes a control unit in the present invention, and executes timing specification processing 60 and 90 and playback processing 70 (see FIGS. 2 to 4), as will be described later. The display timing and the audio output timing are synchronized. The timing data storage unit 29 stores the first reference timing data Dt1 and the second reference timing data Dt2 according to the control of the control unit 28.

  The video display unit 14 is an example of a display unit in the present invention, and includes a buffer 31, a projection mechanism 32, and a display control unit 33. The buffer 31 temporarily stores the video data Dv output from the reproduction processing unit 13. As an example, the projection mechanism 32 includes a lamp drive control unit and an optical engine, and displays various videos based on the video signal Sv output from the display control unit 33 on a screen (not shown). Specifically, the projection mechanism 32 displays various images by optically modulating the projection light from the lamp based on the output video signal Sv and projecting the projection light L onto the screen. In this case, the optical engine includes, for example, a light modulation element (for example, a digital micromirror device or a liquid crystal light valve) and a projection lens (both not shown), and includes a metal halide lamp or a high-pressure mercury lamp. A configuration in which the projection light L is emitted using the lamp as a light source is employed. The lamp drive control unit generates and supplies a lamp drive pulse for lighting the lamp according to the control of the display control unit 33. The display control unit 33 generates a video signal Sv based on the video data Dv, and controls the projection mechanism 32 to display a video based on the video signal Sv. Instead of the video display unit 14 described above, a configuration in which a rear projector with an integrated screen, and various displays such as a liquid crystal display and a plasma display can be employed.

  On the other hand, the content distribution server 2 is a server that distributes various types of video / audio data D via the network N (Internet), and includes a network adapter 41, a storage device 42, and a control device 43. The network adapter 41 is a device connected to the network N, and outputs (distributes) the video / audio data D to the projector 1 or a personal computer (not shown) according to the control of the control device 43 and responds to the request from the projector 1 and the like. Audio data Dc. The storage device 42 stores a plurality of video / audio data D, audio data Dc, and the like output to the projector 1 and the like. The control device 43 controls the network adapter 41 to output the video / audio data D and the audio data Dc stored in the storage device 42 to the projector 1 and the like. In this case, video / audio data D and the like are transmitted and received between the content distribution server 2 and the projector 1 by a standard communication protocol such as http and ftp as an example.

  The audio amplifier 3 outputs an audio signal Sa1 based on the audio data Da1 output from the projector 1 to the speaker 4 to output audio. In this case, in this example, the audio amplifier 3 and the speaker 4 constitute an audio output device according to the present invention. The audio amplifier 3 includes a network adapter 51, a decoder 52, a D / A converter 53, and an amplifier 54. The network adapter 51 is a device that connects the audio amplifier 3 to the network N, and receives the audio data Da1 and the like output from the projector 1. For example, the decoder 52 decodes the MP3 format audio data Da1 to generate LPCM audio data Da2. The D / A converter 53 performs D / A conversion processing on the audio data Da2 generated by the decoder 52 (or the audio data Da2 output from the projector 1) to generate an audio signal Sa1. The amplifier 54 amplifies the audio signal Sa1 and outputs it to the speaker 4. The speaker 4 outputs audio based on the audio signal Sa1 output from the audio amplifier 3.

  Next, the overall operation of the projector 1 will be described with reference to the drawings. When the projector 1 is used, as an example, when the projector 1, the screen, the audio amplifier 3 and the speaker 4 are completely installed, and the projector 1 and the audio amplifier 3 are connected to the network N, the initial setting process of the projector 1 is performed. As one of them, the reference timing for synchronizing the video display timing and the audio output timing at the time of reproduction of the video / audio data D (moving image content) is specified. Specifically, when the setting start is instructed, the control unit 28 starts the timing specifying process 60 (an example of “second specifying process” in the present invention) shown in FIG. In this timing specifying process 60 (hereinafter, also referred to as “specifying process 60”), the control unit 28 first determines whether or not the audio data Dc for timing check is stored in the audio data storage unit 22 (step). 61). At this time, when the audio data Dc is not stored in the audio data storage unit 22, the control unit 28 controls the network adapter 11 to connect to the content distribution server 2 and outputs the audio data Dc from the content distribution server 2. (Send) and store in the voice data storage unit 22 (step 62). Next, the control unit 28 erases (clears) the buffer 24 and resets (initializes) the timer 25 (step 63).

  Subsequently, the control unit 28 starts outputting the audio data Da1 generated based on the audio data Dc to the audio amplifier 3 (step 64). Specifically, the control unit 28 controls the audio processing unit 23 to generate audio data Da1 based on the audio data Dc, and controls the network adapter 11 to output the audio data Da1 to the audio amplifier 3. Further, the control unit 28 controls the timer 25 simultaneously with the start of the output of the audio data Da1 to start timing, and the audio data Da11 for a predetermined time out of the audio data Da1 output from the network adapter 11 is stored in the buffer 24. Remember me. Furthermore, the control unit 28 controls the video display unit 14 to display, for example, a message “Initial setting process in progress. Please wait for a while without making a loud sound” on the screen. In addition, the control unit 28 controls the A / D converter 27 together with the start of outputting the audio data Da1, and generates audio data Da3 based on the sound collected by the microphone 26. At this time, in the audio amplifier 3 that receives the audio data Da1 output from the projector 1, the decoder 52 decodes the audio data Da1 to generate the audio data Da2, and the D / A converter 53 converts the audio data Da2 into the D / D. The audio signal Sa1 is generated by performing the A conversion process, and the amplifier 54 amplifies the audio signal Sa1 and outputs it to the speaker 4. As a result, sound based on the sound data Da1 output from the projector 1 is output from the speaker 4.

  In the projector 1, based on the audio data Da3 output from the A / D converter 27, the control unit 28 monitors whether or not the audio exceeding the predetermined sound pressure is collected by the microphone 26 (step 65). When the audio based on the audio data Da1 is output by the audio amplifier 3 (speaker 4) and the audio exceeding the predetermined sound pressure is collected by the microphone 26, the control unit 28 stores the audio data stored in the buffer 24. Da11 and the audio data Da3 generated by the A / D converter 27 are compared (step 66), and it is determined whether or not the sound pressure pattern corresponds (step 67). At this time, when it is determined that the sound pressure pattern corresponds to the sound pressure pattern of the sound data Da3 output from the A / D converter 27 (that is, the sound output from the speaker 4 by the audio amplifier 3), the control unit 28, from the time when the network adapter 11 is controlled to output the audio data Da1 to the audio amplifier 3 based on the time measurement result by the timer 25, the audio data Da11 ( The time length until the time point when a part of the audio data Da1 is detected is calculated as a delay time for the audio output, and the first reference timing data Dt1 is generated based on the calculation result and stored in the timing data storage unit 29. (Step 68). Thereafter, the control unit 28 ends the specifying process 60 when the output of the audio data Da1 generated based on the audio data Dc is completed (step 69).

  On the other hand, when the video / audio data D (moving image content) distributed by the content distribution server 2 is reproduced, the control unit 28 starts the reproduction processing 70 shown in FIG. 3 when the reproduction start is instructed. In the reproduction process 70, the control unit 28 first determines whether or not the first reference timing data Dt1 is stored in the timing data storage unit 29 (step 71). The specified process 60 is executed. When it is determined that the first reference timing data Dt1 is stored in the timing data storage unit 29, or when the specifying process 60 is completed, the control unit 28 performs the timing specifying process 90 (shown in FIG. 4). An example of “first specific process” in the present invention is started (step 72). In this case, as shown in FIG. 4, the timing specifying process 90 (hereinafter, also referred to as “specifying process 90”) includes the display timing of the video corresponding to the video data Dv generated based on the video / audio data D. This is a process for specifying the reference timing for synchronizing the output timing of the audio corresponding to the audio data Da, and this timing specifying process 90 is executed in parallel with the reproduction process 70 by the control unit 28. The video display timing and the audio output timing of the video / audio data D being reproduced are accurately synchronized, and this state is maintained until the reproduction is completed.

  Specifically, in the specifying process 90, the control unit 28 initializes the timer 25 to start timing, and initializes a parameter for a sound pressure pattern comparison range, which will be described later (step 91). Next, the control unit 28 controls the video / audio processing unit 12 to generate the video data Dv and the audio data Da based on the video / audio data D output from the content distribution server 2, and the audio processing unit 23. Control is performed to generate audio data Da1 based on the audio data Da. At this time, the control unit 28 blocks both the pair of video data Dv and audio data Da1 to be reproduced in synchronism with each other for a predetermined amount of data, and each of the blocked video data Dv and audio data Da1. A time stamp capable of specifying the timing for reproducing the data block is given to each data block (step 92). As a result, the same time stamp is given to the video data Dv and the audio data Da1 (data block) to be reproduced synchronously (to be reproduced simultaneously at the same timing). The video data Dv with the time stamp is output to the video display unit 14 by the control unit 28 and stored in the buffer 31, and the audio data Da1 is output from the network adapter 11 to the audio amplifier 3 via the network N. (Step 73 in the reproduction process 70). Further, the control unit 28 causes the buffer 24 to store the audio data Da11 (data block) for a predetermined time among the audio data Da1 output from the network adapter 11.

  In this case, as an example, the control unit 28 starts storing the audio data Da11 in the buffer 24 from the time when the output of the audio data Da1 is started, and also specifies the first reference specified based on the first reference timing data Dt1. Each time the timing arrives, the audio data Da11 in the buffer 24 is updated to the latest audio data Da11 (another part of the audio data Da1). At this time, the control unit 28 outputs the voice data for 100 ms (data block for 100 ms) before the update time of the voice data Da11 and the voice data for 400 ms (data block for 400 ms) after the update time. The data is stored in the buffer 24 as data Da11. Note that immediately after the start of the specific process 90 (that is, immediately after the start of output of the audio data Da1 to the audio amplifier 3), as shown in FIG. 5, only the audio data for 400 ms from the start of output of the audio data Da1 is the audio data. It is stored in the buffer 24 as Da11. In addition, after the time when the first reference timing has arrived, for example, as shown in FIG. 6, for example, 100 ms of audio data before the arrival of the first reference timing and 400 ms after the arrival of the first reference timing. Are stored in the buffer 24 as audio data Da11.

  On the other hand, when the control unit 28 determines in the reproduction process 70 that the first reference timing has arrived based on the first reference timing data Dt1 stored in the timing data storage unit 29 and the time measurement result by the timer 25, that is, When the time length equal to the time length from when the sound corresponding to the audio data Da1 is collected by the microphone 26 from the output start time of the audio data Da1 corresponding to the audio data Dc in the specific process 60 described above has elapsed. (Step 74), the video display unit 14 is controlled to start displaying the video corresponding to the video data Dv stored in the buffer 31 (the “display timing by the video display unit based on the video data for reproduction” is changed) An example of this: Step 75). At this time, in the video display unit 14, the display control unit 33 reads the video data Dv from the buffer 31 under the control of the control unit 28 to generate the video signal Sv, and outputs the generated video signal Sv to the projection mechanism 32. In response to this, the projection mechanism 32 emits projection light L for projecting an image based on the image signal Sv toward the screen. Thereby, the video based on the video data Dv (video signal Sv) is displayed on the screen.

  In addition, in the specific process 90, the control unit 28 is predetermined earlier than the first reference timing by an allowable time described later based on the first reference timing data Dt1 stored in the timing data storage unit 29 and the time measurement result by the timer 25. Is determined (step 93), the A / D converter 27 is controlled to start generating the audio data Da3 based on the sound collected by the microphone 26. In this case, in the specific process 60 described above, from the output time point of the sound data Da1 corresponding to the sound data Dc to the time point when the sound corresponding to the sound data Da1 is collected by the microphone 26 (based on the collected sound). A delay of a time length corresponding to the first reference timing data Dt1 occurs until the audio data Da3 is generated). Accordingly, the time length corresponding to the first reference timing data Dt1 is also from the time when the sound data Da1 corresponding to the sound data Da is output until the time when the sound corresponding to the sound data Da1 is collected by the microphone 26. An equal or approximately equal time delay will occur.

  Therefore, in the specific process 90, when the generation of the audio data Da3 by the A / D converter 27 is started immediately after the output of the audio data Da1 based on the audio data Da is started, the first reference corresponding to the first reference timing data Dt1. Silent audio data Da3 (audio data Da3 not including audio corresponding to the audio data Da1) is generated until the timing arrives. Furthermore, due to a change in network traffic, audio may be output at a timing slightly different from the first reference timing corresponding to the first reference timing data Dt1. Therefore, in the projector 1, a variation allowable range of ± 100 ms is defined for the first reference timing corresponding to the first reference timing data Dt1, and the first corresponding to the first reference timing data Dt1 is specified in the specifying process 90. After waiting until a timing 100 ms earlier than the reference timing arrives (step 93), the A / D converter 27 is controlled to start generating the audio data Da3. As a result, it is assumed that the comparison processing (processing in step 95 described later) for the silent audio data Da3 is unnecessary, and that the audio corresponding to the audio data Da1 is output at a slightly early timing due to a change in network traffic. However, the sound can be collected by the microphone 26 to generate the sound data Da3.

  Next, the control unit 28 monitors whether or not a sound exceeding a predetermined sound pressure is collected by the microphone 26 based on the sound data Da3 output from the A / D converter 27 (step 94). At this time, when sound based on the sound data Da1 is output by the audio amplifier 3 (speaker 4), sound exceeding a predetermined sound pressure is collected by the microphone 26 and the corresponding sound data Da3 is A / D. It is generated by the converter 27. In response to this, the control unit 28 compares the audio data Da11 (part of the audio data Da1) stored in the buffer 24 with the audio data Da3 generated by the A / D converter 27 (step 95). It is determined whether or not the sound pressure pattern corresponds (step 96). Specifically, as shown in FIG. 5, the control unit 28 sets a time point t0 (first time point in the present invention) of the audio data Da11 for 400 ms from the output start time point (time point t0) of the audio data Da1. The audio data Da11 (data block) for 100 ms from the time point t2 to the time point t2 (second time point in the present invention) is set as a comparison range, and the sound pressure pattern corresponding to the sound pressure pattern of the audio data Da3 is included in the comparison range. It is determined whether or not data Da11 (data block) exists.

  At this time, when the sound data Da11 having the sound pressure pattern corresponding to the sound pressure pattern of the sound data Da3 output from the A / D converter 27 (that is, the sound output from the speaker 4 by the audio amplifier 3) is detected, The control unit 28 calculates the time length (delay time) required for reproducing the audio data Da1 based on the audio data Da (outputting the audio corresponding to the audio data Da1). Specifically, the control unit 28 specifies the sound data Da11 (data block) having a sound pressure pattern corresponding to the sound pressure pattern of the sound data Da3, so that the first reference timing data from the output start time of the sound data Da1. The audio data Da3 corresponding to the sound collected by the microphone 26 at the time when the delay time corresponding to Dt1 has elapsed becomes the audio data Da1 (audio data Da11: data block) output from the network adapter 11 at any time. Specify whether the corresponding voice. Further, the control unit 28 generates the second reference timing data Dt2 based on the time measurement result by the timer 25 and the time stamp given to the specified audio data Da11 (data block), and stores it in the timing data storage unit 29. (Step 97).

  On the other hand, after starting the reproduction of the video data Dv in the reproduction process 70 (step 75), the control unit 28 determines whether or not the second reference timing data Dt2 is stored in the timing data storage unit 29 (step 75). Step 76). At this time, when the second reference timing data Dt2 is not stored in the timing data storage unit 29 (when the generation of the second reference timing data Dt2 by the specifying process 90 is not completed), the control unit 28 It is determined whether or not the reproduction of the video / audio data D has been completed (step 77). If the reproduction has not been completed, whether or not the second reference timing data Dt2 is stored in the timing data storage unit 29 (second reference timing). It is determined again whether or not the storage of the data Dt2 has been completed (step 76). When the generation process of the second reference timing data Dt2 is completed in the specifying process 90 and stored in the timing data storage unit 29, the first reference timing specified based on the first reference timing data Dt1, The temporal speed is compared with the second reference timing specified based on the second reference timing data Dt2.

  At this time, when the first reference timing is earlier than the second reference timing, that is, from the output start point of the audio data Da1 corresponding to the audio data Dc in the above-described specific processing 60, the audio corresponding to the audio data Da1 is received. The audio corresponding to the audio data Da1 is output from the output start time of the audio data Da1 corresponding to the audio data Da generated based on the video / audio data D than the delay time required until the output. When the delay time required until the time is longer (step 78), the control unit 28 outputs the video data Dv to the video display unit 14 for a predetermined time (for example, the first reference timing and the second reference timing). (Time difference) is stopped (step 79). As a result, for example, even if the network traffic is good and the time required from the output of the audio data Da1 to the output of the corresponding audio is longer than when the specifying process 60 is executed, the network traffic is generated based on the video / audio data D. The video display timing corresponding to the video data Dv and the audio output timing corresponding to the audio data Da (audio data Da to be reproduced in synchronization with the video data Dv) generated based on the same video / audio data D And are synchronized.

  On the other hand, when the first reference timing is later than the second reference timing, that is, from the output start time of the audio data Da1 corresponding to the audio data Dc in the above-described specific processing 60, the audio corresponding to the audio data Da1. The time required from the start of output of the audio data Da1 corresponding to the audio data Da generated based on the audio / video data D to the time when the corresponding audio is output is longer than the delay time required until the When the delay time is shorter (step 80), the control unit 28 outputs the video data Dv output to the video display unit 14 for a predetermined time (for example, a first reference timing and a second reference timing). (Time difference) is skipped (step 81). As a result, for example, even if the time required from the output of the audio data Da1 to the output of the corresponding audio becomes shorter than the execution time of the specifying process 60 due to the deterioration of the network traffic, it is generated based on the video / audio data D. The video display timing corresponding to the video data Dv and the audio output timing corresponding to the audio data Da generated based on the same video / audio data D are synchronized.

  On the other hand, the control unit 28 determines each sound of the audio data Da11 (data block: see FIG. 6) output from the time t1a to the time t2a among the audio data Da11 stored in the buffer 24 in the specifying process 90. When it is determined that the pressure pattern does not correspond to the sound pressure pattern of the sound data Da3 generated by the A / D converter 27 (step 96), a comparison range (stored in the buffer 24) to be compared with the sound data Da3. Parameter of which one of the audio data Da11 to be compared is to be compared) (change process in the present invention: step 99). Specifically, the control unit 28 includes a time point t1a (first time point) and a time point t2a (second time point) in the comparison range (comparison range illustrated in FIG. 6) in which the sound data Da11 having the corresponding sound pressure pattern does not exist. (Time point) is changed to a time point 25 ms later (an example of “a time point that differs by a predetermined time” in the present invention), and a time point t1b (first time after the change process) is changed as shown in FIG. Corresponding to the audio data Da1 output within the range of 200 ms from the time point to the time point t2b (second time point after the change process) (75 ms before the first reference timing and 125 ms after the first reference timing). The audio data Da11 to be performed is defined as a new comparison range. In order to avoid a situation in which the comparison range is excessively expanded by the change process, it is preferable to change both the time point t1a (first time point) and the time point t2a (second time point) by the same time, but the time point t1a It is also possible to adopt a configuration in which only one of (first time) and time t2a (second time) is changed.

  Next, the control unit 28 determines whether or not the comparison process (the process of step 95 described above) targeting the newly defined comparison range is possible (step 100). Specifically, the control unit 28 determines whether or not the audio data Da11 corresponding to the comparison range can be stored in the buffer 24, that is, the newly defined time t2b arrives within 400 ms after the first reference timing. It is determined whether or not to do so. At this time, when it is determined that the comparison process for the newly specified comparison range is possible, the control unit 28 displays video and outputs audio based on the video / audio data D (video / audio data D). It is determined whether or not (reproduction) has been completed (step 98). When it is determined that reproduction has not been completed, time stamps are given to the video data Dv and the audio data Da1 (step 92), and the steps after step 93 are performed. Execute the process.

  In addition, in the state where the comparison range changing process in step 99 is executed a plurality of times, the voice data (voice data Da11) for 200 ms from 200 ms to 400 ms after the first reference timing is set as the comparison range. When the sound data Da11 having a sound pressure pattern corresponding to the sound pressure pattern of the sound data Da3 does not exist within the comparison range, the control unit 28 determines that the comparison process in step 95 is impossible (step 95). 100). At this time, the control unit 28 increases the data amount (buffer size) of the audio data Da11 stored in the buffer 24 (step 101). Specifically, the control unit 28 first corresponds to the audio data Da1 for 200 ms from 200 ms to 400 ms after the first reference timing (an example of “from the first time point to the second time point” in the present invention). When the audio data Da11 having the corresponding sound pressure pattern is not detected in the state where the audio data Da11 to be compared is in the comparison range (step 96), 425 ms (from time t1c shown in FIG. 8) after 225 ms (first time). A range of 200 ms up to the time point t2c) shown in FIG. 8 (an example of “from the first time point after the change process to the second time point after the change process” in the present invention) is defined as a new comparison range (step 99). Next, as shown in FIG. 8, the control unit 28 increases the buffer size by 100 ms, and the audio data for 100 ms before the first reference timing and the audio data for 500 ms after the first reference timing are obtained. It is defined that the audio data for a total of 600 ms is stored in the buffer 24 as audio data Da11 (data block) (step 101). As described above, when it is determined that the comparison process for the new comparison range is impossible, the control unit 28 increases the buffer size so that the audio data Da11 for 1000 ms at maximum is stored in the buffer 24. (Step 101).

  On the other hand, when the audio data Da11 having the corresponding sound pressure pattern is not detected and the buffer size is increased to the upper limit by increasing the buffer size (in this example, it is defined that the audio data Da11 for 1000 ms is stored. State: Step 102), the control unit 28 initializes the parameter and buffer size for the comparison range described above, and corrects the first reference timing data Dt1 to an earlier timing by 500 ms as an example (Step 103). As a result, when the next first reference timing arrives (that is, when a timing 500 ms earlier than the first reference timing before the correction has arrived), the time before the first reference timing before the correction is 600 ms before the correction. The audio data Da11 for 500 ms up to the point of 100 ms before the first reference timing is stored in the buffer 24.

  As described above, after the comparison range is changed (step 99), the buffer size is enlarged (step 101), and the first reference timing is corrected (step 103), a series of processes from step 92 onward is executed to obtain the audio data. When it is determined that the sound data Da11 of the sound pressure pattern corresponding to the sound pressure pattern of Da3 is stored in the buffer 24 (step 96), the control unit 28 generates the second reference timing data Dt2 as described above. Then, it is stored in the timing data storage unit 29 (step 97). As a result, the first reference timing corresponding to the first reference timing data Dt1 is compared with the second reference timing corresponding to the second reference timing data Dt2 in steps 78 and 80 of the reproduction process 70, and the second reference timing corresponding to the second reference timing data Dt2 is compared. The output timing of the video data Dv (video display timing based on the video data Dv) is changed. As a result, the audio output timing corresponding to the video data Dv (audio data Da1) and the video display timing corresponding to the video data Dv are synchronized.

  Further, in the reproduction process 70, the control unit 28 stops the output of the video data Dv (step 79), skips the video data Dv to be output (step 81), and the first reference timing is the second reference timing. It is determined whether or not video display and audio output based on the video / audio data D (reproduction of the video / audio data D) has been completed at any point in time (step 77). ). At this time, if it is determined that the reproduction is not completed, the control unit 28 determines whether or not the new second reference timing data Dt2 is stored in the timing data storage unit 29 (the new second reference timing data Dt2 Whether the storage is completed is monitored (step 76). When it is determined that the reproduction of the video / audio data D has been completed (step 77), the control unit 28 ends the reproduction process 70.

  Thus, according to the projector 1, the sound based on the predetermined sound data is collected from the time when the predetermined sound data (in this example, the sound data Da1 corresponding to the sound data Dc, Da) is output. Display timing by the video display unit 14 of the video based on the video data Dv by the control unit 28 according to the time length until the time (the time when the audio data Da11 of the sound pressure pattern corresponding to the sound pressure pattern of the audio data Da3 is detected) Unlike the conventional transmission system in which the delay time when outputting digital audio data is defined as one time length, for example, the audio data Da1 is output due to a difference in the network environment. Even when the time length from the time point to the time point when the sound corresponding to the sound data Da1 is output is different, the network And an output timing of the display timing and the audio of the video can be reliably synchronized by changing the display timing of the video based on the video data Dv in accordance with the delay time of the audio output at the border under. Further, since communication is possible between the projector 1 and the audio amplifier 3 by using a very general protocol such as http or ftp without using a special protocol having a time control function, for example, it is extremely common. The projector 1 and the audio amplifier 3 can be configured at low cost using the general-purpose network adapters 11 and 51.

  In the projector 1, the control unit 28 corresponds to the audio data Da3 from the time when the time difference specifying audio data (in this example, the audio data Da1 generated based on the audio data Dc) corresponding to the audio data Da3 is output. The timing specifying process 60 for specifying the length of time until the sound is collected is executed, and in step 95 of the timing specifying process 90, the playback audio data (in this example, the audio data Da1 generated based on the audio data Da1) is executed. ) Is generated at the time when the time length specified by the timing specification processing 60 has elapsed from the time of output (in this example, when the first reference timing specified based on the first reference timing data Dt1 has arrived) The audio data Da3 is compared with the reproduction audio data. Therefore, according to the projector 1, the audio data is reproduced when the video / audio data D is reproduced without executing the specifying process 60 (without executing the process of specifying the reference timing for generating the first reference timing data Dt1). Unlike the configuration in which the video display timing and the audio output timing are synchronized according to the length of time from when the audio data Da1 corresponding to Da is output to when the audio corresponding to the audio data Da1 is output, Immediately after the start of reproduction of the audio data D, the video display timing and the audio output timing can be synchronized. Moreover, even if the time required for outputting the audio based on the audio data Da1 is changed by executing the specifying process 90 in parallel with the reproduction process 70, for example, the network traffic changes during the reproduction of the video / audio data D. The video display timing corresponding to the video data Dv is sequentially changed based on the second reference timing data Dt2 generated by the specifying process 90 to maintain a state in which the video display timing and the audio output timing are synchronized. be able to.

  Further, in the projector 1, reproduction audio data (audio data, for example, for 500 ms) of the output reproduction audio data (in this example, audio data Da1 generated based on the audio data Da). Da11) is stored in the buffer 24, and in the timing specifying process 90, the first time (for example, time t1a) to the second time (for example, time t2a) of the reproduction audio data stored in the buffer 24 is stored. Audio data Da3 is compared with the audio data for reproduction output before and the audio data for reproduction corresponding to the audio data Da3 is output between the first time point and the second time point. A time point after the first time point and the second time point by a predetermined time (25 ms in this example) when there is no data in the data Reproduction audio data and audio output between the first time after the change processing (time t1b in this example) and the second time after the change processing (time t2b in this example) The data Da3 is compared. Therefore, according to the projector 1, unlike the configuration in which all of the audio data Da1 output from the network adapter 11 is stored in the buffer 24 as the audio data Da11 and compared with the audio data Da3 as a comparison target, the amount of storage is small. The buffer 24 can be configured with a storage element having a capacity, and the reproduction time data corresponding to the sound data Da3 can be reliably detected by automatically changing the first time point and the second time point. Further, when the reproduction audio data corresponding to the audio data Da3 does not exist in the reproduction audio data output from the first time point to the second time point, the first change process performs the first time. The audio data Da11 to be compared in step 95 of the specifying process 90 is changed by changing each of the time point of the second time point and the second time point to a time point that is different by a predetermined time (in this example, a later time point). Can be processed in a short time with a reduced data size (number of data blocks).

  Further, according to the projector 1, by changing only the video display timing based on the video data Dv, the output timing of the audio data Da1 based on the audio data Da is changed to change the video display timing and the audio output timing. Unlike the configuration of synchronizing the video, the video display timing and the audio output timing can be synchronized without interrupting the audio output from the audio amplifier 3 (speaker 4). Therefore, it is possible to reproduce the video / audio data D without recognizing the uncomfortable feeling that the sound is interrupted.

  Further, according to the projector 1, since the playback control device according to the present invention and the display unit according to the present invention are integrally configured, for example, the video data Dv is output to the display unit as an external device. Unlike the configuration in which the video is displayed, the time length from when the video data Dv is output to the video display unit 14 to when the video based on the video data Dv is displayed can be sufficiently shortened. Based on the time length (delay time) specified by the above, the video can be accurately displayed at the changed display timing without delaying the display of the video based on the video data Dv.

  The reproduction system according to the present invention includes the projector 1 (the reproduction control device according to the present invention and the display unit according to the present invention), the audio amplifier 3 and the speaker 4 (the audio output device according to the sound invention). Thus, the video / audio data D can be reproduced by synchronizing the video display timing based on the video data Dv and the audio output timing based on the audio data Da to be reproduced in synchronization with the video data Dv. .

  In addition, this invention is not limited to said structure. For example, in the projector 1 described above, after executing the specifying process 60 as one of the initial setting processes of the projector 1, the reproduction process 70 and the specifying process 90 are performed using the first reference timing data Dt1 generated by the specifying process 60. The processing for specifying the reference timing for synchronizing the video display timing and the audio output timing (the same processing as the above-described specific processing 60 and 90) is employed. For example, it is possible to adopt a configuration that is executed only at one of the initial setting of the projector 1 and the reproduction of the video / audio data D. Specifically, the video display timing and the audio output timing are synchronized by executing the reproduction process 110 shown in FIG. 9 without executing the specifying process 60 and instead of the reproduction process 70 described above. Can do.

  In the reproduction process 110, when the reproduction of the video / audio data D is instructed, first, the above-described specifying process 90 is started (step 111). In this case, in the specific process 90 executed in parallel with the reproduction process 110, the other steps are executed in the same manner as described above without executing the standby until the timing comes in step 93. Therefore, the description about this specific process 90 is abbreviate | omitted. Next, the control unit 28 starts outputting the audio data Da1 based on the audio data Da to the audio amplifier 3 (step 112), and also starts the reproduction of the video data Dv by the video display unit 14 (step 113). Subsequently, the control unit 28 determines whether or not the second reference timing data Dt2 is stored in the timing data storage unit 29 (step 114). At this time, when the storage of the second reference timing data Dt2 is not completed, the control unit 28 determines whether or not the reproduction of the video / audio data D is completed (step 115), and the reproduction is not completed. Sometimes, it is determined whether or not the second reference timing data Dt2 is stored (step 114). Further, when the second reference timing data Dt2 is generated and stored in the timing data storage unit 29 by the specific processing 90 executed in parallel, the control unit 28 is generated (timing data storage unit 29 Whether or not the second reference timing based on the second reference timing data Dt2 has changed (step 116). If no change has occurred, whether or not the reproduction of the video / audio data D has been completed is determined. (Step 115), it is determined whether or not new second reference timing data Dt2 has been stored (step 114).

  On the other hand, when a change occurs in the second reference timing (step 116), the control unit 28 determines whether or not a delay occurs in the second reference timing (step 117). At this time, if there is a delay, the output of the video data Dv to the video display unit 14 is temporarily stopped for a predetermined time (for the time for which the second reference timing is delayed) (step 118). Thereby, the video display timing and the audio output timing are synchronized. When the second reference timing is advanced (step 117), the control unit 28 skips the output of the video data Dv to the video display unit 14 by a predetermined time (by the amount by which the second reference timing is advanced) ( Step 119). Thereby, the video display timing and the audio output timing are synchronized. Thereafter, the control unit 28 determines whether or not the reproduction of the video / audio data D is completed (step 115), and ends the reproduction processing 110 when the reproduction is completed.

  As described above, according to the projector 1 that executes the reproduction process 110 instead of the reproduction process 70, the control unit 28 reproduces audio data corresponding to the audio data Da3 (in this example, audio data generated based on the audio data Da). The timing specifying process 90 for specifying the time length from the time when Da1) is output to the time when the sound corresponding to the audio data Da3 is collected is executed, and the time length specified by the timing specifying process 90 (in this example, By changing the display timing of the video based on the video data Dv by the video display unit 14 according to the second reference timing data Dt2), the delay time when outputting the digital audio data is defined as one time length. Unlike the conventional transmission system, the network traffic changes when the audio / video data D is played, and the audio data Even if the time length from the time when a1 is output to the time when the sound corresponding to the audio data Da1 is changed, the display timing of the video based on the video data Dv is changed according to the change in the time length. The video display timing and the audio output timing can be reliably synchronized.

  Further, instead of the above-described reproduction processes 70 and 110, it is possible to adopt a configuration in which the reproduction process 120 shown in FIG. 10 is executed to synchronize the video display timing and the audio output timing based on the video / audio data D. it can. In this reproduction process 120, when the reproduction start of the video / audio data D is instructed, the control unit 28 determines whether or not the first reference timing data Dt1 is stored in the timing data storage unit 29 (step 121). . In addition, when the first reference timing data Dt1 is not stored, the control unit 28 executes the specifying process 60 described above. As a result, the first reference timing data Dt1 for the first reference timing specified using the check audio data Dc is stored in the timing data storage unit 29. Next, the control unit 28 controls the network adapter 11 to start outputting the audio data Da1 generated based on the audio data Da to the audio amplifier 3 (step 122), and causes the first reference timing data Dt1 to be output. It waits until the first reference timing specified based on it arrives (step 123). When the first reference timing has arrived, the control unit 28 starts reproduction of the video data Dv generated based on the video / audio data D by the video display unit 14 (step 124). As a result, the display of the video based on the video data Dv is delayed by the delay time specified by the specifying process 60, so that the audio output timing based on the audio data Da1 and the video display timing by the video display unit 14 are synchronized. To do. Thereafter, when the reproduction of the video / audio data D is completed (step 125), the control unit 28 ends the reproduction processing 120.

  Thus, according to the projector 1 that executes the reproduction process 120 instead of the reproduction processes 70 and 110, the control unit 28 generates the time difference specifying audio data corresponding to the audio data Da3 (in this example, generated based on the audio data Dc). The timing specifying process 60 for specifying the time length from the time when the audio data Da1) is output to the time when the sound corresponding to the audio data Da3 is collected is executed, and the time length specified by the timing specifying process 60 ( In this example, the delay specified by the specifying process 60 prior to the reproduction of the video / audio data D by changing the display timing of the video based on the video data Dv by the video display unit 14 according to the first reference timing data Dt1). Based on the time (first reference timing data Dt1), the specific process 9 is performed during the reproduction process of the video / audio data D. Without executing or the like, it is possible to synchronize the output timing of the display timing and audio images.

  Further, the projector 1 described above changes only the video display timing based on the video data Dv according to the time length (delay time) from the output time of the audio data Da1 to the corresponding audio output time. Although a configuration is adopted in which the display timing and the audio output timing are synchronized, the present invention is not limited to this. For example, it is possible to employ a configuration in which the video display timing and the audio output timing are synchronized by skipping and outputting the audio data Da1 by the delay time. In addition, the video display timing and the audio output timing are synchronized by changing both the video display timing based on the video data Dv and the output timing of the audio data Da1 to the audio amplifier 3. You can also. Even when these configurations are adopted, similarly to the projector 1 described above, the video display timing and the audio output timing are reliably synchronized without being affected by the difference in the network environment or the change in the network traffic. be able to.

  Moreover, although the example which performs the specific process 60 in the state which installation of the projector 1 was completed was demonstrated, the execution timing of the specific process 60 is not limited at the time of an initial setting process, For example, when the power supply of the projector 1 is turned on, a user Can be adopted to execute at an arbitrary timing designated by. Furthermore, when the output of the audio data Da1 is started in the specifying process 60 (step 64), a configuration is adopted in which a predetermined message is displayed on the video display unit 14, but instead of the message, for example, an advertisement video or relaxation Various images such as images can also be displayed. Moreover, although the example which mounted the reproduction | regeneration control apparatus based on this invention in the projector 1 was replaced with the projection mechanism 32, various displays, such as a liquid crystal display, a plasma display, an organic electroluminescence display, and CRT, were provided. The reproduction control device according to the present invention can be mounted on the display device. Furthermore, the present invention is not limited to a configuration in which a playback control device is mounted on a display device, and a configuration in which a video signal Sv is output to a display device as an external device to display a video can be employed. In this case, for example, even in a state where the audio output device and the display device are installed far away as in an outdoor advertisement display system, the display timing of the video can be obtained by using the playback control device according to the present invention. The sound output timing can be reliably synchronized.

  Furthermore, the example of reproducing the video / audio data D acquired from the content distribution server 2 has been described. However, the video / audio data in the present invention is not limited to the moving image content acquired via the network N, and may be various types such as a DVD player. This includes video / audio data D output from the playback apparatus, video / audio data D received via a tuner, and the like. Also, the time difference specifying audio data (audio data Dc) in the present invention is not limited to the data acquired from the content distribution server 2 or the like, but uses audio data stored in advance in the reproduction control apparatus according to the present invention. A configuration can be employed.

1 is a configuration diagram showing a configuration of a projector 1. FIG. 5 is a flowchart of timing specifying processing 60. 10 is a flowchart of a reproduction process 70. 10 is a flowchart of timing specifying processing 90; 4 is a conceptual diagram of audio data Da11 stored in a buffer 24. FIG. It is another conceptual diagram of the audio data Da11 stored in the buffer 24. FIG. 14 is still another conceptual diagram of the audio data Da11 stored in the buffer 24. FIG. 14 is still another conceptual diagram of the audio data Da11 stored in the buffer 24. 10 is a flowchart of a reproduction process 110. 10 is a flowchart of a reproduction process 120.

Explanation of symbols

  1 projector, 3 audio amplifier, 4 speaker, 11 network adapter, 12 video / audio processing unit, 13 playback processing unit, 14 video display unit, 23 audio processing unit, 24 buffer, 25 timer, 26 microphone, 27 A / D converter, 28 control unit, 29 timing data storage unit, 60, 90 timing specifying process, 70, 110, 120 reproduction process, D video / audio data, Da, Da1 to Da3, Da11, Dc audio data, Dt1 first reference timing data, Dt2 Second reference timing data, Dv video data, N network, Sa1, Sa2 audio signal, Sv video signal, t0, t2, t1a, t2a, t1b, t2b, t1b, t2b

Claims (8)

A data generation unit that generates a pair of reproduction video data and reproduction audio data to be reproduced in synchronization based on the video / audio data, and a data output unit that outputs the reproduction audio data to an audio output device via a network And a controller for outputting the playback video data to the display unit and controlling the data output unit to output the playback audio data to display video based on the playback video data; And a sound collecting part
The control unit controls the data output unit to output a predetermined audio data from the audio output device to a time from when the sound based on the predetermined audio data is collected by the sound collection unit. A playback control device that changes at least one of a display timing of the video based on the playback video data by the display unit and an output timing of the playback audio data by the data output unit according to the length.   The control unit controls the data output unit to output the reproduction audio data as the predetermined audio data, and the comparison audio data generated based on the audio collected by the sound collection unit; Based on the result of comparison with the audio data for reproduction, the time from when the audio data for reproduction corresponding to the audio data for comparison is output to the time when the audio corresponding to the audio data for comparison is collected The playback control apparatus according to claim 1, wherein a first specifying process for specifying a length is executed, and at least one of the display timing of the video and the output timing of the playback audio data is changed according to the specified time length. . A first storage unit for storing time difference specifying voice data;
The control unit controls the data output unit to output the time difference specifying sound data as the predetermined sound data, and based on a result of comparing the time difference specifying sound data and the comparison sound data, A second specifying process for specifying a length of time from when the time difference specifying sound data corresponding to the comparison sound data is output to when the sound corresponding to the comparison sound data is collected; The comparison generated at the time when the time specified by the second specific process has elapsed from the time when the reproduction audio data was output at the time of the first specific process. The reproduction control apparatus according to claim 2, wherein the audio data for reproduction is compared with the audio data for reproduction. A second storage unit for storing the reproduction audio data;
The control unit controls the data output unit to output the reproduction audio data for a predetermined time in the second storage unit during the first specific process. The reproduction audio data output from the first time point to the second time point of the reproduction sound data stored in the second storage unit and the comparison sound data, And when the reproduction audio data corresponding to the comparison audio data does not exist in the reproduction audio data output from the first time point to the second time point, A change process for changing at least one of the first time point and the second time point to a time point that differs by a predetermined time is executed, and after the change process from the first time point after the change process Until the second time point Playback control apparatus according to claim 2 or 3 wherein the output has been the reproduced audio data is compared with the comparison audio data. A first storage unit for storing time difference specifying voice data;
The control unit controls the data output unit to output the time difference specifying audio data as the predetermined audio data, and the comparison audio data generated based on the audio collected by the sound collection unit And when the sound corresponding to the comparison sound data is collected from the time when the time difference specifying sound data corresponding to the comparison sound data is output based on the result of comparing the time difference specifying sound data with the time difference specifying sound data 2. The second specifying process of specifying a time length until the time is performed, and at least one of the display timing of the video and the output timing of the reproduction audio data is changed according to the specified time length. Playback control device.   The reproduction control according to any one of claims 1 to 5, wherein the control unit changes only the display timing of the display timing of the video and the output timing of the audio data for reproduction according to the specified time length. apparatus.   A display device comprising the reproduction control device according to claim 1 and the display unit.   A playback system comprising the playback control device according to claim 1, the display unit, and the audio output device.

Images