JP2019208117A - Video and audio reproduction device - Google Patents

Abstract

To quickly synchronize an internal video and an external audio.SOLUTION: When a device state, which is the state of a video and audio reproduction device 100, relating to at least the output of an internal video is changed, a delay calculation unit 50 calculates a delay time ExD. In accordance with the calculation of the delay time ExD, the video and audio reproduction device 100 uses the delay time ExD to synchronize the internal video output from the video and audio reproduction device 100 and the external audio output from an external device 200.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a video / audio reproduction apparatus that performs processing for synchronizing video and audio.

  A playback device that plays back (outputs) video and audio performs synchronization control so that the viewer does not feel uncomfortable in the playback of video and audio. The playback device is, for example, a television. The television is, for example, a television compliant with a digital broadcasting standard.

  On the other hand, in recent years, a reproduction apparatus having a function of reproducing video and audio outputs video or audio to an external device, and the external device reproduces video or audio. For example, the video is reproduced by a television, and the audio is output (reproduced) by an external speaker connected to the television as an external device.

  However, in such a form, since the processing time required for audio reproduction in the external device is unknown, the video and audio are not synchronized, and the viewer may feel uncomfortable.

  Patent Document 1 discloses a configuration for solving the above problem (hereinafter also referred to as “related configuration A”). In the related configuration A, a synchronization-dedicated mode (adjustment mode) for setting a delay amount for synchronizing video and audio is used. In addition, in a state where the operation mode is the adjustment mode, a delay amount for synchronizing the video output from the television and the audio output from the external device (headphone) communicating with the television is set. Then, when the operation mode is switched from the adjustment mode to the viewing mode, the video and audio are synchronized using the delay amount.

  In the following, a video output from a video / audio reproduction device such as a television is also referred to as “internal video”. In the following, audio output from an external device that communicates with the video / audio reproduction device is also referred to as “external audio”.

JP 2013-187765 A

  In the related configuration A, the delay amount for synchronizing the internal video and the external audio is set in a state where the operation mode is the adjustment mode. In the related configuration A, in order to synchronize the internal video and the external audio, it is necessary to switch the operation mode from the adjustment mode to the viewing mode.

  In the related configuration A, the viewer needs to operate the remote controller to switch the operation mode from the adjustment mode to the viewing mode. Therefore, there is a problem that it takes time to synchronize the internal video and the external audio.

  The present invention has been made to solve such a problem, and an object thereof is to provide a video / audio reproduction device capable of quickly synchronizing internal video and external audio.

  In order to achieve the above object, a video / audio reproduction device according to an aspect of the present invention has a function of outputting video and externally outputs audio based on the audio signal in response to reception of the audio signal. Communicate with the device. The video / audio reproduction device outputs an internal video, which is a video output from the video / audio reproduction device, in response to reception of the audio signal by a transmission unit that transmits the audio signal to the external device. A delay calculation unit that calculates a delay time for synchronizing with external audio that is audio, and at least when the device state that is the state of the video and audio reproduction device regarding the output of the internal video has changed, The delay calculation unit calculates the delay time, and the video / audio reproduction device uses the delay time according to the calculation of the delay time to output the internal video output by the video / audio reproduction device and the external video The external sound output from the device is synchronized.

  According to the present invention, the delay calculation unit calculates the delay time when the device state, which is the state of the video / audio reproduction device, relating to at least the output of the internal video has changed. In accordance with the calculation of the delay time, the video / audio reproduction device uses the delay time to synchronize the internal video output by the video / audio reproduction device and the external audio output by the external device.

  That is, the video / audio reproduction device having the above-described configuration can synchronize the internal video and the external audio even when the viewer does not operate the remote control as in the related configuration A. Thereby, the internal video and the external audio can be quickly synchronized.

1 is a block diagram showing a configuration of a video / audio reproduction device according to Embodiment 1. FIG. 6 is a diagram for explaining synchronization control processing according to Embodiment 1. FIG. 3 is a flowchart of synchronization control processing according to the first embodiment. It is a figure for demonstrating the synchronous control process in connection with an input switching process. It is a block diagram which shows the structure of the audiovisual reproduction apparatus which concerns on the modification 1. It is a block diagram which shows the characteristic function structure of a video / audio reproduction device. It is a hardware block diagram of a video / audio reproduction device.

  Hereinafter, embodiments will be described with reference to the drawings. In the following drawings, the same components are denoted by the same reference numerals. The names and functions of the components having the same reference numerals are the same. Therefore, a detailed description of some of the components having the same reference numerals may be omitted.

<Embodiment 1>
FIG. 1 is a block diagram showing a configuration of a video / audio reproduction device 100 according to the first embodiment. Note that FIG. 1 also shows an external device 200. The video / audio reproduction device 100 has a function of outputting video and audio. The video / audio reproduction device 100 is, for example, a television. The external device 200 is a sound reproduction device having a function of outputting (reproducing) sound.

  The video / audio reproduction device 100 may be a device other than the television. The video / audio reproduction device 100 may be any device capable of processing video and audio.

  The video / audio reproduction device 100 is connected to the external device 200 so that it can communicate with the external device 200. In a situation where the video / audio reproduction device 100 can communicate with the external device 200, the video / audio reproduction device 100 communicates with the external device 200. Specifically, the video / audio reproduction device 100 is connected to the external device 200 by a wired connection unit or a wireless connection unit. The wired connection means is, for example, connection means using a cable. The wireless connection means is a connection means using wireless communication. The wireless communication is, for example, communication conforming to a standard such as Bluetooth (registered trademark).

  Referring to FIG. 1, video / audio reproduction device 100 includes control unit 40, video processing unit 11, video delay adding unit 12, video display unit 13, audio processing unit 21, and audio delay adding unit 22. , An audio output unit 23, a transmission unit 60, a delay calculation unit 50, and a microphone Mk1.

  The control unit 40 controls each component included in the video / audio reproduction device 100. In the present embodiment, the control unit 40 controls the video display unit 13, the audio processing unit 21, the audio output unit 23, and the delay calculation unit 50.

  The video / audio reproduction device 100 receives a video signal Vn that is an original video signal and an audio signal An that is an original audio signal from the outside (for example, an antenna). The audio signal An is a signal corresponding to the video signal Vn. The video signal Vn and the audio signal An are, for example, signals conforming to digital broadcasting standards.

  The video signal Vn includes video data Dv. The video data Dv is, for example, compressed video data. The video processing unit 11 performs signal processing Pv on the video signal Vn (original video signal). The signal processing Pv includes video decoding processing, video processing, and the like. The video decoding process is a process for decoding the video data Dv included in the video signal Vn. Hereinafter, the decoded video data Dv is also referred to as “video data Dvb”. The video data Dvb indicates a video (moving image).

  The video processing is, for example, processing for setting the image quality of the video indicated by the video data Dvb to a predetermined image quality. Note that the number of processes included in the signal processing Pv is not limited to 2, and may be 1 or 3 or more. The processing included in the signal processing Pv may be only video decoding processing, for example.

  Hereinafter, the video signal including the video data Dvb obtained by performing the signal processing Pv on the video signal Vn is also referred to as “video signal Vz”. The video processing unit 11 outputs a video signal Vz. Hereinafter, the video indicated by the video data Dvb is also referred to as “video V1”. That is, the video signal Vz including the video data Dvb includes the video V1. Video V1 is a moving image. In the following, the video included in the video signal may be referred to as “video based on the video signal”.

  The audio signal An includes audio data Da. The audio data Da is, for example, compressed audio data. The audio processing unit 21 performs signal processing Pa on the audio signal An (original audio signal). The signal processing Pa includes audio decoding processing, audio processing, and the like. The audio decoding process is a process for decoding the audio data Da included in the audio signal An. Hereinafter, the decoded audio data Da is also referred to as “audio data Dab”.

  The audio process is a process for setting the sound volume indicated by the audio data Dab to a reference level, for example. In addition, the sound processing is processing for, for example, making the sound quality of the sound indicated by the sound data Dab a reference sound quality. The number of processes included in the signal processing Pa is not limited to 2, and may be 1 or 3 or more. The processing included in the signal processing Pa may be only audio decoding processing, for example.

  Hereinafter, the audio signal including the audio data Dab obtained by performing the signal processing Pa on the audio signal An is also referred to as “audio signal Az”. That is, the audio signal Az is the audio signal An (original audio signal An) that has been subjected to the signal processing Pa. The audio signal Az is a signal corresponding to the video signal Vz.

  The audio processing unit 21 outputs an audio signal Az. Hereinafter, the voice indicated by the voice data Dab is also referred to as “voice A1”. That is, the audio signal Az including the audio data Dab includes the audio A1. Audio A1 is audio corresponding to video V1. In the following, the video included in the audio signal may be referred to as “video based on the audio signal”.

  In the following, the time from when the audio processing unit 21 starts the signal processing Pa to when the audio processing unit 21 outputs the audio signal Az is also referred to as “processing time ts” or “ts”. The voice processing unit 21 notifies the control unit 40 of the processing time ts.

  The transmission unit 60 transmits the audio signal Az output from the audio processing unit 21 to the external device 200.

  The video processing unit 11 and the audio processing unit 21 are synchronized so that the video signal Vz (video V1) output from the video processing unit 11 is synchronized with the audio signal Az (audio A1) output from the audio processing unit 21. The video signal Vz (video V1) and the audio signal Az (audio A1) are output, respectively. Therefore, the video signal Vz (video V1) output from the video processing unit 11 is synchronized with the audio signal Az (audio A1) output from the audio processing unit 21.

  Hereinafter, the video output by the video / audio reproduction device 100 is also referred to as “internal video”. In the following, the sound output from the external device 200 is also referred to as “external sound Ax” or “Ax”. In the following, the time for the internal video output from the video / audio reproduction device 100 to synchronize with the external audio Ax output from the external device 200 is also referred to as “delay time ExD” or “ExD”.

  Although details will be described later, the video / audio reproduction device 100 uses the delay time ExD according to the calculation of the delay time ExD, and the external video output by the external device 200 using the delay time ExD. Synchronize voice Ax.

  As will be described in detail later, the video delay adding unit 12 has a function of outputting the video signal Vz corresponding to the audio signal Az with a delay time ExD.

  The video display unit 13 has a function of outputting (displaying) an internal video based on the video signal Vz output from the video delay adding unit 12. The video display unit 13 is, for example, a display. Hereinafter, the state of the video display unit 13 in a situation where the video display unit 13 can output a video is also referred to as an “output state Sv”. In the following, the state of the video display unit 13 in a situation where the video display unit 13 does not output video is also referred to as “output stop state Svn”.

  Each of the control unit 40 and the delay calculation unit 50 controls the timing at which the video display unit 13 outputs an internal video based on the video signal Vz. Specifically, each of the control unit 40 and the delay calculation unit 50 sets the state of the video display unit 13 to the output stop state Svn or the output state Sv as necessary.

  The audio delay adding unit 22 has a function of delaying and outputting the audio signal Az by the delay time ExD, as will be described in detail later. Hereinafter, the sound A1 included in the sound signal Az output from the sound delay adding unit 22 is also referred to as “internal sound”.

  The audio output unit 23 has a function of outputting the audio A1 (internal audio) based on the audio signal Az output from the audio delay adding unit 22. The audio output unit 23 is, for example, a speaker. Hereinafter, the state of the sound output unit 23 in a state in which the sound output unit 23 can output sound is also referred to as “output state Sa”. In the following, the state of the audio output unit 23 in a situation where the audio output unit 23 does not output audio is also referred to as “output stop state San”. Each of the control unit 40 and the delay calculation unit 50 controls the timing at which the audio output unit 23 outputs the internal audio (audio A1) based on the audio signal Az. Specifically, each of the control unit 40 and the delay calculation unit 50 sets the state of the audio output unit 23 to the output stop state San or the output state Sa as necessary.

  Hereinafter, the state of the video / audio reproduction device 100 relating to at least the output of the internal video is also referred to as “device state St”. The control unit 40 constantly monitors the device state St. The control unit 40 has a function of detecting a change in the device state St. The device state St includes, for example, a state where the video / audio reproduction device 100 is not activated (hereinafter also referred to as “state Stn”). The state Stn is a state in which the video / audio reproduction device 100 cannot output video and audio.

  In the device state St, for example, there is a state in which the video / audio reproduction device 100 can output video and audio (hereinafter also referred to as “state Stm”). In the state Stm, the video display unit 13 can output video, and the audio output unit 23 can output audio.

  For example, when the video / audio reproduction device 100 performs a startup process, an input switching process, a reproduction content switching process, and the like, the apparatus state St changes. The activation process is, for example, a process for shifting the device state St from the state Stn to the state Stm. That is, when the activation process is performed, the apparatus state St shifts from the state Stn to the state Stm. That is, when the activation process is performed, the device state St that is the state Stn changes.

  Hereinafter, the change of the device state St is also referred to as “state change”. When the device state St changes (changes) from the state Stn to the state Stm, a state change occurs. Although details will be described later, the delay calculation unit 50 calculates the delay time ExD every time a change (state change) in the device state St occurs.

  In the device state St, for example, there is a state in which each of the video processing unit 11 and the audio processing unit 21 does not output a signal (video signal or audio signal) (hereinafter also referred to as “state Stcn”). . In the device state St, for example, there is a state in which each of the video processing unit 11 and the audio processing unit 21 outputs a signal (video signal or audio signal) (hereinafter also referred to as “state Stc”). When the device state St changes (changes) from the state Stcn to the state Stc, for example, a state change occurs.

  In addition, the solid line with an arrow shown by FIG. 1 shows flows, such as a video signal or an audio | voice signal. A broken line with an arrow indicates a flow of instructions (control), information (data), and the like. In FIG. 1, positions P1, P2, and P3 described later are shown.

  The external device 200 outputs sound (external sound Ax) based on the sound signal in response to reception of the sound signal from the outside.

  Specifically, the external device 200 includes a receiving unit 201, an external audio processing unit 202, and a speaker Sp1. The receiving unit 201 receives the audio signal Az from the video / audio reproduction device 100 and transmits the audio signal Az to the external audio processing unit 202. The external audio processing unit 202 performs various audio processes on the audio signal Az and transmits the audio signal Az to the speaker Sp1. The speaker Sp1 outputs the sound A1 included in the sound signal Az. That is, the external device 200 outputs the sound A1 (external sound Ax) in response to the reception of the sound signal Az.

  The microphone Mk1 of the video / audio reproduction device 100 has a function of acquiring the external audio Ax (audio A1). The microphone Mk1 transmits the acquired external audio Ax to the delay calculation unit 50.

  The delay calculation unit 50 receives the external voice Ax (voice A1). That is, the delay calculation unit 50 has a function of detecting the external voice Ax (voice A1). Although details will be described later, the delay calculation unit 50 calculates the delay time ExD when the device state St changes. Although details will be described later, the delay calculation unit 50 calculates the delay time ExD using the processing time ts in response to the microphone Mk1 acquiring the external sound Ax output from the external device 200.

  The delay calculating unit 50 notifies the video delay adding unit 12 and the audio delay adding unit 22 of the delay time ExD.

  As described above, the video signal Vz (video V1) output from the video processing unit 11 is synchronized with the audio signal Az (audio A1) output from the audio processing unit 21. Therefore, the value of the delay time ExD notified from the delay calculation unit 50 to the video processing unit 11 is the same as the value of the delay time ExD notified from the delay calculation unit 50 to the audio processing unit 21.

  Further, the delay calculating unit 50 does not change the state of the video display unit 13 to the output state Sv and the state of the audio output unit 23 to the output state Sa during the period when the process for calculating the delay time ExD is performed. As necessary, processing for setting the state of the video display unit 13 to the output stop state Svn and processing for setting the state of the audio output unit 23 to the output stop state San can be performed as necessary.

  By synchronizing the audio signal Az (audio A1) output from the audio delay adding unit 22 and the audio A1 output from the external device 200, the video V1 output from the video / audio reproduction device 100 and the external device 200 output. The voice A1 can be synchronized.

  Therefore, in the following description, only the synchronization of the audio A1 output from the video / audio reproduction device 100 and the audio A1 output from the external device 200 will be described. The description is the same as the description for synchronizing the video V1 output from the video / audio reproduction device 100 and the audio A1 output from the external device 200.

  Next, a process (hereinafter also referred to as “synchronous control process”) performed by the video / audio reproduction device 100 will be described. The synchronization control process is performed every time a state change occurs.

  FIG. 2 is a diagram for explaining the synchronization control process according to the first embodiment. FIG. 2 shows an example of a speech waveform. The horizontal axis in FIG. 2 is time. In FIG. 2, “silence” indicates a period in which no sound is generated. “Sound” indicates a period during which sound is generated.

  “P1” in FIG. 2 shows an example of a sound waveform at the position P1 in FIG. Specifically, “P1” indicates an example of a waveform of the sound A1 included in the sound signal Az output from the sound processing unit 21.

  “P2” in FIG. 2 shows an example of a sound waveform at the position P2 in FIG. Specifically, “P2” indicates an example of a waveform of the voice A1 included in the external voice Ax (voice A1) received by the delay calculation unit 50. “P3” in FIG. 2 shows an example of a sound waveform at the position P3 in FIG. Specifically, “P3” indicates an example of the waveform of the audio A1 included in the audio signal Az output from the audio delay adding unit 22.

  Here, in order to explain an example of the synchronization control process, the following premise Pm1 is considered. In the premise Pm1, the video / audio reproduction device 100 outputs video, and the external device 200 outputs audio. That is, in the assumption Pm1, the video / audio reproduction device 100 does not output audio. Further, in the premise Pm1, the above-described activation process is performed.

  Further, in the premise Pm1, the activation process ends just before time t1 in FIG. Therefore, immediately before time t1, the device state St, which is the state Stn, changes to the state Stm. That is, a state change occurs immediately before time t1. Further, in the premise Pm1, the video / audio reproduction device 100 is in a state incapable of communicating with the external device 200 before the activation process is performed.

  In the premise Pm1, the current (latest) synchronous control process is performed as the synchronous control process. In the premise Pm1, the previous synchronization control process has already been performed before the current synchronization control process is performed. The previous synchronization control process is the same as the later-described synchronization control process described with reference to FIGS. 2 and 3.

  Hereinafter, the current (latest) delay time ExD calculated by the delay calculation unit 50 is also referred to as “current ExD” or “current delay time”. This time ExD is the delay time ExD calculated in the current synchronization control process. In the following, the previous delay time ExD calculated by the delay calculation unit 50 is also referred to as “previous ExD” or “previous delay time”. The previous ExD is the delay time ExD calculated in the previous synchronization control process.

  In the assumption Pm1, each of the video delay adding unit 12, the audio delay adding unit 22, and the delay calculating unit 50 stores the previous ExD indicating the same value.

  The value of the previous ExD is set to 0 (initialized) when the activation process is performed. Therefore, the value of the previous ExD stored in each of the video delay adding unit 12 and the audio delay adding unit 22 is 0 at the time when the video / audio reproduction device 100 is started due to the start process being performed.

  FIG. 3 is a flowchart of the current synchronization control process in the premise Pm1. Note that a signal output impossibility period exists immediately after the video / audio reproduction device 100 is activated due to the activation process being performed. The signal output disabled period is a period in which the video processing unit 11 cannot output a video signal and the audio processing unit 21 cannot output an audio signal.

  As described above, a state change occurs immediately before time t1 when the activation process ends. Hereinafter, the information for notifying the state change is also referred to as “state change notification information”.

  With reference to FIG. 1, FIG. 2, and FIG. 3, in the synchronous control process in premise Pm1, an output stop process is first performed (S101). In the output stop process, the control unit 40 sets the state of the video display unit 13 to the output stop state Svn, and sets the state of the audio output unit 23 to the output stop state San. Thereby, in the signal output disabled period, the state of the video display unit 13 maintains the output stop state Svn, and the state of the audio output unit 23 maintains the output stop state San.

  Next, communication connection processing is performed (S102). In the communication connection process, a process for connecting the video / audio reproduction device 100 to the external device 200 is performed so that the video / audio reproduction device 100 can communicate with the external device 200.

  The control unit 40 transmits state change notification information to the sound processing unit 21 in accordance with a change in the device state St. For example, the control unit 40 transmits state change notification information to the voice processing unit 21 at time t1 (S103).

  The voice processing unit 21 specifies the processing time ts in response to the reception of the state change notification information (S104). The processing time ts is specified as follows. The processing time ts is a fixed value. Therefore, for example, the voice processing unit 21 stores the processing time ts in advance, and the voice processing unit 21 specifies the processing time ts by referring to the processing time ts.

  The specification of the processing time ts is not limited to the above method. For example, in order to measure the processing time ts, the sound processing unit 21 performs the above-described signal processing Pa, so that the sound processing unit 21 measures the time (processing time ts) required to output the sound signal Az. May be. In this case, the audio signal Az is not transmitted to the audio delay adding unit 22.

  Next, the voice processing unit 21 notifies the control unit 40 of the processing time ts at time t2 (S105).

  In the following, the time for calculating the delay time ExD is also referred to as “calculation time td” or “td”.

  In response to the notification of the processing time ts, the control unit 40 controls the delay calculation unit 50 so that the delay calculation unit 50 starts measuring the calculation time td at time t2. Specifically, the control unit 40 transmits an ExD calculation instruction to the delay calculation unit 50 (S106). The ExD calculation instruction is an instruction for causing the delay calculation unit 50 to start measuring the calculation time td and to calculate the delay time ExD. The ExD calculation instruction indicates the processing time ts.

  In response to receiving the ExD calculation instruction, the delay calculation unit 50 starts measuring the calculation time td at time t2 (S107).

  Hereinafter, the process of measuring the calculation time td is also referred to as “measurement process”. The measurement process is a process for measuring elapsed time. That is, the delay calculation unit 50 starts the measurement process in response to receiving the ExD calculation instruction. In the delay calculation unit 50, the measurement process is performed independently of other processes.

  In addition, the audio processing unit 21 starts the above-described signal processing Pa at time t2. Thereby, at time t3 when the processing time ts has elapsed from time t2, the audio processing unit 21 outputs the audio signal Az (audio A1) to the audio delay adding unit 22 and the transmission unit 60 ("P1" in FIG. 2). Waveform reference). At this time, since the previous ExD of the audio delay adding unit 22 is 0, the audio delay adding unit 22 outputs the undelayed audio signal Az to the audio output unit 23. At this time, since the state of the sound output unit 23 is the output stop state San, the sound output unit 23 does not output sound.

  Further, at time t3, the transmission unit 60 receives the audio signal Az (audio A1) and transmits the audio signal Az to the external device 200. In response to reception of the audio signal Az, the external device 200 performs the above-described audio processing on the audio signal Az and outputs an external audio Ax (audio A1).

  At time t4 when the delay time ExD has elapsed from time t3, the microphone Mk1 acquires the external audio Ax (audio A1) output from the external device 200 and transmits the external audio Ax to the delay calculation unit 50. Thereby, the delay calculation unit 50 detects the external voice Ax (voice A1) at time t4 (YES in S108, refer to the waveform “P2” in FIG. 2).

  In response to the detection of the external voice Ax (voice A1), the delay calculation unit 50 calculates the time from the time t2 when the measurement process is started to the time t4 when the voice A1 is detected as the calculation time td. That is, the calculation time td is determined when the microphone Mk1 acquires the external sound Ax output from the external device 200 and based on the sound signal Az.

  At time t3, the video signal Vz (video V1) is output from the video processing unit 11 toward the video delay adding unit 12. At this time, since the previous ExD of the video delay adding unit 12 is 0, the video delay adding unit 12 outputs the undelayed video signal Vz to the video display unit 13. At this time, since the state of the video display unit 13 is the output stop state Svn, the video display unit 13 does not output a video.

  Next, the delay calculation unit 50 performs ExD calculation processing (S109). In the ExD calculation process, the delay calculation unit 50 calculates the delay time ExD based on the calculation time td and the processing time ts notified from the control unit 40. Specifically, the delay calculation unit 50 calculates the delay time ExD by the equation of td−ts.

  Note that the delay time ExD includes processing time by the transmission unit 60 and the microphone Mk1. However, the processing time by the transmission unit 60 and the microphone Mk1 is a time that is negligible compared to the processing time ts. Therefore, in this embodiment, it is assumed that there is no audio signal or audio delay due to processing by the transmission unit 60 and the microphone Mk1.

  If an audio signal or audio delay occurs due to processing by the transmission unit 60 and the microphone Mk1, the delay time can be grasped in the video / audio reproduction device 100. Therefore, the delay calculation unit 50 may store the delay time in advance, and calculate a value obtained by subtracting the delay time from td−ts as the delay time ExD.

  Next, the delay calculation unit 50 compares the current ExD with the previous ExD. Specifically, the delay calculation unit 50 determines whether or not the current ExD matches the previous ExD (S110). This determination is performed using a threshold Th1 (hereinafter also referred to as “Th1”). The value of the threshold Th1 is a small value that does not affect the synchronization between video and audio. The value of the threshold value Th1 is, for example, greater than 0 and less than the time for displaying one frame (1/60 seconds).

  Specifically, when the relational expression 1 is satisfied, the delay calculation unit 50 determines that the current ExD matches the previous ExD. The relational expression 1 is represented by the previous ExD−Th1 ≦ current ExD ≦ previous ExD + Th1.

  When the relational expression 2a or the relational expression 2b is satisfied, the delay calculating unit 50 determines that the current ExD does not match the previous ExD. The relational expression 2a is expressed as ExD <previous ExD-Th1 this time. Further, the relational expression 2b is represented by the previous ExD + Th1 <current ExD.

  If YES in step S110, the process proceeds to step S114. On the other hand, if NO at step S110, the process proceeds to step S111. Note that in the premise Pm1, the previous ExD is 0 because the activation process is performed. Therefore, since Th1 <current ExD based on the relational expression 2b is satisfied, the delay calculating unit 50 determines that the current ExD does not match the previous ExD. Therefore, the process proceeds to step S111.

  Then, at time 4, the delay calculation unit 50 notifies the video delay adding unit 12 and the audio delay adding unit 22 of the delay time ExD that is ExD this time (S111).

  When the delay time ExD is notified, the audio delay adding unit 22 sets the audio signal Az input to the audio delay adding unit 22 from the time when the delay time ExD is notified as a new delay target audio signal. . The audio delay adding unit 22 discards the audio signal Az (audio A1) input to the audio delay adding unit 22 immediately before the audio delay adding unit 22 is notified of the delay time ExD.

  Hereinafter, the audio signal Az input to the audio delay adding unit 22 from the time when the delay time ExD is notified to the audio delay adding unit 22 is also referred to as “audio signal Aza”. In the following, the voice A1 included in the voice signal Aza is also referred to as “voice A1a”. The voice A1a is, for example, a voice indicating a waveform after time t4 corresponding to “P1” in FIG. Further, for example, the sound A1 output from the external device 200 after the time when the delay time ExD is notified to the sound delay adding unit 22 is, for example, a sound indicating a waveform after time t5 corresponding to “P2” in FIG. It is.

  In addition, when the delay time ExD is notified, the video delay adding unit 12 uses the video signal Vz input to the video delay adding unit 12 from the time when the delay time ExD is notified as a new delay target video signal. And The video delay adding unit 12 discards the video signal Vz (video V1) input to the video delay adding unit 12 immediately before the delay time ExD is notified to the video delay adding unit 12.

  Hereinafter, the video signal Vz input to the video delay adding unit 12 from the time when the delay time ExD is notified to the video delay adding unit 12 is also referred to as “video signal Vza”. Hereinafter, the video V1 included in the video signal Vza is also referred to as “video V1a”. The video V1a is, for example, a video corresponding to the audio A1a indicating the waveform after the time t4 corresponding to “P1” in FIG. That is, the video V1a is a video synchronized with the audio A1a. In other words, the audio A1a is an audio synchronized with the video V1a.

  The audio delay adding unit 22 notified of the delay time ExD delays the audio signal Aza by the delay time ExD (current ExD) and outputs it to the audio output unit 23. Thereby, at time t5 when the delay time ExD has elapsed from time t4, the audio delay adding unit 22 outputs the audio signal Aza (audio A1a). Thereby, the waveform of the sound A1a included in the sound signal Aza output from the sound delay adding unit 22 is a waveform corresponding to “P3” in FIG. That is, the waveform of the voice A1a is shown after time t5. Thus, after time t5 in FIG. 2, the sound A1a (“P3” waveform) output from the sound delay adding unit 22 to the sound output unit 23 and the sound A1 (external sound Ax) output from the external device 200 ( "P2" waveform) is a synchronized voice.

  In addition, the video delay adding unit 12 notified of the delay time ExD displays the video so that the internal video output from the video display unit 13 is a video synchronized with the external audio Ax (audio A1) output from the external device 200. The delay adding unit 12 delays the video signal Vza (video V1a) by a delay time ExD (current ExD) and outputs the delayed signal.

  Thereby, at time t5 when the delay time ExD has elapsed from time t4, the video delay adding unit 12 outputs the video signal Vza (video V1a) to the video display unit 13. Accordingly, the video V1a output from the video delay adding unit 12 to the video display unit 13 after time t5 is a video synchronized with the audio A1a output from the audio delay adding unit 22.

  In addition, the delay calculation unit 50 performs a stop extension process (S112). In the stop extension process, the delay calculation unit 50 extends the output stop state of the video display unit 13 and the audio output unit 23 from the time t4 by the current ExD.

  Next, the delay calculation unit 50 performs stop cancellation processing at time t5 (S114). In the stop release process, the output stop state Svn of the video display unit 13 is released. Specifically, the delay calculation unit 50 sets the state of the video display unit 13 to the output state Sv. Note that, in the premise Pm1, since the video / audio reproduction device 100 does not output audio, the output stop state San of the audio output unit 23 is maintained.

  As described above, after time t5 in FIG. 2, the sound A1a (“P3” waveform) output from the sound delay adding unit 22 to the sound output unit 23 and the sound A1 (“P2”) output from the external device 200 are displayed. Waveform) is a synchronized voice. As described above, the video V1a output from the video delay adding unit 12 to the video display unit 13 after time t5 is a video synchronized with the audio A1a output from the audio delay adding unit 22.

  Therefore, when the state of the video display unit 13 is set to the output state Sv, the video V1a output from the video display unit 13 (video / audio reproduction device 100) after time t5 is output by the external device 200 after time t5. The video is synchronized with the audio A1. That is, after time t5, the video V1a output from the video display unit 13 (video / audio reproduction device 100) is synchronized with the audio A1 output from the external device 200.

  Next, a process in which the current ExD matches the previous ExD will be described. As an example, the synchronization control process in the case where the apparatus state St changes due to the input switching process will be described. The input switching process is, for example, a process of switching the video output from the video / audio reproduction device 100 from the internal processing video to the external input video. The internally processed video is a video based on the video signal Vz output from the video processing unit 11. The externally input video is, for example, video input to the video / audio playback device 100 from a video playback device (not shown) as an external device connected to the video / audio playback device 100.

  FIG. 4 is a diagram for explaining a synchronization control process related to the input switching process. FIG. 4 shows an example of a speech waveform. In FIG. 4, “P1”, “P2”, and “P3” are the same as those in FIG.

  Here, in order to explain an example of the synchronization control process, the following premise Pm2 is considered. In the premise Pm2, the video / audio reproduction device 100 outputs video, and the external device 200 outputs audio. That is, in the premise Pm2, the video / audio reproduction device 100 does not output audio.

  In the premise Pm2, the current (latest) synchronization control process is performed as the synchronization control process. Further, in the premise Pm2, the previous synchronization control process has already been performed before the current synchronization control process is performed. The previous synchronization control process is, for example, the synchronization control process in the premise Pm1 described above.

  Further, in the assumption Pm2, the video / audio reproduction device 100 can communicate with the external device 200. In the premise Pm2, the video output from the video display unit 13 (video / audio reproduction device 100) is synchronized with the audio output from the external device 200 by the synchronization control process in the premise Pm1 described above. In the premise Pm2, the input switching process is performed in a state where the video output from the video / audio reproduction device 100 is synchronized with the audio output from the external device 200.

  Further, in the premise Pm2, the input switching process ends immediately before time t1 in FIG. Therefore, a state change occurs immediately before time t1.

  In the assumption Pm2, each of the video delay adding unit 12, the audio delay adding unit 22, and the delay calculating unit 50 stores the previous ExD indicating the same value. The previous ExD in the assumption Pm2 is the delay time ExD calculated by the ExD calculation process of the synchronization control process in the assumption Pm1. The previous ExD in the premise Pm2 corresponds to “ExD” corresponding to “P2” in FIG. In the premise Pm2, a later-described current ExD calculated by the ExD calculation process of the current synchronization control process matches the previous ExD.

  The synchronization control process in the premise Pm2 is different from the synchronization control process in the premise Pm1 mainly in that the processes in steps S102, S111, and S112 are not performed. In the synchronization control process in the premise Pm2, a process similar to the synchronization control process in the premise Pm1 will be described in a simplified manner. Note that the step numbers shown below correspond to the step numbers in the synchronization control process of FIG.

  With reference to FIG. 1, FIG. 3, and FIG. 4, in the synchronous control process in premise Pm2, an output stop process is first performed (S101). Thereby, the state of the video display unit 13 is set to the output stop state Svn, and the state of the audio output unit 23 is set to the output stop state San. Note that since the video / audio reproduction device 100 can communicate with the external device 200, the process of step S102 is not performed.

  The control unit 40 transmits state change notification information to the voice processing unit 21 at time t1 (S103). The voice processing unit 21 specifies the processing time ts in response to the reception of the state change notification information (S104).

  The voice processing unit 21 notifies the control unit 40 of the processing time ts at time t2 (S105). In response to the notification of the processing time ts, the control unit 40 controls the delay calculation unit 50 so that the delay calculation unit 50 starts measuring the calculation time td at time t2. Specifically, the control unit 40 transmits an ExD calculation instruction to the delay calculation unit 50 (S106).

  In response to receiving the ExD calculation instruction, the delay calculation unit 50 starts measuring the calculation time td at time t2 (S107). That is, the delay calculation unit 50 starts the measurement process in response to receiving the ExD calculation instruction.

  In addition, the audio processing unit 21 starts the above-described signal processing Pa at time t2. Thereby, at time t3 when the processing time ts has elapsed from time t2, the audio processing unit 21 outputs the audio signal Az (audio A1) to the audio delay adding unit 22 and the transmission unit 60 ("P1" in FIG. 4). Waveform reference).

  Further, at time t3, the transmission unit 60 receives the audio signal Az (audio A1) and transmits the audio signal Az to the external device 200. In response to reception of the audio signal Az, the external device 200 performs the above-described audio processing on the audio signal Az and outputs an external audio Ax (audio A1).

  At time t4 when the delay time ExD has elapsed from time t3, the microphone Mk1 acquires the external audio Ax (audio A1) output from the external device 200 and transmits the external audio Ax to the delay calculation unit 50. Thereby, the delay calculation unit 50 detects the external voice Ax (voice A1) at time t4 (YES in S108, refer to the waveform “P2” in FIG. 4).

  In response to the detection of the external voice Ax (voice A1), the delay calculating unit 50 calculates the time from the time t2 when the measurement process is started to the time t4 when the voice A1 is detected as the calculation time td.

  Next, the delay calculation unit 50 performs ExD calculation processing (S109). In the ExD calculation process, the delay calculation unit 50 calculates the delay time ExD using a formula of td−ts.

  Next, the delay calculation unit 50 determines whether or not the current ExD matches the previous ExD (S110). In the premise Pm2, the current ExD matches the previous ExD. Therefore, the process proceeds to step S114.

  Therefore, the process of step S111 in FIG. 3 is not performed. That is, the delay calculation unit 50 does not notify the video delay adding unit 12 and the audio delay adding unit 22 of the delay time ExD that is ExD this time. Therefore, the state in which both the time for the video delay adding unit 12 to delay the video signal and the time for the audio delay adding unit 22 to delay the audio signal is the previous ExD is maintained.

  Further, the above-described stop extension process in step S112 is not performed. Then, in the same manner as described above, stop cancellation processing in step S114 is performed. In the stop release process, the output stop state Svn of the video display unit 13 is released. Specifically, the delay calculation unit 50 sets the state of the video display unit 13 to the output state Sv. Note that, in the premise Pm2, since the audio / video reproduction device 100 does not output audio, the output stop state San of the audio output unit 23 is maintained.

  Therefore, after time t4, the video V1a output from the video display unit 13 (video / audio reproduction device 100) is synchronized with the audio A1 output from the external device 200.

  As described above, according to the present embodiment, the delay calculation unit 50 calculates the delay time ExD when the device state, which is the state of the video / audio reproduction device 100, at least regarding the output of the internal video has changed. In accordance with the calculation of the delay time ExD, the video / audio reproduction device 100 uses the delay time ExD to synchronize the internal video output by the video / audio playback device 100 and the external audio output by the external device 200.

  That is, the video / audio reproduction device 100 having the above configuration can synchronize the internal video and the external audio even when the viewer does not operate the remote control as in the related configuration A. Thereby, the internal video and the external audio can be quickly synchronized.

  In the present embodiment, when the video / audio reproduction device 100 can communicate with the external device 200, the internal video and the external audio can be automatically synchronized without the viewer operating the remote control. . Therefore, convenience for the viewer can be improved.

  In the present embodiment, the delay calculation unit 50 determines whether or not the current ExD matches the previous ExD. When the current ExD matches the previous ExD (that is, when the audio delay time by the external device 200 does not change), there is no need to perform a synchronization process for synchronizing the video and audio. Therefore, it is possible to provide a viewer with a synchronized state in which video and audio are synchronized. Further, by determining whether or not the current ExD matches the previous ExD, it is possible to efficiently perform processing for video and audio synchronization when the state of the video / audio reproduction device 100 changes.

  In the present embodiment, the synchronization control process is performed every time a state change occurs. Therefore, for example, even when the delay time changes due to a change in the operating state of the external device 200, the synchronization control process is automatically performed when a change in the state of the video / audio reproduction device 100 occurs. That is, unlike the related configuration A, it is not necessary to set the operation mode of the video / audio reproduction device 100 to a mode dedicated to synchronization. Therefore, convenience for the viewer can be improved.

  In the present embodiment, the control unit 40 performs the main processing in the synchronization control processing. For example, the control unit 40 detects a change in the device state St. The control unit 40 also controls the video display unit 13, the audio processing unit 21, the audio output unit 23, and the delay calculation unit 50. For this reason, the control unit 40 cooperates with the state of the video display unit 13 (output state Sv, output stop state Svn) and the state of the audio output unit 23 ((output state Sa, output stop state San)). Therefore, for example, it is possible to suppress the generation of sounds or the like that the viewer feels uncomfortable.

  In the related configuration A, in order to synchronize the internal video and the external audio, it is necessary to switch the operation mode from the adjustment mode to the viewing mode. In the related configuration A, the viewer needs to operate the remote controller to switch the operation mode from the adjustment mode to the viewing mode. Therefore, there is a problem that the convenience of the viewer is not good.

  Therefore, the video / audio reproduction device 100 of the present embodiment has a configuration for producing the above-described effects. Therefore, the above-described problem can be solved by the video / audio reproduction device 100 of the present embodiment.

  In the present embodiment, the processing in the assumptions Pm1 and Pm2 in which the audio / video reproduction device 100 does not output audio has been described. However, when the viewer desires that both the video / audio reproduction device 100 and the external device 200 output audio simultaneously, the output stop state San of the audio output unit 23 may be canceled. In this case, the delay calculation unit 50 sets the state of the audio output unit 23 to the output state Sa. Thereby, audio is output from both the video / audio reproduction device 100 (audio output unit 23) and the external device 200.

<Modification 1>
Hereinafter, the configuration of the first embodiment is also referred to as “configuration Ct1”. In the following, the configuration of this modification is also referred to as “configuration Ctm1”. The configuration Ctm1 is a configuration in which the voice processing unit 21 performs part of the processing performed by the control unit 40 in the first embodiment. The configuration Ctm1 is applied to the configuration Ct1 (Embodiment 1).

  FIG. 5 is a block diagram showing the configuration of the video / audio reproduction device 100 according to the first modification. In the configuration Ctm1, the audio processing unit 21 controls the timing at which the video display unit 13 outputs an internal video based on the video signal. Specifically, the audio processing unit 21 sets the state of the video display unit 13 to the output stop state Svn or the output state Sv as necessary. The audio processing unit 21 controls the timing at which the audio output unit 23 outputs the internal audio based on the audio signal. Specifically, the sound processing unit 21 sets the state of the sound output unit 23 to the output stop state San or the output state Sa as necessary.

  For example, in the configuration Ctm1, in step S101 (output stop process) in FIG. 3, the audio processing unit 21 sets the state of the video display unit 13 to the output stop state Svn and sets the state of the audio output unit 23 to the output stop state San. Set to.

  Note that the control unit 40 transmits state change notification information to the sound processing unit 21 in accordance with a change in the device state St. The voice processing unit 21 specifies the processing time ts in response to the reception of the state change notification information (S104).

  In the process of step S105 in the configuration Ctm1, the sound processing unit 21 notifies the delay calculation unit 50 of the processing time ts.

  In addition, the voice processing unit 21 controls the delay calculation unit 50 so that the delay calculation unit 50 starts measuring the calculation time td at time t2. Specifically, in the process of step S106 in the configuration Ctm1, the sound processing unit 21 transmits an ExD calculation instruction to the delay calculation unit 50.

  That is, in the configuration Ctm1, each component other than the control unit 40 performs each process of the synchronization control process of the first embodiment after the voice processing unit 21 receives the state change notification information transmitted by the control unit 40. . Thereby, the load concerning the control part 40 can be reduced.

  In addition, if the process which transmits state change notification information to the audio | voice process part 21 is made into the structure which components other than the control part 40 perform, the control part 40 will be unnecessary. Therefore, in this configuration, the synchronization control process can be realized with fewer components.

(Function block diagram)
FIG. 6 is a block diagram showing a characteristic functional configuration of the video / audio reproduction device BL10. The video / audio reproduction device BL10 corresponds to the video / audio reproduction device 100. That is, FIG. 6 is a block diagram showing main functions related to the present invention among the functions of the video / audio reproduction device BL10.

  The video / audio reproduction device BL10 has a function of outputting video and communicates with an external device BL20 that outputs audio based on the audio signal in response to reception of the audio signal. The external device BL20 corresponds to the external device 200.

  The video / audio reproduction device BL10 functionally includes a transmission unit BL1 and a delay calculation unit BL2. The transmission unit BL1 transmits the audio signal to the external device BL20. The transmission unit BL1 corresponds to the transmission unit 60.

  The delay calculation unit BL2 delays the internal video that is the video output from the video / audio reproduction device BL10 to synchronize with the external audio that is the audio that the external device BL20 outputs in response to the reception of the audio signal. Is calculated. The delay calculation unit BL2 corresponds to the delay calculation unit 50.

  At least when the device state, which is the state of the video / audio reproduction device BL10, relating to the output of the internal video has changed, the delay calculation unit BL2 calculates the delay time. In accordance with the calculation of the delay time, the video / audio reproduction device BL10 uses the delay time to synchronize the internal video output by the video / audio reproduction device BL10 and the external audio output by the external device. .

(Other variations)
The video / audio reproduction device according to the present invention has been described based on the embodiment and the modification. However, the present invention is not limited to the embodiment and the modification. The present invention includes those in which the modifications conceived by those skilled in the art have been made to the embodiments and modifications within the scope not departing from the gist of the present invention. That is, within the scope of the present invention, the present invention can be freely combined with the embodiments and modifications, and the embodiments and modifications can be appropriately modified and omitted.

  Further, the video / audio reproduction device 100 may not include all the components shown in the drawing. That is, the video / audio reproduction device 100 may include only the minimum components that can realize the effects of the present invention. For example, the video / audio reproduction device 100 may be configured not to include the video display unit 13 and the audio output unit 23. In this configuration, for example, external devices including the video display unit 13 and the audio output unit 23 are connected to the video / audio reproduction device 100.

  The functions of the transmission unit 60 and the delay calculation unit 50 included in the video / audio reproduction device 100 may be realized by a processing circuit.

  The processing circuit is a circuit for transmitting the audio signal to the external device.

  In addition, the processing circuit delays the internal video, which is the video output from the video / audio reproduction device, to synchronize with the external audio, which is the audio output by the external device in response to reception of the audio signal. It is also a circuit for calculating time.

  The processing circuit is also a circuit for calculating the delay time when a device state, which is a state of the video / audio reproduction device, at least regarding the output of the internal video is changed.

  The processing circuit may be dedicated hardware. The processing circuit may be a processor that executes a program stored in the memory. The processor is, for example, a CPU (Central Processing Unit), a central processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like.

  Hereinafter, the configuration in which the processing circuit is dedicated hardware is also referred to as “configuration Cs1”. In the following, the configuration in which the processing circuit is a processor is also referred to as “configuration Cs2”. Hereinafter, a configuration in which the functions of the transmission unit 60 and the delay calculation unit 50 are realized by a combination of hardware and software is also referred to as “configuration Cs3”.

  In the configuration Cs1, the processing circuit is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof. Applicable. The functions of the transmission unit 60 and the delay calculation unit 50 may be realized by two processing circuits, respectively. Further, all functions of the transmission unit 60 and the delay calculation unit 50 may be realized by one processing circuit.

  Note that a configuration in which all or a part of each component included in the video / audio reproduction device 100 is represented by hardware is, for example, as follows. Hereinafter, a video / audio reproduction device in which all or a part of each component included in the video / audio reproduction device 100 is represented by hardware is also referred to as a “video / audio reproduction device hd10”.

  FIG. 7 is a hardware configuration diagram of the video / audio reproduction device hd10. Referring to FIG. 7, the video / audio reproduction device hd10 includes a processor hd1 and a memory hd2. The memory hd2 is, for example, a nonvolatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM, or an EEPROM. The memory hd2 is, for example, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD, or the like. The memory hd2 may be any storage medium that will be used in the future.

  In the configuration Cs2, the processing circuit is the processor hd1. In the configuration Cs2, the functions of the transmission unit 60 and the delay calculation unit 50 are realized by software, firmware, or a combination of software and firmware. Software or firmware is described as a program and stored in the memory hd2.

  In the configuration Cs2, the processing circuit (processor hd1) reads out the program stored in the memory hd2 and executes the program, whereby the functions of the transmission unit 60 and the delay calculation unit 50 are realized. That is, the memory hd2 stores the following programs.

  The program is a program for causing a processing circuit (processor hd1) to execute the step of transmitting the audio signal to the external device.

  The program also includes a delay time for synchronizing an internal video, which is a video output by the video / audio reproduction device, with an external audio, which is a sound output by the external device in response to reception of the audio signal. Is also a program for causing the processing circuit (processor hd1) to execute the step of calculating.

  Further, the program causes the processing circuit (processor hd1) to execute the step of calculating the delay time when the device state, which is the state of the video / audio reproduction device, at least regarding the output of the internal video has changed. It is also a program.

  The program also causes the computer to execute a procedure of processing performed by each of the transmission unit 60 and the delay calculation unit 50, a method of executing the processing, and the like.

  In the configuration Cs3, some functions of the transmission unit 60 and the delay calculation unit 50 are realized by dedicated hardware. In the configuration Cs3, some other functions of the transmission unit 60 and the delay calculation unit 50 are realized by software or firmware.

  For example, the function of the transmission unit 60 is realized by the processing circuit reading and executing a program stored in the memory. Further, for example, the function of the delay calculation unit 50 is realized by a processing circuit as dedicated hardware.

  Like the configuration Cs1, the configuration Cs2, and the configuration Cs3 described above, the processing circuit can realize the functions described above by hardware, software, firmware, or a combination thereof.

  In addition, the present invention may be realized as a synchronization control method in which operations of characteristic components included in the video / audio reproduction device 100 are steps. The present invention may also be realized as a program that causes a computer to execute each step included in such a synchronization control method. Further, the present invention may be realized as a computer-readable recording medium that stores such a program. The program may be distributed via a transmission medium such as the Internet.

  Further, the synchronization control method according to the present invention corresponds to, for example, the synchronization control process of FIG.

  All the numerical values used in the above-mentioned embodiment are examples of numerical values for specifically explaining the present invention. That is, the present invention is not limited to the numerical values used in the above embodiments.

  It should be noted that the present invention can be freely combined with the embodiments and modifications within the scope of the invention, and the embodiments and modifications can be appropriately modified and omitted.

  11 video processing unit, 12 video delay adding unit, 13 video display unit, 21 audio processing unit, 22 audio delay adding unit, 23 audio output unit, 40 control unit, 50, BL2 delay calculating unit, 60, BL1 transmitting unit, 100 , BL10, hd10 Video / audio playback device, 200 external device, Mk1 microphone.

Claims (10)

A video / audio playback device that has a function of outputting video and communicates with an external device that outputs audio based on the audio signal in response to reception of the audio signal,
The video / audio reproduction device includes:
A transmitter for transmitting the audio signal to the external device;
A delay calculation unit that calculates a delay time for causing an internal video that is a video output from the video / audio reproduction device to synchronize with an external audio that is a sound output by the external device in response to reception of the audio signal. And
When the device state that is the state of the video / audio reproduction device at least regarding the output of the internal video has changed, the delay calculation unit calculates the delay time,
The video / audio reproduction device uses the delay time in accordance with the calculation of the delay time to synchronize the internal video output by the video / audio reproduction device and the external audio output by the external device. Audio playback device. The video / audio reproduction device further includes:
An audio processing unit that performs signal processing on the original audio signal and outputs the audio signal that is the original audio signal that has been subjected to the signal processing;
A microphone for acquiring the external sound output by the external device;
The transmission unit transmits the audio signal output by the audio processing unit to the external device,
In response to the microphone acquiring the external sound output by the external device that has received the audio signal, the delay calculation unit is configured so that the audio processing unit starts after the audio processing unit starts the signal processing. The video / audio reproduction device according to claim 1, wherein the delay time is calculated using a processing time which is a time until the audio signal is output. The video / audio reproduction device further includes:
A control unit for monitoring the device state;
The control unit transmits state change notification information for notifying the change to the sound processing unit according to the change in the device state,
The voice processing unit
(A1) Specifying the processing time in response to receiving the state change notification information,
(A2) The video / audio reproduction device according to claim 2, wherein the control unit is notified of the processing time. The delay calculation unit measures a calculation time which is a time for calculating the delay time,
The calculation time is determined by the microphone acquiring the external sound output by the external device,
The video / audio reproduction device according to claim 3, wherein the delay calculation unit calculates the delay time based on the calculation time and the processing time notified from the control unit. The video / audio reproduction device further includes:
A video delay adding unit having a function of delaying and outputting a video signal corresponding to the audio signal;
A video display unit having a function of outputting the internal video based on the video signal output by the video delay adding unit;
The delay calculating unit notifies the video delay adding unit of the delay time;
The video delay adding unit delays and outputs the video signal by the delay time so that the internal video output from the video display unit is a video synchronized with the external audio output from the external device. Item 5. The video / audio reproduction device according to any one of Items 1 to 4. The delay calculation unit calculates the delay time each time a change in the device state occurs,
The delay calculation unit compares the current delay time that is the current delay time calculated with the previous delay time that is the previous delay time calculated,
The delay calculation unit
(B1) When the current delay time coincides with the previous delay time, the current delay time is not notified to the video delay adding unit,
(B2) The video / audio reproduction device according to claim 5, wherein, when the current delay time does not coincide with the previous delay time, the current delay time is notified to the video delay adding unit. The video / audio reproduction device further includes:
A video delay adding unit having a function of delaying and outputting a video signal corresponding to the audio signal;
A video display unit having a function of outputting the internal video based on the video signal output by the video delay adding unit;
When the voice processing unit notifies the control unit of the processing time,
(C1) The control unit controls the delay calculation unit so as to start measurement of a calculation time that is a time for the delay calculation unit to calculate the delay time,
(C2) The video / audio reproduction device according to claim 3, wherein the control unit controls a timing at which the video display unit outputs the internal video based on the video signal. The video / audio reproduction device further includes:
An audio delay adding unit having a function of outputting the audio signal after delaying the delay time;
An audio output unit having a function of outputting internal audio that is audio based on the audio signal output from the audio delay adding unit;
The video / audio reproduction device according to claim 7, wherein, when the audio processing unit notifies the control unit of the processing time, the control unit controls a timing at which the audio output unit outputs the internal audio. The video / audio reproduction device further includes:
A control unit for monitoring the device state;
A video delay adding unit having a function of delaying and outputting a video signal corresponding to the audio signal;
A video display unit having a function of outputting the internal video based on the video signal output by the video delay adding unit;
The control unit transmits state change notification information for notifying the change to the sound processing unit according to the change in the device state,
The voice processing unit
(D1) specifying the processing time in response to receiving the state change notification information;
(D2) Notifying the delay calculation unit of the processing time;
(D3) controlling the delay calculation unit so as to start measurement of a calculation time that is a time for the delay calculation unit to calculate the delay time;
(D4) The video / audio reproduction device according to claim 2, wherein the video display unit controls a timing of outputting the internal video based on the video signal. The video / audio reproduction device further includes:
An audio delay adding unit having a function of outputting the audio signal after delaying the delay time;
An audio output unit having a function of outputting internal audio that is audio based on the audio signal output from the audio delay adding unit;
The video / audio reproduction device according to claim 9, wherein the audio processing unit controls a timing at which the audio output unit outputs the internal audio.

Images