JP2013162205A - Signal processor and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a signal processor and a program capable of presenting a plurality of contents delivered from different transmission paths while synchronizing smoothly.SOLUTION: The signal processor includes a first separation unit 312 for separating a first signal received from a first receiving unit 311 into a first clock signal and a first content signal, a first decoding unit 314 for decoding the first content signal, a second separation unit 322 for separating a second signal received by a second receiving unit 321 into a second clock signal and a second content signal, a second decoding unit 324 for decoding the second content signal, a master slave relation indication unit 33 for indicating master slave relation of the first and second signals, and a presentation unit 34 for presenting the first content signal decoded by the first decoding unit 314 and the second content signal decoded by the second decoding unit 324 while synchronizing, based on a reference clock signal selected by the master slave relation indication unit 33.

Description

  The present invention relates to a signal processing apparatus and a program having a function of performing synchronization processing on signals transmitted from a plurality of different transmission paths.

  In recent years, with the progress of digitalization of broadcasting and broadbandization of communication, research and development for realizing a broadcasting / communication cooperation service has been performed.

  Here, a general synchronization process will be described below. As shown in Patent Document 1, a receiver separates a received signal (transport stream (TS)) into a video TS, an audio TS, and a PCR. The PCR is a time stamp that is referred to when the reference time (STC) when encoded by the transmitter is reproduced by the STC reproduction unit of the receiver.

  Each video TS and audio TS has a decoding / playback unit called an access unit. In this access unit, a time stamp (PTS (presentation time stamp), DTS (decoding time stamp)) indicating where to decode and when to reproduce for each unit is described in the PES packet header. Yes. PTS is a time stamp used when reproducing an access unit.

  The video TS is temporarily stored in the video buffer, and then synchronized with each PTS based on the STC played back by the STC playback unit, and the access unit corresponding to the synchronized PTS is set as the video PES. Output. The video PES is output to a video decoder and presented as a video on the display unit after decoding.

  Similarly, the audio TS is also temporarily stored in the audio buffer, and then synchronized with the PTS included in the audio TS based on the STC reproduced by the STC reproduction unit. Is output as an audio PES. The audio PES is output to the audio decoder, and output from the speaker as audio after decoding.

Note that streams encoded with MPEG-2 video may differ in decoding order and playback order. In this case, a DTS indicating a time stamp to be decoded is added in addition to the PTS.
In this way, the receiver performs synchronous playback processing for video and audio using PTS and DTS.

JP 2003-259212 A

  By the way, in the broadcasting / communication cooperation service, a form in which contents are distributed using different transmission paths for broadcasting and communication and a plurality of contents are synchronized and presented in a receiver such as a digital television is conceivable.

  Here, in the receiver, when a stream signal such as video or audio is reproduced, a player object on software for controlling reproduction from data broadcasting or the like is used. In order to reproduce a plurality of stream signals in synchronization, it is usually necessary to set a synchronization relationship before each player object performs reproduction. Therefore, the synchronization relationship cannot be set after the reproduction is started. Also, the player object is not provided with a function for controlling the accuracy of synchronization.

  Also, in data broadcasting that controls the reproduction of broadcast programs, the video and audio that are multiplexed and included in the broadcast wave are immediately selected by the player object after channel selection (for example, after changing the channel with a remote controller or the like). Is played back. Therefore, the player object is already in a playback state when the data broadcasting application is activated.

  Also, in the broadcasting / communication cooperation service, it is considered that broadcast waves are often used as a reference for synchronized playback. Then, when playing back video and audio based on the broadcast wave, if you want to play back the content received via communication in sync with the broadcast wave, stop playing the video and audio of the broadcast wave. Otherwise, the content received via communication cannot be reproduced in synchronization with the broadcast wave.

  Also, the required synchronization accuracy may differ depending on the media to be synchronized, such as subtitles and audio, and a technique for flexibly changing the synchronization accuracy is required.

  The present invention intends a reproduction process that has already been started when synchronizing a signal transmitted from a different transmission line when performing a reproduction process on a signal transmitted from one transmission line. An object of the present invention is to provide a signal processing device and a program that can smoothly and synchronously present signals transmitted from different transmission paths without stopping.

  The signal processing apparatus according to the present invention includes a first receiving unit that receives a first signal that is a signal transmitted from a first transmission path and is obtained by multiplexing a plurality of signals, and the first receiving unit. Are stored in the first storage unit, the first storage unit that stores the first content signal, and the first storage unit. A first decoding unit that reads and decodes the first content signal, and a second signal that is transmitted from a second transmission path and that is obtained by multiplexing a plurality of signals. A second receiver for receiving, a second separator for separating the second signal into a second synchronization signal and a second content signal, and a second memory for storing the second content signal And the second content signal stored in the second storage unit A second decoding unit that performs decoding processing, a master-slave relationship instruction unit that instructs a master-slave relationship between the first signal and the second signal, and the first reception unit that receives the first signal. And when the second signal is received by the second receiver, either the first synchronization signal or the second synchronization signal is used as a reference in accordance with an instruction from the master-slave relationship instruction unit. The first content signal decoded by the first decoding unit and the second content signal decoded by the second decoding unit are determined based on the reference synchronization signal. It was set as the structure provided with the presentation process part which performs a presentation process synchronizing.

  According to such a configuration, the signal processing device according to the present invention has the master-slave relationship indicating unit that sets the master-slave relationship for reference synchronization for synchronized playback with respect to the player object, so that the player having the reference clock at any timing Objects can be selected. As a result, for example, when using Java (registered trademark), unlike the conventional JMF, in which synchronous control is delegated, the master-slave relationship of the reference clock for synchronous reproduction is performed. It is possible to select the player object that has started the video game as having a reference clock, and smoothly synchronize and reproduce images based on a plurality of content signals transmitted from different transmission paths.

  Further, in the signal processing device, the master-slave relationship instruction unit receives the first signal by the first reception unit, and the first decoding unit based on the first synchronization signal by the presentation processing unit If the second signal is received by the second receiver when the first content signal decrypted by the first content signal is presented, the first synchronization signal is used as the reference synchronization signal. The presentation processing unit determines the second content signal decoded by the second decoding unit based on the first synchronization signal determined by the master-slave relationship instruction unit. The presentation process may be performed in synchronization with the first content signal decrypted by the decryption unit.

  According to such a configuration, the signal processing apparatus according to the present invention is instructed by the master-slave relationship instruction unit to the reference clock for synchronous reproduction of the reproduction clock of the player object that has already started reproduction. The transmitted video or the like can be reproduced in synchronization with the video or the like that has already been reproduced.

  In the signal processing device, the difference detection unit for detecting a difference from the second synchronization signal with the first synchronization signal as a reference, and whether the difference detected by the difference detection unit exceeds a predetermined range A determination unit configured to determine whether or not the presentation processing unit determines the first content signal based on the first synchronization signal when the determination unit determines that the difference exceeds a predetermined range. A configuration for performing the presentation process may be used.

  According to such a configuration, the signal processing device according to the present invention, when the synchronization shift of a plurality of content signals transmitted from different transmission paths is large beyond a predetermined range, the video based on one content signal, etc. Can only play.

  Further, the signal processing device may be configured to include an adjustment unit that adjusts the predetermined range based on the types of the first content signal and the second content signal.

  According to such a configuration, the signal processing device according to the present invention can appropriately change the accuracy of allowable synchronization deviation based on the types of a plurality of content signals transmitted from different transmission paths.

  In the signal processing device, the first receiving unit receives the broadcast signal as the first signal transmitted through the space as the first transmission path, and the second receiving unit. May be configured to receive a communication signal as the second signal transmitted via a communication line as the second transmission path.

  According to such a configuration, the signal processing apparatus according to the present invention is already started when synchronizing a signal transmitted from an IP network such as the Internet when performing a reproduction process on a broadcast signal. The signal transmitted from the IP network can be smoothly and synchronously presented without intentionally stopping the reproduction process.

  In addition, a program according to the present invention includes a first receiving unit that receives a first signal that is a signal transmitted from a first transmission path and that is obtained by multiplexing a plurality of signals, and the first receiving unit. Are stored in the first storage unit, the first storage unit that stores the first content signal, and the first storage unit. A first decoding unit that reads and decodes the first content signal, and a second signal that is transmitted from a second transmission path and that is obtained by multiplexing a plurality of signals. A second receiver for receiving, a second separator for separating the second signal into a second synchronization signal and a second content signal, and a second memory for storing the second content signal And the second content signal stored in the second storage unit A second decoding unit that performs decoding processing, a master-slave relationship instruction unit that instructs a master-slave relationship between the first signal and the second signal, and the first reception unit that receives the first signal And when the second signal is received by the second receiver, either the first synchronization signal or the second synchronization signal is determined according to an instruction from the master-slave relationship instruction unit. Based on the reference synchronization signal, the first content signal decoded by the first decoding unit and the second content signal decoded by the second decoding unit based on the reference synchronization signal A computer including a presentation processing unit that performs presentation processing in synchronization with each other is configured to function as a signal processing device.

  According to such a configuration, the program according to the present invention has a master-slave relationship instructing unit that sets a master-slave relationship for a reference clock for synchronized playback with respect to the player object. Can be selected. As a result, for example, when using Java (registered trademark), unlike the conventional JMF, in which synchronous control is delegated, the master-slave relationship of the reference clock for synchronous reproduction is performed. It is possible to select the player object that has started the video game as having a reference clock, and smoothly synchronize and reproduce images based on a plurality of content signals transmitted from different transmission paths.

  According to the present invention, when a reproduction process is performed on a signal transmitted from one transmission line, a reproduction process that has already been started when synchronizing a signal transmitted from a different transmission line. Without intentionally stopping the signal, signals transmitted from different transmission paths can be smoothly and synchronously presented.

It is a figure which shows the structure of a broadcast communication cooperation system. It is a figure which shows typically the stack | stuck of the transmission protocol of a broadcast signal. It is a figure which shows the structure of the receiver as a signal processing apparatus of a broadcast communication cooperation system. It is a figure with which it uses for the description about the synchronization between player objects by the chain of synchronization master-slave relationship.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
As shown in FIG. 1, the broadcasting / communication cooperation system 100 includes a broadcasting station 1, a broadcasting antenna 2, a receiver 3, and an information distribution server 4, and realizes a broadcasting / communication cooperation service. It is. Specifically, in the broadcasting / communication cooperation system 100, in the receiver 3, a broadcasting service based on an ISDB (Integrated Services Digital Broadcasting) system and a communication service using an IP network such as the Internet N are linked. The user can use the broadcasting / communication cooperation service by the receiver 3.

  A broadcast signal broadcast from the broadcast station 1 is the same as a broadcast signal of a conventional digital broadcast broadcast by a broadcasting facility, and details thereof will be described later, but ARIB (Association of Radio Industries and Broadcasts) ) Specified in the standard.

  Although not shown, the broadcasting station 1 has a general digital broadcasting broadcasting facility including a program organization facility, a program transmission facility, a transmission facility, and the like.

  The broadcast station 1 broadcasts a broadcast signal including content. The content includes a program that is a normal content broadcast according to a broadcast schedule and an event that is an emergency content that occurs asynchronously with the program. For example, an event is an emergency warning signal, an earthquake early warning, a data broadcast module update, an event message, or the like, and is a broadcast content that does not necessarily occur in conjunction with a program.

  FIG. 2 shows a stack of broadcast signal transmission protocols. The data transmission system is an extension of the international standard MPEG-2 Systems adopted in digital broadcasting, and is roughly divided into a data stream (independent PES) transmission system, a data carousel transmission system, and an event message transmission system. .

  The independent PES (Packetized Elementary Stream) transmission method is a method for transmitting a character / graphic stream such as a caption / breaking news supermarket, and a video / audio stream independent of television video / audio.

  The data carousel transmission system is a transmission system that provides a virtual memory for the receiver 3. The data carousel is realized by repeatedly transmitting the same file set at regular intervals like a carousel indicated by its name.

  The event message transmission method is a method for sending a trigger signal from the broadcasting station 1 to the receiver 3. This method is a method suitable for the broadcast station 1 to transmit a message with a small amount of data to the receiver 3. For example, in a viewer-participation-type quiz program, when the time until the viewer answers is considered, the broadcasting station 1 may send a response start trigger signal to all viewers.

  Multimedia coding language (BML) is based on xHTML defined by W3C (World Wide Web Consortium), and procedural language is based on JavaScript (registered trademark) using ECMA Script. It is a standard defined in consideration of consistency with the standard.

  The receiver 3 has a function of receiving a broadcast signal of the above-described format and performing a predetermined process to output a program display screen and sound in synchronization. The receiver 3 executes the application, and converts the display screen and audio of the content acquired from the information distribution server 4 via the IP network such as the Internet N into the display screen and audio of the program. It has a function to output in cooperation. Hereinafter, a specific configuration of the receiver 3 will be described.

  For example, when various applications are available, the receiver 3 obtains a broadcast program display screen (hereinafter referred to as “broadcast screen”) via an IP network such as the Internet N. A content display screen (hereinafter referred to as an “application screen”) can be displayed in an overlapping manner.

The receiver 3 uses a broadcast signal to control a screen display method and an audio output method between the broadcast program and the application in a broadcast program unit or asynchronously with the broadcast program.
As the screen display method, for example, only the broadcast screen is displayed, or the broadcast screen and the application screen are overlapped or displayed side by side. In addition, the audio output method includes a method of outputting only the sound of the broadcast program, or outputting the sound of the broadcast program and the sound of the application independently or in combination.

  The receiver 3 is a device such as a television receiver, a personal computer, or a portable terminal, and can receive broadcast signals broadcast from the broadcast station 1 and communicate via an IP network such as the Internet N. Receiver.

  The information distribution server 4 also serves as a content distribution server that distributes content such as still images and moving images, and an application distribution server that distributes various applications that operate on the receiver 3.

  The receiver 3 may not only acquire an application from the information distribution server 4 via an IP network such as the Internet N, but may acquire it by another route. For example, the application may be provided to the receiver 3 by being superimposed on a broadcast signal, stored in an information recording medium such as a smart media or an optical disk, and provided to the receiver 3 or received at the time of factory shipment. It may be stored in the internal memory of the machine 3.

  The receiver 3 of the broadcasting / communication cooperation system 100 configured as described above has a function of smoothly synchronizing and presenting a plurality of contents distributed from different transmission paths. Hereinafter, a configuration example for realizing the function will be described.

As shown in FIG. 3, the receiver 3 as a signal processing device includes a first processing unit 31, a second processing unit 32, a master-slave relationship instruction unit 33, and a presentation processing unit 34.
The first processing unit 31 schematically shows the internal structure of one player object. The first processing unit 31 includes a first receiving unit 311, a first separation unit 312, a first storage unit 313, and a first storage unit 313. A decoding unit 314 is provided and performs predetermined processing on the signal transmitted from the first transmission path.

  The first receiving unit 311 is a first stream signal (hereinafter referred to as a “first signal”) that is a signal transmitted from the first transmission path and that is obtained by multiplexing a plurality of signals. Receive. The first signal is, for example, a signal in which a first content signal composed of a video signal, an audio signal, a caption signal, and the like and a first synchronization signal are multiplexed. The first separation unit 312 separates the first signal into a first synchronization signal and a first content signal.

  The first storage unit 313 stores the first content signal. The first decryption unit 314 reads the first content signal stored in the first storage unit 313 and decrypts it.

  The second processing unit 32 schematically shows the internal structure of a player object different from the first processing unit 31, and includes a second receiving unit 321, a second separation unit 322, Storage section 323 and second decoding section 324, and performs predetermined processing on the signal transmitted from the second transmission path.

  The second receiving unit 321 is a signal transmitted from the second transmission path, and is a second stream signal obtained by multiplexing a plurality of signals (hereinafter referred to as “second signal”). Receive. The second signal is, for example, a signal obtained by multiplexing a second content signal composed of a video signal, an audio signal, a caption signal, and the like and a second synchronization signal. The second separation unit 322 separates the second signal into a second synchronization signal and a second content signal.

  The second storage unit 323 stores the second content signal. The second decryption unit 324 reads out the second content signal stored in the second storage unit 323 and decrypts it.

  The master-slave relationship instructing unit 33 instructs the master-slave relationship between the first signal and the second signal. When the first signal is received by the first receiver 311 and the second signal is received by the second receiver 321, the presentation processing unit 34 follows the instruction from the master-slave relationship instruction unit 33. The first synchronization signal or the second synchronization signal is determined as a reference synchronization signal, and the first content signal and the second content decoded by the first decoding unit 314 are determined based on the reference synchronization signal. The presentation process is performed in synchronization with the second content signal decrypted by the decryption unit 324. The video and characters processed by the presentation processing unit 34 are output to the display 38, and the sound processed by the presentation processing unit 34 is output to the speaker 39.

  The master-slave relationship instructing unit 33 may set the broadcast signal as “main” and the signal (communication signal) transmitted from the IP network may be set as “subordinate” in advance. And the communication signal may be compared with each other as “main”, or may be instructed to “main” based on information included in the broadcast signal or communication signal.

  The receiver 3 configured as described above has the master-slave relationship instructing unit 33 that sets the master-slave relationship of the reference clock for synchronized playback with respect to the player object, so that the player object having the reference clock can be selected at an arbitrary timing. can do. As a result, for example, when using Java (registered trademark), unlike the conventional JMF, in which synchronous control is delegated, the master-slave relationship of the reference clock for synchronous reproduction is performed. It is possible to select the player object that has started the video game as having a reference clock, and smoothly synchronize and reproduce images based on a plurality of content signals transmitted from different transmission paths.

  When the first synchronization signal is a PCR (program clock reference), an STC (system time clock) reproduction unit (not shown) generates and generates an STC based on the PCR that is the first synchronization signal. The STC is supplied to the first storage unit 313. The first storage unit 313 extracts a DTS (decoding time stamp) and a PTS (presentation time stamp) from the first content signal based on the time of the STC supplied from the STC playback unit, and the first content signal At the same time, DTS and PTS are supplied to the first decoding unit 314.

  Similarly, when the second synchronization signal is a PCR, an STC (system time clock) reproduction unit (not shown) generates an STC based on the PCR that is the second synchronization signal, and generates the generated STC. Is supplied to the second storage unit 323. The second storage unit 323 extracts a DTS (decoding time stamp) and a PTS (presentation time stamp) from the second content signal based on the time of the STC supplied from the STC playback unit, and the second content signal At the same time, DTS and PTS are supplied to the second decoding unit 324.

  Further, for example, the master-slave relationship instruction unit 33 instructs the first signal transmitted from the first transmission path to “main”, and the second signal transmitted from the second transmission path is “slave”. ", The presentation processing unit 34 performs a presentation process by synchronizing the first content signal and the second content signal based on the first synchronization signal.

  Also, the presentation processing unit 34, for example, based on the first synchronization signal, the predetermined position of the first content signal ("1000" byte from the beginning of the file) and the predetermined position of the second content signal A configuration in which an offset can be set so that (1100th byte from the beginning of the file) is synchronized may be used.

  In addition, although the structure of the receiver 3 was demonstrated in the above, it is not restricted to this, The computer which is provided with each component and presents the several content delivered from the different transmission path smoothly synchronously as a receiver You may comprise by the program to function.

  Here, although not shown, the master-slave relationship instructing unit 33 is provided with a synchronization signal tracking unit for tracking one to the other when two or more synchronization signals are input as an API (application program interface). Yes. The synchronization signal tracking unit delivers the first synchronization signal supplied from the first separation unit 312 as it is to the presentation processing unit 34 as an initial state (a state in which a signal is transmitted only from the first transmission path). It is initialized as a mere electric wire. In this state, the synchronization signal tracking unit has no function other than delivering the given synchronization signal (first synchronization signal) to the presentation processing unit 34 as it is.

  However, even after the player object (presentation processing unit 34) starts presenting information on the display 38 or the speaker 39, the synchronization signal tracking unit synchronizes the first synchronization signal with the second synchronization signal. Thus, the function can be changed so as to have a function of rearranging the synchronization signal.

This is achieved by calling an API defined by the present invention.
After the function is rearranged, the synchronization signal tracking unit generates a synchronization signal that follows the second synchronization signal and supplies the synchronization signal to the presentation processing unit 34, so that the presentation processing unit 34 tracks the second synchronization signal. Will be presented.

  Although not shown, the receiver 3 may be configured to include a synchronization signal supply unit as an API. The synchronization signal supply unit has a function of giving a signal corresponding to the second synchronization signal to another player object, but does not exist as an initial state. If necessary, this function can be generated in the player object even after the presentation processing unit 34 starts presentation by calling an API defined by the present invention. Thus, a synchronization signal can be supplied.

  In addition, the master-slave relationship of synchronization is realized by generating a synchronization signal tracking unit and a synchronization signal supply unit as necessary in each of the plurality of player objects and passing the synchronization signal between them.

  For example, when there are two player objects A and B, a synchronization signal supply unit for the player object A and a synchronization signal follower for the player object B are generated, and the synchronization signal supply unit for the player object A is changed to the player object B. By connecting the synchronization signal follower, the player object B is presented by the synchronization signal of the player object A. That is, in this case, the player object A is “main” and the player object B is “subordinate”.

In addition, the receiver 3 can add the following functions (API).
The first function is a function for instructing the master / slave relationship of synchronization, and when synchronization is actually established, the designated “slave” player object is set as the “main” of the reproduction of the media.

  In addition, the second function instructs when the established synchronization relationship cannot be maintained for some reason and when the instruction of the synchronization master-slave relationship is given (that is, when the API is called). It is a function to do.

  The third function is a function for establishing synchronization of a plurality of player object groups having a plurality of synchronization relationships by enabling a chain of synchronization master-slave relationships.

  According to the third function, for example, as shown in FIG. 4, the player object A is synchronized with “main” (M1) and the player object B is “slave” (S1). When C is “main” (M2) and the player object D is “slave” (S2), the player object A is “main” and the other player objects B to D are “slave”. In this case, by using the third function, the synchronization relationship can be established collectively as “subordinate” without releasing the relationship between the player object C and the player object D. The operation of establishing synchronization can be simplified rather than establishing synchronization.

  The master-slave relationship instructing unit 33 receives the first signal by the first receiving unit 311, and the first decoding unit 314 performs decoding processing based on the first synchronization signal by the presentation processing unit 34. When the second signal is received by the second reception unit 321 in the case where the content signal presentation process is performed, the first synchronization signal is determined as the reference synchronization signal.

  In addition, the presentation processing unit 34 uses the first decoding unit 314 to output the second content signal decoded by the second decoding unit 324 based on the first synchronization signal determined by the master-slave relationship instruction unit 33. Presentation processing is performed in synchronization with the decrypted first content signal.

  In the receiver 3 configured as described above, the playback clock of the player object that has already started playback is instructed as a reference clock for synchronous playback by the master-slave relationship instructing unit 33, so that it is transmitted from different transmission paths. Thus, it is possible to smoothly reproduce the video that has already been started without intentionally stopping the video that has already been started.

Moreover, the receiver 3 may be configured to include a difference detection unit 35 and a determination unit 36 as shown in FIG.
The difference detection unit 35 detects a difference from the second synchronization signal with reference to the first synchronization signal. The determination unit 36 determines whether the difference detected by the difference detection unit 35 exceeds a predetermined range.

  In such a configuration, when the determination unit 36 determines that the difference exceeds the predetermined range, the presentation processing unit 34 performs a presentation process on the first content signal based on the first synchronization signal. .

  For example, when the receiver 3 performs playback processing in synchronization with the first content signal and the second content signal, when the delay occurs in the second content signal and the synchronization shift becomes large, Since only the first content signal is reproduced based on the first synchronization signal, reproduction of all the content signals does not stop when a synchronization shift occurs, and a certain service can be ensured.

  In this way, the receiver 3 reproduces only the video or the like based on one content signal when the synchronization deviation of a plurality of content signals transmitted from different transmission paths is so large that it exceeds a predetermined range. Can do.

  In addition, as shown in FIG. 3, the receiver 3 includes an adjustment unit 37 that adjusts a predetermined range that is a determination criterion of the determination unit 36 based on the types of the first content signal and the second content signal. It may be configured.

  For example, a video signal (stereoscopic (right-eye stereoscopic) video signal) included in the first content signal and a video signal (stereoscopic (left-eye stereoscopic)) included in the second content signal. When a three-dimensional video (3D video) is displayed using a video signal), one frame is an odd frame and the other frame is an even frame. Therefore, synchronization accuracy at the frame level is required.

  In this case, the adjustment unit 37 adjusts the predetermined range which is the determination criterion of the determination unit 36 so as to correspond to the frame level.

  Therefore, when the first content signal and the second content signal are synchronized at the frame level, i.e., within the predetermined range adjusted by the adjustment unit 37, the receiver 3 receives the stereoscopic video. When the synchronization deviation exceeds the frame level, that is, exceeds a predetermined range adjusted by the adjustment unit 37, an image based only on one content signal is displayed on the display 38. . The receiver 3 displays two content signals when the synchronization shift returns to a predetermined range when a video image based on only one content signal is displayed on the display 38 due to the synchronization shift. You may synchronize and display on the display 38 as a three-dimensional image | video.

  For example, when synchronizing the video signal included in the first content signal and the caption signal included in the second content signal, the synchronization accuracy at the frame level as described above is required. Not.

  In this case, the adjustment unit 37 adjusts so that the predetermined range that is the determination criterion of the determination unit 36 is widened.

  Therefore, when the first content signal and the second content signal are within the predetermined range adjusted by the adjustment unit 37, the receiver 3 displays the caption in synchronization with the video, and the adjustment unit 37 When the adjusted predetermined range is exceeded, only the video is displayed on the display 38. Note that the receiver 3 may display subtitles in synchronization with the video when the synchronization shift returns to the predetermined range when the synchronization shift occurs and only the video is displayed on the display 38. good.

  In this way, the receiver 3 can appropriately change the accuracy of the allowable synchronization deviation based on the types of content signals transmitted from different transmission paths.

  The first receiving unit 311 receives a broadcast signal as a first signal transmitted via a space serving as a first transmission path, and the second receiving unit 321 includes a second transmission path. The communication signal may be received as the second signal transmitted via the communication line.

  In this way, the receiver 3 intends the reproduction process that has already been started when the signal transmitted from the IP network such as the Internet is synchronized when the reproduction process is performed on the broadcast signal. Therefore, the signal transmitted from the IP network can be smoothly and synchronously presented without stopping.

  Further, the receiver 3 has been described assuming a configuration in which synchronous reproduction is performed using a broadcast signal broadcast from the broadcast station 1 as a first signal and a communication signal distributed from the information distribution server 4 as a second signal. However, the present invention is not limited to this, and a configuration in which broadcast signals broadcast by different broadcast stations or channels are synchronized and reproduced, or a configuration in which communication signals transmitted from different information distribution servers are synchronized and reproduced may be employed. The receiver 3 may be configured to synchronize three or more signals transmitted from three or more different transmission paths.

  Further, the receiver 3 may display “synchronizing now” or the like on the display 38 when performing a process of synchronizing a plurality of signals.

DESCRIPTION OF SYMBOLS 1 Broadcasting station 2 Broadcasting antenna 3 Receiver 4 Information distribution server 31 1st process part 32 2nd process part 33 Master-slave relation instruction | indication part 34 Presentation process part 35 Difference detection part 36 Determination part 37 Adjustment part 38 Display 39 Speaker 311 First reception unit 312 First separation unit 313 First storage unit 314 First decoding unit 321 Second reception unit 322 Second separation unit 323 Second storage unit 324 Second decoding unit

Claims (6)

A first receiving unit that receives a first signal that is transmitted from a first transmission line and that is obtained by multiplexing a plurality of signals;
A first separation unit that separates the first signal into a first synchronization signal and a first content signal;
A first storage unit for storing the first content signal;
A first decoding unit that reads and decodes the first content signal stored in the first storage unit;
A second reception unit that receives a second signal transmitted from the second transmission path, the signal being multiplexed with a plurality of signals;
A second separation unit that separates the second signal into a second synchronization signal and a second content signal;
A second storage unit for storing the second content signal;
A second decoding unit that reads and decodes the second content signal stored in the second storage unit;
A master-slave relationship instructing unit for instructing a master-slave relationship between the first signal and the second signal;
When the first signal is received by the first receiver and the second signal is received by the second receiver, the first signal is received according to an instruction from the master-slave relationship instruction unit. Either the first synchronization signal or the second synchronization signal is determined as a reference synchronization signal, and the first content signal and the second content decoded by the first decoding unit based on the reference synchronization signal A signal processing apparatus comprising: a presentation processing unit that performs presentation processing in synchronization with the second content signal decoded by the decoding unit. The master-slave relationship instructing unit receives the first signal by the first receiving unit, and the first decoding unit is decoded by the first decoding unit based on the first synchronization signal by the presentation processing unit. If the second signal is received by the second receiving unit when the content signal is presented, the first synchronization signal is determined as the reference synchronization signal,
The presentation processing unit uses the first decoding unit to output the second content signal decoded by the second decoding unit based on the first synchronization signal determined by the master-slave relationship instruction unit. The signal processing apparatus according to claim 1, wherein a presentation process is performed in synchronization with the first content signal that has been decrypted. A difference detection unit that detects a difference from the second synchronization signal on the basis of the first synchronization signal;
A determination unit that determines whether or not the difference detected by the difference detection unit exceeds a predetermined range;
2. The presentation processing unit according to claim 1, wherein, when the determination unit determines that the difference exceeds a predetermined range, the presentation processing unit performs the presentation process on the first content signal based on the first synchronization signal. Signal processing device.   The signal processing apparatus according to claim 3, further comprising: an adjustment unit that adjusts the predetermined range based on types of the first content signal and the second content signal. The first receiving unit receives a broadcast signal as the first signal transmitted through the space as the first transmission path,
The signal processing apparatus according to claim 1, wherein the second receiving unit receives a communication signal as the second signal transmitted via a communication line as the second transmission path. A first receiving unit that receives a first signal that is transmitted from a first transmission line and that is obtained by multiplexing a plurality of signals;
A first separation unit that separates the first signal into a first synchronization signal and a first content signal;
A first storage unit for storing the first content signal;
A first decoding unit that reads and decodes the first content signal stored in the first storage unit;
A second reception unit that receives a second signal transmitted from the second transmission path, the signal being multiplexed with a plurality of signals;
A second separation unit that separates the second signal into a second synchronization signal and a second content signal;
A second storage unit for storing the second content signal;
A second decoding unit that reads and decodes the second content signal stored in the second storage unit;
A master-slave relationship instructing unit for instructing a master-slave relationship between the first signal and the second signal;
When the first signal is received by the first receiver and the second signal is received by the second receiver, the first signal is received according to an instruction from the master-slave relationship instruction unit. Either the first synchronization signal or the second synchronization signal is determined as a reference synchronization signal, and the first content signal and the second content decoded by the first decoding unit based on the reference synchronization signal The program which makes a computer provided with the presentation process part which synchronizes the said 2nd content signal decoded by the decoding part of and performs a presentation process function as a signal processing apparatus.

Images