JP4556185B2 - Video playback device and audio playback device - Google Patents

Description

  The present invention relates to a video playback apparatus and an audio playback apparatus that are physically separated from each other, and in particular, a video playback apparatus and an audio that enable synchronous playback of video data and audio data included in one multimedia encoded data. The present invention relates to a playback device.

  In this specification, data including video information (video information) such as general luminance signals and color difference signals is referred to as video data, and linear PCM (Pulse Code Modulation) or analog audio signal Data including such audio information (voice information) will be referred to as audio data. Also, encoded data in which video data is compressed is referred to as video encoded data, and encoded data in which audio data is compressed is referred to as audio encoded data. Therefore, the video encoded data and the audio encoded data are included in the video data and the audio data. In this specification, data including both video encoded data and audio encoded data is referred to as multimedia encoded data.

  Conventionally, several techniques for synchronously reproducing video data and audio data on respective physically separated playback apparatuses (video playback apparatus and audio playback apparatus) have been proposed. Products suitable for the diverse needs of consumers are also on the market. For example, for data transmission using wireless transmission, a data transmission device that transmits audio data as an optical signal in the infrared region, and the optical signal is received by a light receiving device and converted from an optical signal to an electrical signal for audio reproduction. There exists an infrared transmission type audio reproduction system composed of headphones.

  Recently, IEEE802.11a and IEEE802.11g using the 2.4 GHz band have been known as transmission systems using radio waves. For example, a short-range wireless transmission method such as Bluetooth (registered trademark) is also used for transferring audio data. Data transmission using these radio waves can reduce the size of the transmission / reception unit. In particular, the cost of Bluetooth (registered trademark) is low, and the transmission range is wide compared to wireless communication using light. Because it is very convenient.

  Also, when constructing a multi-channel playback environment by arranging rear speakers, there is a problem that the speaker cord that extends to the rear speakers gets in the way. In order to solve this problem, an amplifier is mounted on the rear speakers. In addition, there is an audio reproduction system that is provided with a wireless signal receiving device and transmits audio data to the rear speaker as a radio signal (wireless signal), thereby supplying the audio data to the rear speaker.

  The synchronized playback of video data and audio data given as an example above is usually supplied to a speaker through a speaker cord or a headphone cord, and an electrical signal of audio data returned to vibration energy in the speaker is converted into an optical signal or a radio signal. By converting the signal into a wireless signal and transmitting it, audio output can be performed in an audio output device that is located physically apart. Therefore, the above-described synchronized playback is not performed while measuring the timing of video data and audio data, and the synchronized playback depends on the output timing of video data and audio data in the video playback device and audio playback device. ing.

  On the other hand, the following Patent Document 1 discloses a technique for realizing synchronized playback of video data and audio data included in multimedia encoded data in a video playback device and an audio playback device that are physically separated from each other. It is disclosed. In the technique disclosed in Patent Document 1, for example, a video playback device and an audio playback device (headphones) are connected by a wireless medium. The video playback device plays back video data and also encodes audio encoded data. Is supplied to the audio reproducing apparatus. The audio reproduction device performs a decoding process on the audio encoded data received from the video reproduction device and outputs the audio. In addition, the audio playback device performs audio playback synchronized with video playback in consideration of input / output buffer capacity, communication delay, decoding delay, and the like at the start of playback. It is possible to eliminate the deviation by measuring the amount of deviation between the video output and the audio output using the clock synchronization and changing the audio reproduction speed.

  Next, an internal configuration of a multimedia encoded data reproducing apparatus that reproduces multimedia encoded data according to a conventional technique will be described.

  FIG. 8 is a block diagram showing an example of a multimedia encoded data reproducing apparatus according to the prior art. Note that the multimedia encoded data playback apparatus shown in FIG. 8 performs synchronized playback of video data and audio data included in the multimedia encoded data, and corresponds to, for example, a portable DVD player.

  8 includes a multimedia stream buffer 1001, a system stream separation unit 1002, an audio decoding unit 1003, a video decoding unit 1004, a control unit (CPU: Central Processing Unit) 1005, An audio data buffer 1006, a video data buffer 1007, a speaker 1008, and a monitor 1009 are provided.

  In FIG. 8, a multimedia stream buffer 1001 is, for example, a DVD disk that stores multimedia encoded data. For example, a system stream read from the multimedia stream buffer 1001 using an optical pickup is separated into a video stream and an audio stream by a system stream separation unit 1002, and the audio stream is decoded by an audio decoding unit 1003 and the video stream is video decoded. The unit 1004 performs a decoding process on each compressed data. Note that encoded data, a stream, and a bit stream are synonyms, and the encoded data is generally called a stream.

  The audio data decoded by the audio decoding unit 1003 and the video data decoded by the video decoding unit 1004 are temporarily stored in an output buffer (audio data buffer 1006 or video data buffer 1007). The control unit 1005 that performs playback control based on time information described in the system stream controls audio data output from the audio data buffer 1006 and video data output from the video data buffer 1007. The audio data output from the audio data buffer 1006 is converted into audio through the speaker 1008, and the video data output from the video data buffer 1007 is converted into an image through the monitor 1009.

  As described above, the synchronous reproduction of the video data and the audio data is managed by the control unit 1005 in the multimedia encoded data reproduction apparatus 1000. For example, the audio decoding unit 1003, the video decoding unit 1004, or an output buffer (audio data) This is realized by controlling the buffer 1006 and the video data buffer 1007).

  FIG. 9 is a block diagram illustrating an example of a separated multimedia encoded data reproducing apparatus according to a conventional technique, and FIG. 10 illustrates an example of a separated multimedia encoded data reproducing apparatus according to a conventional technique. FIG. The separated multimedia encoded data reproducing apparatus shown in FIGS. 9 and 10 performs wireless transmission of audio data by light or radio waves to, for example, physically separated headphones and speakers.

  The separation type multimedia encoded data reproduction apparatus shown in FIG. 9 includes a multimedia encoded data reproduction transmission apparatus 2001 and an audio reproduction apparatus 2002. The separation type multimedia encoded data reproduction apparatus shown in FIG. 9 functions as a multimedia encoded data reproduction transmission apparatus 2001, for example, as shown in FIG. 10, and has a monitor for performing video output, operation buttons, and the like. This corresponds to a set of a main device 3001 and a headphone 3002 that functions as the audio playback device 2002. That is, the separation type multimedia encoded data reproduction apparatus shown in FIG. 9 has a configuration in which the audio reproduction apparatus is separated from the multimedia encoded data reproduction apparatus shown in FIG.

  The multimedia encoded data reproduction / transmission apparatus 2001 shown in FIG. 9 includes a multimedia stream buffer 2101, a system stream separation unit 2102, an audio decoding unit 2103, a video decoding unit 2104, a control unit 2105, an audio data buffer 2106, and a video. A data buffer 2107, a monitor 2109, and an audio data transmission unit 2110 are included. However, as will be described later, the audio decoding unit 2103 is not necessarily implemented.

  When compared with the multimedia encoded data reproduction apparatus 1000 shown in FIG. 8, the multimedia encoded data reproduction apparatus 1000 of FIG. 8 outputs audio from the speaker 1008, while shown in FIG. The multimedia encoded data reproduction / transmission device 2001 is different in that it is configured to wirelessly transmit audio data to the audio reproduction device 2002 through the audio data transmission unit 2110. The function) is basically the same.

  On the other hand, the audio playback device 2002 illustrated in FIG. 9 includes an audio data receiving unit 2201, an audio decoding unit 2202, an audio data buffer 2203, and a speaker 2204. The audio data transmitted from the multimedia encoded data reproduction / transmission apparatus 2001 is received by the audio data receiving unit 2201, and after being decoded by the audio decoding unit 2202 and the buffer by the audio data buffer 2203, the audio data is received from the speaker 2204. Sound is output.

  Note that when the audio decoding unit 2103 is implemented in the multimedia encoded data reproduction / transmission device 2001, the audio decoding unit 2202 does not need to be implemented in the audio reproduction device 2002, and conversely, in the audio reproduction device 2002. When the audio decoding unit 2202 is installed, the audio decoding unit 2103 need not be installed in the multimedia encoded data reproduction / transmission apparatus 2001.

  For example, when the audio decoding unit 2103 is mounted in the multimedia encoded data reproduction / transmission device 2001, the multimedia is taken into account in consideration of delays associated with wireless transmission to the audio reproduction device 2002 and buffer delay. The control unit 2105 of the encoded data reproduction / transmission apparatus 2001 controls the output timing of video data and audio data, so that the video data and the audio data are the same as the multimedia encoded data reproduction apparatus 1000 shown in FIG. Can be realized.

On the other hand, when the audio decoding unit 2202 is mounted on the audio reproduction device 2002, the multimedia encoded data reproduction / transmission device 2001 and the audio reproduction device, as in the technique disclosed in Patent Document 1 described above. The difference between the output timing of the video data and the output timing of the audio data is adjusted by examining the shift amount of the reference time each referred to by 2002, and the audio data buffer storage amount per unit time is adjusted based on the change degree of the audio data buffer. It is necessary to control the output timing of audio data in the playback apparatus 2002. Note that the difference between the output timing of the video data and the output timing of the audio data is based on the reference operating frequency of the multimedia encoded data playback / transmission apparatus 2001 on the main body side and the reference of the audio playback apparatus 2002 on the headphone side. This is a phenomenon that occurs because the operating frequency is different.
JP 2004-7140 A (FIGS. 1, 4, and 7)

  As described above, when playing back multimedia encoded data, a video playback device that plays back video data (output to a monitor) is an audio playback device that is physically separated from the audio playback device. By wirelessly transmitting audio data in real time, simultaneous playback of video playback on the video playback device and audio playback on the audio playback device is performed.

  By the way, recently, manners when using radio waves in public places are regarded as social problems including physical effects. In particular, the use of mobile phones in public institutions such as trains and hospitals is concerned with noise to the people around them and danger to the human body, and there are practical restrictions on their use. The same applies to the transmission of audio data using radio waves. Therefore, when synchronized playback with video data, wireless transmission of audio data in real time using radio waves is very effective if it is a closed space in each home or a space that does not affect the surroundings. Although it is a technology, it cannot be said to be a very suitable technology in situations where the use of radio waves is not preferred.

  Therefore, when synchronized playback of video data and audio data, wireless transmission of audio data in real time using radio waves to an audio playback device that is located physically apart is particularly important for trains. Not suitable for use in medium or highly public facilities. That is, for example, wireless transmission of audio data in real time using the above-described Bluetooth (registered trademark), a transmission method using a 5 GHz band or a 2.4 GHz band, or the like must be basically avoided. is there.

  On the other hand, wireless connection in which a cord is not connected to headphones or speakers can provide a comfortable environment with high convenience to the user. For example, as described above, a wireless transmission method (infrared wireless transmission method) using light such as infrared rays is effective as a technique for wirelessly transmitting audio data without using radio waves while maintaining a wireless state. .

  When synchronized playback of video data and audio data, if a wireless transmission method using light is used to transmit audio data in real time to an audio playback device that is physically located, audio Light is transmitted to both the data transmission side (corresponding to the multimedia encoded data reproduction / transmission apparatus 2001 shown in FIG. 9) and the audio data reception side (corresponding to the audio reproduction apparatus 2002 shown in FIG. 9). It is necessary to provide an optical transmission / reception unit for performing transmission / reception of audio data, and to transmit audio data in real time via this optical transmission / reception unit. However, this optical transmission / reception unit is more expensive than a transmission / reception unit using radio waves, and it is difficult to reduce the size of the optical transmission / reception unit. The problem of being disturbed arises.

  As described above, when radio waves are used for wireless transmission of audio data, it is possible to reduce the cost and size of the apparatus. However, for example, the effects of radio waves on the human body, etc. As a result, there arises a problem that it is necessary to sufficiently consider the influence on the surrounding environment. On the other hand, when light is used for wireless transmission of audio data, it is not necessary to consider the impact on the surrounding environment that occurs when radio waves are used, but this increases the costs associated with the installation of optical transceiver units and increases the size of the device. There is a problem that convenience is reduced due to the increase in weight and the like. In view of these problems, it is desirable to maintain a wireless connection such as headphones and speakers and to realize a comfortable reproduction environment for multimedia encoded data.

  In order to solve the above problems, the present invention maintains the convenience of a state in which the video playback apparatus and the audio playback apparatus are physically separated and connected wirelessly (wireless connection state). For example, a video playback device and audio playback that can realize synchronized playback of video data and audio data with a simple configuration even in environments where radio wave use is restricted, such as in highly public places An object is to provide an apparatus.

To achieve the above object, according to the first aspect of the present invention, there is provided auxiliary information including video encoded data, audio encoded data, and time information for managing the reproduction time of each encoded data. Multimedia encoded data reading means for reading the multimedia encoded data from a recording medium in which multimedia encoded data in which information is multiplexed is recorded;
Operation input means for inputting an external instruction relating to the reproduction operation of the multimedia encoded data;
The multimedia encoded data includes the auxiliary information including time information indicating the playback position related to the playback operation input by the operation input means and operation information for instructing to start the playback operation. Wireless signal transmission means for wirelessly transmitting to a predetermined audio reproduction device in which the audio encoded data is stored in advance;
Radio signal receiving means for receiving, via the radio, a response signal indicating whether or not normal operation can be performed in response to the start instruction of the reproduction operation from the predetermined audio reproduction device;
Referring to the response signal, response signal decoding means for decoding whether or not the predetermined audio reproduction device can normally start the operation in response to the instruction to start the reproduction operation;
Video decoding means for performing decoding processing after the reproduction position related to the reproduction operation input by the operation input means with respect to the video encoded data included in the multimedia encoded data;
Video display means for visually displaying video based on video data generated by the decoding process of the video encoded data in the video decoding means;
Judging that the response signal is decoded by the response signal decoding means, it is determined that the response signal indicating that the predetermined audio reproduction device can normally start the operation in response to the instruction to start the reproduction operation is received. Video playback control means for controlling to start video output after the playback position related to the playback operation input by the operation input means,
A video playback device is provided.

Further, according to the second aspect of the present invention, in the first aspect of the present invention described above, the predetermined audio reproduction device instructs the start of the reproduction operation by decoding the response signal in the response signal decoding means. If it is determined that a response signal indicating that it is impossible to start the operation normally is received, the auxiliary information and the operation information until the predetermined time has elapsed or the predetermined number of times has been exceeded. Wireless signal transmission control means for controlling to continue to transmit,
Even if the predetermined time has elapsed or the predetermined number of times has been exceeded, the response signal indicating that the normal operation can be performed in response to the start instruction of the reproduction operation from the predetermined audio reproduction device Video playback standby control means for controlling to stop the playback operation input by the operation input means,
A video playback device is provided.

  Further, according to the third aspect of the present invention, in the second aspect of the present invention described above, it is impossible to normally start the operation in response to the start instruction of the playback operation from the predetermined audio playback device. And / or when a predetermined time elapses or exceeds a predetermined number of times, the predetermined audio playback device operates normally in response to the playback operation start instruction. When the response signal indicating that it can be performed cannot be received, a video playback apparatus having a notification unit that notifies the fact is provided.

In order to achieve the above object, according to the fourth aspect of the present invention, video encoded data, audio encoded data, and time information for managing the reproduction time of each encoded data are provided. The audio code reconstructed so that audio reproduction of the audio encoded data is performed after the audio encoded data and the auxiliary information are once separated from the multimedia encoded data multiplexed with the auxiliary information including Data storage means for storing the data and the auxiliary information;
Radio signal receiving means for receiving the auxiliary information including time information indicating a reproduction position related to a reproduction operation and operation information for instructing to start the reproduction operation from a predetermined video reproduction device via radio;
An operation execution determination unit that determines whether or not the operation can be normally started in response to the instruction to start the reproduction operation with reference to the auxiliary information and the operation information received by the wireless signal reception unit; ,
Response signal generating means for generating a response signal indicating whether or not the operation can be normally started in response to the instruction to start the reproduction operation based on the determination result in the operation execution determining means;
Wireless signal transmitting means for wirelessly transmitting the response signal generated by the response signal generating means to the predetermined video playback device;
The audio encoded data stored in the data storage unit when it is determined by the determination in the operation execution determination unit that the operation can be normally started in response to the reproduction operation start instruction. An audio decoding means for performing a decoding process after the reproduction position related to the reproduction operation;
Audio output means for outputting the audio encoded data decoded by the audio decoding means;
An audio playback device is provided.

  The present invention has the above-described configuration, and the video playback apparatus and the audio playback apparatus exist in physically separated locations and maintain a wireless connection state (wireless connection state), for example, Even in environments where radio wave use is restricted, such as in highly public places, it is possible to achieve synchronized playback of video data and audio data with a simple configuration, maintain the convenience of wireless connection, and reduce the cost of equipment And having the effect of enabling downsizing and weight reduction of the apparatus. Further, the communication between the video playback device and the audio playback device is bidirectional, and the video playback device confirms the operation status of the audio playback device and determines whether or not video playback is possible. In a situation where the communication environment with the apparatus is inferior, it is possible to prevent adverse effects such as starting only video playback, and to realize more effective synchronized video and audio playback.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. The synchronized playback method of video data and audio data according to the embodiment of the present invention is roughly divided into two stages: a preparation stage before playback (pre-process stage) and a playback stage (post-process stage) in which the user actually watches. It is done.

  First, the pre-process stage, which is a pre-reproduction stage, will be described with reference to FIG. FIG. 1 is a block diagram showing an example of the configuration of a multimedia encoded data separation / transmission apparatus and an audio reproduction apparatus that perform processing according to a previous process step in an embodiment of the present invention.

  FIG. 1 shows a multimedia encoded data separation / transmission apparatus 100 and an audio reproduction apparatus 200. A multimedia encoded data separation / transmission apparatus 100 shown in FIG. 1 includes a multimedia stream buffer 101, a system stream separation unit 102, an audio stream buffer 103, an auxiliary information buffer 104, an audio stream reconstruction unit 105, and an audio stream transmission. Part 106 is provided. 1 includes an audio stream receiving unit 201, an audio stream buffer 202, and a post-process processing unit 203 that performs a process related to a post-process stage.

  The multimedia stream buffer 101 is a storage medium capable of storing multimedia encoded data. For example, if the main body of the multimedia encoded data separating / transmitting apparatus 100 is a DVD player, it corresponds to a DVD disk. An information terminal having a multimedia playback function such as a mobile phone or PDA (Personal Digital Assistance) corresponds to an HDD (Hard Disc Drive), a semiconductor memory, or the like. Here, it is assumed that the multimedia system stream related to the content that the user desires to view is stored in advance in the multimedia stream buffer 101.

  In general, multimedia encoded data is composed of video data and audio data, as well as information obtained by encoding content, content identification information, and other auxiliary information (including time information and attribute information in particular). After the information is compressed according to the respective encoding methods (the information may not be compressed), each is multiplexed to generate a system stream (multimedia system stream). Therefore, when decoding video encoded data or audio encoded data, it is necessary to extract and extract each element (elementary stream) from the system stream in advance.

  The system stream read from the multimedia stream buffer 101 is separated into an audio stream and auxiliary information (particularly including time information and attribute information) associated with the system stream by the system stream separation unit 102. After separation by the system stream separation unit 102, the audio stream is stored in the audio stream buffer 103, and the auxiliary information is stored in the auxiliary information buffer 104.

  The audio playback device 200 that is the transmission destination of the audio stream cannot perform playback even if only the audio stream separated by the system stream separation unit 102 is provided. That is, when an audio stream is played back by the audio playback device 200, content information accompanying the audio stream and auxiliary information for managing playback time are required. Therefore, the audio stream reconstructing unit 105 of the multimedia encoded data separation and transmission apparatus 100 multiplexes the auxiliary information stored in the auxiliary information buffer 104 into the audio stream stored in the audio stream buffer 103, and creates a new one. The correct audio stream. The reconstructed audio stream is generated so that it can be played back by the audio playback device 200.

  The audio stream reconstructed by the audio stream reconstructing unit 105 is transmitted through the audio stream transmitting unit 106 to the audio reproducing device 200 physically separated from the multimedia encoded data separation / transmission device 100. Note that the transmission method of the audio stream from the multimedia encoded data separation transmission device 100 to the audio reproduction device 200 is not particularly limited, and for example, wired transmission via USB (Universal Serial Bus), infrared light, or the like. Or wireless transmission using radio waves can be employed. Further, for example, the audio stream reconstructed by the audio stream reconstructing unit 105 is stored in a portable storage medium, and the audio reproduction apparatus 200 is separated from the multimedia encoded data separation / transmission apparatus 100 by attaching / detaching the portable storage medium. Alternatively, the reconstructed audio stream may be moved.

  On the other hand, for example, the audio stream transmitted from the audio stream transmitting unit 106 is received by the audio stream receiving unit 201 of the audio reproducing device 200, stored in the audio stream buffer 202 provided in the audio reproducing device 200, and Preparation before reproduction (pre-process stage) is completed. The reconstructed audio stream stored in the audio stream buffer 202 is played back by the post-process processing unit 203 at the post-process stage. The post-process processing unit 203 will be described in detail later.

  As described above, in the pre-process stage, after the audio stream and the auxiliary information are once separated from the multimedia encoded data in the multimedia encoded data separating and transmitting apparatus 100, the auxiliary information is multiplexed into the audio stream, The audio stream is reconstructed without the video stream. The reconstructed audio stream is stored in the audio playback device 200 in advance. In the pre-process stage, the reconstructed audio stream is stored in the audio playback apparatus 200 in advance, so that the multimedia encoded data separation / transmission apparatus 100 can perform the actual playback process (the post-process stage described later). Audio data need not be transmitted to the audio playback device 200 in real time.

  Next, a post-process stage, which is a playback stage where the user actually watches, will be described. FIG. 2 and FIG. 3 are block diagrams showing examples of configurations of a multimedia encoded data reproduction apparatus and an audio reproduction apparatus that perform processing related to a later process step, respectively, in the embodiment of the present invention.

  The multimedia encoded data playback device 300 shown in FIG. 2 includes a multimedia stream buffer 301, a system stream separation unit 302, an auxiliary information extraction unit 303, a video decoding unit 304, a control unit 305, and auxiliary information / operation information generation. A unit 306, a video data buffer 307, a monitor 308, a wireless transmission unit 309, a wireless reception unit 310, and a reception information decoding unit 311.

  The multimedia encoded data separation / transmission apparatus 100 shown in FIG. 1 and the multimedia encoded data reproduction apparatus 300 shown in FIG. 2 are preferably implemented by the same apparatus, but are different. It may be realized by a device.

  That is, for example, the multimedia encoded data playback device 300 shown in FIG. 2 is realized by the main body device 3001 shown in FIG. 10, and the headphone 3002 shown in FIG. 1 is provided, the main body apparatus 3001 is provided with the function of the multimedia encoded data separation / transmission apparatus 100 shown in FIG. 1, and the multimedia encoding shown in FIG. It is preferable that the functions of both the data separation and transmission apparatus 100 and the multimedia encoded data reproduction apparatus 300 shown in FIG. 2 are realized by one apparatus. However, for example, the multimedia encoded data separation / transmission apparatus 100 shown in FIG. 1 is realized by a fixed DVD player, a personal computer (PC), or the like. It is also possible to provide only the function of the multimedia encoded data reproduction device 300 shown in FIG. In this case, the user reconstructs audio data using a fixed DVD player or PC, and the reconstructed audio data is stored in advance in the audio playback device 200 and is shown in FIG. Playback control of the audio playback device 200 is performed using the main body device 3001.

  In the multimedia encoded data reproduction device 300 shown in FIG. 2, for example, when a content reproduction instruction is given by a user operation, first, the multimedia encoded data related to the content to be reproduced is Read from the multimedia stream buffer 301. Note that, as described above, the content to be played is reconstructed by the multimedia encoded data separation and transmission apparatus 100 shown in FIG. 1, and the reconstructed audio data related to the content is Suppose that it is already stored in the audio playback device 200.

  The system stream separation unit 302 reads the system stream from the multimedia stream buffer 301 and performs separation processing, and sends data including auxiliary information for video / audio synchronized playback described in the system stream to the auxiliary information extraction unit 303. On the other hand, the video stream is output to the video decoding unit 304.

  The video decoding unit 304 performs a video decoding process such as converting the video stream separated by the system stream separation unit 302 into a luminance signal and a color difference signal representing each pixel data for one frame of video, and performs post-processing. Are output to a video data buffer 307 such as a frame buffer. The video data is once stored in the video data buffer 307, then transmitted to the monitor 308 in accordance with an output command from the control unit 305, and video is output through the monitor 308. Here, a video data buffer 307 is provided at the subsequent stage of the video decoding unit 304 so that the video data decoded by the video decoding unit 304 is temporarily stored in the video data buffer 307, whereby video reproduction is performed in a predetermined manner. However, for example, a video data buffer may be provided in the preceding stage of the video decoding unit 304 to perform time management.

  On the other hand, the auxiliary information extraction unit 303 extracts auxiliary information from the data including the auxiliary information separated by the system stream separation unit 302, and supplies the auxiliary information to the auxiliary information / operation information generation unit 306. The auxiliary information / operation information generation unit 306, in accordance with an instruction from the control unit 305, together with content identification information for identifying content, for example, time information indicating the position of data to be reproduced, an operation instruction indicating a data processing method, and the like Is generated and transmitted to the audio reproduction device 200 via the wireless transmission unit 309. As described above, an example of auxiliary information is time information included in the system stream and content identification information for identifying content, and examples of operation information are an instruction to start / stop playback and special playback. Is instruction information such as an instruction to start / stop. In the present specification, operations related to playback of various other contents including start / stop of playback and start / stop of special playback are referred to as playback operations. Further, the auxiliary information / operation information transmission unit 306 may combine the auxiliary information and the operation information into one information and transmit the information to the audio playback device 200.

  For example, when a user inputs an operation using an operation panel (not shown in FIG. 2) provided in the multimedia encoded data reproduction apparatus 300, operation information indicating the operation content is transmitted through the control unit 305. While being supplied to the auxiliary information / operation information generation unit 306, auxiliary information related to the operation information is read from the auxiliary information extraction unit 303. Based on these operation information and auxiliary information, auxiliary information and / or operation information to be transmitted to the audio playback device 200 is generated in the auxiliary information / operation information generation unit 306, and the audio playback device 309 is transmitted through the wireless transmission unit 309. 200.

  The wireless transmission unit 309 is not particularly limited with respect to the wireless transmission method and the like, but for example, an infrared communication method (IrDA) adopted in a low power consumption and low cost optical transmission device, a PC, a PDA, or the like. It is desirable to perform wireless communication using. The above infrared communication system is suitable for control signal communication according to the present invention, has no influence on the surroundings by radio waves, and easily prevents interference with other devices by narrowing the light transmitting slit and the light receiving slit. It is also possible. Operation information, time information of audio data, content identification information of multimedia encoded data, etc. transmitted from the multimedia encoded data reproduction apparatus 300 are reproduced via a wireless transmission unit 309 in a physically separated position. Wirelessly transmitted to the device 200.

  The content identification information of the multimedia encoded data is information for identifying the content, and indicates unique information of the multimedia encoded data such as a file name and a data length. This content identification information is used when the audio playback apparatus 200 selects a desired content from a plurality of multimedia encoded data (audio streams).

  As will be described later, the audio playback device 200 receives the operation information and auxiliary information transmitted from the multimedia encoded data playback device 300 and starts its operation. Also, the audio playback device 200 responds to the multimedia encoded data playback device 300 with the operation result using the same wireless transmission using an optical signal. Note that the response signal indicating the operation result includes information indicating whether or not the operation of the audio reproduction device 200 has been normally performed according to the operation information from the multimedia encoded data reproduction device 300. The wireless reception unit 310 of the multimedia encoded data reproduction device 300 has a function for receiving this response signal.

  The response signal indicating the state of the audio playback device 200 received by the wireless reception unit 310 is decoded by the reception information decoding unit 311. When the response signal indicates a normal operation, the control unit 305 controls the video data buffer 307 that has been in a standby state in accordance with a predetermined timing, and starts reproducing video data. The predetermined timing is a video playback start timing set in consideration of a delay so that video playback is performed in synchronization with audio playback in the audio playback device 200. As a result, the multimedia encoded data It becomes possible to synchronize the video playback of the playback device 300 with the audio playback of the audio playback device 200.

  On the other hand, when the response signal indicates an abnormal operation (not normally performed), for example, a message using the monitor 308, a warning sound or guidance message using a speaker, or a vibration using a vibration device. For example, the fact that the normal operation has not been performed is notified. At this time, the transmission operation of the operation information and the time information may be repeatedly performed until a predetermined time or number of times has passed again.

  One possible cause of the failure of the optical wireless signal communicated between the multimedia encoded data playback device 300 and the audio playback device 200 is a shift in the optical axis between the two. By notifying that an abnormal operation has occurred, it is possible to notify the user that some sort of malfunction has occurred, and as a result, it is possible to prompt the user to adjust the optical axis. At this time, when a favorable communication state is obtained by adjustment by the user and a good communication state is obtained, the video playback standby state in the multimedia encoded data playback device 300 is slightly extended in order to shift to a normal operation. Synchronous playback itself is performed without problems.

  In addition, when a serious problem (incommunicable state) occurs in a radio signal communicated between the multimedia encoded data reproduction device 300 and the audio reproduction device 200, this incommunicable state is a restriction on wireless communication. Detected by observation of time and number of times. In other words, when normal operation cannot be performed even after a predetermined time has elapsed (when time-out occurs), or even when operation information and time information are transmitted a predetermined number of times, normal operation cannot be performed In this case, an operation invalid message indicating that the normal operation cannot be finally performed may be notified, and the initial state may be returned again.

  Similarly to the above-described communication disabled state, for example, the multimedia playback apparatus is defective, the specified content is incomplete, the data error (for example, lack or damage of audio data related to the content), etc. In the encoded data reproduction device 300, the response can be detected by managing the response signal from the audio reproduction device 200, the time limit and the number of times of wireless communication.

  On the other hand, the audio playback device 200 illustrated in FIG. 3 is the same as the audio playback device 200 illustrated in FIG. 1, and a reconfigured audio stream is stored in the audio stream buffer 202. FIG. 3 also shows details of the components (the post-processing unit 203 shown in FIG. 1) for performing playback processing of the reconstructed audio stream. That is, the audio reproduction device 200 illustrated in FIG. 3 includes an audio stream receiving unit 201, an audio stream buffer 202, a position specifying and data selecting unit 204, a control unit 205, an audio decoding unit 206, an audio data buffer 207, and a speaker 208. A wireless transmission unit 209 and a wireless reception unit 210.

  The wireless reception unit 210 has a function of receiving a control signal (for example, operation information, time information, content identification information, etc.) transmitted from the wireless transmission unit 309 of the multimedia encoded data reproduction device 300. The transmission unit 209 has a function of transmitting a response signal including information on whether or not the operation of the audio reproduction device 200 has been normally performed to the wireless reception unit 310 of the multimedia encoded data reproduction device 300. Yes. Note that the wireless transmission unit 209 and the wireless reception unit 210 of the audio reproduction device 200 use the same wireless transmission scheme as the wireless reception unit 310 and the wireless transmission unit 309 of the multimedia encoded data reproduction device 300, thereby Reception and response signal transmission can be performed.

  Operation information and auxiliary information transmitted from the wireless transmission unit 309 of the multimedia encoded data reproduction device 300 and received by the wireless reception unit 210 of the audio reproduction device 200 are sent to the control unit 205. The control unit 205 decodes the operation information and auxiliary information to determine the operation in the audio playback device 200. For example, when the control signal includes content identification information indicating specific content, time information indicating the position of data to be played back as auxiliary information, and information instructing the start of playback as operation information, the control unit 205 Selects the content specified by the content identification information for the position specification and data selection unit 204, and reads out the audio elementary stream from the start position corresponding to the time information notified from the control unit 205, Instruct to start playback. Note that special playback such as double speed playback and fast forward / rewind processing is also performed based on an instruction from the multimedia encoded data playback device 300.

  In response to an instruction from the control unit 205, the position specification and data selection unit 204 reads the audio elementary stream after the position corresponding to this time information from the audio stream buffer 202 as needed, and reads the read audio stream together with the operation information. The audio decoding unit 206 converts the audio stream into audio data such as linear PCM by performing decoding processing (for example, normal reproduction processing) according to the operation information. The audio data decoded by the audio decoding unit 206 is output from the speaker 208 through a temporary buffer in the audio data buffer 207.

  In addition, the control unit 205 monitors the operation of the entire audio reproduction device 200 and transmits a response signal indicating whether or not the operation of the audio reproduction device 200 has been normally performed to the multimedia encoded data reproduction device 300. It has a function to do. When the audio playback device 200 performs normal processing based on an instruction from the multimedia encoded data playback device 300, the control unit 205 indicates that the operation of the audio playback device 200 has been performed normally. The wireless transmission unit 209 is notified of the response signal, and the wireless transmission unit 209 transmits the response signal to the multimedia encoded data reproduction device 300 by wireless transmission. On the other hand, when the audio playback device 200 does not perform normal processing based on an instruction from the multimedia encoded data playback device 300, the control unit 205 does not perform the operation of the audio playback device 200 normally. The wireless transmission unit 209 is notified of a response signal indicating that the wireless transmission unit 209 has transmitted, and the wireless transmission unit 209 transmits the response signal to the multimedia encoded data reproduction device 300 by wireless transmission.

  When the operation of the audio playback device 200 is not normally performed, the audio playback device 200 includes a reason indicating that the normal operation has not been performed in the response signal, and the multimedia encoded data playback device. You may transmit to 300. The reason why the normal operation is not performed is, for example, the time information given from the multimedia encoded data reproduction device 300 and the time of the audio stream stored in advance in the audio stream buffer 202 when there is no predetermined content For example, inconsistency with information is observed. By transmitting information indicating such a problem to the multimedia encoded data reproduction device 300, it is possible to grasp an abnormal state due to an operation defect in the audio reproduction device 200 on the multimedia encoded data reproduction device 300 side. Thus, it is possible to perform a measure for avoiding this abnormal state.

  Except for the control unit 205 that manages the control signal from the wireless transmission unit 209, the wireless reception unit 210, and the multimedia encoded data reproduction device 300 and controls the operation based on the control signal, the conventional semiconductor memory or HDD The audio reproduction device 200 can be used alone as an audio portable player.

  Next, an example of an operation in the case where synchronized reproduction of multimedia encoded data is performed between the multimedia encoded data reproduction apparatus 300 and the audio reproduction apparatus 200 will be described. As described above, the control unit 305 of the multimedia encoded data reproduction device 300 performs the synchronous reproduction control for the audio reproduction device 200 and the state of the audio reproduction device 200 obtained by bidirectional communication with the audio reproduction device 200. Perform management. Hereinafter, an example of the operation of the control unit 305 will be described with reference to FIG.

  FIG. 4 is a flowchart showing an example of the operation of the control unit of the multimedia encoded data reproduction device when synchronous reproduction is started in the embodiment of the present invention.

  First, the multimedia encoded data reproduction device 300 maintains a standby state until the user inputs an operation command (step S501). When an operation command is input by the user, the operation command is decoded (step S502). First, the multimedia encoded data is read, and separation into a video stream and an auxiliary information stream is started (step S503). Subsequently, video decoding processing with a large delay amount is started (step S504), and video data is once recorded in the video data buffer 307. At this time, the video decoding unit 304 may enter a standby state according to the remaining amount of the buffer, for example, after entering a standby state after decoding a predetermined amount of video data.

  Also, under the control of the control unit 305, when video decoding starts, content identification information of the multimedia encoded data to be reproduced, time information associated with the audio stream, operation information input to the multimedia encoded data reproduction device 300, and the like The configured control signal is wirelessly transmitted from the wireless transmission unit 309 to the audio reproduction device 200 (step S505).

  After transmitting the control signal, the control unit 305 shifts to a standby state for receiving a response signal from the audio playback device 200. When the response signal is received from the audio playback device 200, the control unit 305 decodes the response signal (step S506). If the response signal indicates normal operation, video data reproduction is started at a predetermined timing set in consideration of the delay (step S507). After starting the reproduction of the video data in step S507, the control unit 305 returns to the input standby state for the operation command from the user (step S501).

  On the other hand, if the response signal from the audio playback device 200 indicates an abnormal operation, the process returns to step S505 again through step S508, the control signal is transmitted to the audio playback device 200, and then the audio playback is performed. A transition is made to a standby state for receiving a response signal from the apparatus 200.

  In addition, the multimedia encoded data reproduction device 300 transmits a control signal a plurality of times, thereby, for example, recovering from a simple communication error due to an optical axis shift or the like. It should be noted that it is desirable to provide a time-out limit for receiving a response signal or a control signal transmission limit for a predetermined number of times for the transmission of the control signal multiple times. That is, it is monitored whether or not a predetermined time has elapsed since the first transmission of the control signal, or whether or not the transmission of the control signal has reached a predetermined number of times (step S508). When the transmission is reached, an operation invalid message indicating that the normal operation has not been performed is notified (step S509), and the video data stored in the video data buffer 307 is erased and initialized ( Step S510), again, returns to the input standby state for the operation command from the user (step S501).

  Note that, for example, a serious communication error has occurred and bi-directional communication between the multimedia encoded data playback device 300 and the audio playback device 200 cannot be established, or the desired content is on the audio playback device 200 side. If the time information is not recorded in advance, or if the time information is inconsistent, the operation invalid message is notified without performing a normal operation. The user can confirm the abnormal state by notifying the operation invalid message. For example, by correcting the optical axis deviation or checking the file, the user can perceive that some abnormality has occurred, and can accurately detect it. It is possible to take measures.

  Further, in the flowchart shown in FIG. 4 described above, the operation at the time of starting the synchronous reproduction is illustrated, but the other basic operations such as stop, fast forward, rewind, and pause are almost the same. . FIG. 5 is a flowchart showing an example of the operation of the control unit of the multimedia encoded data playback device when an operation input is performed during synchronous playback in the embodiment of the present invention.

  Even when video data and audio data are played back synchronously in the multimedia encoded data playback device 300 and the audio playback device 200, the multimedia encoded data playback device 300 is in a standby state in which the user inputs an operation command. (Step S601). At this time, for example, when an operation command related to any operation (stop, fast forward, rewind, pause) received during playback is input by the user, the control unit 305 decodes the operation command (step S602). Preceding processing of this operation command (preparation of processing related to this operation command) is executed (step S603), and the process shifts to a standby state.

  Also, under the control of the control unit 305, a control signal including operation information input by the user is wirelessly transmitted from the wireless transmission unit 309 to the audio reproduction device 200 together with the preceding process of the operation command (step S604). Unlike the case of starting synchronous playback, the control signal transmitted when synchronous playback has already been performed does not need to include content identification information, time information, and the like. That is, only operation information indicating a change in the playback state needs to be sent from the multimedia encoded data playback device 300 to the audio playback device 200.

  After transmitting the control signal, the control unit 305 shifts to a standby state for receiving a response signal from the audio playback device 200. When the response signal is received from the audio playback device 200, the control unit 305 decodes the response signal (step S605). If the response signal indicates normal operation, the main processing (actual processing) following the preceding processing performed in step S603 is started in accordance with a predetermined timing set in consideration of the delay (step S603). S606). After starting the reproduction of the video data in step S606, the control unit 305 returns to the input standby state for the operation command from the user (step S601). On the other hand, if the response signal from the audio playback device 200 indicates an abnormal operation, the same processing as steps S508 to S510 of the flowchart shown in FIG. 4 is performed (steps S607 to S609).

  Next, an example of the operation of the audio playback device 200 corresponding to the operation of the multimedia encoded data playback device 300 illustrated in FIGS. 4 and 5 will be described. FIG. 6 is a flowchart showing an example of the operation of the control unit of the audio playback device according to the control signal from the multimedia encoded data playback device in the embodiment of the present invention.

  The audio playback device 200 is in a standby state for receiving a control signal from the multimedia encoded data playback device 300 (step S701). When a control signal is received from the multimedia encoded data reproduction device 300, the operation command included in the control signal is decoded (step S702), and it is determined whether or not the operation command can be executed (step S702). Step S703). In this determination, for example, whether the content identification information included in the control signal can be decoded, whether the audio stream of the content is recorded in the audio stream buffer 202 in advance, or the time information included in the control signal is the audio stream. Whether there is an audio stream in the buffer 202 or whether the information included in the control signal is consistent is referred to.

  When it is determined in step S703 that the operation command can be executed, the control unit 205 of the audio playback device 200 performs control so as to execute an operation related to the operation command (step S704), and the multimedia code Normal operation information indicating that a normal operation has been performed is issued to the structured data reproduction device 300 (step S705). On the other hand, when it is determined in step S703 that the operation command is not executable, the control unit 205 of the audio reproduction device 200 performs control so as to execute an operation related to the operation command (step S704). Abnormal operation information (error information) indicating that the operation related to the operation command cannot be executed is issued to the multimedia encoded data reproduction device 300 (step S706). Then, the control unit 205 generates a response signal including the normal operation information or the abnormal operation information, and the response signal is wirelessly transmitted from the wireless transmission unit 209 to the multimedia encoded data reproduction device 300 (step S707). ).

  Next, an example of each timing of the audio playback device 200, the multimedia encoded data playback device 300, and the input of the operation command by the user will be described. FIG. 7A is a timing chart showing an example of each timing of input of an operation command by an audio playback device, a multimedia encoded data playback device, and a user when a playback command is input in the embodiment of the present invention. FIG. 5 is a timing chart showing an example of timings of input of an operation command by an audio playback device, a multimedia encoded data playback device, and a user when a stop command is input in the embodiment of the present invention. 7A and 7B show the flow of time from the left to the right of the drawing. On this time axis, the audio playback device, the multimedia encoded data playback device, and the input of the operation command by the user, respectively. The timing of is shown. 7A and 7B illustrate a case where normal operation is performed.

  In FIG. 7A, the audio playback device 200 is in a standby mode that waits for a control signal from the multimedia encoded data playback device 300, and the multimedia encoded data playback device 300 waits for a command from the user. It is in the state of. In this state, when the multimedia encoded data playback device 300 receives a playback command from the user, the multimedia encoded data playback device 300 performs video decoding processing and stores the decoded video data in the video data buffer. The control signal including the playback command is transmitted to the audio playback device 200 while being stored. In addition, after transmitting the control signal, the multimedia encoded data playback device 300 enters a status reply standby state from the audio playback device 200.

  After receiving the control signal from the multimedia encoded data playback device 300, the audio playback device 200 decodes the operation command (playback command) in the control signal, starts the audio decoding process, and starts normal operation A response signal (audio status) including normal operation information for notifying that it has been sent is sent back to the multimedia encoded data reproduction device 300.

  The multimedia encoded data playback device 300 that has received the response signal confirms normal operation information included in the response signal and starts video playback. In addition, audio playback is also started in the audio playback device 200 at timing synchronized with the video playback start processing (timing at which video playback and / or audio playback start timing is set in consideration of delay). As a result, synchronized playback of audio and video is started. Thereafter, the audio playback device 200 and the multimedia encoded data playback device 300 transition to the standby mode again.

  In FIG. 7B, the audio playback device 200 and the multimedia encoded data playback device 300 perform synchronized playback. At this time, as described above, the audio playback device 200 and the multimedia encoded data playback device 300 are in the standby mode. In this state, when the multimedia encoded data playback device 300 receives a stop command from the user, the multimedia encoded data playback device 300 transmits a control signal including the stop command to the audio playback device 200. In addition, after transmitting the control signal, the multimedia encoded data playback device 300 enters a status reply standby state from the audio playback device 200.

  After receiving the control signal from the multimedia encoded data playback device 300, the audio playback device 200 decodes the operation command (stop command) in the control signal and notifies that the operation has started normally. A response signal (audio status) including information is returned to the multimedia encoded data reproduction device 300.

  Receiving the response signal, the multimedia encoded data playback device 300 confirms normal operation information included in the response signal and stops video playback. Audio playback is also stopped in the audio playback device 200 at timing synchronized with the video playback stop processing (timing at which video playback and / or audio playback start timing is set in consideration of delay). Thereby, the synchronized playback of audio and video is stopped. Thereafter, the audio playback device 200 and the multimedia encoded data playback device 300 transition to the standby mode again.

  Note that the multimedia encoded data playback device 300 and the audio playback device 200 are physically separated devices and have different reference operating frequencies, so that there may be a time lag between the operations. . In general, this deviation depends on the clock accuracy of the apparatus, but since this deviation is minute, it may take time for the user to perceive the deviation. Therefore, after synchronizing the playback start timing by sending a control signal only when starting playback for the first time, the video and audio are basically kept in sync as they are. It is also possible to make the playback device self-run.

  On the other hand, especially when the playback time of the content is long, there is a possibility that a gap between the video and the audio will occur to the extent that the user can perceive. In order to deal with such a deviation, the time information is periodically transmitted from the multimedia encoded data reproduction device 300 to the audio reproduction device 200, and the audio reproduction device 200 detects the deviation of the synchronous reproduction, and the multimedia reproduction is performed. It is also possible to perform audio playback time management according to the time information periodically sent from the encoded data playback device 300. When the deviation is detected, the audio playback device 200 appropriately selects the audio data while taking care not to give the user a sense of incongruity as in the conventional technique (the technique disclosed in Patent Document 1), for example. By inserting or deleting as many samples as possible, it is possible to keep video and audio synchronized at all times by periodically correcting the deviation.

  Further, when the user perceives the shift, the user himself / herself issues a shift correction instruction, whereby a reproduction start command is transmitted again from the multimedia encoded data playback device 300 to the audio playback device 200, and video and audio are transmitted. It is also possible to re-set the synchronized playback. The resetting of the synchronization by the user operation is to correct the deviation as necessary. Therefore, transmission of time information from the multimedia encoded data playback device 300 to the audio playback device 200 is performed only when resetting of synchronous playback is necessary, and the synchronous playback is maintained by the minimum necessary wireless transmission. Has the advantage of being possible.

  Further, in the bidirectional communication between the multimedia encoded data reproduction device 300 and the audio reproduction device 200, a radio transmission method using radio waves may be adopted instead of optical wireless communication. The present invention does not perform audio data transmission in real time as in the prior art, but between the multimedia encoded data reproduction device 300 and the audio reproduction device 200, a control signal and a response signal with a very small amount of transmission. It can be said that the possibility of affecting the surroundings is extremely small even in an environment where only exchange is performed and the use of radio waves is not preferable.

  As described above, according to the present invention, in a viewing environment using a video playback device and an audio playback device that are physically separated from each other, subordinates can be obtained from multimedia encoded data including video data and audio data in advance. By separating audio encoded data with time information added as information and transmitting it to an audio playback device, video data and audio data can be played back synchronously without real-time data transfer, maintaining wireless convenience. In this way, the content of the multimedia encoded data can be enjoyed even in an unfavorable situation of wireless transmission.

  As described above, according to the present invention, in a state where the multimedia encoded data playback device (video playback device) and the audio playback device are physically separated and connected wirelessly, When the audio data is reconstructed from the multimedia encoded data in advance by the multimedia encoded data separating and transmitting apparatus, the reconstructed audio data is stored in the audio reproducing apparatus in advance, and the content is reproduced. The reproduction start command (or other operation command) is transmitted from the multimedia encoded data reproduction device to the audio reproduction device at a timing taking delay into consideration in real time. Video data and audio data without wireless transmission of audio data It is possible to realize synchronized playback. In addition, the audio playback device returns a response signal indicating whether or not the operation based on the control signal has been normally performed in response to the control signal received from the multimedia encoded data playback device, for example. This makes it possible to recognize when the operation is not performed normally and to detect the cause early.

  Note that the configurations and operations described in the above embodiment are merely examples, and the present invention is not limited to the description of the above embodiment. In addition, each component of the block diagram illustrated for explaining the present invention represents a function, and each of these components can be realized by hardware, software, or a combination of hardware and software. It is.

  Moreover, according to this invention, the following aspect is also provided.

According to a fifth aspect of the present invention, in the first to third aspects of the present invention, the video data storage means for temporarily storing the video data generated by the decoding processing of the video decoding means. Have
The video reproduction control means is configured to start the video output by instructing the output start of the video data decoded in advance by the video decoding means and stored in the video data storage means. A video playback device is provided.

According to a sixth aspect of the present invention, in the first to third aspects of the present invention, the video encoded data for temporarily storing the video encoded data supplied to the video decoding means. Having storage means;
The video playback device is configured to start the video output by instructing the output start of the video encoded data stored in the video encoded data storage unit in advance. Is provided.

  According to a seventh aspect of the present invention, in the first to third, fifth, and sixth aspects of the present invention, the wireless signal transmitting means and the wireless signal receiving means use optical wireless transmission using infrared rays. Provides a video playback device configured to transmit wireless signals.

  According to an eighth aspect of the present invention, in the first to third, fifth, sixth, and seventh aspects of the present invention described above, the video reproduction control means wirelessly communicates with the predetermined audio reproduction device. There is provided a video playback apparatus configured to start the video output at a timing set in consideration of a transmission delay.

  According to the ninth aspect of the present invention, in the fourth aspect of the present invention, when it is determined by the operation execution determining means that it is impossible to start the operation normally, An audio playback device is provided in which the response signal generating means is configured to generate the response signal including information indicating a reason why the operation cannot be normally started.

  According to a tenth aspect of the present invention, in the fourth and ninth aspects of the present invention described above, the wireless signal transmitting means and the wireless signal receiving means transmit a wireless signal by optical wireless transmission using infrared rays. An audio playback device configured to perform transmission is provided.

  The present invention limits the use of radio waves, such as in highly public places, while the video playback apparatus and the audio playback apparatus exist in physically separated locations and remain connected wirelessly. Even in an environment where video data and audio data are synchronized with a simple configuration, the convenience of wireless connection can be maintained, the cost of the device can be reduced, and the size and weight of the device can be reduced. Technology for enabling synchronized playback of video data and audio data contained in one multimedia encoded data in a video playback device and an audio playback device that are physically separated from each other It is applicable to.

In the embodiment of the present invention, it is a block diagram showing an example of the configuration of a multimedia encoded data separation and transmission apparatus and an audio playback apparatus that perform processing according to the previous process stage. In the embodiment of the present invention, it is a block diagram showing an example of the configuration of a multimedia encoded data playback device and an audio playback device that performs processing related to a post-process stage. In an embodiment of the invention, it is a block diagram showing an example of composition of an audio reproducing device which performs processing concerning a post process stage. In the embodiment of the present invention, it is a flowchart showing an example of the operation of the control unit of the multimedia encoded data playback device when starting synchronized playback. In the embodiment of the present invention, it is a flowchart showing an example of the operation of the control unit of the multimedia encoded data playback device when an operation input is performed during synchronous playback. In the embodiment of the present invention, it is a flowchart showing an example of the operation of the control unit of the audio playback device according to the control signal from the multimedia encoded data playback device. 5 is a timing chart illustrating an example of timings of input of an operation command by an audio playback device, a multimedia encoded data playback device, and a user when a playback command is input according to an embodiment of the present invention. It is a timing chart which shows an example of each timing of the audio | voice reproduction apparatus at the time of the stop command input in embodiment of this invention, a multimedia coding data reproduction | regeneration apparatus, and the input of the operation command by a user. It is a block diagram which shows an example of the multimedia coding data reproducing | regenerating apparatus based on a prior art. It is a block diagram which shows an example of the separation type | mold multimedia coding data reproduction apparatus based on a prior art. It is an external view which shows an example of the separation type | mold multimedia coding data reproduction apparatus based on a prior art.

Explanation of symbols

100 Multimedia Encoded Data Separation / Transmission Device 101, 301, 1001, 2101 Multimedia Stream Buffer 102, 302, 1002, 2102 System Stream Separation Unit 103, 202 Audio Stream Buffer 104 Auxiliary Information Buffer 105 Audio Stream Reconstruction Unit 106 Audio Stream Transmission unit 200, 2002 Audio playback device 201 Audio stream reception unit 203 Post-processing unit 204 Position specification and data selection unit 205, 305, 1005, 2105 Control unit 206 Audio decoding unit 207, 1006, 2106, 2203 Audio data buffer 208, 1008, 2204 Speaker 209, 309 Wireless transmission unit 210, 310 Wireless reception unit 300, 1000 Multimedia A coded data reproduction apparatus (video playback device)
303 Auxiliary information extraction unit 304, 1004, 2104 Video decoding unit 306 Auxiliary information / operation information generation unit 307, 1007, 2107 Video data buffer 308, 1009, 2109 Monitor 311 Reception information decoding unit 1003, 2103, 2202 Audio decoding unit 2001 Multi Media encoded data reproduction / transmission device 2110 Audio data transmission unit 2201 Audio data reception unit 3001 Main unit 3002 Headphone

Claims (4)

Recording medium on which multimedia encoded data in which video encoded data, audio encoded data, and auxiliary information including time information for managing the reproduction time of each encoded data are multiplexed is recorded From the multimedia encoded data reading means for reading the multimedia encoded data,
Operation input means for inputting an external instruction relating to the reproduction operation of the multimedia encoded data;
The multimedia encoded data includes the auxiliary information including time information indicating the playback position related to the playback operation input by the operation input means and operation information for instructing to start the playback operation. Wireless signal transmission means for wirelessly transmitting to a predetermined audio reproduction device in which the audio encoded data is stored in advance;
Radio signal receiving means for receiving, via the radio, a response signal indicating whether or not normal operation can be performed in response to the start instruction of the reproduction operation from the predetermined audio reproduction device;
Referring to the response signal, response signal decoding means for decoding whether or not the predetermined audio reproduction device can normally start the operation in response to the instruction to start the reproduction operation;
Video decoding means for performing decoding processing after the reproduction position related to the reproduction operation input by the operation input means with respect to the video encoded data included in the multimedia encoded data;
Video display means for visually displaying video based on video data generated by the decoding process of the video encoded data in the video decoding means;
Judging that the response signal is decoded by the response signal decoding means, it is determined that the response signal indicating that the predetermined audio reproduction device can normally start the operation in response to the instruction to start the reproduction operation is received. Video playback control means for controlling to start video output after the playback position related to the playback operation input by the operation input means,
Having video playback device. When the response signal is decoded by the response signal decoding means, the response signal indicating that the predetermined audio reproduction device cannot normally start the operation in response to the reproduction operation start instruction is received. Radio signal transmission control means for controlling to repeatedly transmit the auxiliary information and the operation information until a predetermined time elapses or exceeds a predetermined number of times, if determined,
Even if the predetermined time has elapsed or the predetermined number of times has been exceeded, the response signal indicating that the normal operation can be performed in response to the start instruction of the reproduction operation from the predetermined audio reproduction device Video playback standby control means for controlling to stop the playback operation input by the operation input means,
The video playback device according to claim 1, comprising:   When a response signal indicating that normal operation cannot be started in response to the playback operation start instruction is received from the predetermined audio playback device, and / or until a predetermined time elapses or predetermined If the response signal indicating that the normal operation can be performed in response to the start instruction of the playback operation from the predetermined audio playback device even if the number of times has been exceeded, The video playback apparatus according to claim 2, further comprising notification means for performing notification. From the multimedia encoded data in which video encoded data, audio encoded data, and auxiliary information including time information for managing the reproduction time of each encoded data are multiplexed, the audio encoded data and Data storage means for storing the audio encoded data and the auxiliary information reconfigured so that audio reproduction of the audio encoded data is performed after the auxiliary information is once separated;
Radio signal receiving means for receiving the auxiliary information including time information indicating a reproduction position related to a reproduction operation and operation information for instructing to start the reproduction operation from a predetermined video reproduction device via radio;
An operation execution determination unit that determines whether or not the operation can be normally started in response to the instruction to start the reproduction operation with reference to the auxiliary information and the operation information received by the wireless signal reception unit; ,
Response signal generating means for generating a response signal indicating whether or not the operation can be normally started in response to the instruction to start the reproduction operation based on the determination result in the operation execution determining means;
Wireless signal transmitting means for wirelessly transmitting the response signal generated by the response signal generating means to the predetermined video playback device;
The audio encoded data stored in the data storage unit when it is determined by the determination in the operation execution determination unit that the operation can be normally started in response to the reproduction operation start instruction. An audio decoding means for performing a decoding process after the reproduction position related to the reproduction operation;
Audio output means for outputting the audio encoded data decoded by the audio decoding means;
Audio playback device having.