JP5596473B2 - Video content playback apparatus, control method therefor, program, and recording medium - Google Patents

Description

  The present invention relates to a video content reproduction apparatus, a control method thereof, a program, and a recording medium that enable selection of a desired video content from a plurality of video contents by thumbnail display.

  2. Description of the Related Art Conventionally, in a recorder apparatus or the like that records video content on a recording medium, in order to display a large number of video content as a list, one frame of a moving image of the video content is reduced and displayed as a still image representing the video content. ing. An image representative of such video content is generally called a thumbnail. When a plurality of video contents are recorded, a plurality of thumbnails are displayed as a list on one screen, and this list display allows the user to select desired video contents.

  On the other hand, the amount of video content recorded on a recording medium or accessible via a network is steadily increasing against the background of increasing capacity of recording media and speeding up of communication lines in recent years. . When the number of video contents increases in this way, thumbnail display using still images is insufficient to access desired contents. This is because in the state of recording a large number of video contents, the contents of all video contents are not necessarily grasped individually before viewing, and they do not have knowledge beyond vague images about video contents before viewing. Because there are many. Examples of such cases include viewing video content that has been automatically recorded according to user preferences, or viewing video content created by an individual without the user having to individually set recording settings. And so on. In order to efficiently search for the target video content at such times, it is effective to search while viewing a moving image that clearly represents the content of the video content in the list display, that is, a moving image thumbnail.

  An example of a list display by moving image thumbnail is shown in FIG. In this way, when displaying a plurality of video contents, since it is a search application, it can be said that the audio of each video content does not necessarily need to be output, but by outputting the audio for the selected video content, It can be said that user convenience is improved. In that case, it is desirable that the selected video content is output immediately after being operated by the user in synchronization with the moving image. In order to realize such synchronization of moving image and sound (AV synchronization), generally, the processing timing of both is adjusted based on time information added to each of moving image data and sound data. It has been broken. As a result, since it is only necessary to synchronize both at the time of output, it is sufficient to synchronize somewhere in the process. For example, in Patent Document 1, when a stream of video content is read from a recording medium, a method of outputting at a timing similar to the input timing of the stream (a reading method based on a time stamp) and an input according to the amount of data in the buffer By switching between the reading method for adjusting the AV, the AV synchronization is realized at a stage before data is input to each decoder.

JP 2006-115245 A

  The reading method based on the time stamp requires random access to the recording medium based on the address of the data recording destination, so that it is easy to apply when reading data from the recording medium. When playing while receiving, it is difficult to apply. This is because a mechanism for realizing reading based on the time stamp must be incorporated not only in the terminal serving as the reception side but also in the server serving as the transmission side. For example, HTTP is used in a server that is widely used. In this case, after a request for data acquisition, the playback terminal receives data transmitted by the server. Unless the protocol is implemented on the server side, only the method of reading while monitoring the data amount in the buffer can be used, and it is difficult to match the time information of the moving image and the sound before decoding. In the end, it is practical to perform AV synchronization not before the video content data is read but before output.

  By the way, in the list display of moving image thumbnails, when the processing amount for a plurality of video contents is larger than the allocated resource amount, reproduction at a display rate (moving image frame rate) determined in the moving image content is possible. In some cases, it is difficult to execute slow playback and skip playback as an alternative. In particular, skip playback tends to increase the frame interval of moving images. For example, as shown in FIG. 11, the frame f1 of the moving image displayed at the time of user operation (time tc seconds), the frame f2 being decoded, and the frame f3 being separated from the video content stream For example, if the interval of each time information is 2 seconds, the display time of f3 is tc + 4. The buffer used for reading the video content stream stores the data around the frame f3, and the audio data that can be read out at the time of tc is in the vicinity of tc + 4 seconds. Even if the decoding of the audio data ends early, the time until the audio is output after the user's operation becomes long.

  The present invention has been made in view of the above circumstances, and is a video content access method (access to a recording device, net access) and a video thumbnail playback method (normal playback and low-load skip, slow playback). Regardless of the user's operation, the video content playback apparatus and the video content playback apparatus that performs the synchronization processing of the moving image and the sound promptly after the user's operation and starts the audio output, thereby improving the responsiveness to the operation and improving the user's convenience A control method, a program, and a recording medium are provided.

  The video content reproduction apparatus of the present invention includes a data acquisition unit that receives an input of a video content stream, a stream processing unit that acquires a moving image stream and an audio stream from the video content stream, and a decoding unit that decodes the moving image stream. A moving image decoding unit for obtaining a decoded moving image frame; a first operation for adjusting an output of the decoded moving image frame based on time information; and a second operation for outputting the decoded moving image frame regardless of the time information. An image output unit that executes an operation, an audio decoding unit that decodes the audio stream and obtains decoded audio data, and an audio output unit that outputs the decoded audio data. The audio stream is acquired from the video content stream in response to the video content stream, and the image output unit receives the decoded audio data. There and switches the operation when it is input to the audio output unit to the second operation from the first operation.

  The image output unit may switch the operation from the first operation to the second operation when the audio output unit starts outputting the decoded audio data.

  The video output unit stores time information of the decoded moving image frame in the second operation, and the audio output unit refers to the time information of the decoded moving image frame and starts outputting the decoded audio data. It may be determined.

  The audio output unit calculates a difference between an output start time of the decoded audio data and time information of the decoded moving image frame, and the image output unit calculates time information of the decoded moving image frame in the first operation. You may make it correct | amend by the said difference.

  The switching from the first operation to the second operation may be performed only when the time information interval of the decoded moving image frame input to the image output unit exceeds a predetermined value.

  When displaying a list of a plurality of video contents, the image output unit may perform switching from the first operation to the second operation only for the video content to be output.

  The video content playback apparatus control method of the present invention is a video content playback apparatus control method for displaying a video content thumbnail, a data acquisition step for receiving an input of a video content stream, and a video from the video content stream. A stream processing step of acquiring an image stream and an audio stream; a moving image decoding step of decoding the moving image stream to obtain a decoded moving image frame; and a first adjusting the output of the decoded moving image frame based on time information And an image output step for executing the second operation for outputting the decoded moving image frame irrespective of the time information, an audio decoding step for decoding the audio stream and obtaining decoded audio data, and the decoding An audio output step of outputting audio data, and the stream In the processing step, the audio stream is acquired from the video content stream in response to a user operation, and in the image output step, the operation is performed when the decoded audio data is input in the audio output step. To the second operation.

  In the image output step, the operation may be switched from the first operation to the second operation when output of the decoded audio data is started in the audio output step.

  In the video output step, time information of the decoded video frame is stored in the second operation, and in the audio output step, output of the decoded audio data is started with reference to time information of the decoded video frame. It may be determined.

  In the audio output step, a difference between the output start time of the decoded audio data and the time information of the decoded video frame is calculated, and in the image output step, the time information of the decoded video frame is calculated in the first operation. You may make it correct | amend by the said difference.

  A program according to the present invention is a program for causing a computer to execute the control method of the video content reproduction apparatus.

  The recording medium of the present invention is a computer-readable recording medium on which the above program is recorded.

  According to the present invention, regardless of the method for accessing video content (access to a recording device, net access) and the method for reproducing a video thumbnail (normal playback, low-load skip, slow playback), the user can quickly operate after the operation. By performing the synchronization processing of the moving image and the sound and starting the sound output, the responsiveness to the operation can be improved and the convenience for the user can be improved.

It is a block diagram which shows the structural example of the video content reproduction apparatus which concerns on embodiment of this invention. It is a figure which shows the system configuration example to which the video content reproduction apparatus which concerns on embodiment of this invention is applied. It is a figure which shows the state transition in operation | movement of the video content reproduction apparatus which concerns on embodiment of this invention. It is a flowchart which shows the operation example of the video content reproduction apparatus which concerns on embodiment of this invention. It is a schematic diagram which shows the operation example of the video content reproduction apparatus which concerns on embodiment of this invention. It is a figure which shows the change of the display time in the video content reproduction apparatus which concerns on embodiment of this invention. It is a flowchart which shows the operation example of the video content reproduction apparatus which concerns on embodiment of this invention. It is a flowchart which shows the operation example of the audio | voice output part of the video content reproduction apparatus which concerns on embodiment of this invention. It is a figure for demonstrating operation | movement of the video content reproduction | regeneration measure which concerns on embodiment of this invention. It is a figure which shows the example of a screen of the list display which concerns on embodiment of this invention. It is a figure which shows an example of the time difference of the process timing in each process.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration example of a video content reproduction apparatus 100 according to the embodiment of the present invention. Here, as an example, the number of video content streams to be processed simultaneously is four.

  The video content reproduction apparatus 100 includes a data acquisition unit 101 that acquires a video content stream, a stream processing unit 102 that analyzes and demultiplexes the video content stream data, and a video decoding unit 103 that decodes video data. , A decoding control unit 104 that controls the operation of the moving image decoding unit 103, an audio decoding unit 106 that decodes audio data, an image output unit 105 that adjusts the output timing of a plurality of moving images, and an audio output that outputs audio Unit 107 and a control unit 108 that controls each of the above-described units.

  Each unit, which is a component of the present invention, is realized by, for example, hardware configured by a microprocessor, a memory, a bus, an interface, a peripheral device, and the like, and software that can be executed on these hardware. A part or all of the hardware can be mounted as an integrated circuit / IC (Integrated Circuit). In this case, the software may be stored in the memory. In addition, all of the components of the present invention may be configured by hardware, and in that case as well, part or all of the hardware can be mounted as an integrated circuit / IC chip set. It is.

  Although not shown, each of the data acquisition unit 101, the stream processing unit 102, the moving image decoding unit 103, the image output unit 105, the audio decoding unit 106, and the audio output unit 107 is a buffer area for storing input processing target data Are allocated in memory. These buffer areas may be arranged collectively in one place in terms of configuration, but for convenience, they are treated as being provided in each part and will be referred to as internal buffers.

  The data acquisition unit 101 is means for acquiring video content stream data from an external device. The data acquisition unit 101 acquires stream data, for example, by accessing a moving image file placed in a recording medium or by making a request to a server via a network.

  The stream processing unit 102 reads the stream data from the data acquisition unit 101, analyzes the header, and acquires moving image stream data and audio stream data multiplexed on the stream data based on the analysis result. The stream processing unit 102 outputs the acquired moving image stream data to the moving image decoding unit 103 and outputs the audio stream data to the audio decoding unit 106. Here, it is assumed that the moving image stream is processed by the number of stream data to be processed, and only one of the audio stream data is processed. Each frame of moving image / sound is accompanied by time information indicating the time to be presented, and the stream processing unit 102 adds the time information when outputting moving image stream data or audio stream data. (A set of audio data composed of a predetermined number of samples is called a frame).

  The moving image decoding unit 103 decodes one frame of the moving image from the input moving image stream data. The time information added to the moving image stream data designates the timing (display time) for displaying the decoded moving image frame, and is output to the image output unit 105 together with the decoded frame. The moving image decoding unit 103 also calculates a delay amount indicating how much the end of the decoding process is delayed with respect to the display time, and outputs the delay amount to the decoding control unit 104. The moving picture decoding unit 103 can change the decoding operation under the control of the decoding control unit 104. Depending on the decoding operation, the moving picture decoding unit 103 rewrites and outputs the frame time information.

  The decoding control unit 104 determines whether or not there is a delay in the decoding process based on the delay amount input from the moving image decoding unit 103. When a delay occurs, the decoding control unit 104 reduces the processing amount per unit time. The operation of the image decoding unit 103 is controlled (here, the operation of the moving image decoding unit 103 is referred to as a reproduction mode). In addition, when the control unit 108 receives designation of video content to be played with priority from other video content, the video content is played at the normal rate regardless of the playback mode at that time. Control to be The normal rate refers to a playback rate (frame rate) of stream data of video content.

  The image output unit 105 performs output processing for displaying the input moving image frame on the display device. Either an operation for adjusting the display timing based on the time information added to the moving image frame (first operation) or an operation for processing the moving image frame regardless of the time information (second operation) is performed. For external output, the frame data format, color format, etc. are converted as necessary. For example, when the frame is Y, U, V color space data and the display is the R, G, B color space, conversion from YUV to RGB is performed.

  The audio decoding unit 106 decodes one frame of audio from the input audio stream data. By repeating this, the audio decoding unit 106 obtains a series of audio frames to be output together with the moving image thumbnail from the audio stream data. The audio output unit 107 outputs the audio data input from the audio decoding unit 106. The image output unit 105 and the audio output unit 107 share the internal state of each of them, and have a function of synchronizing with a frame output of a moving image that becomes a pair at the time of audio output.

  The control unit 108 preferentially designates one video content from a plurality of video content. The priority designation is performed based on, for example, control information acquired from the outside by the control unit 108 or operation information generated by the operation device by a user operation.

  As described above, the video content processing apparatus 100 can process a plurality of video contents and display them simultaneously. For example, as shown in FIG. 2, a recording device (recording medium and its reading device), a communication device, an operation device, a display, and a speaker are connected to display a plurality of video contents on the display as shown in FIG. Then, it is possible to output a sound accompanying the selected video content from the speaker.

  FIG. 3 shows a transition example of the internal state in the operation of the video content reproduction apparatus 100. In FIG. 3A, it is in an initial state after startup. In this example, when video content to be processed is designated and display of a moving image thumbnail is started, the internal state transitions to a playback state without priority designation. In this state, all video content is not prioritized and no audio is displayed. A display example of the screen is as shown in FIG. The video content playback apparatus 100 maintains normal playback if the load is smaller than the processing capability, and performs slow playback or skip playback according to the amount of delay that has occurred when the load exceeds the processing capability. If priority designation is made in this state, a transition is made to a playback state with priority designation. In this state, one video content is preferentially processed and audio is output. A display example of the screen is as shown in FIG. If priority designation is canceled in this state, a transition is made to a playback state without priority designation. When video content with priority designation is changed, the video content to be processed with priority is changed without changing the state with priority designation. A display example of the screen is as shown in FIG.

  FIG. 4 is a flowchart showing an operation related to reproduction of video content. This flowchart shows the operations of the data acquisition unit 101, the stream processing unit 102, and the moving image decoding unit 103 in the playback state without priority designation in FIG.

  In step ST401, the control unit 108 specifies video content to be played back and designates the video content to the stream processing unit 102. For example, the video content recorded as a file in the recording medium is read, or the name of the usable video content is acquired by accessing a server on the network. Further, the system timer value (system time) counted using the internal clock is initialized.

  In step ST402, the stream processing unit 102 analyzes the video content stream, and acquires information about the moving image and the audio stream. The information that can be acquired here is, in the case of a moving image, the resolution, frame rate, encoding method, offset value indicating from which position in the stream data the data for one frame of data can be acquired, and the time for display. Information (hereinafter, time information indicating the display timing of moving image frames is referred to as display time).

  In step ST403, the control unit 108 determines whether or not all the processing of the video content data to be reproduced has been completed. If it has been completed, the control unit 108 ends the operation. If not, the process proceeds to step ST404.

  In step ST404, the stream processing unit 102 extracts moving image stream data from the stream data of the video content after the end of the stream analysis, processes the time information added to the moving image stream data as necessary, and converts the original time The information is added to the moving image stream data together with the information and output to the moving image decoding unit 103.

  In step ST405, the moving picture decoding unit 103 determines whether or not the display time needs to be rewritten. If necessary, the process proceeds to step ST406, and if not necessary, the process proceeds to step ST407.

  In step ST406, the moving image decoding unit 103 rewrites the input time information based on the reproduction mode specified by the decoding control unit 104. Here, the playback mode indicates any one of normal playback, slow playback, and skip playback. For example, when the playback speed in slow playback is twice that of normal playback, the difference between the previously input display time and the current display time is doubled and added to the previously output display time for output.

  In step ST407, the moving image decoding unit 103 determines whether or not to perform moving image data decoding processing. If not, the moving image decoding unit 103 returns to step ST403, and if yes, proceeds to step ST408.

  In step ST408, the moving image decoding unit 103 decodes moving image stream data. When the operation mode is normal reproduction and slow reproduction, decoding is performed in the order input from the stream processing unit 102. In the case of skip reproduction, the moving image stream data is examined before decoding processing, and the encoding type is acquired. Here, the encoding type indicates whether the stream data of one moving image frame can be decoded only with the stream data of the frame (intra frame) or whether information of another frame is used (inter frame). In skip reproduction, for example, only stream data with an encoding type of intra frame is decoded. Alternatively, only stream data of a frame that is not referred to when other frames are decoded is decoded.

  In step ST409, the moving image decoding unit 103 acquires the system time after the decoding process is completed, calculates the delay amount with respect to the display time, and returns to step ST403.

  The decoding control unit 104 operates independently of the operation shown in the flowchart of FIG. 4 and monitors the delay amount from the moving image decoding unit 103. If it is determined that a delay has occurred from the amount of delay, the operation mode of each moving image decoding unit 103 is changed in the direction of light load in the order of normal → slow → skip, and there is no delay, so there is sufficient processing margin. If it is determined that there is, it is changed to a direction with a larger load. It is assumed that the delay occurs, for example, when the delay amount exceeds a threshold value or when the delay amount continues to increase for a predetermined time.

  The image output unit 105 adjusts the output timing for display according to the output of the moving image frame and the time information from each moving image decoding unit 103. For example, as a result of comparing the acquired system time with the display time of the decoded video frame, if the difference between the system time and the display time is less than or equal to a predetermined threshold value, or the display time is delayed with respect to the system time If so, a decoded frame is output.

  The display time and system time will be described with reference to FIGS. Here, it is assumed that the control unit 108 initializes the system time to T0 at the start of the reproduction process. The stream processing unit 102 derives Tv (i) from the display time tv (i) attached to the stream data. Here, i is the frame number of the moving image, and d is an offset value for delaying the display time by a fixed time. The display time Tv (i) is an actual display time based on the system time T0.

  The stream processing unit 102 adds the two display times tv (i) and Tv (i) to the moving image stream, and outputs them to the moving image decoding unit 103. The moving picture decoding unit 103 rewrites Tv (i) to Tv ′ (i) by executing playback control. Tv (i) and rewritten Tv ′ (i) are added to the decoded moving image frame and output to the image output unit 105. Assuming that the system time at the end of the decoding process is T1, the moving picture decoding unit 103 outputs Tv ′ (i) −T1 as a delay amount. The moving image decoding unit 103 outputs Tv ′ (i) to the image output unit 105 as the display time.

  In the case of FIG. 6A, T1 <Tv ′ (i), and the image output unit 105 outputs the decoded frame when the system time reaches Tv ′ (i).

  FIG. 6B shows an example in which a delay occurs at the system time T2> Tv ′ (i) at the end of the decoding process. In this case, the image output unit 105 outputs the decoded frame immediately after the decoded frame is input from the moving image decoding unit 103. The two display times attached to the stream data are stored in the image output unit 105, and are used for synchronization with the audio stream when priority is designated.

  In the playback state with priority designation in FIG. 3, audio is output with priority given to one video content. In this case, not only the moving image stream data but also the audio stream data is acquired in step ST404, and the audio decoding unit 106 executes the decoding process. Furthermore, the decoding control unit 104 sets the operation mode of the moving image decoding unit 103 that processes the preferentially specified video content to normal playback regardless of the state of other video content.

  FIG. 7 is a flowchart showing the flow of processing at the time of state transition from no priority designation to priority designation. When the process starts, in step ST701, the control unit 108 acquires audio stream data from the stream processing unit 102 (hereinafter referred to as a priority-designated stream processing unit) that processes a stream of video content that has been designated by priority. And the decoding control unit 104 is instructed to process all frames of the moving image stream of the video content.

  In step ST702, the priority-designated stream processing unit 102 acquires the display time of the moving image stream processed in the past in the most processed moving image stream.

  In step ST703, the priority-designated stream processing unit 102 determines the display time of the audio stream to be acquired based on the display time acquired in step ST702. The display time handled here is different from the final display time Tv ′ (i) handled by the image output unit 105, and is a value tv that is multiplexed with the video content stream data along with the moving image stream data. (I). Based on the display time tv (i) of the moving image stream, for example, the display time of the nearest audio stream is calculated, and this is set to ta (j).

  In step ST704, the stream processing unit 102 searches the internal buffer for audio stream data having the display time ta (j), determines that the audio can be extracted if the corresponding audio stream data is found in the internal buffer, and proceeds to step ST705. In step ST704, if the corresponding audio stream data is not found in the internal buffer, it is determined that the audio cannot be extracted. When the data in the internal buffer is updated again, the audio stream data is searched from the internal buffer. At the time when an audio stream suitable for the condition can be searched, the moving image and the audio are not necessarily synchronized. When the stream processing unit 102 outputs the audio stream data to the audio decoding unit 106 later in step ST705, the stream processing unit 102 attaches the display time ta (j).

  In step ST705, the priority-designated stream processing unit 102 acquires both the moving image stream and the audio stream data from the internal buffer. On the other hand, the stream processing unit 102 without priority designation continues the same operation as before (reproduction information without priority designation). The acquired moving image stream is sent to the corresponding internal buffer of the moving image decoding unit 103, and the audio stream data is sent to the internal buffer of the audio decoding unit 106 and decoded as appropriate.

  In step ST706, the audio output unit 107 determines whether or not the audio data can be output when the first decoded audio data after priority designation is received in order to synchronize the decoded video stream and audio stream. If it is determined that output is possible, the process proceeds to step ST708, and if output is not possible, the process proceeds to step ST707.

  In step ST708, the moving image and the sound are output in synchronization, and the process ends.

  In step ST707, the output of only the moving image is continued, and the process returns to step ST705.

  A specific operation of the audio output unit 107 will be described with reference to a flowchart of FIG.

  In step ST801, the audio output unit 107 monitors the internal buffer to check whether or not there is decoded data. If there is, the process proceeds to step ST802.

  In step ST802, the audio output unit 107 notifies the image output unit 105 that the first decoded audio data after priority designation has been received.

  In step ST803, the audio output unit 107 acquires the display times tv (i) and Tv '(i) of the output moving image frame corresponding to the audio data from the image output unit 105.

  In step ST804, the audio output unit 107 refers to the display time of the acquired moving image frame and determines whether audio output is possible. That is, the audio output unit 107 compares the audio display time ta (j) with the moving image display time tv (i). For example, the difference between the display time ta (j) and the display time tv (i) is a predetermined value. If it is within the threshold range, it is determined that audio output is possible. If audio output is possible, the process proceeds to step ST805, and if audio output is not possible, the process returns to step ST803.

  In step ST805, the audio output unit 107 starts outputting audio data.

  In step ST806, the audio output unit 107 calculates the difference between the system time when the output of the audio data is started and the display time Tv ′ (i) of the displayed moving image frame acquired from the image output unit 105 as the display time. Calculate as an offset.

  In step ST807, the audio output unit 107 outputs the calculated offset to the image output unit 105, notifies the audio output, and ends the operation.

  The image output unit 105 receives two notifications of audio data acquisition and audio data output from the audio output unit 107. After priority designation, as described above, the operation to adjust the output timing of the video frame for display according to the time information is performed. Regardless of the display time Tv ′ (i), the operation is changed so that immediate output is performed at the time of reception. Thereafter, this operation is continued until a voice output notification is received from the voice output unit 107. The display time tv (i) and Tv ′ (i) of the moving image frame at this time are stored, and are output in response to the inquiry from the audio output unit 107 as described for step ST803 in FIG.

  For moving images other than priority designation, output is performed according to time information as before. FIG. 9 shows a processing example.

  In FIG. 9A, the user performs a priority designation operation while outputting the moving image frame V1, and at this time, the stream processing unit 102 is processing the moving image stream data V7. In this state, the stream processing unit 102 starts acquisition from the audio stream A5.

  FIG. 9B shows a state after Δt has elapsed from FIG. 9A, and when the decoded audio data A5 is input to the audio output unit 107, the image output unit 105 displays the moving image frame. It is in the state of waiting for the output of V6. Here, the image output unit 105 switches from the operation of adjusting the moving image frame output timing for display according to the time information to the operation not considering the time information. In FIG. 9B, V6 is output immediately and tv (6) and Tv ′ (6) are stored. The audio output unit 107 refers to tv (6) and compares it with ta (7). If the audio data A7 can be output, the difference Td between the display time Tv '(6) of V6 and the system time t is calculated. The image output unit 105 adjusts the output timing of a moving image frame after V7 at a time obtained by subtracting Td from the time Tv ′ (i).

  While the moving image and the sound are synchronized, the moving image is output regardless of the time information, and generally the output timing is advanced. However, the amount of fluctuation of the time to be advanced depends on the interval of the moving image frames, and varies greatly when the frame interval is widened, for example, skip reproduction, but hardly varies at a normal reproduction rate. In skip reproduction, since the frame interval is originally wide, even if the display time is advanced, there is little discomfort perceived by the user. It is possible to always shorten the time until the voice output while starting the voice processing when the voice output is selected by the user.

  In the above-described embodiment, the second operation executed while synchronizing the moving image and the sound is to output the moving image frame immediately regardless of the time information. The video frame data may be simply discarded from the internal buffer without being displayed, or is output immediately regardless of the time information only when the time interval between frames exceeds a predetermined value. (Or discard it without outputting it).

  The object of the present invention can also be achieved by supplying a recording medium storing software program codes for realizing the functions of the embodiments of the present invention to the apparatus and executing the program codes by a microprocessor or DPS. In this case, the software program code itself realizes the functions of this embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

  Although the embodiment of the present invention has been described above, the video content reproduction apparatus, the control method, the program, and the recording medium of the present invention are not limited to the above-described embodiment, and do not depart from the gist of the present invention. Of course, various changes can be made.

  INDUSTRIAL APPLICABILITY The present invention can be used for a video content reproduction apparatus, a control method thereof, a program, and a recording medium.

DESCRIPTION OF SYMBOLS 100 Video content reproduction apparatus 101 Data acquisition part 102 Stream processing part 103 Moving image decoding part 104 Decoding control part 105 Image output part 106 Audio decoding part 107 Audio output part 108 Control part

Claims (12)

A data acquisition unit that receives an input of a stream of video content;
A stream processing unit for obtaining a moving image stream and an audio stream from the video content stream;
A video decoding unit that decodes the video stream and obtains a decoded video frame;
An image output unit that executes a first operation for adjusting the output of the decoded moving image frame based on time information and a second operation for outputting the decoded moving image frame regardless of the time information;
An audio decoding unit that decodes the audio stream and obtains decoded audio data;
An audio output unit for outputting the decoded audio data;
With
The stream processing unit acquires the audio stream from the video content stream in response to a user operation,
The video content reproduction apparatus, wherein the image output unit switches the operation from the first operation to the second operation when the decoded audio data is input to the audio output unit.   2. The video content according to claim 1, wherein the image output unit switches the operation from the second operation to the first operation when the audio output unit starts outputting the decoded audio data. Playback device. The image output unit stores time information of the decoded moving image frame in the second operation,
The video content reproduction apparatus according to claim 1 or 2, wherein the audio output unit determines output start of the decoded audio data with reference to time information of the decoded moving image frame. The audio output unit calculates a difference between an output start time of the decoded audio data and time information of the decoded moving image frame;
4. The video content reproduction apparatus according to claim 3, wherein the image output unit corrects time information of the decoded moving image frame by the difference in the first operation.   The switching from the first operation to the second operation is performed only when an interval of time information of the decoded moving image frame input to the image output unit exceeds a predetermined value. Item 5. The video content reproduction device according to any one of Items 1 to 4.   The image output unit, when displaying a list of a plurality of video contents, performs switching from the first operation to the second operation only for the video content to be output. 5. The video content reproduction apparatus according to any one of 1 to 4. A control method of a video content playback apparatus that displays a thumbnail of video content,
A data acquisition step for receiving an input of a video content stream;
A stream processing step of obtaining a moving image stream and an audio stream from the video content stream;
A video decoding step of decoding the video stream and obtaining a decoded video frame;
An image output step for executing a first operation for adjusting the output of the decoded moving image frame based on time information and a second operation for outputting the decoded moving image frame irrespective of the time information;
An audio decoding step of decoding the audio stream to obtain decoded audio data;
An audio output step for outputting the decoded audio data;
Have
In the stream processing step, the audio stream is acquired from the video content stream in response to a user operation,
The method for controlling a video content reproduction apparatus, wherein, in the image output step, the operation is switched from the first operation to the second operation when the decoded audio data is input in the audio output step.   8. The video content according to claim 7, wherein in the image output step, the operation is switched from the second operation to the first operation at the time when the output of the decoded audio data is started in the audio output step. A control method of a playback device. In the image output step, time information of the decoded moving image frame is stored in the second operation,
9. The method of controlling a video content reproduction apparatus according to claim 7, wherein in the audio output step, the output start of the decoded audio data is determined with reference to time information of the decoded moving image frame. In the audio output step, the difference between the output start time of the decoded audio data and the time information of the decoded video frame is calculated,
10. The video content playback apparatus control method according to claim 9, wherein, in the image output step, time information of the decoded moving image frame is corrected by the difference in the first operation.   A program for causing a computer to execute the control method of the video content reproduction apparatus according to any one of claims 7 to 10.   The computer-readable recording medium which recorded the program of Claim 11.

Images