JP5311448B2 - Subtitled video playback device, subtitled video playback method and program - Google Patents

Description

  The present invention relates to a captioned video playback apparatus, a captioned video playback method, and a program for playing back captioned video.

  There is a technique for separating subtitle information and video information of a video with subtitles and separately outputting them to a display unit.

In Patent Document 1, a caption text is extracted from a stream with a display time attached, and when the user selects a caption text, the selected caption text and a video corresponding to the caption text are synthesized. A closed caption display device for reproduction is disclosed.
JP 2003-18491 A

  However, in the caption display device disclosed in Patent Document 1, when a caption text is selected, a process of reproducing a video corresponding to the caption text is executed. Therefore, the caption display device disclosed in Patent Document 1 performs a process of playing back a video corresponding to a caption text each time the caption text is selected when a plurality of caption texts are continuously selected. There is a problem that the processing speed is lowered. In particular, when the subtitle text is continuously selected and fast-forwarded or rewinded, the processing speed is significantly reduced.

  The present invention has been made in view of the above circumstances, and includes a captioned video playback apparatus, a captioned video playback method, and a program capable of preventing a reduction in processing speed when continuously selecting caption texts. The purpose is to provide.

In order to achieve the above object, a video playback device with subtitles according to the first aspect of the present invention provides:
Storage means for storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
Subtitle sentence selecting means for selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage means;
Subtitle sentence reproduction means for reproducing the subtitle sentence selected by the subtitle sentence selection means;
Video playback means for playing back video corresponding to the caption text being played back by the caption text playback means;
A first mode in which the subtitle sentence selecting means sequentially selects subtitle sentences in ascending or descending order according to the reproduction order; and the subtitle sentence selecting means selects a predetermined subtitle sentence and successively in ascending or descending order according to the reproduction order. A setting means for setting any one of the second mode for sending a caption sentence;
When the setting means sets the first mode, the video playback means is allowed to play the video, and when the setting means sets the second mode, the video playback means plays the video. And control means for prohibiting the operation.

  For example, when the setting unit sets the second mode, the control unit sets the playback order in a playback order that is a predetermined number away from the playback order corresponding to the subtitle text being played back by the subtitle text playback unit. A corresponding subtitle sentence may be discriminated, and the subtitle sentence selecting means may select the discriminated subtitle sentence.

  For example, when the setting unit sets the second mode, the control unit sets the playback order in a playback order that is a predetermined number away from the playback order corresponding to the subtitle text being played back by the subtitle text playback unit. A corresponding subtitle sentence may be discriminated, and the subtitle sentence selecting means may select the discriminated subtitle sentence.

In order to achieve the above object, a video playback method with captions according to the second aspect of the present invention includes:
A storage step of storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
A subtitle sentence selection step of selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage step ;
A subtitle sentence reproduction step of reproducing the subtitle sentence selected in the subtitle sentence selection step ;
A video playback step of playing back video corresponding to the subtitle text being played back in the subtitle text playback step;
A first mode in which subtitle sentences are sequentially selected in the ascending order or descending order according to the reproduction order in the subtitle sentence selection step, and a predetermined subtitle sentence is selected in the subtitle sentence selection step and continuously in ascending or descending order according to the reproduction order. A setting step for setting any one of the second mode for sending subtitle text;
Control for controlling to allow playback of video when the first mode is set in the setting step, and prohibiting playback of video when the second mode is set in the setting step And a step.

In order to achieve the above object, a program according to the third aspect of the present invention provides:
On the computer,
A storage step of storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
A caption sentence selection step of selecting any caption sentence from the plurality of caption sentences stored in the storage step;
A subtitle sentence reproduction step of reproducing the subtitle sentence selected in the subtitle sentence selection step;
A video playback step of playing back a video corresponding to the subtitle text being played back in the subtitle text playback step;
A first mode in which subtitle sentences are sequentially selected in the ascending order or descending order according to the reproduction order in the subtitle sentence selection step, and a predetermined subtitle sentence is selected in the subtitle sentence selection step and continuously in ascending or descending order according to the reproduction order. A setting step for setting any one of the second mode and the second mode for sending a caption sentence;
Control for controlling to allow playback of video when the first mode is set in the setting step, and prohibiting playback of video when the second mode is set in the setting step The step is executed.

  According to the present invention, it is possible to prevent a reduction in processing speed when continuously selecting subtitle sentences.

  Hereinafter, a captioned video reproduction apparatus according to an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, the video playback device with captions is described as a mobile phone.

An appearance of a mobile phone according to this embodiment is shown in FIG.
The mobile phone 1 is, for example, a folding type that is divided into an upper housing 1a and a lower housing 1b.

FIG. 2 shows the configuration of the mobile phone 1 according to the present embodiment.
The cellular phone 1 according to the present embodiment includes an antenna 11, a communication unit 12, an audio microphone 13, an audio speaker 14, an antenna 15, a tuner 16, a decoding unit 17, a storage unit 18, and a DAC 19. , A speaker 20, a display unit 21, an operation unit 22, a control unit 23, and a bus 24.

  The mobile phone 1 is capable of displaying a caption text and a video and displaying a caption list, and is configured to be able to select a video based on the caption text selected in the caption list.

  The bus 24 transmits data between the units. The control unit 23, the storage unit 18, the DAC 19, and the display unit 21 are connected via a bus 24.

  The antenna 11 transmits and receives radio signals such as call voice and various data to and from a base station (not shown). As shown in FIG. Provided.

The communication unit 12 performs signal processing of radio signals transmitted and received by the antenna 11.
As shown in FIG. 1, the audio microphone 13 is provided in the lower housing 1 b and collects audio and converts it into an audio signal during a call or the like, and supplies the converted audio signal to the communication unit 12. .

  The audio speaker 14 is provided in the upper housing 1a as shown in FIG. 1, and outputs audio based on an audio signal during a call or the like.

  The antenna 15 receives a radio signal of a broadcast signal of one-segment broadcasting, and is built in the mobile phone 1. The broadcast signal of this one-segment broadcasting includes video data, audio data, and caption data as broadcast program content data. The radio wave signal received by the antenna 15 has a format conforming to a data transfer method in one-segment broadcasting, for example.

  The tuner 16 and the decoding unit 17 analyze the broadcast signal received by the antenna 15 and acquire video data, audio data, and caption data. The tuner 16 demodulates the one-segment broadcasting signal from the radio signal received by the antenna 15, and supplies the demodulated demodulated signal to the decoding unit 17.

  The decoding unit 17 decodes the supplied demodulated signal and generates a TS (Transport Stream) as shown in FIG.

  TS is a stream in which TSP (Transport Stream Packet) is multiplexed, and video packet V for video data, audio packet A for audio data, and subtitle packet C for subtitles are included in TSP. is there.

  Each TSP is composed of a TS header and a payload, as shown in FIG. The TS header is an area for storing data indicating the start of a TS packet, a packet identifier, and the like.

  The payload is an area for storing data, and a PES (Packetized Elementary Stream) packet as shown in FIG. 3C is divided and stored. The PES is composed of data stored in each payload.

  The PES is composed of a PES header and a PES payload. The PES header is an area in which data indicating the start of PES, data such as a packet identifier and a packet length are stored. The PES payload is an area in which an ES (Elementary Stream) is divided and stored, and video data, audio data, and caption data are compression-coded and stored in the PES payload.

  Based on the information stored in the TS header, the decoding unit 17 separates the video packet V, the audio packet A, and the caption packet C from the TS, and extracts the PES from the payload of each TSP.

  Further, based on the data stored in the PES header, the decoding unit 17 performs video PES including video data, audio PES including audio data, and subtitles including subtitle data, as shown in FIG. PES is generated.

  The TS packet has a fixed length, and the PES has a variable length. For this reason, the TSP may include an adaptation field for making the length of the TSP constant.

  FIG. 4 shows an example of the displayed video and caption television signal SG. The cellular phone 1 converts the content recording data into the format of the television signal SG, and further converts it into displayable video data to reproduce the video.

  Data in the one-segment broadcasting is data conforming to the predictive coding method, and the video PES includes an IDR (Instantaneous Decoder Refresh) frame and a P frame.

  In FIG. 4, Id_1, Id_2, Id_3, and Id_q indicate IDR frames, and P11, P12, P21, P22, and Pq1 indicate P frames.

  IDR frames Id_1 to Id_q are frames that do not refer to other video frames and correspond to independent video packets VI. The P frames P11 to Pq1 are frames that refer to the IDR frames Id_1 to Id_q that are reproduced prior to their own reproduction timing, and correspond to the reference video packet VP.

  The playback timing Tf is stored in the PES header of the video PES. The reproduction timing Tf is data indicating the reproduction time of the first video of the constructed television signal SG. Further, the TSP header includes a seek point TR indicating the display time of the IDR frames Id_1 to Id_q.

  In FIG. 4, TR_1, TR_2, TR_3, and TR_q indicate elapsed times of the IDR frames Id_1, Id_2, Id_3, and Id_q from the reproduction timing Tf, respectively.

  In the PES payload of the caption PES, compression-coded captions (data) M1 to Mp (p: integer) are stored. The caption texts M1 to Mp are data indicating the contents of the caption added to the video.

  Each PES header of the caption PES includes caption display times TM1 to TMp and control codes CS1 to CSp.

  The caption display times TM1 to TMp are time information indicating the timing for displaying the caption texts M1 to Mp, respectively. The control codes CS1 to CSp are information indicating delimiters of the caption sentences M1 to Mp, respectively, and indicate timings for switching the display of the caption sentences M1 to Mp.

  In the TS header shown in FIG. 3B, reference time information called PCR (Program Clock Reference) is stored. A PTS (Presentation Time Stamp) is stored in the PES header. This PTS is time information indicating a time for reproducing an ES (Elementary Stream) in the PES, and is expressed based on a clock frequency of 90 kHz.

  The mobile phone 1 interprets the time at the moment of receiving the PCR as the time indicated by the PCR value, and synchronizes the STC (System Time Clock; reference time) of the mobile phone 1 with the PCR. Thereby, the time of all the receivers (cell-phone 1) synchronizes.

  Note that the reproduction timing Tf, caption display times TM1 to TMp, and elapsed times TR1 to TRq are stored as data in units of PTS.

  The decoding unit 17 supplies the TS header and PES header information to the control unit 23 together with the decoded video PES, audio PES, and subtitle PES.

  Returning to FIG. 1, the storage unit 18 stores various data, and includes a nonvolatile memory such as a flash memory, an internal memory such as a RAM (Random Access Memory), and an external recording medium.

  As shown in FIG. 5, the storage unit 18 includes a content recording data storage area 181, a caption management data storage area 182, a seek point management information storage area 183, and a display data storage area 184.

  The content recording data storage area 181 is an area for storing video PES, audio PES, and subtitle PES analyzed by the decoding unit 17 as data.

  The caption management data storage area 182 is an area for storing caption management data as shown in FIG. The caption management data is table data that associates “caption display time TMi” (i = 1 to p) with “caption sentence Mi”, and is generated by the control unit 23.

  “Subtitle display time TMi” indicates the time at which the caption text Mi is displayed. In this embodiment, the subtitle display time TMi, that is, the reference for displaying the subtitle sentence M, is the offset time that is the reproduction timing Tf at the start of reproduction of the content recording data (the reproduction time of the first video of the television signal). To do.

  The seek point management information storage area 183 is an area for storing seek point management information. The seek point management information is table data associating seek points TRj (j = 1 to q) and video positions PRj as shown in FIG. 6B, and is generated by the control unit 23.

  “Seek point TRj” indicates the time at which each video frame is displayed, and is expressed in units of PTS. “Video position PRj” is data indicating the position of the video frame in the content recording data, and functions as an index. In the case of one-segment broadcasting, “video position PRj” is usually a TSP number including the head of the IDR frame.

  The display data storage area 184 is an area for storing data such as video and subtitles displayed on the display unit 21.

  Further, the storage unit 18 stores data of an operation control program for the control unit 23 and also functions as a work memory for the control unit 23.

  The DAC 19 converts the digital audio signal (audio data) from the control unit 23 into an analog audio signal, and supplies the converted analog audio signal to the speaker 20.

  The speaker 20 outputs sound based on the analog audio signal supplied from the DAC 19, and is provided in the upper housing 1a as shown in FIG.

  The display unit 21 includes a dot matrix type LCD (Liquid Crystal Display) 31 and a driver circuit (not shown) shown in FIG. 1 and displays subtitles reproduced together with video on the LCD 31. The LCD 31 is provided in the upper housing 1a.

  The display unit 21 reads data from the display data storage area 184 of the storage unit 18 under the control of the control unit 23, and displays the subtitles reproduced along with the video based on the read data on the LCD 31.

  The mobile phone 1 has two viewing modes, and there are two viewing modes of “viewing mode with caption list” and “normal viewing mode”. The display unit 21 displays a screen corresponding to the mode on the LCD 31.

  The “viewing mode with subtitle list” is a mode in which subtitles corresponding to the video are displayed and the subtitle list is displayed to enable selection of the video from the subtitle list. “Normal viewing mode” is a mode in which subtitles and video are displayed without displaying a subtitle list.

  When “viewing mode with subtitle list” is selected, the display unit 21 displays a screen D1 as shown in FIG.

  In the “viewing mode with subtitle list” screen, the video area RA is an area for displaying video. The display unit 21 displays a video with a reproduction timing corresponding to the reproduction timing of the subtitle selected from the subtitle list in the video area RA.

  The caption area MA is an area for displaying captions. The display unit 21 displays the caption text selected by the user from the caption list in the caption area MA.

  The subtitle list area LA is an area for displaying a plurality of subtitle sentences arranged in a list format. The display unit 21 displays, for example, five subtitle list branch areas LA1 to LA5 in the subtitle list area LA.

  The soft key area FA is an area for displaying soft keys Soft1 and Soft2. Soft keys Soft1 and Soft2 are used, for example, to switch viewing modes. The soft keys Soft1 and Soft2 are selected by operating the keyboard 32.

  The picto area PA is an area for displaying operation information of the mobile phone 1. The display unit 21 displays the radio wave reception status, the remaining battery level, the current date and time, etc. of the mobile phone 1 in this pictogram area PA.

  The “normal viewing mode” is a mode for displaying the subtitles reproduced together with the video without displaying the subtitle list. When “normal viewing mode” is selected, the display unit 21 displays on the LCD 31 a screen D2 in which the subtitle list area LA as shown in FIG.

The operation unit 22 is, for example, an instruction for starting / ending reception of a television broadcast, an instruction for starting / ending content recording when the user records a TV program, and a password input at the time of user authentication. It accepts input.
The operation unit 22 includes a keyboard 32 as shown in FIG. The keyboard 32 includes a power switch, a cursor key 33, a numeric keypad, and the like, and is used for turning on / off the power of the mobile phone 1, switching modes, inputting numbers, characters, symbols, selecting menus, and receiving one-segment broadcasting. .

  The cursor key 33 is a key for scrolling the cursor displayed on the screen and selecting an arbitrary subtitle sentence from the subtitle list.

For example, when the up / down key of the cursor key 33 is pressed for a long time, the control unit 23 determines the operation information supplied from the operation unit 22 and sets the continuous subtitle feed mode in which subtitle sentences are continuously selected. . The continuous subtitle sending mode is a mode in which a subtitle sentence is continuously sent in the forward direction (or in the reverse direction) from the currently selected subtitle sentence. Details of the operation of the mobile phone 1 in this mode will be described later.
When the long press is released, the control unit 23 determines the operation information supplied from the operation unit 22 and cancels the continuous subtitle feed mode. When the continuous subtitle feed mode is canceled, the control unit 23 selects the subtitle sentences sequentially from the subtitle sentences selected when the mode is canceled in the forward direction (or the reverse direction) according to the playback order, Play video corresponding to subtitle text.

  The control unit 23 includes a microprocessor unit and the like, and controls the operation of the entire mobile phone 1 according to operation control program data stored in the storage unit 18.

  The control unit 23 controls the operation of the mobile phone 1 based on the operation information supplied from the operation unit 22.

Next, the operation of the mobile phone 1 according to this embodiment will be described.
The control unit 23 turns on and off the power of the mobile phone 1 every time operation information indicating that the power switch of the keyboard 32 is pressed is supplied from the operation unit 22.

  When the operation information for selecting the menu for receiving the broadcast signal of the one-segment broadcast is supplied from the operation unit 22, the control unit 23 controls the antenna 15, the tuner 16, and the decoding unit 17 to start reception of the one-segment broadcast. .

  The antenna 15 receives a one-segment broadcast radio signal, and the tuner 16 demodulates the one-segment broadcast signal from the radio signal received by the antenna 15 and supplies the demodulated demodulated signal to the decoding unit 17.

  The video data, audio data, and subtitle data included in the supplied content data are separated, these data are decoded, and the decoded video PES, audio PES, and subtitle PES are supplied to the control unit 23.

  When the operation information indicating that the menu for recording the content of the 1Seg broadcast is selected from the operation unit 22, the control unit 23 records the 1Seg broadcast.

  That is, the control unit 23 stores the video PES, audio PES, and subtitle PES supplied from the decoding unit 17 in the content recording data storage area 181 of the storage unit 18.

  When storing the video PES, the audio PES, and the caption PES in the content recording data storage area 181, the control unit 23 reads the program data of the caption management data generation process, and executes the caption management data generation process according to the flowchart shown in FIG. To do.

  The control unit 23 determines whether or not the caption PES can be acquired (step S11).

  When determining that the caption PES cannot be acquired (step S11: No), the control unit 23 ends the caption management data generation process.

  When it determines with subtitle PES being acquirable (step S11: Yes), the control part 23 determines whether a subtitle sentence exists (step S12).

  When it is determined that the caption text Mi does not exist (step S12: No), the control unit 23 determines again whether or not the caption PES can be acquired (step S11).

  When it is determined that the caption text Mi exists (step S12: Yes), the control unit 23 analyzes the acquired caption PES, subtracts the reproduction timing Tf from the PTS stored in the PES header of the caption PES, and starts from the top video. Is obtained (PTS unit) (step S13).

  The control unit 23 converts the obtained elapsed time in PTS units into elapsed time in hour / minute / second units (step S14), and uses the converted elapsed time as the caption display time TMi, and the caption display time TMi is stored in the storage unit 18. Registration is made in the caption management data in the caption management data storage area 182 (step S15).

  The control unit 23 divides the data with the control code CS included in the caption PES, and acquires the caption text Mi immediately before the control code CS. The control unit 23 registers the acquired subtitle sentence Mi in the subtitle management data in the subtitle management data storage area 182 of the storage unit 18 (step S16).

  The control unit 23 determines whether or not the caption text Mi is the last content recording data (step S17). If there is a control code CS, the control unit 23 determines that the caption sentence Mi is not the last of the content recording data, and if there is no control code CS, determines that the caption sentence Mi is the last data.

  When it is determined that the caption text Mi is not the last of the content recording data (step S17: No), the control unit 23 executes steps S11 to 16 again.

  When it is determined that the caption text Mi is the end of the content recording data (step S17: Yes), the control unit 23 ends the caption management data generation process.

  When the subtitle management data generation process is executed in this way, the control unit 23 sequentially analyzes the TSP based on the TS header data supplied from the decoding unit 17. The control unit 23 registers the analyzed data in the seek point management information in the seek point management information storage area 183 of the storage unit 18 to generate seek point management information.

  Next, the operation of the mobile phone 1 when the operation unit 22 is operated and the control unit 23 selects a predetermined subtitle sentence and is set to the continuous subtitle feed mode in which the subtitle sentence is continuously transmitted is illustrated in FIG. This will be described with reference to the flowchart shown in FIG.

  When the keyboard 32 is operated, the operation unit 22 supplies operation information to the control unit 23. When acquiring the operation information from the operation unit 22, the control unit 23 determines the acquired operation information, and determines whether or not the instruction is to send a caption text (step S20). As a result of the determination, if it is an instruction to send the caption text in the forward direction (step S20: Yes), the control unit 23 executes the caption text sending process according to the flowchart shown in FIG.

  The control unit 23 selects the caption sentence Mi + k (k> 0 in the forward direction, k <0 in the backward direction), and updates the caption sentence to be displayed in the caption area MA to the caption sentence Mi + k. (Step S21).

  When the subtitle sentence is updated, the control unit 23 determines whether or not operation information indicating that the “continuous subtitle sending mode” is set to send the subtitle sentence continuously by selecting the subtitle sentence from the operation unit 22 is determined. (Step S22). When the operation information for setting the continuous subtitle feed mode is not supplied (step S22: No), the control unit 23 turns off the continuous subtitle feed mode.

  When the continuous subtitle feed mode is set to OFF, the control unit 23 reproduces the currently selected subtitle sentence Mi + k and the video corresponding to the subtitle sentence on the display unit 21 (step S25). Then, the control unit 23 reproduces the subtitle sentence before and after the subtitle sentence Mi + k in the subtitle list area LA (step S26), and forwards (or reverses) the subtitle sentence Mi + k according to the reproduction order. ) Play subtitle text and video sequentially.

  When the operation information for setting the continuous subtitle feed mode is supplied (step S22: Yes), the control unit 23 sets the continuous subtitle feed mode to ON and sets the currently selected subtitle sentence Mi + k to the subtitle. Playback is performed in the area MA, and playback of the video corresponding to the subtitle sentence Mi + k is prohibited.

  The control unit 23 determines and selects a caption sentence Mi + m (m> k in the forward direction and m <k in the reverse direction) (step S23). Next, the control unit 23 determines whether or not operation information indicating that the continuous subtitle feed mode is turned off has been supplied from the operation unit 22 (step S24).

  When it is determined that the operation information for turning off the continuous subtitle feed mode is not supplied (step S24: No), the control unit 23 reproduces the currently selected subtitle sentence Mi + m in the subtitle area MA, Playback of the video corresponding to the subtitle sentence Mi + m is prohibited. Then, the control unit 23 determines and selects the subtitle sentence Mi + n (n> m in the forward direction and n <m in the reverse direction) (step S23).

  When it is determined that the operation information for turning off the continuous subtitle feed mode is supplied (step S24: Yes), the control unit 23 reproduces the selected subtitle sentence Mi + m in the subtitle area MA, and the subtitle sentence Mi + Playback of the video corresponding to m is started (step S25). Then, the control unit 23 displays the subtitle sentences before and after the subtitle sentence Mi + m in the subtitle list area LA (step S26), and forwards the subtitle sentence Mi + m in the forward direction (or in the reverse direction). ) Play subtitle text and video sequentially.

  Specifically, for example, it is assumed that the currently selected caption text is the caption text M3 as shown in FIG. This specified number may be set in advance, for example, or may be set by a user from a menu screen. In this case, when the user operates the cursor key 33 to instruct to select a subtitle sentence after the specified number 4 from the subtitle sentence M3, the subtitle sentence M7 is selected (processing in step S21). If the user does not give an instruction to turn on the continuous subtitle feed mode (No in step S22), the video corresponding to the subtitle sentence M7 is displayed in the video area RA (step S25), and the subtitle list Subtitle sentences M5, M6, M8, and M9 before and after the subtitle sentence M7 are displayed in the area LA (processing in step S26), and the subtitle sentence and video are forward (or backward) from the subtitle sentence M7 according to the reproduction order. And are played sequentially.

  For example, assume that the currently selected caption text is M3 and the specified number is set to 2. In this case, when the user operates the cursor key 33 to instruct to select a subtitle sentence that is a predetermined number 2 after the subtitle sentence M3, the subtitle sentence M5 is selected (processing in step S21). For example, when the user presses the cursor key 33 for a long time and the continuous subtitle feed mode is set to ON (Yes in step S22), the subtitle sentence M5 is handled as shown in FIG. 11B. The video is not reproduced, and the subtitle sentence M7 after the specified number 2 is further selected from the subtitle sentence M5 (processing in step S23). After the caption text M7 is selected, for example, when the user releases the long press of the cursor key 33 and the continuous caption feed mode is set to OFF (Yes in step S24), the process is illustrated in FIG. In this way, the video corresponding to the caption text M7 is reproduced in the video area RA (step S25). Then, subtitle sentences M5, M6, M8, and M9 before and after the subtitle sentence M7 are displayed in the subtitle list area LA (processing in step S26), and forward (or backward) in accordance with the reproduction order from the subtitle sentence M7. Subtitle text and video are played sequentially.

  In the above-described embodiment, a case has been described in which the control unit 23 continuously sends subtitle sentences according to the playback order (forward feed). However, the subtitle sentences are continuously sent in reverse order to the playback order (reverse feed). May be. Even in the case of reverse feed in the continuous caption feed mode, the control unit 23 does not execute the process of playing back the video corresponding to the selected caption sentence.

  In addition, for example, the user may be able to set an arbitrary number for the specified number for sending the caption text on the menu screen of the mobile phone 1. In particular, when the specified number is 1, it is possible to continuously view the next subtitle sentence after the currently viewed subtitle sentence.

  In addition, during the continuous subtitle feed mode, in addition to the method of not displaying anything in the video area RA, for example, characters such as “fast forward” are displayed, or still images related to the subtitle text being played back are displayed. It may be displayed.

  Due to the subtitle sending process, during the continuous subtitle sending mode, the process for playing back the video corresponding to the selected subtitle sentence is not executed, so the processing time for sending the subtitle sentence is shortened. Therefore, the user can quickly view a desired subtitle sentence and a video corresponding thereto.

  In the above embodiment, the video playback device with captions has been described as the mobile phone 1. However, the closed caption video playback device is not limited to this, for example, PHS, PDA (Personal Digital Assistants), electronic camera, electronic watch, notebook PC, portable TV, portable video recording device / playback It can also be applied to devices and car navigation devices.

  In the above embodiment, the program is described as being recorded in advance in a memory or the like. However, a program for operating the subtitled video playback apparatus as all or a part of the entire apparatus or executing the above-described processing is stored in a flexible disk, a CD-ROM (Compact Disk Read-Only Memory), a DVD ( Store and distribute in a computer-readable recording medium such as Digital Versatile Disk (MO) or MO (Magneto Optical disk), install it on another computer, operate as the above-mentioned means, or execute the above-mentioned steps May be.

  Furthermore, the program may be stored in a disk device or the like included in a server device on the Internet, and may be downloaded onto a computer by being superimposed on a carrier wave, for example.

It is a figure which shows the external appearance of the mobile telephone which concerns on embodiment of this invention. It is a block diagram which shows the structure of the mobile telephone which concerns on embodiment of this invention. It is a figure which shows the structure of the signal to receive, (a) shows TS, (b) shows TSP, (c) shows PES. It is a figure which shows the structure of the converted television signal. It is a figure which shows each storage area of the memory | storage part shown in FIG. (A) shows an example of the data structure of caption management data, and (b) shows an example of the data structure of seek point management information. It is a figure which shows the screen which a display part displays on LCD, (a) shows an example of the screen in subtitle list viewing mode, (b) shows an example of the screen in normal viewing mode. It is a flowchart which shows the title management data generation process which the control part shown in FIG. 2 performs. It is a flowchart of the subtitle sentence transmission process which the control part shown in FIG. 2 performs. It is an example of the screen which a display part displays on LCD, (a) shows an example of the screen before subtitle transmission process execution, (b) shows an example of the screen at the time of completion of subtitle transmission processing. It is an example of the screen which a display part displays on LCD, (a) shows an example of the screen before subtitle transmission processing execution, (b) shows an example of the screen during continuous subtitle transmission, (c) is An example of a screen at the time of completion of continuous subtitle feed processing is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Mobile phone, 18 ... Memory | storage part, 21 ... Display part, 22 ... Operation part, 23 ... Control part

Claims (5)

Storage means for storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
Subtitle sentence selecting means for selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage means;
Subtitle sentence reproduction means for reproducing the subtitle sentence selected by the subtitle sentence selection means;
Video playback means for playing back video corresponding to the caption text being played back by the caption text playback means;
A first mode in which the subtitle sentence selecting means sequentially selects subtitle sentences in ascending or descending order according to the reproduction order; and the subtitle sentence selecting means selects a predetermined subtitle sentence and successively in ascending or descending order according to the reproduction order. A setting means for setting any one of the second mode for sending a caption sentence;
When the setting means sets the first mode, the video playback means is allowed to play the video, and when the setting means sets the second mode, the video playback means plays the video. Control means forbidding to do,
A video playback apparatus with captions, comprising: When the setting means sets the second mode, the control means corresponds to a playback order that is separated by a predetermined number in ascending order from the playback order corresponding to the caption text being played back by the caption text playback means. Discriminating a subtitle sentence and causing the subtitle sentence selection means to select the discriminated subtitle sentence;
The video reproduction apparatus with captions according to claim 1. When the setting means sets the second mode, the control means corresponds to a reproduction order that is a predetermined number away from the reproduction order corresponding to the subtitle text being reproduced by the subtitle sentence reproduction means in descending order. Discriminating a subtitle sentence and causing the subtitle sentence selection means to select the discriminated subtitle sentence;
The video reproduction apparatus with captions according to claim 1. A storage step of storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
A subtitle sentence selection step of selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage step ;
A subtitle sentence reproduction step of reproducing the subtitle sentence selected in the subtitle sentence selection step ;
A video playback step of playing back video corresponding to the subtitle text being played back in the subtitle text playback step;
A first mode in which subtitle sentences are sequentially selected in the ascending order or descending order according to the reproduction order in the subtitle sentence selection step, and a predetermined subtitle sentence is selected in the subtitle sentence selection step and continuously in ascending or descending order according to the reproduction order. A setting step for setting any one of the second mode for sending subtitle text;
Control for controlling to allow playback of video when the first mode is set in the setting step, and prohibiting playback of video when the second mode is set in the setting step Steps,
A video playback method with subtitles, comprising: On the computer,
A storage step of storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
A caption sentence selection step of selecting any caption sentence from the plurality of caption sentences stored in the storage step;
A subtitle sentence reproduction step of reproducing the subtitle sentence selected in the subtitle sentence selection step;
A video playback step of playing back a video corresponding to the subtitle text being played back in the subtitle text playback step;
A first mode in which subtitle sentences are sequentially selected in the ascending order or descending order according to the reproduction order in the subtitle sentence selection step, and a predetermined subtitle sentence is selected in the subtitle sentence selection step and continuously in ascending or descending order according to the reproduction order. A setting step for setting any one of the second mode and the second mode for sending a caption sentence;
Control for controlling to allow playback of video when the first mode is set in the setting step, and prohibiting playback of video when the second mode is set in the setting step Step,
A program characterized by having executed.

Images