JP4839488B2 - Subtitled video playback apparatus and method, and program - Google Patents

Subtitled video playback apparatus and method, and program Download PDF

Info

Publication number
JP4839488B2
JP4839488B2 JP2007317619A JP2007317619A JP4839488B2 JP 4839488 B2 JP4839488 B2 JP 4839488B2 JP 2007317619 A JP2007317619 A JP 2007317619A JP 2007317619 A JP2007317619 A JP 2007317619A JP 4839488 B2 JP4839488 B2 JP 4839488B2
Authority
JP
Japan
Prior art keywords
subtitle
playback
video
reproduction
sentence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2007317619A
Other languages
Japanese (ja)
Other versions
JP2009141810A (en
Inventor
真弓 中出
恵理奈 佐藤
友哉 尾崎
正裕 山崎
正樹 若林
Original Assignee
Necカシオモバイルコミュニケーションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Necカシオモバイルコミュニケーションズ株式会社 filed Critical Necカシオモバイルコミュニケーションズ株式会社
Priority to JP2007317619A priority Critical patent/JP4839488B2/en
Publication of JP2009141810A publication Critical patent/JP2009141810A/en
Application granted granted Critical
Publication of JP4839488B2 publication Critical patent/JP4839488B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Description

  The present invention relates to a captioned video playback apparatus, method, and program for playing back captioned video.

  There is a technique for separating subtitle information and video information of a video with subtitles and separately outputting them to a display unit.

Patent Document 1 discloses a caption display device that records a video stream with captions and separately displays the video and the captions.
JP 2003-18491 A

  When the user selects a caption text, the caption display device disclosed in Patent Document 1 cues a video corresponding to the selected caption text and reproduces the subsequent video.

  However, the caption display device disclosed in Patent Document 1 plays back until the instruction to stop the video is received or when the video corresponding to the selected caption text is cued and started to be played, or until the end of the video. Continue.

  Therefore, for example, when the user wants to repeatedly reproduce the video with subtitles, the user must select the subtitles, start playing the video, stop the video by performing a stop operation, and select the subtitles again.

  Also, for example, when the user wants to play back only the video corresponding to a plurality of subtitle sentences, if the user misses the timing to stop, the subtitle sentence after a smaller or larger number than the predetermined number that the user wants to play back There is a problem that it stops at the video corresponding to.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a video playback apparatus with captions that is user-friendly.

In order to achieve the above object, a video playback device with captions according to the first aspect of the present invention stores a plurality of caption texts and a plurality of videos in association with each other based on the playback order. When,
Subtitle sentence selecting means for selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage means;
Subtitle sentence reproduction means for reproducing subtitle sentences from the subtitle sentence selected by the subtitle sentence selection means according to the reproduction order;
Video playback means for playing back video corresponding to the caption text being played back by the caption text playback means;
Timer means for measuring an elapsed time from the start of reproduction of the caption sentence by the caption sentence reproduction means, and determining that a predetermined time has elapsed;
Control means for controlling the subtitle sentence reproduction means so as to reproduce a subtitle sentence in a predetermined reproduction order when the timer means measures a predetermined time;
Playback speed selection means for selecting one playback speed from a plurality of playback speeds;
Video playback means for playing back video at a speed selected by the playback speed selection means,
The control means switches subtitle sentences at time intervals corresponding to the reproduction speed selected by the reproduction speed selection means,
The timer means includes means for correcting the predetermined time based on the reproduction speed selected by the reproduction speed selection means,
The storage means
A plurality of switching time intervals of subtitle sentences during playback and a plurality of playback speeds of the video are stored in association with each other,
Each subtitle sentence is pre-stored with reproduction duration information indicating a reproduction duration for continuously reproducing the subtitle sentence,
The control means, the determined time interval to switch the caption text on the basis of the playback time continuation of the subtitle sentence caption text selecting means has selected, to determine the playback speed corresponding to the determined time interval,
The playback speed selection means selects the playback speed determined by the control means;
It is characterized by that.

  For example, the control means may control the subtitle sentence reproduction means so that subtitle sentences are sequentially reproduced from subtitle sentences in a predetermined reproduction order when the timer means measures the predetermined time. Good.

For example, each subtitle sentence is attached with playback time information that specifies a playback duration for continuous playback of each subtitle sentence.
Each video consists of a video consisting of multiple frames,
The control means sets the playback duration indicated by the playback time information added to the caption text selected by the caption text selection means as the predetermined time measured by the timer means, and performs the timing operation of the timer means. Start
When the timer unit measures the predetermined time, a predetermined frame of the video associated with the subtitle sentence selected by the subtitle sentence selecting unit may be reproduced.

  For example, each of the subtitles between the subtitle sentence selected by the subtitle sentence selection means and the subtitle sentence corresponding to the playback order after a predetermined number of times as the predetermined time measured by the timer means The sum of the reproduction durations indicated by the reproduction time information added to the sentence may be set and the timing operation of the timer means may be activated.

For example, each subtitle sentence is attached with character number information indicating the number of subtitle characters included in the subtitle sentence.
The storage means stores the number of characters and a reproduction duration time for continuously reproducing the subtitle sentence of the number of characters in association with each other,
The control means determines the number of characters from the number-of-characters information added to the caption text selected by the caption text selection means,
Referring to the storage means, determine the playback duration corresponding to the determined number of characters, set the determined playback duration as the predetermined time in the timer means,
When the timer unit measures the predetermined time, the video associated with the subtitle sentence selected by the subtitle sentence selecting unit may be reproduced from a predetermined frame.

  For example, the control means may reproduce the first frame of the video associated with the caption text selected by the caption text selection means when the timer means measures the predetermined time. .

  For example, the control means may reproduce the last frame of the video associated with the caption text selected by the caption text selection means when the timer means measures the predetermined time. .

  For example, when the timer unit measures the predetermined time, the control unit causes the video associated with the subtitle sentence selected by the subtitle sentence selection unit to be played in order from the predetermined frame. May be.

  For example, when the timer unit measures the predetermined time, the control unit may sequentially reproduce the video from the first frame associated with the subtitle sentence selected by the subtitle sentence selection unit. Good.

For example, the control unit detects an IDR (Instantaneous Decoder Refresh) frame included in a plurality of frames constituting a video of a predictive coding scheme associated with the subtitle sentence selected by the subtitle sentence selection unit,
When the timer means measures the predetermined time, the IDR frame closest to the frame being reproduced may be determined and reproduced.

  For example, the video playback device with caption includes display means for displaying a ratio of the elapsed time measured by the timer means to the playback duration indicated by the duration information added to the caption text selected by the caption text selection means. You may make it prepare.

For example, the subtitle-added video reproduction device includes audio output means for outputting audio,
Audio is added to the video,
The control means comprises means for designating the playback speed of the video,
When the reproduction speed is a predetermined reference speed, the sound output means may be controlled so that sound is output, and when the reproduction speed is faster than the predetermined reference speed, the sound output means is not output.

In order to achieve the above object, a video playback method with subtitles according to a second aspect of the present invention defines a plurality of subtitle signals defining a plurality of subtitle sentences and a video associated with the subtitle sentences. A subtitle sentence selection step of selecting any subtitle sentence from a plurality of video signals;
A subtitle sentence reproduction step of reproducing a subtitle sentence from the subtitle sentence selected in the subtitle sentence selection step according to the reproduction order;
A video playback step of playing back video corresponding to the subtitle text being played back in the subtitle text playback step;
A determination step of measuring an elapsed time from the start of subtitle sentence reproduction in the subtitle sentence reproduction step and determining that a predetermined time has elapsed;
A control step for controlling to reproduce a subtitle sentence in a predetermined reproduction order when it is determined that a predetermined time has elapsed in the determination step;
A playback speed selection step of selecting one playback speed from a plurality of playback speeds;
A video playback step of playing back the video at the speed selected in the playback speed selection step,
The control step switches subtitle sentences at time intervals corresponding to the playback speed selected in the playback speed selection step,
The determining step corrects the predetermined time based on the reproduction speed selected in the reproduction speed selection step,
The control step is added to the subtitle sentence selected in the subtitle sentence selection step among the reproduction duration information indicating the reproduction duration time for continuously reproducing the subtitle sentence added in advance to each subtitle sentence . The time interval for switching the subtitle sentence is determined based on the playback duration information, and the playback speed corresponding to the determined time interval is associated with a plurality of subtitle sentence switching time intervals during playback and the video playback speeds. Based on the information
The playback speed selection step selects the playback speed determined in the control step.
It is characterized by that.

In order to achieve the above object, a program according to the third aspect of the present invention is provided on a computer.
A storage step of storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
A subtitle sentence selection step of selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage step;
A subtitle sentence reproduction step of reproducing the subtitle sentence according to the reproduction order from the subtitle sentence selected in the subtitle sentence selection step;
A video playback step of playing back a video corresponding to the subtitle text being played back in the subtitle text playback step;
A determination step of measuring an elapsed time from the start of reproduction of the subtitle sentence in the subtitle sentence reproduction step and determining that a predetermined time has elapsed;
A control step for controlling to reproduce a subtitle sentence in a predetermined reproduction order when it is determined that a predetermined time has elapsed in the determination step;
A playback speed selection step for selecting one playback speed from a plurality of playback speeds;
Executing a video playback step of playing back video at a speed selected in the playback speed selection step;
The control step switches subtitle sentences at time intervals corresponding to the playback speed selected in the playback speed selection step,
The determining step corrects the predetermined time based on the reproduction speed selected in the reproduction speed selection step,
The control step is added to the subtitle sentence selected in the subtitle sentence selection step among the reproduction duration information indicating the reproduction duration time for continuously reproducing the subtitle sentence added in advance to each subtitle sentence . The time interval for switching the subtitle sentence is determined based on the playback duration information, and the playback speed corresponding to the determined time interval is associated with a plurality of subtitle sentence switching time intervals during playback and the video playback speeds. Based on the information
The playback speed selection step selects the playback speed determined in the control step.
It is characterized by that.

  According to the present invention, it is possible to provide a video playback apparatus with captions that is convenient for the user, a method thereof, and a program.

(Embodiment 1)
Hereinafter, a video playback apparatus with captions according to an embodiment of the present invention will be described. Embodiment 1 is an example in which a captioned video reproduction apparatus according to an embodiment of the present invention is applied to a mobile phone 1 having a content reception function.

  The mobile phone 1 can receive content in accordance with an arbitrary data transfer method. In the present embodiment, a case of receiving content of one-segment broadcasting will be described.

  The mobile phone 1 is, for example, a foldable type as shown in FIG. 1, and includes a keyboard 2, a display panel 5, and the like.

  The keyboard 2 includes a cursor key 3, a display switching button 4, and various other buttons, and is used by a user to input various data and instructions. For example, it is used for inputting instructions such as reproduction and termination of video with captions.

  The display panel 5 is composed of a dot matrix type LCD (liquid crystal display) panel or the like, and displays an arbitrary image. For example, content videos, subtitle sentences, a list of subtitle sentences (hereinafter referred to as “subtitle list”), and the like are displayed.

  The call microphone 6 inputs a call voice.

  The call speaker 7 outputs a received voice. The speaker 8 outputs sound at the time of content reproduction.

  Further, the mobile phone 1 includes a tuner 10, a decoding unit 11, an audio output unit 12, an audio input unit 13, a communication unit 14, a display unit 15, and an operation unit, as in the circuit configuration illustrated in FIG. 16, a storage unit 17, a bus 18, and a control unit 19.

  The tuner 10 acquires and demodulates the content of the one-segment broadcasting received by the antenna 10A, and outputs a demodulated signal to the control unit 19.

  The decoding unit 11 separates the content output from the tuner 10 into a video signal, an audio signal, and a caption signal, decodes them, and outputs them.

  The audio output unit 12 includes the above-described speaker 7 and a DAC (digital analog converter), for example.

  The voice input unit 13 collects voice signals during a call or the like and supplies them to the communication unit 14.

  The communication unit 14 transmits / receives call voice, various data, and the like via the base station.

  The display unit 15 includes the display panel 5 and a driver circuit, and displays an image on the display panel 5 under the control of the control unit 19.

  The operation unit 16 includes various keys or buttons for the user to input instructions and data, and supplies various instructions and data to the control unit 19 to the control unit 19. For example, an instruction to start / end reception of a television signal, an instruction to start / end recording of content when a user records a television program, and a password input at the time of user authentication can be performed.

  The operation unit 16 is provided with the cursor key 3 described above. The user can select an arbitrary subtitle sentence from the subtitle list by scrolling the cursor displayed on the screen by operating the cursor key 3.

  Furthermore, the operation unit 16 is provided with a list display switching button 4. When the user presses the list display switching button, the display on the display unit 15 is switched between a list display mode and a list non-display mode described later.

  The storage unit 17 stores content recording data 121 and caption management data 122, which will be described later.

  The storage unit 17 may be configured by either a memory built in the mobile phone 1 or a removable external memory. The storage unit 17 also functions as a work memory for the control unit 19.

  The bus 18 transmits data between the units.

  The control unit 19 controls the overall operation of the mobile phone 1. For example, it controls start / end of playback of recorded content, switching of subtitle texts displayed in the subtitle list, and the like.

  The control unit 19 includes a CPU 20 (Central Processing Unit), a ROM (Read Only Memory) 21, and a timer 22.

  The CPU 20 reads program data stored in the ROM 21 and executes processing according to the program to control the operation of the entire mobile phone 1.

  The ROM 21 stores program data processed by the CPU 20.

  The timer 22 is composed of, for example, a software timer.

  The timer 22 acquires time information indicating the video playback duration from the CPU 20. When the control unit 19 reproduces the video on the display unit, the timer 22 measures the elapsed time from the start of reproduction. When the measured time reaches the time indicated by the time information, a signal to that effect is supplied to the CPU 20.

  The control unit 19 controls the start / end of the reception of the television broadcast when the user views the TV program and the start / end of the recording of the content when the user records the TV program.

  Next, data used in the present embodiment will be described. As shown in FIG. 3A, the storage unit 17 stores content recording data 121 and caption management data 122.

  As shown in FIG. 3B, the one-segment broadcasting content (television signal) is composed of TSP (Transport Stream Packet).

  The TSP is composed of a stream in which a video packet V storing video data in a payload, an audio packet A storing audio data in the payload, and a subtitle packet C storing subtitle data in the payload are mixed.

  The control unit 19 classifies each packet constituting the received TSP according to the type of data stored in each packet, and rearranges the packets based on the packet number assigned to each packet.

  Then, as shown in FIG. 3C, the control unit 19 generates a video PES (Packetized Elementary Stream) 131, an audio PES 132, and a subtitle PES 133, and stores them in the storage unit 17 as the content recording data 121. To do.

  The video PES 131 is compression-encoded data of packetized frames, and includes data defining each frame. Each frame includes data indicating the reproduction timing.

  TSP in one-segment broadcasting is data according to a predictive coding method. Therefore, the video PES 131 includes an IDR (Instantaneous Decoder Refresh) frame (corresponding to the independent video packet VI) that does not refer to other frames, and a P frame (reference) that refers to an IDR frame that is reproduced earlier than its own reproduction timing. Corresponding to the video packet VP). In one-segment broadcasting, the frame rate of video frames is 15 frames / second.

  The voice PES 132 is packetized voice compression encoded data.

  The caption PES 133 is compression encoded data of a packetized caption text. The caption PES 133 includes data necessary for generating the caption management data 122. For example, the subtitle PES 133 includes a subtitle sentence Stn (n: 1 to N, N: the number of subtitles PES in the content recording data 121), a subtitle playback timing TMn (n: 1 to N), and a control code CSn (n: 1-N).

  The caption text Stn indicates the content of the caption text of the video with caption, and is data stored as the caption text Stn of the caption management data 122. The caption reproduction timing TMn indicates the timing of reproducing the caption text Stn, and is expressed in units of PTS (Presentation Time Stamp). In one-segment broadcasting, each caption sentence is generated once every 15 seconds.

  As shown in FIG. 4, the caption management data 122 is data that stores the caption display time Tdn and the caption text Stn in association with each other. The caption display time Tdn indicates the time when the reproduction of the caption text Stn is started. For example, when the caption management data 122 is the data shown in FIG. 4, the caption sentence “Good morning” is reproduced from the display time “00:00:04” and reaches the display time “00:00:09”. , caption text "Hello." is played.

  In one-segment broadcasting, the video frame rate is 15 frames / second. For this reason, one subtitle sentence corresponds to a plurality of frames as video corresponding to the reproduction timing.

  Therefore, for example, a plurality of frames I1 to P1L correspond to the caption sentence St1 (“Good morning”) as a video corresponding to the reproduction timing TM1.

  Then, when a video with subtitles corresponding to the subtitle sentence St1 (“Good morning”) is reproduced, the display unit 15 displays a video composed of the subtitle sentence St1 and the frame I1 → the subtitle sentence St1, the frame I1, and the P11 frame. Synthesized video → Subtitle sentence St1 and video synthesized from frame I1 and P12 frame → are continuously displayed.

  Next, an operation in which the control unit 19 registers the information acquired from the television signal in the caption management data 122 will be described with reference to the flowchart in FIG. Note that the control unit 19 creates subtitle data 3BN (N: integer) in the subtitle management data 122 by the same number as the control code CS included in the television signal.

  The process shown in the flowchart of FIG. 5 is started when the control unit 19 acquires the television signal supplied from the tuner 10 and stores it in the storage unit 17.

  When the process shown in the flowchart of FIG. 5 is started, the control unit 19 tries to extract the caption PES from the television signal and determines whether the caption PES has been extracted (step S101).

  If the caption PES cannot be extracted and the end of the file is reached (step S101: No), the control unit 19 ends the process.

  If the caption PES can be extracted (step S101: Yes), the control unit 19 determines whether or not the information included in the extracted caption PES is a caption sentence (step S102). If the extracted information is not a caption text (step S102: No), the control unit 19 returns the process to step S101 to extract the next caption PES.

  If the extracted information is a caption text (step S102; Yes), the control unit 19 analyzes the caption PES, and displays the caption playback timing TM1 included in the caption PES and the caption text to be stored in the caption text St1. Take out (step S103).

  The control unit 19 subtracts the playback timing Tf of the video at the head of the television signal from the playback timing TM1 of the caption text extracted from the subtitle PES, and obtains the elapsed time Tp1 (PTS unit) when played back from the head of the video. .

  The control unit 19 converts the elapsed time Tp1 (PTS unit) into a normal hour / minute / second unit, and stores the converted elapsed time Tp1 (character fraction / second unit) as the display time Td1 of the caption management data 122 (step S104). ). That is, in FIG. 4, 00:00:00 is registered as the display time Td1.

  Further, the control unit 19 registers the subtitle sentence (“Good morning”) up to immediately before the control code CS1 in the subtitle sentence 3B1 of the subtitle management data 122 (step S105).

  When the caption data St1 (“Good morning”) is registered in the caption management data 122, the control unit 19 returns the process to step S101 and searches for the caption reproduction timing TM2 after the control code CS1.

  The control unit 19 uses, as the display time Td2 of the caption management data 122, the video playback timing TM2 (00:00:20) converted from the PTS unit to the hour / minute / second unit at the display time Td1 (00:00:00). The added display time Td2 (00:00:20) is registered (step S104).

  The control unit 19 registers the subtitle data St2 included between the first control code CS1 to the next control code CS2 (the "hello.") To the caption text 3B2 (step S105).

  Hereinafter, the control unit 19 repeats the process of extracting the caption reproduction timing TMn from the television signal and generating the caption management data 122 until the control code CSn disappears.

  If the control code CS is not present before the control code CS1, the control unit 19 registers all the caption texts included in the television signal in the caption text St1.

  And the control part 19 produces | generates the caption management data 122 as a table (step S106), and complete | finishes a process.

  Next, a screen displayed on the display unit 15 when the user views the captioned video will be described below with reference to FIGS. 6 (a) and 6 (b). Note that, in the screen D2 of FIG. 6B, the same components as those of the screen D1 are denoted by the same reference numerals as those in FIG.

  Screen display modes when the user views the video with captions include a list display mode and a list non-display mode. The user can select whether to display the screen D1 or the screen D2 on the display unit 15 by pressing the list display switching button 4 on the operation unit 16.

  The screen D1 in the list display mode is the screen shown in FIG. 6A, and the screen D2 in the list non-display mode is the screen shown in FIG. 6B.

  As shown in FIG. 6A, the screen D1 in the list display mode includes a pictogram area PA, a video area DA, a caption area SA, a caption list area LA, and a soft key area FA.

  The pictogram area PA is an area for displaying the reception status of the mobile phone, the remaining battery level, the current date and time, and the like.

  The video area DA is an area for displaying a video corresponding to the selected caption text. In FIG. 6A, a human face is displayed as an image corresponding to the currently selected subtitle sentence.

  The caption area SA is an area for displaying a selected caption text.

  The subtitle list area LA is an area for displaying a subtitle list in which a plurality of subtitle sentences are arranged. FIG. 6A shows an example of a caption list that displays five caption sentences. The caption list area LA includes caption list branch areas LA1 to LA5 for displaying five caption sentences.

  In the list display mode, a list of subtitle sentences that can be selected by the user is displayed in the subtitle list area LA.

  When the subtitle management data 122 shown in FIG. 4 is registered in the storage unit 17, the subtitle management data 122 is sorted and displayed in ascending order according to the display time Td, “Good morning” is displayed in the subtitle list branch area LA1, and the subtitle list area LA2 is displayed. "Hello." is displayed in the.

  When the user operates the cursor key 3 to select a subtitle sentence from the subtitle list, the selected subtitle sentence is displayed in the center of the subtitle list area LA (subtitle list branch area LA3). Details of the operation for displaying the selected caption text in the center of the caption list area LA will be described later.

  The soft key area FA is an area for displaying the currently selected operation mode and the like.

  Next, the screen D2 in the list non-display mode will be described. On the screen D2, as shown in FIG. 6B, the subtitle list is not displayed, so the main part constituting the screen is the video area DA.

  When viewing the content, the user can concentrate on viewing the subtitled video by selecting the list non-display mode and reproducing and displaying the subtitled video.

  Next, an operation in which the control unit 19 scrolls the selected subtitle sentence at the center of the subtitle list area LA will be described.

  As a premise, it is assumed that the caption sentence selected by the user is the Mth caption sentence StM (M: positive integer from 1 to N) from the first line in the caption management data 122.

  The control unit 19 determines that the caption text StM has been selected based on the operation information supplied from the operation unit 16.

  The control unit 19 determines whether or not M-1 is 2 or more.

  If it is determined that M-1 is 2 or more, the control unit 19 displays the subtitle sentence StM-2 two lines before the subtitle sentence StM in the subtitle list branch area LA1, and the subtitle sentence StM in the subtitle list branch area LA2. The subtitle sentence StM-1 of the previous line is displayed.

  If it is determined that M-1 is 1, the subtitle sentence being selected by the user is the subtitle sentence St2 in the second line from the top, so the control unit 19 does not display anything in the subtitle list branch area LA1, The caption text St1 is displayed in the caption list branch area LA2.

  Further, if it is determined that M-1 is 0, the subtitle sentence currently selected by the user is the subtitle sentence St1 in the first line, so the control unit 19 displays nothing in the subtitle list display branch areas LA1 and LA2. do not do.

  Further, the control unit 19 determines whether or not NM is 2 or more in order to determine which subtitle text is displayed in the subtitle list branch areas LA4 and LA5.

  If it is determined that NM is 2 or more, the control unit 19 displays the caption sentence St (M + 1) in the caption list branch area LA4 and the caption sentence St (M + 2) in the caption list branch area LA5.

  If it is determined that NM is 1, the control unit 19 displays the caption text StN in the caption list branch area LA4 and does not display anything in the caption list branch area LA5.

  Furthermore, if NM is 0, the subtitle sentence currently selected by the user is the subtitle sentence StN in the last line, and therefore the control unit 19 displays nothing in the subtitle list branch areas LA4 and LA5.

  Thereby, the caption text selected by the user is displayed in the caption list branch area LA3 located in the center of the caption list area LA.

  FIGS. 7A and 7B show examples of screen display when the user presses the cursor key 3 provided on the operation unit 16 and selects a caption sentence in the caption list area LA in the list display mode. Show.

  FIGS. 7C and 7D show examples of screen display when the user presses the cursor key in the list non-display mode. At this time, since the subtitle sentence selected according to the user's operation of the cursor key 3 is changed, the subtitle sentence displayed in the subtitle area SA of the screen D2 is changed.

  Next, the operation of displaying the video of the IDR frame corresponding to the start of reproduction of the selected caption text StM will be described with reference to the flowchart of FIG.

  The process shown in the flowchart of FIG. 8 is activated when the user operates the cursor key 3 to select a caption sentence StM in the caption list.

  When the user selects a caption sentence (step S110), the control unit 19 extracts information on the leading frame from the television signal (step S111).

  The control unit 19 determines whether or not the extracted frame is an IDR frame from the extracted frame information (step S112). If it is determined that the frame is not an IDR frame (step S112: No), the control unit 19 returns the process to step S111 and extracts information of the next frame.

  If it is determined that the frame is an IDR frame (step S112: Yes), the control unit 19 subtracts the playback timing Tf of the frame at the head of the television signal from the playback timing of the IDR frame and calculates an elapsed time TpM from the head. (Step S113).

  When the elapsed time TpM is calculated, the control unit 19 determines the magnitude between the elapsed time TpM and the display time TdM of the selected caption text StM (step S114).

  If it is determined that the display time TdM of the caption text StM is larger than the elapsed time TpM of the extracted frame (step S114: Yes), the control unit 19 stores the position of the data of the frame extracted in step S113 (step S115). .

  Then, the control unit 19 returns the process to step S111, and further extracts frame information.

  If it is determined that the display time TdM is greater than the elapsed time TpM in the next extracted frame (step S114: Yes), the control unit 19 stores the data position of the newly extracted frame (step S115).

  On the other hand, if it is determined that the display time TdM is smaller than the elapsed time TpM (step S114: No), the control unit 19 displays an IDR frame based on the information stored in step S115 (step S116).

  The control unit 19 displays the selected caption text StM in the caption area SA (step S117).

  In addition, the control unit 19 scrolls the subtitle list so that the selected subtitle sentence StM is positioned at the center of the subtitle list area LA (step S118).

  Thereby, for example, when the user selects the caption text St1 (“Good morning”), the IDR frame I1 immediately after the caption display time Td1 is displayed. For example, when the user selects the caption text St2 ( "hello."), IDR frames I2 immediately after the subtitle display time Td2 is displayed. Note that control may be performed so that the IDR frame immediately before the caption display time is displayed.

  Next, a one-scene moving image playback function for playing back a video corresponding to the caption sentence StM selected by the user will be described with reference to the flowchart shown in FIG.

  The user has previously turned on or off the one-scene moving image playback mode on the menu screen.

  When the user turns on the one-scene video playback mode, the control unit 19 turns on the one-scene video playback flag. The one-scene video reproduction flag is a software variable stored in the storage unit 17. For example, if the value of this variable is 1, the 1-scene moving image playback mode is ON, and if it is 0, it is OFF.

  The user operates the cursor key 3 to select a caption sentence StM from the caption sentences displayed in the caption list area LA.

  First, the control unit 19 executes processing similar to the processing from step S110 to step S116 shown in the flowchart of FIG.

  The control unit 19 displays an IDR frame corresponding to the caption text StM selected by the user in the video area DA (step S117), and reproduces the caption text StM in the center of the caption area SA (step S118).

  Next, the control unit 19 determines whether or not the one-scene video playback flag is ON (step S121). When it is determined that the one-scene video reproduction flag is OFF (step S121: No), the control unit 19 ends the process.

  If it is determined that the one-scene video playback flag is ON (step S121: Yes), the control unit 19 displays the caption text StM display time TdM and the caption text StM next to the caption text StM from the caption management data 122 (M + 1). Display time Td (M + 1) is acquired (step S122).

  When acquiring the display times Td (M + 1) and TdM, the control unit 19 calculates the difference Td (M + 1) −TdM.

  The control unit 19 reproduces the video from the IDR frame corresponding to the start of reproduction of the caption sentence StM (step S123).

  The control unit 19 measures the elapsed time since the start of video reproduction in step S123 (step S124).

  The control unit 19 determines whether or not the elapsed time is greater than the display time difference Td (M + 1) −TdM (step S125).

  When it is determined that the elapsed time is smaller than the display time difference Td (M + 1) −TdM (step S125: No), the control unit 19 returns the process to step S124 and restarts the time measurement.

  When it is determined that the elapsed time is greater than the display time difference Td (M + 1) −TdM (step S125: Yes), the control unit 19 pauses the video (step S126) and ends the process.

  As a result, the user can view only the desired scene by simply operating the cursor key 3 and selecting the caption sentence corresponding to the desired scene. Therefore, it is not necessary to perform a stop operation, and usability is improved.

(Embodiment 2)
In the one-scene video reproduction, the playback is paused when the display time of the next caption text after the selected caption text is reached. Therefore, a frame corresponding to the next subtitle sentence after the selected subtitle sentence is reproduced on the display unit. That is, a frame that does not correspond to the selected subtitle sentence is being played back.

  Therefore, after the reproduction of one scene video, the IDR frame immediately after the subtitle display time of the selected subtitle text is reproduced. The operation of reproducing the IDR frame immediately after the caption display time of the caption text selected after the one-scene moving image reproduction will be described with reference to the flowchart shown in FIG.

  When the user selects a caption text StM from the caption texts displayed in the caption list area LA, the control unit 19 first executes the same processing as Steps S110 to S126 and pauses (Step S126).

  Next, the control part 19 performs the process similar to step S110-step S116, and displays the IDR frame immediately after the caption display time of the caption sentence StM which the user selected (step S131).

  As a result, the IDR frame immediately after the subtitle display time of the subtitle text selected by the user is displayed after the one-scene video is reproduced and paused, so that an operation without any sense of incongruity for the user is realized.

(Embodiment 3)
Next, the operation of repeatedly playing back the video corresponding to the selected caption text will be described with reference to the flowchart shown in FIG.

  On the menu screen, the user has previously turned on the one-scene moving image playback mode and turned on or off the repeated playback mode.

  When the user turns on the repeated playback mode, the control unit 19 turns on the repeated playback flag. The repeated reproduction flag is a software variable stored in the storage unit 17. If the value of this variable is 1, for example, the repeat playback mode is ON, and if it is 0, it is OFF.

  First, the control unit 19 reproduces a video corresponding to the caption sentence StM selected by the user and pauses (Step S126).

  Next, the control unit 19 determines whether the repeated regeneration flag is in an ON state or an OFF state (step S141). When it is determined that the repeated reproduction flag is in the OFF state (step S141: No), the control unit 19 ends the process in a temporarily stopped state.

  When it is determined that the repeated reproduction flag is in the ON state (step S141: Yes), the control unit 19 displays the IDR frame immediately after the caption display time of the caption sentence StM selected by the user (step S131), and the caption sentence StM. The video corresponding to is reproduced once and paused (step S142).

  Next, the control unit 19 determines whether or not the user has performed another operation during the reproduction based on the operation information supplied with the operation information from the operation unit 16 (step S143). When it is determined that the user has performed another operation (step S143: Yes), the control unit 19 ends the one-scene video reproduction and executes other processing instructed by the user.

  When it is determined that the user has not performed another operation (step S143: No), the control unit 19 returns the process to step S131.

  This repeated reproduction improves usability for the user, for example, by repeatedly viewing a conversation scene that cannot be heard in an English conversation program.

(Embodiment 4)
In the embodiments so far, if another subtitle sentence is selected during one-scene moving image reproduction, it is necessary to wait until the reproduction of the video is stopped. Further, the decoding unit 11 extracts frame information from the content recording data 121 during video reproduction, and when another subtitle sentence is selected, the frame information at two locations must be extracted simultaneously. As a result, power consumption increases and the circuit scale also increases.

  Therefore, an operation when the user selects another caption text from the caption list during one-scene video reproduction will be described with reference to the flowchart shown in FIG.

  When the user selects another subtitle sentence StL, the control unit 19 determines whether or not a moving image is being reproduced (step S151). When it is determined that the moving image is not being reproduced (step S151: No), the control unit 19 reproduces the selected caption text StL and the video corresponding to the caption text StL (step S153).

  When it is determined that the video is being played back (step S151: Yes), the control unit 19 pauses the video currently being played back (step S152), and the video corresponding to the selected subtitle sentence StL and the subtitle sentence StL. Are reproduced (step S153).

  This makes it possible to reduce power consumption and eliminate the need to increase the circuit scale. In addition, the user can immediately view the video corresponding to the newly selected subtitle sentence by selecting another subtitle sentence at a desired timing during the video reproduction.

(Embodiment 5)
Next, an operation of repeatedly reproducing a video corresponding to a subtitle sentence selected by the user from a video corresponding to a subtitle sentence after a predetermined number will be described with reference to a flowchart shown in FIG.

  The subtitle number n is a software variable stored in the storage unit 17. The control unit 19 can access the storage unit 17 and obtain the subtitle number n.

  The subtitle number n may be determined when compiling the program, but may be set by the user while operating the mobile phone 1.

  First, the control unit 19 executes processing similar to steps S110 to S126 in the flowchart shown in FIG.

  Next, the control unit 19 acquires a preset subtitle number n (step S161).

  The control unit 19 acquires the display time TdM of the subtitle sentence StM and the display time Td (M + n) of the n subtitle sentences St (M + n) after the subtitle sentence StM (step S162).

  When acquiring the display times Td (M + n) and TdM, the control unit 19 calculates the difference Td (M + n) −TdM.

  Next, the control unit 19 executes the same processing as steps S110 to S116 in the flowchart shown in FIG. 9, and displays the IDR frame immediately before the caption display time TdM of the caption text StM selected by the user (step S131). .

  The control unit 19 measures the elapsed time since the start of video reproduction in step S123 (step S124).

  The control unit 19 determines whether or not the elapsed time is greater than the display time difference Td (M + n) −TdM (step S163).

  When it is determined that the elapsed time is smaller than the display time difference Td (M + n) −TdM (step S163: No), the control unit 19 returns the process to step S124 and restarts the time measurement.

  When it is determined that the elapsed time is greater than the display time difference Td (M + 1) −TdM (step S163: Yes), the control unit 19 pauses the video (step S126).

  Next, the control unit 19 determines whether or not the user has performed another operation during reproduction based on the operation information supplied with the operation information from the operation unit 16 (step S164). If it is determined that the user has performed another operation (step S164: Yes), the control unit 19 ends the process and executes another process instructed by the user.

  When it is determined that the user has not performed another operation (step S164: No), the control unit 19 returns the process to step S131.

  Thereby, for example, even when a scene that cannot be heard in an English conversation program is a scene that spans a plurality of subtitle sentences, the user can repeatedly reproduce and view the scene that cannot be heard.

  In this embodiment, the video between the subtitle sentence selected by the user and the subtitle sentence after the predetermined number is repeatedly reproduced. However, for example, when the reproduction of the video corresponding to the subtitle sentence after a predetermined number of times ends, the video corresponding to the end of the reproduction may be paused. Further, for example, after the reproduction of the video, the IDR frame immediately after the caption display time of the caption text selected by the user may be reproduced and paused.

  Here, an example of the display displayed on the screen of the mobile phone 1 will be described with reference to FIGS.

  The user operates the cursor key 3, if you select the "Hello." Caption text 1407 that is displayed in the caption list, frame 1401 corresponding to the caption text 1407 in the video area DA is displayed.

  Advance 1 when scene video reproduction flag is ON state, the user selects the "Hello." Caption text 1407, as shown in FIG. 14 (b), the image is reproduced in the image area DA.

  Then, when the display time of the subtitle sentence 1408 “Good evening” next to the subtitle sentence 1407 is reached, as shown in FIG.

  Next, when the user presses the downward key of the cursor key 3, the subtitle sentence 1409 “Good evening” is selected as shown in FIG.

  Then, as shown in FIG. 14E, the video corresponding to the caption sentence 1409 “Good evening” is reproduced.

  Then, when time elapses and the display time of the subtitle sentence 1410 “Goodbye”, which is the next subtitle sentence, is reached, as shown in FIG.

  In the repeat playback mode, as shown in FIG. 14C, after the video is temporarily stopped, the state returns to the state shown in FIG. 14A and the video is played back.

  Also, when the number of subtitle sentences to be repeated is two in a mode in which a plurality of subtitle sentences are repeatedly reproduced, the subtitle sentence is replayed until the display time of the subtitle sentence 1410 “Goodbye” that is two behind the subtitle sentence 1407 Pause and return to the state shown in FIG. 14A, and the video is played back.

(Embodiment 6)
In one-scene video playback, if the time interval from the subtitle display time of the subtitle sentence selected by the user to the subtitle display time of the next subtitle sentence is long, the time for playing back the video corresponding to the selected subtitle sentence becomes long. .

  Therefore, the flowchart shown in FIG. 15 shows the operation of determining the video playback time according to the number of characters included in the subtitle sentence selected by the user, and pausing the video playback time after the video playback has started. Will be described with reference to FIG.

  The mobile phone 1 stores the subtitle character count-video playback time correspondence data 1600 in the storage unit 17 in advance. An example of the subtitle character count-video playback time correspondence data is shown in FIG.

  In the subtitle character count-video playback time correspondence data 1600, the subtitle character count 1601 and the video playback time 1602 are registered.

  For example, when the number of subtitle characters included in the subtitle text selected by the user is “1 to 10 characters”, the control unit 19 sets the video playback time for playing back the video corresponding to the subtitle text to “5 seconds”. .

  First, the control part 19 performs the process of step S110-step S118 of the flowchart shown in FIG. When the control unit 19 ends the process of step S118, the IDR frame immediately after the caption display time TdM of the caption text StM selected by the user and the caption text StM are reproduced.

  Next, the control unit 19 determines whether or not the one-scene video playback flag is ON (step S121). If it is determined that the one-scene video playback flag is not ON (step S121: No), the control unit 19 ends the process.

  When it is determined that the one-scene moving image playback flag is ON (step S121: Yes), the control unit 19 acquires the caption display times TdM and Td (M + 1) (step S122).

  Next, the control unit 19 determines the number of subtitle characters included in the subtitle sentence StM (step S171).

  Next, the control unit 19 reads the subtitle character count-video playback time correspondence data 1600 stored in the storage unit 17, and determines the video playback time Tplay corresponding to the subtitle character count determined in step S171 (step S172). .

  The control unit 19 determines the difference Td (M + 1) −TdM between the display time Td (M + 1) and TdM determined in step S122 and the size of the video reproduction time Tplay determined in step S172 (step S173).

  When it is determined that the difference Td (M + 1) −TdM is larger than Tplay (step S173: Yes), the control unit 19 sets Tplay as the time for reproducing the video corresponding to the caption text StM (step S174).

  When it is determined that the difference Td (M + 1) −TdM is smaller than Tplay (step S173: No), the control unit 19 sets Td (M + 1) −TdM as the time for reproducing the video corresponding to the caption text StM ( Step S175).

  The control unit 19 reproduces the video from the IDR frame immediately after the caption display time TdM of the caption text StM (step S123).

  The control unit 19 measures the elapsed time from the start of reproduction in step S123 (step S124).

  The control unit 19 determines whether or not the elapsed time is longer than the reproduction time set in step S174 or step 175 (step S176).

  When it is determined that the elapsed time is shorter than the reproduction time set in step S174 or step 175 (step S176: No), the control unit 19 returns the process to step S124 and restarts timing.

  If it is determined that the elapsed time is longer than the playback time set in step S174 or step 175 (step S176: Yes), the control unit 19 pauses the video (step S126) and ends the process.

  Therefore, in normal one-scene video reproduction, the video is reproduced from the caption display time TdM to Td (M + 1) in FIG. However, in the one-scene video playback in this embodiment, the video is played from the caption display time TdM to TdM + Tplay.

  In this embodiment, when Tplay elapses, the playback is paused at the frame being played.

  For example, when Tplay elapses, a frame corresponding to the reproduction end timing of the caption sentence selected by the user may be reproduced. Alternatively, after Tplay, the IDR frame immediately after the caption display time of the caption text selected by the user may be played and paused.

  Further, when Tplay has passed, the playback may be started from the IDR frame immediately after the caption display time TdM of the caption text selected by the user.

  Thereby, the user can watch the scene in which the caption text is displayed with priority. For example, if the user wants to view the scene immediately before the CM, if there is no function of this embodiment, the video must be played back until the time when the subtitle text is displayed after the CM. However, if the function of this embodiment is provided, it is not necessary to view the CM. Accordingly, since a scene that the user does not want to view is not reproduced, usability is improved.

  Further, by adding the operation of repeated playback, it is possible to view the scene immediately before the CM many times.

(Embodiment 7)
Further, the video playback time may be matched with the display time of the IDR frame. This is because an IDR frame has a high probability of occurring when switching scenes, and there is a possibility that the scene corresponding to the selected subtitle sentence ends at the display time of the IDR frame.

  Therefore, when the playback time is determined in step S174 or step S175, the control unit 19 determines an IDR frame immediately before or after the determined playback time.

  Then, the control unit 19 sets the display time of the determined IDR frame as a time to pause. FIG. 17B shows stop time candidates. The display time of the IDR frame immediately before (immediately after) TdM + Tplay is T1 (T2), and this time is set as the stop time.

  Thereby, since the user can watch a moving image without a sense of incongruity, a user's convenience improves.

(Embodiment 8)
Next, when the playback time of the subtitle sentence selected by the user is long, and you want to understand the scene contents corresponding to the selected subtitle sentence by playing at a higher playback speed instead of the normal playback speed. There is.

  Accordingly, with reference to the flowchart shown in FIG. 18, an operation for determining the playback speed corresponding to the playback time for playing the selected subtitle sentence and playing the video corresponding to the subtitle sentence at the determined playback speed will be described. I will explain.

  The cellular phone 1 stores the reproduction speed correspondence data 1900 shown in FIG.

  In the reproduction speed correspondence data 1900, a reproduction time 1901 and a reproduction speed 1902 are registered.

  For example, when the reproduction time of the caption sentence selected by the user is “31 to 60 seconds”, the control unit 19 sets a speed “1.3 times” the normal reproduction speed as the reproduction speed.

  First, the control part 19 performs the process from step S110 to step S118 of the flowchart shown in FIG. When the control unit 19 ends the process of step S118, the IDR frame immediately after the caption display time TdM and the caption text StM are displayed.

  Next, the control unit 19 acquires the caption display time TdM of the caption text SdM and the caption display time Td (M + 1) of the next caption text.

  When acquiring the caption display times TdM and Td (M + 1), the control unit 19 calculates the difference Td (M + 1) −TdM (step S181).

  Next, the control unit 19 reads the playback speed correspondence data 1900 stored in the storage unit 17 and acquires the playback speed corresponding to Td (M + 1) −TdM calculated in step S181 (step S182).

  The control unit 19 sets the acquired playback speed and plays back the video corresponding to the caption text StM (step S183).

  When the reproduction is started, the control unit 19 executes the processing from step S124 to step S126 in the flowchart shown in FIG. 9, pauses the video, and ends the processing.

  At this time, the timer 22 corrects the video playback time based on the playback speed at which the control unit 19 plays back the video.

  For example, when the playback speed is four times the normal playback speed and the playback time at the normal playback speed is 20 seconds, the timer 22 corrects the time to be measured as 20 (seconds) / 4 = 5 seconds. And keep time.

  In this embodiment, when the time corrected by the timer 22 has elapsed since the start of video playback, the frame being played is played back and paused. In addition, for example, when the time corrected by the timer 22 has elapsed, the IDR frame immediately after the caption display time of the selected caption text may be reproduced.

  Thereby, even when the reproduction time of the selected caption text is long, the user can grasp the contents of the scene corresponding to the caption text in a short time.

(Embodiment 9)
Next, the operation of setting the playback speed as the playback mode in advance and determining the playback speed from the playback mode during playback will be described with reference to the flowchart shown in FIG.

  As a method for setting the playback mode, there is a method in which the user operates a key provided on the operation unit 16 or a user sets from a menu of the user interface.

  For example, when the user presses the “2” key on the keyboard, the playback mode may be set to the fast-forward mode, and when the user presses the “0” key, the playback mode may be set to the normal playback mode.

  In order to determine the playback speed from the playback mode, the storage unit 17 stores in advance playback mode-playback speed correspondence data indicating the correspondence between the playback mode and the playback speed shown in FIG. In the reproduction mode-reproduction speed correspondence data 2100, a reproduction mode 2101 and a reproduction speed 2102 are registered.

  For example, when the playback mode is “fast forward mode”, the playback speed is set to “double”. The playback mode is a software variable stored in the storage unit 12. For example, if the value of the playback mode is 0, the playback mode is set to the normal playback mode.

  First, the control part 19 performs the process from step S110 to step S118 of the flowchart shown in FIG. When the control unit 19 ends the process of step S118, the caption sentence StM selected by the user and the IDR frame immediately after the caption display time TdM are reproduced.

  Next, the control unit 19 acquires the display start time TdM of the subtitle sentence StM and the playback start time Td (M + 1) of the next subtitle sentence (step S191).

  When acquiring the display times TdM and Td (M + 1), the control unit 19 calculates the difference Td (M + 1) −TdM.

  Next, the control unit 19 reads out the playback mode and the playback mode-playback speed correspondence data 2100 stored in the storage unit 17, and determines the playback speed corresponding to the set playback mode (step S192).

  The control unit 19 plays back the video corresponding to the subtitle sentence StM at the determined playback speed (step S193).

  When the reproduction is started, the control unit 19 executes the processing from step S124 to step S126 in the flowchart shown in FIG. 9, pauses the video, and ends the processing.

  In this embodiment, the process is paused and the process is terminated. However, for example, it is also possible to reproduce a video repeatedly. Further, for example, the IDR frame immediately after the caption display time TdM of the caption text StM may be reproduced and paused after the suspension.

  Accordingly, the video can be played back at the playback speed that the user wants to play regardless of the playback time of the caption text selected by the user.

  Further, the presence or absence of audio output may be set according to the playback mode.

  For example, when video is played at a normal speed, audio is output, and when video is played at a speed three times the normal playback speed, no audio is output.

  Thereby, the user can concentrate on only the video.

  Here, FIG. 22 shows an example of the screen display when the user sets the playback speed according to the menu displayed on the screen of the mobile phone 1.

  A screen in the list display mode is shown in FIG. When the user presses a key corresponding to the “sub menu” of the soft key 2201, a sub menu screen is displayed. The submenu screen is shown in FIG.

  When the user selects “reproduction speed setting”, a reproduction speed setting screen is displayed as shown in FIG.

  The user presses the up / down direction key of the cursor key 3 to change the reproduction speed shown in the display field 2202.

  Further, FIG. 22D shows a playback speed setting screen when the playback speed can be changed for each playback time for playing back the caption text. The user can change the playback speed by changing the numbers displayed on the displays 2203 and 2204.

  For example, when the subtitle playback time is 1 to 30 seconds, the playback speed can be set to double, and when the subtitle playback time is 31 to 60 seconds, the playback speed can be set to 4 times.

  Thereby, the user can set a favorite reproduction speed according to the length of the subtitle reproduction time.

(Embodiment 10)
Next, an operation for displaying the progress of moving image reproduction will be described with reference to the flowchart shown in FIG. Here, a generally used bar display will be described as an example.

  As a method of setting the bar display mode for executing the bar display, there is a method in which the user operates a key provided on the operation unit 16 or a user sets from a menu of the user interface.

  First, when the user selects a caption text StM, the control unit 19 executes processing from step S110 to step S118 in the flowchart shown in FIG. When the control unit 19 finishes the process of step S118, an IDR frame corresponding to the reproduction start timing of the caption text StM selected by the user and the caption text StM are displayed.

  Next, the control unit 19 determines whether or not the one-scene video reproduction flag is ON (step S121). If it is determined that the one-scene video playback flag is not ON (step S121: No), the control unit 19 ends the process.

  If it is determined that the one-scene video playback flag is ON (step S121: Yes), the control unit 19 displays the display time TdM of the caption text StM and the display time Td (M + 1) of the caption text St (M + 1) next to the caption text StM. M + 1) is acquired (step S122).

  The control unit 19 reproduces the video from the IDR frame corresponding to the reproduction start timing of the caption sentence StM (step S123).

  The control unit 19 measures the elapsed time since the start of video reproduction in step S123 (step S124).

  Next, the control unit 19 calculates the ratio of the elapsed time from the reproduction start timed in step S124 to the reproduction time Td (M + 1) −TdM of the caption text StM (step S201).

  When the ratio is calculated, the control unit 19 calculates the length of the progress bar with respect to the entire bar displayed on the display unit 15, and displays the calculated length of the bar (step S202).

  Next, the control unit 19 determines whether or not the elapsed time is greater than the display time difference Td (M + 1) −TdM (step S125).

  When it is determined that the elapsed time is smaller than the display time difference Td (M + 1) −TdM (step S125: No), the control unit 19 returns the process to step S124 and restarts the time measurement.

  When it is determined that the elapsed time is greater than the display time difference Td (M + 1) −TdM (step S125: Yes), the control unit 19 pauses the video (step S126) and ends the process.

  For example, the bar display is performed as follows.

  Let the playback time of the selected subtitle sentence be 100 pixels. When the ratio calculated in step S201 is 45%, the length of the progress bar is 100 × 0.45 = 45 pixels.

  In this case, for example, when the playback time is 1 minute and the elapsed time from the start of playback is 36 seconds, the length of the progress bar is 100 (pixels) × 36 (seconds) / 60 (seconds) = 60 (pixels) It is.

  Next, an example of the display unit 15 during video reproduction is shown in FIG.

  When playing an image corresponding to the caption text "Hello.", Reproduction time bar 2401 at the start of reproduction, as shown in FIG. 24 (a), it is displayed in a state of white.

  When the video is played back, the progress bar 2402 fills the playback time bar 2401 as shown in FIG.

  When the elapsed time from the start of playback reaches the playback time, the progress bar 2402 has the same length as the playback time bar 2401 as shown in FIG.

  Further, the ratio of the playback time of the caption sentence selected by the user to the playback time of the entire video may be displayed as a bar 2403 in FIG.

  As shown in FIG. 24D, the bar 2403 indicates the ratio of the playback time of the caption text selected by the user to the playback time of the entire video.

  Also, as shown in FIG. 24E, a time 2404 for reproducing a caption text may be displayed in the vicinity of the reproduction time bar 2401.

  In addition to the bar display, for example, a circular display may be displayed, or the elapsed time may be displayed as a digital number.

  Thereby, the user can visually grasp the elapsed time since the video corresponding to the selected subtitle sentence is reproduced. Therefore, user convenience improves.

  In addition, the method of the present invention is not limited to a dedicated computer system. For example, a video playback device with any subtitles such as a PDA, an electronic camera, an electronic watch, a portable TV, a car navigation device, etc., having a content recording / playback function. It is applicable to.

  In addition, the concept of the present invention is to create, distribute, and lend a computer program for causing a computer to function and operate as the mobile phone 1, install it on the computer, and use and transfer it as the mobile phone 1. You may lend.

It is an external view when it sees from the front in the state which opened the mobile telephone which concerns on embodiment of this invention. It is a block diagram which shows the structure of the mobile telephone which concerns on embodiment of this invention. (A) is a figure which shows typically the structure of the data stored in a memory | storage part. (B) is a figure which shows an example of the data structure of content video recording data. (C) is a figure which shows typically the data structure of the content video recording data 121 stored in a memory | storage part. (D) is a figure which shows an example of the data structure of caption PES133. It is a figure which shows an example of the data structure of subtitle management data. It is a flowchart which shows the process which extracts information from TV signal and produces | generates subtitle management data. (A) is a figure which shows a screen structure when the subtitle display list | wrist of the mobile telephone which concerns on embodiment of this invention is displayed. (B) is a figure which shows a screen structure when not displaying the subtitle display list of the mobile telephone which concerns on embodiment of this invention. (A) is a figure which shows the screen structure before a user scrolls a cursor on the screen which displayed the subtitle list, and changes the subtitle to select. (B) is a figure which shows the screen structure after a user changes the subtitle to select by scrolling a cursor on the screen which displayed the subtitle list. (C) is a figure which shows the screen structure before a user scrolls a cursor and changes the subtitle to select on the screen which does not display a subtitle list. (D) is a figure which shows the screen structure after the user scrolls a cursor and changes the subtitle to select on the screen which does not display a subtitle list. It is a flowchart which shows the process which displays the subtitle sentence selected by the user in the center of a subtitle sentence list. It is a flowchart which shows 1 scene moving image reproduction | regeneration processing. It is a flowchart which shows the process which displays the image | video corresponding to the subtitle sentence selected after 1 scene moving image reproduction | regeneration. It is a flowchart which shows the process repeatedly reproduced after 1 scene moving image reproduction | regeneration. It is a flowchart which shows a process when another subtitle sentence is selected during 1 scene moving image reproduction | regeneration. It is a flowchart which shows the process which reproduces | regenerates repeatedly the image | video corresponding to the subtitle sentence after several selected subtitle sentences. It is a figure which shows an example of the display of the screen of the mobile telephone which concerns on embodiment of this invention. It is a flowchart which shows the process which reproduces | regenerates an image | video by the reproduction time corresponding to the number of subtitle characters contained in the selected subtitle sentence. It is a figure which shows an example of subtitle character number-video reproduction | regeneration time corresponding | compatible data. (A) is a figure which shows the relationship between the display time when the selected subtitle sentence and the next subtitle sentence are displayed, and the time which pauses reproduction | regeneration of a video. (B) is a figure which shows the relationship between the stop time corresponding to the number of subtitle characters contained in the selected subtitle sentence, and the display time of the IDR frame displayed before and behind that. It is a flowchart which shows the process which reproduces | regenerates an image | video at the reproduction speed corresponding to the time which reproduces the selected subtitle sentence. It is a figure which shows an example of the reproduction speed corresponding data. It is a flowchart which shows the process which determines reproduction | regeneration speed from reproduction | regeneration mode and reproduces | regenerates an image | video. It is a figure which shows an example of reproduction | regeneration mode-reproduction speed corresponding | compatible data. It is a figure which shows an example of the screen display which sets a mode. It is a flowchart which shows the process which displays the progress of reproduction | regeneration bar while reproducing | regenerating an image | video. (A) is a figure which shows an example of the screen display at the time of the video reproduction start in bar display mode. (B) is a figure which shows an example of the screen display during the image | video reproduction | regeneration in bar display mode. (C) is a figure which shows an example of the screen display at the time of completion | finish of video reproduction | regeneration in bar display mode. (D) is a figure which shows an example of the screen display in bar display mode. (E) is a figure which shows an example of the screen display in bar display mode.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mobile phone, 2 ... Keyboard, 3 ... Cursor key, 4 ... Display switch button, 5 ... Display panel, 6 ... Call microphone, 7 ... Call speaker , 8 ... Speaker, 10 ... Tuner, 10A ... Antenna, 11 ... Decoding unit, 12 ... Audio output unit, 13 ... Audio input unit, 14 ... Communication unit, 15 ... Display unit, 16 ... Operating unit, 17 ... Storage unit, 18 ... Bus, 19 ... Control unit, 20 ... CPU, 21 ... ROM, 22 ... Timer

Claims (14)

  1. Storage means for storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
    Subtitle sentence selecting means for selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage means;
    Subtitle sentence reproduction means for reproducing subtitle sentences from the subtitle sentence selected by the subtitle sentence selection means according to the reproduction order;
    Video playback means for playing back video corresponding to the caption text being played back by the caption text playback means;
    Timer means for measuring an elapsed time from the start of reproduction of the caption sentence by the caption sentence reproduction means, and determining that a predetermined time has elapsed;
    Control means for controlling the subtitle sentence reproduction means so as to reproduce a subtitle sentence in a predetermined reproduction order when the timer means measures a predetermined time;
    Playback speed selection means for selecting one playback speed from a plurality of playback speeds;
    Video playback means for playing back video at a speed selected by the playback speed selection means,
    The control means switches subtitle sentences at time intervals corresponding to the reproduction speed selected by the reproduction speed selection means,
    The timer means includes means for correcting the predetermined time based on the reproduction speed selected by the reproduction speed selection means,
    The storage means
    A plurality of switching time intervals of subtitle sentences during playback and a plurality of playback speeds of the video are stored in association with each other,
    Each subtitle sentence is pre-stored with reproduction duration information indicating a reproduction duration for continuously reproducing the subtitle sentence,
    The control means, the determined time interval to switch the caption text on the basis of the playback time continuation of the subtitle sentence caption text selecting means has selected, to determine the playback speed corresponding to the determined time interval,
    The playback speed selection means selects the playback speed determined by the control means;
    A video playback device with captions.
  2. The control means controls the subtitle sentence reproduction means so that subtitle sentences are sequentially reproduced from subtitle sentences in a predetermined reproduction order when the timer means measures the predetermined time.
    The video reproduction apparatus with captions according to claim 1.
  3. Each subtitle sentence is accompanied by playback time information that specifies the playback duration for each subtitle sentence to be played continuously.
    Each video consists of a video consisting of multiple frames,
    The control means includes
    As the predetermined time measured by the timer means, the reproduction duration indicated by the reproduction time information added to the caption sentence selected by the caption sentence selection means is set and the timer means starts the time counting operation,
    When the timer unit measures the predetermined time, a predetermined frame of the video associated with the subtitle sentence selected by the subtitle sentence selecting unit is reproduced.
    The video reproduction apparatus with captions according to claim 1 or 2.
  4. The control means includes, as a predetermined time measured by the timer means, each subtitle sentence between the subtitle sentence selected by the subtitle sentence selection means and a subtitle sentence corresponding to the reproduction order after a predetermined number of times. Setting the sum of the playback durations indicated by the added playback time information and starting the time counting operation of the timer means;
    The video reproduction apparatus with captions according to claim 1 or 2.
  5. Each subtitle sentence is attached with character number information indicating the number of subtitle characters included in the subtitle sentence.
    The storage means stores the number of characters and a reproduction duration time for continuously reproducing the subtitle sentence of the number of characters in association with each other,
    The control means includes
    Determining the number of characters from the number-of-characters information added to the subtitle sentence selected by the subtitle sentence selection means;
    Referring to the storage means, determine the playback duration corresponding to the determined number of characters, set the determined playback duration as the predetermined time in the timer means,
    When the timer unit measures the predetermined time, the video associated with the subtitle sentence selected by the subtitle sentence selecting unit is reproduced from a predetermined frame.
    The video reproduction apparatus with captions according to claim 3.
  6. The control means reproduces the first frame of the video associated with the caption text selected by the caption text selection means when the timer means measures the predetermined time.
    The video playback device with captions according to any one of claims 3 to 5.
  7. The control means plays back the last frame of the video associated with the caption text selected by the caption text selection means when the timer means measures the predetermined time.
    The video playback device with captions according to any one of claims 3 to 5.
  8. The control means, when the timer means measures the predetermined time, reproduces the video associated with the subtitle sentence selected by the subtitle sentence selection means in order from the predetermined frame,
    The video reproduction apparatus with captions according to claim 3 or 5.
  9. The control means reproduces sequentially from the first frame of the video associated with the caption text selected by the caption text selection means when the timer means measures the predetermined time,
    The video reproduction apparatus with captions according to claim 8.
  10. The control means includes
    Detecting an IDR (Instantaneous Decoder Refresh) frame included in a plurality of frames constituting a video of a predictive encoding method associated with the subtitle sentence selected by the subtitle sentence selecting unit;
    When the timer means measures the predetermined time, the IDR frame closest to the frame being reproduced is determined and reproduced.
    The video reproduction apparatus with captions according to claim 5.
  11. The video playback device with subtitles is
    Display means for displaying a ratio of the elapsed time measured by the timer means to the playback duration indicated by the duration information added to the caption text selected by the caption text selection means;
    The video playback device with captions according to any one of claims 1 to 10 .
  12. This subtitled video playback device
    Provided with an audio output means for outputting audio;
    Audio is added to the video,
    The control means includes
    Means for designating the playback speed of the video,
    When the reproduction speed is a predetermined reference speed, the sound is output, and when the reproduction speed is faster than the predetermined reference speed, the sound output unit is controlled so as not to output the sound.
    The video playback device with captions according to any one of claims 1 to 11 , wherein the video playback device has captions.
  13. A subtitle sentence selection step of selecting any subtitle sentence from among a plurality of subtitle signals defining a plurality of subtitle sentences and a plurality of video signals defining a video associated with the subtitle sentence;
    A subtitle sentence reproduction step of reproducing a subtitle sentence from the subtitle sentence selected in the subtitle sentence selection step according to the reproduction order;
    A video playback step of playing back video corresponding to the subtitle text being played back in the subtitle text playback step;
    A determination step of measuring an elapsed time from the start of subtitle sentence reproduction in the subtitle sentence reproduction step and determining that a predetermined time has elapsed;
    A control step for controlling to reproduce a subtitle sentence in a predetermined reproduction order when it is determined that a predetermined time has elapsed in the determination step;
    A playback speed selection step of selecting one playback speed from a plurality of playback speeds;
    A video playback step of playing back the video at the speed selected in the playback speed selection step,
    The control step switches subtitle sentences at time intervals corresponding to the playback speed selected in the playback speed selection step,
    The determining step corrects the predetermined time based on the reproduction speed selected in the reproduction speed selection step,
    The control step is added to the subtitle sentence selected in the subtitle sentence selection step among the reproduction duration information indicating the reproduction duration time for continuously reproducing the subtitle sentence added in advance to each subtitle sentence . The time interval for switching the subtitle sentence is determined based on the playback duration information, and the playback speed corresponding to the determined time interval is associated with a plurality of subtitle sentence switching time intervals during playback and the video playback speeds. Based on the information
    The playback speed selection step selects the playback speed determined in the control step.
    A video playback method with subtitles.
  14. On the computer,
    A storage step of storing a plurality of subtitle sentences and a plurality of videos in association with each other based on the reproduction order;
    A subtitle sentence selection step of selecting any subtitle sentence from a plurality of subtitle sentences stored in the storage step;
    A subtitle sentence reproduction step of reproducing the subtitle sentence according to the reproduction order from the subtitle sentence selected in the subtitle sentence selection step;
    A video playback step of playing back a video corresponding to the subtitle text being played back in the subtitle text playback step;
    A determination step of measuring an elapsed time from the start of reproduction of the subtitle sentence in the subtitle sentence reproduction step and determining that a predetermined time has elapsed;
    A control step for controlling to reproduce a subtitle sentence in a predetermined reproduction order when it is determined that a predetermined time has elapsed in the determination step;
    A playback speed selection step for selecting one playback speed from a plurality of playback speeds;
    Executing a video playback step of playing back video at a speed selected in the playback speed selection step;
    The control step switches subtitle sentences at time intervals corresponding to the playback speed selected in the playback speed selection step,
    The determining step corrects the predetermined time based on the reproduction speed selected in the reproduction speed selection step,
    The control step is added to the subtitle sentence selected in the subtitle sentence selection step among the reproduction duration information indicating the reproduction duration time for continuously reproducing the subtitle sentence added in advance to each subtitle sentence . The time interval for switching the subtitle sentence is determined based on the playback duration information, and the playback speed corresponding to the determined time interval is associated with a plurality of subtitle sentence switching time intervals during playback and the video playback speeds. Based on the information
    The playback speed selection step selects the playback speed determined in the control step.
    A program characterized by that.
JP2007317619A 2007-12-07 2007-12-07 Subtitled video playback apparatus and method, and program Expired - Fee Related JP4839488B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2007317619A JP4839488B2 (en) 2007-12-07 2007-12-07 Subtitled video playback apparatus and method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2007317619A JP4839488B2 (en) 2007-12-07 2007-12-07 Subtitled video playback apparatus and method, and program
JP2011181024A JP5310808B2 (en) 2007-12-07 2011-08-22 Subtitled video playback device and subtitled video playback program

Publications (2)

Publication Number Publication Date
JP2009141810A JP2009141810A (en) 2009-06-25
JP4839488B2 true JP4839488B2 (en) 2011-12-21

Family

ID=40871944

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2007317619A Expired - Fee Related JP4839488B2 (en) 2007-12-07 2007-12-07 Subtitled video playback apparatus and method, and program
JP2011181024A Expired - Fee Related JP5310808B2 (en) 2007-12-07 2011-08-22 Subtitled video playback device and subtitled video playback program

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2011181024A Expired - Fee Related JP5310808B2 (en) 2007-12-07 2011-08-22 Subtitled video playback device and subtitled video playback program

Country Status (1)

Country Link
JP (2) JP4839488B2 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ZA9708537B (en) 1996-09-23 1998-05-12 Focal Inc Polymerizable biodegradable polymers including carbonate or dioxanone linkages.
US20120047437A1 (en) * 2010-08-23 2012-02-23 Jeffrey Chan Method for Creating and Navigating Link Based Multimedia
JP5765593B2 (en) 2012-12-20 2015-08-19 カシオ計算機株式会社 Movie playback device, movie playback method, movie playback program, movie playback control device, movie playback control method, and movie playback control program
JP5765592B2 (en) * 2012-12-20 2015-08-19 カシオ計算機株式会社 Movie playback device, movie playback method, movie playback program, movie playback control device, movie playback control method, and movie playback control program
CN111314775A (en) * 2018-12-12 2020-06-19 华为终端有限公司 Video splitting method and electronic equipment

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3485111B2 (en) * 1992-09-22 2004-01-13 ソニー株式会社 Reproduction method and reproduction device
JPH11184867A (en) * 1997-12-19 1999-07-09 Toshiba Corp Video information retrieval/reproduction method/device and record medium programming and recording the method
JP2001186446A (en) * 1999-12-24 2001-07-06 Toshiba Corp Information reproducing device and information reproducing method
JP2001268464A (en) * 2000-03-17 2001-09-28 Sanyo Electric Co Ltd Digital television broadcast receiver
JP2001285812A (en) * 2000-03-29 2001-10-12 Sanyo Electric Co Ltd Broadcast receiver
JP4172904B2 (en) * 2000-08-10 2008-10-29 日本放送協会 Video / voice search device
JP2003018491A (en) * 2001-07-04 2003-01-17 Sony Corp Caption display device and method
JP2003174495A (en) * 2001-09-28 2003-06-20 Nec Corp Folding portable information terminal
JP2004080476A (en) * 2002-08-20 2004-03-11 Sanyo Electric Co Ltd Digital video reproducing device
JP4177691B2 (en) * 2003-03-19 2008-11-05 シャープ株式会社 Digital data playback device
JP4170808B2 (en) * 2003-03-31 2008-10-22 株式会社東芝 Information display device, information display method, and program
JP2006238147A (en) * 2005-02-25 2006-09-07 Toshiba Corp Content reproducing device, subtitle reproducing method, and program
JP2007243842A (en) * 2006-03-10 2007-09-20 Sanyo Electric Co Ltd Information reproducing apparatus and information reproducing method
JP2007316613A (en) * 2006-04-26 2007-12-06 Matsushita Electric Ind Co Ltd Caption display control apparatus
JP2007318369A (en) * 2006-05-25 2007-12-06 Hitachi Ltd Portable video reproducing device

Also Published As

Publication number Publication date
JP5310808B2 (en) 2013-10-09
JP2009141810A (en) 2009-06-25
JP2011244487A (en) 2011-12-01

Similar Documents

Publication Publication Date Title
JP4843872B2 (en) Television receiver
KR100456024B1 (en) An apparatus and method of subtitle play in digital versatile disk player
KR100388007B1 (en) Transmission apparatus and transmission method, reception apparatus and reception method, broadcasting system and broadcasting method
JP4492462B2 (en) Electronic device, video processing apparatus, and video processing method
JP5057918B2 (en) Electronic device and scene type display method
EP2271089B1 (en) Apparatus and method for simultaneously utilizing audio visual data
JP3897774B2 (en) Multimedia playback apparatus and menu screen display method
JP3954653B2 (en) Broadcast receiving apparatus, broadcast receiving method, and recording medium containing the method using selective navigation information selected with transport stream
EP1628478B1 (en) Multimedia playback device and playback method
JP4834640B2 (en) Electronic device and image display control method
US7830570B2 (en) Device and method for edition of moving picture data
KR100608074B1 (en) Method for reproducing storage medium storing interactive graphics stream activated by user's demand
JP4170808B2 (en) Information display device, information display method, and program
JP4349277B2 (en) Movie playback device
JP5757080B2 (en) Operation terminal device, display device, and operation method of display device
KR100438703B1 (en) Method for indexing image hierarchically and apparatus thereof
KR101146926B1 (en) Method Of Providing Key Frames Of Video In Mobile Terminal
KR101148712B1 (en) Remote control system and apparatus used in the remote control system
EP2209311A1 (en) Electronic device, reproduction method and program
EP0656727A1 (en) Teletext receiver
US20050144637A1 (en) Signal output method and channel selecting apparatus
US8989551B2 (en) Captioned video playback apparatus and recording medium
JPWO2011111321A1 (en) Voice reading apparatus and voice reading method
EP1347455A2 (en) Contents recording/playback apparatus and contents edit method
JP4192476B2 (en) Video conversion apparatus and video conversion method

Legal Events

Date Code Title Description
A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A712

Effective date: 20100805

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20110224

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20110308

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110509

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20110621

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110822

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20110906

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20110916

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20141014

Year of fee payment: 3

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20141014

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20141014

Year of fee payment: 3

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

LAPS Cancellation because of no payment of annual fees